2023-12-16T02:53:14.085 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T02:53:14.085 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523 --owner scheduled_yuriw@teuthology --name yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523/orig.config.yaml 2023-12-16T02:53:14.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:53:14.224 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523 branch: main description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: yweinste@redhat.com first_in_suite: false job_id: '7493523' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5996 sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 targets: smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJNmUeTk7cvV4/hBxeHJHabAwqQSG/0I544i8eBAl8M8nQqLVbUMWirq2BjY8t1iG9Ms03YbUrUpnxQ7Z02tp/I= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRIjktrYHU73h4pCJsuSjrdVTHmQyG9O7D3ilqeIBoQiqLa6lFF37s12hE2RUfcD/NqcbajAFkh5mNiotN/c9s= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-16_00:09:48 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-16T02:53:14.224 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa; will attempt to use it 2023-12-16T02:53:14.225 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks 2023-12-16T02:53:14.225 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-16T02:53:14.226 INFO:teuthology.task.internal:Checking packages... 2023-12-16T02:53:14.248 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6d933094a156ec7587742e5aa25fba5ba27ec678' 2023-12-16T02:53:14.248 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T02:53:14.248 INFO:teuthology.packaging:ref: None 2023-12-16T02:53:14.248 INFO:teuthology.packaging:tag: None 2023-12-16T02:53:14.248 INFO:teuthology.packaging:branch: main 2023-12-16T02:53:14.249 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T02:53:14.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-12-16T02:53:14.587 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-196.g85fe3c65 2023-12-16T02:53:14.588 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-16T02:53:14.599 INFO:teuthology.task.internal:no buildpackages task found 2023-12-16T02:53:14.600 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-16T02:53:14.620 INFO:teuthology.task.internal:Saving configuration 2023-12-16T02:53:14.641 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-16T02:53:14.652 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T02:53:14.674 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 02:48:06.760530', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJNmUeTk7cvV4/hBxeHJHabAwqQSG/0I544i8eBAl8M8nQqLVbUMWirq2BjY8t1iG9Ms03YbUrUpnxQ7Z02tp/I='} 2023-12-16T02:53:14.689 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 02:48:06.758803', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRIjktrYHU73h4pCJsuSjrdVTHmQyG9O7D3ilqeIBoQiqLa6lFF37s12hE2RUfcD/NqcbajAFkh5mNiotN/c9s='} 2023-12-16T02:53:14.690 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-16T02:53:14.701 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-16T02:53:14.701 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-16T02:53:14.701 INFO:teuthology.run_tasks:Running task console_log... 2023-12-16T02:53:14.771 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f81115fce50>, signals=[15]) 2023-12-16T02:53:14.771 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-16T02:53:14.782 INFO:teuthology.task.internal:Opening connections... 2023-12-16T02:53:14.783 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T02:53:14.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T02:53:14.855 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-12-16T02:53:14.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T02:53:14.925 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-16T02:53:14.935 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-12-16T02:53:14.958 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-12-16T02:53:14.959 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-12-16T02:53:15.021 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-12-16T02:53:15.021 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2023-12-16T02:53:15.021 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-12-16T02:53:15.021 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-12-16T02:53:15.021 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2023-12-16T02:53:15.021 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-12-16T02:53:15.021 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T02:53:15.021 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-12-16T02:53:15.021 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T02:53:15.022 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-12-16T02:53:15.022 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T02:53:15.022 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T02:53:15.022 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T02:53:15.022 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-12-16T02:53:15.043 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-12-16T02:53:15.066 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-12-16T02:53:15.066 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-12-16T02:53:15.128 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-12-16T02:53:15.128 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8" 2023-12-16T02:53:15.128 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-12-16T02:53:15.128 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-12-16T02:53:15.128 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8" 2023-12-16T02:53:15.128 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-12-16T02:53:15.129 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T02:53:15.129 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-12-16T02:53:15.129 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T02:53:15.129 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-12-16T02:53:15.129 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T02:53:15.129 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T02:53:15.129 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T02:53:15.129 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-12-16T02:53:15.151 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-16T02:53:15.161 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-16T02:53:15.174 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-16T02:53:15.174 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2023-12-16T02:53:15.176 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-12-16T02:53:15.197 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-16T02:53:15.206 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-16T02:53:15.206 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2023-12-16T02:53:15.239 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-12-16T02:53:15.277 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-16T02:53:15.332 INFO:teuthology.run_tasks:Running task kernel... 2023-12-16T02:53:15.348 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-16T02:53:15.348 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-16T02:53:15.348 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T02:53:15.349 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T02:53:15.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T02:53:15.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T02:53:15.371 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-12-16T02:53:15.372 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2023-12-16T02:53:15.433 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-489.el8.x86_64 2023-12-16T02:53:15.433 INFO:teuthology.task.kernel:Running kernel on smithi184: 4.18.0-489.el8.x86_64 2023-12-16T02:53:15.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2023-12-16T02:53:15.434 INFO:teuthology.orchestra.run.smithi064.stdout:4.18.0-489.el8.x86_64 2023-12-16T02:53:15.434 INFO:teuthology.task.kernel:Running kernel on smithi064: 4.18.0-489.el8.x86_64 2023-12-16T02:53:15.434 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum install -y kernel 2023-12-16T02:53:20.334 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 8 - AppStream 15 MB/s | 35 MB 00:02 2023-12-16T02:53:22.107 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - AppStream 8.5 MB/s | 35 MB 00:04 2023-12-16T02:53:38.292 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 8 - BaseOS 4.9 MB/s | 56 MB 00:11 2023-12-16T02:53:39.655 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - BaseOS 5.0 MB/s | 56 MB 00:11 2023-12-16T02:53:47.141 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-12-16T02:53:47.691 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.9 kB 00:00 2023-12-16T02:53:48.010 INFO:teuthology.orchestra.run.smithi064.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-12-16T02:53:48.030 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-12-16T02:53:48.588 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-12-16T02:53:48.882 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-12-16T02:53:49.841 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-12-16T02:53:50.635 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 16 MB 00:02 2023-12-16T02:53:53.641 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 369 kB/s | 24 kB 00:00 2023-12-16T02:53:54.636 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 424 kB/s | 24 kB 00:00 2023-12-16T02:53:57.282 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-16T02:53:57.283 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-16T02:53:57.570 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T02:53:57.570 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T02:53:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: kernel x86_64 4.18.0-527.el8 baseos 10 M 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core x86_64 4.18.0-527.el8 baseos 43 M 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules x86_64 4.18.0-527.el8 baseos 36 M 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout:Install 3 Packages 2023-12-16T02:53:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T02:53:57.572 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 90 M 2023-12-16T02:53:57.572 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 96 M 2023-12-16T02:53:57.572 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T02:53:58.794 INFO:teuthology.orchestra.run.smithi064.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-16T02:53:58.794 INFO:teuthology.orchestra.run.smithi064.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-16T02:53:59.094 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: kernel x86_64 4.18.0-527.el8 baseos 10 M 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-core x86_64 4.18.0-527.el8 baseos 43 M 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules x86_64 4.18.0-527.el8 baseos 36 M 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T02:53:59.095 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T02:53:59.096 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T02:53:59.096 INFO:teuthology.orchestra.run.smithi064.stdout:Install 3 Packages 2023-12-16T02:53:59.096 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T02:53:59.096 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 90 M 2023-12-16T02:53:59.096 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 96 M 2023-12-16T02:53:59.096 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T02:53:59.267 INFO:teuthology.orchestra.run.smithi184.stdout:(1/3): kernel-4.18.0-527.el8.x86_64.rpm 6.7 MB/s | 10 MB 00:01 2023-12-16T02:54:00.660 INFO:teuthology.orchestra.run.smithi064.stdout:(1/3): kernel-4.18.0-527.el8.x86_64.rpm 6.6 MB/s | 10 MB 00:01 2023-12-16T02:54:00.826 INFO:teuthology.orchestra.run.smithi184.stdout:(2/3): kernel-modules-4.18.0-527.el8.x86_64.rpm 12 MB/s | 36 MB 00:03 2023-12-16T02:54:01.643 INFO:teuthology.orchestra.run.smithi184.stdout:(3/3): kernel-core-4.18.0-527.el8.x86_64.rpm 11 MB/s | 43 MB 00:03 2023-12-16T02:54:01.643 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T02:54:01.643 INFO:teuthology.orchestra.run.smithi184.stdout:Total 22 MB/s | 90 MB 00:04 2023-12-16T02:54:02.203 INFO:teuthology.orchestra.run.smithi064.stdout:(2/3): kernel-modules-4.18.0-527.el8.x86_64.rpm 12 MB/s | 36 MB 00:03 2023-12-16T02:54:02.322 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T02:54:02.751 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T02:54:02.751 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T02:54:02.770 INFO:teuthology.orchestra.run.smithi064.stdout:(3/3): kernel-core-4.18.0-527.el8.x86_64.rpm 12 MB/s | 43 MB 00:03 2023-12-16T02:54:02.771 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T02:54:02.771 INFO:teuthology.orchestra.run.smithi064.stdout:Total 24 MB/s | 90 MB 00:03 2023-12-16T02:54:03.474 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T02:54:03.905 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T02:54:03.906 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T02:54:03.992 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T02:54:04.007 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T02:54:05.198 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T02:54:05.226 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T02:54:06.793 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T02:54:07.374 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T02:54:08.179 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T02:54:08.696 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T02:54:10.973 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T02:54:11.323 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T02:54:12.415 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T02:54:12.812 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T02:54:14.748 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T02:54:15.070 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:16.481 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T02:54:16.754 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:36.962 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:36.987 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:37.337 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:37.337 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-4.18.0-527.el8.x86_64 1/3 2023-12-16T02:54:37.337 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-core-4.18.0-527.el8.x86_64 2/3 2023-12-16T02:54:38.109 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:38.109 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T02:54:38.109 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T02:54:38.109 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-4.18.0-527.el8.x86_64 kernel-core-4.18.0-527.el8.x86_64 2023-12-16T02:54:38.109 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-4.18.0-527.el8.x86_64 2023-12-16T02:54:38.109 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T02:54:38.109 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T02:54:38.266 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T02:54:38.482 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T02:54:38.482 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T02:54:38.483 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-527.el8.x86_64 2023-12-16T02:54:38.483 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T02:54:38.483 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T02:54:38.483 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-12-16T02:54:38.483 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T02:54:38.483 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T02:54:38.693 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T02:54:38.693 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T02:54:38.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.02 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 129.el8 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:Group : System Environment/Base 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 9265586 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2023-12-16T02:54:38.727 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:Relocations : (not relocatable) 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : CentOS BuildSystem 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T02:54:38.728 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T02:54:38.729 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2023-12-16T02:54:38.729 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T02:54:38.729 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T02:54:38.729 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T02:54:38.730 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 4.18.0-527.el8.x86_64 2023-12-16T02:54:38.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T02:54:40.103 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:40.128 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:40.239 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-12-16T02:54:40.537 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:40.537 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-4.18.0-527.el8.x86_64 1/3 2023-12-16T02:54:40.537 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-core-4.18.0-527.el8.x86_64 2/3 2023-12-16T02:54:41.348 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T02:54:41.348 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T02:54:41.348 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T02:54:41.348 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-4.18.0-527.el8.x86_64 kernel-core-4.18.0-527.el8.x86_64 2023-12-16T02:54:41.349 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules-4.18.0-527.el8.x86_64 2023-12-16T02:54:41.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T02:54:41.349 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T02:54:41.486 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T02:54:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T02:54:41.710 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T02:54:41.711 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-527.el8.x86_64 2023-12-16T02:54:41.711 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T02:54:41.711 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T02:54:41.711 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-16T02:54:41.711 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi064.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T02:54:41.711 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T02:54:41.929 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T02:54:41.929 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T02:54:41.929 DEBUG:teuthology.orchestra.run.smithi064:> sudo rpm -qi grub2-tools 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:Name : grub2-tools 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:Epoch : 1 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:Version : 2.02 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:Release : 129.el8 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:Architecture: x86_64 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:Group : System Environment/Base 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:Size : 9265586 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:License : GPLv3+ 2023-12-16T02:54:41.964 INFO:teuthology.orchestra.run.smithi064.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:Relocations : (not relocatable) 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:Packager : CentOS BuildSystem 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:Vendor : CentOS 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:Summary : Support tools for GRUB. 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:Description : 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout:hardware devices. 2023-12-16T02:54:41.965 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T02:54:41.966 INFO:teuthology.orchestra.run.smithi064.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T02:54:41.966 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T02:54:41.967 INFO:teuthology.task.kernel:Updating grub on smithi064 to boot 4.18.0-527.el8.x86_64 2023-12-16T02:54:41.967 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T02:54:42.270 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-12-16T02:54:42.271 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-12-16T02:54:42.311 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.zDI7b0BoS1 2023-12-16T02:54:42.311 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zDI7b0BoS1 2023-12-16T02:54:42.386 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.zDI7b0BoS1 2023-12-16T02:54:42.530 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.zDI7b0BoS1 is 6KB 2023-12-16T02:54:42.578 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.zDI7b0BoS1 2023-12-16T02:54:42.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T02:54:42.664 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-16T02:54:42.664 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-16T02:54:42.664 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-16T02:54:42.664 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64.conf 2023-12-16T02:54:42.665 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64 2023-12-16T02:54:42.820 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2023-12-16T02:54:43.694 INFO:teuthology.orchestra.run.smithi064.stderr:Generating grub configuration file ... 2023-12-16T02:54:46.098 INFO:teuthology.orchestra.run.smithi064.stderr:done 2023-12-16T02:54:46.100 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2023-12-16T02:54:46.121 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.jIdteIwMwd 2023-12-16T02:54:46.121 DEBUG:teuthology.orchestra.run.smithi064:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jIdteIwMwd 2023-12-16T02:54:46.194 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.jIdteIwMwd 2023-12-16T02:54:46.334 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.jIdteIwMwd is 6KB 2023-12-16T02:54:46.382 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.jIdteIwMwd 2023-12-16T02:54:46.400 DEBUG:teuthology.orchestra.run.smithi064:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T02:54:46.476 INFO:teuthology.orchestra.run.smithi064.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-16T02:54:46.476 INFO:teuthology.orchestra.run.smithi064.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-16T02:54:46.476 INFO:teuthology.orchestra.run.smithi064.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-16T02:54:46.476 INFO:teuthology.orchestra.run.smithi064.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64.conf 2023-12-16T02:54:46.477 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64 2023-12-16T02:54:46.629 DEBUG:teuthology.orchestra.run.smithi064:> sudo shutdown -r now 2023-12-16T02:55:12.829 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-16T02:55:12.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-16T02:55:12.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T02:55:16.635 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-16T02:55:16.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-16T02:55:16.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T02:55:31.350 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-16T02:55:35.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-16T02:55:40.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-16T02:55:40.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T02:55:43.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-16T02:55:44.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-16T02:55:44.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T02:55:47.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-16T02:55:55.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-16T02:55:55.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T02:55:59.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-16T02:55:59.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T02:56:17.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-12-16T02:56:27.324 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-12-16T02:56:28.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-16T02:56:28.059 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-527.el8.x86_64"... 2023-12-16T02:56:28.059 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-12-16T02:56:28.482 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-527.el8.x86_64 2023-12-16T02:56:28.482 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-527.el8.x86_64 vs 4.18.0-527.el8.x86_64 2023-12-16T02:56:28.482 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T02:56:28.483 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T02:56:29.484 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-16T02:56:29.484 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T02:56:29.542 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2023-12-16T02:56:29.566 DEBUG:teuthology.parallel:result is None 2023-12-16T02:56:32.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-16T02:56:32.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T02:56:33.049 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-12-16T02:56:33.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-16T02:56:33.327 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-527.el8.x86_64"... 2023-12-16T02:56:33.327 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2023-12-16T02:56:33.345 INFO:teuthology.orchestra.run.smithi064.stdout:4.18.0-527.el8.x86_64 2023-12-16T02:56:33.345 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-527.el8.x86_64 vs 4.18.0-527.el8.x86_64 2023-12-16T02:56:33.345 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T02:56:33.345 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T02:56:34.346 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-16T02:56:34.346 DEBUG:teuthology.orchestra.run.smithi064:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T02:56:34.515 INFO:teuthology.orchestra.run.smithi064.stdout:ttyS1 2023-12-16T02:56:34.530 DEBUG:teuthology.parallel:result is None 2023-12-16T02:56:34.530 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-16T02:56:34.537 INFO:teuthology.task.internal:Creating test directory... 2023-12-16T02:56:34.537 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T02:56:34.542 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T02:56:34.566 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-16T02:56:34.573 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-16T02:56:34.580 INFO:teuthology.task.internal:Creating archive directory... 2023-12-16T02:56:34.581 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T02:56:34.600 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T02:56:34.666 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-16T02:56:34.673 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-16T02:56:34.673 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T02:56:34.687 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T02:56:34.729 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T02:56:34.741 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T02:56:35.218 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T02:56:35.345 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T02:56:35.357 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-16T02:56:35.365 INFO:teuthology.task.internal:Configuring sudo... 2023-12-16T02:56:35.365 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T02:56:35.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T02:56:35.653 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-16T02:56:35.662 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-16T02:56:35.663 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T02:56:35.716 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T02:56:36.126 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T02:56:36.288 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T02:56:36.326 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T02:56:36.415 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T02:56:36.456 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T02:56:36.457 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T02:56:36.524 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T02:56:36.567 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T02:56:36.632 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T02:56:36.677 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T02:56:36.729 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T02:56:36.729 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T02:56:36.802 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2023-12-16T02:56:36.804 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-12-16T02:56:36.852 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T02:56:36.931 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T02:56:37.319 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-16T02:56:37.330 INFO:teuthology.task.internal:Starting timer... 2023-12-16T02:56:37.330 INFO:teuthology.run_tasks:Running task pcp... 2023-12-16T02:56:37.341 INFO:teuthology.run_tasks:Running task selinux... 2023-12-16T02:56:37.349 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-16T02:56:37.349 DEBUG:teuthology.orchestra.run.smithi064:> sudo service auditd rotate 2023-12-16T02:56:37.439 INFO:teuthology.orchestra.run.smithi064.stdout:Rotating logs: 2023-12-16T02:56:37.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2023-12-16T02:56:37.551 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2023-12-16T02:56:37.554 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-16T02:56:37.554 DEBUG:teuthology.orchestra.run.smithi064:> /usr/sbin/getenforce 2023-12-16T02:56:37.625 INFO:teuthology.orchestra.run.smithi064.stdout:Permissive 2023-12-16T02:56:37.625 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2023-12-16T02:56:37.676 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2023-12-16T02:56:37.677 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi064.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2023-12-16T02:56:37.677 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T02:56:37.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T02:56:37.706 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T02:56:37.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T02:56:37.740 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-16T02:56:37.740 DEBUG:teuthology.orchestra.run.smithi064:> sudo /usr/sbin/setenforce permissive 2023-12-16T02:56:37.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2023-12-16T02:56:37.814 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-16T02:56:37.825 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-16T02:56:37.830 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-16T02:56:37.942 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-16T02:56:37.958 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-16T02:56:37.959 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi064.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-16T03:04:16.390 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi064.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2023-12-16T03:04:16.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-16T03:04:16.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:04:16.464 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-12-16T03:04:16.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-12-16T03:04:16.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-16T03:04:16.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:04:16.643 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-12-16T03:04:16.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-16T03:04:16.669 INFO:teuthology.run_tasks:Running task clock... 2023-12-16T03:04:16.681 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-16T03:04:16.681 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T03:04:16.681 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:04:16.683 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T03:04:16.683 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:04:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T03:04:16.728 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T03:04:16.741 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T03:04:16.754 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T03:04:16.797 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: ntpd: command not found 2023-12-16T03:04:16.808 INFO:teuthology.orchestra.run.smithi064.stdout:506 Cannot talk to daemon 2023-12-16T03:04:16.823 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T03:04:16.828 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2023-12-16T03:04:16.836 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T03:04:16.838 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2023-12-16T03:04:16.853 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T03:04:16.866 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T03:04:16.913 INFO:teuthology.orchestra.run.smithi064.stderr:bash: ntpq: command not found 2023-12-16T03:04:16.917 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T03:04:16.918 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2023-12-16T03:04:16.918 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:04:16.918 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:04:16.918 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:04:16.918 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:04:16.932 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-12-16T03:04:16.935 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T03:04:16.935 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-12-16T03:04:16.935 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:04:16.935 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:04:16.935 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:04:16.935 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:04:16.936 INFO:teuthology.run_tasks:Running task pexec... 2023-12-16T03:04:16.945 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-16T03:04:16.946 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:04:16.946 DEBUG:teuthology.orchestra.run.smithi064:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-16T03:04:16.946 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi184.front.sepia.ceph.com 2023-12-16T03:04:16.946 DEBUG:teuthology.orchestra.run.smithi184:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-16T03:04:17.847 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:37 ago on Sat 16 Dec 2023 03:02:40 AM UTC. 2023-12-16T03:04:17.864 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:39 ago on Sat 16 Dec 2023 03:02:38 AM UTC. 2023-12-16T03:04:20.016 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:04:20.017 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:04:20.017 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-12-16T03:04:20.017 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:04:20.017 INFO:teuthology.orchestra.run.smithi184.stdout:Resetting modules: 2023-12-16T03:04:20.017 INFO:teuthology.orchestra.run.smithi184.stdout: container-tools 2023-12-16T03:04:20.017 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:04:20.017 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:04:20.017 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:04:20.017 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:04:20.168 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:04:20.169 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:04:20.170 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2023-12-16T03:04:20.170 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:04:20.170 INFO:teuthology.orchestra.run.smithi064.stdout:Resetting modules: 2023-12-16T03:04:20.170 INFO:teuthology.orchestra.run.smithi064.stdout: container-tools 2023-12-16T03:04:20.170 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:04:20.170 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:04:20.170 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:04:20.170 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:04:20.305 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:04:20.428 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:04:21.231 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:41 ago on Sat 16 Dec 2023 03:02:40 AM UTC. 2023-12-16T03:04:21.407 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:43 ago on Sat 16 Dec 2023 03:02:38 AM UTC. 2023-12-16T03:04:23.371 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:04:23.557 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:04:23.557 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout:Installing group/module packages: 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-16T03:04:23.558 INFO:teuthology.orchestra.run.smithi184.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout:Installing module profiles: 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout: container-tools/common 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout:Enabling module streams: 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout: container-tools rhel8 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout:Install 13 Packages 2023-12-16T03:04:23.559 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:04:23.560 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 27 M 2023-12-16T03:04:23.560 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 89 M 2023-12-16T03:04:23.560 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:04:23.677 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout:Installing group/module packages: 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-16T03:04:23.878 INFO:teuthology.orchestra.run.smithi064.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout:Installing weak dependencies: 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout:Installing module profiles: 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout: container-tools/common 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout:Enabling module streams: 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout: container-tools rhel8 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:04:23.879 INFO:teuthology.orchestra.run.smithi064.stdout:Install 13 Packages 2023-12-16T03:04:23.880 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:04:23.880 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 27 M 2023-12-16T03:04:23.880 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 89 M 2023-12-16T03:04:23.880 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:04:23.962 INFO:teuthology.orchestra.run.smithi184.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 3.5 MB/s | 750 kB 00:00 2023-12-16T03:04:23.996 INFO:teuthology.orchestra.run.smithi184.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 4.1 MB/s | 1.0 MB 00:00 2023-12-16T03:04:24.046 INFO:teuthology.orchestra.run.smithi184.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 455 kB/s | 38 kB 00:00 2023-12-16T03:04:24.146 INFO:teuthology.orchestra.run.smithi184.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 1.6 MB/s | 241 kB 00:00 2023-12-16T03:04:24.380 INFO:teuthology.orchestra.run.smithi184.stdout:(5/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 15 MB/s | 9.6 MB 00:00 2023-12-16T03:04:24.405 INFO:teuthology.orchestra.run.smithi184.stdout:(6/13): python3-podman-4.7.0-1.module_el8+712+4 687 kB/s | 178 kB 00:00 2023-12-16T03:04:24.421 INFO:teuthology.orchestra.run.smithi064.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 2.1 MB/s | 750 kB 00:00 2023-12-16T03:04:24.464 INFO:teuthology.orchestra.run.smithi064.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 2.6 MB/s | 1.0 MB 00:00 2023-12-16T03:04:24.472 INFO:teuthology.orchestra.run.smithi184.stdout:(7/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 9.2 MB/s | 3.9 MB 00:00 2023-12-16T03:04:24.489 INFO:teuthology.orchestra.run.smithi184.stdout:(8/13): python3-pytoml-0.1.14-5.git7dea353.el8. 228 kB/s | 25 kB 00:00 2023-12-16T03:04:24.506 INFO:teuthology.orchestra.run.smithi184.stdout:(9/13): python3-pyxdg-0.25-16.el8.noarch.rpm 932 kB/s | 94 kB 00:00 2023-12-16T03:04:24.506 INFO:teuthology.orchestra.run.smithi064.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 442 kB/s | 38 kB 00:00 2023-12-16T03:04:24.598 INFO:teuthology.orchestra.run.smithi064.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 1.8 MB/s | 241 kB 00:00 2023-12-16T03:04:24.626 INFO:teuthology.orchestra.run.smithi184.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 439 kB/s | 53 kB 00:00 2023-12-16T03:04:24.765 INFO:teuthology.orchestra.run.smithi184.stdout:(11/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 9.2 MB/s | 2.5 MB 00:00 2023-12-16T03:04:24.774 INFO:teuthology.orchestra.run.smithi064.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 1.0 MB/s | 178 kB 00:00 2023-12-16T03:04:24.782 INFO:teuthology.orchestra.run.smithi184.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 263 kB/s | 41 kB 00:00 2023-12-16T03:04:24.874 INFO:teuthology.orchestra.run.smithi064.stdout:(6/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 11 MB/s | 3.9 MB 00:00 2023-12-16T03:04:24.899 INFO:teuthology.orchestra.run.smithi064.stdout:(7/13): python3-pytoml-0.1.14-5.git7dea353.el8. 197 kB/s | 25 kB 00:00 2023-12-16T03:04:25.016 INFO:teuthology.orchestra.run.smithi184.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 15 MB/s | 8.1 MB 00:00 2023-12-16T03:04:25.016 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:04:25.016 INFO:teuthology.orchestra.run.smithi184.stdout:Total 18 MB/s | 27 MB 00:01 2023-12-16T03:04:25.058 INFO:teuthology.orchestra.run.smithi064.stdout:(8/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 9.8 MB/s | 9.6 MB 00:00 2023-12-16T03:04:25.083 INFO:teuthology.orchestra.run.smithi064.stdout:(9/13): python3-pyxdg-0.25-16.el8.noarch.rpm 450 kB/s | 94 kB 00:00 2023-12-16T03:04:25.175 INFO:teuthology.orchestra.run.smithi064.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 573 kB/s | 53 kB 00:00 2023-12-16T03:04:25.259 INFO:teuthology.orchestra.run.smithi064.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 492 kB/s | 41 kB 00:00 2023-12-16T03:04:25.282 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:04:25.303 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:04:25.303 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:04:25.326 INFO:teuthology.orchestra.run.smithi064.stdout:(12/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 9.5 MB/s | 2.5 MB 00:00 2023-12-16T03:04:25.418 INFO:teuthology.orchestra.run.smithi064.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 16 MB/s | 8.1 MB 00:00 2023-12-16T03:04:25.418 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:04:25.418 INFO:teuthology.orchestra.run.smithi064.stdout:Total 17 MB/s | 27 MB 00:01 2023-12-16T03:04:25.562 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:04:25.563 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:04:25.693 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:04:25.716 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:04:25.716 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:04:25.999 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:04:26.003 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:04:26.277 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:04:26.475 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-16T03:04:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-16T03:04:26.679 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:04:26.868 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-16T03:04:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-16T03:04:27.070 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-16T03:04:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T03:04:27.292 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-16T03:04:27.553 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T03:04:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-16T03:04:28.122 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-16T03:04:28.618 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T03:04:29.012 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-16T03:04:29.148 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T03:04:29.246 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-16T03:04:29.360 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-16T03:04:29.499 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-16T03:04:29.584 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-16T03:04:29.833 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-16T03:04:29.924 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-16T03:04:30.237 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-16T03:04:30.805 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T03:04:31.018 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-16T03:04:31.158 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T03:04:31.202 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T03:04:31.369 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-16T03:04:31.578 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T03:04:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T03:04:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-16T03:04:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-16T03:04:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-16T03:04:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T03:04:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-16T03:04:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T03:04:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-16T03:04:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-16T03:04:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-16T03:04:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-16T03:04:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T03:04:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-16T03:04:32.036 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T03:04:32.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-16T03:04:32.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-16T03:04:32.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-16T03:04:32.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T03:04:32.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-16T03:04:32.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T03:04:32.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-16T03:04:32.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-16T03:04:32.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-16T03:04:32.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-16T03:04:32.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T03:04:32.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-16T03:04:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-16T03:04:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-16T03:04:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-16T03:04:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-16T03:04:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:04:32.564 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:04:32.834 DEBUG:teuthology.parallel:result is None 2023-12-16T03:04:32.904 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-16T03:04:32.904 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:04:32.904 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:04:32.904 INFO:teuthology.orchestra.run.smithi064.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.904 INFO:teuthology.orchestra.run.smithi064.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.904 INFO:teuthology.orchestra.run.smithi064.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-16T03:04:32.904 INFO:teuthology.orchestra.run.smithi064.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-16T03:04:32.904 INFO:teuthology.orchestra.run.smithi064.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:04:32.905 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:04:33.207 DEBUG:teuthology.parallel:result is None 2023-12-16T03:04:33.207 INFO:teuthology.run_tasks:Running task install... 2023-12-16T03:04:33.216 DEBUG:teuthology.task.install:project ceph 2023-12-16T03:04:33.216 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}} 2023-12-16T03:04:33.217 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'} 2023-12-16T03:04:33.217 INFO:teuthology.task.install:Using flavor: default 2023-12-16T03:04:33.222 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-16T03:04:33.223 INFO:teuthology.task.install:extra packages: [] 2023-12-16T03:04:33.223 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'tag': None, 'wait_for_package': False} 2023-12-16T03:04:33.223 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T03:04:33.223 INFO:teuthology.packaging:ref: None 2023-12-16T03:04:33.223 INFO:teuthology.packaging:tag: None 2023-12-16T03:04:33.223 INFO:teuthology.packaging:branch: quincy 2023-12-16T03:04:33.223 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:04:33.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T03:04:33.226 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'tag': None, 'wait_for_package': False} 2023-12-16T03:04:33.226 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T03:04:33.226 INFO:teuthology.packaging:ref: None 2023-12-16T03:04:33.226 INFO:teuthology.packaging:tag: None 2023-12-16T03:04:33.226 INFO:teuthology.packaging:branch: quincy 2023-12-16T03:04:33.226 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:04:33.226 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T03:04:33.457 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/ 2023-12-16T03:04:33.457 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-16T03:04:33.468 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/ 2023-12-16T03:04:33.468 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-16T03:04:33.740 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T03:04:33.741 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:04:33.741 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T03:04:33.771 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T03:04:33.771 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:04:33.771 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T03:04:33.775 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T03:04:33.775 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T03:04:33.775 INFO:teuthology.packaging:ref: None 2023-12-16T03:04:33.775 INFO:teuthology.packaging:tag: None 2023-12-16T03:04:33.775 INFO:teuthology.packaging:branch: quincy 2023-12-16T03:04:33.775 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:04:33.775 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T03:04:33.803 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T03:04:33.803 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T03:04:33.803 INFO:teuthology.packaging:ref: None 2023-12-16T03:04:33.803 INFO:teuthology.packaging:tag: None 2023-12-16T03:04:33.803 INFO:teuthology.packaging:branch: quincy 2023-12-16T03:04:33.803 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:04:33.803 DEBUG:teuthology.orchestra.run.smithi064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T03:04:33.847 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T03:04:33.874 DEBUG:teuthology.orchestra.run.smithi064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T03:04:33.927 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T03:04:33.956 DEBUG:teuthology.orchestra.run.smithi064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T03:04:33.995 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2023-12-16T03:04:33.996 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2023-12-16T03:04:34.025 INFO:teuthology.orchestra.run.smithi064.stdout:check_obsoletes = 1 2023-12-16T03:04:34.026 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum clean all 2023-12-16T03:04:34.264 INFO:teuthology.orchestra.run.smithi184.stdout:76 files removed 2023-12-16T03:04:34.292 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw 2023-12-16T03:04:34.306 INFO:teuthology.orchestra.run.smithi064.stdout:76 files removed 2023-12-16T03:04:34.335 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-radosgw 2023-12-16T03:04:35.152 INFO:teuthology.orchestra.run.smithi064.stdout:ceph packages for x86_64 201 kB/s | 78 kB 00:00 2023-12-16T03:04:35.156 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 170 kB/s | 78 kB 00:00 2023-12-16T03:04:35.670 INFO:teuthology.orchestra.run.smithi064.stdout:ceph noarch packages 19 kB/s | 9.1 kB 00:00 2023-12-16T03:04:35.681 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 19 kB/s | 9.1 kB 00:00 2023-12-16T03:04:36.154 INFO:teuthology.orchestra.run.smithi064.stdout:ceph source packages 3.2 kB/s | 1.5 kB 00:00 2023-12-16T03:04:36.241 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 2.7 kB/s | 1.5 kB 00:00 2023-12-16T03:04:37.754 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 8 - AppStream 22 MB/s | 35 MB 00:01 2023-12-16T03:04:38.041 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - AppStream 19 MB/s | 35 MB 00:01 2023-12-16T03:04:53.063 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 8 - BaseOS 6.6 MB/s | 56 MB 00:08 2023-12-16T03:04:55.515 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - BaseOS 5.0 MB/s | 56 MB 00:11 2023-12-16T03:05:01.946 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2023-12-16T03:05:02.746 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.9 kB 00:00 2023-12-16T03:05:03.931 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-12-16T03:05:04.451 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 8 - PowerTools 4.3 MB/s | 6.6 MB 00:01 2023-12-16T03:05:04.508 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-12-16T03:05:05.878 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - PowerTools 5.4 MB/s | 6.6 MB 00:01 2023-12-16T03:05:05.983 INFO:teuthology.orchestra.run.smithi064.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-12-16T03:05:07.101 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-12-16T03:05:07.302 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 32 kB/s | 3.5 kB 00:00 2023-12-16T03:05:08.703 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-12-16T03:05:11.210 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 415 kB/s | 24 kB 00:00 2023-12-16T03:05:12.628 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 421 kB/s | 24 kB 00:00 2023-12-16T03:05:16.079 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.6 M 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.2 M 2023-12-16T03:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 23 M 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 24 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 796 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 509 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.6 M 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 45 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 115 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 190 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-16T03:05:16.083 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 371 k 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 359 k 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 106 k 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout:Install 21 Packages 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 2 Packages 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:05:16.084 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 64 M 2023-12-16T03:05:16.085 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:05:16.852 INFO:teuthology.orchestra.run.smithi064.stdout:(1/23): ceph-base-17.2.7-125.g1f2f5510.el8.x86_ 8.0 MB/s | 5.2 MB 00:00 2023-12-16T03:05:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:(2/23): ceph-selinux-17.2.7-125.g1f2f5510.el8.x 266 kB/s | 24 kB 00:00 2023-12-16T03:05:17.045 INFO:teuthology.orchestra.run.smithi064.stdout:(3/23): libcephfs2-17.2.7-125.g1f2f5510.el8.x86 7.8 MB/s | 796 kB 00:00 2023-12-16T03:05:17.145 INFO:teuthology.orchestra.run.smithi064.stdout:(4/23): libradosstriper1-17.2.7-125.g1f2f5510.e 5.0 MB/s | 509 kB 00:00 2023-12-16T03:05:17.221 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:05:17.223 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.6 M 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.2 M 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 23 M 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 24 k 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 796 k 2023-12-16T03:05:17.224 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 509 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.6 M 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 45 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 115 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 190 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 371 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 359 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 106 k 2023-12-16T03:05:17.225 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-16T03:05:17.226 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:05:17.226 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:05:17.226 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:05:17.226 INFO:teuthology.orchestra.run.smithi184.stdout:Install 21 Packages 2023-12-16T03:05:17.226 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 2 Packages 2023-12-16T03:05:17.226 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:05:17.227 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 64 M 2023-12-16T03:05:17.227 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:05:17.725 INFO:teuthology.orchestra.run.smithi064.stdout:(5/23): librgw2-17.2.7-125.g1f2f5510.el8.x86_64 9.6 MB/s | 5.6 MB 00:00 2023-12-16T03:05:17.804 INFO:teuthology.orchestra.run.smithi064.stdout:(6/23): python3-ceph-argparse-17.2.7-125.g1f2f5 569 kB/s | 45 kB 00:00 2023-12-16T03:05:18.004 INFO:teuthology.orchestra.run.smithi064.stdout:(7/23): ceph-radosgw-17.2.7-125.g1f2f5510.el8.x 9.3 MB/s | 17 MB 00:01 2023-12-16T03:05:18.029 INFO:teuthology.orchestra.run.smithi064.stdout:(8/23): python3-ceph-common-17.2.7-125.g1f2f551 513 kB/s | 115 kB 00:00 2023-12-16T03:05:18.095 INFO:teuthology.orchestra.run.smithi064.stdout:(9/23): python3-cephfs-17.2.7-125.g1f2f5510.el8 2.1 MB/s | 190 kB 00:00 2023-12-16T03:05:18.130 INFO:teuthology.orchestra.run.smithi064.stdout:(10/23): python3-rados-17.2.7-125.g1f2f5510.el8 3.6 MB/s | 371 kB 00:00 2023-12-16T03:05:18.155 INFO:teuthology.orchestra.run.smithi064.stdout:(11/23): python3-rbd-17.2.7-125.g1f2f5510.el8.x 5.8 MB/s | 359 kB 00:00 2023-12-16T03:05:18.189 INFO:teuthology.orchestra.run.smithi064.stdout:(12/23): python3-rgw-17.2.7-125.g1f2f5510.el8.x 1.8 MB/s | 106 kB 00:00 2023-12-16T03:05:18.356 INFO:teuthology.orchestra.run.smithi064.stdout:(13/23): librdkafka-1.6.1-1.el8.x86_64.rpm 3.3 MB/s | 677 kB 00:00 2023-12-16T03:05:18.381 INFO:teuthology.orchestra.run.smithi064.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-12-16T03:05:18.465 INFO:teuthology.orchestra.run.smithi064.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 404 kB/s | 44 kB 00:00 2023-12-16T03:05:18.699 INFO:teuthology.orchestra.run.smithi064.stdout:(16/23): ceph-common-17.2.7-125.g1f2f5510.el8.x 9.4 MB/s | 23 MB 00:02 2023-12-16T03:05:18.724 INFO:teuthology.orchestra.run.smithi064.stdout:(17/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 137 kB/s | 47 kB 00:00 2023-12-16T03:05:19.033 INFO:teuthology.orchestra.run.smithi064.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 176 kB/s | 59 kB 00:00 2023-12-16T03:05:19.083 INFO:teuthology.orchestra.run.smithi064.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 209 kB/s | 75 kB 00:00 2023-12-16T03:05:19.171 INFO:teuthology.orchestra.run.smithi064.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 434 kB/s | 306 kB 00:00 2023-12-16T03:05:19.261 INFO:teuthology.orchestra.run.smithi184.stdout:(1/23): ceph-radosgw-17.2.7-125.g1f2f5510.el8.x 9.5 MB/s | 17 MB 00:01 2023-12-16T03:05:19.346 INFO:teuthology.orchestra.run.smithi184.stdout:(2/23): ceph-selinux-17.2.7-125.g1f2f5510.el8.x 288 kB/s | 24 kB 00:00 2023-12-16T03:05:19.392 INFO:teuthology.orchestra.run.smithi064.stdout:(21/23): librados2-17.2.7-125.g1f2f5510.el8.x86 11 MB/s | 3.5 MB 00:00 2023-12-16T03:05:19.438 INFO:teuthology.orchestra.run.smithi184.stdout:(3/23): libcephfs2-17.2.7-125.g1f2f5510.el8.x86 8.5 MB/s | 796 kB 00:00 2023-12-16T03:05:19.540 INFO:teuthology.orchestra.run.smithi184.stdout:(4/23): libradosstriper1-17.2.7-125.g1f2f5510.e 4.9 MB/s | 509 kB 00:00 2023-12-16T03:05:19.559 INFO:teuthology.orchestra.run.smithi064.stdout:(22/23): thrift-0.13.0-2.el8.x86_64.rpm 3.3 MB/s | 1.7 MB 00:00 2023-12-16T03:05:19.614 INFO:teuthology.orchestra.run.smithi184.stdout:(5/23): ceph-base-17.2.7-125.g1f2f5510.el8.x86_ 2.4 MB/s | 5.2 MB 00:02 2023-12-16T03:05:19.617 INFO:teuthology.orchestra.run.smithi064.stdout:(23/23): librbd1-17.2.7-125.g1f2f5510.el8.x86_6 8.0 MB/s | 3.6 MB 00:00 2023-12-16T03:05:19.619 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:05:19.620 INFO:teuthology.orchestra.run.smithi064.stdout:Total 18 MB/s | 64 MB 00:03 2023-12-16T03:05:19.664 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:05:19.697 INFO:teuthology.orchestra.run.smithi184.stdout:(6/23): python3-ceph-argparse-17.2.7-125.g1f2f5 539 kB/s | 45 kB 00:00 2023-12-16T03:05:19.714 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:05:19.714 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:05:19.811 INFO:teuthology.orchestra.run.smithi184.stdout:(7/23): python3-ceph-common-17.2.7-125.g1f2f551 1.0 MB/s | 115 kB 00:00 2023-12-16T03:05:19.906 INFO:teuthology.orchestra.run.smithi184.stdout:(8/23): librgw2-17.2.7-125.g1f2f5510.el8.x86_64 15 MB/s | 5.6 MB 00:00 2023-12-16T03:05:19.931 INFO:teuthology.orchestra.run.smithi184.stdout:(9/23): python3-cephfs-17.2.7-125.g1f2f5510.el8 1.5 MB/s | 190 kB 00:00 2023-12-16T03:05:19.965 INFO:teuthology.orchestra.run.smithi184.stdout:(10/23): python3-rados-17.2.7-125.g1f2f5510.el8 6.2 MB/s | 371 kB 00:00 2023-12-16T03:05:20.015 INFO:teuthology.orchestra.run.smithi184.stdout:(11/23): python3-rgw-17.2.7-125.g1f2f5510.el8.x 2.1 MB/s | 106 kB 00:00 2023-12-16T03:05:20.040 INFO:teuthology.orchestra.run.smithi184.stdout:(12/23): python3-rbd-17.2.7-125.g1f2f5510.el8.x 3.2 MB/s | 359 kB 00:00 2023-12-16T03:05:20.107 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:05:20.111 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:05:20.207 INFO:teuthology.orchestra.run.smithi184.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.5 MB/s | 259 kB 00:00 2023-12-16T03:05:20.249 INFO:teuthology.orchestra.run.smithi184.stdout:(14/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.8 MB/s | 677 kB 00:00 2023-12-16T03:05:20.308 INFO:teuthology.orchestra.run.smithi184.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 438 kB/s | 44 kB 00:00 2023-12-16T03:05:20.467 INFO:teuthology.orchestra.run.smithi184.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.9 MB/s | 306 kB 00:00 2023-12-16T03:05:20.509 INFO:teuthology.orchestra.run.smithi184.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-12-16T03:05:20.551 INFO:teuthology.orchestra.run.smithi184.stdout:(18/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 156 kB/s | 47 kB 00:00 2023-12-16T03:05:20.576 INFO:teuthology.orchestra.run.smithi184.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-12-16T03:05:20.785 INFO:teuthology.orchestra.run.smithi184.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-12-16T03:05:21.199 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:05:21.269 INFO:teuthology.orchestra.run.smithi184.stdout:(21/23): ceph-common-17.2.7-125.g1f2f5510.el8.x 6.2 MB/s | 23 MB 00:03 2023-12-16T03:05:21.335 INFO:teuthology.orchestra.run.smithi184.stdout:(22/23): librbd1-17.2.7-125.g1f2f5510.el8.x86_6 6.5 MB/s | 3.6 MB 00:00 2023-12-16T03:05:21.394 INFO:teuthology.orchestra.run.smithi184.stdout:(23/23): librados2-17.2.7-125.g1f2f5510.el8.x86 4.2 MB/s | 3.5 MB 00:00 2023-12-16T03:05:21.396 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:05:21.396 INFO:teuthology.orchestra.run.smithi184.stdout:Total 15 MB/s | 64 MB 00:04 2023-12-16T03:05:21.417 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-16T03:05:21.437 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:05:21.483 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:05:21.484 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:05:21.555 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T03:05:21.864 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:05:21.867 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:05:21.961 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T03:05:22.172 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T03:05:22.277 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T03:05:22.517 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T03:05:22.688 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T03:05:22.935 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:05:23.133 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T03:05:23.144 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-16T03:05:23.296 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T03:05:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T03:05:23.530 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T03:05:23.692 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T03:05:23.709 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-16T03:05:23.869 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T03:05:23.934 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-16T03:05:24.019 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T03:05:24.243 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T03:05:24.419 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T03:05:24.611 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-16T03:05:24.746 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T03:05:24.811 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T03:05:24.812 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T03:05:24.992 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 11/25 2023-12-16T03:05:24.994 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T03:05:25.164 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T03:05:25.195 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T03:05:25.382 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-16T03:05:25.391 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T03:05:25.562 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-16T03:05:25.595 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 14/25 2023-12-16T03:05:25.763 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T03:05:25.817 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T03:05:26.041 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-16T03:05:26.213 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-16T03:05:26.242 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-16T03:05:26.385 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T03:05:26.409 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-16T03:05:26.470 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T03:05:26.597 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 19/25 2023-12-16T03:05:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 11/25 2023-12-16T03:05:26.805 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T03:05:26.994 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T03:05:27.197 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 14/25 2023-12-16T03:05:27.352 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T03:05:27.425 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T03:05:27.661 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-16T03:05:27.876 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-16T03:05:28.060 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-16T03:05:28.294 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 19/25 2023-12-16T03:05:29.432 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T03:05:29.671 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T03:05:30.296 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T03:05:30.565 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T03:05:30.709 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T03:05:30.993 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T03:05:31.050 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T03:05:31.235 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T03:05:31.841 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T03:05:32.129 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T03:05:32.243 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T03:05:32.426 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T03:05:50.261 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /sys 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /proc 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /dev 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /run 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /mnt 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /var/tmp 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /home 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /tmp 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /dev 2023-12-16T03:05:50.262 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /run 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-12-16T03:05:51.172 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:05:52.196 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T03:05:52.274 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T03:05:52.274 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T03:05:52.462 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T03:05:52.462 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T03:05:52.909 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T03:05:52.972 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T03:05:52.972 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T03:05:53.145 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T03:05:53.145 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 1/25 2023-12-16T03:05:53.145 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2/25 2023-12-16T03:05:53.145 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T03:05:53.145 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T03:05:53.145 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 7/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 8/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 9/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 11/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-16T03:05:53.146 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-16T03:05:53.147 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-16T03:05:53.147 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-16T03:05:53.147 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-16T03:05:53.147 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T03:05:53.147 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-16T03:05:53.147 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 24/25 2023-12-16T03:05:53.183 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T03:05:53.183 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T03:05:53.847 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T03:05:53.847 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 1/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 7/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 8/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 9/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 11/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-16T03:05:53.848 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-16T03:05:53.849 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-16T03:05:53.849 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-16T03:05:53.849 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-16T03:05:53.849 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-16T03:05:53.849 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-16T03:05:53.849 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T03:05:53.849 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-16T03:05:53.849 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 24/25 2023-12-16T03:05:54.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T03:05:54.437 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:05:54.437 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2023-12-16T03:05:54.437 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.437 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.437 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:05:54.437 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.437 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-16T03:05:54.438 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.439 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.439 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.439 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-16T03:05:54.439 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.439 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.439 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:54.439 INFO:teuthology.orchestra.run.smithi064.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-16T03:05:54.439 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:05:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:05:54.707 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-test 2023-12-16T03:05:55.161 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T03:05:55.161 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:05:55.161 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2023-12-16T03:05:55.161 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.161 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.161 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:05:55.161 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.162 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-16T03:05:55.163 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.163 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.163 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:05:55.163 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-16T03:05:55.163 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:05:55.163 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:05:55.461 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-test 2023-12-16T03:05:55.595 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:00:44 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:05:56.313 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:44 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:05:57.403 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:05:57.404 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:05:57.404 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:05:57.404 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:05:57.404 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 52 M 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 174 k 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout:Install 6 Packages 2023-12-16T03:05:57.405 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:05:57.406 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 53 M 2023-12-16T03:05:57.406 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 234 M 2023-12-16T03:05:57.406 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:05:57.622 INFO:teuthology.orchestra.run.smithi064.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.1 MB/s | 203 kB 00:00 2023-12-16T03:05:57.648 INFO:teuthology.orchestra.run.smithi064.stdout:(2/6): libcephsqlite-17.2.7-125.g1f2f5510.el8.x 864 kB/s | 174 kB 00:00 2023-12-16T03:05:57.881 INFO:teuthology.orchestra.run.smithi064.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 725 kB/s | 187 kB 00:00 2023-12-16T03:05:57.940 INFO:teuthology.orchestra.run.smithi064.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 MB/s | 323 kB 00:00 2023-12-16T03:05:57.973 INFO:teuthology.orchestra.run.smithi064.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 768 kB/s | 71 kB 00:00 2023-12-16T03:05:57.988 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:05:57.989 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 52 M 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 174 k 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:05:57.990 INFO:teuthology.orchestra.run.smithi184.stdout:Install 6 Packages 2023-12-16T03:05:57.991 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:05:57.991 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 53 M 2023-12-16T03:05:57.991 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 234 M 2023-12-16T03:05:57.991 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:05:58.378 INFO:teuthology.orchestra.run.smithi184.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.0 MB/s | 203 kB 00:00 2023-12-16T03:05:58.404 INFO:teuthology.orchestra.run.smithi184.stdout:(2/6): libcephsqlite-17.2.7-125.g1f2f5510.el8.x 785 kB/s | 174 kB 00:00 2023-12-16T03:05:58.504 INFO:teuthology.orchestra.run.smithi184.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2023-12-16T03:05:58.571 INFO:teuthology.orchestra.run.smithi184.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2023-12-16T03:05:58.588 INFO:teuthology.orchestra.run.smithi184.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 846 kB/s | 71 kB 00:00 2023-12-16T03:06:01.382 INFO:teuthology.orchestra.run.smithi064.stdout:(6/6): ceph-test-17.2.7-125.g1f2f5510.el8.x86_6 13 MB/s | 52 MB 00:03 2023-12-16T03:06:01.384 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:01.384 INFO:teuthology.orchestra.run.smithi064.stdout:Total 13 MB/s | 53 MB 00:03 2023-12-16T03:06:01.429 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:06:01.451 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:06:01.452 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:06:01.754 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:06:01.757 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:06:02.261 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:06:02.466 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-16T03:06:02.703 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-16T03:06:02.704 INFO:teuthology.orchestra.run.smithi184.stdout:(6/6): ceph-test-17.2.7-125.g1f2f5510.el8.x86_6 11 MB/s | 52 MB 00:04 2023-12-16T03:06:02.706 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:02.706 INFO:teuthology.orchestra.run.smithi184.stdout:Total 11 MB/s | 53 MB 00:04 2023-12-16T03:06:02.748 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:06:02.768 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:06:02.768 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:06:02.808 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T03:06:02.887 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T03:06:03.055 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:06:03.057 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:06:03.099 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-16T03:06:03.258 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T03:06:03.565 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:06:03.817 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-16T03:06:03.989 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-16T03:06:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T03:06:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T03:06:04.411 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-16T03:06:04.554 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T03:06:08.544 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T03:06:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T03:06:09.093 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T03:06:09.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 1/6 2023-12-16T03:06:09.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2/6 2023-12-16T03:06:09.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-16T03:06:09.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-16T03:06:09.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-16T03:06:09.548 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T03:06:09.836 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T03:06:09.869 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout: jq-1.6-8.el8.x86_64 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:09.870 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:06:10.073 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph 2023-12-16T03:06:10.123 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T03:06:10.124 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 1/6 2023-12-16T03:06:10.124 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2/6 2023-12-16T03:06:10.124 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-16T03:06:10.124 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-16T03:06:10.124 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-16T03:06:10.829 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-16T03:06:10.829 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:10.829 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:06:10.829 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:10.829 INFO:teuthology.orchestra.run.smithi184.stdout: jq-1.6-8.el8.x86_64 2023-12-16T03:06:10.829 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:10.829 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-16T03:06:10.830 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-16T03:06:10.830 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-16T03:06:10.830 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:10.830 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:06:10.949 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:00:59 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:06:11.068 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph 2023-12-16T03:06:11.918 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:59 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:06:12.759 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:06:12.762 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:12.762 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 6.4 k 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 2.3 M 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 1.6 M 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 238 k 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.9 M 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-16T03:06:12.763 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-16T03:06:12.764 INFO:teuthology.orchestra.run.smithi064.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout:Install 32 Packages 2023-12-16T03:06:12.765 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:12.766 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 28 M 2023-12-16T03:06:12.766 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 110 M 2023-12-16T03:06:12.766 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:06:13.227 INFO:teuthology.orchestra.run.smithi064.stdout:(1/32): ceph-17.2.7-125.g1f2f5510.el8.x86_64.rp 34 kB/s | 6.4 kB 00:00 2023-12-16T03:06:13.535 INFO:teuthology.orchestra.run.smithi064.stdout:(2/32): ceph-mgr-17.2.7-125.g1f2f5510.el8.x86_6 3.2 MB/s | 1.6 MB 00:00 2023-12-16T03:06:13.577 INFO:teuthology.orchestra.run.smithi064.stdout:(3/32): ceph-mds-17.2.7-125.g1f2f5510.el8.x86_6 4.3 MB/s | 2.3 MB 00:00 2023-12-16T03:06:13.601 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:06:13.604 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:13.604 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 6.4 k 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 2.3 M 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 1.6 M 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 238 k 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.9 M 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T03:06:13.605 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-16T03:06:13.606 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:06:13.607 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:13.608 INFO:teuthology.orchestra.run.smithi184.stdout:Install 32 Packages 2023-12-16T03:06:13.608 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:13.608 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 28 M 2023-12-16T03:06:13.608 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 110 M 2023-12-16T03:06:13.608 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:06:13.661 INFO:teuthology.orchestra.run.smithi064.stdout:(4/32): ceph-mgr-modules-core-17.2.7-125.g1f2f5 2.8 MB/s | 238 kB 00:00 2023-12-16T03:06:13.795 INFO:teuthology.orchestra.run.smithi064.stdout:(5/32): ceph-mon-17.2.7-125.g1f2f5510.el8.x86_6 6.9 MB/s | 3.9 MB 00:00 2023-12-16T03:06:13.836 INFO:teuthology.orchestra.run.smithi064.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 896 kB/s | 157 kB 00:00 2023-12-16T03:06:13.945 INFO:teuthology.orchestra.run.smithi064.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 258 kB/s | 39 kB 00:00 2023-12-16T03:06:13.972 INFO:teuthology.orchestra.run.smithi064.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 774 kB/s | 103 kB 00:00 2023-12-16T03:06:14.031 INFO:teuthology.orchestra.run.smithi184.stdout:(1/32): ceph-17.2.7-125.g1f2f5510.el8.x86_64.rp 48 kB/s | 6.4 kB 00:00 2023-12-16T03:06:14.046 INFO:teuthology.orchestra.run.smithi064.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 568 kB/s | 57 kB 00:00 2023-12-16T03:06:14.130 INFO:teuthology.orchestra.run.smithi064.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.8 MB/s | 457 kB 00:00 2023-12-16T03:06:14.422 INFO:teuthology.orchestra.run.smithi184.stdout:(2/32): ceph-mds-17.2.7-125.g1f2f5510.el8.x86_6 4.4 MB/s | 2.3 MB 00:00 2023-12-16T03:06:14.490 INFO:teuthology.orchestra.run.smithi184.stdout:(3/32): ceph-mgr-17.2.7-125.g1f2f5510.el8.x86_6 2.7 MB/s | 1.6 MB 00:00 2023-12-16T03:06:14.557 INFO:teuthology.orchestra.run.smithi184.stdout:(4/32): ceph-mgr-modules-core-17.2.7-125.g1f2f5 3.5 MB/s | 238 kB 00:00 2023-12-16T03:06:14.638 INFO:teuthology.orchestra.run.smithi064.stdout:(11/32): ceph-osd-17.2.7-125.g1f2f5510.el8.x86_ 15 MB/s | 17 MB 00:01 2023-12-16T03:06:14.663 INFO:teuthology.orchestra.run.smithi064.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 403 kB/s | 249 kB 00:00 2023-12-16T03:06:14.709 INFO:teuthology.orchestra.run.smithi184.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2023-12-16T03:06:14.790 INFO:teuthology.orchestra.run.smithi184.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 466 kB/s | 39 kB 00:00 2023-12-16T03:06:14.838 INFO:teuthology.orchestra.run.smithi064.stdout:(13/32): python3-cryptography-3.2.1-6.el8.x86_6 905 kB/s | 641 kB 00:00 2023-12-16T03:06:14.899 INFO:teuthology.orchestra.run.smithi184.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 955 kB/s | 103 kB 00:00 2023-12-16T03:06:14.905 INFO:teuthology.orchestra.run.smithi064.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 180 kB/s | 44 kB 00:00 2023-12-16T03:06:15.006 INFO:teuthology.orchestra.run.smithi064.stdout:(15/32): python3-pycparser-2.14-14.el8.noarch.r 297 kB/s | 109 kB 00:00 2023-12-16T03:06:15.020 INFO:teuthology.orchestra.run.smithi184.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 472 kB/s | 57 kB 00:00 2023-12-16T03:06:15.123 INFO:teuthology.orchestra.run.smithi064.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 814 kB/s | 173 kB 00:00 2023-12-16T03:06:15.166 INFO:teuthology.orchestra.run.smithi184.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 3.1 MB/s | 457 kB 00:00 2023-12-16T03:06:15.206 INFO:teuthology.orchestra.run.smithi064.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-12-16T03:06:15.231 INFO:teuthology.orchestra.run.smithi064.stdout:(18/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 472 kB/s | 185 kB 00:00 2023-12-16T03:06:15.282 INFO:teuthology.orchestra.run.smithi064.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 234 kB/s | 18 kB 00:00 2023-12-16T03:06:15.299 INFO:teuthology.orchestra.run.smithi064.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 727 kB/s | 49 kB 00:00 2023-12-16T03:06:15.357 INFO:teuthology.orchestra.run.smithi064.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 780 kB/s | 59 kB 00:00 2023-12-16T03:06:15.375 INFO:teuthology.orchestra.run.smithi184.stdout:(10/32): ceph-osd-17.2.7-125.g1f2f5510.el8.x86_ 18 MB/s | 17 MB 00:00 2023-12-16T03:06:15.441 INFO:teuthology.orchestra.run.smithi064.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2023-12-16T03:06:15.483 INFO:teuthology.orchestra.run.smithi184.stdout:(11/32): ceph-mon-17.2.7-125.g1f2f5510.el8.x86_ 2.7 MB/s | 3.9 MB 00:01 2023-12-16T03:06:15.491 INFO:teuthology.orchestra.run.smithi064.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-12-16T03:06:15.558 INFO:teuthology.orchestra.run.smithi064.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 160 kB/s | 19 kB 00:00 2023-12-16T03:06:15.583 INFO:teuthology.orchestra.run.smithi064.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 260 kB/s | 24 kB 00:00 2023-12-16T03:06:15.609 INFO:teuthology.orchestra.run.smithi064.stdout:(26/32): python3-cherrypy-18.4.0-1.el8.noarch.r 638 kB/s | 384 kB 00:00 2023-12-16T03:06:15.651 INFO:teuthology.orchestra.run.smithi064.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 316 kB/s | 29 kB 00:00 2023-12-16T03:06:15.676 INFO:teuthology.orchestra.run.smithi064.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 297 kB/s | 27 kB 00:00 2023-12-16T03:06:15.785 INFO:teuthology.orchestra.run.smithi064.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 788 kB/s | 85 kB 00:00 2023-12-16T03:06:15.905 INFO:teuthology.orchestra.run.smithi064.stdout:(30/32): python3-waitress-1.4.3-1.el8.noarch.rp 864 kB/s | 255 kB 00:00 2023-12-16T03:06:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 153 kB/s | 23 kB 00:00 2023-12-16T03:06:15.961 INFO:teuthology.orchestra.run.smithi064.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 813 kB/s | 251 kB 00:00 2023-12-16T03:06:15.965 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:15.965 INFO:teuthology.orchestra.run.smithi064.stdout:Total 8.9 MB/s | 28 MB 00:03 2023-12-16T03:06:16.052 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:06:16.093 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:06:16.093 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:06:16.308 INFO:teuthology.orchestra.run.smithi184.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 132 kB/s | 109 kB 00:00 2023-12-16T03:06:16.334 INFO:teuthology.orchestra.run.smithi184.stdout:(13/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 213 kB/s | 249 kB 00:01 2023-12-16T03:06:16.409 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:06:16.412 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:06:16.417 INFO:teuthology.orchestra.run.smithi184.stdout:(14/32): python3-cryptography-3.2.1-6.el8.x86_6 615 kB/s | 641 kB 00:01 2023-12-16T03:06:16.868 INFO:teuthology.orchestra.run.smithi184.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 78 kB/s | 44 kB 00:00 2023-12-16T03:06:16.961 INFO:teuthology.orchestra.run.smithi184.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 296 kB/s | 185 kB 00:00 2023-12-16T03:06:17.060 INFO:teuthology.orchestra.run.smithi184.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 273 kB/s | 173 kB 00:00 2023-12-16T03:06:17.085 INFO:teuthology.orchestra.run.smithi184.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-12-16T03:06:17.160 INFO:teuthology.orchestra.run.smithi184.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 175 kB/s | 18 kB 00:00 2023-12-16T03:06:17.209 INFO:teuthology.orchestra.run.smithi184.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 396 kB/s | 49 kB 00:00 2023-12-16T03:06:17.269 INFO:teuthology.orchestra.run.smithi184.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 540 kB/s | 59 kB 00:00 2023-12-16T03:06:17.378 INFO:teuthology.orchestra.run.smithi184.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-12-16T03:06:17.403 INFO:teuthology.orchestra.run.smithi184.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-12-16T03:06:17.445 INFO:teuthology.orchestra.run.smithi184.stdout:(24/32): python3-cherrypy-18.4.0-1.el8.noarch.r 666 kB/s | 384 kB 00:00 2023-12-16T03:06:17.512 INFO:teuthology.orchestra.run.smithi184.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 140 kB/s | 19 kB 00:00 2023-12-16T03:06:17.537 INFO:teuthology.orchestra.run.smithi184.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 179 kB/s | 24 kB 00:00 2023-12-16T03:06:17.557 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:06:17.562 INFO:teuthology.orchestra.run.smithi184.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 249 kB/s | 29 kB 00:00 2023-12-16T03:06:17.613 INFO:teuthology.orchestra.run.smithi184.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 273 kB/s | 27 kB 00:00 2023-12-16T03:06:17.647 INFO:teuthology.orchestra.run.smithi184.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.3 MB/s | 255 kB 00:00 2023-12-16T03:06:17.722 INFO:teuthology.orchestra.run.smithi184.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 788 kB/s | 85 kB 00:00 2023-12-16T03:06:17.772 INFO:teuthology.orchestra.run.smithi184.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 183 kB/s | 23 kB 00:00 2023-12-16T03:06:17.807 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-16T03:06:17.906 INFO:teuthology.orchestra.run.smithi184.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 733 kB/s | 251 kB 00:00 2023-12-16T03:06:17.910 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:17.910 INFO:teuthology.orchestra.run.smithi184.stdout:Total 6.6 MB/s | 28 MB 00:04 2023-12-16T03:06:17.993 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:06:18.021 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-16T03:06:18.029 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:06:18.030 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:06:18.268 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-16T03:06:18.320 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:06:18.323 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:06:18.513 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-16T03:06:18.711 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-16T03:06:18.942 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-16T03:06:19.134 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-16T03:06:19.354 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-16T03:06:19.480 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:06:19.590 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-16T03:06:19.724 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-16T03:06:19.811 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-16T03:06:19.957 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-16T03:06:20.082 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-16T03:06:20.184 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-16T03:06:20.357 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-16T03:06:20.424 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-16T03:06:20.638 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-16T03:06:20.739 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-16T03:06:20.862 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-16T03:06:21.026 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-16T03:06:21.096 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-16T03:06:21.213 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-16T03:06:21.274 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-16T03:06:21.495 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-16T03:06:21.506 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-16T03:06:21.732 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T03:06:21.736 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-16T03:06:21.974 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-16T03:06:22.038 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-16T03:06:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-16T03:06:22.279 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-16T03:06:22.467 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-16T03:06:22.622 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-16T03:06:22.669 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-16T03:06:22.878 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-16T03:06:22.939 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-16T03:06:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-16T03:06:23.180 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-16T03:06:23.375 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-16T03:06:23.426 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-16T03:06:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T03:06:23.809 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-16T03:06:23.954 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-16T03:06:24.159 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-16T03:06:24.223 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-16T03:06:24.371 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-16T03:06:24.542 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-16T03:06:24.555 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 27/32 2023-12-16T03:06:24.802 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-16T03:06:24.808 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T03:06:25.088 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-16T03:06:25.348 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-16T03:06:25.688 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-16T03:06:25.979 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-16T03:06:26.387 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T03:06:26.583 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T03:06:26.999 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T03:06:27.026 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 27/32 2023-12-16T03:06:27.208 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T03:06:27.261 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T03:06:27.436 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T03:06:27.613 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T03:06:27.632 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T03:06:27.772 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T03:06:28.198 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 1/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 3/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 4/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 5/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 6/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-16T03:06:28.199 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-16T03:06:28.200 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-16T03:06:28.201 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-16T03:06:28.201 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-16T03:06:28.201 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-16T03:06:28.746 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T03:06:28.952 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T03:06:29.344 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T03:06:29.519 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-16T03:06:29.520 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend-2.6-1.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-16T03:06:29.521 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-16T03:06:29.522 INFO:teuthology.orchestra.run.smithi064.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-16T03:06:29.522 INFO:teuthology.orchestra.run.smithi064.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-16T03:06:29.522 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-16T03:06:29.522 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-16T03:06:29.522 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-16T03:06:29.522 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-16T03:06:29.522 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:29.522 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:06:29.549 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T03:06:29.658 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-base 2023-12-16T03:06:29.766 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T03:06:29.933 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T03:06:29.951 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T03:06:30.108 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T03:06:30.527 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T03:06:30.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 1/32 2023-12-16T03:06:30.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2/32 2023-12-16T03:06:30.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 3/32 2023-12-16T03:06:30.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 4/32 2023-12-16T03:06:30.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 5/32 2023-12-16T03:06:30.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 6/32 2023-12-16T03:06:30.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-16T03:06:30.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-16T03:06:30.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-16T03:06:30.529 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-16T03:06:30.529 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-16T03:06:30.529 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-16T03:06:30.529 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-16T03:06:30.529 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-16T03:06:30.530 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-16T03:06:30.530 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-16T03:06:30.549 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:19 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-16T03:06:31.818 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-2.6-1.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-16T03:06:31.819 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:31.820 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:06:32.057 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-base 2023-12-16T03:06:32.109 INFO:teuthology.orchestra.run.smithi064.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:06:32.352 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:06:32.354 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2023-12-16T03:06:32.354 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:06:32.453 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install cephadm 2023-12-16T03:06:32.912 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:20 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:06:33.336 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:22 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:06:34.377 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:06:34.605 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:06:34.608 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-12-16T03:06:34.608 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:06:34.721 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install cephadm 2023-12-16T03:06:35.131 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:06:35.132 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:35.132 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:06:35.132 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:35.132 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:06:35.132 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 80 k 2023-12-16T03:06:35.132 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:35.133 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:06:35.133 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:35.133 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2023-12-16T03:06:35.133 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:35.133 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 80 k 2023-12-16T03:06:35.133 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 364 k 2023-12-16T03:06:35.133 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:06:35.494 INFO:teuthology.orchestra.run.smithi064.stdout:cephadm-17.2.7-125.g1f2f5510.el8.noarch.rpm 222 kB/s | 80 kB 00:00 2023-12-16T03:06:35.495 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:35.495 INFO:teuthology.orchestra.run.smithi064.stdout:Total 221 kB/s | 80 kB 00:00 2023-12-16T03:06:35.495 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:06:35.504 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:06:35.504 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:06:35.506 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:06:35.509 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:06:35.552 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:06:35.573 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:23 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:06:37.265 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:06:37.265 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:37.265 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:06:37.265 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:37.266 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:06:37.266 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 80 k 2023-12-16T03:06:37.266 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:37.266 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:06:37.266 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:37.266 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-12-16T03:06:37.266 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:37.267 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 80 k 2023-12-16T03:06:37.267 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 364 k 2023-12-16T03:06:37.267 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:06:37.880 INFO:teuthology.orchestra.run.smithi184.stdout:cephadm-17.2.7-125.g1f2f5510.el8.noarch.rpm 131 kB/s | 80 kB 00:00 2023-12-16T03:06:37.881 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:37.881 INFO:teuthology.orchestra.run.smithi184.stdout:Total 131 kB/s | 80 kB 00:00 2023-12-16T03:06:37.882 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:06:37.887 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T03:06:37.891 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:06:37.891 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:06:37.893 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:06:37.896 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:06:38.136 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T03:06:38.382 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T03:06:38.578 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:06:39.137 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T03:06:39.137 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:39.137 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:06:39.137 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:39.137 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:39.137 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:06:39.324 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T03:06:40.213 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:29 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:06:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T03:06:40.647 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T03:06:40.880 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T03:06:41.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T03:06:41.583 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:41.583 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:06:41.583 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:41.583 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:41.583 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:06:41.837 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T03:06:42.017 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:06:42.018 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:42.018 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2023-12-16T03:06:42.018 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:42.018 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:06:42.019 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 161 k 2023-12-16T03:06:42.019 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:42.019 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:06:42.019 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:42.019 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2023-12-16T03:06:42.019 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:42.019 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 161 k 2023-12-16T03:06:42.019 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 490 k 2023-12-16T03:06:42.019 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:06:42.333 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 514 kB/s | 161 kB 00:00 2023-12-16T03:06:42.334 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:42.334 INFO:teuthology.orchestra.run.smithi064.stdout:Total 512 kB/s | 161 kB 00:00 2023-12-16T03:06:42.334 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:06:42.346 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:06:42.346 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:06:42.396 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:06:42.399 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:06:42.510 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:06:42.703 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:30 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:06:42.719 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T03:06:43.153 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T03:06:43.905 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T03:06:43.906 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:43.906 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:06:43.906 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:43.906 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:43.906 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:06:44.142 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr 2023-12-16T03:06:44.399 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:06:44.399 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:44.399 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2023-12-16T03:06:44.399 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:44.399 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:06:44.399 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 161 k 2023-12-16T03:06:44.399 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:44.400 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:06:44.400 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:44.400 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-12-16T03:06:44.400 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:44.400 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 161 k 2023-12-16T03:06:44.400 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 490 k 2023-12-16T03:06:44.400 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:06:44.691 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 556 kB/s | 161 kB 00:00 2023-12-16T03:06:44.691 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:44.691 INFO:teuthology.orchestra.run.smithi184.stdout:Total 554 kB/s | 161 kB 00:00 2023-12-16T03:06:44.692 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:06:44.702 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:06:44.702 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:06:44.749 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:06:44.751 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:06:44.859 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:06:45.028 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:34 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:06:45.064 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T03:06:45.518 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T03:06:46.208 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T03:06:46.208 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:46.208 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:06:46.208 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:06:46.209 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:46.209 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:06:46.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr 2023-12-16T03:06:46.582 INFO:teuthology.orchestra.run.smithi064.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:06:46.824 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:06:46.825 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2023-12-16T03:06:46.825 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:06:46.915 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T03:06:47.287 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:35 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:06:47.809 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:36 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:06:48.750 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:06:48.977 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:06:48.979 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-12-16T03:06:48.979 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:06:49.089 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T03:06:49.624 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:06:49.625 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:49.625 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:06:49.625 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:49.625 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:06:49.625 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 1.7 M 2023-12-16T03:06:49.625 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T03:06:49.625 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 23 k 2023-12-16T03:06:49.625 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 14 k 2023-12-16T03:06:49.626 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-16T03:06:49.626 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-16T03:06:49.626 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-16T03:06:49.626 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:49.626 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:06:49.626 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:06:49.626 INFO:teuthology.orchestra.run.smithi064.stdout:Install 6 Packages 2023-12-16T03:06:49.626 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:49.627 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 2.0 M 2023-12-16T03:06:49.627 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 8.0 M 2023-12-16T03:06:49.627 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:06:49.854 INFO:teuthology.orchestra.run.smithi064.stdout:(1/6): ceph-grafana-dashboards-17.2.7-125.g1f2f 148 kB/s | 23 kB 00:00 2023-12-16T03:06:49.879 INFO:teuthology.orchestra.run.smithi064.stdout:(2/6): ceph-prometheus-alerts-17.2.7-125.g1f2f5 80 kB/s | 14 kB 00:00 2023-12-16T03:06:49.945 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:37 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:06:49.954 INFO:teuthology.orchestra.run.smithi064.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 447 kB/s | 34 kB 00:00 2023-12-16T03:06:50.071 INFO:teuthology.orchestra.run.smithi064.stdout:(4/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.6 MB/s | 196 kB 00:00 2023-12-16T03:06:50.188 INFO:teuthology.orchestra.run.smithi064.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 127 kB/s | 43 kB 00:00 2023-12-16T03:06:50.222 INFO:teuthology.orchestra.run.smithi064.stdout:(6/6): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 3.2 MB/s | 1.7 MB 00:00 2023-12-16T03:06:50.225 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:50.226 INFO:teuthology.orchestra.run.smithi064.stdout:Total 3.3 MB/s | 2.0 MB 00:00 2023-12-16T03:06:50.235 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:06:50.246 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:06:50.247 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:06:50.323 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:06:50.327 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:06:50.612 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:06:50.810 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-16T03:06:51.070 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-16T03:06:51.296 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-16T03:06:51.417 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 4/6 2023-12-16T03:06:51.628 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:06:51.629 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:51.629 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:06:51.629 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:51.629 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:06:51.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 1.7 M 2023-12-16T03:06:51.629 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T03:06:51.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 23 k 2023-12-16T03:06:51.629 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 14 k 2023-12-16T03:06:51.630 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-16T03:06:51.630 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-16T03:06:51.630 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-16T03:06:51.630 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:51.630 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:06:51.630 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:06:51.630 INFO:teuthology.orchestra.run.smithi184.stdout:Install 6 Packages 2023-12-16T03:06:51.630 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:51.630 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 2.0 M 2023-12-16T03:06:51.631 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 8.0 M 2023-12-16T03:06:51.631 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:06:51.792 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 5/6 2023-12-16T03:06:52.029 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T03:06:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:(1/6): ceph-grafana-dashboards-17.2.7-125.g1f2f 151 kB/s | 23 kB 00:00 2023-12-16T03:06:52.187 INFO:teuthology.orchestra.run.smithi184.stdout:(2/6): ceph-prometheus-alerts-17.2.7-125.g1f2f5 59 kB/s | 14 kB 00:00 2023-12-16T03:06:52.312 INFO:teuthology.orchestra.run.smithi184.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 269 kB/s | 34 kB 00:00 2023-12-16T03:06:52.326 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T03:06:52.326 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 1/6 2023-12-16T03:06:52.326 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2/6 2023-12-16T03:06:52.326 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 3/6 2023-12-16T03:06:52.326 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-16T03:06:52.326 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-16T03:06:52.396 INFO:teuthology.orchestra.run.smithi184.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 142 kB/s | 43 kB 00:00 2023-12-16T03:06:52.421 INFO:teuthology.orchestra.run.smithi184.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.8 MB/s | 196 kB 00:00 2023-12-16T03:06:52.463 INFO:teuthology.orchestra.run.smithi184.stdout:(6/6): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 3.3 MB/s | 1.7 MB 00:00 2023-12-16T03:06:52.465 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:52.466 INFO:teuthology.orchestra.run.smithi184.stdout:Total 2.4 MB/s | 2.0 MB 00:00 2023-12-16T03:06:52.477 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:06:52.487 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:06:52.487 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:06:52.596 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:06:52.599 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:06:52.901 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:06:53.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:53.093 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:06:53.152 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-16T03:06:53.209 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T03:06:53.421 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-16T03:06:53.665 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-16T03:06:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 4/6 2023-12-16T03:06:54.095 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:43 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:06:54.142 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 5/6 2023-12-16T03:06:54.422 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T03:06:54.733 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T03:06:54.733 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 1/6 2023-12-16T03:06:54.733 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2/6 2023-12-16T03:06:54.733 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 3/6 2023-12-16T03:06:54.733 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-16T03:06:54.733 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-16T03:06:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-16T03:06:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:55.452 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:06:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:06:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-16T03:06:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-16T03:06:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-16T03:06:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:55.453 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:06:55.673 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T03:06:55.917 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================================ 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================================ 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 7.4 M 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-16T03:06:55.919 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:06:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================================ 2023-12-16T03:06:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:Install 8 Packages 2023-12-16T03:06:55.920 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:06:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 36 M 2023-12-16T03:06:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 210 M 2023-12-16T03:06:55.920 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:06:56.528 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:44 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:06:56.830 INFO:teuthology.orchestra.run.smithi064.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2023-12-16T03:06:56.897 INFO:teuthology.orchestra.run.smithi064.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 9.3 MB/s | 4.9 MB 00:00 2023-12-16T03:06:57.031 INFO:teuthology.orchestra.run.smithi064.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.6 MB/s | 225 kB 00:00 2023-12-16T03:06:57.123 INFO:teuthology.orchestra.run.smithi064.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 13 MB/s | 3.7 MB 00:00 2023-12-16T03:06:57.740 INFO:teuthology.orchestra.run.smithi064.stdout:(5/8): python3-scipy-1.0.0-21.module_el8+762+77 20 MB/s | 14 MB 00:00 2023-12-16T03:06:57.765 INFO:teuthology.orchestra.run.smithi064.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.0 MB/s | 645 kB 00:00 2023-12-16T03:06:58.115 INFO:teuthology.orchestra.run.smithi064.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 460 kB/s | 172 kB 00:00 2023-12-16T03:06:58.199 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:06:58.200 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================ 2023-12-16T03:06:58.200 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:06:58.200 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================ 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 7.4 M 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================ 2023-12-16T03:06:58.201 INFO:teuthology.orchestra.run.smithi184.stdout:Install 8 Packages 2023-12-16T03:06:58.202 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:06:58.202 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 36 M 2023-12-16T03:06:58.202 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 210 M 2023-12-16T03:06:58.202 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:06:58.324 INFO:teuthology.orchestra.run.smithi064.stdout:(8/8): ceph-mgr-diskprediction-local-17.2.7-125 3.8 MB/s | 7.4 MB 00:01 2023-12-16T03:06:58.324 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:58.324 INFO:teuthology.orchestra.run.smithi064.stdout:Total 15 MB/s | 36 MB 00:02 2023-12-16T03:06:58.565 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:06:58.584 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:06:58.584 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:06:58.971 INFO:teuthology.orchestra.run.smithi184.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 13 MB/s | 4.9 MB 00:00 2023-12-16T03:06:59.038 INFO:teuthology.orchestra.run.smithi184.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2023-12-16T03:06:59.129 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:06:59.132 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:06:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.8 MB/s | 225 kB 00:00 2023-12-16T03:06:59.255 INFO:teuthology.orchestra.run.smithi184.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 13 MB/s | 3.7 MB 00:00 2023-12-16T03:06:59.421 INFO:teuthology.orchestra.run.smithi184.stdout:(5/8): ceph-mgr-diskprediction-local-17.2.7-125 8.8 MB/s | 7.4 MB 00:00 2023-12-16T03:06:59.889 INFO:teuthology.orchestra.run.smithi184.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 20 MB/s | 14 MB 00:00 2023-12-16T03:06:59.914 INFO:teuthology.orchestra.run.smithi184.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 350 kB/s | 172 kB 00:00 2023-12-16T03:06:59.968 INFO:teuthology.orchestra.run.smithi184.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 905 kB/s | 645 kB 00:00 2023-12-16T03:06:59.969 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:06:59.969 INFO:teuthology.orchestra.run.smithi184.stdout:Total 20 MB/s | 36 MB 00:01 2023-12-16T03:07:00.201 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:07:00.219 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:07:00.219 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:07:00.444 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:07:00.575 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T03:07:00.736 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T03:07:00.809 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:07:00.812 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:07:00.884 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T03:07:01.518 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T03:07:01.658 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T03:07:02.044 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:07:02.177 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T03:07:02.302 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T03:07:02.317 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T03:07:02.444 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T03:07:02.495 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T03:07:03.047 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T03:07:03.236 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T03:07:03.238 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T03:07:03.600 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T03:07:03.819 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T03:07:03.853 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T03:07:04.060 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T03:07:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T03:07:05.105 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T03:07:05.376 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T03:07:05.700 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T03:07:06.968 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-16T03:07:07.125 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T03:07:07.191 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T03:07:07.522 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T03:07:07.523 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 1/8 2023-12-16T03:07:07.523 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-16T03:07:07.523 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-16T03:07:07.523 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-16T03:07:07.523 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T03:07:07.523 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-16T03:07:07.523 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:08.289 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:08.381 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-16T03:07:08.409 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-rook 2023-12-16T03:07:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T03:07:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T03:07:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 1/8 2023-12-16T03:07:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-16T03:07:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-16T03:07:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-16T03:07:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T03:07:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-16T03:07:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-16T03:07:09.296 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:58 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:09.648 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-16T03:07:09.648 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:09.648 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:07:09.648 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:07:09.648 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-16T03:07:09.648 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-16T03:07:09.648 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-16T03:07:09.648 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-16T03:07:09.649 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-16T03:07:09.649 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-16T03:07:09.649 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-16T03:07:09.649 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:09.649 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:09.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-rook 2023-12-16T03:07:10.644 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:58 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:11.096 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:11.098 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:11.098 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:07:11.098 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:11.098 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:07:11.098 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 47 k 2023-12-16T03:07:11.098 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T03:07:11.098 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-16T03:07:11.098 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:11.099 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:07:11.100 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:11.100 INFO:teuthology.orchestra.run.smithi064.stdout:Install 13 Packages 2023-12-16T03:07:11.100 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:11.100 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 1.9 M 2023-12-16T03:07:11.100 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 25 M 2023-12-16T03:07:11.100 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:07:11.641 INFO:teuthology.orchestra.run.smithi064.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 165 kB/s | 20 kB 00:00 2023-12-16T03:07:11.666 INFO:teuthology.orchestra.run.smithi064.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 181 kB/s | 27 kB 00:00 2023-12-16T03:07:11.691 INFO:teuthology.orchestra.run.smithi064.stdout:(3/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el8. 276 kB/s | 47 kB 00:00 2023-12-16T03:07:11.767 INFO:teuthology.orchestra.run.smithi064.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-12-16T03:07:11.792 INFO:teuthology.orchestra.run.smithi064.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 876 kB/s | 110 kB 00:00 2023-12-16T03:07:11.917 INFO:teuthology.orchestra.run.smithi064.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 263 kB/s | 33 kB 00:00 2023-12-16T03:07:11.968 INFO:teuthology.orchestra.run.smithi064.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 327 kB/s | 16 kB 00:00 2023-12-16T03:07:12.034 INFO:teuthology.orchestra.run.smithi064.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 1.2 MB/s | 81 kB 00:00 2023-12-16T03:07:12.089 INFO:teuthology.orchestra.run.smithi064.stdout:(9/13): python3-requests-oauthlib-1.0.0-1.el8.n 132 kB/s | 43 kB 00:00 2023-12-16T03:07:12.118 INFO:teuthology.orchestra.run.smithi064.stdout:(10/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 363 kB/s | 155 kB 00:00 2023-12-16T03:07:12.194 INFO:teuthology.orchestra.run.smithi064.stdout:(11/13): python3-kubernetes-11.0.0-6.el8.noarch 7.3 MB/s | 1.2 MB 00:00 2023-12-16T03:07:12.244 INFO:teuthology.orchestra.run.smithi064.stdout:(12/13): python3-rsa-4.9-2.el8.noarch.rpm 416 kB/s | 64 kB 00:00 2023-12-16T03:07:12.277 INFO:teuthology.orchestra.run.smithi064.stdout:(13/13): python3-websocket-client-0.56.0-5.el8. 398 kB/s | 61 kB 00:00 2023-12-16T03:07:12.280 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:12.280 INFO:teuthology.orchestra.run.smithi064.stdout:Total 1.6 MB/s | 1.9 MB 00:01 2023-12-16T03:07:12.327 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:12.329 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:12.329 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:07:12.329 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:12.329 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:07:12.329 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 47 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-16T03:07:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-16T03:07:12.331 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-16T03:07:12.331 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:12.331 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:07:12.331 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:12.331 INFO:teuthology.orchestra.run.smithi184.stdout:Install 13 Packages 2023-12-16T03:07:12.331 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:12.331 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 1.9 M 2023-12-16T03:07:12.331 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 25 M 2023-12-16T03:07:12.332 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:07:12.342 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:07:12.359 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:07:12.359 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:07:12.453 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:07:12.457 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:07:12.861 INFO:teuthology.orchestra.run.smithi184.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 165 kB/s | 20 kB 00:00 2023-12-16T03:07:12.878 INFO:teuthology.orchestra.run.smithi184.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 193 kB/s | 27 kB 00:00 2023-12-16T03:07:12.895 INFO:teuthology.orchestra.run.smithi184.stdout:(3/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el8. 306 kB/s | 47 kB 00:00 2023-12-16T03:07:12.987 INFO:teuthology.orchestra.run.smithi184.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-12-16T03:07:13.012 INFO:teuthology.orchestra.run.smithi184.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 820 kB/s | 110 kB 00:00 2023-12-16T03:07:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:07:13.079 INFO:teuthology.orchestra.run.smithi184.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 495 kB/s | 33 kB 00:00 2023-12-16T03:07:13.113 INFO:teuthology.orchestra.run.smithi184.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 488 kB/s | 16 kB 00:00 2023-12-16T03:07:13.172 INFO:teuthology.orchestra.run.smithi184.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 1.4 MB/s | 81 kB 00:00 2023-12-16T03:07:13.289 INFO:teuthology.orchestra.run.smithi184.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 10 MB/s | 1.2 MB 00:00 2023-12-16T03:07:13.304 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-16T03:07:13.313 INFO:teuthology.orchestra.run.smithi184.stdout:(10/13): python3-requests-oauthlib-1.0.0-1.el8. 131 kB/s | 43 kB 00:00 2023-12-16T03:07:13.339 INFO:teuthology.orchestra.run.smithi184.stdout:(11/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 349 kB/s | 155 kB 00:00 2023-12-16T03:07:13.364 INFO:teuthology.orchestra.run.smithi184.stdout:(12/13): python3-rsa-4.9-2.el8.noarch.rpm 850 kB/s | 64 kB 00:00 2023-12-16T03:07:13.414 INFO:teuthology.orchestra.run.smithi184.stdout:(13/13): python3-websocket-client-0.56.0-5.el8. 609 kB/s | 61 kB 00:00 2023-12-16T03:07:13.415 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:13.415 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.8 MB/s | 1.9 MB 00:01 2023-12-16T03:07:13.469 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:07:13.483 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-16T03:07:13.484 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:07:13.484 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:07:13.568 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:07:13.571 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:07:13.744 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-16T03:07:14.022 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-16T03:07:14.178 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:07:14.213 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-16T03:07:14.436 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-16T03:07:14.490 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-16T03:07:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-16T03:07:14.795 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-16T03:07:14.860 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-16T03:07:15.063 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-16T03:07:15.073 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-16T03:07:15.289 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-16T03:07:15.536 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-16T03:07:15.829 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-16T03:07:16.104 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-16T03:07:16.144 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-16T03:07:16.413 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-16T03:07:16.633 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-16T03:07:16.850 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-16T03:07:17.023 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T03:07:17.155 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 1/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-16T03:07:17.321 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-16T03:07:17.456 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-16T03:07:17.690 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-16T03:07:17.884 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-16T03:07:18.050 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T03:07:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-16T03:07:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:18.109 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:07:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:07:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-16T03:07:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:18.110 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:18.226 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T03:07:18.329 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T03:07:18.329 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 1/13 2023-12-16T03:07:18.329 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-16T03:07:18.329 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-16T03:07:18.329 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-16T03:07:18.330 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-16T03:07:18.330 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-16T03:07:18.330 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-16T03:07:18.330 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-16T03:07:18.330 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-16T03:07:18.330 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-16T03:07:18.330 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-16T03:07:18.330 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-16T03:07:19.118 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:08 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-16T03:07:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-16T03:07:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-16T03:07:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-16T03:07:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:19.151 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:19.269 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T03:07:20.123 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:08 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:20.922 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 121 k 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-16T03:07:20.923 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:20.924 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:07:20.924 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:20.924 INFO:teuthology.orchestra.run.smithi064.stdout:Install 5 Packages 2023-12-16T03:07:20.924 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:20.924 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 6.0 M 2023-12-16T03:07:20.924 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 26 M 2023-12-16T03:07:20.924 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:07:21.319 INFO:teuthology.orchestra.run.smithi064.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.4 MB/s | 538 kB 00:00 2023-12-16T03:07:21.377 INFO:teuthology.orchestra.run.smithi064.stdout:(2/5): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 437 kB/s | 121 kB 00:00 2023-12-16T03:07:21.470 INFO:teuthology.orchestra.run.smithi064.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-12-16T03:07:21.578 INFO:teuthology.orchestra.run.smithi064.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 301 kB/s | 60 kB 00:00 2023-12-16T03:07:21.645 INFO:teuthology.orchestra.run.smithi064.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.4 MB/s | 476 kB 00:00 2023-12-16T03:07:21.646 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:21.647 INFO:teuthology.orchestra.run.smithi064.stdout:Total 8.2 MB/s | 6.0 MB 00:00 2023-12-16T03:07:21.700 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:07:21.711 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:07:21.711 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:07:21.818 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:21.819 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:21.819 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:07:21.819 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:21.819 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 121 k 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout:Install 5 Packages 2023-12-16T03:07:21.820 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:21.821 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 6.0 M 2023-12-16T03:07:21.821 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 26 M 2023-12-16T03:07:21.821 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:07:21.827 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:07:21.831 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:07:22.100 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:07:22.254 INFO:teuthology.orchestra.run.smithi184.stdout:(1/5): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 637 kB/s | 121 kB 00:00 2023-12-16T03:07:22.321 INFO:teuthology.orchestra.run.smithi184.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.0 MB/s | 538 kB 00:00 2023-12-16T03:07:22.438 INFO:teuthology.orchestra.run.smithi184.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-12-16T03:07:22.467 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-16T03:07:22.505 INFO:teuthology.orchestra.run.smithi184.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 328 kB/s | 60 kB 00:00 2023-12-16T03:07:22.630 INFO:teuthology.orchestra.run.smithi184.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.2 MB/s | 476 kB 00:00 2023-12-16T03:07:22.631 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:22.632 INFO:teuthology.orchestra.run.smithi184.stdout:Total 7.3 MB/s | 6.0 MB 00:00 2023-12-16T03:07:22.684 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:07:22.695 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:07:22.695 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:07:22.804 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:07:22.807 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:07:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:07:23.386 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-16T03:07:23.473 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-16T03:07:23.825 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-16T03:07:24.104 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-16T03:07:24.322 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T03:07:24.330 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-16T03:07:24.603 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T03:07:24.603 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/5 2023-12-16T03:07:24.603 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-16T03:07:24.603 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-16T03:07:24.603 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-16T03:07:24.709 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-16T03:07:24.983 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-16T03:07:25.265 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T03:07:25.328 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-16T03:07:25.328 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:25.328 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:07:25.328 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:07:25.328 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-16T03:07:25.329 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-16T03:07:25.329 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-16T03:07:25.329 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-16T03:07:25.329 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:25.329 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:25.463 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-fuse 2023-12-16T03:07:25.546 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T03:07:25.547 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/5 2023-12-16T03:07:25.547 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-16T03:07:25.547 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-16T03:07:25.547 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-16T03:07:26.266 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-16T03:07:26.266 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:26.266 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:07:26.267 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T03:07:26.267 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-16T03:07:26.267 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-16T03:07:26.267 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-16T03:07:26.267 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-16T03:07:26.267 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:26.267 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:15 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:26.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-fuse 2023-12-16T03:07:27.274 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:15 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:28.184 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 875 k 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout:Install 2 Packages 2023-12-16T03:07:28.185 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:28.186 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 958 k 2023-12-16T03:07:28.186 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 3.0 M 2023-12-16T03:07:28.186 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:07:28.737 INFO:teuthology.orchestra.run.smithi064.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 235 kB/s | 83 kB 00:00 2023-12-16T03:07:28.949 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 875 k 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout:Install 2 Packages 2023-12-16T03:07:28.950 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:28.951 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 958 k 2023-12-16T03:07:28.951 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 3.0 M 2023-12-16T03:07:28.951 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:07:28.958 INFO:teuthology.orchestra.run.smithi064.stdout:(2/2): ceph-fuse-17.2.7-125.g1f2f5510.el8.x86_6 1.5 MB/s | 875 kB 00:00 2023-12-16T03:07:28.958 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:28.959 INFO:teuthology.orchestra.run.smithi064.stdout:Total 1.2 MB/s | 958 kB 00:00 2023-12-16T03:07:28.971 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:07:28.994 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:07:28.995 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:07:29.094 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:07:29.097 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:07:29.277 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:07:29.313 INFO:teuthology.orchestra.run.smithi184.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 256 kB/s | 83 kB 00:00 2023-12-16T03:07:29.422 INFO:teuthology.orchestra.run.smithi184.stdout:(2/2): ceph-fuse-17.2.7-125.g1f2f5510.el8.x86_6 2.0 MB/s | 875 kB 00:00 2023-12-16T03:07:29.422 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:29.423 INFO:teuthology.orchestra.run.smithi184.stdout:Total 2.0 MB/s | 958 kB 00:00 2023-12-16T03:07:29.432 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:07:29.453 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:07:29.453 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:07:29.538 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:07:29.541 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:07:29.685 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-16T03:07:29.720 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:07:29.888 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T03:07:29.992 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-16T03:07:30.189 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T03:07:30.302 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T03:07:30.302 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/2 2023-12-16T03:07:30.599 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T03:07:30.599 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/2 2023-12-16T03:07:31.035 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-16T03:07:31.035 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:31.035 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:07:31.036 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-16T03:07:31.036 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:31.036 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:31.298 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-16T03:07:31.298 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:31.298 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:07:31.298 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-16T03:07:31.298 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:31.298 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:31.553 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados-devel 2023-12-16T03:07:31.691 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install librados-devel 2023-12-16T03:07:32.418 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:20 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:32.592 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:21 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:34.098 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:34.098 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:34.099 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2023-12-16T03:07:34.099 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:34.099 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:07:34.099 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 130 k 2023-12-16T03:07:34.099 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:34.099 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:07:34.099 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:34.099 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-12-16T03:07:34.099 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:34.100 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 130 k 2023-12-16T03:07:34.100 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 464 k 2023-12-16T03:07:34.100 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:07:34.392 INFO:teuthology.orchestra.run.smithi184.stdout:librados-devel-17.2.7-125.g1f2f5510.el8.x86_64. 444 kB/s | 130 kB 00:00 2023-12-16T03:07:34.392 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:34.393 INFO:teuthology.orchestra.run.smithi184.stdout:Total 442 kB/s | 130 kB 00:00 2023-12-16T03:07:34.393 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 130 k 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:34.397 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 130 k 2023-12-16T03:07:34.398 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 464 k 2023-12-16T03:07:34.398 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:07:34.398 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:07:34.398 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:07:34.448 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:07:34.451 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:07:34.572 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:07:34.592 INFO:teuthology.orchestra.run.smithi064.stdout:librados-devel-17.2.7-125.g1f2f5510.el8.x86_64. 666 kB/s | 130 kB 00:00 2023-12-16T03:07:34.593 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:34.593 INFO:teuthology.orchestra.run.smithi064.stdout:Total 662 kB/s | 130 kB 00:00 2023-12-16T03:07:34.593 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:07:34.599 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:07:34.599 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:07:34.651 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:07:34.655 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:07:34.766 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:07:34.821 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:35.020 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:35.146 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:35.323 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:35.859 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:07:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:07:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:35.859 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:36.061 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:36.061 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:36.061 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:07:36.061 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:07:36.061 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:36.062 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:36.126 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs2 2023-12-16T03:07:36.283 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install libcephfs2 2023-12-16T03:07:36.989 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:24 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:37.182 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:26 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:38.436 INFO:teuthology.orchestra.run.smithi184.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:38.664 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:38.665 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-12-16T03:07:38.665 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:38.747 INFO:teuthology.orchestra.run.smithi064.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:38.992 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:38.993 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2023-12-16T03:07:38.993 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:39.083 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install libcephfs-devel 2023-12-16T03:07:39.331 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs-devel 2023-12-16T03:07:39.980 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:28 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:40.192 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:28 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:41.802 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 25 k 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2023-12-16T03:07:41.803 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:41.804 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 25 k 2023-12-16T03:07:41.804 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 109 k 2023-12-16T03:07:41.804 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:07:41.890 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:41.891 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:41.891 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2023-12-16T03:07:41.891 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:41.891 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:07:41.891 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 25 k 2023-12-16T03:07:41.891 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:41.891 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:07:41.891 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:07:41.892 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-12-16T03:07:41.892 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:41.892 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 25 k 2023-12-16T03:07:41.892 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 109 k 2023-12-16T03:07:41.892 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:07:42.024 INFO:teuthology.orchestra.run.smithi064.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el8.x86_64 113 kB/s | 25 kB 00:00 2023-12-16T03:07:42.025 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:42.025 INFO:teuthology.orchestra.run.smithi064.stdout:Total 112 kB/s | 25 kB 00:00 2023-12-16T03:07:42.025 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:07:42.029 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:07:42.029 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:07:42.031 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:07:42.031 INFO:teuthology.orchestra.run.smithi184.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el8.x86_64 179 kB/s | 25 kB 00:00 2023-12-16T03:07:42.031 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:07:42.032 INFO:teuthology.orchestra.run.smithi184.stdout:Total 177 kB/s | 25 kB 00:00 2023-12-16T03:07:42.032 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:07:42.034 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:07:42.035 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:07:42.035 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:07:42.037 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:07:42.040 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:07:42.087 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:07:42.087 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:07:42.294 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:42.311 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:42.563 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:42.568 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:43.211 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:43.211 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:43.211 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:07:43.211 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:07:43.211 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:07:43.211 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:43.281 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:07:43.281 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:43.281 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:07:43.281 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:07:43.281 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:07:43.282 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:43.332 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados2 2023-12-16T03:07:43.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install librados2 2023-12-16T03:07:44.181 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:32 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:44.286 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:33 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:45.644 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:45.859 INFO:teuthology.orchestra.run.smithi064.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:45.873 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:45.875 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-12-16T03:07:45.875 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:45.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librbd1 2023-12-16T03:07:46.103 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:46.104 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2023-12-16T03:07:46.104 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:46.204 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install librbd1 2023-12-16T03:07:46.819 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:34 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:47.085 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:36 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:48.277 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:48.510 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:48.511 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-12-16T03:07:48.511 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:48.626 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rados 2023-12-16T03:07:48.719 INFO:teuthology.orchestra.run.smithi064.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:48.966 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:48.967 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2023-12-16T03:07:48.967 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:49.070 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-rados 2023-12-16T03:07:49.489 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:37 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:49.962 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:38 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:50.936 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:51.162 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:51.163 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-12-16T03:07:51.163 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:51.264 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rgw 2023-12-16T03:07:51.511 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:51.758 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:51.760 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2023-12-16T03:07:51.760 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:51.853 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-rgw 2023-12-16T03:07:52.122 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:40 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:52.748 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:41 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:53.581 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:53.818 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:53.819 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-12-16T03:07:53.819 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:53.926 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-cephfs 2023-12-16T03:07:54.311 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:54.552 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:54.553 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2023-12-16T03:07:54.553 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:54.651 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-cephfs 2023-12-16T03:07:54.772 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:42 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:55.533 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:44 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:56.228 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:56.456 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:56.457 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-12-16T03:07:56.457 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:56.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rbd 2023-12-16T03:07:57.082 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:57.332 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:07:57.333 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2023-12-16T03:07:57.333 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:07:57.435 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-rbd 2023-12-16T03:07:57.455 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:45 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:07:58.333 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:47 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:07:58.925 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:07:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:07:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-12-16T03:07:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:07:59.267 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-fuse 2023-12-16T03:07:59.883 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T03:08:00.117 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:48 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:08:00.134 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:08:00.136 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2023-12-16T03:08:00.136 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:08:00.231 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install rbd-fuse 2023-12-16T03:08:01.116 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:50 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:08:01.809 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 90 k 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 90 k 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 264 k 2023-12-16T03:08:01.810 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:08:02.079 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el8.x86_64.rpm 338 kB/s | 90 kB 00:00 2023-12-16T03:08:02.079 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:08:02.079 INFO:teuthology.orchestra.run.smithi184.stdout:Total 336 kB/s | 90 kB 00:00 2023-12-16T03:08:02.079 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:08:02.090 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:08:02.090 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:08:02.140 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:08:02.143 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:08:02.259 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:08:02.449 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:02.758 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:02.933 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:08:02.933 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 90 k 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:02.934 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 90 k 2023-12-16T03:08:02.935 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 264 k 2023-12-16T03:08:02.935 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:08:03.105 INFO:teuthology.orchestra.run.smithi064.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el8.x86_64.rpm 529 kB/s | 90 kB 00:00 2023-12-16T03:08:03.106 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:08:03.106 INFO:teuthology.orchestra.run.smithi064.stdout:Total 525 kB/s | 90 kB 00:00 2023-12-16T03:08:03.106 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:08:03.117 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:08:03.117 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:08:03.170 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:08:03.173 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:08:03.294 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:08:03.477 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:03.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:03.495 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:03.495 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:08:03.495 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:08:03.495 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:03.495 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:08:03.725 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-mirror 2023-12-16T03:08:03.805 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:04.528 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:04.528 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:04.528 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:08:04.528 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:08:04.528 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:04.528 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:08:04.592 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:52 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:08:04.973 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install rbd-mirror 2023-12-16T03:08:05.868 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:54 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:08:06.269 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:08:06.269 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:08:06.269 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2023-12-16T03:08:06.269 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:08:06.269 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:08:06.270 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T03:08:06.270 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:06.270 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:08:06.270 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:08:06.270 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-12-16T03:08:06.270 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:06.271 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 3.5 M 2023-12-16T03:08:06.271 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 16 M 2023-12-16T03:08:06.272 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:08:06.922 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el8.x86_64.rpm 5.3 MB/s | 3.5 MB 00:00 2023-12-16T03:08:06.922 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:08:06.923 INFO:teuthology.orchestra.run.smithi184.stdout:Total 5.3 MB/s | 3.5 MB 00:00 2023-12-16T03:08:06.923 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:08:06.934 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:08:06.935 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:08:06.997 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:08:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:08:07.433 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:08:07.617 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:07.660 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:08:07.660 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:08:07.660 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2023-12-16T03:08:07.660 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:08:07.661 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:08:07.661 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T03:08:07.661 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:07.661 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:08:07.661 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:08:07.661 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2023-12-16T03:08:07.661 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:07.661 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 3.5 M 2023-12-16T03:08:07.662 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 16 M 2023-12-16T03:08:07.662 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:08:08.043 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:08.067 INFO:teuthology.orchestra.run.smithi064.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el8.x86_64.rpm 8.5 MB/s | 3.5 MB 00:00 2023-12-16T03:08:08.068 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:08:08.068 INFO:teuthology.orchestra.run.smithi064.stdout:Total 8.5 MB/s | 3.5 MB 00:00 2023-12-16T03:08:08.068 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:08:08.080 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:08:08.081 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:08:08.146 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:08:08.149 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:08:08.630 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:08:08.736 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:08.736 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:08.736 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:08:08.736 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:08:08.736 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:08.736 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:08:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:08.979 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-nbd 2023-12-16T03:08:09.240 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:09.841 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:57 ago on Sat 16 Dec 2023 03:05:12 AM UTC. 2023-12-16T03:08:10.003 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:10.003 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:10.003 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:08:10.003 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:08:10.003 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:10.003 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:08:10.249 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install rbd-nbd 2023-12-16T03:08:11.139 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:00 ago on Sat 16 Dec 2023 03:05:11 AM UTC. 2023-12-16T03:08:11.522 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 173 k 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-12-16T03:08:11.523 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:11.524 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 173 k 2023-12-16T03:08:11.524 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 552 k 2023-12-16T03:08:11.524 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-12-16T03:08:12.080 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el8.x86_64.rpm 311 kB/s | 173 kB 00:00 2023-12-16T03:08:12.080 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:08:12.081 INFO:teuthology.orchestra.run.smithi184.stdout:Total 310 kB/s | 173 kB 00:00 2023-12-16T03:08:12.081 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-12-16T03:08:12.092 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-12-16T03:08:12.092 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-12-16T03:08:12.145 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-12-16T03:08:12.148 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-12-16T03:08:12.270 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-12-16T03:08:12.498 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:12.770 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:12.945 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-12-16T03:08:12.945 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:08:12.945 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2023-12-16T03:08:12.946 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:08:12.946 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-12-16T03:08:12.946 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 173 k 2023-12-16T03:08:12.946 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:12.946 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-12-16T03:08:12.946 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-12-16T03:08:12.946 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2023-12-16T03:08:12.946 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:12.947 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 173 k 2023-12-16T03:08:12.947 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 552 k 2023-12-16T03:08:12.947 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-12-16T03:08:13.137 INFO:teuthology.orchestra.run.smithi064.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el8.x86_64.rpm 909 kB/s | 173 kB 00:00 2023-12-16T03:08:13.138 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:08:13.138 INFO:teuthology.orchestra.run.smithi064.stdout:Total 903 kB/s | 173 kB 00:00 2023-12-16T03:08:13.138 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-12-16T03:08:13.149 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-12-16T03:08:13.149 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-12-16T03:08:13.203 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-12-16T03:08:13.206 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-12-16T03:08:13.340 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-12-16T03:08:13.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:13.458 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:13.458 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-12-16T03:08:13.458 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:08:13.458 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:08:13.458 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-12-16T03:08:13.515 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:13.657 DEBUG:teuthology.parallel:result is None 2023-12-16T03:08:13.852 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:14.568 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T03:08:14.569 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:14.569 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-12-16T03:08:14.569 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T03:08:14.569 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:14.569 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-12-16T03:08:14.814 DEBUG:teuthology.parallel:result is None 2023-12-16T03:08:14.814 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T03:08:14.814 INFO:teuthology.packaging:ref: None 2023-12-16T03:08:14.815 INFO:teuthology.packaging:tag: None 2023-12-16T03:08:14.815 INFO:teuthology.packaging:branch: quincy 2023-12-16T03:08:14.815 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:08:14.815 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T03:08:15.035 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T03:08:15.058 INFO:teuthology.orchestra.run.smithi064.stdout:17.2.7-125.g1f2f5510.el8 2023-12-16T03:08:15.058 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el8 2023-12-16T03:08:15.059 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-16T03:08:15.060 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T03:08:15.060 INFO:teuthology.packaging:ref: None 2023-12-16T03:08:15.060 INFO:teuthology.packaging:tag: None 2023-12-16T03:08:15.060 INFO:teuthology.packaging:branch: quincy 2023-12-16T03:08:15.060 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:08:15.061 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T03:08:15.378 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T03:08:15.405 INFO:teuthology.orchestra.run.smithi184.stdout:17.2.7-125.g1f2f5510.el8 2023-12-16T03:08:15.405 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el8 2023-12-16T03:08:15.405 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-16T03:08:15.406 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-16T03:08:15.407 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:08:15.407 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T03:08:15.436 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:08:15.436 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T03:08:15.479 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-16T03:08:15.479 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:08:15.480 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T03:08:15.507 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T03:08:15.574 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:08:15.574 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T03:08:15.606 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T03:08:15.676 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-16T03:08:15.677 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:08:15.677 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T03:08:15.704 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T03:08:15.771 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:08:15.771 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T03:08:15.801 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T03:08:15.871 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-16T03:08:15.871 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:08:15.871 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T03:08:15.898 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T03:08:15.966 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:08:15.966 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T03:08:15.996 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T03:08:16.066 INFO:teuthology.run_tasks:Running task print... 2023-12-16T03:08:16.075 INFO:teuthology.task.print:**** done install task... 2023-12-16T03:08:16.075 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-16T03:08:16.291 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'} 2023-12-16T03:08:16.291 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-16T03:08:16.292 INFO:tasks.cephadm:Cluster fsid is 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:08:16.292 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-16T03:08:16.292 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-16T03:08:16.292 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi064': '172.21.15.64', 'mon.smithi184': '172.21.15.184'} 2023-12-16T03:08:16.292 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-16T03:08:16.292 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname $(hostname -s) 2023-12-16T03:08:16.322 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname $(hostname -s) 2023-12-16T03:08:16.354 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-16T03:08:16.354 DEBUG:teuthology.orchestra.run.smithi064:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-16T03:08:16.517 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 16 03:08 /home/ubuntu/cephtest/cephadm 2023-12-16T03:08:16.517 DEBUG:teuthology.orchestra.run.smithi184:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-16T03:08:16.688 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 16 03:08 /home/ubuntu/cephtest/cephadm 2023-12-16T03:08:16.689 DEBUG:teuthology.orchestra.run.smithi064:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-16T03:08:16.710 DEBUG:teuthology.orchestra.run.smithi184:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-16T03:08:16.742 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-16T03:08:16.742 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-16T03:08:16.753 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-16T03:08:17.849 INFO:teuthology.orchestra.run.smithi064.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T03:08:18.009 INFO:teuthology.orchestra.run.smithi184.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T03:08:43.900 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-12-16T03:08:43.900 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-16T03:08:43.900 INFO:teuthology.orchestra.run.smithi184.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-16T03:08:43.900 INFO:teuthology.orchestra.run.smithi184.stdout: "repo_digests": [ 2023-12-16T03:08:43.900 INFO:teuthology.orchestra.run.smithi184.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-16T03:08:43.900 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2023-12-16T03:08:43.900 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-12-16T03:08:46.417 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:08:46.417 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-16T03:08:46.417 INFO:teuthology.orchestra.run.smithi064.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-16T03:08:46.417 INFO:teuthology.orchestra.run.smithi064.stdout: "repo_digests": [ 2023-12-16T03:08:46.417 INFO:teuthology.orchestra.run.smithi064.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-16T03:08:46.418 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2023-12-16T03:08:46.418 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:08:46.436 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph 2023-12-16T03:08:46.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph 2023-12-16T03:08:46.505 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /etc/ceph 2023-12-16T03:08:46.534 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /etc/ceph 2023-12-16T03:08:46.579 INFO:tasks.cephadm:Writing seed config... 2023-12-16T03:08:46.580 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-16T03:08:46.580 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-16T03:08:46.580 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-16T03:08:46.580 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-16T03:08:46.580 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-16T03:08:46.581 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-16T03:08:46.582 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-16T03:08:46.583 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-16T03:08:46.583 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-16T03:08:46.583 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-16T03:08:46.583 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-16T03:08:46.583 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-16T03:08:46.584 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:08:46.584 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-16T03:08:46.602 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5b4de048-9bc0-11ee-95a5-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-16T03:08:46.602 DEBUG:teuthology.orchestra.run.smithi064:mon.smithi064> sudo journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi064.service 2023-12-16T03:08:46.644 INFO:tasks.cephadm:Bootstrapping... 2023-12-16T03:08:46.645 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.64 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-16T03:08:46.671 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:-- Logs begin at Sat 2023-12-16 02:56:13 UTC. -- 2023-12-16T03:08:46.853 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:08:46.854 INFO:teuthology.orchestra.run.smithi064.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '5b4de048-9bc0-11ee-95a5-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.64', '--skip-admin-label'] 2023-12-16T03:08:46.888 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stdout 4.6.1 2023-12-16T03:08:46.888 INFO:teuthology.orchestra.run.smithi064.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-16T03:08:46.888 INFO:teuthology.orchestra.run.smithi064.stdout:Verifying podman|docker is present... 2023-12-16T03:08:46.921 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stdout 4.6.1 2023-12-16T03:08:46.921 INFO:teuthology.orchestra.run.smithi064.stdout:Verifying lvm2 is present... 2023-12-16T03:08:46.921 INFO:teuthology.orchestra.run.smithi064.stdout:Verifying time synchronization is in place... 2023-12-16T03:08:46.928 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-16T03:08:46.928 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-16T03:08:46.934 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-16T03:08:46.934 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout inactive 2023-12-16T03:08:46.940 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout enabled 2023-12-16T03:08:46.946 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout active 2023-12-16T03:08:46.946 INFO:teuthology.orchestra.run.smithi064.stdout:Unit chronyd.service is enabled and running 2023-12-16T03:08:46.946 INFO:teuthology.orchestra.run.smithi064.stdout:Repeating the final host check... 2023-12-16T03:08:46.977 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stdout 4.6.1 2023-12-16T03:08:46.977 INFO:teuthology.orchestra.run.smithi064.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-16T03:08:46.977 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl is present 2023-12-16T03:08:46.977 INFO:teuthology.orchestra.run.smithi064.stdout:lvcreate is present 2023-12-16T03:08:46.983 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-16T03:08:46.983 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-16T03:08:46.989 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-16T03:08:46.989 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout inactive 2023-12-16T03:08:46.995 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout enabled 2023-12-16T03:08:47.001 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout active 2023-12-16T03:08:47.001 INFO:teuthology.orchestra.run.smithi064.stdout:Unit chronyd.service is enabled and running 2023-12-16T03:08:47.001 INFO:teuthology.orchestra.run.smithi064.stdout:Host looks OK 2023-12-16T03:08:47.002 INFO:teuthology.orchestra.run.smithi064.stdout:Cluster fsid: 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:08:47.002 INFO:teuthology.orchestra.run.smithi064.stdout:Acquiring lock 140117605321192 on /run/cephadm/5b4de048-9bc0-11ee-95a5-87774f69a715.lock 2023-12-16T03:08:47.002 INFO:teuthology.orchestra.run.smithi064.stdout:Lock 140117605321192 acquired on /run/cephadm/5b4de048-9bc0-11ee-95a5-87774f69a715.lock 2023-12-16T03:08:47.002 INFO:teuthology.orchestra.run.smithi064.stdout:Verifying IP 172.21.15.64 port 3300 ... 2023-12-16T03:08:47.002 INFO:teuthology.orchestra.run.smithi064.stdout:Verifying IP 172.21.15.64 port 6789 ... 2023-12-16T03:08:47.002 INFO:teuthology.orchestra.run.smithi064.stdout:Base mon IP(s) is [172.21.15.64:3300, 172.21.15.64:6789], mon addrv is [v2:172.21.15.64:3300,v1:172.21.15.64:6789] 2023-12-16T03:08:47.006 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.64 metric 100 2023-12-16T03:08:47.006 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.64 metric 100 2023-12-16T03:08:47.009 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-16T03:08:47.009 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-12-16T03:08:47.009 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1793sec hoplimit 64 pref medium 2023-12-16T03:08:47.012 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-16T03:08:47.012 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-16T03:08:47.012 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-16T03:08:47.012 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-16T03:08:47.012 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2023-12-16T03:08:47.012 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-16T03:08:47.013 INFO:teuthology.orchestra.run.smithi064.stdout:Mon IP `172.21.15.64` is in CIDR network `172.21.0.0/20` 2023-12-16T03:08:47.013 INFO:teuthology.orchestra.run.smithi064.stdout:Mon IP `172.21.15.64` is in CIDR network `172.21.0.0/20` 2023-12-16T03:08:47.013 INFO:teuthology.orchestra.run.smithi064.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-16T03:08:47.014 INFO:teuthology.orchestra.run.smithi064.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-16T03:08:47.015 INFO:teuthology.orchestra.run.smithi064.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T03:08:47.371 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stdout 60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-16T03:08:47.371 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T03:08:47.371 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stderr Getting image source signatures 2023-12-16T03:08:47.371 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stderr Copying blob sha256:3c21fa6304a567e69d15522c48775b11468df75d53cc353263c55c753e1a9b4e 2023-12-16T03:08:47.371 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2023-12-16T03:08:47.371 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stderr Copying config sha256:60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-16T03:08:47.371 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-16T03:08:48.053 INFO:teuthology.orchestra.run.smithi064.stdout:ceph: stdout ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-16T03:08:48.054 INFO:teuthology.orchestra.run.smithi064.stdout:Ceph version: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-16T03:08:48.054 INFO:teuthology.orchestra.run.smithi064.stdout:Extracting ceph user uid/gid from container image... 2023-12-16T03:08:48.665 INFO:teuthology.orchestra.run.smithi064.stdout:stat: stdout 167 167 2023-12-16T03:08:48.665 INFO:teuthology.orchestra.run.smithi064.stdout:Creating initial keys... 2023-12-16T03:08:49.312 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph-authtool: stdout AQDAFH1l/kGmNxAAXJXybiRm3GHBTJGn6GK/qA== 2023-12-16T03:08:49.929 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph-authtool: stdout AQDBFH1l+iCWIhAAYeWcquhw4Xv5e63y/Yjstg== 2023-12-16T03:08:50.528 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph-authtool: stdout AQDCFH1lJ1tqCxAAay7ybvSD/e0Cp+gFbEmt0A== 2023-12-16T03:08:50.529 INFO:teuthology.orchestra.run.smithi064.stdout:Creating initial monmap... 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout:monmaptool for smithi064 [v2:172.21.15.64:3300,v1:172.21.15.64:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout:setting min_mon_release = octopus 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/monmaptool: set fsid to 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:08:51.154 INFO:teuthology.orchestra.run.smithi064.stdout:Creating mon... 2023-12-16T03:08:51.789 INFO:teuthology.orchestra.run.smithi064.stdout:create mon.smithi064 on 2023-12-16T03:08:51.894 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-16T03:08:51.987 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-16T03:08:52.087 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715.target. 2023-12-16T03:08:52.087 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715.target. 2023-12-16T03:08:52.231 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi064 2023-12-16T03:08:52.231 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi064.service: Unit ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi064.service not loaded. 2023-12-16T03:08:52.331 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715.target.wants/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi064.service → /etc/systemd/system/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@.service. 2023-12-16T03:08:52.672 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:52 smithi064 systemd[1]: Starting Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:08:52.751 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T03:08:52.751 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout disabled 2023-12-16T03:08:52.759 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T03:08:52.759 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout inactive 2023-12-16T03:08:52.759 INFO:teuthology.orchestra.run.smithi064.stdout:firewalld.service is not enabled 2023-12-16T03:08:52.760 INFO:teuthology.orchestra.run.smithi064.stdout:Not possible to enable service . firewalld.service is not available 2023-12-16T03:08:52.760 INFO:teuthology.orchestra.run.smithi064.stdout:Waiting for mon to start... 2023-12-16T03:08:52.760 INFO:teuthology.orchestra.run.smithi064.stdout:Waiting for mon... 2023-12-16T03:08:53.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:52 smithi064 bash[111437]: 2dd4fa7eb2c8bf28cceab08e4502c270917cb9849000a97fddcb4672923ae92a 2023-12-16T03:08:53.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:52 smithi064 systemd[1]: Started Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:08:53.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:52 smithi064 ceph-mon[111475]: mkfs 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:08:53.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:52 smithi064 ceph-mon[111475]: mon.smithi064 is new leader, mons smithi064 in quorum (ranks 0) 2023-12-16T03:08:53.614 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout cluster: 2023-12-16T03:08:53.614 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout id: 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:08:53.615 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-16T03:08:53.615 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:08:53.615 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout services: 2023-12-16T03:08:53.615 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi064 (age 0.469663s) 2023-12-16T03:08:53.615 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-16T03:08:53.615 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-16T03:08:53.615 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:08:53.615 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout data: 2023-12-16T03:08:53.616 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-16T03:08:53.616 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-16T03:08:53.616 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-16T03:08:53.616 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout pgs: 2023-12-16T03:08:53.616 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:08:53.616 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.150+0000 7fea2f953700 1 Processor -- start 2023-12-16T03:08:53.616 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.150+0000 7fea2f953700 1 -- start start 2023-12-16T03:08:53.617 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.150+0000 7fea2f953700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea280760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:53.617 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.150+0000 7fea2f953700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea28077fe0 con 0x7fea28077bd0 2023-12-16T03:08:53.617 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.151+0000 7fea2d6ef700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea280760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:53.617 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.151+0000 7fea2d6ef700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea280760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37702/0 (socket says 172.21.15.64:37702) 2023-12-16T03:08:53.617 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.151+0000 7fea2d6ef700 1 -- 172.21.15.64:0/2845100173 learned_addr learned my addr 172.21.15.64:0/2845100173 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:53.618 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.151+0000 7fea2d6ef700 1 -- 172.21.15.64:0/2845100173 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28076620 con 0x7fea28077bd0 2023-12-16T03:08:53.618 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.151+0000 7fea2d6ef700 1 --2- 172.21.15.64:0/2845100173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea280760e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fea240098e0 tx=0x7fea24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517330f9fd5d7069 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:53.618 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.151+0000 7fea1bfff700 1 -- 172.21.15.64:0/2845100173 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea2400b860 con 0x7fea28077bd0 2023-12-16T03:08:53.618 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.151+0000 7fea1bfff700 1 -- 172.21.15.64:0/2845100173 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2400b9c0 con 0x7fea28077bd0 2023-12-16T03:08:53.618 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.151+0000 7fea1bfff700 1 -- 172.21.15.64:0/2845100173 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea2400bc90 con 0x7fea28077bd0 2023-12-16T03:08:53.618 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.152+0000 7fea2f953700 1 -- 172.21.15.64:0/2845100173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 msgr2=0x7fea280760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:53.619 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.152+0000 7fea2f953700 1 --2- 172.21.15.64:0/2845100173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea280760e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fea240098e0 tx=0x7fea24009250 comp rx=0 tx=0).stop 2023-12-16T03:08:53.619 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.152+0000 7fea2f953700 1 -- 172.21.15.64:0/2845100173 shutdown_connections 2023-12-16T03:08:53.619 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.152+0000 7fea2f953700 1 --2- 172.21.15.64:0/2845100173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea280760e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:53.619 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.152+0000 7fea2f953700 1 -- 172.21.15.64:0/2845100173 >> 172.21.15.64:0/2845100173 conn(0x7fea280fda50 msgr2=0x7fea280ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:53.619 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.152+0000 7fea2f953700 1 -- 172.21.15.64:0/2845100173 shutdown_connections 2023-12-16T03:08:53.619 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.152+0000 7fea2f953700 1 -- 172.21.15.64:0/2845100173 wait complete. 2023-12-16T03:08:53.619 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.152+0000 7fea2f953700 1 Processor -- start 2023-12-16T03:08:53.619 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.152+0000 7fea2f953700 1 -- start start 2023-12-16T03:08:53.619 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea2f953700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea28112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea2f953700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea281130c0 con 0x7fea28077bd0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea2d6ef700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea28112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea2d6ef700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea28112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37706/0 (socket says 172.21.15.64:37706) 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea2d6ef700 1 -- 172.21.15.64:0/2831103427 learned_addr learned my addr 172.21.15.64:0/2831103427 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea2d6ef700 1 -- 172.21.15.64:0/2831103427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240094f0 con 0x7fea28077bd0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea2d6ef700 1 --2- 172.21.15.64:0/2831103427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea28112b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fea24009290 tx=0x7fea24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea19ffb700 1 -- 172.21.15.64:0/2831103427 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea2401c5c0 con 0x7fea28077bd0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea19ffb700 1 -- 172.21.15.64:0/2831103427 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2401c740 con 0x7fea28077bd0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea19ffb700 1 -- 172.21.15.64:0/2831103427 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea2401ca50 con 0x7fea28077bd0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.153+0000 7fea2f953700 1 -- 172.21.15.64:0/2831103427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea281132c0 con 0x7fea28077bd0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.154+0000 7fea2f953700 1 -- 172.21.15.64:0/2831103427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea281136d0 con 0x7fea28077bd0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.154+0000 7fea19ffb700 1 -- 172.21.15.64:0/2831103427 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fea2401a450 con 0x7fea28077bd0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.154+0000 7fea19ffb700 1 -- 172.21.15.64:0/2831103427 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fea2402e790 con 0x7fea28077bd0 2023-12-16T03:08:53.620 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.155+0000 7fea2f953700 1 -- 172.21.15.64:0/2831103427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2804bb80 con 0x7fea28077bd0 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.157+0000 7fea19ffb700 1 -- 172.21.15.64:0/2831103427 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fea2401ce30 con 0x7fea28077bd0 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.229+0000 7fea2f953700 1 -- 172.21.15.64:0/2831103427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fea2810be00 con 0x7fea28077bd0 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.230+0000 7fea19ffb700 1 -- 172.21.15.64:0/2831103427 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fea2401a890 con 0x7fea28077bd0 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.230+0000 7fea2f953700 1 -- 172.21.15.64:0/2831103427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 msgr2=0x7fea28112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.230+0000 7fea2f953700 1 --2- 172.21.15.64:0/2831103427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea28112b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fea24009290 tx=0x7fea24016000 comp rx=0 tx=0).stop 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.230+0000 7fea2f953700 1 -- 172.21.15.64:0/2831103427 shutdown_connections 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.230+0000 7fea2f953700 1 --2- 172.21.15.64:0/2831103427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea28077bd0 0x7fea28112b80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.230+0000 7fea2f953700 1 -- 172.21.15.64:0/2831103427 >> 172.21.15.64:0/2831103427 conn(0x7fea280fda50 msgr2=0x7fea28107040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.230+0000 7fea2f953700 1 -- 172.21.15.64:0/2831103427 shutdown_connections 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.231+0000 7fea2f953700 1 -- 172.21.15.64:0/2831103427 wait complete. 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:mon is available 2023-12-16T03:08:53.621 INFO:teuthology.orchestra.run.smithi064.stdout:Assimilating anything we can from ceph.conf... 2023-12-16T03:08:53.806 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:53 smithi064 ceph-mon[111475]: mon.smithi064 is new leader, mons smithi064 in quorum (ranks 0) 2023-12-16T03:08:53.807 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:53 smithi064 ceph-mon[111475]: monmap e1: 1 mons at {smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T03:08:53.807 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:53 smithi064 ceph-mon[111475]: fsmap 2023-12-16T03:08:53.807 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:53 smithi064 ceph-mon[111475]: osdmap e1: 0 total, 0 up, 0 in 2023-12-16T03:08:53.807 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:53 smithi064 ceph-mon[111475]: mgrmap e1: no daemons active 2023-12-16T03:08:53.807 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:53 smithi064 ceph-mon[111475]: from='client.? 172.21.15.64:0/2831103427' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-16T03:08:54.437 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:08:54.437 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout [global] 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout fsid = 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.64:3300,v1:172.21.15.64:6789] 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout [osd] 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-16T03:08:54.438 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.987+0000 7f04d475c700 1 Processor -- start 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.987+0000 7f04d475c700 1 -- start start 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.987+0000 7f04d475c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc102be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.987+0000 7f04d475c700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc103120 con 0x7f04cc1027d0 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.988+0000 7f04d24f8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.988+0000 7f04d24f8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc102be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37708/0 (socket says 172.21.15.64:37708) 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.988+0000 7f04d24f8700 1 -- 172.21.15.64:0/3295925160 learned_addr learned my addr 172.21.15.64:0/3295925160 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.988+0000 7f04d24f8700 1 -- 172.21.15.64:0/3295925160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc103260 con 0x7f04cc1027d0 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.988+0000 7f04d24f8700 1 --2- 172.21.15.64:0/3295925160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc102be0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f04c000bb80 tx=0x7f04c000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99c0b2ee0d80a59 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.988+0000 7f04d14f6700 1 -- 172.21.15.64:0/3295925160 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04c000dd00 con 0x7f04cc1027d0 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.988+0000 7f04d14f6700 1 -- 172.21.15.64:0/3295925160 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c000de60 con 0x7f04cc1027d0 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.988+0000 7f04d14f6700 1 -- 172.21.15.64:0/3295925160 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04c00105f0 con 0x7f04cc1027d0 2023-12-16T03:08:54.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 -- 172.21.15.64:0/3295925160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 msgr2=0x7f04cc102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 --2- 172.21.15.64:0/3295925160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc102be0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f04c000bb80 tx=0x7f04c000b4f0 comp rx=0 tx=0).stop 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 -- 172.21.15.64:0/3295925160 shutdown_connections 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 --2- 172.21.15.64:0/3295925160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc102be0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 -- 172.21.15.64:0/3295925160 >> 172.21.15.64:0/3295925160 conn(0x7f04cc0fc0b0 msgr2=0x7f04cc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 -- 172.21.15.64:0/3295925160 shutdown_connections 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 -- 172.21.15.64:0/3295925160 wait complete. 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 Processor -- start 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 -- start start 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.989+0000 7f04d475c700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc113120 con 0x7f04cc1027d0 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04d24f8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04d24f8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc112be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37712/0 (socket says 172.21.15.64:37712) 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04d24f8700 1 -- 172.21.15.64:0/2177244349 learned_addr learned my addr 172.21.15.64:0/2177244349 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:54.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04d24f8700 1 -- 172.21.15.64:0/2177244349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c000b790 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04d24f8700 1 --2- 172.21.15.64:0/2177244349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc112be0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f04c000b530 tx=0x7f04c001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04beffd700 1 -- 172.21.15.64:0/2177244349 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04c00189b0 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04beffd700 1 -- 172.21.15.64:0/2177244349 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c0018b10 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04d475c700 1 -- 172.21.15.64:0/2177244349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc113320 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04beffd700 1 -- 172.21.15.64:0/2177244349 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04c0018e20 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04d475c700 1 -- 172.21.15.64:0/2177244349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc113730 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04beffd700 1 -- 172.21.15.64:0/2177244349 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f04c0022450 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.990+0000 7f04beffd700 1 -- 172.21.15.64:0/2177244349 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f04c0014070 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.991+0000 7f04d475c700 1 -- 172.21.15.64:0/2177244349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc04bb80 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:53.994+0000 7f04beffd700 1 -- 172.21.15.64:0/2177244349 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f04c0027070 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.065+0000 7f04d475c700 1 -- 172.21.15.64:0/2177244349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f04cc100480 con 0x7f04cc1027d0 2023-12-16T03:08:54.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.069+0000 7f04beffd700 1 -- 172.21.15.64:0/2177244349 <== mon.0 v2:172.21.15.64:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f04c000f3d0 con 0x7f04cc1027d0 2023-12-16T03:08:54.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.069+0000 7f04beffd700 1 -- 172.21.15.64:0/2177244349 <== mon.0 v2:172.21.15.64:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f04c0034540 con 0x7f04cc1027d0 2023-12-16T03:08:54.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.070+0000 7f04d475c700 1 -- 172.21.15.64:0/2177244349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 msgr2=0x7f04cc112be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:54.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.070+0000 7f04d475c700 1 --2- 172.21.15.64:0/2177244349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc112be0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f04c000b530 tx=0x7f04c001a000 comp rx=0 tx=0).stop 2023-12-16T03:08:54.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.070+0000 7f04d475c700 1 -- 172.21.15.64:0/2177244349 shutdown_connections 2023-12-16T03:08:54.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.070+0000 7f04d475c700 1 --2- 172.21.15.64:0/2177244349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04cc1027d0 0x7f04cc112be0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:54.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.070+0000 7f04d475c700 1 -- 172.21.15.64:0/2177244349 >> 172.21.15.64:0/2177244349 conn(0x7f04cc0fc0b0 msgr2=0x7f04cc0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:54.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.070+0000 7f04d475c700 1 -- 172.21.15.64:0/2177244349 shutdown_connections 2023-12-16T03:08:54.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.070+0000 7f04d475c700 1 -- 172.21.15.64:0/2177244349 wait complete. 2023-12-16T03:08:54.442 INFO:teuthology.orchestra.run.smithi064.stdout:Generating new minimal ceph.conf... 2023-12-16T03:08:55.074 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:54 smithi064 ceph-mon[111475]: from='client.? 172.21.15.64:0/2177244349' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-16T03:08:55.075 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:54 smithi064 ceph-mon[111475]: from='client.? 172.21.15.64:0/2177244349' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-16T03:08:55.201 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.772+0000 7fe9f3d27700 1 Processor -- start 2023-12-16T03:08:55.201 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.772+0000 7fe9f3d27700 1 -- start start 2023-12-16T03:08:55.201 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.772+0000 7fe9f3d27700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:55.201 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.772+0000 7fe9f3d27700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec102c20 con 0x7fe9ec1022d0 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.772+0000 7fe9f1ac3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.772+0000 7fe9f1ac3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37718/0 (socket says 172.21.15.64:37718) 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.772+0000 7fe9f1ac3700 1 -- 172.21.15.64:0/1663694632 learned_addr learned my addr 172.21.15.64:0/1663694632 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.773+0000 7fe9f1ac3700 1 -- 172.21.15.64:0/1663694632 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec102d60 con 0x7fe9ec1022d0 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.773+0000 7fe9f1ac3700 1 --2- 172.21.15.64:0/1663694632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec1026e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0098e0 tx=0x7fe9dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795a5cf051afb3be server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.773+0000 7fe9f0ac1700 1 -- 172.21.15.64:0/1663694632 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9dc00b860 con 0x7fe9ec1022d0 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.773+0000 7fe9f0ac1700 1 -- 172.21.15.64:0/1663694632 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe9dc00be30 con 0x7fe9ec1022d0 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.773+0000 7fe9f0ac1700 1 -- 172.21.15.64:0/1663694632 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9dc010380 con 0x7fe9ec1022d0 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.774+0000 7fe9f3d27700 1 -- 172.21.15.64:0/1663694632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 msgr2=0x7fe9ec1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.774+0000 7fe9f3d27700 1 --2- 172.21.15.64:0/1663694632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec1026e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0098e0 tx=0x7fe9dc009250 comp rx=0 tx=0).stop 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.774+0000 7fe9f3d27700 1 -- 172.21.15.64:0/1663694632 shutdown_connections 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.774+0000 7fe9f3d27700 1 --2- 172.21.15.64:0/1663694632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec1026e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.774+0000 7fe9f3d27700 1 -- 172.21.15.64:0/1663694632 >> 172.21.15.64:0/1663694632 conn(0x7fe9ec0fda50 msgr2=0x7fe9ec0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.774+0000 7fe9f3d27700 1 -- 172.21.15.64:0/1663694632 shutdown_connections 2023-12-16T03:08:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.774+0000 7fe9f3d27700 1 -- 172.21.15.64:0/1663694632 wait complete. 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.774+0000 7fe9f3d27700 1 Processor -- start 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9f3d27700 1 -- start start 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9f3d27700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9f3d27700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec076080 con 0x7fe9ec1022d0 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9f1ac3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9f1ac3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37728/0 (socket says 172.21.15.64:37728) 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9f1ac3700 1 -- 172.21.15.64:0/2008534141 learned_addr learned my addr 172.21.15.64:0/2008534141 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9f1ac3700 1 -- 172.21.15.64:0/2008534141 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0094f0 con 0x7fe9ec1022d0 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9f1ac3700 1 --2- 172.21.15.64:0/2008534141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec077c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc000c00 tx=0x7fe9dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9e27fc700 1 -- 172.21.15.64:0/2008534141 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9dc010a80 con 0x7fe9ec1022d0 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9e27fc700 1 -- 172.21.15.64:0/2008534141 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe9dc01a430 con 0x7fe9ec1022d0 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9f3d27700 1 -- 172.21.15.64:0/2008534141 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec076280 con 0x7fe9ec1022d0 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.775+0000 7fe9e27fc700 1 -- 172.21.15.64:0/2008534141 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9dc0245b0 con 0x7fe9ec1022d0 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.776+0000 7fe9f3d27700 1 -- 172.21.15.64:0/2008534141 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec076690 con 0x7fe9ec1022d0 2023-12-16T03:08:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.776+0000 7fe9e27fc700 1 -- 172.21.15.64:0/2008534141 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe9dc024a70 con 0x7fe9ec1022d0 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.776+0000 7fe9e27fc700 1 -- 172.21.15.64:0/2008534141 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe9dc02eb50 con 0x7fe9ec1022d0 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.776+0000 7fe9f3d27700 1 -- 172.21.15.64:0/2008534141 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec04bb80 con 0x7fe9ec1022d0 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.779+0000 7fe9e27fc700 1 -- 172.21.15.64:0/2008534141 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe9dc01a960 con 0x7fe9ec1022d0 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.850+0000 7fe9f3d27700 1 -- 172.21.15.64:0/2008534141 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe9ec1041d0 con 0x7fe9ec1022d0 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.850+0000 7fe9e27fc700 1 -- 172.21.15.64:0/2008534141 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fe9dc02ed60 con 0x7fe9ec1022d0 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.851+0000 7fe9f3d27700 1 -- 172.21.15.64:0/2008534141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 msgr2=0x7fe9ec077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.851+0000 7fe9f3d27700 1 --2- 172.21.15.64:0/2008534141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec077c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc000c00 tx=0x7fe9dc009250 comp rx=0 tx=0).stop 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.851+0000 7fe9f3d27700 1 -- 172.21.15.64:0/2008534141 shutdown_connections 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.851+0000 7fe9f3d27700 1 --2- 172.21.15.64:0/2008534141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9ec1022d0 0x7fe9ec077c00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.851+0000 7fe9f3d27700 1 -- 172.21.15.64:0/2008534141 >> 172.21.15.64:0/2008534141 conn(0x7fe9ec0fda50 msgr2=0x7fe9ec0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.851+0000 7fe9f3d27700 1 -- 172.21.15.64:0/2008534141 shutdown_connections 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:54.851+0000 7fe9f3d27700 1 -- 172.21.15.64:0/2008534141 wait complete. 2023-12-16T03:08:55.204 INFO:teuthology.orchestra.run.smithi064.stdout:Restarting the monitor... 2023-12-16T03:08:55.377 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:55 smithi064 systemd[1]: Stopping Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:08:55.679 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:55 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064[111452]: 2023-12-16T03:08:55.374+0000 7f711a669700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi064 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:08:55.679 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:55 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064[111452]: 2023-12-16T03:08:55.374+0000 7f711a669700 -1 mon.smithi064@0(leader) e1 *** Got Signal Terminated *** 2023-12-16T03:08:55.679 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:55 smithi064 bash[111800]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064 2023-12-16T03:08:55.941 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:55 smithi064 systemd[1]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi064.service: Succeeded. 2023-12-16T03:08:55.941 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:55 smithi064 systemd[1]: Stopped Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:08:55.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:55 smithi064 systemd[1]: Starting Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:08:56.190 INFO:teuthology.orchestra.run.smithi064.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-16T03:08:56.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T03:08:56.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable), process ceph-mon, pid 7 2023-12-16T03:08:56.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: pidfile_write: ignore empty --pid-file 2023-12-16T03:08:56.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: load: jerasure load: lrc 2023-12-16T03:08:56.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: RocksDB version: 6.15.5 2023-12-16T03:08:56.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-16T03:08:56.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Compile date Dec 13 2023 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: DB SUMMARY 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: DB Session ID: E4BSUAMVQ33CIZBC9ORU 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: CURRENT file: CURRENT 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi064/store.db dir, Total Num: 1, files: 000008.sst 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi064/store.db: 000010.log size: 95334 ; 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.error_if_exists: 0 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.create_if_missing: 0 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.paranoid_checks: 1 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.env: 0x55be2544fa80 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.fs: Posix File System 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.info_log: 0x55be266a4780 2023-12-16T03:08:56.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.statistics: (nil) 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.use_fsync: 0 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_log_file_size: 0 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.allow_fallocate: 1 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.use_direct_reads: 0 2023-12-16T03:08:56.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.db_log_dir: 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi064/store.db 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.write_buffer_manager: 0x55be274149f0 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 bash[111921]: 302d0d58c306c0e98502e549a5ce5c81b868ac55cecf96f98afdc626c5e55cb5 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T03:08:56.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.unordered_write: 0 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.row_cache: None 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.wal_filter: None 2023-12-16T03:08:56.447 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.preserve_deletes: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.two_write_queues: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.atomic_flush: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.log_readahead_size: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T03:08:56.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_background_jobs: 2 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_background_compactions: -1 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_subcompactions: 1 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_open_files: -1 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T03:08:56.449 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_background_flushes: -1 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Compression algorithms supported: 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: kZSTD supported: 0 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: kXpressCompression supported: 0 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: kZlibCompression supported: 1 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: kSnappyCompression supported: 1 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: kLZ4Compression supported: 1 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: kBZip2Compression supported: 0 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi064/store.db/MANIFEST-000009 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-16T03:08:56.450 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.merge_operator: 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_filter: None 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55be266f4f90) 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: cache_index_and_filter_blocks: 1 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: pin_top_level_index_and_filter: 1 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_type: 0 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_block_index_type: 0 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_shortening: 1 2023-12-16T03:08:56.451 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: hash_index_allow_collision: 1 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: checksum: 1 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: no_block_cache: 0 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache: 0x55be26727090 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_name: BinnedLRUCache 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_options: 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: capacity : 536870912 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: num_shard_bits : 4 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: strict_capacity_limit : 0 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: high_pri_pool_ratio: 0.000 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_compressed: (nil) 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: persistent_cache: (nil) 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_size: 4096 2023-12-16T03:08:56.452 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_size_deviation: 10 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_restart_interval: 16 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_block_restart_interval: 1 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: metadata_block_size: 4096 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: partition_filters: 0 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: use_delta_encoding: 1 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: whole_key_filtering: 1 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: verify_compression: 0 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: read_amp_bytes_per_bit: 0 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: format_version: 4 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: enable_index_compression: 1 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_align: 0 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T03:08:56.453 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compression: NoCompression 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.num_levels: 7 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T03:08:56.454 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T03:08:56.455 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.arena_block_size: 4194304 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T03:08:56.456 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.table_properties_collectors: 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.inplace_update_support: 0 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T03:08:56.457 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.bloom_locality: 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.max_successive_merges: 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.ttl: 2592000 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.enable_blob_files: false 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.min_blob_size: 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi064/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T03:08:56.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696136186080, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696136186903, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90860, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88955, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13169, "raw_average_key_size": 49, "raw_value_size": 81733, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 264, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702696136, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "18799e5e-de2a-4198-b960-0a57a469ed56", "db_session_id": "E4BSUAMVQ33CIZBC9ORU"}} 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696136187234, "job": 1, "event": "recovery_finished"} 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi064/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55be266bb180 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: DB pointer 0x55be26790000 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** DB Stats ** 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:08:56.459 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.001 0 0 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.001 0 0 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.001 0 0 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T03:08:56.460 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 162.3 0.00 0.00 1 0.001 0 0 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative compaction: 0.00 GB write, 28.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval compaction: 0.00 GB write, 28.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:08:56.461 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.001 0 0 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.3 0.00 0.00 1 0.001 0 0 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:08:56.462 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 162.3 0.00 0.00 1 0.001 0 0 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative compaction: 0.00 GB write, 27.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 systemd[1]: Started Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: starting mon.smithi064 rank 0 at public addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] at bind addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi064 fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:08:56.463 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mon.smithi064@-1(???) e1 preinit fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mon.smithi064@-1(???).mds e1 new map 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mon.smithi064@-1(???).mds e1 print_map 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: e1 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: legacy client fscid: -1 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: No filesystems configured 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mon.smithi064@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mon.smithi064@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mon.smithi064@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mon.smithi064@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mon.smithi064@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-16T03:08:56.464 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mon.smithi064 is new leader, mons smithi064 in quorum (ranks 0) 2023-12-16T03:08:56.465 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: monmap e1: 1 mons at {smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T03:08:56.465 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: fsmap 2023-12-16T03:08:56.465 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: osdmap e1: 0 total, 0 up, 0 in 2023-12-16T03:08:56.465 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:56 smithi064 ceph-mon[111958]: mgrmap e1: no daemons active 2023-12-16T03:08:56.955 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.527+0000 7f0178e7b700 1 Processor -- start 2023-12-16T03:08:56.960 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.527+0000 7f0178e7b700 1 -- start start 2023-12-16T03:08:56.960 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.528+0000 7f0178e7b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f0174102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:56.960 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.528+0000 7f0178e7b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01741030d0 con 0x7f0174102780 2023-12-16T03:08:56.960 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.528+0000 7f017259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f0174102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:56.960 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.528+0000 7f017259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f0174102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37730/0 (socket says 172.21.15.64:37730) 2023-12-16T03:08:56.960 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.528+0000 7f017259c700 1 -- 172.21.15.64:0/3538686853 learned_addr learned my addr 172.21.15.64:0/3538686853 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:56.960 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.529+0000 7f017259c700 1 -- 172.21.15.64:0/3538686853 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0174103210 con 0x7f0174102780 2023-12-16T03:08:56.960 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.529+0000 7f017259c700 1 --2- 172.21.15.64:0/3538686853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f0174102b90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f016400bb80 tx=0x7f016400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7da73adce64b74 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.529+0000 7f017159a700 1 -- 172.21.15.64:0/3538686853 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f016400dd00 con 0x7f0174102780 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.529+0000 7f017159a700 1 -- 172.21.15.64:0/3538686853 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f016400de60 con 0x7f0174102780 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.529+0000 7f017159a700 1 -- 172.21.15.64:0/3538686853 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0164018840 con 0x7f0174102780 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.529+0000 7f0178e7b700 1 -- 172.21.15.64:0/3538686853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 msgr2=0x7f0174102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.529+0000 7f0178e7b700 1 --2- 172.21.15.64:0/3538686853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f0174102b90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f016400bb80 tx=0x7f016400b4f0 comp rx=0 tx=0).stop 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f0178e7b700 1 -- 172.21.15.64:0/3538686853 shutdown_connections 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f0178e7b700 1 --2- 172.21.15.64:0/3538686853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f0174102b90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f0178e7b700 1 -- 172.21.15.64:0/3538686853 >> 172.21.15.64:0/3538686853 conn(0x7f01740fc0b0 msgr2=0x7f01740fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f0178e7b700 1 -- 172.21.15.64:0/3538686853 shutdown_connections 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f0178e7b700 1 -- 172.21.15.64:0/3538686853 wait complete. 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f0178e7b700 1 Processor -- start 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f0178e7b700 1 -- start start 2023-12-16T03:08:56.961 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f0178e7b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f017410ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f0178e7b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017410f470 con 0x7f0174102780 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f017259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f017410ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f017259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f017410ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37732/0 (socket says 172.21.15.64:37732) 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.530+0000 7f017259c700 1 -- 172.21.15.64:0/2951315448 learned_addr learned my addr 172.21.15.64:0/2951315448 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.531+0000 7f017259c700 1 -- 172.21.15.64:0/2951315448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016400b790 con 0x7f0174102780 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.531+0000 7f017259c700 1 --2- 172.21.15.64:0/2951315448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f017410ef30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0164018460 tx=0x7f016400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.531+0000 7f0162ffd700 1 -- 172.21.15.64:0/2951315448 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01640108e0 con 0x7f0174102780 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.531+0000 7f0162ffd700 1 -- 172.21.15.64:0/2951315448 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f016401d050 con 0x7f0174102780 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.531+0000 7f0178e7b700 1 -- 172.21.15.64:0/2951315448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017410f670 con 0x7f0174102780 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.531+0000 7f0162ffd700 1 -- 172.21.15.64:0/2951315448 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01640223d0 con 0x7f0174102780 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.531+0000 7f0178e7b700 1 -- 172.21.15.64:0/2951315448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017410fa80 con 0x7f0174102780 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.532+0000 7f0162ffd700 1 -- 172.21.15.64:0/2951315448 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0164023470 con 0x7f0174102780 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.532+0000 7f0178e7b700 1 -- 172.21.15.64:0/2951315448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017404bb80 con 0x7f0174102780 2023-12-16T03:08:56.962 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.532+0000 7f0162ffd700 1 -- 172.21.15.64:0/2951315448 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0164014070 con 0x7f0174102780 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.534+0000 7f0162ffd700 1 -- 172.21.15.64:0/2951315448 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0164006c90 con 0x7f0174102780 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.605+0000 7f0178e7b700 1 -- 172.21.15.64:0/2951315448 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f0174100ef0 con 0x7f0174102780 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.608+0000 7f0162ffd700 1 -- 172.21.15.64:0/2951315448 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0164022690 con 0x7f0174102780 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.609+0000 7f0178e7b700 1 -- 172.21.15.64:0/2951315448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 msgr2=0x7f017410ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.609+0000 7f0178e7b700 1 --2- 172.21.15.64:0/2951315448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f017410ef30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0164018460 tx=0x7f016400b4f0 comp rx=0 tx=0).stop 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.609+0000 7f0178e7b700 1 -- 172.21.15.64:0/2951315448 shutdown_connections 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.609+0000 7f0178e7b700 1 --2- 172.21.15.64:0/2951315448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0174102780 0x7f017410ef30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.609+0000 7f0178e7b700 1 -- 172.21.15.64:0/2951315448 >> 172.21.15.64:0/2951315448 conn(0x7f01740fc0b0 msgr2=0x7f0174105f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.609+0000 7f0178e7b700 1 -- 172.21.15.64:0/2951315448 shutdown_connections 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:56.609+0000 7f0178e7b700 1 -- 172.21.15.64:0/2951315448 wait complete. 2023-12-16T03:08:56.963 INFO:teuthology.orchestra.run.smithi064.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-16T03:08:56.964 INFO:teuthology.orchestra.run.smithi064.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-16T03:08:56.964 INFO:teuthology.orchestra.run.smithi064.stdout:Creating mgr... 2023-12-16T03:08:56.964 INFO:teuthology.orchestra.run.smithi064.stdout:Verifying port 9283 ... 2023-12-16T03:08:57.092 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mgr.smithi064.ueciyw 2023-12-16T03:08:57.093 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mgr.smithi064.ueciyw.service: Unit ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mgr.smithi064.ueciyw.service not loaded. 2023-12-16T03:08:57.189 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715.target.wants/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mgr.smithi064.ueciyw.service → /etc/systemd/system/ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@.service. 2023-12-16T03:08:57.618 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T03:08:57.618 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout disabled 2023-12-16T03:08:57.626 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T03:08:57.626 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout inactive 2023-12-16T03:08:57.626 INFO:teuthology.orchestra.run.smithi064.stdout:firewalld.service is not enabled 2023-12-16T03:08:57.626 INFO:teuthology.orchestra.run.smithi064.stdout:Not possible to enable service . firewalld.service is not available 2023-12-16T03:08:57.634 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T03:08:57.634 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout disabled 2023-12-16T03:08:57.643 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T03:08:57.643 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout inactive 2023-12-16T03:08:57.643 INFO:teuthology.orchestra.run.smithi064.stdout:firewalld.service is not enabled 2023-12-16T03:08:57.643 INFO:teuthology.orchestra.run.smithi064.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-16T03:08:57.643 INFO:teuthology.orchestra.run.smithi064.stdout:Waiting for mgr to start... 2023-12-16T03:08:57.643 INFO:teuthology.orchestra.run.smithi064.stdout:Waiting for mgr... 2023-12-16T03:08:57.891 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:57 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2951315448' entity='client.admin' 2023-12-16T03:08:58.474 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:08:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout { 2023-12-16T03:08:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "fsid": "5b4de048-9bc0-11ee-95a5-87774f69a715", 2023-12-16T03:08:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T03:08:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T03:08:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T03:08:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T03:08:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:08:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T03:08:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 0 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "smithi064" 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T03:08:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:08:58.477 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T03:08:58.477 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T03:08:58.477 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T03:08:58.484 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T03:08:58.484 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T03:08:58.484 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T03:08:58.484 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:08:58.484 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T03:08:58.484 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T03:08:58.485 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T03:08:52.762398+0000", 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T03:08:58.486 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout } 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.049+0000 7fb10bac6700 1 Processor -- start 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.049+0000 7fb10bac6700 1 -- start start 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.049+0000 7fb10bac6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.049+0000 7fb10bac6700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb104102d10 con 0x7fb104070f80 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.049+0000 7fb109862700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.049+0000 7fb109862700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37766/0 (socket says 172.21.15.64:37766) 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.049+0000 7fb109862700 1 -- 172.21.15.64:0/3044090521 learned_addr learned my addr 172.21.15.64:0/3044090521 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.050+0000 7fb109862700 1 -- 172.21.15.64:0/3044090521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104107860 con 0x7fb104070f80 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.050+0000 7fb109862700 1 --2- 172.21.15.64:0/3044090521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104107320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb1000098e0 tx=0x7fb100009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bedd83ac879c8c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.050+0000 7fb108860700 1 -- 172.21.15.64:0/3044090521 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb10000b860 con 0x7fb104070f80 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.050+0000 7fb108860700 1 -- 172.21.15.64:0/3044090521 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb10000be30 con 0x7fb104070f80 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.050+0000 7fb108860700 1 -- 172.21.15.64:0/3044090521 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb100010380 con 0x7fb104070f80 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.051+0000 7fb10bac6700 1 -- 172.21.15.64:0/3044090521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 msgr2=0x7fb104107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.051+0000 7fb10bac6700 1 --2- 172.21.15.64:0/3044090521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104107320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb1000098e0 tx=0x7fb100009250 comp rx=0 tx=0).stop 2023-12-16T03:08:58.487 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.051+0000 7fb10bac6700 1 -- 172.21.15.64:0/3044090521 shutdown_connections 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.051+0000 7fb10bac6700 1 --2- 172.21.15.64:0/3044090521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104107320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.051+0000 7fb10bac6700 1 -- 172.21.15.64:0/3044090521 >> 172.21.15.64:0/3044090521 conn(0x7fb1040fc970 msgr2=0x7fb1040fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.051+0000 7fb10bac6700 1 -- 172.21.15.64:0/3044090521 shutdown_connections 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.051+0000 7fb10bac6700 1 -- 172.21.15.64:0/3044090521 wait complete. 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.051+0000 7fb10bac6700 1 Processor -- start 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.052+0000 7fb10bac6700 1 -- start start 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.052+0000 7fb10bac6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.052+0000 7fb10bac6700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1041138c0 con 0x7fb104070f80 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.052+0000 7fb109862700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.052+0000 7fb109862700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37780/0 (socket says 172.21.15.64:37780) 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.052+0000 7fb109862700 1 -- 172.21.15.64:0/810502479 learned_addr learned my addr 172.21.15.64:0/810502479 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.052+0000 7fb109862700 1 -- 172.21.15.64:0/810502479 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1000094f0 con 0x7fb104070f80 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.052+0000 7fb109862700 1 --2- 172.21.15.64:0/810502479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb100006d40 tx=0x7fb100009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.053+0000 7fb0fa7fc700 1 -- 172.21.15.64:0/810502479 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1000109b0 con 0x7fb104070f80 2023-12-16T03:08:58.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.053+0000 7fb0fa7fc700 1 -- 172.21.15.64:0/810502479 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb100024440 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.053+0000 7fb10bac6700 1 -- 172.21.15.64:0/810502479 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb104113ac0 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.053+0000 7fb0fa7fc700 1 -- 172.21.15.64:0/810502479 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb10001a5f0 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.053+0000 7fb10bac6700 1 -- 172.21.15.64:0/810502479 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb104113ed0 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.053+0000 7fb0fa7fc700 1 -- 172.21.15.64:0/810502479 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb10001aaf0 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.053+0000 7fb0fa7fc700 1 -- 172.21.15.64:0/810502479 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb10002da60 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.054+0000 7fb10bac6700 1 -- 172.21.15.64:0/810502479 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10404bb80 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.056+0000 7fb0fa7fc700 1 -- 172.21.15.64:0/810502479 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb100024970 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.131+0000 7fb10bac6700 1 -- 172.21.15.64:0/810502479 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb1041084f0 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.131+0000 7fb0fa7fc700 1 -- 172.21.15.64:0/810502479 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fb1000245b0 con 0x7fb104070f80 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.132+0000 7fb10bac6700 1 -- 172.21.15.64:0/810502479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 msgr2=0x7fb104113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.132+0000 7fb10bac6700 1 --2- 172.21.15.64:0/810502479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb100006d40 tx=0x7fb100009250 comp rx=0 tx=0).stop 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.132+0000 7fb10bac6700 1 -- 172.21.15.64:0/810502479 shutdown_connections 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.132+0000 7fb10bac6700 1 --2- 172.21.15.64:0/810502479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb104070f80 0x7fb104113380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:08:58.489 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.132+0000 7fb10bac6700 1 -- 172.21.15.64:0/810502479 >> 172.21.15.64:0/810502479 conn(0x7fb1040fc970 msgr2=0x7fb1040fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:08:58.490 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.132+0000 7fb10bac6700 1 -- 172.21.15.64:0/810502479 shutdown_connections 2023-12-16T03:08:58.490 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:08:58.132+0000 7fb10bac6700 1 -- 172.21.15.64:0/810502479 wait complete. 2023-12-16T03:08:58.490 INFO:teuthology.orchestra.run.smithi064.stdout:mgr not available, waiting (1/15)... 2023-12-16T03:08:58.940 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:08:58 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/810502479' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T03:09:01.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:01 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2179040541' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T03:09:01.562 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:09:01.565 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout { 2023-12-16T03:09:01.565 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "fsid": "5b4de048-9bc0-11ee-95a5-87774f69a715", 2023-12-16T03:09:01.565 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T03:09:01.565 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T03:09:01.565 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T03:09:01.565 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T03:09:01.565 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:01.565 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T03:09:01.565 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 0 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "smithi064" 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T03:09:01.566 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T03:09:01.567 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T03:09:01.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T03:09:01.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T03:09:01.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:01.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:01.576 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T03:08:52.762398+0000", 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout } 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.082+0000 7f8f6ea33700 1 Processor -- start 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.082+0000 7f8f6ea33700 1 -- start start 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.082+0000 7f8f6ea33700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f681026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.082+0000 7f8f6ea33700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f68102c20 con 0x7f8f681022d0 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.083+0000 7f8f67fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f681026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.083+0000 7f8f67fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f681026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37796/0 (socket says 172.21.15.64:37796) 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.083+0000 7f8f67fff700 1 -- 172.21.15.64:0/1912528701 learned_addr learned my addr 172.21.15.64:0/1912528701 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.083+0000 7f8f67fff700 1 -- 172.21.15.64:0/1912528701 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68102d60 con 0x7f8f681022d0 2023-12-16T03:09:01.577 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.083+0000 7f8f67fff700 1 --2- 172.21.15.64:0/1912528701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f681026e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f580098e0 tx=0x7f8f58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d392fb4b6037ac server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.083+0000 7f8f66ffd700 1 -- 172.21.15.64:0/1912528701 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f5800b860 con 0x7f8f681022d0 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.083+0000 7f8f66ffd700 1 -- 172.21.15.64:0/1912528701 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8f5800be30 con 0x7f8f681022d0 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.083+0000 7f8f66ffd700 1 -- 172.21.15.64:0/1912528701 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f58010380 con 0x7f8f681022d0 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.084+0000 7f8f6ea33700 1 -- 172.21.15.64:0/1912528701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 msgr2=0x7f8f681026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.084+0000 7f8f6ea33700 1 --2- 172.21.15.64:0/1912528701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f681026e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f580098e0 tx=0x7f8f58009250 comp rx=0 tx=0).stop 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.084+0000 7f8f6ea33700 1 -- 172.21.15.64:0/1912528701 shutdown_connections 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.084+0000 7f8f6ea33700 1 --2- 172.21.15.64:0/1912528701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f681026e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.084+0000 7f8f6ea33700 1 -- 172.21.15.64:0/1912528701 >> 172.21.15.64:0/1912528701 conn(0x7f8f680fda50 msgr2=0x7f8f680ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.084+0000 7f8f6ea33700 1 -- 172.21.15.64:0/1912528701 shutdown_connections 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.084+0000 7f8f6ea33700 1 -- 172.21.15.64:0/1912528701 wait complete. 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.085+0000 7f8f6ea33700 1 Processor -- start 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.085+0000 7f8f6ea33700 1 -- start start 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.085+0000 7f8f6ea33700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f68077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.085+0000 7f8f6ea33700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f68076080 con 0x7f8f681022d0 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.085+0000 7f8f67fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f68077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:01.578 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.085+0000 7f8f67fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f68077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37798/0 (socket says 172.21.15.64:37798) 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.085+0000 7f8f67fff700 1 -- 172.21.15.64:0/2179040541 learned_addr learned my addr 172.21.15.64:0/2179040541 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.086+0000 7f8f67fff700 1 -- 172.21.15.64:0/2179040541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580094f0 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.086+0000 7f8f67fff700 1 --2- 172.21.15.64:0/2179040541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f68077c00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f58000c00 tx=0x7f8f58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.086+0000 7f8f64ff9700 1 -- 172.21.15.64:0/2179040541 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f58010a80 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.086+0000 7f8f64ff9700 1 -- 172.21.15.64:0/2179040541 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8f5801a430 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.086+0000 7f8f6ea33700 1 -- 172.21.15.64:0/2179040541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f68076280 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.086+0000 7f8f64ff9700 1 -- 172.21.15.64:0/2179040541 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f580245b0 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.086+0000 7f8f6ea33700 1 -- 172.21.15.64:0/2179040541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f68076690 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.086+0000 7f8f64ff9700 1 -- 172.21.15.64:0/2179040541 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8f58024a20 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.086+0000 7f8f64ff9700 1 -- 172.21.15.64:0/2179040541 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8f5802eb00 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.087+0000 7f8f6ea33700 1 -- 172.21.15.64:0/2179040541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6804bb80 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.089+0000 7f8f64ff9700 1 -- 172.21.15.64:0/2179040541 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8f5801a960 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.163+0000 7f8f6ea33700 1 -- 172.21.15.64:0/2179040541 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8f681041d0 con 0x7f8f681022d0 2023-12-16T03:09:01.579 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.163+0000 7f8f64ff9700 1 -- 172.21.15.64:0/2179040541 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f8f5802ed10 con 0x7f8f681022d0 2023-12-16T03:09:01.580 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.164+0000 7f8f6ea33700 1 -- 172.21.15.64:0/2179040541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 msgr2=0x7f8f68077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:01.580 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.164+0000 7f8f6ea33700 1 --2- 172.21.15.64:0/2179040541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f68077c00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f58000c00 tx=0x7f8f58009250 comp rx=0 tx=0).stop 2023-12-16T03:09:01.580 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.164+0000 7f8f6ea33700 1 -- 172.21.15.64:0/2179040541 shutdown_connections 2023-12-16T03:09:01.580 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.164+0000 7f8f6ea33700 1 --2- 172.21.15.64:0/2179040541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f681022d0 0x7f8f68077c00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:01.580 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.164+0000 7f8f6ea33700 1 -- 172.21.15.64:0/2179040541 >> 172.21.15.64:0/2179040541 conn(0x7f8f680fda50 msgr2=0x7f8f680ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:01.580 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.164+0000 7f8f6ea33700 1 -- 172.21.15.64:0/2179040541 shutdown_connections 2023-12-16T03:09:01.580 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:01.164+0000 7f8f6ea33700 1 -- 172.21.15.64:0/2179040541 wait complete. 2023-12-16T03:09:01.580 INFO:teuthology.orchestra.run.smithi064.stdout:mgr not available, waiting (2/15)... 2023-12-16T03:09:04.306 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:04 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/358607876' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T03:09:04.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:09:04.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout { 2023-12-16T03:09:04.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "fsid": "5b4de048-9bc0-11ee-95a5-87774f69a715", 2023-12-16T03:09:04.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T03:09:04.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T03:09:04.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 0 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "smithi064" 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:04.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T03:09:04.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:04.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T03:09:04.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T03:09:04.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T03:09:04.390 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T03:09:04.391 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:09:04.392 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T03:08:52.762398+0000", 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout } 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.928+0000 7f8df27a8700 1 Processor -- start 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.928+0000 7f8df27a8700 1 -- start start 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.928+0000 7f8df27a8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.928+0000 7f8df27a8700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec105420 con 0x7f8dec070fc0 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.928+0000 7f8debfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.928+0000 7f8debfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35092/0 (socket says 172.21.15.64:35092) 2023-12-16T03:09:04.393 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.928+0000 7f8debfff700 1 -- 172.21.15.64:0/3183696686 learned_addr learned my addr 172.21.15.64:0/3183696686 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.928+0000 7f8debfff700 1 -- 172.21.15.64:0/3183696686 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec105560 con 0x7f8dec070fc0 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.929+0000 7f8debfff700 1 --2- 172.21.15.64:0/3183696686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec104ee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0098e0 tx=0x7f8ddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cfb63a204bad13 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.929+0000 7f8deaffd700 1 -- 172.21.15.64:0/3183696686 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ddc00b860 con 0x7f8dec070fc0 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.929+0000 7f8deaffd700 1 -- 172.21.15.64:0/3183696686 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8ddc00be30 con 0x7f8dec070fc0 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.929+0000 7f8deaffd700 1 -- 172.21.15.64:0/3183696686 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ddc010380 con 0x7f8dec070fc0 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.929+0000 7f8df27a8700 1 -- 172.21.15.64:0/3183696686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 msgr2=0x7f8dec104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.929+0000 7f8df27a8700 1 --2- 172.21.15.64:0/3183696686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec104ee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0098e0 tx=0x7f8ddc009250 comp rx=0 tx=0).stop 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.929+0000 7f8df27a8700 1 -- 172.21.15.64:0/3183696686 shutdown_connections 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.929+0000 7f8df27a8700 1 --2- 172.21.15.64:0/3183696686 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec104ee0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.929+0000 7f8df27a8700 1 -- 172.21.15.64:0/3183696686 >> 172.21.15.64:0/3183696686 conn(0x7f8dec0fc970 msgr2=0x7f8dec0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.930+0000 7f8df27a8700 1 -- 172.21.15.64:0/3183696686 shutdown_connections 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.930+0000 7f8df27a8700 1 -- 172.21.15.64:0/3183696686 wait complete. 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.930+0000 7f8df27a8700 1 Processor -- start 2023-12-16T03:09:04.394 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.930+0000 7f8df27a8700 1 -- start start 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.930+0000 7f8df27a8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.930+0000 7f8df27a8700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec1116c0 con 0x7f8dec070fc0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8debfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8debfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35102/0 (socket says 172.21.15.64:35102) 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8debfff700 1 -- 172.21.15.64:0/358607876 learned_addr learned my addr 172.21.15.64:0/358607876 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8debfff700 1 -- 172.21.15.64:0/358607876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0094f0 con 0x7f8dec070fc0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8debfff700 1 --2- 172.21.15.64:0/358607876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec111180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc006d40 tx=0x7f8ddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8de8ff9700 1 -- 172.21.15.64:0/358607876 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ddc0109b0 con 0x7f8dec070fc0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8de8ff9700 1 -- 172.21.15.64:0/358607876 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8ddc024440 con 0x7f8dec070fc0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8df27a8700 1 -- 172.21.15.64:0/358607876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dec1118c0 con 0x7f8dec070fc0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8de8ff9700 1 -- 172.21.15.64:0/358607876 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ddc01a5f0 con 0x7f8dec070fc0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8df27a8700 1 -- 172.21.15.64:0/358607876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dec111cd0 con 0x7f8dec070fc0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8de8ff9700 1 -- 172.21.15.64:0/358607876 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8ddc01aaa0 con 0x7f8dec070fc0 2023-12-16T03:09:04.395 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.931+0000 7f8de8ff9700 1 -- 172.21.15.64:0/358607876 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8ddc02da40 con 0x7f8dec070fc0 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.932+0000 7f8df27a8700 1 -- 172.21.15.64:0/358607876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dec04bb80 con 0x7f8dec070fc0 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:03.934+0000 7f8de8ff9700 1 -- 172.21.15.64:0/358607876 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8ddc024970 con 0x7f8dec070fc0 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:04.010+0000 7f8df27a8700 1 -- 172.21.15.64:0/358607876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8dec106310 con 0x7f8dec070fc0 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:04.010+0000 7f8de8ff9700 1 -- 172.21.15.64:0/358607876 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f8dec106310 con 0x7f8dec070fc0 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:04.011+0000 7f8df27a8700 1 -- 172.21.15.64:0/358607876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 msgr2=0x7f8dec111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:04.011+0000 7f8df27a8700 1 --2- 172.21.15.64:0/358607876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec111180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc006d40 tx=0x7f8ddc009250 comp rx=0 tx=0).stop 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:04.011+0000 7f8df27a8700 1 -- 172.21.15.64:0/358607876 shutdown_connections 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:04.011+0000 7f8df27a8700 1 --2- 172.21.15.64:0/358607876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8dec070fc0 0x7f8dec111180 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:04.011+0000 7f8df27a8700 1 -- 172.21.15.64:0/358607876 >> 172.21.15.64:0/358607876 conn(0x7f8dec0fc970 msgr2=0x7f8dec0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:04.011+0000 7f8df27a8700 1 -- 172.21.15.64:0/358607876 shutdown_connections 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:04.011+0000 7f8df27a8700 1 -- 172.21.15.64:0/358607876 wait complete. 2023-12-16T03:09:04.396 INFO:teuthology.orchestra.run.smithi064.stdout:mgr not available, waiting (3/15)... 2023-12-16T03:09:05.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: Activating manager daemon smithi064.ueciyw 2023-12-16T03:09:05.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: mgrmap e2: smithi064.ueciyw(active, starting, since 0.00302824s) 2023-12-16T03:09:05.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:09:05.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:09:05.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:09:05.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:09:05.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:09:05.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: Manager daemon smithi064.ueciyw is now available 2023-12-16T03:09:05.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:09:05.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/trash_purge_schedule"}]: dispatch 2023-12-16T03:09:05.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:05.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:05.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:05 smithi064 ceph-mon[111958]: from='mgr.14100 172.21.15.64:0/890056106' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:06.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:06 smithi064 ceph-mon[111958]: mgrmap e3: smithi064.ueciyw(active, since 1.00923s) 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout { 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "fsid": "5b4de048-9bc0-11ee-95a5-87774f69a715", 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 0 2023-12-16T03:09:07.407 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "smithi064" 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T03:09:07.408 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T03:09:07.417 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T03:09:07.417 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T03:09:07.417 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T03:09:07.417 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:07.417 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T03:09:07.417 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T03:09:07.417 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T03:09:07.418 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ], 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T03:08:52.762398+0000", 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout }, 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T03:09:07.419 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout } 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.757+0000 7fb797af9700 1 Processor -- start 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.757+0000 7fb797af9700 1 -- start start 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.758+0000 7fb797af9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb7901015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.758+0000 7fb797af9700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790101b20 con 0x7fb7901011d0 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.758+0000 7fb795895700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb7901015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.758+0000 7fb795895700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb7901015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35168/0 (socket says 172.21.15.64:35168) 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.758+0000 7fb795895700 1 -- 172.21.15.64:0/161346568 learned_addr learned my addr 172.21.15.64:0/161346568 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.758+0000 7fb795895700 1 -- 172.21.15.64:0/161346568 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790101c60 con 0x7fb7901011d0 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.758+0000 7fb795895700 1 --2- 172.21.15.64:0/161346568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb7901015e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bb80 tx=0x7fb78000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc00787715dec7b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb794893700 1 -- 172.21.15.64:0/161346568 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb78000dd00 con 0x7fb7901011d0 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb794893700 1 -- 172.21.15.64:0/161346568 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb78000de60 con 0x7fb7901011d0 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb794893700 1 -- 172.21.15.64:0/161346568 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb780018840 con 0x7fb7901011d0 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb797af9700 1 -- 172.21.15.64:0/161346568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 msgr2=0x7fb7901015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb797af9700 1 --2- 172.21.15.64:0/161346568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb7901015e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bb80 tx=0x7fb78000b4f0 comp rx=0 tx=0).stop 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb797af9700 1 -- 172.21.15.64:0/161346568 shutdown_connections 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb797af9700 1 --2- 172.21.15.64:0/161346568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb7901015e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb797af9700 1 -- 172.21.15.64:0/161346568 >> 172.21.15.64:0/161346568 conn(0x7fb7900fc970 msgr2=0x7fb7900fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb797af9700 1 -- 172.21.15.64:0/161346568 shutdown_connections 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.759+0000 7fb797af9700 1 -- 172.21.15.64:0/161346568 wait complete. 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.760+0000 7fb797af9700 1 Processor -- start 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.760+0000 7fb797af9700 1 -- start start 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.760+0000 7fb797af9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb79010ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.760+0000 7fb797af9700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79010f450 con 0x7fb7901011d0 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.760+0000 7fb795895700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb79010ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.760+0000 7fb795895700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb79010ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35176/0 (socket says 172.21.15.64:35176) 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.760+0000 7fb795895700 1 -- 172.21.15.64:0/3743273422 learned_addr learned my addr 172.21.15.64:0/3743273422 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.760+0000 7fb795895700 1 -- 172.21.15.64:0/3743273422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78000b790 con 0x7fb7901011d0 2023-12-16T03:09:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.761+0000 7fb795895700 1 --2- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb79010ef10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb780007010 tx=0x7fb78000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.761+0000 7fb7867fc700 1 -- 172.21.15.64:0/3743273422 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7800108e0 con 0x7fb7901011d0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.761+0000 7fb7867fc700 1 -- 172.21.15.64:0/3743273422 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb78001d050 con 0x7fb7901011d0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.761+0000 7fb7867fc700 1 -- 172.21.15.64:0/3743273422 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7800223d0 con 0x7fb7901011d0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.761+0000 7fb797af9700 1 -- 172.21.15.64:0/3743273422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79010f650 con 0x7fb7901011d0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.761+0000 7fb797af9700 1 -- 172.21.15.64:0/3743273422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79010fa60 con 0x7fb7901011d0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.762+0000 7fb7867fc700 1 -- 172.21.15.64:0/3743273422 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 3) v1 ==== 43164+0+0 (secure 0 0 0) 0x7fb780022600 con 0x7fb7901011d0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.762+0000 7fb7867fc700 1 --2- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fb77c0364c0 0x7fb77c038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.762+0000 7fb77bfff700 1 -- 172.21.15.64:0/3743273422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700052b0 con 0x7fb7901011d0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.762+0000 7fb7867fc700 1 -- 172.21.15.64:0/3743273422 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb780014070 con 0x7fb7901011d0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.762+0000 7fb795094700 1 --2- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fb77c0364c0 0x7fb77c038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.762+0000 7fb795094700 1 --2- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fb77c0364c0 0x7fb77c038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009990 tx=0x7fb78c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:06.767+0000 7fb7867fc700 1 -- 172.21.15.64:0/3743273422 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb78002d460 con 0x7fb7901011d0 2023-12-16T03:09:07.422 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.045+0000 7fb77bfff700 1 -- 172.21.15.64:0/3743273422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb770005560 con 0x7fb7901011d0 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.046+0000 7fb7867fc700 1 -- 172.21.15.64:0/3743273422 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fb7800217a0 con 0x7fb7901011d0 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 -- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fb77c0364c0 msgr2=0x7fb77c038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 --2- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fb77c0364c0 0x7fb77c038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009990 tx=0x7fb78c006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 -- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 msgr2=0x7fb79010ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 --2- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb79010ef10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb780007010 tx=0x7fb78000b4f0 comp rx=0 tx=0).stop 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 -- 172.21.15.64:0/3743273422 shutdown_connections 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 --2- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fb77c0364c0 0x7fb77c038970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 --2- 172.21.15.64:0/3743273422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7901011d0 0x7fb79010ef10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 -- 172.21.15.64:0/3743273422 >> 172.21.15.64:0/3743273422 conn(0x7fb7900fc970 msgr2=0x7fb790105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 -- 172.21.15.64:0/3743273422 shutdown_connections 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.048+0000 7fb77bfff700 1 -- 172.21.15.64:0/3743273422 wait complete. 2023-12-16T03:09:07.423 INFO:teuthology.orchestra.run.smithi064.stdout:mgr is available 2023-12-16T03:09:07.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:07 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3743273422' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T03:09:08.335 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout [global] 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout fsid = 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout [osd] 2023-12-16T03:09:08.336 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.742+0000 7f9aff2da700 1 Processor -- start 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.742+0000 7f9aff2da700 1 -- start start 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9aff2da700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af8103da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9aff2da700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81042e0 con 0x7f9af8103990 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9afd076700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af8103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9afd076700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af8103da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35178/0 (socket says 172.21.15.64:35178) 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9afd076700 1 -- 172.21.15.64:0/3188800399 learned_addr learned my addr 172.21.15.64:0/3188800399 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9afd076700 1 -- 172.21.15.64:0/3188800399 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8104420 con 0x7f9af8103990 2023-12-16T03:09:08.337 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9afd076700 1 --2- 172.21.15.64:0/3188800399 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af8103da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9af40098e0 tx=0x7f9af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c964f4fc608f658f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9aeffff700 1 -- 172.21.15.64:0/3188800399 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af400b860 con 0x7f9af8103990 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9aeffff700 1 -- 172.21.15.64:0/3188800399 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9af400be30 con 0x7f9af8103990 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.743+0000 7f9aeffff700 1 -- 172.21.15.64:0/3188800399 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af4010380 con 0x7f9af8103990 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.744+0000 7f9aff2da700 1 -- 172.21.15.64:0/3188800399 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 msgr2=0x7f9af8103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.744+0000 7f9aff2da700 1 --2- 172.21.15.64:0/3188800399 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af8103da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9af40098e0 tx=0x7f9af4009250 comp rx=0 tx=0).stop 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.744+0000 7f9aff2da700 1 -- 172.21.15.64:0/3188800399 shutdown_connections 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.744+0000 7f9aff2da700 1 --2- 172.21.15.64:0/3188800399 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af8103da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.744+0000 7f9aff2da700 1 -- 172.21.15.64:0/3188800399 >> 172.21.15.64:0/3188800399 conn(0x7f9af80fc0b0 msgr2=0x7f9af80fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.744+0000 7f9aff2da700 1 -- 172.21.15.64:0/3188800399 shutdown_connections 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.744+0000 7f9aff2da700 1 -- 172.21.15.64:0/3188800399 wait complete. 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9aff2da700 1 Processor -- start 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9aff2da700 1 -- start start 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9aff2da700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af81031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9aff2da700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af8101650 con 0x7f9af8103990 2023-12-16T03:09:08.338 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9afd076700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af81031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9afd076700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af81031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35182/0 (socket says 172.21.15.64:35182) 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9afd076700 1 -- 172.21.15.64:0/1083796937 learned_addr learned my addr 172.21.15.64:0/1083796937 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9afd076700 1 -- 172.21.15.64:0/1083796937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40094f0 con 0x7f9af8103990 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9afd076700 1 --2- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af81031d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000c00 tx=0x7f9af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9aedffb700 1 -- 172.21.15.64:0/1083796937 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af4010a80 con 0x7f9af8103990 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9aedffb700 1 -- 172.21.15.64:0/1083796937 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9af401a430 con 0x7f9af8103990 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af8101850 con 0x7f9af8103990 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.745+0000 7f9aedffb700 1 -- 172.21.15.64:0/1083796937 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af40245b0 con 0x7f9af8103990 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.746+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af8101c60 con 0x7f9af8103990 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.746+0000 7f9aedffb700 1 -- 172.21.15.64:0/1083796937 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f9af40247a0 con 0x7f9af8103990 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.747+0000 7f9aedffb700 1 --2- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f9ae40365f0 0x7f9ae4038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.747+0000 7f9aedffb700 1 -- 172.21.15.64:0/1083796937 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9af404aa80 con 0x7f9af8103990 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.747+0000 7f9afc875700 1 --2- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f9ae40365f0 0x7f9ae4038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:08.339 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.747+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af805f270 con 0x7f9af8103990 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.747+0000 7f9afc875700 1 --2- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f9ae40365f0 0x7f9ae4038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009990 tx=0x7f9ae8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.752+0000 7f9aedffb700 1 -- 172.21.15.64:0/1083796937 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9af4023df0 con 0x7f9af8103990 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.947+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9af804bb80 con 0x7f9af8103990 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.948+0000 7f9aedffb700 1 -- 172.21.15.64:0/1083796937 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f9af4049020 con 0x7f9af8103990 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f9ae40365f0 msgr2=0x7f9ae4038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 --2- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f9ae40365f0 0x7f9ae4038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009990 tx=0x7f9ae8006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 msgr2=0x7f9af81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 --2- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af81031d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000c00 tx=0x7f9af4009250 comp rx=0 tx=0).stop 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 shutdown_connections 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 --2- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f9ae40365f0 0x7f9ae4038aa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 --2- 172.21.15.64:0/1083796937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9af8103990 0x7f9af81031d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 >> 172.21.15.64:0/1083796937 conn(0x7f9af80fc0b0 msgr2=0x7f9af80fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 shutdown_connections 2023-12-16T03:09:08.340 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:07.951+0000 7f9aff2da700 1 -- 172.21.15.64:0/1083796937 wait complete. 2023-12-16T03:09:08.341 INFO:teuthology.orchestra.run.smithi064.stdout:Enabling cephadm module... 2023-12-16T03:09:08.508 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:08 smithi064 ceph-mon[111958]: mgrmap e4: smithi064.ueciyw(active, since 3s) 2023-12-16T03:09:08.509 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:08 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1083796937' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-16T03:09:09.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:09 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3138143025' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-16T03:09:09.791 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.694+0000 7fe7781fd700 1 Processor -- start 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.695+0000 7fe7781fd700 1 -- start start 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.695+0000 7fe7781fd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770102d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.695+0000 7fe7781fd700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe770103270 con 0x7fe770102920 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.695+0000 7fe775f99700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.695+0000 7fe775f99700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35190/0 (socket says 172.21.15.64:35190) 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.695+0000 7fe775f99700 1 -- 172.21.15.64:0/1633254639 learned_addr learned my addr 172.21.15.64:0/1633254639 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.695+0000 7fe775f99700 1 -- 172.21.15.64:0/1633254639 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7701033b0 con 0x7fe770102920 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.695+0000 7fe775f99700 1 --2- 172.21.15.64:0/1633254639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770102d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0098e0 tx=0x7fe76c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebba41d7738c12ba server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe774f97700 1 -- 172.21.15.64:0/1633254639 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe76c00b860 con 0x7fe770102920 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe774f97700 1 -- 172.21.15.64:0/1633254639 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe76c00be30 con 0x7fe770102920 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe774f97700 1 -- 172.21.15.64:0/1633254639 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe76c010380 con 0x7fe770102920 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe7781fd700 1 -- 172.21.15.64:0/1633254639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 msgr2=0x7fe770102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe7781fd700 1 --2- 172.21.15.64:0/1633254639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770102d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0098e0 tx=0x7fe76c009250 comp rx=0 tx=0).stop 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe7781fd700 1 -- 172.21.15.64:0/1633254639 shutdown_connections 2023-12-16T03:09:09.792 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe7781fd700 1 --2- 172.21.15.64:0/1633254639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770102d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe7781fd700 1 -- 172.21.15.64:0/1633254639 >> 172.21.15.64:0/1633254639 conn(0x7fe7700fc0b0 msgr2=0x7fe7700fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe7781fd700 1 -- 172.21.15.64:0/1633254639 shutdown_connections 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.696+0000 7fe7781fd700 1 -- 172.21.15.64:0/1633254639 wait complete. 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.697+0000 7fe7781fd700 1 Processor -- start 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.697+0000 7fe7781fd700 1 -- start start 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.697+0000 7fe7781fd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.697+0000 7fe7781fd700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7701138a0 con 0x7fe770102920 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.697+0000 7fe775f99700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.697+0000 7fe775f99700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770113360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35196/0 (socket says 172.21.15.64:35196) 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.697+0000 7fe775f99700 1 -- 172.21.15.64:0/3138143025 learned_addr learned my addr 172.21.15.64:0/3138143025 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.697+0000 7fe775f99700 1 -- 172.21.15.64:0/3138143025 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0094f0 con 0x7fe770102920 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.697+0000 7fe775f99700 1 --2- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770113360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe76c006b00 tx=0x7fe76c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.698+0000 7fe7667fc700 1 -- 172.21.15.64:0/3138143025 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe76c0109b0 con 0x7fe770102920 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.698+0000 7fe7667fc700 1 -- 172.21.15.64:0/3138143025 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe76c024440 con 0x7fe770102920 2023-12-16T03:09:09.793 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.698+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe770113aa0 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.698+0000 7fe7667fc700 1 -- 172.21.15.64:0/3138143025 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe76c01a5f0 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.698+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe770113eb0 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.698+0000 7fe7667fc700 1 -- 172.21.15.64:0/3138143025 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fe76c010b10 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.698+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77004bb80 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.699+0000 7fe7667fc700 1 --2- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fe75c0365f0 0x7fe75c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.699+0000 7fe7667fc700 1 -- 172.21.15.64:0/3138143025 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe76c04a4f0 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.699+0000 7fe775798700 1 --2- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fe75c0365f0 0x7fe75c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.699+0000 7fe775798700 1 --2- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fe75c0365f0 0x7fe75c038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe760009990 tx=0x7fe760006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.703+0000 7fe7667fc700 1 -- 172.21.15.64:0/3138143025 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe76c0239f0 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:08.951+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fe77010d160 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.418+0000 7fe7667fc700 1 -- 172.21.15.64:0/3138143025 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe76c010dc0 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.419+0000 7fe7667fc700 1 -- 172.21.15.64:0/3138143025 <== mon.0 v2:172.21.15.64:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fe76c01ada0 con 0x7fe770102920 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fe75c0365f0 msgr2=0x7fe75c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 --2- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fe75c0365f0 0x7fe75c038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe760009990 tx=0x7fe760006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 msgr2=0x7fe770113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:09.795 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 --2- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770113360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe76c006b00 tx=0x7fe76c009250 comp rx=0 tx=0).stop 2023-12-16T03:09:09.795 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 shutdown_connections 2023-12-16T03:09:09.795 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 --2- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fe75c0365f0 0x7fe75c038aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:09.795 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 --2- 172.21.15.64:0/3138143025 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe770102920 0x7fe770113360 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:09.795 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 >> 172.21.15.64:0/3138143025 conn(0x7fe7700fc0b0 msgr2=0x7fe7700fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:09.795 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 shutdown_connections 2023-12-16T03:09:09.795 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:09.422+0000 7fe7781fd700 1 -- 172.21.15.64:0/3138143025 wait complete. 2023-12-16T03:09:10.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:10 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3138143025' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-16T03:09:10.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:10 smithi064 ceph-mon[111958]: mgrmap e5: smithi064.ueciyw(active, since 5s) 2023-12-16T03:09:11.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:11 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/597722753' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-16T03:09:12.250 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout { 2023-12-16T03:09:12.250 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "active_name": "smithi064.ueciyw", 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout } 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.154+0000 7fa68b5df700 1 Processor -- start 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.155+0000 7fa68b5df700 1 -- start start 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.155+0000 7fa68b5df700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6840760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.155+0000 7fa68b5df700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684077fe0 con 0x7fa684077bd0 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.155+0000 7fa68937b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6840760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.155+0000 7fa68937b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6840760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35230/0 (socket says 172.21.15.64:35230) 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.155+0000 7fa68937b700 1 -- 172.21.15.64:0/1280325575 learned_addr learned my addr 172.21.15.64:0/1280325575 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.155+0000 7fa68937b700 1 -- 172.21.15.64:0/1280325575 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684076620 con 0x7fa684077bd0 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa68937b700 1 --2- 172.21.15.64:0/1280325575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6840760e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa6800098e0 tx=0x7fa680009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cde0dbf394dfbe server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:12.251 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa67bfff700 1 -- 172.21.15.64:0/1280325575 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa68000b860 con 0x7fa684077bd0 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa67bfff700 1 -- 172.21.15.64:0/1280325575 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa68000be30 con 0x7fa684077bd0 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa67bfff700 1 -- 172.21.15.64:0/1280325575 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa680010380 con 0x7fa684077bd0 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa68b5df700 1 -- 172.21.15.64:0/1280325575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 msgr2=0x7fa6840760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa68b5df700 1 --2- 172.21.15.64:0/1280325575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6840760e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa6800098e0 tx=0x7fa680009250 comp rx=0 tx=0).stop 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa68b5df700 1 -- 172.21.15.64:0/1280325575 shutdown_connections 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa68b5df700 1 --2- 172.21.15.64:0/1280325575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6840760e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa68b5df700 1 -- 172.21.15.64:0/1280325575 >> 172.21.15.64:0/1280325575 conn(0x7fa6840fda50 msgr2=0x7fa6840ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.156+0000 7fa68b5df700 1 -- 172.21.15.64:0/1280325575 shutdown_connections 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.157+0000 7fa68b5df700 1 -- 172.21.15.64:0/1280325575 wait complete. 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.157+0000 7fa68b5df700 1 Processor -- start 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.157+0000 7fa68b5df700 1 -- start start 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.157+0000 7fa68b5df700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6841133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.157+0000 7fa68b5df700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684113900 con 0x7fa684077bd0 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.157+0000 7fa68937b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6841133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:12.252 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.157+0000 7fa68937b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6841133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35236/0 (socket says 172.21.15.64:35236) 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.157+0000 7fa68937b700 1 -- 172.21.15.64:0/597722753 learned_addr learned my addr 172.21.15.64:0/597722753 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.158+0000 7fa68937b700 1 -- 172.21.15.64:0/597722753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6800094f0 con 0x7fa684077bd0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.158+0000 7fa68937b700 1 --2- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6841133c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa680006fd0 tx=0x7fa680009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.158+0000 7fa679ffb700 1 -- 172.21.15.64:0/597722753 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa680010750 con 0x7fa684077bd0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.158+0000 7fa679ffb700 1 -- 172.21.15.64:0/597722753 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa680010d20 con 0x7fa684077bd0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.158+0000 7fa679ffb700 1 -- 172.21.15.64:0/597722753 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa68001ada0 con 0x7fa684077bd0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.158+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa684113b00 con 0x7fa684077bd0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.158+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa684113f10 con 0x7fa684077bd0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.159+0000 7fa679ffb700 1 -- 172.21.15.64:0/597722753 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa6800108b0 con 0x7fa684077bd0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.159+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68404bb80 con 0x7fa684077bd0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.159+0000 7fa679ffb700 1 --2- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fa670036640 0x7fa670038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.159+0000 7fa688b7a700 1 -- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fa670036640 msgr2=0x7fa670038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/150543208 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.159+0000 7fa679ffb700 1 -- 172.21.15.64:0/597722753 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa680049b30 con 0x7fa684077bd0 2023-12-16T03:09:12.253 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.159+0000 7fa688b7a700 1 --2- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fa670036640 0x7fa670038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.168+0000 7fa679ffb700 1 -- 172.21.15.64:0/597722753 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa680022720 con 0x7fa684077bd0 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.360+0000 7fa688b7a700 1 -- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fa670036640 msgr2=0x7fa670038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/150543208 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.360+0000 7fa688b7a700 1 --2- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fa670036640 0x7fa670038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.420+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa68410d180 con 0x7fa684077bd0 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.420+0000 7fa679ffb700 1 -- 172.21.15.64:0/597722753 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fa680020020 con 0x7fa684077bd0 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fa670036640 msgr2=0x7fa670038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 --2- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fa670036640 0x7fa670038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 msgr2=0x7fa6841133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 --2- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6841133c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa680006fd0 tx=0x7fa680009250 comp rx=0 tx=0).stop 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 shutdown_connections 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 --2- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7fa670036640 0x7fa670038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 --2- 172.21.15.64:0/597722753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa684077bd0 0x7fa6841133c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 >> 172.21.15.64:0/597722753 conn(0x7fa6840fda50 msgr2=0x7fa6840ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 shutdown_connections 2023-12-16T03:09:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:10.424+0000 7fa68b5df700 1 -- 172.21.15.64:0/597722753 wait complete. 2023-12-16T03:09:12.255 INFO:teuthology.orchestra.run.smithi064.stdout:Waiting for the mgr to restart... 2023-12-16T03:09:12.255 INFO:teuthology.orchestra.run.smithi064.stdout:Waiting for mgr epoch 5... 2023-12-16T03:09:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: Active manager daemon smithi064.ueciyw restarted 2023-12-16T03:09:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: Activating manager daemon smithi064.ueciyw 2023-12-16T03:09:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: osdmap e2: 0 total, 0 up, 0 in 2023-12-16T03:09:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: mgrmap e6: smithi064.ueciyw(active, starting, since 0.00325027s) 2023-12-16T03:09:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:09:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:09:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:09:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: Manager daemon smithi064.ueciyw is now available 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: Found migration_current of "None". Setting to last migration. 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:09:17.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:17 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/trash_purge_schedule"}]: dispatch 2023-12-16T03:09:18.685 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:18 smithi064 ceph-mon[111958]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-16T03:09:18.685 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:18 smithi064 ceph-mon[111958]: mgrmap e7: smithi064.ueciyw(active, since 1.00778s) 2023-12-16T03:09:18.685 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:18 smithi064 ceph-mon[111958]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout { 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout } 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.267+0000 7f50ab8e6700 1 Processor -- start 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.267+0000 7f50ab8e6700 1 -- start start 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.267+0000 7f50ab8e6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a40771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.267+0000 7f50ab8e6700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40790f0 con 0x7f50a4078ce0 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.268+0000 7f50a9682700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a40771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.268+0000 7f50a9682700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a40771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58548/0 (socket says 172.21.15.64:58548) 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.268+0000 7f50a9682700 1 -- 172.21.15.64:0/585026730 learned_addr learned my addr 172.21.15.64:0/585026730 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:19.652 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.268+0000 7f50a9682700 1 -- 172.21.15.64:0/585026730 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a4077730 con 0x7f50a4078ce0 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.268+0000 7f50a9682700 1 --2- 172.21.15.64:0/585026730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a40771f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f50940098e0 tx=0x7f5094009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4550a924527956 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.268+0000 7f509bfff700 1 -- 172.21.15.64:0/585026730 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f509400b860 con 0x7f50a4078ce0 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.268+0000 7f509bfff700 1 -- 172.21.15.64:0/585026730 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f509400be30 con 0x7f50a4078ce0 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.268+0000 7f509bfff700 1 -- 172.21.15.64:0/585026730 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5094010380 con 0x7f50a4078ce0 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.269+0000 7f50ab8e6700 1 -- 172.21.15.64:0/585026730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 msgr2=0x7f50a40771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.269+0000 7f50ab8e6700 1 --2- 172.21.15.64:0/585026730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a40771f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f50940098e0 tx=0x7f5094009250 comp rx=0 tx=0).stop 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.269+0000 7f50ab8e6700 1 -- 172.21.15.64:0/585026730 shutdown_connections 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.269+0000 7f50ab8e6700 1 --2- 172.21.15.64:0/585026730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a40771f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.269+0000 7f50ab8e6700 1 -- 172.21.15.64:0/585026730 >> 172.21.15.64:0/585026730 conn(0x7f50a40fda10 msgr2=0x7f50a40ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.269+0000 7f50ab8e6700 1 -- 172.21.15.64:0/585026730 shutdown_connections 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.269+0000 7f50ab8e6700 1 -- 172.21.15.64:0/585026730 wait complete. 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.269+0000 7f50ab8e6700 1 Processor -- start 2023-12-16T03:09:19.653 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.269+0000 7f50ab8e6700 1 -- start start 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f50ab8e6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a4113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f50ab8e6700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a4113870 con 0x7f50a4078ce0 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f50a9682700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a4113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f50a9682700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a4113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58560/0 (socket says 172.21.15.64:58560) 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f50a9682700 1 -- 172.21.15.64:0/2798484870 learned_addr learned my addr 172.21.15.64:0/2798484870 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f50a9682700 1 -- 172.21.15.64:0/2798484870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940094f0 con 0x7f50a4078ce0 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f50a9682700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a4113330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5094006fd0 tx=0x7f5094009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5094010800 con 0x7f50a4078ce0 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5094010dd0 con 0x7f50a4078ce0 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a4113a70 con 0x7f50a4078ce0 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.270+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f509401add0 con 0x7f50a4078ce0 2023-12-16T03:09:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.271+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a4113e80 con 0x7f50a4078ce0 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.271+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f509402c440 con 0x7f50a4078ce0 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.271+0000 7f5099ffb700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 0x7f5090038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.271+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 --> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50a404bb80 con 0x7f50900365f0 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.271+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f509401e070 con 0x7f50a4078ce0 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.271+0000 7f50a8e81700 1 -- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 msgr2=0x7f5090038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/150543208 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.272+0000 7f50a8e81700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 0x7f5090038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.473+0000 7f50a8e81700 1 -- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 msgr2=0x7f5090038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/150543208 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.473+0000 7f50a8e81700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 0x7f5090038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.874+0000 7f50a8e81700 1 -- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 msgr2=0x7f5090038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/150543208 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:13.874+0000 7f50a8e81700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 0x7f5090038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:14.675+0000 7f50a8e81700 1 -- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 msgr2=0x7f5090038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/150543208 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:14.675+0000 7f50a8e81700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 0x7f5090038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:16.220+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f5094049bb0 con 0x7f50a4078ce0 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:16.220+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 msgr2=0x7f5090038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:16.220+0000 7f5099ffb700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 0x7f5090038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:19.655 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.223+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f509402a390 con 0x7f50a4078ce0 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.224+0000 7f5099ffb700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5090039db0 0x7f509003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.224+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50a404bb80 con 0x7f5090039db0 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.224+0000 7f50a8e81700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5090039db0 0x7f509003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.225+0000 7f50a8e81700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5090039db0 0x7f509003c190 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f50a00039d0 tx=0x7f50a0009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.225+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f50a404bb80 con 0x7f5090039db0 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f50a4108520 con 0x7f5090039db0 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f5099ffb700 1 -- 172.21.15.64:0/2798484870 <== mgr.14120 v2:172.21.15.64:6800/2673193978 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f50a4108520 con 0x7f5090039db0 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5090039db0 msgr2=0x7f509003c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5090039db0 0x7f509003c190 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f50a00039d0 tx=0x7f50a0009350 comp rx=0 tx=0).stop 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 msgr2=0x7f50a4113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a4113330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5094006fd0 tx=0x7f5094009250 comp rx=0 tx=0).stop 2023-12-16T03:09:19.656 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 shutdown_connections 2023-12-16T03:09:19.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:19 smithi064 ceph-mon[111958]: [16/Dec/2023:03:09:18] ENGINE Bus STARTING 2023-12-16T03:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:19 smithi064 ceph-mon[111958]: [16/Dec/2023:03:09:18] ENGINE Serving on https://172.21.15.64:7150 2023-12-16T03:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:19 smithi064 ceph-mon[111958]: [16/Dec/2023:03:09:18] ENGINE Bus STARTED 2023-12-16T03:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:19 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:19 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:19 smithi064 ceph-mon[111958]: mgrmap e8: smithi064.ueciyw(active, since 3s) 2023-12-16T03:09:19.658 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5090039db0 0x7f509003c190 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:19.658 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50a4078ce0 0x7f50a4113330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:19.658 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 --2- 172.21.15.64:0/2798484870 >> [v2:172.21.15.64:6800/150543208,v1:172.21.15.64:6801/150543208] conn(0x7f50900365f0 0x7f5090038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:19.658 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 >> 172.21.15.64:0/2798484870 conn(0x7f50a40fda10 msgr2=0x7f50a40ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:19.658 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 shutdown_connections 2023-12-16T03:09:19.658 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:17.232+0000 7f50ab8e6700 1 -- 172.21.15.64:0/2798484870 wait complete. 2023-12-16T03:09:19.658 INFO:teuthology.orchestra.run.smithi064.stdout:mgr epoch 5 is available 2023-12-16T03:09:19.658 INFO:teuthology.orchestra.run.smithi064.stdout:Setting orchestrator backend to cephadm... 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.184+0000 7f3024bf8700 1 Processor -- start 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.184+0000 7f3024bf8700 1 -- start start 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.184+0000 7f3024bf8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020104f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.184+0000 7f3024bf8700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3020105450 con 0x7f3020076be0 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.184+0000 7f301e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020104f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.184+0000 7f301e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020104f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58664/0 (socket says 172.21.15.64:58664) 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.184+0000 7f301e59c700 1 -- 172.21.15.64:0/822649912 learned_addr learned my addr 172.21.15.64:0/822649912 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.185+0000 7f301e59c700 1 -- 172.21.15.64:0/822649912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3020105590 con 0x7f3020076be0 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.185+0000 7f301e59c700 1 --2- 172.21.15.64:0/822649912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020104f10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f30100098e0 tx=0x7f3010009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799772bba57fe85 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.185+0000 7f301d59a700 1 -- 172.21.15.64:0/822649912 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f301000b860 con 0x7f3020076be0 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.185+0000 7f301d59a700 1 -- 172.21.15.64:0/822649912 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f301000be30 con 0x7f3020076be0 2023-12-16T03:09:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.185+0000 7f301d59a700 1 -- 172.21.15.64:0/822649912 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3010010380 con 0x7f3020076be0 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.185+0000 7f3024bf8700 1 -- 172.21.15.64:0/822649912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 msgr2=0x7f3020104f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.185+0000 7f3024bf8700 1 --2- 172.21.15.64:0/822649912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020104f10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f30100098e0 tx=0x7f3010009250 comp rx=0 tx=0).stop 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.186+0000 7f3024bf8700 1 -- 172.21.15.64:0/822649912 shutdown_connections 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.186+0000 7f3024bf8700 1 --2- 172.21.15.64:0/822649912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020104f10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.186+0000 7f3024bf8700 1 -- 172.21.15.64:0/822649912 >> 172.21.15.64:0/822649912 conn(0x7f30200fc980 msgr2=0x7f30200fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.186+0000 7f3024bf8700 1 -- 172.21.15.64:0/822649912 shutdown_connections 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.186+0000 7f3024bf8700 1 -- 172.21.15.64:0/822649912 wait complete. 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.186+0000 7f3024bf8700 1 Processor -- start 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.186+0000 7f3024bf8700 1 -- start start 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.186+0000 7f3024bf8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020102990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.186+0000 7f3024bf8700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3020100e10 con 0x7f3020076be0 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f301e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020102990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f301e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020102990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58672/0 (socket says 172.21.15.64:58672) 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f301e59c700 1 -- 172.21.15.64:0/1023052412 learned_addr learned my addr 172.21.15.64:0/1023052412 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:20.767 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f301e59c700 1 -- 172.21.15.64:0/1023052412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30100094f0 con 0x7f3020076be0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f301e59c700 1 --2- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020102990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3010006b00 tx=0x7f3010009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f300effd700 1 -- 172.21.15.64:0/1023052412 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3010010a80 con 0x7f3020076be0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f300effd700 1 -- 172.21.15.64:0/1023052412 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f301001a430 con 0x7f3020076be0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3020101010 con 0x7f3020076be0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f300effd700 1 -- 172.21.15.64:0/1023052412 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30100245b0 con 0x7f3020076be0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.187+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3020101420 con 0x7f3020076be0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.188+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302004bb80 con 0x7f3020076be0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.188+0000 7f300effd700 1 -- 172.21.15.64:0/1023052412 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f3010010be0 con 0x7f3020076be0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.189+0000 7f300effd700 1 --2- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f3008036640 0x7f3008038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.189+0000 7f300effd700 1 -- 172.21.15.64:0/1023052412 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f301004aff0 con 0x7f3020076be0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.189+0000 7f301dd9b700 1 --2- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f3008036640 0x7f3008038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.189+0000 7f301dd9b700 1 --2- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f3008036640 0x7f3008038af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3014009990 tx=0x7f3014006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:20.768 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.193+0000 7f300effd700 1 -- 172.21.15.64:0/1023052412 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3010010e90 con 0x7f3020076be0 2023-12-16T03:09:20.769 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.402+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f302010ada0 con 0x7f3008036640 2023-12-16T03:09:20.769 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.408+0000 7f300effd700 1 -- 172.21.15.64:0/1023052412 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f302010ada0 con 0x7f3008036640 2023-12-16T03:09:20.769 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.410+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f3008036640 msgr2=0x7f3008038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:20.769 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.410+0000 7f3024bf8700 1 --2- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f3008036640 0x7f3008038af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3014009990 tx=0x7f3014006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:20.769 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.410+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 msgr2=0x7f3020102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:20.769 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.410+0000 7f3024bf8700 1 --2- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020102990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3010006b00 tx=0x7f3010009250 comp rx=0 tx=0).stop 2023-12-16T03:09:20.769 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.411+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 shutdown_connections 2023-12-16T03:09:20.769 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.411+0000 7f3024bf8700 1 --2- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f3008036640 0x7f3008038af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:20.770 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.411+0000 7f3024bf8700 1 --2- 172.21.15.64:0/1023052412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3020076be0 0x7f3020102990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:20.770 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.411+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 >> 172.21.15.64:0/1023052412 conn(0x7f30200fc980 msgr2=0x7f30200fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:20.770 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.411+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 shutdown_connections 2023-12-16T03:09:20.770 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:20.411+0000 7f3024bf8700 1 -- 172.21.15.64:0/1023052412 wait complete. 2023-12-16T03:09:21.604 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:21 smithi064 ceph-mon[111958]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:21.604 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:21 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:21.604 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:21 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:09:21.665 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-16T03:09:21.665 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.110+0000 7fe8d8052700 1 Processor -- start 2023-12-16T03:09:21.665 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.110+0000 7fe8d8052700 1 -- start start 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.110+0000 7fe8d8052700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d01015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.110+0000 7fe8d8052700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0101b20 con 0x7fe8d01011d0 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.110+0000 7fe8d5dee700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d01015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.110+0000 7fe8d5dee700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d01015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58688/0 (socket says 172.21.15.64:58688) 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.110+0000 7fe8d5dee700 1 -- 172.21.15.64:0/2092287699 learned_addr learned my addr 172.21.15.64:0/2092287699 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.111+0000 7fe8d5dee700 1 -- 172.21.15.64:0/2092287699 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0101c60 con 0x7fe8d01011d0 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.111+0000 7fe8d5dee700 1 --2- 172.21.15.64:0/2092287699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d01015e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0098e0 tx=0x7fe8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e3ddd3bc6315ad server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.111+0000 7fe8d4dec700 1 -- 172.21.15.64:0/2092287699 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8cc00b860 con 0x7fe8d01011d0 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.111+0000 7fe8d4dec700 1 -- 172.21.15.64:0/2092287699 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe8cc00be30 con 0x7fe8d01011d0 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.111+0000 7fe8d4dec700 1 -- 172.21.15.64:0/2092287699 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8cc010380 con 0x7fe8d01011d0 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.111+0000 7fe8d8052700 1 -- 172.21.15.64:0/2092287699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 msgr2=0x7fe8d01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.111+0000 7fe8d8052700 1 --2- 172.21.15.64:0/2092287699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d01015e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0098e0 tx=0x7fe8cc009250 comp rx=0 tx=0).stop 2023-12-16T03:09:21.666 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.112+0000 7fe8d8052700 1 -- 172.21.15.64:0/2092287699 shutdown_connections 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.112+0000 7fe8d8052700 1 --2- 172.21.15.64:0/2092287699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d01015e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.112+0000 7fe8d8052700 1 -- 172.21.15.64:0/2092287699 >> 172.21.15.64:0/2092287699 conn(0x7fe8d00fc950 msgr2=0x7fe8d00fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.112+0000 7fe8d8052700 1 -- 172.21.15.64:0/2092287699 shutdown_connections 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.112+0000 7fe8d8052700 1 -- 172.21.15.64:0/2092287699 wait complete. 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.112+0000 7fe8d8052700 1 Processor -- start 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.112+0000 7fe8d8052700 1 -- start start 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8d8052700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d010ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8d8052700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d010f480 con 0x7fe8d01011d0 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8d5dee700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d010ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8d5dee700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d010ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58698/0 (socket says 172.21.15.64:58698) 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8d5dee700 1 -- 172.21.15.64:0/749740649 learned_addr learned my addr 172.21.15.64:0/749740649 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8d5dee700 1 -- 172.21.15.64:0/749740649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc0094f0 con 0x7fe8d01011d0 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8d5dee700 1 --2- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d010ef40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006b00 tx=0x7fe8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8c67fc700 1 -- 172.21.15.64:0/749740649 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8cc0109b0 con 0x7fe8d01011d0 2023-12-16T03:09:21.667 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d010f680 con 0x7fe8d01011d0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8c67fc700 1 -- 172.21.15.64:0/749740649 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe8cc024440 con 0x7fe8d01011d0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8c67fc700 1 -- 172.21.15.64:0/749740649 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8cc01a5f0 con 0x7fe8d01011d0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.113+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d010fa90 con 0x7fe8d01011d0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.114+0000 7fe8c67fc700 1 -- 172.21.15.64:0/749740649 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe8cc01a870 con 0x7fe8d01011d0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.114+0000 7fe8c67fc700 1 --2- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fe8bc038830 0x7fe8bc03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.114+0000 7fe8c67fc700 1 -- 172.21.15.64:0/749740649 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe8cc04a5d0 con 0x7fe8d01011d0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.114+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d004bb80 con 0x7fe8d01011d0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.114+0000 7fe8d55ed700 1 --2- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fe8bc038830 0x7fe8bc03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.115+0000 7fe8d55ed700 1 --2- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fe8bc038830 0x7fe8bc03ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009990 tx=0x7fe8c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.119+0000 7fe8c67fc700 1 -- 172.21.15.64:0/749740649 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe8cc022340 con 0x7fe8d01011d0 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.317+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8d0108b90 con 0x7fe8bc038830 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.318+0000 7fe8c67fc700 1 -- 172.21.15.64:0/749740649 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fe8d0108b90 con 0x7fe8bc038830 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fe8bc038830 msgr2=0x7fe8bc03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:21.668 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 --2- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fe8bc038830 0x7fe8bc03ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009990 tx=0x7fe8c0006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:21.669 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 msgr2=0x7fe8d010ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:21.669 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 --2- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d010ef40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006b00 tx=0x7fe8cc009250 comp rx=0 tx=0).stop 2023-12-16T03:09:21.669 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 shutdown_connections 2023-12-16T03:09:21.669 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 --2- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fe8bc038830 0x7fe8bc03ace0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:21.669 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 --2- 172.21.15.64:0/749740649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d01011d0 0x7fe8d010ef40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:21.669 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 >> 172.21.15.64:0/749740649 conn(0x7fe8d00fc950 msgr2=0x7fe8d0105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:21.669 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 shutdown_connections 2023-12-16T03:09:21.669 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:21.320+0000 7fe8d8052700 1 -- 172.21.15.64:0/749740649 wait complete. 2023-12-16T03:09:21.669 INFO:teuthology.orchestra.run.smithi064.stdout:Generating ssh key... 2023-12-16T03:09:22.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:22 smithi064 ceph-mon[111958]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:22.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:22 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:22.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:22 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:22.757 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.019+0000 7f05f2604700 1 Processor -- start 2023-12-16T03:09:22.757 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.019+0000 7f05f2604700 1 -- start start 2023-12-16T03:09:22.757 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.019+0000 7f05f2604700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:22.757 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.019+0000 7f05f2604700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec101b20 con 0x7f05ec1011d0 2023-12-16T03:09:22.757 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.019+0000 7f05ebfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.019+0000 7f05ebfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58706/0 (socket says 172.21.15.64:58706) 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.019+0000 7f05ebfff700 1 -- 172.21.15.64:0/3617697538 learned_addr learned my addr 172.21.15.64:0/3617697538 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.019+0000 7f05ebfff700 1 -- 172.21.15.64:0/3617697538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec101c60 con 0x7f05ec1011d0 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05ebfff700 1 --2- 172.21.15.64:0/3617697538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec1015e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0098e0 tx=0x7f05dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11167a21f0ff0702 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05eaffd700 1 -- 172.21.15.64:0/3617697538 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05dc00b860 con 0x7f05ec1011d0 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05eaffd700 1 -- 172.21.15.64:0/3617697538 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f05dc00be30 con 0x7f05ec1011d0 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05eaffd700 1 -- 172.21.15.64:0/3617697538 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05dc010380 con 0x7f05ec1011d0 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05f2604700 1 -- 172.21.15.64:0/3617697538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 msgr2=0x7f05ec1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05f2604700 1 --2- 172.21.15.64:0/3617697538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec1015e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0098e0 tx=0x7f05dc009250 comp rx=0 tx=0).stop 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05f2604700 1 -- 172.21.15.64:0/3617697538 shutdown_connections 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05f2604700 1 --2- 172.21.15.64:0/3617697538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec1015e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05f2604700 1 -- 172.21.15.64:0/3617697538 >> 172.21.15.64:0/3617697538 conn(0x7f05ec0fc970 msgr2=0x7f05ec0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05f2604700 1 -- 172.21.15.64:0/3617697538 shutdown_connections 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.020+0000 7f05f2604700 1 -- 172.21.15.64:0/3617697538 wait complete. 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.021+0000 7f05f2604700 1 Processor -- start 2023-12-16T03:09:22.758 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.021+0000 7f05f2604700 1 -- start start 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.021+0000 7f05f2604700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.021+0000 7f05f2604700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec111690 con 0x7f05ec1011d0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.021+0000 7f05ebfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.021+0000 7f05ebfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58716/0 (socket says 172.21.15.64:58716) 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.021+0000 7f05ebfff700 1 -- 172.21.15.64:0/4115572218 learned_addr learned my addr 172.21.15.64:0/4115572218 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.022+0000 7f05ebfff700 1 -- 172.21.15.64:0/4115572218 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc0094f0 con 0x7f05ec1011d0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.022+0000 7f05ebfff700 1 --2- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec111150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000c00 tx=0x7f05dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.022+0000 7f05e8ff9700 1 -- 172.21.15.64:0/4115572218 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05dc010a80 con 0x7f05ec1011d0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.022+0000 7f05e8ff9700 1 -- 172.21.15.64:0/4115572218 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f05dc01a430 con 0x7f05ec1011d0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.022+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ec111890 con 0x7f05ec1011d0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.022+0000 7f05e8ff9700 1 -- 172.21.15.64:0/4115572218 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05dc0245b0 con 0x7f05ec1011d0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.022+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec111ca0 con 0x7f05ec1011d0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.023+0000 7f05e8ff9700 1 -- 172.21.15.64:0/4115572218 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f05dc0247a0 con 0x7f05ec1011d0 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.023+0000 7f05e8ff9700 1 --2- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f05d4036640 0x7f05d4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.023+0000 7f05e8ff9700 1 -- 172.21.15.64:0/4115572218 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f05dc04ab30 con 0x7f05ec1011d0 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.023+0000 7f05eb7fe700 1 --2- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f05d4036640 0x7f05d4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.023+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec04bb80 con 0x7f05ec1011d0 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.023+0000 7f05eb7fe700 1 --2- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f05d4036640 0x7f05d4038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009990 tx=0x7f05e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.028+0000 7f05e8ff9700 1 -- 172.21.15.64:0/4115572218 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f05dc018350 con 0x7f05ec1011d0 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.224+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f05ec0febe0 con 0x7f05d4036640 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.398+0000 7f05e8ff9700 1 -- 172.21.15.64:0/4115572218 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f05ec0febe0 con 0x7f05d4036640 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f05d4036640 msgr2=0x7f05d4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 --2- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f05d4036640 0x7f05d4038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009990 tx=0x7f05e0006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 msgr2=0x7f05ec111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 --2- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec111150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000c00 tx=0x7f05dc009250 comp rx=0 tx=0).stop 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 shutdown_connections 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 --2- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f05d4036640 0x7f05d4038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:22.760 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 --2- 172.21.15.64:0/4115572218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05ec1011d0 0x7f05ec111150 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:22.761 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 >> 172.21.15.64:0/4115572218 conn(0x7f05ec0fc970 msgr2=0x7f05ec070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:22.761 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 shutdown_connections 2023-12-16T03:09:22.761 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:22.400+0000 7f05f2604700 1 -- 172.21.15.64:0/4115572218 wait complete. 2023-12-16T03:09:23.595 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:23 smithi064 ceph-mon[111958]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:23.596 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:23 smithi064 ceph-mon[111958]: Generating ssh key... 2023-12-16T03:09:23.688 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfFy/DQL+KEotU08s+QhtI32ueByDZqQfRjDpf01kokEXtdCx7/wuCnRXb214wAG6jDmSAoKeR9+CyGULx82wdTPtJvr0MNODLx5niYd1XBszf3HbOaUDcFp+drSukvBHRZx0CrBFL3M9cX84ozMug4O8ttXVsv78Y0ek4rfcif+8ZowsWJZH7Qp5oeSRiSK7VT3rQwYJqxWozGgm02r9g6zMcs6nnERtZBTyD2DhidfJPPGMm8Iwx+4zWQ5SvtvzXhiUEfMQDntmXFrTkvUWCCga7zB7BO+Tlb0av84Orkgve+aTaZqZ7VP+69FnlG/esIH0t++26+0o/A5qcEzRJ2m05Xnj1tM+VqTgZpfGPiRLsHTnc7rzl07zYKIF/N3HDOdS5+388gdu7HN/0D+AI70kVTNsZDgfnWp++KH1OvrTY3hqL5eeTUs3KTazcySCpfMkjopvi550NLcMiDr0y5kfciLZ/yf3POSDo2IwxTcKEehlW3mOcHbEBUADmPok= ceph-5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:09:23.688 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.106+0000 7f8557326700 1 Processor -- start 2023-12-16T03:09:23.688 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.106+0000 7f8557326700 1 -- start start 2023-12-16T03:09:23.688 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.106+0000 7f8557326700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f85501015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:23.688 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.106+0000 7f8557326700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8550101b10 con 0x7f85501011c0 2023-12-16T03:09:23.688 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.106+0000 7f85550c2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f85501015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:23.689 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.106+0000 7f85550c2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f85501015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60912/0 (socket says 172.21.15.64:60912) 2023-12-16T03:09:23.689 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.106+0000 7f85550c2700 1 -- 172.21.15.64:0/2980367937 learned_addr learned my addr 172.21.15.64:0/2980367937 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:23.689 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f85550c2700 1 -- 172.21.15.64:0/2980367937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550101c50 con 0x7f85501011c0 2023-12-16T03:09:23.689 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f85550c2700 1 --2- 172.21.15.64:0/2980367937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f85501015d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f854c0098e0 tx=0x7f854c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baa2a9b93009050 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:23.689 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f8547fff700 1 -- 172.21.15.64:0/2980367937 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f854c00b860 con 0x7f85501011c0 2023-12-16T03:09:23.689 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f8547fff700 1 -- 172.21.15.64:0/2980367937 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f854c00be30 con 0x7f85501011c0 2023-12-16T03:09:23.690 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f8547fff700 1 -- 172.21.15.64:0/2980367937 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f854c010380 con 0x7f85501011c0 2023-12-16T03:09:23.690 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f8557326700 1 -- 172.21.15.64:0/2980367937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 msgr2=0x7f85501015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:23.690 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f8557326700 1 --2- 172.21.15.64:0/2980367937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f85501015d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f854c0098e0 tx=0x7f854c009250 comp rx=0 tx=0).stop 2023-12-16T03:09:23.690 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f8557326700 1 -- 172.21.15.64:0/2980367937 shutdown_connections 2023-12-16T03:09:23.690 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f8557326700 1 --2- 172.21.15.64:0/2980367937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f85501015d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:23.690 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.107+0000 7f8557326700 1 -- 172.21.15.64:0/2980367937 >> 172.21.15.64:0/2980367937 conn(0x7f85500fc980 msgr2=0x7f85500fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:23.691 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.108+0000 7f8557326700 1 -- 172.21.15.64:0/2980367937 shutdown_connections 2023-12-16T03:09:23.691 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.108+0000 7f8557326700 1 -- 172.21.15.64:0/2980367937 wait complete. 2023-12-16T03:09:23.691 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.108+0000 7f8557326700 1 Processor -- start 2023-12-16T03:09:23.691 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.108+0000 7f8557326700 1 -- start start 2023-12-16T03:09:23.691 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.108+0000 7f8557326700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f8550111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:23.691 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.108+0000 7f8557326700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8550111690 con 0x7f85501011c0 2023-12-16T03:09:23.691 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.108+0000 7f85550c2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f8550111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:23.692 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.108+0000 7f85550c2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f8550111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60918/0 (socket says 172.21.15.64:60918) 2023-12-16T03:09:23.692 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.108+0000 7f85550c2700 1 -- 172.21.15.64:0/2067063947 learned_addr learned my addr 172.21.15.64:0/2067063947 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:23.692 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.109+0000 7f85550c2700 1 -- 172.21.15.64:0/2067063947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c0094f0 con 0x7f85501011c0 2023-12-16T03:09:23.692 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.109+0000 7f85550c2700 1 --2- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f8550111150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f854c000c00 tx=0x7f854c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:23.692 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.109+0000 7f8545ffb700 1 -- 172.21.15.64:0/2067063947 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f854c010a80 con 0x7f85501011c0 2023-12-16T03:09:23.692 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.109+0000 7f8545ffb700 1 -- 172.21.15.64:0/2067063947 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f854c01a430 con 0x7f85501011c0 2023-12-16T03:09:23.693 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.109+0000 7f8545ffb700 1 -- 172.21.15.64:0/2067063947 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f854c0245b0 con 0x7f85501011c0 2023-12-16T03:09:23.693 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.109+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8550111890 con 0x7f85501011c0 2023-12-16T03:09:23.693 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.109+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8550111ca0 con 0x7f85501011c0 2023-12-16T03:09:23.693 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.110+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855004bb80 con 0x7f85501011c0 2023-12-16T03:09:23.693 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.110+0000 7f8545ffb700 1 -- 172.21.15.64:0/2067063947 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f854c01a5a0 con 0x7f85501011c0 2023-12-16T03:09:23.693 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.111+0000 7f8545ffb700 1 --2- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f853c0365f0 0x7f853c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:23.693 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.111+0000 7f8545ffb700 1 -- 172.21.15.64:0/2067063947 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f854c04ae80 con 0x7f85501011c0 2023-12-16T03:09:23.694 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.111+0000 7f85548c1700 1 --2- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f853c0365f0 0x7f853c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:23.694 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.111+0000 7f85548c1700 1 --2- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f853c0365f0 0x7f853c038aa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8540009990 tx=0x7f8540006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:23.694 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.115+0000 7f8545ffb700 1 -- 172.21.15.64:0/2067063947 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f854c0237a0 con 0x7f85501011c0 2023-12-16T03:09:23.694 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.311+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f85500feca0 con 0x7f853c0365f0 2023-12-16T03:09:23.694 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.312+0000 7f8545ffb700 1 -- 172.21.15.64:0/2067063947 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f85500feca0 con 0x7f853c0365f0 2023-12-16T03:09:23.694 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f853c0365f0 msgr2=0x7f853c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:23.695 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 --2- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f853c0365f0 0x7f853c038aa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8540009990 tx=0x7f8540006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:23.695 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 msgr2=0x7f8550111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:23.695 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 --2- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f8550111150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f854c000c00 tx=0x7f854c009250 comp rx=0 tx=0).stop 2023-12-16T03:09:23.695 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 shutdown_connections 2023-12-16T03:09:23.695 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 --2- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f853c0365f0 0x7f853c038aa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:23.695 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 --2- 172.21.15.64:0/2067063947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85501011c0 0x7f8550111150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:23.695 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 >> 172.21.15.64:0/2067063947 conn(0x7f85500fc980 msgr2=0x7f8550076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:23.696 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 shutdown_connections 2023-12-16T03:09:23.696 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:23.314+0000 7f8557326700 1 -- 172.21.15.64:0/2067063947 wait complete. 2023-12-16T03:09:23.696 INFO:teuthology.orchestra.run.smithi064.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-16T03:09:23.696 INFO:teuthology.orchestra.run.smithi064.stdout:Adding key to root@localhost authorized_keys... 2023-12-16T03:09:23.696 INFO:teuthology.orchestra.run.smithi064.stdout:Adding host smithi064... 2023-12-16T03:09:24.536 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:24 smithi064 ceph-mon[111958]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:25.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:25 smithi064 ceph-mon[111958]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi064", "addr": "172.21.15.64", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout Added host 'smithi064' with addr '172.21.15.64' 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.050+0000 7f5b150dd700 1 Processor -- start 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.050+0000 7f5b150dd700 1 -- start start 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.050+0000 7f5b150dd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b100771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.050+0000 7f5b150dd700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100790f0 con 0x7f5b10078ce0 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.050+0000 7f5b0ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b100771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.050+0000 7f5b0ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b100771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60930/0 (socket says 172.21.15.64:60930) 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.050+0000 7f5b0ed9d700 1 -- 172.21.15.64:0/3088599784 learned_addr learned my addr 172.21.15.64:0/3088599784 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.050+0000 7f5b0ed9d700 1 -- 172.21.15.64:0/3088599784 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10077730 con 0x7f5b10078ce0 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b0ed9d700 1 --2- 172.21.15.64:0/3088599784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b100771f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b000098e0 tx=0x7f5b00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6239c7c275edb113 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b0dd9b700 1 -- 172.21.15.64:0/3088599784 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b0000b860 con 0x7f5b10078ce0 2023-12-16T03:09:26.359 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b0dd9b700 1 -- 172.21.15.64:0/3088599784 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5b0000be30 con 0x7f5b10078ce0 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b0dd9b700 1 -- 172.21.15.64:0/3088599784 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b00010380 con 0x7f5b10078ce0 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b150dd700 1 -- 172.21.15.64:0/3088599784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 msgr2=0x7f5b100771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b150dd700 1 --2- 172.21.15.64:0/3088599784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b100771f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b000098e0 tx=0x7f5b00009250 comp rx=0 tx=0).stop 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b150dd700 1 -- 172.21.15.64:0/3088599784 shutdown_connections 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b150dd700 1 --2- 172.21.15.64:0/3088599784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b100771f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b150dd700 1 -- 172.21.15.64:0/3088599784 >> 172.21.15.64:0/3088599784 conn(0x7f5b100fda10 msgr2=0x7f5b100ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b150dd700 1 -- 172.21.15.64:0/3088599784 shutdown_connections 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.051+0000 7f5b150dd700 1 -- 172.21.15.64:0/3088599784 wait complete. 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.052+0000 7f5b150dd700 1 Processor -- start 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.052+0000 7f5b150dd700 1 -- start start 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.052+0000 7f5b150dd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b10113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.052+0000 7f5b150dd700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10113870 con 0x7f5b10078ce0 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.052+0000 7f5b0ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b10113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.052+0000 7f5b0ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b10113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60938/0 (socket says 172.21.15.64:60938) 2023-12-16T03:09:26.360 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.052+0000 7f5b0ed9d700 1 -- 172.21.15.64:0/1426212430 learned_addr learned my addr 172.21.15.64:0/1426212430 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.053+0000 7f5b0ed9d700 1 -- 172.21.15.64:0/1426212430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000094f0 con 0x7f5b10078ce0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.053+0000 7f5b0ed9d700 1 --2- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b10113330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006d40 tx=0x7f5b00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.053+0000 7f5b077fe700 1 -- 172.21.15.64:0/1426212430 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b000107a0 con 0x7f5b10078ce0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.053+0000 7f5b077fe700 1 -- 172.21.15.64:0/1426212430 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5b00010d70 con 0x7f5b10078ce0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.053+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b10113a70 con 0x7f5b10078ce0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.053+0000 7f5b077fe700 1 -- 172.21.15.64:0/1426212430 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b0001ad60 con 0x7f5b10078ce0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.053+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b10113e80 con 0x7f5b10078ce0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.054+0000 7f5b077fe700 1 -- 172.21.15.64:0/1426212430 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5b00022630 con 0x7f5b10078ce0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.054+0000 7f5b077fe700 1 --2- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5afc0365f0 0x7f5afc038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.054+0000 7f5b077fe700 1 -- 172.21.15.64:0/1426212430 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5b0001e070 con 0x7f5b10078ce0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.054+0000 7f5b0e59c700 1 --2- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5afc0365f0 0x7f5afc038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.054+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1004bb80 con 0x7f5b10078ce0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.055+0000 7f5b0e59c700 1 --2- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5afc0365f0 0x7f5afc038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009990 tx=0x7f5af8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:26.361 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.059+0000 7f5b077fe700 1 -- 172.21.15.64:0/1426212430 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5b0002ad60 con 0x7f5b10078ce0 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:24.259+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi064", "addr": "172.21.15.64", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b1010cef0 con 0x7f5afc0365f0 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.049+0000 7f5b077fe700 1 -- 172.21.15.64:0/1426212430 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f5b1010cef0 con 0x7f5afc0365f0 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5afc0365f0 msgr2=0x7f5afc038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 --2- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5afc0365f0 0x7f5afc038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009990 tx=0x7f5af8006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 msgr2=0x7f5b10113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 --2- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b10113330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006d40 tx=0x7f5b00009250 comp rx=0 tx=0).stop 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 shutdown_connections 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 --2- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5afc0365f0 0x7f5afc038aa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 --2- 172.21.15.64:0/1426212430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b10078ce0 0x7f5b10113330 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 >> 172.21.15.64:0/1426212430 conn(0x7f5b100fda10 msgr2=0x7f5b100ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 shutdown_connections 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.052+0000 7f5b150dd700 1 -- 172.21.15.64:0/1426212430 wait complete. 2023-12-16T03:09:26.362 INFO:teuthology.orchestra.run.smithi064.stdout:Deploying mon service with default placement... 2023-12-16T03:09:26.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:26 smithi064 ceph-mon[111958]: Deploying cephadm binary to smithi064 2023-12-16T03:09:26.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:26 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:26.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:26 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:09:27.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-16T03:09:27.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.718+0000 7fc33cdf4700 1 Processor -- start 2023-12-16T03:09:27.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.718+0000 7fc33cdf4700 1 -- start start 2023-12-16T03:09:27.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.718+0000 7fc33cdf4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.718+0000 7fc33cdf4700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc338102d10 con 0x7fc338070f80 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.719+0000 7fc33659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.719+0000 7fc33659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60954/0 (socket says 172.21.15.64:60954) 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.719+0000 7fc33659c700 1 -- 172.21.15.64:0/4261985329 learned_addr learned my addr 172.21.15.64:0/4261985329 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.719+0000 7fc33659c700 1 -- 172.21.15.64:0/4261985329 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338107860 con 0x7fc338070f80 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.719+0000 7fc33659c700 1 --2- 172.21.15.64:0/4261985329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338107320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc3280098e0 tx=0x7fc328009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab855724d051751 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.719+0000 7fc33559a700 1 -- 172.21.15.64:0/4261985329 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc32800b860 con 0x7fc338070f80 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.719+0000 7fc33559a700 1 -- 172.21.15.64:0/4261985329 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc32800be30 con 0x7fc338070f80 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.719+0000 7fc33559a700 1 -- 172.21.15.64:0/4261985329 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc328010380 con 0x7fc338070f80 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.720+0000 7fc33cdf4700 1 -- 172.21.15.64:0/4261985329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 msgr2=0x7fc338107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.720+0000 7fc33cdf4700 1 --2- 172.21.15.64:0/4261985329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338107320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc3280098e0 tx=0x7fc328009250 comp rx=0 tx=0).stop 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.720+0000 7fc33cdf4700 1 -- 172.21.15.64:0/4261985329 shutdown_connections 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.720+0000 7fc33cdf4700 1 --2- 172.21.15.64:0/4261985329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338107320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.720+0000 7fc33cdf4700 1 -- 172.21.15.64:0/4261985329 >> 172.21.15.64:0/4261985329 conn(0x7fc3380fc970 msgr2=0x7fc3380fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.720+0000 7fc33cdf4700 1 -- 172.21.15.64:0/4261985329 shutdown_connections 2023-12-16T03:09:27.382 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.720+0000 7fc33cdf4700 1 -- 172.21.15.64:0/4261985329 wait complete. 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.720+0000 7fc33cdf4700 1 Processor -- start 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.720+0000 7fc33cdf4700 1 -- start start 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc33cdf4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc33cdf4700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3381138c0 con 0x7fc338070f80 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc33659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc33659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60968/0 (socket says 172.21.15.64:60968) 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc33659c700 1 -- 172.21.15.64:0/773925718 learned_addr learned my addr 172.21.15.64:0/773925718 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc33659c700 1 -- 172.21.15.64:0/773925718 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280094f0 con 0x7fc338070f80 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc33659c700 1 --2- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338113380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc328006d40 tx=0x7fc328009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc326ffd700 1 -- 172.21.15.64:0/773925718 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3280109b0 con 0x7fc338070f80 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc338113ac0 con 0x7fc338070f80 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc326ffd700 1 -- 172.21.15.64:0/773925718 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc328024440 con 0x7fc338070f80 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc326ffd700 1 -- 172.21.15.64:0/773925718 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc32801a5f0 con 0x7fc338070f80 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.721+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc338113ed0 con 0x7fc338070f80 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.722+0000 7fc326ffd700 1 -- 172.21.15.64:0/773925718 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc32801a870 con 0x7fc338070f80 2023-12-16T03:09:27.383 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.722+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33804bb80 con 0x7fc338070f80 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.722+0000 7fc326ffd700 1 --2- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fc3200365f0 0x7fc320038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.722+0000 7fc326ffd700 1 -- 172.21.15.64:0/773925718 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc32804a5c0 con 0x7fc338070f80 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.722+0000 7fc335d9b700 1 --2- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fc3200365f0 0x7fc320038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.723+0000 7fc335d9b700 1 --2- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fc3200365f0 0x7fc320038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009990 tx=0x7fc32c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.727+0000 7fc326ffd700 1 -- 172.21.15.64:0/773925718 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc328018350 con 0x7fc338070f80 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.939+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fc33810d1b0 con 0x7fc3200365f0 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.944+0000 7fc326ffd700 1 -- 172.21.15.64:0/773925718 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc33810d1b0 con 0x7fc3200365f0 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fc3200365f0 msgr2=0x7fc320038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 --2- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fc3200365f0 0x7fc320038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009990 tx=0x7fc32c006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 msgr2=0x7fc338113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 --2- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338113380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc328006d40 tx=0x7fc328009250 comp rx=0 tx=0).stop 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 shutdown_connections 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 --2- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fc3200365f0 0x7fc320038aa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 --2- 172.21.15.64:0/773925718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc338070f80 0x7fc338113380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 >> 172.21.15.64:0/773925718 conn(0x7fc3380fc970 msgr2=0x7fc3380fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:27.384 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 shutdown_connections 2023-12-16T03:09:27.385 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:26.947+0000 7fc33cdf4700 1 -- 172.21.15.64:0/773925718 wait complete. 2023-12-16T03:09:27.385 INFO:teuthology.orchestra.run.smithi064.stdout:Deploying mgr service with default placement... 2023-12-16T03:09:27.531 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:27 smithi064 ceph-mon[111958]: Added host smithi064 2023-12-16T03:09:27.532 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:27 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:28.451 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-16T03:09:28.451 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.844+0000 7fcf65a3b700 1 Processor -- start 2023-12-16T03:09:28.451 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.845+0000 7fcf65a3b700 1 -- start start 2023-12-16T03:09:28.451 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.845+0000 7fcf65a3b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60103dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:28.451 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.845+0000 7fcf65a3b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf60104300 con 0x7fcf601039b0 2023-12-16T03:09:28.451 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.845+0000 7fcf5effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60103dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:28.451 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.845+0000 7fcf5effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60103dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60974/0 (socket says 172.21.15.64:60974) 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.845+0000 7fcf5effd700 1 -- 172.21.15.64:0/2854174216 learned_addr learned my addr 172.21.15.64:0/2854174216 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.845+0000 7fcf5effd700 1 -- 172.21.15.64:0/2854174216 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf60104440 con 0x7fcf601039b0 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.845+0000 7fcf5effd700 1 --2- 172.21.15.64:0/2854174216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60103dc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcf500098e0 tx=0x7fcf50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85ec1dee89c857b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.846+0000 7fcf5dffb700 1 -- 172.21.15.64:0/2854174216 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf5000b860 con 0x7fcf601039b0 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.846+0000 7fcf5dffb700 1 -- 172.21.15.64:0/2854174216 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf5000be70 con 0x7fcf601039b0 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.846+0000 7fcf5dffb700 1 -- 172.21.15.64:0/2854174216 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf50010380 con 0x7fcf601039b0 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.846+0000 7fcf65a3b700 1 -- 172.21.15.64:0/2854174216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 msgr2=0x7fcf60103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.846+0000 7fcf65a3b700 1 --2- 172.21.15.64:0/2854174216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60103dc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcf500098e0 tx=0x7fcf50009250 comp rx=0 tx=0).stop 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.846+0000 7fcf65a3b700 1 -- 172.21.15.64:0/2854174216 shutdown_connections 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.846+0000 7fcf65a3b700 1 --2- 172.21.15.64:0/2854174216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60103dc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.846+0000 7fcf65a3b700 1 -- 172.21.15.64:0/2854174216 >> 172.21.15.64:0/2854174216 conn(0x7fcf600fc0b0 msgr2=0x7fcf600fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.847+0000 7fcf65a3b700 1 -- 172.21.15.64:0/2854174216 shutdown_connections 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.847+0000 7fcf65a3b700 1 -- 172.21.15.64:0/2854174216 wait complete. 2023-12-16T03:09:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.848+0000 7fcf65a3b700 1 Processor -- start 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.848+0000 7fcf65a3b700 1 -- start start 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.848+0000 7fcf65a3b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.848+0000 7fcf65a3b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf601116d0 con 0x7fcf601039b0 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.848+0000 7fcf5effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.848+0000 7fcf5effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60990/0 (socket says 172.21.15.64:60990) 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.848+0000 7fcf5effd700 1 -- 172.21.15.64:0/1176401051 learned_addr learned my addr 172.21.15.64:0/1176401051 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.848+0000 7fcf5effd700 1 -- 172.21.15.64:0/1176401051 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500094f0 con 0x7fcf601039b0 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.848+0000 7fcf5effd700 1 --2- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60111190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf50011b60 tx=0x7fcf50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.849+0000 7fcf477fe700 1 -- 172.21.15.64:0/1176401051 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf50010850 con 0x7fcf601039b0 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.849+0000 7fcf477fe700 1 -- 172.21.15.64:0/1176401051 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf50010e60 con 0x7fcf601039b0 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.849+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf601118d0 con 0x7fcf601039b0 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.849+0000 7fcf477fe700 1 -- 172.21.15.64:0/1176401051 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf5001ae20 con 0x7fcf601039b0 2023-12-16T03:09:28.453 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.849+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf60111ce0 con 0x7fcf601039b0 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.849+0000 7fcf477fe700 1 -- 172.21.15.64:0/1176401051 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fcf5002d3f0 con 0x7fcf601039b0 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.850+0000 7fcf477fe700 1 --2- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fcf48036640 0x7fcf48038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.850+0000 7fcf477fe700 1 -- 172.21.15.64:0/1176401051 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcf5001a6a0 con 0x7fcf601039b0 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.850+0000 7fcf5e7fc700 1 --2- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fcf48036640 0x7fcf48038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.850+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6004bb80 con 0x7fcf601039b0 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.850+0000 7fcf5e7fc700 1 --2- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fcf48036640 0x7fcf48038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009990 tx=0x7fcf54006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:27.855+0000 7fcf477fe700 1 -- 172.21.15.64:0/1176401051 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcf5002b8e0 con 0x7fcf601039b0 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.064+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf6010acc0 con 0x7fcf48036640 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.070+0000 7fcf477fe700 1 -- 172.21.15.64:0/1176401051 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcf6010acc0 con 0x7fcf48036640 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fcf48036640 msgr2=0x7fcf48038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 --2- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fcf48036640 0x7fcf48038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009990 tx=0x7fcf54006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 msgr2=0x7fcf60111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:28.454 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 --2- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60111190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf50011b60 tx=0x7fcf50009250 comp rx=0 tx=0).stop 2023-12-16T03:09:28.455 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 shutdown_connections 2023-12-16T03:09:28.455 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 --2- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fcf48036640 0x7fcf48038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:28.455 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 --2- 172.21.15.64:0/1176401051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf601039b0 0x7fcf60111190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:28.455 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 >> 172.21.15.64:0/1176401051 conn(0x7fcf600fc0b0 msgr2=0x7fcf600fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:28.455 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 shutdown_connections 2023-12-16T03:09:28.455 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.072+0000 7fcf65a3b700 1 -- 172.21.15.64:0/1176401051 wait complete. 2023-12-16T03:09:28.455 INFO:teuthology.orchestra.run.smithi064.stdout:Deploying crash service with default placement... 2023-12-16T03:09:28.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:28 smithi064 ceph-mon[111958]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:28 smithi064 ceph-mon[111958]: Saving service mon spec with placement count:5 2023-12-16T03:09:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:28 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:28 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:28 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:29.464 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-16T03:09:29.464 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.862+0000 7feea7cbe700 1 Processor -- start 2023-12-16T03:09:29.464 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.862+0000 7feea7cbe700 1 -- start start 2023-12-16T03:09:29.464 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.863+0000 7feea7cbe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:29.464 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.863+0000 7feea7cbe700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea0104240 con 0x7feea01038f0 2023-12-16T03:09:29.464 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.863+0000 7feea5a5a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:29.464 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.863+0000 7feea5a5a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60996/0 (socket says 172.21.15.64:60996) 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.863+0000 7feea5a5a700 1 -- 172.21.15.64:0/3080983288 learned_addr learned my addr 172.21.15.64:0/3080983288 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.863+0000 7feea5a5a700 1 -- 172.21.15.64:0/3080983288 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0104380 con 0x7feea01038f0 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.863+0000 7feea5a5a700 1 --2- 172.21.15.64:0/3080983288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0103d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0098e0 tx=0x7fee9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f954d7647cdd2de server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.864+0000 7feea4a58700 1 -- 172.21.15.64:0/3080983288 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee9c00b860 con 0x7feea01038f0 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.864+0000 7feea4a58700 1 -- 172.21.15.64:0/3080983288 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee9c00be70 con 0x7feea01038f0 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.864+0000 7feea4a58700 1 -- 172.21.15.64:0/3080983288 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee9c010380 con 0x7feea01038f0 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.864+0000 7feea7cbe700 1 -- 172.21.15.64:0/3080983288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 msgr2=0x7feea0103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.864+0000 7feea7cbe700 1 --2- 172.21.15.64:0/3080983288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0103d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0098e0 tx=0x7fee9c009250 comp rx=0 tx=0).stop 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.864+0000 7feea7cbe700 1 -- 172.21.15.64:0/3080983288 shutdown_connections 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.864+0000 7feea7cbe700 1 --2- 172.21.15.64:0/3080983288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0103d00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.864+0000 7feea7cbe700 1 -- 172.21.15.64:0/3080983288 >> 172.21.15.64:0/3080983288 conn(0x7feea00fc0b0 msgr2=0x7feea00fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.865+0000 7feea7cbe700 1 -- 172.21.15.64:0/3080983288 shutdown_connections 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.865+0000 7feea7cbe700 1 -- 172.21.15.64:0/3080983288 wait complete. 2023-12-16T03:09:29.465 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.865+0000 7feea7cbe700 1 Processor -- start 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.865+0000 7feea7cbe700 1 -- start start 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.865+0000 7feea7cbe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.865+0000 7feea7cbe700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea0111680 con 0x7feea01038f0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7feea5a5a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7feea5a5a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32770/0 (socket says 172.21.15.64:32770) 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7feea5a5a700 1 -- 172.21.15.64:0/3688336655 learned_addr learned my addr 172.21.15.64:0/3688336655 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7feea5a5a700 1 -- 172.21.15.64:0/3688336655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0094f0 con 0x7feea01038f0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7feea5a5a700 1 --2- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0111140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c010 tx=0x7fee9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7fee967fc700 1 -- 172.21.15.64:0/3688336655 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee9c010960 con 0x7feea01038f0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7fee967fc700 1 -- 172.21.15.64:0/3688336655 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee9c01a430 con 0x7feea01038f0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea0111880 con 0x7feea01038f0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7fee967fc700 1 -- 172.21.15.64:0/3688336655 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee9c0245b0 con 0x7feea01038f0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.866+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea0111c90 con 0x7feea01038f0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.867+0000 7fee967fc700 1 -- 172.21.15.64:0/3688336655 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fee9c0247f0 con 0x7feea01038f0 2023-12-16T03:09:29.466 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.867+0000 7fee967fc700 1 --2- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fee8c0365f0 0x7fee8c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.867+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea004bb80 con 0x7feea01038f0 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.867+0000 7fee967fc700 1 -- 172.21.15.64:0/3688336655 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fee9c04b530 con 0x7feea01038f0 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.867+0000 7feea5259700 1 --2- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fee8c0365f0 0x7fee8c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.868+0000 7feea5259700 1 --2- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fee8c0365f0 0x7fee8c038aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee90009990 tx=0x7fee90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:28.874+0000 7fee967fc700 1 -- 172.21.15.64:0/3688336655 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fee9c02c340 con 0x7feea01038f0 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.088+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7feea010b010 con 0x7fee8c0365f0 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.093+0000 7fee967fc700 1 -- 172.21.15.64:0/3688336655 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7feea010b010 con 0x7fee8c0365f0 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fee8c0365f0 msgr2=0x7fee8c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 --2- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fee8c0365f0 0x7fee8c038aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee90009990 tx=0x7fee90006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 msgr2=0x7feea0111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 --2- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0111140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c010 tx=0x7fee9c009250 comp rx=0 tx=0).stop 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 shutdown_connections 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 --2- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fee8c0365f0 0x7fee8c038aa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:29.467 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 --2- 172.21.15.64:0/3688336655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feea01038f0 0x7feea0111140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:29.468 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 >> 172.21.15.64:0/3688336655 conn(0x7feea00fc0b0 msgr2=0x7feea00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:29.468 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 shutdown_connections 2023-12-16T03:09:29.468 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.095+0000 7feea7cbe700 1 -- 172.21.15.64:0/3688336655 wait complete. 2023-12-16T03:09:29.468 INFO:teuthology.orchestra.run.smithi064.stdout:Deploying prometheus service with default placement... 2023-12-16T03:09:29.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:29 smithi064 ceph-mon[111958]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:29 smithi064 ceph-mon[111958]: Saving service mgr spec with placement count:2 2023-12-16T03:09:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:29 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:29 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:30.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-16T03:09:30.439 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.819+0000 7f4b528db700 1 Processor -- start 2023-12-16T03:09:30.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.819+0000 7f4b528db700 1 -- start start 2023-12-16T03:09:30.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.819+0000 7f4b528db700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:30.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.819+0000 7f4b528db700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c102c20 con 0x7f4b4c1022d0 2023-12-16T03:09:30.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.819+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:30.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.819+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32780/0 (socket says 172.21.15.64:32780) 2023-12-16T03:09:30.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.819+0000 7f4b4bfff700 1 -- 172.21.15.64:0/2309248213 learned_addr learned my addr 172.21.15.64:0/2309248213 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:30.440 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.820+0000 7f4b4bfff700 1 -- 172.21.15.64:0/2309248213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c102d60 con 0x7f4b4c1022d0 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.820+0000 7f4b4bfff700 1 --2- 172.21.15.64:0/2309248213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c1026e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0098e0 tx=0x7f4b3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65bcfe4f1efb390 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.820+0000 7f4b4affd700 1 -- 172.21.15.64:0/2309248213 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b3c00b860 con 0x7f4b4c1022d0 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.820+0000 7f4b4affd700 1 -- 172.21.15.64:0/2309248213 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b3c00be70 con 0x7f4b4c1022d0 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.820+0000 7f4b4affd700 1 -- 172.21.15.64:0/2309248213 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b3c010380 con 0x7f4b4c1022d0 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.821+0000 7f4b528db700 1 -- 172.21.15.64:0/2309248213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 msgr2=0x7f4b4c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.821+0000 7f4b528db700 1 --2- 172.21.15.64:0/2309248213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c1026e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0098e0 tx=0x7f4b3c009250 comp rx=0 tx=0).stop 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.821+0000 7f4b528db700 1 -- 172.21.15.64:0/2309248213 shutdown_connections 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.821+0000 7f4b528db700 1 --2- 172.21.15.64:0/2309248213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c1026e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.821+0000 7f4b528db700 1 -- 172.21.15.64:0/2309248213 >> 172.21.15.64:0/2309248213 conn(0x7f4b4c0fda50 msgr2=0x7f4b4c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.821+0000 7f4b528db700 1 -- 172.21.15.64:0/2309248213 shutdown_connections 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.821+0000 7f4b528db700 1 -- 172.21.15.64:0/2309248213 wait complete. 2023-12-16T03:09:30.441 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.822+0000 7f4b528db700 1 Processor -- start 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.822+0000 7f4b528db700 1 -- start start 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.822+0000 7f4b528db700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.822+0000 7f4b528db700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1116c0 con 0x7f4b4c1022d0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.822+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.822+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32790/0 (socket says 172.21.15.64:32790) 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.822+0000 7f4b4bfff700 1 -- 172.21.15.64:0/1594281322 learned_addr learned my addr 172.21.15.64:0/1594281322 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.823+0000 7f4b4bfff700 1 -- 172.21.15.64:0/1594281322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c0094f0 con 0x7f4b4c1022d0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.823+0000 7f4b4bfff700 1 --2- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c111180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c011b60 tx=0x7f4b3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.823+0000 7f4b48ff9700 1 -- 172.21.15.64:0/1594281322 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b3c010850 con 0x7f4b4c1022d0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.823+0000 7f4b48ff9700 1 -- 172.21.15.64:0/1594281322 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b3c010e60 con 0x7f4b4c1022d0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.823+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c1118c0 con 0x7f4b4c1022d0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.823+0000 7f4b48ff9700 1 -- 172.21.15.64:0/1594281322 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b3c01ae20 con 0x7f4b4c1022d0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.823+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c111cd0 con 0x7f4b4c1022d0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.824+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c04bb80 con 0x7f4b4c1022d0 2023-12-16T03:09:30.442 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.824+0000 7f4b48ff9700 1 -- 172.21.15.64:0/1594281322 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f4b3c02d3f0 con 0x7f4b4c1022d0 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.824+0000 7f4b48ff9700 1 --2- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f4b340365f0 0x7f4b34038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.824+0000 7f4b48ff9700 1 -- 172.21.15.64:0/1594281322 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4b3c04a450 con 0x7f4b4c1022d0 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.824+0000 7f4b4b7fe700 1 --2- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f4b340365f0 0x7f4b34038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.825+0000 7f4b4b7fe700 1 --2- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f4b340365f0 0x7f4b34038aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009990 tx=0x7f4b40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:29.833+0000 7f4b48ff9700 1 -- 172.21.15.64:0/1594281322 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4b3c02b8e0 con 0x7f4b4c1022d0 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.045+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b4c10b000 con 0x7f4b340365f0 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.050+0000 7f4b48ff9700 1 -- 172.21.15.64:0/1594281322 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f4b4c10b000 con 0x7f4b340365f0 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f4b340365f0 msgr2=0x7f4b34038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 --2- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f4b340365f0 0x7f4b34038aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009990 tx=0x7f4b40006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 msgr2=0x7f4b4c111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 --2- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c111180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c011b60 tx=0x7f4b3c009250 comp rx=0 tx=0).stop 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 shutdown_connections 2023-12-16T03:09:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 --2- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f4b340365f0 0x7f4b34038aa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:30.444 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 --2- 172.21.15.64:0/1594281322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b4c1022d0 0x7f4b4c111180 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:30.444 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 >> 172.21.15.64:0/1594281322 conn(0x7f4b4c0fda50 msgr2=0x7f4b4c0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:30.444 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 shutdown_connections 2023-12-16T03:09:30.444 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.052+0000 7f4b528db700 1 -- 172.21.15.64:0/1594281322 wait complete. 2023-12-16T03:09:30.444 INFO:teuthology.orchestra.run.smithi064.stdout:Deploying grafana service with default placement... 2023-12-16T03:09:30.687 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:30 smithi064 ceph-mon[111958]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:30.687 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:30 smithi064 ceph-mon[111958]: Saving service crash spec with placement * 2023-12-16T03:09:30.687 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:30 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:30.687 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:30 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:31.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-16T03:09:31.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.805+0000 7fbc96685700 1 Processor -- start 2023-12-16T03:09:31.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.805+0000 7fbc96685700 1 -- start start 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.805+0000 7fbc96685700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc901026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.805+0000 7fbc96685700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90102c20 con 0x7fbc901022d0 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.805+0000 7fbc8ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc901026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.805+0000 7fbc8ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc901026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32804/0 (socket says 172.21.15.64:32804) 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.805+0000 7fbc8ffff700 1 -- 172.21.15.64:0/1115592361 learned_addr learned my addr 172.21.15.64:0/1115592361 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.806+0000 7fbc8ffff700 1 -- 172.21.15.64:0/1115592361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90102d60 con 0x7fbc901022d0 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.806+0000 7fbc8ffff700 1 --2- 172.21.15.64:0/1115592361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc901026e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbc800098e0 tx=0x7fbc80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5affcba135c3f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.806+0000 7fbc8effd700 1 -- 172.21.15.64:0/1115592361 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc8000b860 con 0x7fbc901022d0 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.806+0000 7fbc8effd700 1 -- 172.21.15.64:0/1115592361 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc8000be70 con 0x7fbc901022d0 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.806+0000 7fbc8effd700 1 -- 172.21.15.64:0/1115592361 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc80010380 con 0x7fbc901022d0 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 -- 172.21.15.64:0/1115592361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 msgr2=0x7fbc901026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 --2- 172.21.15.64:0/1115592361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc901026e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbc800098e0 tx=0x7fbc80009250 comp rx=0 tx=0).stop 2023-12-16T03:09:31.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 -- 172.21.15.64:0/1115592361 shutdown_connections 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 --2- 172.21.15.64:0/1115592361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc901026e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 -- 172.21.15.64:0/1115592361 >> 172.21.15.64:0/1115592361 conn(0x7fbc900fda50 msgr2=0x7fbc900ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 -- 172.21.15.64:0/1115592361 shutdown_connections 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 -- 172.21.15.64:0/1115592361 wait complete. 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 Processor -- start 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 -- start start 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.807+0000 7fbc96685700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc90077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc96685700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90076080 con 0x7fbc901022d0 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc8ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc90077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc8ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc90077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32816/0 (socket says 172.21.15.64:32816) 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc8ffff700 1 -- 172.21.15.64:0/2460468980 learned_addr learned my addr 172.21.15.64:0/2460468980 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc8ffff700 1 -- 172.21.15.64:0/2460468980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800094f0 con 0x7fbc901022d0 2023-12-16T03:09:31.516 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc8ffff700 1 --2- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc90077c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbc80011b60 tx=0x7fbc80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc8cff9700 1 -- 172.21.15.64:0/2460468980 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc80010850 con 0x7fbc901022d0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc90076280 con 0x7fbc901022d0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc8cff9700 1 -- 172.21.15.64:0/2460468980 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc80010e60 con 0x7fbc901022d0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc8cff9700 1 -- 172.21.15.64:0/2460468980 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc8001ae20 con 0x7fbc901022d0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.808+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc90076690 con 0x7fbc901022d0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.809+0000 7fbc8cff9700 1 -- 172.21.15.64:0/2460468980 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fbc8002d3f0 con 0x7fbc901022d0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.809+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9004bb80 con 0x7fbc901022d0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.809+0000 7fbc8cff9700 1 --2- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fbc780365f0 0x7fbc78038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.809+0000 7fbc8cff9700 1 -- 172.21.15.64:0/2460468980 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbc8004a400 con 0x7fbc901022d0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.809+0000 7fbc8f7fe700 1 --2- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fbc780365f0 0x7fbc78038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.810+0000 7fbc8f7fe700 1 --2- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fbc780365f0 0x7fbc78038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009990 tx=0x7fbc84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:30.814+0000 7fbc8cff9700 1 -- 172.21.15.64:0/2460468980 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbc8002b8e0 con 0x7fbc901022d0 2023-12-16T03:09:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.026+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc9010ae00 con 0x7fbc780365f0 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.031+0000 7fbc8cff9700 1 -- 172.21.15.64:0/2460468980 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fbc9010ae00 con 0x7fbc780365f0 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.032+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fbc780365f0 msgr2=0x7fbc78038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.032+0000 7fbc96685700 1 --2- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fbc780365f0 0x7fbc78038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009990 tx=0x7fbc84006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.033+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 msgr2=0x7fbc90077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.033+0000 7fbc96685700 1 --2- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc90077c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbc80011b60 tx=0x7fbc80009250 comp rx=0 tx=0).stop 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.033+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 shutdown_connections 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.033+0000 7fbc96685700 1 --2- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fbc780365f0 0x7fbc78038aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.033+0000 7fbc96685700 1 --2- 172.21.15.64:0/2460468980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc901022d0 0x7fbc90077c00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.033+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 >> 172.21.15.64:0/2460468980 conn(0x7fbc900fda50 msgr2=0x7fbc900ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.033+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 shutdown_connections 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.033+0000 7fbc96685700 1 -- 172.21.15.64:0/2460468980 wait complete. 2023-12-16T03:09:31.518 INFO:teuthology.orchestra.run.smithi064.stdout:Deploying node-exporter service with default placement... 2023-12-16T03:09:31.642 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:31 smithi064 ceph-mon[111958]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:31.642 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:31 smithi064 ceph-mon[111958]: Saving service prometheus spec with placement count:1 2023-12-16T03:09:31.643 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:31 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:32.468 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-16T03:09:32.468 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5add86d700 1 Processor -- start 2023-12-16T03:09:32.469 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5add86d700 1 -- start start 2023-12-16T03:09:32.469 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5add86d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad80771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:32.469 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5add86d700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80790f0 con 0x7f5ad8078ce0 2023-12-16T03:09:32.469 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5ad6ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad80771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:32.469 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5ad6ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad80771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32820/0 (socket says 172.21.15.64:32820) 2023-12-16T03:09:32.469 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5ad6ffd700 1 -- 172.21.15.64:0/1019933071 learned_addr learned my addr 172.21.15.64:0/1019933071 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:32.469 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5ad6ffd700 1 -- 172.21.15.64:0/1019933071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8077730 con 0x7f5ad8078ce0 2023-12-16T03:09:32.470 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5ad6ffd700 1 --2- 172.21.15.64:0/1019933071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad80771f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80098e0 tx=0x7f5ac8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2a7706cb30601c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:32.470 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5ad5ffb700 1 -- 172.21.15.64:0/1019933071 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ac800b860 con 0x7f5ad8078ce0 2023-12-16T03:09:32.470 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5ad5ffb700 1 -- 172.21.15.64:0/1019933071 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ac800be70 con 0x7f5ad8078ce0 2023-12-16T03:09:32.470 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.877+0000 7f5ad5ffb700 1 -- 172.21.15.64:0/1019933071 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ac8010380 con 0x7f5ad8078ce0 2023-12-16T03:09:32.470 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.878+0000 7f5add86d700 1 -- 172.21.15.64:0/1019933071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 msgr2=0x7f5ad80771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:32.470 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.878+0000 7f5add86d700 1 --2- 172.21.15.64:0/1019933071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad80771f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80098e0 tx=0x7f5ac8009250 comp rx=0 tx=0).stop 2023-12-16T03:09:32.470 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.878+0000 7f5add86d700 1 -- 172.21.15.64:0/1019933071 shutdown_connections 2023-12-16T03:09:32.470 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.878+0000 7f5add86d700 1 --2- 172.21.15.64:0/1019933071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad80771f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:32.470 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.878+0000 7f5add86d700 1 -- 172.21.15.64:0/1019933071 >> 172.21.15.64:0/1019933071 conn(0x7f5ad80fda10 msgr2=0x7f5ad80ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:32.471 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.878+0000 7f5add86d700 1 -- 172.21.15.64:0/1019933071 shutdown_connections 2023-12-16T03:09:32.471 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.878+0000 7f5add86d700 1 -- 172.21.15.64:0/1019933071 wait complete. 2023-12-16T03:09:32.471 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5add86d700 1 Processor -- start 2023-12-16T03:09:32.471 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5add86d700 1 -- start start 2023-12-16T03:09:32.471 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5add86d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad8113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:32.471 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5add86d700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8113870 con 0x7f5ad8078ce0 2023-12-16T03:09:32.471 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5ad6ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad8113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:32.471 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5ad6ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad8113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32830/0 (socket says 172.21.15.64:32830) 2023-12-16T03:09:32.472 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5ad6ffd700 1 -- 172.21.15.64:0/3046562385 learned_addr learned my addr 172.21.15.64:0/3046562385 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:32.472 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5ad6ffd700 1 -- 172.21.15.64:0/3046562385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac80094f0 con 0x7f5ad8078ce0 2023-12-16T03:09:32.472 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5ad6ffd700 1 --2- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad8113330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800ba70 tx=0x7f5ac8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:32.472 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5acf7fe700 1 -- 172.21.15.64:0/3046562385 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ac8010960 con 0x7f5ad8078ce0 2023-12-16T03:09:32.472 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5acf7fe700 1 -- 172.21.15.64:0/3046562385 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ac8024430 con 0x7f5ad8078ce0 2023-12-16T03:09:32.472 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.879+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad8113a70 con 0x7f5ad8078ce0 2023-12-16T03:09:32.472 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.880+0000 7f5acf7fe700 1 -- 172.21.15.64:0/3046562385 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ac801a5f0 con 0x7f5ad8078ce0 2023-12-16T03:09:32.472 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.880+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad8113e80 con 0x7f5ad8078ce0 2023-12-16T03:09:32.472 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.880+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad804bb80 con 0x7f5ad8078ce0 2023-12-16T03:09:32.473 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.881+0000 7f5acf7fe700 1 -- 172.21.15.64:0/3046562385 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5ac80249f0 con 0x7f5ad8078ce0 2023-12-16T03:09:32.473 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.881+0000 7f5acf7fe700 1 --2- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5ac4036640 0x7f5ac4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:32.473 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.881+0000 7f5acf7fe700 1 -- 172.21.15.64:0/3046562385 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5ac804a280 con 0x7f5ad8078ce0 2023-12-16T03:09:32.473 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.881+0000 7f5ad67fc700 1 --2- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5ac4036640 0x7f5ac4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:32.473 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.881+0000 7f5ad67fc700 1 --2- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5ac4036640 0x7f5ac4038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009990 tx=0x7f5ac0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:32.473 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:31.886+0000 7f5acf7fe700 1 -- 172.21.15.64:0/3046562385 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5ac8022920 con 0x7f5ad8078ce0 2023-12-16T03:09:32.473 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.091+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ad810d1d0 con 0x7f5ac4036640 2023-12-16T03:09:32.474 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.095+0000 7f5acf7fe700 1 -- 172.21.15.64:0/3046562385 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f5ad810d1d0 con 0x7f5ac4036640 2023-12-16T03:09:32.474 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5ac4036640 msgr2=0x7f5ac4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:32.474 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 --2- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5ac4036640 0x7f5ac4038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009990 tx=0x7f5ac0006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:32.474 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 msgr2=0x7f5ad8113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:32.474 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 --2- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad8113330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800ba70 tx=0x7f5ac8009250 comp rx=0 tx=0).stop 2023-12-16T03:09:32.474 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 shutdown_connections 2023-12-16T03:09:32.474 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 --2- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f5ac4036640 0x7f5ac4038af0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:32.474 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 --2- 172.21.15.64:0/3046562385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ad8078ce0 0x7f5ad8113330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:32.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 >> 172.21.15.64:0/3046562385 conn(0x7f5ad80fda10 msgr2=0x7f5ad80ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:32.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 shutdown_connections 2023-12-16T03:09:32.475 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.097+0000 7f5add86d700 1 -- 172.21.15.64:0/3046562385 wait complete. 2023-12-16T03:09:32.475 INFO:teuthology.orchestra.run.smithi064.stdout:Deploying alertmanager service with default placement... 2023-12-16T03:09:32.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:32 smithi064 ceph-mon[111958]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:32.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:32 smithi064 ceph-mon[111958]: Saving service grafana spec with placement count:1 2023-12-16T03:09:32.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:32 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:33.397 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.812+0000 7fb3c6b95700 1 Processor -- start 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.812+0000 7fb3c6b95700 1 -- start start 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.812+0000 7fb3c6b95700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c0104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.812+0000 7fb3c6b95700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0105420 con 0x7fb3c0070fc0 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.812+0000 7fb3c4931700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c0104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.812+0000 7fb3c4931700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c0104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43150/0 (socket says 172.21.15.64:43150) 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.812+0000 7fb3c4931700 1 -- 172.21.15.64:0/2003347456 learned_addr learned my addr 172.21.15.64:0/2003347456 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.812+0000 7fb3c4931700 1 -- 172.21.15.64:0/2003347456 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0105560 con 0x7fb3c0070fc0 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3c4931700 1 --2- 172.21.15.64:0/2003347456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c0104ee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40098e0 tx=0x7fb3b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f791991512096b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3bf7fe700 1 -- 172.21.15.64:0/2003347456 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3b400b860 con 0x7fb3c0070fc0 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3bf7fe700 1 -- 172.21.15.64:0/2003347456 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb3b400be70 con 0x7fb3c0070fc0 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3bf7fe700 1 -- 172.21.15.64:0/2003347456 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3b4010380 con 0x7fb3c0070fc0 2023-12-16T03:09:33.398 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3c6b95700 1 -- 172.21.15.64:0/2003347456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 msgr2=0x7fb3c0104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3c6b95700 1 --2- 172.21.15.64:0/2003347456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c0104ee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40098e0 tx=0x7fb3b4009250 comp rx=0 tx=0).stop 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3c6b95700 1 -- 172.21.15.64:0/2003347456 shutdown_connections 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3c6b95700 1 --2- 172.21.15.64:0/2003347456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c0104ee0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3c6b95700 1 -- 172.21.15.64:0/2003347456 >> 172.21.15.64:0/2003347456 conn(0x7fb3c00fc970 msgr2=0x7fb3c00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3c6b95700 1 -- 172.21.15.64:0/2003347456 shutdown_connections 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.813+0000 7fb3c6b95700 1 -- 172.21.15.64:0/2003347456 wait complete. 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.814+0000 7fb3c6b95700 1 Processor -- start 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.814+0000 7fb3c6b95700 1 -- start start 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.814+0000 7fb3c6b95700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c01111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.814+0000 7fb3c6b95700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0111700 con 0x7fb3c0070fc0 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.814+0000 7fb3c4931700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c01111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.814+0000 7fb3c4931700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c01111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43164/0 (socket says 172.21.15.64:43164) 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.814+0000 7fb3c4931700 1 -- 172.21.15.64:0/3586819322 learned_addr learned my addr 172.21.15.64:0/3586819322 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.815+0000 7fb3c4931700 1 -- 172.21.15.64:0/3586819322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b40094f0 con 0x7fb3c0070fc0 2023-12-16T03:09:33.399 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.815+0000 7fb3c4931700 1 --2- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c01111c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40094c0 tx=0x7fb3b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.815+0000 7fb3bd7fa700 1 -- 172.21.15.64:0/3586819322 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3b4010850 con 0x7fb3c0070fc0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.815+0000 7fb3bd7fa700 1 -- 172.21.15.64:0/3586819322 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb3b4010e60 con 0x7fb3c0070fc0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.815+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c0111900 con 0x7fb3c0070fc0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.815+0000 7fb3bd7fa700 1 -- 172.21.15.64:0/3586819322 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3b401a430 con 0x7fb3c0070fc0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.815+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c0111d10 con 0x7fb3c0070fc0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.816+0000 7fb3bd7fa700 1 -- 172.21.15.64:0/3586819322 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fb3b401a6b0 con 0x7fb3c0070fc0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.816+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c004bb80 con 0x7fb3c0070fc0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.816+0000 7fb3bd7fa700 1 --2- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fb3b00365f0 0x7fb3b0038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.816+0000 7fb3bd7fa700 1 -- 172.21.15.64:0/3586819322 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb3b404a4b0 con 0x7fb3c0070fc0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.816+0000 7fb3bffff700 1 --2- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fb3b00365f0 0x7fb3b0038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.816+0000 7fb3bffff700 1 --2- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fb3b00365f0 0x7fb3b0038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009990 tx=0x7fb3ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:32.821+0000 7fb3bd7fa700 1 -- 172.21.15.64:0/3586819322 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb3b40189a0 con 0x7fb3c0070fc0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.026+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3c010aff0 con 0x7fb3b00365f0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.031+0000 7fb3bd7fa700 1 -- 172.21.15.64:0/3586819322 <== mgr.14120 v2:172.21.15.64:6800/2673193978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fb3c010aff0 con 0x7fb3b00365f0 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fb3b00365f0 msgr2=0x7fb3b0038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:33.400 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 --2- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fb3b00365f0 0x7fb3b0038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009990 tx=0x7fb3ac006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:33.401 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 msgr2=0x7fb3c01111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:33.401 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 --2- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c01111c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40094c0 tx=0x7fb3b4009250 comp rx=0 tx=0).stop 2023-12-16T03:09:33.401 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 shutdown_connections 2023-12-16T03:09:33.401 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 --2- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7fb3b00365f0 0x7fb3b0038aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:33.401 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 --2- 172.21.15.64:0/3586819322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3c0070fc0 0x7fb3c01111c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:33.401 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 >> 172.21.15.64:0/3586819322 conn(0x7fb3c00fc970 msgr2=0x7fb3c00fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:33.401 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 shutdown_connections 2023-12-16T03:09:33.401 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.033+0000 7fb3c6b95700 1 -- 172.21.15.64:0/3586819322 wait complete. 2023-12-16T03:09:33.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:33 smithi064 ceph-mon[111958]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:33.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:33 smithi064 ceph-mon[111958]: Saving service node-exporter spec with placement * 2023-12-16T03:09:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:33 smithi064 ceph-mon[111958]: from='mgr.14120 172.21.15.64:0/2644361718' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:34.371 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.791+0000 7f6f80206700 1 Processor -- start 2023-12-16T03:09:34.371 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.791+0000 7f6f80206700 1 -- start start 2023-12-16T03:09:34.371 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.791+0000 7f6f80206700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f780771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:34.371 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.791+0000 7f6f80206700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780790d0 con 0x7f6f78078cc0 2023-12-16T03:09:34.371 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.791+0000 7f6f7dfa2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f780771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.791+0000 7f6f7dfa2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f780771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43176/0 (socket says 172.21.15.64:43176) 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.791+0000 7f6f7dfa2700 1 -- 172.21.15.64:0/3685968939 learned_addr learned my addr 172.21.15.64:0/3685968939 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.791+0000 7f6f7dfa2700 1 -- 172.21.15.64:0/3685968939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78077710 con 0x7f6f78078cc0 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.792+0000 7f6f7dfa2700 1 --2- 172.21.15.64:0/3685968939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f780771d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f740098e0 tx=0x7f6f74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a23c9333e60463 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.792+0000 7f6f7cfa0700 1 -- 172.21.15.64:0/3685968939 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f7400b860 con 0x7f6f78078cc0 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.792+0000 7f6f7cfa0700 1 -- 172.21.15.64:0/3685968939 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f7400be70 con 0x7f6f78078cc0 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.792+0000 7f6f7cfa0700 1 -- 172.21.15.64:0/3685968939 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f74010380 con 0x7f6f78078cc0 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.792+0000 7f6f80206700 1 -- 172.21.15.64:0/3685968939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 msgr2=0x7f6f780771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.792+0000 7f6f80206700 1 --2- 172.21.15.64:0/3685968939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f780771d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f740098e0 tx=0x7f6f74009250 comp rx=0 tx=0).stop 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.792+0000 7f6f80206700 1 -- 172.21.15.64:0/3685968939 shutdown_connections 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.792+0000 7f6f80206700 1 --2- 172.21.15.64:0/3685968939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f780771d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.792+0000 7f6f80206700 1 -- 172.21.15.64:0/3685968939 >> 172.21.15.64:0/3685968939 conn(0x7f6f780fda10 msgr2=0x7f6f780ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.793+0000 7f6f80206700 1 -- 172.21.15.64:0/3685968939 shutdown_connections 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.793+0000 7f6f80206700 1 -- 172.21.15.64:0/3685968939 wait complete. 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.793+0000 7f6f80206700 1 Processor -- start 2023-12-16T03:09:34.372 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.793+0000 7f6f80206700 1 -- start start 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.793+0000 7f6f80206700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f78113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f80206700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78113890 con 0x7f6f78078cc0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f7dfa2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f78113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f7dfa2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f78113350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43188/0 (socket says 172.21.15.64:43188) 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f7dfa2700 1 -- 172.21.15.64:0/3145510620 learned_addr learned my addr 172.21.15.64:0/3145510620 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f7dfa2700 1 -- 172.21.15.64:0/3145510620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740094f0 con 0x7f6f78078cc0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f7dfa2700 1 --2- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f78113350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f740094c0 tx=0x7f6f74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f6e7fc700 1 -- 172.21.15.64:0/3145510620 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f74010850 con 0x7f6f78078cc0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f6e7fc700 1 -- 172.21.15.64:0/3145510620 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f74010e60 con 0x7f6f78078cc0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f78113a90 con 0x7f6f78078cc0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f6e7fc700 1 -- 172.21.15.64:0/3145510620 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f740243f0 con 0x7f6f78078cc0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.794+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f78113ea0 con 0x7f6f78078cc0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.795+0000 7f6f6e7fc700 1 -- 172.21.15.64:0/3145510620 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f6f740109b0 con 0x7f6f78078cc0 2023-12-16T03:09:34.373 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.795+0000 7f6f6e7fc700 1 --2- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f6f64036640 0x7f6f64038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.795+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7804bb80 con 0x7f6f78078cc0 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.795+0000 7f6f6e7fc700 1 -- 172.21.15.64:0/3145510620 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6f7404a5a0 con 0x7f6f78078cc0 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.795+0000 7f6f7d7a1700 1 --2- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f6f64036640 0x7f6f64038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.796+0000 7f6f7d7a1700 1 --2- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f6f64036640 0x7f6f64038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009990 tx=0x7f6f68006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.800+0000 7f6f6e7fc700 1 -- 172.21.15.64:0/3145510620 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6f74024660 con 0x7f6f78078cc0 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.994+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f6f78108530 con 0x7f6f78078cc0 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.997+0000 7f6f6e7fc700 1 -- 172.21.15.64:0/3145510620 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f6f74024660 con 0x7f6f78078cc0 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.999+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f6f64036640 msgr2=0x7f6f64038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.999+0000 7f6f80206700 1 --2- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f6f64036640 0x7f6f64038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009990 tx=0x7f6f68006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.999+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 msgr2=0x7f6f78113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.999+0000 7f6f80206700 1 --2- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f78113350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f740094c0 tx=0x7f6f74009250 comp rx=0 tx=0).stop 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.999+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 shutdown_connections 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.999+0000 7f6f80206700 1 --2- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f6f64036640 0x7f6f64038af0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.999+0000 7f6f80206700 1 --2- 172.21.15.64:0/3145510620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f78078cc0 0x7f6f78113350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:33.999+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 >> 172.21.15.64:0/3145510620 conn(0x7f6f780fda10 msgr2=0x7f6f780ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:34.374 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.000+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 shutdown_connections 2023-12-16T03:09:34.375 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.000+0000 7f6f80206700 1 -- 172.21.15.64:0/3145510620 wait complete. 2023-12-16T03:09:34.533 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:34 smithi064 ceph-mon[111958]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:34.533 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:34 smithi064 ceph-mon[111958]: Saving service alertmanager spec with placement count:1 2023-12-16T03:09:34.533 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:34 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3145510620' entity='client.admin' 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.718+0000 7f9ddcd11700 1 Processor -- start 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.718+0000 7f9ddcd11700 1 -- start start 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.718+0000 7f9ddcd11700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.718+0000 7f9ddcd11700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8105410 con 0x7f9dd8076c20 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.718+0000 7f9dd659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.718+0000 7f9dd659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8104ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43198/0 (socket says 172.21.15.64:43198) 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.718+0000 7f9dd659c700 1 -- 172.21.15.64:0/235695464 learned_addr learned my addr 172.21.15.64:0/235695464 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9dd659c700 1 -- 172.21.15.64:0/235695464 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8105550 con 0x7f9dd8076c20 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9dd659c700 1 --2- 172.21.15.64:0/235695464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8104ed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80098e0 tx=0x7f9dc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2d019bccd5ba0f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:35.297 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9dd559a700 1 -- 172.21.15.64:0/235695464 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc800b860 con 0x7f9dd8076c20 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9dd559a700 1 -- 172.21.15.64:0/235695464 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9dc800be70 con 0x7f9dd8076c20 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9dd559a700 1 -- 172.21.15.64:0/235695464 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc8010380 con 0x7f9dd8076c20 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9ddcd11700 1 -- 172.21.15.64:0/235695464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 msgr2=0x7f9dd8104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9ddcd11700 1 --2- 172.21.15.64:0/235695464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8104ed0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80098e0 tx=0x7f9dc8009250 comp rx=0 tx=0).stop 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9ddcd11700 1 -- 172.21.15.64:0/235695464 shutdown_connections 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9ddcd11700 1 --2- 172.21.15.64:0/235695464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8104ed0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.719+0000 7f9ddcd11700 1 -- 172.21.15.64:0/235695464 >> 172.21.15.64:0/235695464 conn(0x7f9dd80fc980 msgr2=0x7f9dd80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.720+0000 7f9ddcd11700 1 -- 172.21.15.64:0/235695464 shutdown_connections 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.720+0000 7f9ddcd11700 1 -- 172.21.15.64:0/235695464 wait complete. 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.720+0000 7f9ddcd11700 1 Processor -- start 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.720+0000 7f9ddcd11700 1 -- start start 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9ddcd11700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9ddcd11700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd81116c0 con 0x7f9dd8076c20 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9dd659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:35.298 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9dd659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43202/0 (socket says 172.21.15.64:43202) 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9dd659c700 1 -- 172.21.15.64:0/1083227717 learned_addr learned my addr 172.21.15.64:0/1083227717 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9dd659c700 1 -- 172.21.15.64:0/1083227717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc80094f0 con 0x7f9dd8076c20 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9dd659c700 1 --2- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8111180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80094c0 tx=0x7f9dc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9dc6ffd700 1 -- 172.21.15.64:0/1083227717 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc8010850 con 0x7f9dd8076c20 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9dc6ffd700 1 -- 172.21.15.64:0/1083227717 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9dc8010e60 con 0x7f9dd8076c20 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd81118c0 con 0x7f9dd8076c20 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9dc6ffd700 1 -- 172.21.15.64:0/1083227717 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc801a430 con 0x7f9dd8076c20 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.721+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd8111cd0 con 0x7f9dd8076c20 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.722+0000 7f9dc6ffd700 1 -- 172.21.15.64:0/1083227717 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9dc801a660 con 0x7f9dd8076c20 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.722+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd804bb80 con 0x7f9dd8076c20 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.722+0000 7f9dc6ffd700 1 --2- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f9dc0036640 0x7f9dc0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.722+0000 7f9dc6ffd700 1 -- 172.21.15.64:0/1083227717 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9dc804a650 con 0x7f9dd8076c20 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.722+0000 7f9dd5d9b700 1 --2- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f9dc0036640 0x7f9dc0038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.723+0000 7f9dd5d9b700 1 --2- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f9dc0036640 0x7f9dc0038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009990 tx=0x7f9dcc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:35.299 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.727+0000 7f9dc6ffd700 1 -- 172.21.15.64:0/1083227717 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9dc801a910 con 0x7f9dd8076c20 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.922+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f9dd81062d0 con 0x7f9dd8076c20 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.928+0000 7f9dc6ffd700 1 -- 172.21.15.64:0/1083227717 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f9dc804a010 con 0x7f9dd8076c20 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f9dc0036640 msgr2=0x7f9dc0038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 --2- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f9dc0036640 0x7f9dc0038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009990 tx=0x7f9dcc006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 msgr2=0x7f9dd8111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 --2- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8111180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80094c0 tx=0x7f9dc8009250 comp rx=0 tx=0).stop 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 shutdown_connections 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 --2- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f9dc0036640 0x7f9dc0038af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 --2- 172.21.15.64:0/1083227717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dd8076c20 0x7f9dd8111180 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 >> 172.21.15.64:0/1083227717 conn(0x7f9dd80fc980 msgr2=0x7f9dd80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 shutdown_connections 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:34.930+0000 7f9ddcd11700 1 -- 172.21.15.64:0/1083227717 wait complete. 2023-12-16T03:09:35.300 INFO:teuthology.orchestra.run.smithi064.stdout:Enabling the dashboard module... 2023-12-16T03:09:36.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:35 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1083227717' entity='client.admin' 2023-12-16T03:09:36.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:35 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/262295763' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.652+0000 7f0cbbc49700 1 Processor -- start 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.652+0000 7f0cbbc49700 1 -- start start 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.652+0000 7f0cbbc49700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb4102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.652+0000 7f0cbbc49700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41030d0 con 0x7f0cb4102780 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.652+0000 7f0cb99e5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb4102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.652+0000 7f0cb99e5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb4102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43210/0 (socket says 172.21.15.64:43210) 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.653+0000 7f0cb99e5700 1 -- 172.21.15.64:0/4064387812 learned_addr learned my addr 172.21.15.64:0/4064387812 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.653+0000 7f0cb99e5700 1 -- 172.21.15.64:0/4064387812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4103210 con 0x7f0cb4102780 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.653+0000 7f0cb99e5700 1 --2- 172.21.15.64:0/4064387812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb4102b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80098e0 tx=0x7f0ca8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcc83cce490b289 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:36.314 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.653+0000 7f0cb89e3700 1 -- 172.21.15.64:0/4064387812 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ca800b860 con 0x7f0cb4102780 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.653+0000 7f0cb89e3700 1 -- 172.21.15.64:0/4064387812 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ca800be70 con 0x7f0cb4102780 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.653+0000 7f0cb89e3700 1 -- 172.21.15.64:0/4064387812 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ca8010380 con 0x7f0cb4102780 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.654+0000 7f0cbbc49700 1 -- 172.21.15.64:0/4064387812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 msgr2=0x7f0cb4102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.654+0000 7f0cbbc49700 1 --2- 172.21.15.64:0/4064387812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb4102b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80098e0 tx=0x7f0ca8009250 comp rx=0 tx=0).stop 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.654+0000 7f0cbbc49700 1 -- 172.21.15.64:0/4064387812 shutdown_connections 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.654+0000 7f0cbbc49700 1 --2- 172.21.15.64:0/4064387812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb4102b90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.654+0000 7f0cbbc49700 1 -- 172.21.15.64:0/4064387812 >> 172.21.15.64:0/4064387812 conn(0x7f0cb40fc0b0 msgr2=0x7f0cb40fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.654+0000 7f0cbbc49700 1 -- 172.21.15.64:0/4064387812 shutdown_connections 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.654+0000 7f0cbbc49700 1 -- 172.21.15.64:0/4064387812 wait complete. 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.655+0000 7f0cbbc49700 1 Processor -- start 2023-12-16T03:09:36.315 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.655+0000 7f0cbbc49700 1 -- start start 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.655+0000 7f0cbbc49700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb41100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.655+0000 7f0cbbc49700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41105e0 con 0x7f0cb4102780 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.655+0000 7f0cb99e5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb41100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.655+0000 7f0cb99e5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb41100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43226/0 (socket says 172.21.15.64:43226) 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.655+0000 7f0cb99e5700 1 -- 172.21.15.64:0/262295763 learned_addr learned my addr 172.21.15.64:0/262295763 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.655+0000 7f0cb99e5700 1 -- 172.21.15.64:0/262295763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80094f0 con 0x7f0cb4102780 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.655+0000 7f0cb99e5700 1 --2- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb41100a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80094c0 tx=0x7f0ca8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.656+0000 7f0ca67fc700 1 -- 172.21.15.64:0/262295763 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ca8010850 con 0x7f0cb4102780 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.656+0000 7f0ca67fc700 1 -- 172.21.15.64:0/262295763 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ca8010e60 con 0x7f0cb4102780 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.656+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb41107e0 con 0x7f0cb4102780 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.656+0000 7f0ca67fc700 1 -- 172.21.15.64:0/262295763 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ca801a430 con 0x7f0cb4102780 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.656+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb4110bf0 con 0x7f0cb4102780 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.656+0000 7f0ca67fc700 1 -- 172.21.15.64:0/262295763 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f0ca801a6b0 con 0x7f0cb4102780 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.657+0000 7f0ca67fc700 1 --2- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f0ca00365f0 0x7f0ca0038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:36.316 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.657+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb404bb80 con 0x7f0cb4102780 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.657+0000 7f0ca67fc700 1 -- 172.21.15.64:0/262295763 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0ca804a560 con 0x7f0cb4102780 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.657+0000 7f0cb91e4700 1 --2- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f0ca00365f0 0x7f0ca0038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.657+0000 7f0cb91e4700 1 --2- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f0ca00365f0 0x7f0ca0038aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009990 tx=0x7f0cb0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.661+0000 7f0ca67fc700 1 -- 172.21.15.64:0/262295763 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0ca8018530 con 0x7f0cb4102780 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.911+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f0cb4109eb0 con 0x7f0cb4102780 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.928+0000 7f0ca67fc700 1 -- 172.21.15.64:0/262295763 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f0ca80247b0 con 0x7f0cb4102780 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.929+0000 7f0ca67fc700 1 -- 172.21.15.64:0/262295763 <== mon.0 v2:172.21.15.64:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f0ca8019d50 con 0x7f0cb4102780 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.931+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f0ca00365f0 msgr2=0x7f0ca0038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.931+0000 7f0cbbc49700 1 --2- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f0ca00365f0 0x7f0ca0038aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009990 tx=0x7f0cb0006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.931+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 msgr2=0x7f0cb41100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.931+0000 7f0cbbc49700 1 --2- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb41100a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80094c0 tx=0x7f0ca8009250 comp rx=0 tx=0).stop 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.931+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 shutdown_connections 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.931+0000 7f0cbbc49700 1 --2- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f0ca00365f0 0x7f0ca0038aa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:36.317 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.931+0000 7f0cbbc49700 1 --2- 172.21.15.64:0/262295763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cb4102780 0x7f0cb41100a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:36.318 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.931+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 >> 172.21.15.64:0/262295763 conn(0x7f0cb40fc0b0 msgr2=0x7f0cb40fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:36.318 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.932+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 shutdown_connections 2023-12-16T03:09:36.318 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:35.932+0000 7f0cbbc49700 1 -- 172.21.15.64:0/262295763 wait complete. 2023-12-16T03:09:37.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:36 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/262295763' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-16T03:09:37.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:36 smithi064 ceph-mon[111958]: mgrmap e9: smithi064.ueciyw(active, since 19s) 2023-12-16T03:09:37.330 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout { 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "active_name": "smithi064.ueciyw", 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout } 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.701+0000 7f2eaf1da700 1 Processor -- start 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.701+0000 7f2eaf1da700 1 -- start start 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.701+0000 7f2eaf1da700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea8102bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.701+0000 7f2eaf1da700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea81030f0 con 0x7f2ea81027a0 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.702+0000 7f2eacf76700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea8102bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:37.331 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.702+0000 7f2eacf76700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea8102bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43264/0 (socket says 172.21.15.64:43264) 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.702+0000 7f2eacf76700 1 -- 172.21.15.64:0/2586876777 learned_addr learned my addr 172.21.15.64:0/2586876777 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.702+0000 7f2eacf76700 1 -- 172.21.15.64:0/2586876777 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8103230 con 0x7f2ea81027a0 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.702+0000 7f2eacf76700 1 --2- 172.21.15.64:0/2586876777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea8102bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00bb80 tx=0x7f2e9c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc46ea003640b3f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.702+0000 7f2ea77fe700 1 -- 172.21.15.64:0/2586876777 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e9c00dd00 con 0x7f2ea81027a0 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.702+0000 7f2ea77fe700 1 -- 172.21.15.64:0/2586876777 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e9c00de60 con 0x7f2ea81027a0 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.702+0000 7f2ea77fe700 1 -- 172.21.15.64:0/2586876777 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e9c0188d0 con 0x7f2ea81027a0 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.703+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2586876777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 msgr2=0x7f2ea8102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.703+0000 7f2eaf1da700 1 --2- 172.21.15.64:0/2586876777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea8102bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00bb80 tx=0x7f2e9c00b4f0 comp rx=0 tx=0).stop 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.703+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2586876777 shutdown_connections 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.703+0000 7f2eaf1da700 1 --2- 172.21.15.64:0/2586876777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea8102bb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.703+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2586876777 >> 172.21.15.64:0/2586876777 conn(0x7f2ea80fc0b0 msgr2=0x7f2ea80fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.703+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2586876777 shutdown_connections 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.703+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2586876777 wait complete. 2023-12-16T03:09:37.332 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.704+0000 7f2eaf1da700 1 Processor -- start 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.704+0000 7f2eaf1da700 1 -- start start 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.704+0000 7f2eaf1da700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea810ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.704+0000 7f2eaf1da700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea810f480 con 0x7f2ea81027a0 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.704+0000 7f2eacf76700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea810ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.704+0000 7f2eacf76700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea810ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43270/0 (socket says 172.21.15.64:43270) 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.704+0000 7f2eacf76700 1 -- 172.21.15.64:0/2785540033 learned_addr learned my addr 172.21.15.64:0/2785540033 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.705+0000 7f2eacf76700 1 -- 172.21.15.64:0/2785540033 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c00b790 con 0x7f2ea81027a0 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.705+0000 7f2eacf76700 1 --2- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea810ef40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c007010 tx=0x7f2e9c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.705+0000 7f2ea57fa700 1 -- 172.21.15.64:0/2785540033 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e9c010b30 con 0x7f2ea81027a0 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.705+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea810f680 con 0x7f2ea81027a0 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.705+0000 7f2ea57fa700 1 -- 172.21.15.64:0/2785540033 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e9c01d050 con 0x7f2ea81027a0 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.705+0000 7f2ea57fa700 1 -- 172.21.15.64:0/2785540033 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e9c022590 con 0x7f2ea81027a0 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.705+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea810fa90 con 0x7f2ea81027a0 2023-12-16T03:09:37.333 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.706+0000 7f2ea57fa700 1 -- 172.21.15.64:0/2785540033 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f2e9c022790 con 0x7f2ea81027a0 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.706+0000 7f2ea57fa700 1 --2- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f2e98036640 0x7f2e98038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.706+0000 7f2ea57fa700 1 -- 172.21.15.64:0/2785540033 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2e9c014070 con 0x7f2ea81027a0 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.706+0000 7f2ea7fff700 1 -- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f2e98036640 msgr2=0x7f2e98038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/2673193978 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.706+0000 7f2ea7fff700 1 --2- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f2e98036640 0x7f2e98038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.706+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea804bb80 con 0x7f2ea81027a0 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.711+0000 7f2ea57fa700 1 -- 172.21.15.64:0/2785540033 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2e9c049080 con 0x7f2ea81027a0 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.907+0000 7f2ea7fff700 1 -- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f2e98036640 msgr2=0x7f2e98038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/2673193978 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.907+0000 7f2ea7fff700 1 --2- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f2e98036640 0x7f2e98038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.965+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f2ea8108920 con 0x7f2ea81027a0 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.966+0000 7f2ea57fa700 1 -- 172.21.15.64:0/2785540033 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f2e9c022ae0 con 0x7f2ea81027a0 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f2e98036640 msgr2=0x7f2e98038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 --2- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f2e98036640 0x7f2e98038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 msgr2=0x7f2ea810ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:37.334 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 --2- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea810ef40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c007010 tx=0x7f2e9c00b4f0 comp rx=0 tx=0).stop 2023-12-16T03:09:37.335 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 shutdown_connections 2023-12-16T03:09:37.335 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 --2- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f2e98036640 0x7f2e98038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:37.335 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 --2- 172.21.15.64:0/2785540033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ea81027a0 0x7f2ea810ef40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:37.335 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 >> 172.21.15.64:0/2785540033 conn(0x7f2ea80fc0b0 msgr2=0x7f2ea8105f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:37.335 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 shutdown_connections 2023-12-16T03:09:37.335 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:36.968+0000 7f2eaf1da700 1 -- 172.21.15.64:0/2785540033 wait complete. 2023-12-16T03:09:37.335 INFO:teuthology.orchestra.run.smithi064.stdout:Waiting for the mgr to restart... 2023-12-16T03:09:37.335 INFO:teuthology.orchestra.run.smithi064.stdout:Waiting for mgr epoch 9... 2023-12-16T03:09:38.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:37 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2785540033' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-16T03:09:42.879 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: Active manager daemon smithi064.ueciyw restarted 2023-12-16T03:09:42.879 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: Activating manager daemon smithi064.ueciyw 2023-12-16T03:09:42.879 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: osdmap e3: 0 total, 0 up, 0 in 2023-12-16T03:09:42.879 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: mgrmap e10: smithi064.ueciyw(active, starting, since 0.00350454s) 2023-12-16T03:09:42.879 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:09:42.879 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:09:42.879 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:09:42.879 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:09:42.879 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:09:42.880 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: Manager daemon smithi064.ueciyw is now available 2023-12-16T03:09:42.880 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:09:42.880 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:42 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:09:44.110 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:43 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:09:44.110 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:43 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/trash_purge_schedule"}]: dispatch 2023-12-16T03:09:44.110 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:43 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:44.110 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:43 smithi064 ceph-mon[111958]: mgrmap e11: smithi064.ueciyw(active, since 1.00565s) 2023-12-16T03:09:44.110 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:43 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:44.130 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout { 2023-12-16T03:09:44.130 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-16T03:09:44.130 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-16T03:09:44.130 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout } 2023-12-16T03:09:44.130 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.704+0000 7f120760f700 1 Processor -- start 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.704+0000 7f120760f700 1 -- start start 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.704+0000 7f120760f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f12001015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.704+0000 7f120760f700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200101b20 con 0x7f12001011d0 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.704+0000 7f12053ab700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f12001015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.704+0000 7f12053ab700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f12001015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43280/0 (socket says 172.21.15.64:43280) 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.704+0000 7f12053ab700 1 -- 172.21.15.64:0/2867478511 learned_addr learned my addr 172.21.15.64:0/2867478511 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.705+0000 7f12053ab700 1 -- 172.21.15.64:0/2867478511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1200101c60 con 0x7f12001011d0 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.705+0000 7f12053ab700 1 --2- 172.21.15.64:0/2867478511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f12001015e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0098e0 tx=0x7f11fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7464de15c2cf33ff server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.705+0000 7f11f7fff700 1 -- 172.21.15.64:0/2867478511 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11fc00b860 con 0x7f12001011d0 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.705+0000 7f11f7fff700 1 -- 172.21.15.64:0/2867478511 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11fc00be70 con 0x7f12001011d0 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.705+0000 7f11f7fff700 1 -- 172.21.15.64:0/2867478511 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11fc010380 con 0x7f12001011d0 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.706+0000 7f120760f700 1 -- 172.21.15.64:0/2867478511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 msgr2=0x7f12001015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.706+0000 7f120760f700 1 --2- 172.21.15.64:0/2867478511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f12001015e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0098e0 tx=0x7f11fc009250 comp rx=0 tx=0).stop 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.706+0000 7f120760f700 1 -- 172.21.15.64:0/2867478511 shutdown_connections 2023-12-16T03:09:44.131 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.706+0000 7f120760f700 1 --2- 172.21.15.64:0/2867478511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f12001015e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.706+0000 7f120760f700 1 -- 172.21.15.64:0/2867478511 >> 172.21.15.64:0/2867478511 conn(0x7f12000fc970 msgr2=0x7f12000fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.706+0000 7f120760f700 1 -- 172.21.15.64:0/2867478511 shutdown_connections 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.706+0000 7f120760f700 1 -- 172.21.15.64:0/2867478511 wait complete. 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.706+0000 7f120760f700 1 Processor -- start 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.706+0000 7f120760f700 1 -- start start 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f120760f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f120010ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f120760f700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120010f4c0 con 0x7f12001011d0 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f12053ab700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f120010ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f12053ab700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f120010ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43294/0 (socket says 172.21.15.64:43294) 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f12053ab700 1 -- 172.21.15.64:0/3988756094 learned_addr learned my addr 172.21.15.64:0/3988756094 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f12053ab700 1 -- 172.21.15.64:0/3988756094 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0094f0 con 0x7f12001011d0 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f12053ab700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f120010ef80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11fc011b60 tx=0x7f11fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11fc010850 con 0x7f12001011d0 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11fc010e60 con 0x7f12001011d0 2023-12-16T03:09:44.132 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f120760f700 1 -- 172.21.15.64:0/3988756094 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120010f6c0 con 0x7f12001011d0 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.707+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11fc01ae20 con 0x7f12001011d0 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.708+0000 7f120760f700 1 -- 172.21.15.64:0/3988756094 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120010fad0 con 0x7f12001011d0 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.708+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f11fc02d3f0 con 0x7f12001011d0 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.709+0000 7f11f5ffb700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 0x7f11ec03ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.709+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 --> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11ec03b4a0 con 0x7f11ec0388e0 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.709+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f11fc04a330 con 0x7f12001011d0 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.709+0000 7f1204baa700 1 -- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 msgr2=0x7f11ec03ad90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/2673193978 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.709+0000 7f1204baa700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 0x7f11ec03ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.910+0000 7f1204baa700 1 -- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 msgr2=0x7f11ec03ad90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/2673193978 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:37.910+0000 7f1204baa700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 0x7f11ec03ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:38.311+0000 7f1204baa700 1 -- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 msgr2=0x7f11ec03ad90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/2673193978 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:38.311+0000 7f1204baa700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 0x7f11ec03ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:39.112+0000 7f1204baa700 1 -- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 msgr2=0x7f11ec03ad90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/2673193978 2023-12-16T03:09:44.133 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:39.112+0000 7f1204baa700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 0x7f11ec03ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:40.713+0000 7f1204baa700 1 -- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 msgr2=0x7f11ec03ad90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/2673193978 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:40.713+0000 7f1204baa700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 0x7f11ec03ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:42.760+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f11fc02d740 con 0x7f12001011d0 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:42.760+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 msgr2=0x7f11ec03ad90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:42.760+0000 7f11f5ffb700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 0x7f11ec03ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.761+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f11fc008d10 con 0x7f12001011d0 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.761+0000 7f11f5ffb700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f11ec03c390 0x7f11ec03e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.761+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 --> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11ec03b4a0 con 0x7f11ec03c390 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.762+0000 7f1204baa700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f11ec03c390 0x7f11ec03e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.762+0000 7f1204baa700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f11ec03c390 0x7f11ec03e770 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f11f00039d0 tx=0x7f11f0009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.763+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 <== mgr.14162 v2:172.21.15.64:6800/1165076471 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f11ec03b4a0 con 0x7f11ec03c390 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.769+0000 7f120760f700 1 -- 172.21.15.64:0/3988756094 --> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f120004bb80 con 0x7f11ec03c390 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.769+0000 7f11f5ffb700 1 -- 172.21.15.64:0/3988756094 <== mgr.14162 v2:172.21.15.64:6800/1165076471 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f120004bb80 con 0x7f11ec03c390 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 -- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f11ec03c390 msgr2=0x7f11ec03e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f11ec03c390 0x7f11ec03e770 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f11f00039d0 tx=0x7f11f0009350 comp rx=0 tx=0).stop 2023-12-16T03:09:44.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 -- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 msgr2=0x7f120010ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f120010ef80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11fc011b60 tx=0x7f11fc009250 comp rx=0 tx=0).stop 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 -- 172.21.15.64:0/3988756094 shutdown_connections 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f11ec03c390 0x7f11ec03e770 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12001011d0 0x7f120010ef80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 --2- 172.21.15.64:0/3988756094 >> [v2:172.21.15.64:6800/2673193978,v1:172.21.15.64:6801/2673193978] conn(0x7f11ec0388e0 0x7f11ec03ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 -- 172.21.15.64:0/3988756094 >> 172.21.15.64:0/3988756094 conn(0x7f12000fc970 msgr2=0x7f1200105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 -- 172.21.15.64:0/3988756094 shutdown_connections 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:43.770+0000 7f120760f700 1 -- 172.21.15.64:0/3988756094 wait complete. 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:mgr epoch 9 is available 2023-12-16T03:09:44.135 INFO:teuthology.orchestra.run.smithi064.stdout:Generating a dashboard self-signed certificate... 2023-12-16T03:09:45.068 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:44 smithi064 ceph-mon[111958]: [16/Dec/2023:03:09:43] ENGINE Bus STARTING 2023-12-16T03:09:45.068 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:44 smithi064 ceph-mon[111958]: [16/Dec/2023:03:09:43] ENGINE Serving on https://172.21.15.64:7150 2023-12-16T03:09:45.068 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:44 smithi064 ceph-mon[111958]: [16/Dec/2023:03:09:43] ENGINE Bus STARTED 2023-12-16T03:09:45.068 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:44 smithi064 ceph-mon[111958]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-16T03:09:45.068 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:44 smithi064 ceph-mon[111958]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-16T03:09:45.069 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:44 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:45.069 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:44 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:45.069 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:44 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:45.136 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.511+0000 7f6589062700 1 Processor -- start 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.511+0000 7f6589062700 1 -- start start 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.511+0000 7f6589062700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.511+0000 7f6589062700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6584105410 con 0x7f6584076c20 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.511+0000 7f6582d9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.511+0000 7f6582d9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584104ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37386/0 (socket says 172.21.15.64:37386) 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.511+0000 7f6582d9d700 1 -- 172.21.15.64:0/1626115147 learned_addr learned my addr 172.21.15.64:0/1626115147 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.511+0000 7f6582d9d700 1 -- 172.21.15.64:0/1626115147 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6584105550 con 0x7f6584076c20 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6582d9d700 1 --2- 172.21.15.64:0/1626115147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584104ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65740098e0 tx=0x7f6574009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5903848707d6c5ed server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6581d9b700 1 -- 172.21.15.64:0/1626115147 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f657400b860 con 0x7f6584076c20 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6581d9b700 1 -- 172.21.15.64:0/1626115147 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f657400be70 con 0x7f6584076c20 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6581d9b700 1 -- 172.21.15.64:0/1626115147 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6574010380 con 0x7f6584076c20 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6589062700 1 -- 172.21.15.64:0/1626115147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 msgr2=0x7f6584104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6589062700 1 --2- 172.21.15.64:0/1626115147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584104ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65740098e0 tx=0x7f6574009250 comp rx=0 tx=0).stop 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6589062700 1 -- 172.21.15.64:0/1626115147 shutdown_connections 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6589062700 1 --2- 172.21.15.64:0/1626115147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584104ed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6589062700 1 -- 172.21.15.64:0/1626115147 >> 172.21.15.64:0/1626115147 conn(0x7f65840fc980 msgr2=0x7f65840fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6589062700 1 -- 172.21.15.64:0/1626115147 shutdown_connections 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.512+0000 7f6589062700 1 -- 172.21.15.64:0/1626115147 wait complete. 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.513+0000 7f6589062700 1 Processor -- start 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.513+0000 7f6589062700 1 -- start start 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.513+0000 7f6589062700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.513+0000 7f6589062700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65841116c0 con 0x7f6584076c20 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.513+0000 7f6582d9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.513+0000 7f6582d9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37402/0 (socket says 172.21.15.64:37402) 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.513+0000 7f6582d9d700 1 -- 172.21.15.64:0/137327661 learned_addr learned my addr 172.21.15.64:0/137327661 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.514+0000 7f6582d9d700 1 -- 172.21.15.64:0/137327661 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740094f0 con 0x7f6584076c20 2023-12-16T03:09:45.138 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.514+0000 7f6582d9d700 1 --2- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584111180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f65740094c0 tx=0x7f6574009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.514+0000 7f656b7fe700 1 -- 172.21.15.64:0/137327661 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6574010850 con 0x7f6584076c20 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.514+0000 7f656b7fe700 1 -- 172.21.15.64:0/137327661 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6574010e60 con 0x7f6584076c20 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.514+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65841118c0 con 0x7f6584076c20 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.514+0000 7f656b7fe700 1 -- 172.21.15.64:0/137327661 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f657401a430 con 0x7f6584076c20 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.514+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6584111cd0 con 0x7f6584076c20 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.515+0000 7f656b7fe700 1 -- 172.21.15.64:0/137327661 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f65740109b0 con 0x7f6584076c20 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.515+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658404bb80 con 0x7f6584076c20 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.515+0000 7f656b7fe700 1 --2- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f656c036570 0x7f656c038a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.515+0000 7f656b7fe700 1 -- 172.21.15.64:0/137327661 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f657404a330 con 0x7f6584076c20 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.515+0000 7f658259c700 1 --2- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f656c036570 0x7f656c038a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.516+0000 7f658259c700 1 --2- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f656c036570 0x7f656c038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6578009990 tx=0x7f6578006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.520+0000 7f656b7fe700 1 -- 172.21.15.64:0/137327661 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f65740227b0 con 0x7f6584076c20 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.726+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 --> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f658410afe0 con 0x7f656c036570 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.775+0000 7f656b7fe700 1 -- 172.21.15.64:0/137327661 <== mgr.14162 v2:172.21.15.64:6800/1165076471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f658410afe0 con 0x7f656c036570 2023-12-16T03:09:45.139 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f656c036570 msgr2=0x7f656c038a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 --2- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f656c036570 0x7f656c038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6578009990 tx=0x7f6578006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 msgr2=0x7f6584111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 --2- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584111180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f65740094c0 tx=0x7f6574009250 comp rx=0 tx=0).stop 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 shutdown_connections 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 --2- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f656c036570 0x7f656c038a20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 --2- 172.21.15.64:0/137327661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6584076c20 0x7f6584111180 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 >> 172.21.15.64:0/137327661 conn(0x7f65840fc980 msgr2=0x7f65840fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 shutdown_connections 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:44.778+0000 7f6589062700 1 -- 172.21.15.64:0/137327661 wait complete. 2023-12-16T03:09:45.140 INFO:teuthology.orchestra.run.smithi064.stdout:Creating initial admin user... 2023-12-16T03:09:46.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:45 smithi064 ceph-mon[111958]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:46.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:45 smithi064 ceph-mon[111958]: mgrmap e12: smithi064.ueciyw(active, since 2s) 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$zp/uUCceX4CtLYvcwuZhw.bedpR/9i.GCK8u8sGSy.9DkgA5Xzff2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702696186, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.732+0000 7f68e8ac1700 1 Processor -- start 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.732+0000 7f68e8ac1700 1 -- start start 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.732+0000 7f68e8ac1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e40760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.732+0000 7f68e8ac1700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4077fc0 con 0x7f68e4077bb0 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.732+0000 7f68e259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e40760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.732+0000 7f68e259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e40760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37416/0 (socket says 172.21.15.64:37416) 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.732+0000 7f68e259c700 1 -- 172.21.15.64:0/3797812801 learned_addr learned my addr 172.21.15.64:0/3797812801 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.733+0000 7f68e259c700 1 -- 172.21.15.64:0/3797812801 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4076600 con 0x7f68e4077bb0 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.733+0000 7f68e259c700 1 --2- 172.21.15.64:0/3797812801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e40760c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009e50 tx=0x7f68d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce026ac6c98d601 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.733+0000 7f68e159a700 1 -- 172.21.15.64:0/3797812801 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68d40092e0 con 0x7f68e4077bb0 2023-12-16T03:09:46.572 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.733+0000 7f68e159a700 1 -- 172.21.15.64:0/3797812801 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68d4012430 con 0x7f68e4077bb0 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.733+0000 7f68e159a700 1 -- 172.21.15.64:0/3797812801 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68d40075c0 con 0x7f68e4077bb0 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.734+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3797812801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 msgr2=0x7f68e40760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.734+0000 7f68e8ac1700 1 --2- 172.21.15.64:0/3797812801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e40760c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009e50 tx=0x7f68d4009840 comp rx=0 tx=0).stop 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.734+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3797812801 shutdown_connections 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.734+0000 7f68e8ac1700 1 --2- 172.21.15.64:0/3797812801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e40760c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.734+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3797812801 >> 172.21.15.64:0/3797812801 conn(0x7f68e40fda50 msgr2=0x7f68e40ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.734+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3797812801 shutdown_connections 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.734+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3797812801 wait complete. 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.734+0000 7f68e8ac1700 1 Processor -- start 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.734+0000 7f68e8ac1700 1 -- start start 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68e8ac1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e41133e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68e8ac1700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4113920 con 0x7f68e4077bb0 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68e259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e41133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:46.573 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68e259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e41133e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37430/0 (socket says 172.21.15.64:37430) 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68e259c700 1 -- 172.21.15.64:0/3917800593 learned_addr learned my addr 172.21.15.64:0/3917800593 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68e259c700 1 -- 172.21.15.64:0/3917800593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4009ae0 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68e259c700 1 --2- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e41133e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009fd0 tx=0x7f68d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68daffd700 1 -- 172.21.15.64:0/3917800593 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68d40092e0 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68daffd700 1 -- 172.21.15.64:0/3917800593 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68d4007ce0 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e4113b20 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68daffd700 1 -- 172.21.15.64:0/3917800593 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68d401c880 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.735+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e41147c0 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.736+0000 7f68daffd700 1 -- 172.21.15.64:0/3917800593 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f68d4019070 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.736+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e405f270 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.736+0000 7f68daffd700 1 --2- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f68d0036690 0x7f68d0038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.737+0000 7f68daffd700 1 -- 172.21.15.64:0/3917800593 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f68d4049db0 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.737+0000 7f68e1d9b700 1 --2- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f68d0036690 0x7f68d0038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.737+0000 7f68e1d9b700 1 --2- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f68d0036690 0x7f68d0038b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009990 tx=0x7f68cc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.741+0000 7f68daffd700 1 -- 172.21.15.64:0/3917800593 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f68d4007830 con 0x7f68e4077bb0 2023-12-16T03:09:46.574 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:45.952+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 --> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f68e405f090 con 0x7f68d0036690 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.197+0000 7f68daffd700 1 -- 172.21.15.64:0/3917800593 <== mgr.14162 v2:172.21.15.64:6800/1165076471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f68e405f090 con 0x7f68d0036690 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f68d0036690 msgr2=0x7f68d0038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 --2- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f68d0036690 0x7f68d0038b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009990 tx=0x7f68cc006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 msgr2=0x7f68e41133e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 --2- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e41133e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009fd0 tx=0x7f68d4009840 comp rx=0 tx=0).stop 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 shutdown_connections 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 --2- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f68d0036690 0x7f68d0038b40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 --2- 172.21.15.64:0/3917800593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68e4077bb0 0x7f68e41133e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 >> 172.21.15.64:0/3917800593 conn(0x7f68e40fda50 msgr2=0x7f68e40ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 shutdown_connections 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.199+0000 7f68e8ac1700 1 -- 172.21.15.64:0/3917800593 wait complete. 2023-12-16T03:09:46.575 INFO:teuthology.orchestra.run.smithi064.stdout:Fetching dashboard port number... 2023-12-16T03:09:47.187 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:46 smithi064 ceph-mon[111958]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:47.188 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:46 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:47.554 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stdout 8443 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.952+0000 7fd125b6c700 1 Processor -- start 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.952+0000 7fd125b6c700 1 -- start start 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.952+0000 7fd125b6c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd120103da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.952+0000 7fd125b6c700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201042e0 con 0x7fd120103990 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.952+0000 7fd11f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd120103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.952+0000 7fd11f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd120103da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37446/0 (socket says 172.21.15.64:37446) 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.952+0000 7fd11f7fe700 1 -- 172.21.15.64:0/2456195169 learned_addr learned my addr 172.21.15.64:0/2456195169 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.952+0000 7fd11f7fe700 1 -- 172.21.15.64:0/2456195169 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120104420 con 0x7fd120103990 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd11f7fe700 1 --2- 172.21.15.64:0/2456195169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd120103da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1100098e0 tx=0x7fd110009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b385ded9e5bebe5a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd11e7fc700 1 -- 172.21.15.64:0/2456195169 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd11000b860 con 0x7fd120103990 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd11e7fc700 1 -- 172.21.15.64:0/2456195169 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd11000be70 con 0x7fd120103990 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd11e7fc700 1 -- 172.21.15.64:0/2456195169 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd110010380 con 0x7fd120103990 2023-12-16T03:09:47.555 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd125b6c700 1 -- 172.21.15.64:0/2456195169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 msgr2=0x7fd120103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd125b6c700 1 --2- 172.21.15.64:0/2456195169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd120103da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1100098e0 tx=0x7fd110009250 comp rx=0 tx=0).stop 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd125b6c700 1 -- 172.21.15.64:0/2456195169 shutdown_connections 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd125b6c700 1 --2- 172.21.15.64:0/2456195169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd120103da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd125b6c700 1 -- 172.21.15.64:0/2456195169 >> 172.21.15.64:0/2456195169 conn(0x7fd1200fc0b0 msgr2=0x7fd1200fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd125b6c700 1 -- 172.21.15.64:0/2456195169 shutdown_connections 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.953+0000 7fd125b6c700 1 -- 172.21.15.64:0/2456195169 wait complete. 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.954+0000 7fd125b6c700 1 Processor -- start 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.954+0000 7fd125b6c700 1 -- start start 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.954+0000 7fd125b6c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd1201031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.954+0000 7fd125b6c700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120101650 con 0x7fd120103990 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.954+0000 7fd11f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd1201031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.954+0000 7fd11f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd1201031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37448/0 (socket says 172.21.15.64:37448) 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.954+0000 7fd11f7fe700 1 -- 172.21.15.64:0/1577263485 learned_addr learned my addr 172.21.15.64:0/1577263485 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.955+0000 7fd11f7fe700 1 -- 172.21.15.64:0/1577263485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100094f0 con 0x7fd120103990 2023-12-16T03:09:47.556 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.955+0000 7fd11f7fe700 1 --2- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd1201031d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd11000c010 tx=0x7fd110009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.955+0000 7fd107fff700 1 -- 172.21.15.64:0/1577263485 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd110010960 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.955+0000 7fd107fff700 1 -- 172.21.15.64:0/1577263485 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd11001a430 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.955+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd120101850 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.955+0000 7fd107fff700 1 -- 172.21.15.64:0/1577263485 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd110019580 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.955+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd120101c60 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.956+0000 7fd107fff700 1 -- 172.21.15.64:0/1577263485 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fd110019800 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.956+0000 7fd107fff700 1 --2- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd108036640 0x7fd108038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.956+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12004bb80 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.956+0000 7fd107fff700 1 -- 172.21.15.64:0/1577263485 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd11004a510 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.956+0000 7fd11effd700 1 --2- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd108036640 0x7fd108038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.956+0000 7fd11effd700 1 --2- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd108036640 0x7fd108038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd114009990 tx=0x7fd114006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:46.961+0000 7fd107fff700 1 -- 172.21.15.64:0/1577263485 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd11002bb30 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.156+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fd120100de0 con 0x7fd120103990 2023-12-16T03:09:47.557 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.156+0000 7fd107fff700 1 -- 172.21.15.64:0/1577263485 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fd110023e40 con 0x7fd120103990 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.158+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd108036640 msgr2=0x7fd108038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.158+0000 7fd125b6c700 1 --2- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd108036640 0x7fd108038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd114009990 tx=0x7fd114006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.158+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 msgr2=0x7fd1201031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.158+0000 7fd125b6c700 1 --2- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd1201031d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd11000c010 tx=0x7fd110009250 comp rx=0 tx=0).stop 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.158+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 shutdown_connections 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.158+0000 7fd125b6c700 1 --2- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd108036640 0x7fd108038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.158+0000 7fd125b6c700 1 --2- 172.21.15.64:0/1577263485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd120103990 0x7fd1201031d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.158+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 >> 172.21.15.64:0/1577263485 conn(0x7fd1200fc0b0 msgr2=0x7fd1200fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.159+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 shutdown_connections 2023-12-16T03:09:47.558 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.159+0000 7fd125b6c700 1 -- 172.21.15.64:0/1577263485 wait complete. 2023-12-16T03:09:47.561 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T03:09:47.561 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout disabled 2023-12-16T03:09:47.569 INFO:teuthology.orchestra.run.smithi064.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T03:09:47.569 INFO:teuthology.orchestra.run.smithi064.stdout:systemctl: stdout inactive 2023-12-16T03:09:47.569 INFO:teuthology.orchestra.run.smithi064.stdout:firewalld.service is not enabled 2023-12-16T03:09:47.570 INFO:teuthology.orchestra.run.smithi064.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-16T03:09:47.571 INFO:teuthology.orchestra.run.smithi064.stdout:Ceph Dashboard is now available at: 2023-12-16T03:09:47.571 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:47.571 INFO:teuthology.orchestra.run.smithi064.stdout: URL: https://smithi064.front.sepia.ceph.com:8443/ 2023-12-16T03:09:47.571 INFO:teuthology.orchestra.run.smithi064.stdout: User: admin 2023-12-16T03:09:47.571 INFO:teuthology.orchestra.run.smithi064.stdout: Password: s9onoc4p65 2023-12-16T03:09:47.571 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:47.572 INFO:teuthology.orchestra.run.smithi064.stdout:Saving cluster configuration to /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config directory 2023-12-16T03:09:47.572 INFO:teuthology.orchestra.run.smithi064.stdout:Enabling autotune for osd_memory_target 2023-12-16T03:09:48.176 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:47 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1577263485' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-16T03:09:48.511 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.944+0000 7efda857b700 1 Processor -- start 2023-12-16T03:09:48.511 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.944+0000 7efda857b700 1 -- start start 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.945+0000 7efda857b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda01015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.945+0000 7efda857b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda0101b10 con 0x7efda01011c0 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.945+0000 7efda6317700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda01015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.945+0000 7efda6317700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda01015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37460/0 (socket says 172.21.15.64:37460) 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.945+0000 7efda6317700 1 -- 172.21.15.64:0/119811222 learned_addr learned my addr 172.21.15.64:0/119811222 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.945+0000 7efda6317700 1 -- 172.21.15.64:0/119811222 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0101c50 con 0x7efda01011c0 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.945+0000 7efda6317700 1 --2- 172.21.15.64:0/119811222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda01015d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00bb80 tx=0x7efd9c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c831f91571100a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.946+0000 7efda5315700 1 -- 172.21.15.64:0/119811222 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd9c00dd00 con 0x7efda01011c0 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.946+0000 7efda5315700 1 -- 172.21.15.64:0/119811222 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd9c00de60 con 0x7efda01011c0 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.946+0000 7efda5315700 1 -- 172.21.15.64:0/119811222 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd9c0188d0 con 0x7efda01011c0 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.946+0000 7efda857b700 1 -- 172.21.15.64:0/119811222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 msgr2=0x7efda01015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.946+0000 7efda857b700 1 --2- 172.21.15.64:0/119811222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda01015d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00bb80 tx=0x7efd9c00b4f0 comp rx=0 tx=0).stop 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.946+0000 7efda857b700 1 -- 172.21.15.64:0/119811222 shutdown_connections 2023-12-16T03:09:48.512 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.946+0000 7efda857b700 1 --2- 172.21.15.64:0/119811222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda01015d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.946+0000 7efda857b700 1 -- 172.21.15.64:0/119811222 >> 172.21.15.64:0/119811222 conn(0x7efda00fc980 msgr2=0x7efda00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.946+0000 7efda857b700 1 -- 172.21.15.64:0/119811222 shutdown_connections 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.947+0000 7efda857b700 1 -- 172.21.15.64:0/119811222 wait complete. 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.947+0000 7efda857b700 1 Processor -- start 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.947+0000 7efda857b700 1 -- start start 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.947+0000 7efda857b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda010ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.947+0000 7efda857b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda010f440 con 0x7efda01011c0 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.947+0000 7efda6317700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda010ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.947+0000 7efda6317700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda010ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37470/0 (socket says 172.21.15.64:37470) 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.947+0000 7efda6317700 1 -- 172.21.15.64:0/2628228023 learned_addr learned my addr 172.21.15.64:0/2628228023 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.948+0000 7efda6317700 1 -- 172.21.15.64:0/2628228023 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c00b790 con 0x7efda01011c0 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.948+0000 7efda6317700 1 --2- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda010ef00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0184f0 tx=0x7efd9c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.948+0000 7efd96ffd700 1 -- 172.21.15.64:0/2628228023 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd9c010bd0 con 0x7efda01011c0 2023-12-16T03:09:48.513 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.948+0000 7efd96ffd700 1 -- 172.21.15.64:0/2628228023 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd9c01d050 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.948+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda010f640 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.948+0000 7efd96ffd700 1 -- 172.21.15.64:0/2628228023 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd9c022590 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.948+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda010fa50 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.949+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda004bb80 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.949+0000 7efd96ffd700 1 -- 172.21.15.64:0/2628228023 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7efd9c023470 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.950+0000 7efd96ffd700 1 --2- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd8c036690 0x7efd8c038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.950+0000 7efd96ffd700 1 -- 172.21.15.64:0/2628228023 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efd9c014070 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.950+0000 7efda5b16700 1 --2- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd8c036690 0x7efd8c038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.950+0000 7efda5b16700 1 --2- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd8c036690 0x7efd8c038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efd90009990 tx=0x7efd90006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:47.954+0000 7efd96ffd700 1 -- 172.21.15.64:0/2628228023 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efd9c022d20 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.151+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7efda0102fa0 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.151+0000 7efd96ffd700 1 -- 172.21.15.64:0/2628228023 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7efd9c00e360 con 0x7efda01011c0 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.153+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd8c036690 msgr2=0x7efd8c038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:48.514 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.153+0000 7efda857b700 1 --2- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd8c036690 0x7efd8c038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efd90009990 tx=0x7efd90006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:48.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.153+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 msgr2=0x7efda010ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:48.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.153+0000 7efda857b700 1 --2- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda010ef00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0184f0 tx=0x7efd9c00b4f0 comp rx=0 tx=0).stop 2023-12-16T03:09:48.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.153+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 shutdown_connections 2023-12-16T03:09:48.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.153+0000 7efda857b700 1 --2- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd8c036690 0x7efd8c038b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:48.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.153+0000 7efda857b700 1 --2- 172.21.15.64:0/2628228023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda01011c0 0x7efda010ef00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:48.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.153+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 >> 172.21.15.64:0/2628228023 conn(0x7efda00fc980 msgr2=0x7efda0105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:48.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.154+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 shutdown_connections 2023-12-16T03:09:48.515 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.154+0000 7efda857b700 1 -- 172.21.15.64:0/2628228023 wait complete. 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.865+0000 7fc4b7903700 1 Processor -- start 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.865+0000 7fc4b7903700 1 -- start start 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.865+0000 7fc4b7903700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b01026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.865+0000 7fc4b7903700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0102c00 con 0x7fc4b01022b0 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.865+0000 7fc4b569f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b01026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.865+0000 7fc4b569f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b01026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37486/0 (socket says 172.21.15.64:37486) 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.865+0000 7fc4b569f700 1 -- 172.21.15.64:0/811035583 learned_addr learned my addr 172.21.15.64:0/811035583 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4b569f700 1 -- 172.21.15.64:0/811035583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0102d40 con 0x7fc4b01022b0 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4b569f700 1 --2- 172.21.15.64:0/811035583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b01026c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0098e0 tx=0x7fc4ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8135e601ee499103 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:49.538 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4a7fff700 1 -- 172.21.15.64:0/811035583 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4ac00b860 con 0x7fc4b01022b0 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4a7fff700 1 -- 172.21.15.64:0/811035583 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4ac00be70 con 0x7fc4b01022b0 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4a7fff700 1 -- 172.21.15.64:0/811035583 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4ac010380 con 0x7fc4b01022b0 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4b7903700 1 -- 172.21.15.64:0/811035583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 msgr2=0x7fc4b01026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4b7903700 1 --2- 172.21.15.64:0/811035583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b01026c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0098e0 tx=0x7fc4ac009250 comp rx=0 tx=0).stop 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4b7903700 1 -- 172.21.15.64:0/811035583 shutdown_connections 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4b7903700 1 --2- 172.21.15.64:0/811035583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b01026c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.866+0000 7fc4b7903700 1 -- 172.21.15.64:0/811035583 >> 172.21.15.64:0/811035583 conn(0x7fc4b00fda10 msgr2=0x7fc4b00ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.867+0000 7fc4b7903700 1 -- 172.21.15.64:0/811035583 shutdown_connections 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.867+0000 7fc4b7903700 1 -- 172.21.15.64:0/811035583 wait complete. 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.867+0000 7fc4b7903700 1 Processor -- start 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.867+0000 7fc4b7903700 1 -- start start 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.867+0000 7fc4b7903700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b0078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.867+0000 7fc4b7903700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0077190 con 0x7fc4b01022b0 2023-12-16T03:09:49.539 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.867+0000 7fc4b569f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b0078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.867+0000 7fc4b569f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b0078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37488/0 (socket says 172.21.15.64:37488) 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.867+0000 7fc4b569f700 1 -- 172.21.15.64:0/486029247 learned_addr learned my addr 172.21.15.64:0/486029247 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.868+0000 7fc4b569f700 1 -- 172.21.15.64:0/486029247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0094f0 con 0x7fc4b01022b0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.868+0000 7fc4b569f700 1 --2- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b0078d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00c010 tx=0x7fc4ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.868+0000 7fc4a5ffb700 1 -- 172.21.15.64:0/486029247 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4ac010960 con 0x7fc4b01022b0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.868+0000 7fc4a5ffb700 1 -- 172.21.15.64:0/486029247 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4ac01a430 con 0x7fc4b01022b0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.868+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b0077390 con 0x7fc4b01022b0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.868+0000 7fc4a5ffb700 1 -- 172.21.15.64:0/486029247 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4ac019580 con 0x7fc4b01022b0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.868+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b00777a0 con 0x7fc4b01022b0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.869+0000 7fc4a5ffb700 1 -- 172.21.15.64:0/486029247 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fc4ac019800 con 0x7fc4b01022b0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.869+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b004bb80 con 0x7fc4b01022b0 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.869+0000 7fc4a5ffb700 1 --2- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fc49c036730 0x7fc49c038be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:49.540 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.869+0000 7fc4a5ffb700 1 -- 172.21.15.64:0/486029247 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc4ac04a650 con 0x7fc4b01022b0 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.869+0000 7fc4b4e9e700 1 --2- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fc49c036730 0x7fc49c038be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.870+0000 7fc4b4e9e700 1 --2- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fc49c036730 0x7fc49c038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009990 tx=0x7fc4a0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:48.874+0000 7fc4a5ffb700 1 -- 172.21.15.64:0/486029247 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc4ac02bb30 con 0x7fc4b01022b0 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.180+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fc4b0104090 con 0x7fc4b01022b0 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.183+0000 7fc4a5ffb700 1 -- 172.21.15.64:0/486029247 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fc4ac029e60 con 0x7fc4b01022b0 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fc49c036730 msgr2=0x7fc49c038be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 --2- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fc49c036730 0x7fc49c038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009990 tx=0x7fc4a0006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 msgr2=0x7fc4b0078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 --2- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b0078d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00c010 tx=0x7fc4ac009250 comp rx=0 tx=0).stop 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 shutdown_connections 2023-12-16T03:09:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 --2- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fc49c036730 0x7fc49c038be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 --2- 172.21.15.64:0/486029247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4b01022b0 0x7fc4b0078d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 >> 172.21.15.64:0/486029247 conn(0x7fc4b00fda10 msgr2=0x7fc4b00ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 shutdown_connections 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr 2023-12-16T03:09:49.185+0000 7fc4b7903700 1 -- 172.21.15.64:0/486029247 wait complete. 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout:Or, if you are only running a single cluster on this host: 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:49.542 INFO:teuthology.orchestra.run.smithi064.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-16T03:09:49.543 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:49.543 INFO:teuthology.orchestra.run.smithi064.stdout: ceph telemetry on 2023-12-16T03:09:49.543 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:49.543 INFO:teuthology.orchestra.run.smithi064.stdout:For more information see: 2023-12-16T03:09:49.543 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:49.543 INFO:teuthology.orchestra.run.smithi064.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-16T03:09:49.543 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:49.543 INFO:teuthology.orchestra.run.smithi064.stdout:Bootstrap complete. 2023-12-16T03:09:49.570 INFO:tasks.cephadm:Fetching config... 2023-12-16T03:09:49.570 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:09:49.570 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-16T03:09:49.629 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-16T03:09:49.629 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:09:49.629 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-16T03:09:49.688 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-16T03:09:49.688 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:09:49.688 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/keyring of=/dev/stdout 2023-12-16T03:09:49.759 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-16T03:09:49.760 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:09:49.760 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-16T03:09:49.818 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-16T03:09:49.818 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfFy/DQL+KEotU08s+QhtI32ueByDZqQfRjDpf01kokEXtdCx7/wuCnRXb214wAG6jDmSAoKeR9+CyGULx82wdTPtJvr0MNODLx5niYd1XBszf3HbOaUDcFp+drSukvBHRZx0CrBFL3M9cX84ozMug4O8ttXVsv78Y0ek4rfcif+8ZowsWJZH7Qp5oeSRiSK7VT3rQwYJqxWozGgm02r9g6zMcs6nnERtZBTyD2DhidfJPPGMm8Iwx+4zWQ5SvtvzXhiUEfMQDntmXFrTkvUWCCga7zB7BO+Tlb0av84Orkgve+aTaZqZ7VP+69FnlG/esIH0t++26+0o/A5qcEzRJ2m05Xnj1tM+VqTgZpfGPiRLsHTnc7rzl07zYKIF/N3HDOdS5+388gdu7HN/0D+AI70kVTNsZDgfnWp++KH1OvrTY3hqL5eeTUs3KTazcySCpfMkjopvi550NLcMiDr0y5kfciLZ/yf3POSDo2IwxTcKEehlW3mOcHbEBUADmPok= ceph-5b4de048-9bc0-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-16T03:09:49.896 INFO:teuthology.orchestra.run.smithi064.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfFy/DQL+KEotU08s+QhtI32ueByDZqQfRjDpf01kokEXtdCx7/wuCnRXb214wAG6jDmSAoKeR9+CyGULx82wdTPtJvr0MNODLx5niYd1XBszf3HbOaUDcFp+drSukvBHRZx0CrBFL3M9cX84ozMug4O8ttXVsv78Y0ek4rfcif+8ZowsWJZH7Qp5oeSRiSK7VT3rQwYJqxWozGgm02r9g6zMcs6nnERtZBTyD2DhidfJPPGMm8Iwx+4zWQ5SvtvzXhiUEfMQDntmXFrTkvUWCCga7zB7BO+Tlb0av84Orkgve+aTaZqZ7VP+69FnlG/esIH0t++26+0o/A5qcEzRJ2m05Xnj1tM+VqTgZpfGPiRLsHTnc7rzl07zYKIF/N3HDOdS5+388gdu7HN/0D+AI70kVTNsZDgfnWp++KH1OvrTY3hqL5eeTUs3KTazcySCpfMkjopvi550NLcMiDr0y5kfciLZ/yf3POSDo2IwxTcKEehlW3mOcHbEBUADmPok= ceph-5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:09:49.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfFy/DQL+KEotU08s+QhtI32ueByDZqQfRjDpf01kokEXtdCx7/wuCnRXb214wAG6jDmSAoKeR9+CyGULx82wdTPtJvr0MNODLx5niYd1XBszf3HbOaUDcFp+drSukvBHRZx0CrBFL3M9cX84ozMug4O8ttXVsv78Y0ek4rfcif+8ZowsWJZH7Qp5oeSRiSK7VT3rQwYJqxWozGgm02r9g6zMcs6nnERtZBTyD2DhidfJPPGMm8Iwx+4zWQ5SvtvzXhiUEfMQDntmXFrTkvUWCCga7zB7BO+Tlb0av84Orkgve+aTaZqZ7VP+69FnlG/esIH0t++26+0o/A5qcEzRJ2m05Xnj1tM+VqTgZpfGPiRLsHTnc7rzl07zYKIF/N3HDOdS5+388gdu7HN/0D+AI70kVTNsZDgfnWp++KH1OvrTY3hqL5eeTUs3KTazcySCpfMkjopvi550NLcMiDr0y5kfciLZ/yf3POSDo2IwxTcKEehlW3mOcHbEBUADmPok= ceph-5b4de048-9bc0-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-16T03:09:49.953 INFO:teuthology.orchestra.run.smithi184.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfFy/DQL+KEotU08s+QhtI32ueByDZqQfRjDpf01kokEXtdCx7/wuCnRXb214wAG6jDmSAoKeR9+CyGULx82wdTPtJvr0MNODLx5niYd1XBszf3HbOaUDcFp+drSukvBHRZx0CrBFL3M9cX84ozMug4O8ttXVsv78Y0ek4rfcif+8ZowsWJZH7Qp5oeSRiSK7VT3rQwYJqxWozGgm02r9g6zMcs6nnERtZBTyD2DhidfJPPGMm8Iwx+4zWQ5SvtvzXhiUEfMQDntmXFrTkvUWCCga7zB7BO+Tlb0av84Orkgve+aTaZqZ7VP+69FnlG/esIH0t++26+0o/A5qcEzRJ2m05Xnj1tM+VqTgZpfGPiRLsHTnc7rzl07zYKIF/N3HDOdS5+388gdu7HN/0D+AI70kVTNsZDgfnWp++KH1OvrTY3hqL5eeTUs3KTazcySCpfMkjopvi550NLcMiDr0y5kfciLZ/yf3POSDo2IwxTcKEehlW3mOcHbEBUADmPok= ceph-5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:09:49.965 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-16T03:09:50.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:49 smithi064 ceph-mon[111958]: mgrmap e13: smithi064.ueciyw(active, since 6s) 2023-12-16T03:09:50.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:49 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/486029247' entity='client.admin' 2023-12-16T03:09:50.243 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.542+0000 7f58108c8700 1 -- 172.21.15.64:0/2382473226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 msgr2=0x7f580c0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.542+0000 7f58108c8700 1 --2- 172.21.15.64:0/2382473226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 0x7f580c0fbb90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0048c0 tx=0x7f57fc009e30 comp rx=0 tx=0).stop 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.542+0000 7f58108c8700 1 -- 172.21.15.64:0/2382473226 shutdown_connections 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.542+0000 7f58108c8700 1 --2- 172.21.15.64:0/2382473226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 0x7f580c0fbb90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.542+0000 7f58108c8700 1 -- 172.21.15.64:0/2382473226 >> 172.21.15.64:0/2382473226 conn(0x7f580c0f6e40 msgr2=0x7f580c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.542+0000 7f58108c8700 1 -- 172.21.15.64:0/2382473226 shutdown_connections 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.542+0000 7f58108c8700 1 -- 172.21.15.64:0/2382473226 wait complete. 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.543+0000 7f58108c8700 1 Processor -- start 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.543+0000 7f58108c8700 1 -- start start 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.543+0000 7f58108c8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 0x7f580c10b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.543+0000 7f58108c8700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c10bee0 con 0x7f580c0fb780 2023-12-16T03:09:51.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.543+0000 7f580a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 0x7f580c10b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.543+0000 7f580a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 0x7f580c10b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37506/0 (socket says 172.21.15.64:37506) 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.543+0000 7f580a59c700 1 -- 172.21.15.64:0/2092284101 learned_addr learned my addr 172.21.15.64:0/2092284101 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.544+0000 7f580a59c700 1 -- 172.21.15.64:0/2092284101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc005040 con 0x7f580c0fb780 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.544+0000 7f580a59c700 1 --2- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 0x7f580c10b9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00b690 tx=0x7f57fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.544+0000 7f5802ffd700 1 -- 172.21.15.64:0/2092284101 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57fc009650 con 0x7f580c0fb780 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.544+0000 7f5802ffd700 1 -- 172.21.15.64:0/2092284101 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f57fc0097b0 con 0x7f580c0fb780 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.544+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c10c0e0 con 0x7f580c0fb780 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.544+0000 7f5802ffd700 1 -- 172.21.15.64:0/2092284101 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57fc01c5d0 con 0x7f580c0fb780 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.544+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c10cd80 con 0x7f580c0fb780 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.545+0000 7f5802ffd700 1 -- 172.21.15.64:0/2092284101 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f57fc01c840 con 0x7f580c0fb780 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.545+0000 7f5802ffd700 1 --2- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f57f80366d0 0x7f57f8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.545+0000 7f5802ffd700 1 -- 172.21.15.64:0/2092284101 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f57fc049960 con 0x7f580c0fb780 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.545+0000 7f5809d9b700 1 --2- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f57f80366d0 0x7f57f8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:51.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.545+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c05f270 con 0x7f580c0fb780 2023-12-16T03:09:51.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.545+0000 7f5809d9b700 1 --2- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f57f80366d0 0x7f57f8038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009990 tx=0x7f57f4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:51.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.550+0000 7f5802ffd700 1 -- 172.21.15.64:0/2092284101 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f57fc023950 con 0x7f580c0fb780 2023-12-16T03:09:51.757 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.756+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f580c10d800 con 0x7f580c0fb780 2023-12-16T03:09:51.760 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.759+0000 7f5802ffd700 1 -- 172.21.15.64:0/2092284101 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f57fc023300 con 0x7f580c0fb780 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f57f80366d0 msgr2=0x7f57f8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 --2- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f57f80366d0 0x7f57f8038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009990 tx=0x7f57f4006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 msgr2=0x7f580c10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 --2- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 0x7f580c10b9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00b690 tx=0x7f57fc009e30 comp rx=0 tx=0).stop 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 shutdown_connections 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 --2- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f57f80366d0 0x7f57f8038b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 --2- 172.21.15.64:0/2092284101 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f580c0fb780 0x7f580c10b9a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 >> 172.21.15.64:0/2092284101 conn(0x7f580c0f6e40 msgr2=0x7f580c0f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 shutdown_connections 2023-12-16T03:09:51.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:51.762+0000 7f58108c8700 1 -- 172.21.15.64:0/2092284101 wait complete. 2023-12-16T03:09:52.146 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-16T03:09:52.146 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-16T03:09:52.427 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:09:52.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:52 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2092284101' entity='client.admin' 2023-12-16T03:09:53.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.720+0000 7fe6db5ec700 1 -- 172.21.15.64:0/956649195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 msgr2=0x7fe6d40fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:53.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.720+0000 7fe6db5ec700 1 --2- 172.21.15.64:0/956649195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 0x7fe6d40fbb90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00048c0 tx=0x7fe6d0009e30 comp rx=0 tx=0).stop 2023-12-16T03:09:53.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.720+0000 7fe6db5ec700 1 -- 172.21.15.64:0/956649195 shutdown_connections 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.720+0000 7fe6db5ec700 1 --2- 172.21.15.64:0/956649195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 0x7fe6d40fbb90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.720+0000 7fe6db5ec700 1 -- 172.21.15.64:0/956649195 >> 172.21.15.64:0/956649195 conn(0x7fe6d40f6e40 msgr2=0x7fe6d40f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.720+0000 7fe6db5ec700 1 -- 172.21.15.64:0/956649195 shutdown_connections 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.720+0000 7fe6db5ec700 1 -- 172.21.15.64:0/956649195 wait complete. 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6db5ec700 1 Processor -- start 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6db5ec700 1 -- start start 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6db5ec700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 0x7fe6d410ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6db5ec700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d410f2b0 con 0x7fe6d40fb780 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6d9388700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 0x7fe6d410ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6d9388700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 0x7fe6d410ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32774/0 (socket says 172.21.15.64:32774) 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6d9388700 1 -- 172.21.15.64:0/1512652105 learned_addr learned my addr 172.21.15.64:0/1512652105 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:53.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6d9388700 1 -- 172.21.15.64:0/1512652105 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d0005040 con 0x7fe6d40fb780 2023-12-16T03:09:53.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6d9388700 1 --2- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 0x7fe6d410ed70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009330 tx=0x7fe6d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:53.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.721+0000 7fe6c5ffb700 1 -- 172.21.15.64:0/1512652105 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6d00096b0 con 0x7fe6d40fb780 2023-12-16T03:09:53.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.722+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d410f4b0 con 0x7fe6d40fb780 2023-12-16T03:09:53.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.722+0000 7fe6c5ffb700 1 -- 172.21.15.64:0/1512652105 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6d0009810 con 0x7fe6d40fb780 2023-12-16T03:09:53.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.722+0000 7fe6c5ffb700 1 -- 172.21.15.64:0/1512652105 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6d001c5b0 con 0x7fe6d40fb780 2023-12-16T03:09:53.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.722+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d4110070 con 0x7fe6d40fb780 2023-12-16T03:09:53.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.723+0000 7fe6c5ffb700 1 -- 172.21.15.64:0/1512652105 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fe6d001c870 con 0x7fe6d40fb780 2023-12-16T03:09:53.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.723+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d405f270 con 0x7fe6d40fb780 2023-12-16T03:09:53.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.723+0000 7fe6c5ffb700 1 --2- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe6c00366d0 0x7fe6c0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:53.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.723+0000 7fe6c5ffb700 1 -- 172.21.15.64:0/1512652105 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe6d0049a10 con 0x7fe6d40fb780 2023-12-16T03:09:53.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.723+0000 7fe6d8b87700 1 --2- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe6c00366d0 0x7fe6c0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:53.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.724+0000 7fe6d8b87700 1 --2- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe6c00366d0 0x7fe6c0038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009990 tx=0x7fe6c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:53.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.728+0000 7fe6c5ffb700 1 -- 172.21.15.64:0/1512652105 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe6d0011dd0 con 0x7fe6d40fb780 2023-12-16T03:09:53.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.933+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 --> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6d40f8980 con 0x7fe6c00366d0 2023-12-16T03:09:53.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.936+0000 7fe6c5ffb700 1 -- 172.21.15.64:0/1512652105 <== mgr.14162 v2:172.21.15.64:6800/1165076471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe6d40f8980 con 0x7fe6c00366d0 2023-12-16T03:09:53.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe6c00366d0 msgr2=0x7fe6c0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:53.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 --2- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe6c00366d0 0x7fe6c0038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009990 tx=0x7fe6c8006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:53.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 msgr2=0x7fe6d410ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:53.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 --2- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 0x7fe6d410ed70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009330 tx=0x7fe6d0009e30 comp rx=0 tx=0).stop 2023-12-16T03:09:53.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 shutdown_connections 2023-12-16T03:09:53.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 --2- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe6c00366d0 0x7fe6c0038b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:53.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 --2- 172.21.15.64:0/1512652105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6d40fb780 0x7fe6d410ed70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:53.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 >> 172.21.15.64:0/1512652105 conn(0x7fe6d40f6e40 msgr2=0x7fe6d40f7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:53.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 shutdown_connections 2023-12-16T03:09:53.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:53.938+0000 7fe6db5ec700 1 -- 172.21.15.64:0/1512652105 wait complete. 2023-12-16T03:09:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:09:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:09:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T03:09:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:09:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: Deploying daemon crash.smithi064 on smithi064 2023-12-16T03:09:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:54.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:54 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:54.399 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi184 2023-12-16T03:09:54.399 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:09:54.399 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.conf 2023-12-16T03:09:54.421 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:09:54.421 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:09:54.482 INFO:tasks.cephadm:Adding host smithi184 to orchestrator... 2023-12-16T03:09:54.483 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch host add smithi184 2023-12-16T03:09:54.812 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:09:55.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.922+0000 7fd26f314700 1 -- 172.21.15.64:0/3232811081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 msgr2=0x7fd2680ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:55.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.922+0000 7fd26f314700 1 --2- 172.21.15.64:0/3232811081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 0x7fd2680ff7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd2640048c0 tx=0x7fd264009e30 comp rx=0 tx=0).stop 2023-12-16T03:09:55.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.922+0000 7fd26f314700 1 -- 172.21.15.64:0/3232811081 shutdown_connections 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.922+0000 7fd26f314700 1 --2- 172.21.15.64:0/3232811081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 0x7fd2680ff7a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.922+0000 7fd26f314700 1 -- 172.21.15.64:0/3232811081 >> 172.21.15.64:0/3232811081 conn(0x7fd2680f6e40 msgr2=0x7fd2680f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.922+0000 7fd26f314700 1 -- 172.21.15.64:0/3232811081 shutdown_connections 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.923+0000 7fd26f314700 1 -- 172.21.15.64:0/3232811081 wait complete. 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.923+0000 7fd26f314700 1 Processor -- start 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.923+0000 7fd26f314700 1 -- start start 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.923+0000 7fd26f314700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 0x7fd26810ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.923+0000 7fd26f314700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26810cfa0 con 0x7fd2680fd3c0 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.923+0000 7fd26d0b0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 0x7fd26810ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.923+0000 7fd26d0b0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 0x7fd26810ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32806/0 (socket says 172.21.15.64:32806) 2023-12-16T03:09:55.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.924+0000 7fd26d0b0700 1 -- 172.21.15.64:0/939911776 learned_addr learned my addr 172.21.15.64:0/939911776 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.924+0000 7fd26d0b0700 1 -- 172.21.15.64:0/939911776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd264005040 con 0x7fd2680fd3c0 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.924+0000 7fd26d0b0700 1 --2- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 0x7fd26810ca60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd26400b690 tx=0x7fd264009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.924+0000 7fd25dffb700 1 -- 172.21.15.64:0/939911776 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd264009650 con 0x7fd2680fd3c0 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.924+0000 7fd25dffb700 1 -- 172.21.15.64:0/939911776 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2640097b0 con 0x7fd2680fd3c0 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.924+0000 7fd25dffb700 1 -- 172.21.15.64:0/939911776 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd26401c5b0 con 0x7fd2680fd3c0 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.924+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26810d1a0 con 0x7fd2680fd3c0 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.924+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26810de40 con 0x7fd2680fd3c0 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.925+0000 7fd25dffb700 1 -- 172.21.15.64:0/939911776 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd26401c870 con 0x7fd2680fd3c0 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.926+0000 7fd25dffb700 1 --2- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd2540366d0 0x7fd254038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:55.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.926+0000 7fd25dffb700 1 -- 172.21.15.64:0/939911776 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd2640498c0 con 0x7fd2680fd3c0 2023-12-16T03:09:55.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.926+0000 7fd26c8af700 1 --2- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd2540366d0 0x7fd254038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:55.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.926+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26805f270 con 0x7fd2680fd3c0 2023-12-16T03:09:55.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.926+0000 7fd26c8af700 1 --2- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd2540366d0 0x7fd254038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd258009990 tx=0x7fd258006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:55.932 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:55.931+0000 7fd25dffb700 1 -- 172.21.15.64:0/939911776 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd264013420 con 0x7fd2680fd3c0 2023-12-16T03:09:55.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:55 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:55.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:55 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:55.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:55 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:55.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:55 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:55.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:55 smithi064 ceph-mon[111958]: Deploying daemon node-exporter.smithi064 on smithi064 2023-12-16T03:09:56.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:56.152+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 --> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2681026c0 con 0x7fd2540366d0 2023-12-16T03:09:57.563 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:57 smithi064 ceph-mon[111958]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:09:57.563 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:57 smithi064 ceph-mon[111958]: Deploying cephadm binary to smithi184 2023-12-16T03:09:57.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.985+0000 7fd25dffb700 1 -- 172.21.15.64:0/939911776 <== mgr.14162 v2:172.21.15.64:6800/1165076471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd2681026c0 con 0x7fd2540366d0 2023-12-16T03:09:57.986 INFO:teuthology.orchestra.run.smithi064.stdout:Added host 'smithi184' with addr '172.21.15.184' 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd2540366d0 msgr2=0x7fd254038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 --2- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd2540366d0 0x7fd254038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd258009990 tx=0x7fd258006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 msgr2=0x7fd26810ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 --2- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 0x7fd26810ca60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd26400b690 tx=0x7fd264009e30 comp rx=0 tx=0).stop 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 shutdown_connections 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 --2- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd2540366d0 0x7fd254038b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 --2- 172.21.15.64:0/939911776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2680fd3c0 0x7fd26810ca60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 >> 172.21.15.64:0/939911776 conn(0x7fd2680f6e40 msgr2=0x7fd2680f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 shutdown_connections 2023-12-16T03:09:57.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:57.987+0000 7fd26f314700 1 -- 172.21.15.64:0/939911776 wait complete. 2023-12-16T03:09:58.410 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch host ls --format=json 2023-12-16T03:09:58.698 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:09:59.154 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:58 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:59.155 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:58 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:59.155 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:58 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:59.155 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:58 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:59.155 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:58 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:59.155 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:58 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:09:59.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.672+0000 7fd125519700 1 -- 172.21.15.64:0/1336321171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 msgr2=0x7fd1200ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:59.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.672+0000 7fd125519700 1 --2- 172.21.15.64:0/1336321171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 0x7fd1200ff480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1100048c0 tx=0x7fd110009e30 comp rx=0 tx=0).stop 2023-12-16T03:09:59.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.673+0000 7fd125519700 1 -- 172.21.15.64:0/1336321171 shutdown_connections 2023-12-16T03:09:59.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.673+0000 7fd125519700 1 --2- 172.21.15.64:0/1336321171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 0x7fd1200ff480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:59.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.673+0000 7fd125519700 1 -- 172.21.15.64:0/1336321171 >> 172.21.15.64:0/1336321171 conn(0x7fd1200f6e50 msgr2=0x7fd1200f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:59.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.673+0000 7fd125519700 1 -- 172.21.15.64:0/1336321171 shutdown_connections 2023-12-16T03:09:59.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.673+0000 7fd125519700 1 -- 172.21.15.64:0/1336321171 wait complete. 2023-12-16T03:09:59.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.673+0000 7fd125519700 1 Processor -- start 2023-12-16T03:09:59.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.673+0000 7fd125519700 1 -- start start 2023-12-16T03:09:59.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.673+0000 7fd125519700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 0x7fd1200fcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:59.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.673+0000 7fd125519700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200fb380 con 0x7fd1200664f0 2023-12-16T03:09:59.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd11effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 0x7fd1200fcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:59.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd11effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 0x7fd1200fcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:32826/0 (socket says 172.21.15.64:32826) 2023-12-16T03:09:59.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd11effd700 1 -- 172.21.15.64:0/984166958 learned_addr learned my addr 172.21.15.64:0/984166958 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:09:59.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd11effd700 1 -- 172.21.15.64:0/984166958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd110005040 con 0x7fd1200664f0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd11effd700 1 --2- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 0x7fd1200fcf00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd110009040 tx=0x7fd110009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd1177fe700 1 -- 172.21.15.64:0/984166958 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd110009620 con 0x7fd1200664f0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1200fb580 con 0x7fd1200664f0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd1177fe700 1 -- 172.21.15.64:0/984166958 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd110009780 con 0x7fd1200664f0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd1177fe700 1 -- 172.21.15.64:0/984166958 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd11001c5b0 con 0x7fd1200664f0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.674+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1200fba70 con 0x7fd1200664f0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.675+0000 7fd1177fe700 1 -- 172.21.15.64:0/984166958 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd110013a60 con 0x7fd1200664f0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.675+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd120106500 con 0x7fd1200664f0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.675+0000 7fd1177fe700 1 --2- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd10c0366d0 0x7fd10c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.675+0000 7fd1177fe700 1 -- 172.21.15.64:0/984166958 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd1100498c0 con 0x7fd1200664f0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.675+0000 7fd11e7fc700 1 --2- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd10c0366d0 0x7fd10c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:09:59.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.676+0000 7fd11e7fc700 1 --2- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd10c0366d0 0x7fd10c038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd108009990 tx=0x7fd108006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:09:59.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.680+0000 7fd1177fe700 1 -- 172.21.15.64:0/984166958 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd1100119c0 con 0x7fd1200664f0 2023-12-16T03:09:59.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.893+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 --> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd12002b1f0 con 0x7fd10c0366d0 2023-12-16T03:09:59.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.894+0000 7fd1177fe700 1 -- 172.21.15.64:0/984166958 <== mgr.14162 v2:172.21.15.64:6800/1165076471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fd12002b1f0 con 0x7fd10c0366d0 2023-12-16T03:09:59.895 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:09:59.895 INFO:teuthology.orchestra.run.smithi064.stdout:[{"addr": "172.21.15.64", "hostname": "smithi064", "labels": [], "status": ""}, {"addr": "172.21.15.184", "hostname": "smithi184", "labels": [], "status": ""}] 2023-12-16T03:09:59.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd10c0366d0 msgr2=0x7fd10c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:59.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 --2- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd10c0366d0 0x7fd10c038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd108009990 tx=0x7fd108006e40 comp rx=0 tx=0).stop 2023-12-16T03:09:59.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 msgr2=0x7fd1200fcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:09:59.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 --2- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 0x7fd1200fcf00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd110009040 tx=0x7fd110009e30 comp rx=0 tx=0).stop 2023-12-16T03:09:59.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 shutdown_connections 2023-12-16T03:09:59.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 --2- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd10c0366d0 0x7fd10c038b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:59.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 --2- 172.21.15.64:0/984166958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200664f0 0x7fd1200fcf00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:09:59.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 >> 172.21.15.64:0/984166958 conn(0x7fd1200f6e50 msgr2=0x7fd1200f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:09:59.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 shutdown_connections 2023-12-16T03:09:59.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:09:59.896+0000 7fd125519700 1 -- 172.21.15.64:0/984166958 wait complete. 2023-12-16T03:10:00.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:59 smithi064 ceph-mon[111958]: Added host smithi184 2023-12-16T03:10:00.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:09:59 smithi064 ceph-mon[111958]: Deploying daemon alertmanager.smithi064 on smithi064 2023-12-16T03:10:00.962 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-16T03:10:00.962 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd crush tunables default 2023-12-16T03:10:01.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:00 smithi064 ceph-mon[111958]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T03:10:01.786 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:10:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.117+0000 7fde57597700 1 -- 172.21.15.64:0/553921787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 msgr2=0x7fde500fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.117+0000 7fde57597700 1 --2- 172.21.15.64:0/553921787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 0x7fde500fcc80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0048c0 tx=0x7fde4c009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.117+0000 7fde57597700 1 -- 172.21.15.64:0/553921787 shutdown_connections 2023-12-16T03:10:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.117+0000 7fde57597700 1 --2- 172.21.15.64:0/553921787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 0x7fde500fcc80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.117+0000 7fde57597700 1 -- 172.21.15.64:0/553921787 >> 172.21.15.64:0/553921787 conn(0x7fde500f7f50 msgr2=0x7fde500fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.117+0000 7fde57597700 1 -- 172.21.15.64:0/553921787 shutdown_connections 2023-12-16T03:10:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.117+0000 7fde57597700 1 -- 172.21.15.64:0/553921787 wait complete. 2023-12-16T03:10:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.118+0000 7fde57597700 1 Processor -- start 2023-12-16T03:10:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.118+0000 7fde57597700 1 -- start start 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.118+0000 7fde57597700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 0x7fde5010ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.118+0000 7fde57597700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5010f270 con 0x7fde500fc870 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.118+0000 7fde55333700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 0x7fde5010ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.118+0000 7fde55333700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 0x7fde5010ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49118/0 (socket says 172.21.15.64:49118) 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.118+0000 7fde55333700 1 -- 172.21.15.64:0/3251535872 learned_addr learned my addr 172.21.15.64:0/3251535872 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.119+0000 7fde55333700 1 -- 172.21.15.64:0/3251535872 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c005040 con 0x7fde500fc870 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.119+0000 7fde55333700 1 --2- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 0x7fde5010ed30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009330 tx=0x7fde4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.119+0000 7fde41ffb700 1 -- 172.21.15.64:0/3251535872 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde4c0096b0 con 0x7fde500fc870 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.119+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5010f470 con 0x7fde500fc870 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.119+0000 7fde41ffb700 1 -- 172.21.15.64:0/3251535872 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde4c009810 con 0x7fde500fc870 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.119+0000 7fde41ffb700 1 -- 172.21.15.64:0/3251535872 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde4c01c5b0 con 0x7fde500fc870 2023-12-16T03:10:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.119+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5010ffd0 con 0x7fde500fc870 2023-12-16T03:10:03.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.120+0000 7fde41ffb700 1 -- 172.21.15.64:0/3251535872 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fde4c013420 con 0x7fde500fc870 2023-12-16T03:10:03.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.120+0000 7fde41ffb700 1 --2- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fde3c0366d0 0x7fde3c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:03.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.120+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5004bb80 con 0x7fde500fc870 2023-12-16T03:10:03.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.120+0000 7fde41ffb700 1 -- 172.21.15.64:0/3251535872 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fde4c049a00 con 0x7fde500fc870 2023-12-16T03:10:03.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.120+0000 7fde54b32700 1 --2- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fde3c0366d0 0x7fde3c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:03.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.121+0000 7fde54b32700 1 --2- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fde3c0366d0 0x7fde3c038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fde44009990 tx=0x7fde44006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:03.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.125+0000 7fde41ffb700 1 -- 172.21.15.64:0/3251535872 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fde4c0119c0 con 0x7fde500fc870 2023-12-16T03:10:03.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.327+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fde50110160 con 0x7fde500fc870 2023-12-16T03:10:03.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.822+0000 7fde41ffb700 1 -- 172.21.15.64:0/3251535872 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fde4c011370 con 0x7fde500fc870 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fde3c0366d0 msgr2=0x7fde3c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 --2- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fde3c0366d0 0x7fde3c038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fde44009990 tx=0x7fde44006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 msgr2=0x7fde5010ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 --2- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 0x7fde5010ed30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009330 tx=0x7fde4c009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 shutdown_connections 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 --2- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fde3c0366d0 0x7fde3c038b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 --2- 172.21.15.64:0/3251535872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde500fc870 0x7fde5010ed30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 >> 172.21.15.64:0/3251535872 conn(0x7fde500f7f50 msgr2=0x7fde5006fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 shutdown_connections 2023-12-16T03:10:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:03.825+0000 7fde57597700 1 -- 172.21.15.64:0/3251535872 wait complete. 2023-12-16T03:10:03.828 INFO:teuthology.orchestra.run.smithi064.stderr:adjusted tunables profile to default 2023-12-16T03:10:03.941 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:03 smithi064 ceph-mon[111958]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:03.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:03 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:03.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:03 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3251535872' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-16T03:10:04.534 INFO:tasks.cephadm:Adding mon.smithi064 on smithi064 2023-12-16T03:10:04.535 INFO:tasks.cephadm:Adding mon.smithi184 on smithi184 2023-12-16T03:10:04.535 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch apply mon '2;smithi064:172.21.15.64=smithi064;smithi184:172.21.15.184=smithi184' 2023-12-16T03:10:04.839 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:04.895 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:05.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:04 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3251535872' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-16T03:10:05.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:04 smithi064 ceph-mon[111958]: osdmap e4: 0 total, 0 up, 0 in 2023-12-16T03:10:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:05 smithi064 ceph-mon[111958]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:05 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:05 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:05 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:05 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:05 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:05 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:05 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T03:10:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:05 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.205+0000 7f217c1c5700 1 -- 172.21.15.184:0/1014990165 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 msgr2=0x7f21740fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.205+0000 7f217c1c5700 1 --2- 172.21.15.184:0/1014990165 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 0x7f21740fcc90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f21700048c0 tx=0x7f2170009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.205+0000 7f217c1c5700 1 -- 172.21.15.184:0/1014990165 shutdown_connections 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.205+0000 7f217c1c5700 1 --2- 172.21.15.184:0/1014990165 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 0x7f21740fcc90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.205+0000 7f217c1c5700 1 -- 172.21.15.184:0/1014990165 >> 172.21.15.184:0/1014990165 conn(0x7f21740f7f40 msgr2=0x7f21740fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.205+0000 7f217c1c5700 1 -- 172.21.15.184:0/1014990165 shutdown_connections 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.205+0000 7f217c1c5700 1 -- 172.21.15.184:0/1014990165 wait complete. 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.205+0000 7f217c1c5700 1 Processor -- start 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.205+0000 7f217c1c5700 1 -- start start 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.206+0000 7f217c1c5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 0x7f217410cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.206+0000 7f217c1c5700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217410d000 con 0x7f21740fc880 2023-12-16T03:10:06.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.206+0000 7f2179f61700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 0x7f217410cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:06.209 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.206+0000 7f2179f61700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 0x7f217410cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:40844/0 (socket says 172.21.15.184:40844) 2023-12-16T03:10:06.209 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.206+0000 7f2179f61700 1 -- 172.21.15.184:0/773905194 learned_addr learned my addr 172.21.15.184:0/773905194 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:06.209 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.206+0000 7f2179f61700 1 -- 172.21.15.184:0/773905194 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170005040 con 0x7f21740fc880 2023-12-16T03:10:06.209 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.206+0000 7f2179f61700 1 --2- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 0x7f217410cac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2170009330 tx=0x7f2170009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.207+0000 7f216a7fc700 1 -- 172.21.15.184:0/773905194 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21700096b0 con 0x7f21740fc880 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.207+0000 7f216a7fc700 1 -- 172.21.15.184:0/773905194 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2170009810 con 0x7f21740fc880 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.207+0000 7f216a7fc700 1 -- 172.21.15.184:0/773905194 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f217001c5b0 con 0x7f21740fc880 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.207+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217410d200 con 0x7f21740fc880 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.207+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217410dea0 con 0x7f21740fc880 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.208+0000 7f216a7fc700 1 -- 172.21.15.184:0/773905194 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f2170013420 con 0x7f21740fc880 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.208+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217405f270 con 0x7f21740fc880 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.208+0000 7f216a7fc700 1 --2- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f21600366d0 0x7f2160038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.208+0000 7f216a7fc700 1 -- 172.21.15.184:0/773905194 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2170049ad0 con 0x7f21740fc880 2023-12-16T03:10:06.210 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.208+0000 7f2179760700 1 --2- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f21600366d0 0x7f2160038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:06.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.209+0000 7f2179760700 1 --2- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f21600366d0 0x7f2160038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2164009990 tx=0x7f2164006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:06.215 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.213+0000 7f216a7fc700 1 -- 172.21.15.184:0/773905194 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f21700119c0 con 0x7f21740fc880 2023-12-16T03:10:06.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.405+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 --> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi064:172.21.15.64=smithi064;smithi184:172.21.15.184=smithi184", "target": ["mon-mgr", ""]}) v1 -- 0x7f217410eb10 con 0x7f21600366d0 2023-12-16T03:10:06.416 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.415+0000 7f216a7fc700 1 -- 172.21.15.184:0/773905194 <== mgr.14162 v2:172.21.15.64:6800/1165076471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f217410eb10 con 0x7f21600366d0 2023-12-16T03:10:06.416 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mon update... 2023-12-16T03:10:06.421 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.416+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f21600366d0 msgr2=0x7f2160038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:06.421 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.416+0000 7f217c1c5700 1 --2- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f21600366d0 0x7f2160038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2164009990 tx=0x7f2164006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:06.421 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.416+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 msgr2=0x7f217410cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:06.421 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.416+0000 7f217c1c5700 1 --2- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 0x7f217410cac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2170009330 tx=0x7f2170009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:06.422 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.416+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 shutdown_connections 2023-12-16T03:10:06.422 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.416+0000 7f217c1c5700 1 --2- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f21600366d0 0x7f2160038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:06.422 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.416+0000 7f217c1c5700 1 --2- 172.21.15.184:0/773905194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21740fc880 0x7f217410cac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:06.422 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.416+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 >> 172.21.15.184:0/773905194 conn(0x7f21740f7f40 msgr2=0x7f21740f8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:06.422 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.417+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 shutdown_connections 2023-12-16T03:10:06.422 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:06.417+0000 7f217c1c5700 1 -- 172.21.15.184:0/773905194 wait complete. 2023-12-16T03:10:06.798 DEBUG:teuthology.orchestra.run.smithi184:mon.smithi184> sudo journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi184.service 2023-12-16T03:10:06.800 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:06.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:06.829 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:-- Logs begin at Sat 2023-12-16 02:56:06 UTC. -- 2023-12-16T03:10:07.098 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:07.159 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:07.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:06 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T03:10:07.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:06 smithi064 ceph-mon[111958]: Deploying daemon grafana.smithi064 on smithi064 2023-12-16T03:10:07.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:06 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:08.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:07 smithi064 ceph-mon[111958]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi064:172.21.15.64=smithi064;smithi184:172.21.15.184=smithi184", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:10:08.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:07 smithi064 ceph-mon[111958]: Saving service mon spec with placement smithi064:172.21.15.64=smithi064;smithi184:172.21.15.184=smithi184;count:2 2023-12-16T03:10:08.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:07 smithi064 ceph-mon[111958]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:08.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:07 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:08.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.207+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/4249399862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 msgr2=0x7fe5ac0ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:08.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.207+0000 7fe5b0ad8700 1 --2- 172.21.15.184:0/4249399862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 0x7fe5ac0ff440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5940048c0 tx=0x7fe594009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:08.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.208+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/4249399862 shutdown_connections 2023-12-16T03:10:08.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.208+0000 7fe5b0ad8700 1 --2- 172.21.15.184:0/4249399862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 0x7fe5ac0ff440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:08.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.208+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/4249399862 >> 172.21.15.184:0/4249399862 conn(0x7fe5ac0f6e50 msgr2=0x7fe5ac0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:08.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.208+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/4249399862 shutdown_connections 2023-12-16T03:10:08.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.208+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/4249399862 wait complete. 2023-12-16T03:10:08.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.208+0000 7fe5b0ad8700 1 Processor -- start 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.208+0000 7fe5b0ad8700 1 -- start start 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.208+0000 7fe5b0ad8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 0x7fe5ac10ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.208+0000 7fe5b0ad8700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac10cfb0 con 0x7fe5ac066310 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5aa59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 0x7fe5ac10ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5aa59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 0x7fe5ac10ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:40868/0 (socket says 172.21.15.184:40868) 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5aa59c700 1 -- 172.21.15.184:0/991067664 learned_addr learned my addr 172.21.15.184:0/991067664 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5aa59c700 1 -- 172.21.15.184:0/991067664 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe594005040 con 0x7fe5ac066310 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5aa59c700 1 --2- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 0x7fe5ac10ca70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe594009040 tx=0x7fe594009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5a2ffd700 1 -- 172.21.15.184:0/991067664 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe594009620 con 0x7fe5ac066310 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5a2ffd700 1 -- 172.21.15.184:0/991067664 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe594009780 con 0x7fe5ac066310 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac10d1b0 con 0x7fe5ac066310 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5a2ffd700 1 -- 172.21.15.184:0/991067664 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe59401c5b0 con 0x7fe5ac066310 2023-12-16T03:10:08.212 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.209+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac10de50 con 0x7fe5ac066310 2023-12-16T03:10:08.213 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.210+0000 7fe5a2ffd700 1 -- 172.21.15.184:0/991067664 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fe59401c870 con 0x7fe5ac066310 2023-12-16T03:10:08.213 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.210+0000 7fe5a2ffd700 1 --2- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe5980366d0 0x7fe598038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:08.213 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.210+0000 7fe5a2ffd700 1 -- 172.21.15.184:0/991067664 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe5940498d0 con 0x7fe5ac066310 2023-12-16T03:10:08.213 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.210+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac05f270 con 0x7fe5ac066310 2023-12-16T03:10:08.213 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.210+0000 7fe5a9d9b700 1 --2- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe5980366d0 0x7fe598038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:08.214 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.211+0000 7fe5a9d9b700 1 --2- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe5980366d0 0x7fe598038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009990 tx=0x7fe59c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:08.217 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.215+0000 7fe5a2ffd700 1 -- 172.21.15.184:0/991067664 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe594023300 con 0x7fe5ac066310 2023-12-16T03:10:08.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.475+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe5ac10e860 con 0x7fe5ac066310 2023-12-16T03:10:08.477 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.476+0000 7fe5a2ffd700 1 -- 172.21.15.184:0/991067664 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe594034090 con 0x7fe5ac066310 2023-12-16T03:10:08.477 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:08.477 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:08.479 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe5980366d0 msgr2=0x7fe598038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:08.479 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 --2- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe5980366d0 0x7fe598038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009990 tx=0x7fe59c006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:08.479 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 msgr2=0x7fe5ac10ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:08.479 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 --2- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 0x7fe5ac10ca70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe594009040 tx=0x7fe594009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:08.480 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 shutdown_connections 2023-12-16T03:10:08.480 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 --2- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fe5980366d0 0x7fe598038b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:08.480 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 --2- 172.21.15.184:0/991067664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5ac066310 0x7fe5ac10ca70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:08.480 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 >> 172.21.15.184:0/991067664 conn(0x7fe5ac0f6e50 msgr2=0x7fe5ac0f7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:08.480 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 shutdown_connections 2023-12-16T03:10:08.480 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:08.478+0000 7fe5b0ad8700 1 -- 172.21.15.184:0/991067664 wait complete. 2023-12-16T03:10:08.480 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:09.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:08 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/991067664' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:09.850 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:09.851 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:10.132 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:10.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:09 smithi064 ceph-mon[111958]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:10.197 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:11.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.231+0000 7f12a1796700 1 -- 172.21.15.184:0/3329404628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 msgr2=0x7f129c0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:11.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.231+0000 7f12a1796700 1 --2- 172.21.15.184:0/3329404628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 0x7f129c0fbb90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f12900048c0 tx=0x7f1290009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:11.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.231+0000 7f12a1796700 1 -- 172.21.15.184:0/3329404628 shutdown_connections 2023-12-16T03:10:11.234 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.231+0000 7f12a1796700 1 --2- 172.21.15.184:0/3329404628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 0x7f129c0fbb90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:11.234 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.231+0000 7f12a1796700 1 -- 172.21.15.184:0/3329404628 >> 172.21.15.184:0/3329404628 conn(0x7f129c0f6e40 msgr2=0x7f129c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:11.234 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.232+0000 7f12a1796700 1 -- 172.21.15.184:0/3329404628 shutdown_connections 2023-12-16T03:10:11.234 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.232+0000 7f12a1796700 1 -- 172.21.15.184:0/3329404628 wait complete. 2023-12-16T03:10:11.236 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.232+0000 7f12a1796700 1 Processor -- start 2023-12-16T03:10:11.236 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.232+0000 7f12a1796700 1 -- start start 2023-12-16T03:10:11.236 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.232+0000 7f12a1796700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 0x7f129c0f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:11.236 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.232+0000 7f12a1796700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0f7400 con 0x7f129c0fb780 2023-12-16T03:10:11.236 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f129affd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 0x7f129c0f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:11.236 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f129affd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 0x7f129c0f8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:40890/0 (socket says 172.21.15.184:40890) 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f129affd700 1 -- 172.21.15.184:0/2890333047 learned_addr learned my addr 172.21.15.184:0/2890333047 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f129affd700 1 -- 172.21.15.184:0/2890333047 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1290005040 con 0x7f129c0fb780 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f129affd700 1 --2- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 0x7f129c0f8f80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f129000b690 tx=0x7f1290009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f12837fe700 1 -- 172.21.15.184:0/2890333047 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1290009650 con 0x7f129c0fb780 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c0f7600 con 0x7f129c0fb780 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f12837fe700 1 -- 172.21.15.184:0/2890333047 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f12900097b0 con 0x7f129c0fb780 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f12837fe700 1 -- 172.21.15.184:0/2890333047 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f129001c5d0 con 0x7f129c0fb780 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.233+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c0f7af0 con 0x7f129c0fb780 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.234+0000 7f12837fe700 1 -- 172.21.15.184:0/2890333047 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f129001c840 con 0x7f129c0fb780 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.234+0000 7f12837fe700 1 --2- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f1284036720 0x7f1284038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:11.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.234+0000 7f12837fe700 1 -- 172.21.15.184:0/2890333047 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1290049a40 con 0x7f129c0fb780 2023-12-16T03:10:11.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.234+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c106420 con 0x7f129c0fb780 2023-12-16T03:10:11.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.234+0000 7f129a7fc700 1 --2- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f1284036720 0x7f1284038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:11.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.235+0000 7f129a7fc700 1 --2- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f1284036720 0x7f1284038bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f128c009990 tx=0x7f128c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:11.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.242+0000 7f12837fe700 1 -- 172.21.15.184:0/2890333047 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1290023300 con 0x7f129c0fb780 2023-12-16T03:10:11.502 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.500+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f129c02b0e0 con 0x7f129c0fb780 2023-12-16T03:10:11.502 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.501+0000 7f12837fe700 1 -- 172.21.15.184:0/2890333047 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1290011b60 con 0x7f129c0fb780 2023-12-16T03:10:11.503 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:11.503 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:11.504 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f1284036720 msgr2=0x7f1284038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:11.504 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 --2- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f1284036720 0x7f1284038bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f128c009990 tx=0x7f128c006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:11.505 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 msgr2=0x7f129c0f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:11.505 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 --2- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 0x7f129c0f8f80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f129000b690 tx=0x7f1290009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:11.505 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 shutdown_connections 2023-12-16T03:10:11.505 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 --2- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f1284036720 0x7f1284038bd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:11.505 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 --2- 172.21.15.184:0/2890333047 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f129c0fb780 0x7f129c0f8f80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:11.505 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 >> 172.21.15.184:0/2890333047 conn(0x7f129c0f6e40 msgr2=0x7f129c065610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:11.505 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 shutdown_connections 2023-12-16T03:10:11.505 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:11.503+0000 7f12a1796700 1 -- 172.21.15.184:0/2890333047 wait complete. 2023-12-16T03:10:11.505 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:12.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:11 smithi064 ceph-mon[111958]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:12.191 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:11 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/2890333047' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:12.888 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:12.889 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:13.166 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:13.221 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:14.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:13 smithi064 ceph-mon[111958]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:14.291 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.288+0000 7efd27679700 1 -- 172.21.15.184:0/2461510630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 msgr2=0x7efd200faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.288+0000 7efd27679700 1 --2- 172.21.15.184:0/2461510630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 0x7efd200faf40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0048c0 tx=0x7efd1c009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.288+0000 7efd27679700 1 -- 172.21.15.184:0/2461510630 shutdown_connections 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.288+0000 7efd27679700 1 --2- 172.21.15.184:0/2461510630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 0x7efd200faf40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.288+0000 7efd27679700 1 -- 172.21.15.184:0/2461510630 >> 172.21.15.184:0/2461510630 conn(0x7efd200f65d0 msgr2=0x7efd200f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.289+0000 7efd27679700 1 -- 172.21.15.184:0/2461510630 shutdown_connections 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.289+0000 7efd27679700 1 -- 172.21.15.184:0/2461510630 wait complete. 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.289+0000 7efd27679700 1 Processor -- start 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.289+0000 7efd27679700 1 -- start start 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.289+0000 7efd27679700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 0x7efd200fd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.289+0000 7efd27679700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200fbad0 con 0x7efd200fab30 2023-12-16T03:10:14.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.290+0000 7efd25415700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 0x7efd200fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:14.293 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.290+0000 7efd25415700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 0x7efd200fd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:40896/0 (socket says 172.21.15.184:40896) 2023-12-16T03:10:14.293 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.290+0000 7efd25415700 1 -- 172.21.15.184:0/2338984883 learned_addr learned my addr 172.21.15.184:0/2338984883 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:14.293 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.290+0000 7efd25415700 1 -- 172.21.15.184:0/2338984883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c005040 con 0x7efd200fab30 2023-12-16T03:10:14.293 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.290+0000 7efd25415700 1 --2- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 0x7efd200fd650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009040 tx=0x7efd1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:14.294 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.290+0000 7efd15ffb700 1 -- 172.21.15.184:0/2338984883 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd1c009650 con 0x7efd200fab30 2023-12-16T03:10:14.294 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.290+0000 7efd15ffb700 1 -- 172.21.15.184:0/2338984883 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd1c0097b0 con 0x7efd200fab30 2023-12-16T03:10:14.294 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.290+0000 7efd15ffb700 1 -- 172.21.15.184:0/2338984883 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd1c01c5b0 con 0x7efd200fab30 2023-12-16T03:10:14.294 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.290+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd200fbcd0 con 0x7efd200fab30 2023-12-16T03:10:14.294 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.291+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd200fc1c0 con 0x7efd200fab30 2023-12-16T03:10:14.294 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.291+0000 7efd15ffb700 1 -- 172.21.15.184:0/2338984883 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7efd1c0139d0 con 0x7efd200fab30 2023-12-16T03:10:14.294 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.291+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd201064a0 con 0x7efd200fab30 2023-12-16T03:10:14.295 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.292+0000 7efd15ffb700 1 --2- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd0c0366d0 0x7efd0c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:14.295 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.292+0000 7efd15ffb700 1 -- 172.21.15.184:0/2338984883 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efd1c049970 con 0x7efd200fab30 2023-12-16T03:10:14.295 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.292+0000 7efd24c14700 1 --2- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd0c0366d0 0x7efd0c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:14.295 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.292+0000 7efd24c14700 1 --2- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd0c0366d0 0x7efd0c038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efd10009990 tx=0x7efd10006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:14.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.298+0000 7efd15ffb700 1 -- 172.21.15.184:0/2338984883 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efd1c011940 con 0x7efd200fab30 2023-12-16T03:10:14.554 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.552+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efd2004bb80 con 0x7efd200fab30 2023-12-16T03:10:14.555 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.553+0000 7efd15ffb700 1 -- 172.21.15.184:0/2338984883 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7efd1c011370 con 0x7efd200fab30 2023-12-16T03:10:14.555 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:14.555 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:14.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd0c0366d0 msgr2=0x7efd0c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:14.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 --2- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd0c0366d0 0x7efd0c038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efd10009990 tx=0x7efd10006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:14.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 msgr2=0x7efd200fd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:14.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 --2- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 0x7efd200fd650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009040 tx=0x7efd1c009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:14.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 shutdown_connections 2023-12-16T03:10:14.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 --2- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7efd0c0366d0 0x7efd0c038b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:14.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 --2- 172.21.15.184:0/2338984883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd200fab30 0x7efd200fd650 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:14.557 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 >> 172.21.15.184:0/2338984883 conn(0x7efd200f65d0 msgr2=0x7efd200f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:14.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 shutdown_connections 2023-12-16T03:10:14.558 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:14.555+0000 7efd27679700 1 -- 172.21.15.184:0/2338984883 wait complete. 2023-12-16T03:10:14.558 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:14.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:14 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/2338984883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:15.918 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:15.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:15.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:15 smithi064 ceph-mon[111958]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:16.212 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:16.271 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:17.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.305+0000 7f4a72a81700 1 -- 172.21.15.184:0/3481909003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 msgr2=0x7f4a6c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:17.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.305+0000 7f4a72a81700 1 --2- 172.21.15.184:0/3481909003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 0x7f4a6c0fcc80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a600048c0 tx=0x7f4a60009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:17.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.305+0000 7f4a72a81700 1 -- 172.21.15.184:0/3481909003 shutdown_connections 2023-12-16T03:10:17.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.305+0000 7f4a72a81700 1 --2- 172.21.15.184:0/3481909003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 0x7f4a6c0fcc80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:17.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.305+0000 7f4a72a81700 1 -- 172.21.15.184:0/3481909003 >> 172.21.15.184:0/3481909003 conn(0x7f4a6c0f7f50 msgr2=0x7f4a6c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:17.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.305+0000 7f4a72a81700 1 -- 172.21.15.184:0/3481909003 shutdown_connections 2023-12-16T03:10:17.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.305+0000 7f4a72a81700 1 -- 172.21.15.184:0/3481909003 wait complete. 2023-12-16T03:10:17.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.305+0000 7f4a72a81700 1 Processor -- start 2023-12-16T03:10:17.307 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.305+0000 7f4a72a81700 1 -- start start 2023-12-16T03:10:17.308 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.306+0000 7f4a72a81700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 0x7f4a6c10ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.306+0000 7f4a72a81700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c10cfc0 con 0x7f4a6c0fc870 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.306+0000 7f4a7081d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 0x7f4a6c10ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.306+0000 7f4a7081d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 0x7f4a6c10ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:57696/0 (socket says 172.21.15.184:57696) 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.306+0000 7f4a7081d700 1 -- 172.21.15.184:0/2095765290 learned_addr learned my addr 172.21.15.184:0/2095765290 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.306+0000 7f4a7081d700 1 -- 172.21.15.184:0/2095765290 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60005040 con 0x7f4a6c0fc870 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.306+0000 7f4a7081d700 1 --2- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 0x7f4a6c10ca80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000b690 tx=0x7f4a60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.307+0000 7f4a697fa700 1 -- 172.21.15.184:0/2095765290 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a60009650 con 0x7f4a6c0fc870 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.307+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c10d1c0 con 0x7f4a6c0fc870 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.307+0000 7f4a697fa700 1 -- 172.21.15.184:0/2095765290 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a600097b0 con 0x7f4a6c0fc870 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.307+0000 7f4a697fa700 1 -- 172.21.15.184:0/2095765290 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a6001c5d0 con 0x7f4a6c0fc870 2023-12-16T03:10:17.309 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.307+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c10de60 con 0x7f4a6c0fc870 2023-12-16T03:10:17.310 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.308+0000 7f4a697fa700 1 -- 172.21.15.184:0/2095765290 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f4a60013420 con 0x7f4a6c0fc870 2023-12-16T03:10:17.310 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.308+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c05f270 con 0x7f4a6c0fc870 2023-12-16T03:10:17.310 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.308+0000 7f4a697fa700 1 --2- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f4a5c036720 0x7f4a5c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:17.310 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.308+0000 7f4a697fa700 1 -- 172.21.15.184:0/2095765290 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4a60049990 con 0x7f4a6c0fc870 2023-12-16T03:10:17.310 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.308+0000 7f4a6bfff700 1 --2- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f4a5c036720 0x7f4a5c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:17.311 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.308+0000 7f4a6bfff700 1 --2- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f4a5c036720 0x7f4a5c038bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009990 tx=0x7f4a58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:17.314 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.313+0000 7f4a697fa700 1 -- 172.21.15.184:0/2095765290 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4a600123c0 con 0x7f4a6c0fc870 2023-12-16T03:10:17.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:17 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:17.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:17 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:17.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:17 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:17.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:17 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:17.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:17 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:17.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:17 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:17.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:17 smithi064 ceph-mon[111958]: Deploying daemon prometheus.smithi064 on smithi064 2023-12-16T03:10:17.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:17 smithi064 ceph-mon[111958]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:17.568 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.567+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4a6c10e9b0 con 0x7f4a6c0fc870 2023-12-16T03:10:17.569 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.567+0000 7f4a697fa700 1 -- 172.21.15.184:0/2095765290 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4a600123c0 con 0x7f4a6c0fc870 2023-12-16T03:10:17.569 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:17.569 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:17.571 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.569+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f4a5c036720 msgr2=0x7f4a5c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:17.571 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.569+0000 7f4a72a81700 1 --2- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f4a5c036720 0x7f4a5c038bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009990 tx=0x7f4a58006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:17.571 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.569+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 msgr2=0x7f4a6c10ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:17.571 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.569+0000 7f4a72a81700 1 --2- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 0x7f4a6c10ca80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000b690 tx=0x7f4a60009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:17.571 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.570+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 shutdown_connections 2023-12-16T03:10:17.571 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.570+0000 7f4a72a81700 1 --2- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f4a5c036720 0x7f4a5c038bd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:17.572 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.570+0000 7f4a72a81700 1 --2- 172.21.15.184:0/2095765290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a6c0fc870 0x7f4a6c10ca80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:17.572 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.570+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 >> 172.21.15.184:0/2095765290 conn(0x7f4a6c0f7f50 msgr2=0x7f4a6c0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:17.572 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.570+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 shutdown_connections 2023-12-16T03:10:17.572 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:17.570+0000 7f4a72a81700 1 -- 172.21.15.184:0/2095765290 wait complete. 2023-12-16T03:10:17.572 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:18 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/2095765290' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:18 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:18.961 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:18.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:19.256 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:19.315 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:19.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:19 smithi064 ceph-mon[111958]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.296+0000 7fa915bb0700 1 -- 172.21.15.184:0/1244792278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 msgr2=0x7fa9100fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.296+0000 7fa915bb0700 1 --2- 172.21.15.184:0/1244792278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 0x7fa9100fbb90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa9040048c0 tx=0x7fa904009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.296+0000 7fa915bb0700 1 -- 172.21.15.184:0/1244792278 shutdown_connections 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.296+0000 7fa915bb0700 1 --2- 172.21.15.184:0/1244792278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 0x7fa9100fbb90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.296+0000 7fa915bb0700 1 -- 172.21.15.184:0/1244792278 >> 172.21.15.184:0/1244792278 conn(0x7fa9100f6e40 msgr2=0x7fa9100f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.296+0000 7fa915bb0700 1 -- 172.21.15.184:0/1244792278 shutdown_connections 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.296+0000 7fa915bb0700 1 -- 172.21.15.184:0/1244792278 wait complete. 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.296+0000 7fa915bb0700 1 Processor -- start 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.296+0000 7fa915bb0700 1 -- start start 2023-12-16T03:10:20.299 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa915bb0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 0x7fa91010f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa915bb0700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910065a10 con 0x7fa9100fb780 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa90f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 0x7fa91010f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa90f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 0x7fa91010f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:57714/0 (socket says 172.21.15.184:57714) 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa90f7fe700 1 -- 172.21.15.184:0/1563424263 learned_addr learned my addr 172.21.15.184:0/1563424263 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa90f7fe700 1 -- 172.21.15.184:0/1563424263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904005040 con 0x7fa9100fb780 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa90f7fe700 1 --2- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 0x7fa91010f7c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa90400b690 tx=0x7fa904009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa8f7fff700 1 -- 172.21.15.184:0/1563424263 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa904009650 con 0x7fa9100fb780 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa8f7fff700 1 -- 172.21.15.184:0/1563424263 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9040097b0 con 0x7fa9100fb780 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa910065c10 con 0x7fa9100fb780 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa8f7fff700 1 -- 172.21.15.184:0/1563424263 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa90401c5d0 con 0x7fa9100fb780 2023-12-16T03:10:20.300 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.297+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91010ff40 con 0x7fa9100fb780 2023-12-16T03:10:20.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.298+0000 7fa8f7fff700 1 -- 172.21.15.184:0/1563424263 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fa90401c840 con 0x7fa9100fb780 2023-12-16T03:10:20.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.298+0000 7fa8f7fff700 1 --2- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fa8f80366d0 0x7fa8f8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:20.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.298+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa910105410 con 0x7fa9100fb780 2023-12-16T03:10:20.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.298+0000 7fa8f7fff700 1 -- 172.21.15.184:0/1563424263 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa904049b50 con 0x7fa9100fb780 2023-12-16T03:10:20.301 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.299+0000 7fa90effd700 1 --2- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fa8f80366d0 0x7fa8f8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:20.302 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.299+0000 7fa90effd700 1 --2- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fa8f80366d0 0x7fa8f8038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa900009990 tx=0x7fa900006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:20.305 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.305+0000 7fa8f7fff700 1 -- 172.21.15.184:0/1563424263 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa904011550 con 0x7fa9100fb780 2023-12-16T03:10:20.562 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.561+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa91004bb80 con 0x7fa9100fb780 2023-12-16T03:10:20.563 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.562+0000 7fa8f7fff700 1 -- 172.21.15.184:0/1563424263 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa904011370 con 0x7fa9100fb780 2023-12-16T03:10:20.563 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:20.563 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:20.565 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.563+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fa8f80366d0 msgr2=0x7fa8f8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:20.565 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.563+0000 7fa915bb0700 1 --2- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fa8f80366d0 0x7fa8f8038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa900009990 tx=0x7fa900006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:20.565 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.563+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 msgr2=0x7fa91010f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:20.565 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.563+0000 7fa915bb0700 1 --2- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 0x7fa91010f7c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa90400b690 tx=0x7fa904009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:20.565 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.563+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 shutdown_connections 2023-12-16T03:10:20.565 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.563+0000 7fa915bb0700 1 --2- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fa8f80366d0 0x7fa8f8038b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:20.565 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.563+0000 7fa915bb0700 1 --2- 172.21.15.184:0/1563424263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9100fb780 0x7fa91010f7c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:20.566 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.563+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 >> 172.21.15.184:0/1563424263 conn(0x7fa9100f6e40 msgr2=0x7fa9100f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:20.566 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.564+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 shutdown_connections 2023-12-16T03:10:20.566 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:20.564+0000 7fa915bb0700 1 -- 172.21.15.184:0/1563424263 wait complete. 2023-12-16T03:10:20.566 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:20.941 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:20 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/1563424263' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:21.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:21 smithi064 ceph-mon[111958]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:21.952 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:21.952 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:22.241 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:22.307 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.358+0000 7fd990b97700 1 -- 172.21.15.184:0/1102741897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 msgr2=0x7fd98c0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.358+0000 7fd990b97700 1 --2- 172.21.15.184:0/1102741897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 0x7fd98c0fbb90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd9800048c0 tx=0x7fd980009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.358+0000 7fd990b97700 1 -- 172.21.15.184:0/1102741897 shutdown_connections 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.358+0000 7fd990b97700 1 --2- 172.21.15.184:0/1102741897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 0x7fd98c0fbb90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.358+0000 7fd990b97700 1 -- 172.21.15.184:0/1102741897 >> 172.21.15.184:0/1102741897 conn(0x7fd98c0f6e40 msgr2=0x7fd98c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.358+0000 7fd990b97700 1 -- 172.21.15.184:0/1102741897 shutdown_connections 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.358+0000 7fd990b97700 1 -- 172.21.15.184:0/1102741897 wait complete. 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.359+0000 7fd990b97700 1 Processor -- start 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.359+0000 7fd990b97700 1 -- start start 2023-12-16T03:10:23.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.359+0000 7fd990b97700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 0x7fd98c10f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:23.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.359+0000 7fd990b97700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c065a10 con 0x7fd98c0fb780 2023-12-16T03:10:23.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.359+0000 7fd98a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 0x7fd98c10f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:23.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.359+0000 7fd98a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 0x7fd98c10f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:57734/0 (socket says 172.21.15.184:57734) 2023-12-16T03:10:23.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.359+0000 7fd98a59c700 1 -- 172.21.15.184:0/3684378612 learned_addr learned my addr 172.21.15.184:0/3684378612 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:23.361 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.359+0000 7fd98a59c700 1 -- 172.21.15.184:0/3684378612 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd980005040 con 0x7fd98c0fb780 2023-12-16T03:10:23.363 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.360+0000 7fd98a59c700 1 --2- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 0x7fd98c10f7c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd980009330 tx=0x7fd980009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:23.363 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.360+0000 7fd97affd700 1 -- 172.21.15.184:0/3684378612 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9800096b0 con 0x7fd98c0fb780 2023-12-16T03:10:23.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.360+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c065c10 con 0x7fd98c0fb780 2023-12-16T03:10:23.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.360+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c10ff40 con 0x7fd98c0fb780 2023-12-16T03:10:23.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.360+0000 7fd97affd700 1 -- 172.21.15.184:0/3684378612 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd980009810 con 0x7fd98c0fb780 2023-12-16T03:10:23.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.360+0000 7fd97affd700 1 -- 172.21.15.184:0/3684378612 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd980025400 con 0x7fd98c0fb780 2023-12-16T03:10:23.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.361+0000 7fd97affd700 1 -- 172.21.15.184:0/3684378612 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd980013420 con 0x7fd98c0fb780 2023-12-16T03:10:23.364 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.361+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c0052e0 con 0x7fd98c0fb780 2023-12-16T03:10:23.365 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.361+0000 7fd97affd700 1 --2- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd9740366d0 0x7fd974038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:23.365 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.361+0000 7fd97affd700 1 -- 172.21.15.184:0/3684378612 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd9800499e0 con 0x7fd98c0fb780 2023-12-16T03:10:23.365 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.361+0000 7fd989d9b700 1 --2- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd9740366d0 0x7fd974038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:23.365 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.362+0000 7fd989d9b700 1 --2- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd9740366d0 0x7fd974038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009990 tx=0x7fd97c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:23.366 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.366+0000 7fd97affd700 1 -- 172.21.15.184:0/3684378612 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd980011ad0 con 0x7fd98c0fb780 2023-12-16T03:10:23.624 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.624+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd96c005590 con 0x7fd98c0fb780 2023-12-16T03:10:23.625 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.625+0000 7fd97affd700 1 -- 172.21.15.184:0/3684378612 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd98001ce40 con 0x7fd98c0fb780 2023-12-16T03:10:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:23.625 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:23.627 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.626+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd9740366d0 msgr2=0x7fd974038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:23.627 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.627+0000 7fd990b97700 1 --2- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd9740366d0 0x7fd974038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009990 tx=0x7fd97c006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:23.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.627+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 msgr2=0x7fd98c10f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:23.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.627+0000 7fd990b97700 1 --2- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 0x7fd98c10f7c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd980009330 tx=0x7fd980009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:23.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.627+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 shutdown_connections 2023-12-16T03:10:23.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.627+0000 7fd990b97700 1 --2- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7fd9740366d0 0x7fd974038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:23.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.627+0000 7fd990b97700 1 --2- 172.21.15.184:0/3684378612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98c0fb780 0x7fd98c10f7c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:23.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.627+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 >> 172.21.15.184:0/3684378612 conn(0x7fd98c0f6e40 msgr2=0x7fd98c0f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:23.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.627+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 shutdown_connections 2023-12-16T03:10:23.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:23.627+0000 7fd990b97700 1 -- 172.21.15.184:0/3684378612 wait complete. 2023-12-16T03:10:23.628 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:24.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:23 smithi064 ceph-mon[111958]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:24.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:23 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/3684378612' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:25.054 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:25.054 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:25.343 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:25.402 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:25.839 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:25 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:25.839 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:25 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:25.839 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:25 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:25.840 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:25 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-16T03:10:25.840 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:25 smithi064 ceph-mon[111958]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:26.427 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.425+0000 7ff590607700 1 -- 172.21.15.184:0/2670617539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 msgr2=0x7ff5880fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:26.427 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.425+0000 7ff590607700 1 --2- 172.21.15.184:0/2670617539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 0x7ff5880fbb90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff5780048c0 tx=0x7ff578009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:26.427 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.425+0000 7ff590607700 1 -- 172.21.15.184:0/2670617539 shutdown_connections 2023-12-16T03:10:26.427 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.425+0000 7ff590607700 1 --2- 172.21.15.184:0/2670617539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 0x7ff5880fbb90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:26.427 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.425+0000 7ff590607700 1 -- 172.21.15.184:0/2670617539 >> 172.21.15.184:0/2670617539 conn(0x7ff5880f6e40 msgr2=0x7ff5880f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:26.427 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.425+0000 7ff590607700 1 -- 172.21.15.184:0/2670617539 shutdown_connections 2023-12-16T03:10:26.427 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.425+0000 7ff590607700 1 -- 172.21.15.184:0/2670617539 wait complete. 2023-12-16T03:10:26.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.426+0000 7ff590607700 1 Processor -- start 2023-12-16T03:10:26.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.426+0000 7ff590607700 1 -- start start 2023-12-16T03:10:26.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.426+0000 7ff590607700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 0x7ff58810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:26.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.426+0000 7ff590607700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58810f290 con 0x7ff5880fb780 2023-12-16T03:10:26.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.426+0000 7ff58e3a3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 0x7ff58810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:26.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.426+0000 7ff58e3a3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 0x7ff58810ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:52574/0 (socket says 172.21.15.184:52574) 2023-12-16T03:10:26.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.426+0000 7ff58e3a3700 1 -- 172.21.15.184:0/1988820182 learned_addr learned my addr 172.21.15.184:0/1988820182 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:26.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.427+0000 7ff58e3a3700 1 -- 172.21.15.184:0/1988820182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578005040 con 0x7ff5880fb780 2023-12-16T03:10:26.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.427+0000 7ff58e3a3700 1 --2- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 0x7ff58810ed50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff57800b690 tx=0x7ff578009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:26.429 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.427+0000 7ff57effd700 1 -- 172.21.15.184:0/1988820182 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff578009650 con 0x7ff5880fb780 2023-12-16T03:10:26.429 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.427+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58810f490 con 0x7ff5880fb780 2023-12-16T03:10:26.430 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.427+0000 7ff57effd700 1 -- 172.21.15.184:0/1988820182 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff5780097b0 con 0x7ff5880fb780 2023-12-16T03:10:26.430 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.427+0000 7ff57effd700 1 -- 172.21.15.184:0/1988820182 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff57801c5d0 con 0x7ff5880fb780 2023-12-16T03:10:26.430 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.427+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58810fff0 con 0x7ff5880fb780 2023-12-16T03:10:26.430 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.428+0000 7ff57effd700 1 -- 172.21.15.184:0/1988820182 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7ff578013420 con 0x7ff5880fb780 2023-12-16T03:10:26.430 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.428+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58804bb80 con 0x7ff5880fb780 2023-12-16T03:10:26.430 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.428+0000 7ff57effd700 1 --2- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7ff574036720 0x7ff574038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:26.430 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.428+0000 7ff57effd700 1 -- 172.21.15.184:0/1988820182 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff578049a70 con 0x7ff5880fb780 2023-12-16T03:10:26.430 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.428+0000 7ff58dba2700 1 -- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7ff574036720 msgr2=0x7ff574038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/1165076471 2023-12-16T03:10:26.430 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.428+0000 7ff58dba2700 1 --2- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7ff574036720 0x7ff574038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:10:26.433 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.433+0000 7ff57effd700 1 -- 172.21.15.184:0/1988820182 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff578025400 con 0x7ff5880fb780 2023-12-16T03:10:26.629 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.629+0000 7ff58dba2700 1 -- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7ff574036720 msgr2=0x7ff574038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/1165076471 2023-12-16T03:10:26.629 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.629+0000 7ff58dba2700 1 --2- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7ff574036720 0x7ff574038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:10:26.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.687+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff588108240 con 0x7ff5880fb780 2023-12-16T03:10:26.688 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.688+0000 7ff57effd700 1 -- 172.21.15.184:0/1988820182 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff578025400 con 0x7ff5880fb780 2023-12-16T03:10:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:26.688 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:26.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.689+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7ff574036720 msgr2=0x7ff574038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:10:26.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.689+0000 7ff590607700 1 --2- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7ff574036720 0x7ff574038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:26.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.689+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 msgr2=0x7ff58810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:26.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.689+0000 7ff590607700 1 --2- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 0x7ff58810ed50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff57800b690 tx=0x7ff578009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:26.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.689+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 shutdown_connections 2023-12-16T03:10:26.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.689+0000 7ff590607700 1 --2- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7ff574036720 0x7ff574038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:26.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.689+0000 7ff590607700 1 --2- 172.21.15.184:0/1988820182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5880fb780 0x7ff58810ed50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:26.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.690+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 >> 172.21.15.184:0/1988820182 conn(0x7ff5880f6e40 msgr2=0x7ff588065650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:26.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.690+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 shutdown_connections 2023-12-16T03:10:26.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:26.690+0000 7ff590607700 1 -- 172.21.15.184:0/1988820182 wait complete. 2023-12-16T03:10:26.691 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:26.858 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:26 smithi064 ceph-mon[111958]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-16T03:10:26.859 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:26 smithi064 ceph-mon[111958]: mgrmap e14: smithi064.ueciyw(active, since 42s) 2023-12-16T03:10:27.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:27 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/1988820182' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:28.104 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:28.104 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:28.395 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:28.458 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:29.451 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.450+0000 7f8c33347700 1 -- 172.21.15.184:0/2388821766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 msgr2=0x7f8c2c0ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:29.451 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.450+0000 7f8c33347700 1 --2- 172.21.15.184:0/2388821766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 0x7f8c2c0ff430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0048c0 tx=0x7f8c1c009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.450+0000 7f8c33347700 1 -- 172.21.15.184:0/2388821766 shutdown_connections 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.450+0000 7f8c33347700 1 --2- 172.21.15.184:0/2388821766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 0x7f8c2c0ff430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.450+0000 7f8c33347700 1 -- 172.21.15.184:0/2388821766 >> 172.21.15.184:0/2388821766 conn(0x7f8c2c0f6e40 msgr2=0x7f8c2c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.450+0000 7f8c33347700 1 -- 172.21.15.184:0/2388821766 shutdown_connections 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.450+0000 7f8c33347700 1 -- 172.21.15.184:0/2388821766 wait complete. 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.450+0000 7f8c33347700 1 Processor -- start 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c33347700 1 -- start start 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c33347700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 0x7f8c2c10ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c33347700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c10cfa0 con 0x7f8c2c065aa0 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c310e3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 0x7f8c2c10ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c310e3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 0x7f8c2c10ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:52602/0 (socket says 172.21.15.184:52602) 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c310e3700 1 -- 172.21.15.184:0/3931738565 learned_addr learned my addr 172.21.15.184:0/3931738565 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:29.452 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c310e3700 1 -- 172.21.15.184:0/3931738565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c005040 con 0x7f8c2c065aa0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c310e3700 1 --2- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 0x7f8c2c10ca60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009040 tx=0x7f8c1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c21ffb700 1 -- 172.21.15.184:0/3931738565 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c1c009620 con 0x7f8c2c065aa0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.451+0000 7f8c21ffb700 1 -- 172.21.15.184:0/3931738565 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c1c009780 con 0x7f8c2c065aa0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.452+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c10d1a0 con 0x7f8c2c065aa0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.452+0000 7f8c21ffb700 1 -- 172.21.15.184:0/3931738565 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c1c01c5b0 con 0x7f8c2c065aa0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.452+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c10de40 con 0x7f8c2c065aa0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.452+0000 7f8c21ffb700 1 -- 172.21.15.184:0/3931738565 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f8c1c013a60 con 0x7f8c2c065aa0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.453+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c05f270 con 0x7f8c2c065aa0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.453+0000 7f8c21ffb700 1 --2- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f8c18036720 0x7f8c18038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.453+0000 7f8c21ffb700 1 -- 172.21.15.184:0/3931738565 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8c1c049970 con 0x7f8c2c065aa0 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.453+0000 7f8c308e2700 1 -- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f8c18036720 msgr2=0x7f8c18038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/1165076471 2023-12-16T03:10:29.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.453+0000 7f8c308e2700 1 --2- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f8c18036720 0x7f8c18038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:10:29.458 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.458+0000 7f8c21ffb700 1 -- 172.21.15.184:0/3931738565 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8c1c025400 con 0x7f8c2c065aa0 2023-12-16T03:10:29.654 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.654+0000 7f8c308e2700 1 -- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f8c18036720 msgr2=0x7f8c18038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:6800/1165076471 2023-12-16T03:10:29.654 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.654+0000 7f8c308e2700 1 --2- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f8c18036720 0x7f8c18038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:10:29.716 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.716+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8c2c10e990 con 0x7f8c2c065aa0 2023-12-16T03:10:29.717 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.717+0000 7f8c21ffb700 1 -- 172.21.15.184:0/3931738565 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8c1c011370 con 0x7f8c2c065aa0 2023-12-16T03:10:29.717 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:29.717 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:29.719 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.718+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f8c18036720 msgr2=0x7f8c18038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:10:29.719 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.718+0000 7f8c33347700 1 --2- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f8c18036720 0x7f8c18038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:29.719 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.719+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 msgr2=0x7f8c2c10ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:29.719 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.719+0000 7f8c33347700 1 --2- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 0x7f8c2c10ca60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009040 tx=0x7f8c1c009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:29.719 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.719+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 shutdown_connections 2023-12-16T03:10:29.720 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.719+0000 7f8c33347700 1 --2- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:6800/1165076471,v1:172.21.15.64:6801/1165076471] conn(0x7f8c18036720 0x7f8c18038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:29.720 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.719+0000 7f8c33347700 1 --2- 172.21.15.184:0/3931738565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c2c065aa0 0x7f8c2c10ca60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:29.720 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.719+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 >> 172.21.15.184:0/3931738565 conn(0x7f8c2c0f6e40 msgr2=0x7f8c2c0f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:29.720 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.719+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 shutdown_connections 2023-12-16T03:10:29.720 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:29.719+0000 7f8c33347700 1 -- 172.21.15.184:0/3931738565 wait complete. 2023-12-16T03:10:29.720 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:30.032 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:29 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/3931738565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:31.146 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:31.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:31.430 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:31.488 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:32.474 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 -- 172.21.15.184:0/594277869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 msgr2=0x7fceb80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:32.474 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 --2- 172.21.15.184:0/594277869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 0x7fceb80fcc80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fceac0048c0 tx=0x7fceac009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:32.474 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 -- 172.21.15.184:0/594277869 shutdown_connections 2023-12-16T03:10:32.474 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 --2- 172.21.15.184:0/594277869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 0x7fceb80fcc80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:32.474 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 -- 172.21.15.184:0/594277869 >> 172.21.15.184:0/594277869 conn(0x7fceb80f7f50 msgr2=0x7fceb80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:32.474 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 -- 172.21.15.184:0/594277869 shutdown_connections 2023-12-16T03:10:32.474 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 -- 172.21.15.184:0/594277869 wait complete. 2023-12-16T03:10:32.474 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 Processor -- start 2023-12-16T03:10:32.475 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 -- start start 2023-12-16T03:10:32.475 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.473+0000 7fcebee77700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 0x7fceb810ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:32.475 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fcebee77700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb810cfd0 con 0x7fceb80fc870 2023-12-16T03:10:32.475 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fcebcc13700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 0x7fceb810ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:32.475 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fcebcc13700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 0x7fceb810ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:52632/0 (socket says 172.21.15.184:52632) 2023-12-16T03:10:32.475 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fcebcc13700 1 -- 172.21.15.184:0/2508072152 learned_addr learned my addr 172.21.15.184:0/2508072152 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fcebcc13700 1 -- 172.21.15.184:0/2508072152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac005040 con 0x7fceb80fc870 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fcebcc13700 1 --2- 172.21.15.184:0/2508072152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 0x7fceb810ca90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fceac009330 tx=0x7fceac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fceb57fa700 1 -- 172.21.15.184:0/2508072152 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceac0096b0 con 0x7fceb80fc870 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fcebee77700 1 -- 172.21.15.184:0/2508072152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb810d1d0 con 0x7fceb80fc870 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fceb57fa700 1 -- 172.21.15.184:0/2508072152 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fceac009810 con 0x7fceb80fc870 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fceb57fa700 1 -- 172.21.15.184:0/2508072152 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceac01c5b0 con 0x7fceb80fc870 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.474+0000 7fcebee77700 1 -- 172.21.15.184:0/2508072152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb810de70 con 0x7fceb80fc870 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.475+0000 7fceb57fa700 1 -- 172.21.15.184:0/2508072152 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 15) v1 ==== 43075+0+0 (secure 0 0 0) 0x7fceac013420 con 0x7fceb80fc870 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.475+0000 7fcebee77700 1 -- 172.21.15.184:0/2508072152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb805f270 con 0x7fceb80fc870 2023-12-16T03:10:32.476 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.475+0000 7fceb57fa700 1 -- 172.21.15.184:0/2508072152 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fceac0496b0 con 0x7fceb80fc870 2023-12-16T03:10:32.485 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.484+0000 7fceb57fa700 1 -- 172.21.15.184:0/2508072152 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fceac011db0 con 0x7fceb80fc870 2023-12-16T03:10:32.508 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: Active manager daemon smithi064.ueciyw restarted 2023-12-16T03:10:32.508 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: Activating manager daemon smithi064.ueciyw 2023-12-16T03:10:32.508 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T03:10:32.508 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: mgrmap e15: smithi064.ueciyw(active, starting, since 0.00368245s) 2023-12-16T03:10:32.508 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:10:32.508 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:10:32.508 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:10:32.509 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:10:32.509 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:10:32.509 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: Manager daemon smithi064.ueciyw is now available 2023-12-16T03:10:32.509 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:10:32.509 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:10:32.509 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:32.750 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.749+0000 7fcebee77700 1 -- 172.21.15.184:0/2508072152 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fceb810e9c0 con 0x7fceb80fc870 2023-12-16T03:10:32.751 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.750+0000 7fceb57fa700 1 -- 172.21.15.184:0/2508072152 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fceac011370 con 0x7fceb80fc870 2023-12-16T03:10:32.751 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:32.751 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:32.753 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.752+0000 7fcebee77700 1 -- 172.21.15.184:0/2508072152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 msgr2=0x7fceb810ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:32.753 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.752+0000 7fcebee77700 1 --2- 172.21.15.184:0/2508072152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 0x7fceb810ca90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fceac009330 tx=0x7fceac009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:32.753 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.752+0000 7fcebee77700 1 -- 172.21.15.184:0/2508072152 shutdown_connections 2023-12-16T03:10:32.753 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.752+0000 7fcebee77700 1 --2- 172.21.15.184:0/2508072152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fceb80fc870 0x7fceb810ca90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:32.753 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.752+0000 7fcebee77700 1 -- 172.21.15.184:0/2508072152 >> 172.21.15.184:0/2508072152 conn(0x7fceb80f7f50 msgr2=0x7fceb80f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:32.753 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.752+0000 7fcebee77700 1 -- 172.21.15.184:0/2508072152 shutdown_connections 2023-12-16T03:10:32.753 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:32.752+0000 7fcebee77700 1 -- 172.21.15.184:0/2508072152 wait complete. 2023-12-16T03:10:32.753 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:10:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:10:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/trash_purge_schedule"}]: dispatch 2023-12-16T03:10:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:33 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/2508072152' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:33 smithi064 ceph-mon[111958]: mgrmap e16: smithi064.ueciyw(active, since 1.005s) 2023-12-16T03:10:34.154 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:34.155 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:34 smithi064 ceph-mon[111958]: [16/Dec/2023:03:10:33] ENGINE Bus STARTING 2023-12-16T03:10:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:34 smithi064 ceph-mon[111958]: [16/Dec/2023:03:10:33] ENGINE Serving on https://172.21.15.64:7150 2023-12-16T03:10:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:34 smithi064 ceph-mon[111958]: [16/Dec/2023:03:10:33] ENGINE Bus STARTED 2023-12-16T03:10:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:34 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:34 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:34.767 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:34.998 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T03:10:36.134 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.131+0000 7f861019d700 1 -- 172.21.15.184:0/1752688148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 msgr2=0x7f86080fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:36.134 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.131+0000 7f861019d700 1 --2- 172.21.15.184:0/1752688148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 0x7f86080fd160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86040048c0 tx=0x7f8604009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:36.134 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.131+0000 7f861019d700 1 -- 172.21.15.184:0/1752688148 shutdown_connections 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.131+0000 7f861019d700 1 --2- 172.21.15.184:0/1752688148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 0x7f86080fd160 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.131+0000 7f861019d700 1 -- 172.21.15.184:0/1752688148 >> 172.21.15.184:0/1752688148 conn(0x7f86080f65d0 msgr2=0x7f86080f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.131+0000 7f861019d700 1 -- 172.21.15.184:0/1752688148 shutdown_connections 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.131+0000 7f861019d700 1 -- 172.21.15.184:0/1752688148 wait complete. 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.131+0000 7f861019d700 1 Processor -- start 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.131+0000 7f861019d700 1 -- start start 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f861019d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 0x7f860810f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f861019d700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86080fb650 con 0x7f86080fcd50 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f860df39700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 0x7f860810f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f860df39700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 0x7f860810f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:46954/0 (socket says 172.21.15.184:46954) 2023-12-16T03:10:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f860df39700 1 -- 172.21.15.184:0/3853813111 learned_addr learned my addr 172.21.15.184:0/3853813111 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f860df39700 1 -- 172.21.15.184:0/3853813111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604005040 con 0x7f86080fcd50 2023-12-16T03:10:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f860df39700 1 --2- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 0x7f860810f730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8604009040 tx=0x7f8604009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f85fe7fc700 1 -- 172.21.15.184:0/3853813111 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8604009650 con 0x7f86080fcd50 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f85fe7fc700 1 -- 172.21.15.184:0/3853813111 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f86040097b0 con 0x7f86080fcd50 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86080fb850 con 0x7f86080fcd50 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.132+0000 7f85fe7fc700 1 -- 172.21.15.184:0/3853813111 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f860401c5b0 con 0x7f86080fcd50 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.133+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860810feb0 con 0x7f86080fcd50 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.133+0000 7f85fe7fc700 1 -- 172.21.15.184:0/3853813111 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f8604013420 con 0x7f86080fcd50 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.133+0000 7f85fe7fc700 1 --2- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f85f40367c0 0x7f85f4038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.134+0000 7f85fe7fc700 1 -- 172.21.15.184:0/3853813111 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f8604049bf0 con 0x7f86080fcd50 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.134+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86081053a0 con 0x7f86080fcd50 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.134+0000 7f860d738700 1 --2- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f85f40367c0 0x7f85f4038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.134+0000 7f860d738700 1 --2- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f85f40367c0 0x7f85f4038c70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009990 tx=0x7f85f8006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:36.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.139+0000 7f85fe7fc700 1 -- 172.21.15.184:0/3853813111 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f86040139d0 con 0x7f86080fcd50 2023-12-16T03:10:36.410 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.409+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f860804bb80 con 0x7f86080fcd50 2023-12-16T03:10:36.411 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.409+0000 7f85fe7fc700 1 -- 172.21.15.184:0/3853813111 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8604011370 con 0x7f86080fcd50 2023-12-16T03:10:36.411 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:36.411 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:36.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f85f40367c0 msgr2=0x7f85f4038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 --2- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f85f40367c0 0x7f85f4038c70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009990 tx=0x7f85f8006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 msgr2=0x7f860810f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 --2- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 0x7f860810f730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8604009040 tx=0x7f8604009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 shutdown_connections 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 --2- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f85f40367c0 0x7f85f4038c70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 --2- 172.21.15.184:0/3853813111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86080fcd50 0x7f860810f730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 >> 172.21.15.184:0/3853813111 conn(0x7f86080f65d0 msgr2=0x7f86080f7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 shutdown_connections 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:36.411+0000 7f861019d700 1 -- 172.21.15.184:0/3853813111 wait complete. 2023-12-16T03:10:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:36.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:36 smithi064 ceph-mon[111958]: mgrmap e17: smithi064.ueciyw(active, since 2s) 2023-12-16T03:10:36.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:36 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:36.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:36 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/3853813111' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:10:37.960 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:37.960 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:38.373 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:10:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:10:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:10:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:10:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:10:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:10:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:38.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:38.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:38.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:38.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:38.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:10:38.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T03:10:38.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:39.507 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.505+0000 7f5f5eddb700 1 -- 172.21.15.184:0/815408699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 msgr2=0x7f5f58102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:39.507 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.505+0000 7f5f5eddb700 1 --2- 172.21.15.184:0/815408699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 0x7f5f58102ca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5f480048c0 tx=0x7f5f48009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:39.507 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.505+0000 7f5f5eddb700 1 -- 172.21.15.184:0/815408699 shutdown_connections 2023-12-16T03:10:39.507 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.505+0000 7f5f5eddb700 1 --2- 172.21.15.184:0/815408699 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 0x7f5f58102ca0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.505+0000 7f5f5eddb700 1 -- 172.21.15.184:0/815408699 >> 172.21.15.184:0/815408699 conn(0x7f5f580f8410 msgr2=0x7f5f580fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.505+0000 7f5f5eddb700 1 -- 172.21.15.184:0/815408699 shutdown_connections 2023-12-16T03:10:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.505+0000 7f5f5eddb700 1 -- 172.21.15.184:0/815408699 wait complete. 2023-12-16T03:10:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.505+0000 7f5f5eddb700 1 Processor -- start 2023-12-16T03:10:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.505+0000 7f5f5eddb700 1 -- start start 2023-12-16T03:10:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.506+0000 7f5f5eddb700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 0x7f5f58112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:39.508 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.506+0000 7f5f5eddb700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f581130b0 con 0x7f5f581028d0 2023-12-16T03:10:39.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.506+0000 7f5f5cb77700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 0x7f5f58112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:39.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.506+0000 7f5f5cb77700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 0x7f5f58112b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:46976/0 (socket says 172.21.15.184:46976) 2023-12-16T03:10:39.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.506+0000 7f5f5cb77700 1 -- 172.21.15.184:0/4092370854 learned_addr learned my addr 172.21.15.184:0/4092370854 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:39.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.506+0000 7f5f5cb77700 1 -- 172.21.15.184:0/4092370854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48005040 con 0x7f5f581028d0 2023-12-16T03:10:39.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.506+0000 7f5f5cb77700 1 --2- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 0x7f5f58112b70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009040 tx=0x7f5f48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:39.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.507+0000 7f5f557fa700 1 -- 172.21.15.184:0/4092370854 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f48004e60 con 0x7f5f581028d0 2023-12-16T03:10:39.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.507+0000 7f5f557fa700 1 -- 172.21.15.184:0/4092370854 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f48009650 con 0x7f5f581028d0 2023-12-16T03:10:39.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.507+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f581132b0 con 0x7f5f581028d0 2023-12-16T03:10:39.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.507+0000 7f5f557fa700 1 -- 172.21.15.184:0/4092370854 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f4801c3f0 con 0x7f5f581028d0 2023-12-16T03:10:39.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.507+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5810ca30 con 0x7f5f581028d0 2023-12-16T03:10:39.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.508+0000 7f5f557fa700 1 -- 172.21.15.184:0/4092370854 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f5f4801c6b0 con 0x7f5f581028d0 2023-12-16T03:10:39.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.508+0000 7f5f557fa700 1 --2- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5f400367c0 0x7f5f40038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:39.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.508+0000 7f5f557fa700 1 -- 172.21.15.184:0/4092370854 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5f48049a90 con 0x7f5f581028d0 2023-12-16T03:10:39.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.508+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5805f270 con 0x7f5f581028d0 2023-12-16T03:10:39.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.508+0000 7f5f57fff700 1 --2- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5f400367c0 0x7f5f40038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:39.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.508+0000 7f5f57fff700 1 --2- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5f400367c0 0x7f5f40038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009990 tx=0x7f5f4c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:39.515 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.513+0000 7f5f557fa700 1 -- 172.21.15.184:0/4092370854 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5f48025400 con 0x7f5f581028d0 2023-12-16T03:10:39.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:39 smithi064 ceph-mon[111958]: Deploying daemon crash.smithi184 on smithi184 2023-12-16T03:10:39.811 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.809+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5f5810e150 con 0x7f5f581028d0 2023-12-16T03:10:39.811 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.810+0000 7f5f557fa700 1 -- 172.21.15.184:0/4092370854 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5f48034090 con 0x7f5f581028d0 2023-12-16T03:10:39.812 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:39.812 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5f400367c0 msgr2=0x7f5f40038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 --2- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5f400367c0 0x7f5f40038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009990 tx=0x7f5f4c006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 msgr2=0x7f5f58112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 --2- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 0x7f5f58112b70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009040 tx=0x7f5f48009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 shutdown_connections 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 --2- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5f400367c0 0x7f5f40038c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 --2- 172.21.15.184:0/4092370854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f581028d0 0x7f5f58112b70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 >> 172.21.15.184:0/4092370854 conn(0x7f5f580f8410 msgr2=0x7f5f581049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 shutdown_connections 2023-12-16T03:10:39.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:39.812+0000 7f5f5eddb700 1 -- 172.21.15.184:0/4092370854 wait complete. 2023-12-16T03:10:39.815 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:40 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/4092370854' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:40 smithi064 ceph-mon[111958]: Deploying daemon node-exporter.smithi184 on smithi184 2023-12-16T03:10:41.215 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:41.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:41.774 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:42.998 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.996+0000 7f2a69656700 1 -- 172.21.15.184:0/2262929436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 msgr2=0x7f2a640fb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:42.998 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.996+0000 7f2a69656700 1 --2- 172.21.15.184:0/2262929436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 0x7f2a640fb420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2a540048c0 tx=0x7f2a54009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:42.998 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.996+0000 7f2a69656700 1 -- 172.21.15.184:0/2262929436 shutdown_connections 2023-12-16T03:10:42.998 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.996+0000 7f2a69656700 1 --2- 172.21.15.184:0/2262929436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 0x7f2a640fb420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:42.999 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.996+0000 7f2a69656700 1 -- 172.21.15.184:0/2262929436 >> 172.21.15.184:0/2262929436 conn(0x7f2a64071d60 msgr2=0x7f2a64072160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:42.999 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.996+0000 7f2a69656700 1 -- 172.21.15.184:0/2262929436 shutdown_connections 2023-12-16T03:10:42.999 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.996+0000 7f2a69656700 1 -- 172.21.15.184:0/2262929436 wait complete. 2023-12-16T03:10:42.999 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.997+0000 7f2a69656700 1 Processor -- start 2023-12-16T03:10:42.999 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.997+0000 7f2a69656700 1 -- start start 2023-12-16T03:10:42.999 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.997+0000 7f2a69656700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 0x7f2a64112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:42.999 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.997+0000 7f2a69656700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64113110 con 0x7f2a640fb050 2023-12-16T03:10:43.000 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.997+0000 7f2a62ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 0x7f2a64112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.997+0000 7f2a62ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 0x7f2a64112bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:46990/0 (socket says 172.21.15.184:46990) 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.997+0000 7f2a62ffd700 1 -- 172.21.15.184:0/701344242 learned_addr learned my addr 172.21.15.184:0/701344242 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.998+0000 7f2a62ffd700 1 -- 172.21.15.184:0/701344242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54005040 con 0x7f2a640fb050 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.998+0000 7f2a62ffd700 1 --2- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 0x7f2a64112bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009300 tx=0x7f2a54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.998+0000 7f2a4b7fe700 1 -- 172.21.15.184:0/701344242 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a54004e60 con 0x7f2a640fb050 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.998+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a64113310 con 0x7f2a640fb050 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.998+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a64113780 con 0x7f2a640fb050 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.998+0000 7f2a4b7fe700 1 -- 172.21.15.184:0/701344242 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a54013420 con 0x7f2a640fb050 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.998+0000 7f2a4b7fe700 1 -- 172.21.15.184:0/701344242 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a540255c0 con 0x7f2a640fb050 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.999+0000 7f2a4b7fe700 1 -- 172.21.15.184:0/701344242 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f2a5401c3f0 con 0x7f2a640fb050 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.999+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a500052e0 con 0x7f2a640fb050 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.999+0000 7f2a4b7fe700 1 --2- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a4c036770 0x7f2a4c038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:43.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.999+0000 7f2a4b7fe700 1 -- 172.21.15.184:0/701344242 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2a54049920 con 0x7f2a640fb050 2023-12-16T03:10:43.002 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:42.999+0000 7f2a627fc700 1 --2- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a4c036770 0x7f2a4c038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:43.002 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.000+0000 7f2a627fc700 1 --2- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a4c036770 0x7f2a4c038c20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009990 tx=0x7f2a58006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:43.005 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.004+0000 7f2a4b7fe700 1 -- 172.21.15.184:0/701344242 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2a5401cc20 con 0x7f2a640fb050 2023-12-16T03:10:43.282 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.280+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2a50005590 con 0x7f2a640fb050 2023-12-16T03:10:43.282 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.281+0000 7f2a4b7fe700 1 -- 172.21.15.184:0/701344242 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2a54011370 con 0x7f2a640fb050 2023-12-16T03:10:43.282 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:43.283 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a4c036770 msgr2=0x7f2a4c038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 --2- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a4c036770 0x7f2a4c038c20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009990 tx=0x7f2a58006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 msgr2=0x7f2a64112bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 --2- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 0x7f2a64112bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009300 tx=0x7f2a54009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 shutdown_connections 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 --2- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a4c036770 0x7f2a4c038c20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 --2- 172.21.15.184:0/701344242 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a640fb050 0x7f2a64112bd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 >> 172.21.15.184:0/701344242 conn(0x7f2a64071d60 msgr2=0x7f2a64100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 shutdown_connections 2023-12-16T03:10:43.285 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:43.283+0000 7f2a69656700 1 -- 172.21.15.184:0/701344242 wait complete. 2023-12-16T03:10:43.286 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:10:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-16T03:10:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:10:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:43 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/701344242' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:44.662 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:44.662 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:44.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:44 smithi064 ceph-mon[111958]: Deploying daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:10:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:46.151 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.148+0000 7f211d844700 1 -- 172.21.15.184:0/1987115363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 msgr2=0x7f2118102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:46.151 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.148+0000 7f211d844700 1 --2- 172.21.15.184:0/1987115363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 0x7f2118102cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f21080048c0 tx=0x7f2108009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.148+0000 7f211d844700 1 -- 172.21.15.184:0/1987115363 shutdown_connections 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.148+0000 7f211d844700 1 --2- 172.21.15.184:0/1987115363 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 0x7f2118102cc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.148+0000 7f211d844700 1 -- 172.21.15.184:0/1987115363 >> 172.21.15.184:0/1987115363 conn(0x7f21180715e0 msgr2=0x7f21180719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.149+0000 7f211d844700 1 -- 172.21.15.184:0/1987115363 shutdown_connections 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.149+0000 7f211d844700 1 -- 172.21.15.184:0/1987115363 wait complete. 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.149+0000 7f211d844700 1 Processor -- start 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.149+0000 7f211d844700 1 -- start start 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.149+0000 7f211d844700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 0x7f2118112b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.149+0000 7f211d844700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118113090 con 0x7f21181028f0 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.150+0000 7f2116ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 0x7f2118112b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.150+0000 7f2116ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 0x7f2118112b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.184:49874/0 (socket says 172.21.15.184:49874) 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.150+0000 7f2116ffd700 1 -- 172.21.15.184:0/1945724343 learned_addr learned my addr 172.21.15.184:0/1945724343 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:46.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.150+0000 7f2116ffd700 1 -- 172.21.15.184:0/1945724343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108005040 con 0x7f21181028f0 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.150+0000 7f2116ffd700 1 --2- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 0x7f2118112b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2108009300 tx=0x7f2108009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.150+0000 7f20ff7fe700 1 -- 172.21.15.184:0/1945724343 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2108004e60 con 0x7f21181028f0 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.150+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2118113290 con 0x7f21181028f0 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.150+0000 7f20ff7fe700 1 -- 172.21.15.184:0/1945724343 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2108013420 con 0x7f21181028f0 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.151+0000 7f20ff7fe700 1 -- 172.21.15.184:0/1945724343 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f210801c5b0 con 0x7f21181028f0 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.151+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211810ca10 con 0x7f21181028f0 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.151+0000 7f20ff7fe700 1 -- 172.21.15.184:0/1945724343 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f210801c7f0 con 0x7f21181028f0 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.151+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211805f270 con 0x7f21181028f0 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.152+0000 7f20ff7fe700 1 --2- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f21000367c0 0x7f2100038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:46.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.152+0000 7f20ff7fe700 1 -- 172.21.15.184:0/1945724343 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2108049b70 con 0x7f21181028f0 2023-12-16T03:10:46.155 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.152+0000 7f21167fc700 1 --2- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f21000367c0 0x7f2100038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:46.155 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.152+0000 7f21167fc700 1 --2- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f21000367c0 0x7f2100038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f210c009990 tx=0x7f210c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:46.158 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.157+0000 7f20ff7fe700 1 -- 172.21.15.184:0/1945724343 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2108023300 con 0x7f21181028f0 2023-12-16T03:10:46.436 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.435+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f211804bbe0 con 0x7f21181028f0 2023-12-16T03:10:46.437 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.435+0000 7f20ff7fe700 1 -- 172.21.15.184:0/1945724343 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2108011b60 con 0x7f21181028f0 2023-12-16T03:10:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:46.437 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:08:50.814975Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T03:10:46.439 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.437+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f21000367c0 msgr2=0x7f2100038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:46.439 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.437+0000 7f211d844700 1 --2- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f21000367c0 0x7f2100038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f210c009990 tx=0x7f210c006e40 comp rx=0 tx=0).stop 2023-12-16T03:10:46.439 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.437+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 msgr2=0x7f2118112b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:46.439 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.437+0000 7f211d844700 1 --2- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 0x7f2118112b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2108009300 tx=0x7f2108009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:46.439 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.437+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 shutdown_connections 2023-12-16T03:10:46.439 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.437+0000 7f211d844700 1 --2- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f21000367c0 0x7f2100038c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:46.440 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.437+0000 7f211d844700 1 --2- 172.21.15.184:0/1945724343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21181028f0 0x7f2118112b50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:46.440 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.437+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 >> 172.21.15.184:0/1945724343 conn(0x7f21180715e0 msgr2=0x7f2118103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:46.440 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.438+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 shutdown_connections 2023-12-16T03:10:46.440 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:46.438+0000 7f211d844700 1 -- 172.21.15.184:0/1945724343 wait complete. 2023-12-16T03:10:46.440 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-12-16T03:10:46.441 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:46 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:46.441 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:46 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:46.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:46 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:46.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:46 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:46.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:46 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:10:46.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:46 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:46.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:46 smithi064 ceph-mon[111958]: Deploying daemon mon.smithi184 on smithi184 2023-12-16T03:10:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:47 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/1945724343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:47.879 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T03:10:47.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T03:10:48.056 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:47 smithi184 systemd[1]: Starting Ceph mon.smithi184 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:10:48.172 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi184/config 2023-12-16T03:10:48.308 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T03:10:48.308 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable), process ceph-mon, pid 7 2023-12-16T03:10:48.308 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pidfile_write: ignore empty --pid-file 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 bash[121120]: f54881c252b6c0ae489bf059093281185b6f9d08167f209f0f6ad1d2d28a5dc4 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: load: jerasure load: lrc 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: RocksDB version: 6.15.5 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Compile date Dec 13 2023 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: DB SUMMARY 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: DB Session ID: P7HP3HIYXCP7DXZISTQG 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: CURRENT file: CURRENT 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi184/store.db dir, Total Num: 0, files: 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi184/store.db: 000004.log size: 511 ; 2023-12-16T03:10:48.309 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.error_if_exists: 0 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.create_if_missing: 0 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.paranoid_checks: 1 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.env: 0x55705447ea80 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.fs: Posix File System 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.info_log: 0x557055c12780 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.statistics: (nil) 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.use_fsync: 0 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_log_file_size: 0 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T03:10:48.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.allow_fallocate: 1 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.use_direct_reads: 0 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.db_log_dir: 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi184/store.db 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T03:10:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.write_buffer_manager: 0x5570569829f0 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.unordered_write: 0 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.row_cache: None 2023-12-16T03:10:48.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.wal_filter: None 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.preserve_deletes: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.two_write_queues: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.atomic_flush: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.log_readahead_size: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T03:10:48.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_background_jobs: 2 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_background_compactions: -1 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_subcompactions: 1 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_open_files: -1 2023-12-16T03:10:48.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_background_flushes: -1 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Compression algorithms supported: 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: kZSTD supported: 0 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: kXpressCompression supported: 0 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: kZlibCompression supported: 1 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: kSnappyCompression supported: 1 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: kLZ4Compression supported: 1 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: kBZip2Compression supported: 0 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T03:10:48.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi184/store.db/MANIFEST-000003 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.merge_operator: 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_filter: None 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557055c62f90) 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: cache_index_and_filter_blocks: 1 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: pin_top_level_index_and_filter: 1 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: index_type: 0 2023-12-16T03:10:48.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: data_block_index_type: 0 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: index_shortening: 1 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: hash_index_allow_collision: 1 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: checksum: 1 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: no_block_cache: 0 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache: 0x557055c95090 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache_name: BinnedLRUCache 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache_options: 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: capacity : 536870912 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: num_shard_bits : 4 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: strict_capacity_limit : 0 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: high_pri_pool_ratio: 0.000 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache_compressed: (nil) 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: persistent_cache: (nil) 2023-12-16T03:10:48.317 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_size: 4096 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_size_deviation: 10 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_restart_interval: 16 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: index_block_restart_interval: 1 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: metadata_block_size: 4096 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: partition_filters: 0 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: use_delta_encoding: 1 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: whole_key_filtering: 1 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: verify_compression: 0 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: read_amp_bytes_per_bit: 0 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: format_version: 4 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: enable_index_compression: 1 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_align: 0 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T03:10:48.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compression: NoCompression 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.num_levels: 7 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 systemd[1]: Started Ceph mon.smithi184 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T03:10:48.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T03:10:48.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.arena_block_size: 4194304 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T03:10:48.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-16T03:10:48.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T03:10:48.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T03:10:48.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T03:10:48.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T03:10:48.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T03:10:48.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T03:10:48.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T03:10:48.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T03:10:48.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T03:10:48.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.table_properties_collectors: 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.inplace_update_support: 0 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.bloom_locality: 0 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.max_successive_merges: 0 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.ttl: 2592000 2023-12-16T03:10:48.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.enable_blob_files: false 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.min_blob_size: 0 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi184/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696248065383, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696248065788, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702696248, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "6834e8d2-18e7-4019-bd9a-46012b4c6222", "db_session_id": "P7HP3HIYXCP7DXZISTQG"}} 2023-12-16T03:10:48.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696248066221, "job": 1, "event": "recovery_finished"} 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi184/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x557055c29180 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: DB pointer 0x557055cfe000 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** DB Stats ** 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-16T03:10:48.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** Compaction Stats [default] ** 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** Compaction Stats [default] ** 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T03:10:48.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative compaction: 0.00 GB write, 0.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval compaction: 0.00 GB write, 0.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** Compaction Stats [default] ** 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-12-16T03:10:48.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** Compaction Stats [default] ** 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative compaction: 0.00 GB write, 0.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T03:10:48.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184 does not exist in monmap, will attempt to join an existing cluster 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: using public_addr v2:172.21.15.184:0/0 -> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: starting mon.smithi184 rank -1 at public addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] at bind addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi184 fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(???) e0 preinit fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).mds e1 new map 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).mds e1 print_map 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: e1 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: legacy client fscid: -1 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: No filesystems configured 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-16T03:10:48.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3251535872' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: osdmap e4: 0 total, 0 up, 0 in 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Deploying daemon grafana.smithi064 on smithi064 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi064:172.21.15.64=smithi064;smithi184:172.21.15.184=smithi184", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Saving service mon spec with placement smithi064:172.21.15.64=smithi064;smithi184:172.21.15.184=smithi184;count:2 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/991067664' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/2890333047' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/2338984883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Deploying daemon prometheus.smithi064 on smithi064 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/2095765290' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/1563424263' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/3684378612' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14162 172.21.15.64:0/1053692135' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mgrmap e14: smithi064.ueciyw(active, since 42s) 2023-12-16T03:10:48.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/1988820182' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/3931738565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Active manager daemon smithi064.ueciyw restarted 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Activating manager daemon smithi064.ueciyw 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mgrmap e15: smithi064.ueciyw(active, starting, since 0.00368245s) 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Manager daemon smithi064.ueciyw is now available 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/trash_purge_schedule"}]: dispatch 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/2508072152' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mgrmap e16: smithi064.ueciyw(active, since 1.005s) 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: [16/Dec/2023:03:10:33] ENGINE Bus STARTING 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: [16/Dec/2023:03:10:33] ENGINE Serving on https://172.21.15.64:7150 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: [16/Dec/2023:03:10:33] ENGINE Bus STARTED 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mgrmap e17: smithi064.ueciyw(active, since 2s) 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/3853813111' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:48.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Deploying daemon crash.smithi184 on smithi184 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.338 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/4092370854' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Deploying daemon node-exporter.smithi184 on smithi184 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/701344242' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.339 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Deploying daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: Deploying daemon mon.smithi184 on smithi184 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/1945724343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-16T03:10:48.340 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:48 smithi184 ceph-mon[121180]: mon.smithi184@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-16T03:10:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:10:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: mon.smithi064 calling monitor election 2023-12-16T03:10:53.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: mon.smithi184 calling monitor election 2023-12-16T03:10:53.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/480296933' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:10:53.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:53.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: mon.smithi064 is new leader, mons smithi064,smithi184 in quorum (ranks 0,1) 2023-12-16T03:10:53.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: monmap e2: 2 mons at {smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T03:10:53.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: fsmap 2023-12-16T03:10:53.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T03:10:53.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: mgrmap e17: smithi064.ueciyw(active, since 20s) 2023-12-16T03:10:53.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:10:53.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/480296933' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:10:53.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: overall HEALTH_OK 2023-12-16T03:10:53.563 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/480296933' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:10:53.563 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/480296933' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:10:53.563 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:53.563 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:53.595 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.593+0000 7f75faee8700 1 -- 172.21.15.184:0/619825751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e4003580 msgr2=0x7f75e4005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:53.595 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.593+0000 7f75faee8700 1 --2- 172.21.15.184:0/619825751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e4003580 0x7f75e4005a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f75f4065c50 tx=0x7f75e8002040 comp rx=0 tx=0).stop 2023-12-16T03:10:53.595 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.593+0000 7f75faee8700 1 -- 172.21.15.184:0/619825751 shutdown_connections 2023-12-16T03:10:53.595 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.593+0000 7f75faee8700 1 --2- 172.21.15.184:0/619825751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75e4003580 0x7f75e4005a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:53.596 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.593+0000 7f75faee8700 1 -- 172.21.15.184:0/619825751 >> 172.21.15.184:0/619825751 conn(0x7f75f40f73f0 msgr2=0x7f75f40f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:53.596 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.593+0000 7f75faee8700 1 -- 172.21.15.184:0/619825751 shutdown_connections 2023-12-16T03:10:53.596 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.593+0000 7f75faee8700 1 -- 172.21.15.184:0/619825751 wait complete. 2023-12-16T03:10:53.596 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75faee8700 1 Processor -- start 2023-12-16T03:10:53.596 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75faee8700 1 -- start start 2023-12-16T03:10:53.597 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75faee8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 0x7f75f4112d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:53.597 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75faee8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f41132d0 0x7f75f410cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:53.597 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75faee8700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f41138e0 con 0x7f75f41132d0 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75faee8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f410d170 con 0x7f75e4003580 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75f8c84700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 0x7f75f4112d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75f8c84700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 0x7f75f4112d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45212/0 (socket says 172.21.15.184:45212) 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75f8c84700 1 -- 172.21.15.184:0/3769910786 learned_addr learned my addr 172.21.15.184:0/3769910786 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75f3fff700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f41132d0 0x7f75f410cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75f8c84700 1 -- 172.21.15.184:0/3769910786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 msgr2=0x7f75f4112d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.594+0000 7f75f8c84700 1 -- 172.21.15.184:0/3769910786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 msgr2=0x7f75f4112d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75f8c84700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 0x7f75f4112d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75f8c84700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 0x7f75f4112d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75f3fff700 1 -- 172.21.15.184:0/3769910786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 msgr2=0x7f75f4112d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75f3fff700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 0x7f75f4112d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75f3fff700 1 -- 172.21.15.184:0/3769910786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e8005040 con 0x7f75f41132d0 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75f3fff700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f41132d0 0x7f75f410cc30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75e000b790 tx=0x7f75e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:53.598 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75f17fa700 1 -- 172.21.15.184:0/3769910786 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e0011810 con 0x7f75f41132d0 2023-12-16T03:10:53.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75f17fa700 1 -- 172.21.15.184:0/3769910786 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75e0011e20 con 0x7f75f41132d0 2023-12-16T03:10:53.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f410d450 con 0x7f75f41132d0 2023-12-16T03:10:53.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75f17fa700 1 -- 172.21.15.184:0/3769910786 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e000f2e0 con 0x7f75f41132d0 2023-12-16T03:10:53.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.595+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f410d990 con 0x7f75f41132d0 2023-12-16T03:10:53.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.596+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f405f270 con 0x7f75f41132d0 2023-12-16T03:10:53.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.597+0000 7f75f17fa700 1 -- 172.21.15.184:0/3769910786 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f75e0010380 con 0x7f75f41132d0 2023-12-16T03:10:53.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.597+0000 7f75f17fa700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f75d8068fe0 0x7f75d806b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:53.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.598+0000 7f75f17fa700 1 -- 172.21.15.184:0/3769910786 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f75e0085fe0 con 0x7f75f41132d0 2023-12-16T03:10:53.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.598+0000 7f75f8c84700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f75d8068fe0 0x7f75d806b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:53.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.598+0000 7f75f8c84700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f75d8068fe0 0x7f75d806b490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75e80047e0 tx=0x7f75e8019040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:53.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.603+0000 7f75f17fa700 1 -- 172.21.15.184:0/3769910786 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f75e0056fa0 con 0x7f75f41132d0 2023-12-16T03:10:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:10:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: mon.smithi064 calling monitor election 2023-12-16T03:10:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: mon.smithi184 calling monitor election 2023-12-16T03:10:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/480296933' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: mon.smithi064 is new leader, mons smithi064,smithi184 in quorum (ranks 0,1) 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: monmap e2: 2 mons at {smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: fsmap 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: mgrmap e17: smithi064.ueciyw(active, since 20s) 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/480296933' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: overall HEALTH_OK 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/480296933' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/480296933' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:53.886 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.884+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f75f41045b0 con 0x7f75f41132d0 2023-12-16T03:10:53.886 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.885+0000 7f75f17fa700 1 -- 172.21.15.184:0/3769910786 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f75e0015090 con 0x7f75f41132d0 2023-12-16T03:10:53.887 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-16T03:10:53.887 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":2,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","modified":"2023-12-16T03:10:48.097424Z","created":"2023-12-16T03:08:50.814975Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi184","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-16T03:10:53.889 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f75d8068fe0 msgr2=0x7f75d806b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:53.889 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f75d8068fe0 0x7f75d806b490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75e80047e0 tx=0x7f75e8019040 comp rx=0 tx=0).stop 2023-12-16T03:10:53.889 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f41132d0 msgr2=0x7f75f410cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:53.889 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f41132d0 0x7f75f410cc30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75e000b790 tx=0x7f75e00091a0 comp rx=0 tx=0).stop 2023-12-16T03:10:53.889 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 shutdown_connections 2023-12-16T03:10:53.889 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f75d8068fe0 0x7f75d806b490 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:53.889 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75e4003580 0x7f75f4112d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:53.889 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 --2- 172.21.15.184:0/3769910786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f41132d0 0x7f75f410cc30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:53.889 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 >> 172.21.15.184:0/3769910786 conn(0x7f75f40f73f0 msgr2=0x7f75f40fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:53.890 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 shutdown_connections 2023-12-16T03:10:53.890 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:10:53.887+0000 7f75faee8700 1 -- 172.21.15.184:0/3769910786 wait complete. 2023-12-16T03:10:53.890 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 2 2023-12-16T03:10:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:54 smithi184 ceph-mon[121180]: mgrmap e18: smithi064.ueciyw(active, since 20s), standbys: smithi184.urtxla 2023-12-16T03:10:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi184.urtxla", "id": "smithi184.urtxla"}]: dispatch 2023-12-16T03:10:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:10:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:54 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/3769910786' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:54 smithi064 ceph-mon[111958]: mgrmap e18: smithi064.ueciyw(active, since 20s), standbys: smithi184.urtxla 2023-12-16T03:10:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi184.urtxla", "id": "smithi184.urtxla"}]: dispatch 2023-12-16T03:10:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:10:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:54 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/3769910786' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T03:10:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:10:54.733 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-16T03:10:54.734 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph config generate-minimal-conf 2023-12-16T03:10:55.041 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:10:55.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:55 smithi184 ceph-mon[121180]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:55.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:55 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:55.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:55 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:55.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:55 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:55.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:55 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:10:55.647 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:55 smithi064 ceph-mon[111958]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:55.647 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:55 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:55.647 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:55 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:55.647 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:55 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:55.647 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:55 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:10:56.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.226+0000 7f559cf4b700 1 -- 172.21.15.64:0/2464255829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 msgr2=0x7f5598101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.226+0000 7f559cf4b700 1 --2- 172.21.15.64:0/2464255829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 0x7f5598101ba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55880048c0 tx=0x7f5588009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.226+0000 7f559cf4b700 1 -- 172.21.15.64:0/2464255829 shutdown_connections 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.226+0000 7f559cf4b700 1 --2- 172.21.15.64:0/2464255829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 0x7f5598101ba0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.226+0000 7f559cf4b700 1 -- 172.21.15.64:0/2464255829 >> 172.21.15.64:0/2464255829 conn(0x7f55980f7310 msgr2=0x7f55980f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.226+0000 7f559cf4b700 1 -- 172.21.15.64:0/2464255829 shutdown_connections 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.226+0000 7f559cf4b700 1 -- 172.21.15.64:0/2464255829 wait complete. 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.226+0000 7f559cf4b700 1 Processor -- start 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.226+0000 7f559cf4b700 1 -- start start 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559cf4b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 0x7f5598112d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559cf4b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5598113240 0x7f559810cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559cf4b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5598113850 con 0x7f55981017d0 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559cf4b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559810d0e0 con 0x7f5598113240 2023-12-16T03:10:56.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 0x7f5598112d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:56.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 0x7f5598112d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57104/0 (socket says 172.21.15.64:57104) 2023-12-16T03:10:56.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559659c700 1 -- 172.21.15.64:0/2333199084 learned_addr learned my addr 172.21.15.64:0/2333199084 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:10:56.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559659c700 1 -- 172.21.15.64:0/2333199084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5598113240 msgr2=0x7f559810cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:56.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f5595d9b700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5598113240 0x7f559810cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559659c700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5598113240 0x7f559810cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559659c700 1 -- 172.21.15.64:0/2333199084 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588005040 con 0x7f55981017d0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f5595d9b700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5598113240 0x7f559810cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f559659c700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 0x7f5598112d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f558800bfe0 tx=0x7f5588009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f5586ffd700 1 -- 172.21.15.64:0/2333199084 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f558800e040 con 0x7f55981017d0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f5586ffd700 1 -- 172.21.15.64:0/2333199084 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5588013420 con 0x7f55981017d0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.227+0000 7f5586ffd700 1 -- 172.21.15.64:0/2333199084 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f558801c630 con 0x7f55981017d0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.228+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559810d360 con 0x7f55981017d0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.228+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559810d920 con 0x7f55981017d0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.229+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559805f270 con 0x7f55981017d0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.229+0000 7f5586ffd700 1 -- 172.21.15.64:0/2333199084 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f55880139e0 con 0x7f55981017d0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.229+0000 7f5586ffd700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5580069030 0x7f558006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.229+0000 7f5586ffd700 1 -- 172.21.15.64:0/2333199084 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5588086f20 con 0x7f55981017d0 2023-12-16T03:10:56.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.229+0000 7f5595d9b700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5580069030 0x7f558006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:10:56.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.230+0000 7f5595d9b700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5580069030 0x7f558006b4e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f558c0079f0 tx=0x7f558c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:10:56.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.234+0000 7f5586ffd700 1 -- 172.21.15.64:0/2333199084 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5588058000 con 0x7f55981017d0 2023-12-16T03:10:56.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.440+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5598105980 con 0x7f55981017d0 2023-12-16T03:10:56.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.440+0000 7f5586ffd700 1 -- 172.21.15.64:0/2333199084 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f5588057b90 con 0x7f55981017d0 2023-12-16T03:10:56.442 INFO:teuthology.orchestra.run.smithi064.stdout:# minimal ceph.conf for 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:10:56.443 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2023-12-16T03:10:56.443 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:10:56.443 INFO:teuthology.orchestra.run.smithi064.stdout: mon_host = [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2023-12-16T03:10:56.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5580069030 msgr2=0x7f558006b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:56.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5580069030 0x7f558006b4e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f558c0079f0 tx=0x7f558c008040 comp rx=0 tx=0).stop 2023-12-16T03:10:56.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 msgr2=0x7f5598112d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:10:56.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 0x7f5598112d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f558800bfe0 tx=0x7f5588009e30 comp rx=0 tx=0).stop 2023-12-16T03:10:56.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 shutdown_connections 2023-12-16T03:10:56.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5580069030 0x7f558006b4e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:56.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55981017d0 0x7f5598112d00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:56.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 --2- 172.21.15.64:0/2333199084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5598113240 0x7f559810cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:10:56.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 >> 172.21.15.64:0/2333199084 conn(0x7f55980f7310 msgr2=0x7f55980ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:10:56.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 shutdown_connections 2023-12-16T03:10:56.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:10:56.442+0000 7f559cf4b700 1 -- 172.21.15.64:0/2333199084 wait complete. 2023-12-16T03:10:56.469 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:10:56.469 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:10:56.469 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:56.469 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:56.469 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.469 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.470 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.470 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.470 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.470 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: Reconfiguring mon.smithi064 (unknown last config time)... 2023-12-16T03:10:56.470 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:10:56.470 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:10:56.470 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:56.470 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:56 smithi064 ceph-mon[111958]: Reconfiguring daemon mon.smithi064 on smithi064 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: Reconfiguring mon.smithi064 (unknown last config time)... 2023-12-16T03:10:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:10:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:10:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:56 smithi184 ceph-mon[121180]: Reconfiguring daemon mon.smithi064 on smithi064 2023-12-16T03:10:56.965 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-16T03:10:56.965 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:10:56.966 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.conf 2023-12-16T03:10:56.996 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:10:56.996 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:10:57.066 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:10:57.066 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.conf 2023-12-16T03:10:57.103 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:10:57.103 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:10:57.174 INFO:tasks.cephadm:Deploying OSDs... 2023-12-16T03:10:57.174 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:10:57.175 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T03:10:57.193 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T03:10:57.193 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2023-12-16T03:10:57.252 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T03:10:57.252 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:10:57.252 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 390012 Links: 1 2023-12-16T03:10:57.252 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:10:57.252 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:10:57.252 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-12-16 03:10:23.903562382 +0000 2023-12-16T03:10:57.253 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-12-16 03:03:38.139927284 +0000 2023-12-16T03:10:57.253 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-12-16 03:03:38.139927284 +0000 2023-12-16T03:10:57.253 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: - 2023-12-16T03:10:57.253 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T03:10:57.321 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-12-16T03:10:57.322 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-12-16T03:10:57.322 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000207845 s, 2.5 MB/s 2023-12-16T03:10:57.323 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T03:10:57.383 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2023-12-16T03:10:57.441 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T03:10:57.441 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:10:57.441 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 391031 Links: 1 2023-12-16T03:10:57.442 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:10:57.442 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:10:57.442 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-12-16 03:10:23.903562382 +0000 2023-12-16T03:10:57.442 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-12-16 03:03:38.654917209 +0000 2023-12-16T03:10:57.442 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-12-16 03:03:38.654917209 +0000 2023-12-16T03:10:57.442 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: - 2023-12-16T03:10:57.442 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T03:10:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-12-16T03:10:57.507 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-12-16T03:10:57.508 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000189344 s, 2.7 MB/s 2023-12-16T03:10:57.508 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T03:10:57.569 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2023-12-16T03:10:57.627 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T03:10:57.627 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:10:57.627 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 394710 Links: 1 2023-12-16T03:10:57.627 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:10:57.627 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:10:57.627 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-12-16 03:10:23.903562382 +0000 2023-12-16T03:10:57.627 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-12-16 03:03:39.167907174 +0000 2023-12-16T03:10:57.627 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-12-16 03:03:39.167907174 +0000 2023-12-16T03:10:57.627 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: - 2023-12-16T03:10:57.628 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T03:10:57.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:57 smithi064 ceph-mon[111958]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:57 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2333199084' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.ueciyw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:10:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:10:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:57.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-12-16T03:10:57.695 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-12-16T03:10:57.695 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000211736 s, 2.4 MB/s 2023-12-16T03:10:57.696 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T03:10:57.757 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2023-12-16T03:10:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:57 smithi184 ceph-mon[121180]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:57 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2333199084' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.ueciyw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:10:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:10:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:57.818 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T03:10:57.818 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:10:57.819 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 394849 Links: 1 2023-12-16T03:10:57.819 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:10:57.819 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:10:57.819 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-12-16 03:10:23.903562382 +0000 2023-12-16T03:10:57.819 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-12-16 03:03:39.666897413 +0000 2023-12-16T03:10:57.819 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-12-16 03:03:39.666897413 +0000 2023-12-16T03:10:57.819 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: - 2023-12-16T03:10:57.819 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T03:10:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-12-16T03:10:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-12-16T03:10:57.887 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000225603 s, 2.3 MB/s 2023-12-16T03:10:57.888 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T03:10:57.949 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:10:57.949 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T03:10:57.972 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T03:10:57.972 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2023-12-16T03:10:58.033 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T03:10:58.034 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:10:58.034 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 391956 Links: 1 2023-12-16T03:10:58.034 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:10:58.034 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:10:58.034 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-12-16 03:10:47.682695428 +0000 2023-12-16T03:10:58.034 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-12-16 03:03:38.114015158 +0000 2023-12-16T03:10:58.034 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-12-16 03:03:38.114015158 +0000 2023-12-16T03:10:58.034 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-12-16T03:10:58.034 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T03:10:58.105 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-12-16T03:10:58.105 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-12-16T03:10:58.105 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000213597 s, 2.4 MB/s 2023-12-16T03:10:58.106 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T03:10:58.168 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2023-12-16T03:10:58.227 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T03:10:58.228 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:10:58.228 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 388862 Links: 1 2023-12-16T03:10:58.228 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:10:58.228 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:10:58.228 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-12-16 03:10:47.682695428 +0000 2023-12-16T03:10:58.228 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-12-16 03:03:38.658004072 +0000 2023-12-16T03:10:58.228 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-12-16 03:03:38.658004072 +0000 2023-12-16T03:10:58.228 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-12-16T03:10:58.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T03:10:58.296 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-12-16T03:10:58.296 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-12-16T03:10:58.296 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000212095 s, 2.4 MB/s 2023-12-16T03:10:58.297 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T03:10:58.357 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2023-12-16T03:10:58.416 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T03:10:58.416 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:10:58.416 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 396478 Links: 1 2023-12-16T03:10:58.416 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:10:58.416 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:10:58.417 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-12-16 03:10:47.682695428 +0000 2023-12-16T03:10:58.417 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-12-16 03:03:39.153993964 +0000 2023-12-16T03:10:58.417 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-12-16 03:03:39.153993964 +0000 2023-12-16T03:10:58.417 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-12-16T03:10:58.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T03:10:58.482 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-12-16T03:10:58.483 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-12-16T03:10:58.483 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000219441 s, 2.3 MB/s 2023-12-16T03:10:58.484 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T03:10:58.543 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2023-12-16T03:10:58.601 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T03:10:58.602 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:10:58.602 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 388966 Links: 1 2023-12-16T03:10:58.602 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:10:58.602 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:10:58.602 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-12-16 03:10:47.682695428 +0000 2023-12-16T03:10:58.602 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-12-16 03:03:39.669983449 +0000 2023-12-16T03:10:58.602 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-12-16 03:03:39.669983449 +0000 2023-12-16T03:10:58.602 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-12-16T03:10:58.602 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T03:10:58.665 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:58 smithi184 ceph-mon[121180]: Reconfiguring mgr.smithi064.ueciyw (unknown last config time)... 2023-12-16T03:10:58.665 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:58 smithi184 ceph-mon[121180]: Reconfiguring daemon mgr.smithi064.ueciyw on smithi064 2023-12-16T03:10:58.666 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:58 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:58.666 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:58 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:58.666 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:58 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:58.666 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:58 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:10:58.666 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:58 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:58.667 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-12-16T03:10:58.667 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-12-16T03:10:58.667 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00020317 s, 2.5 MB/s 2023-12-16T03:10:58.668 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T03:10:58.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:58 smithi064 ceph-mon[111958]: Reconfiguring mgr.smithi064.ueciyw (unknown last config time)... 2023-12-16T03:10:58.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:58 smithi064 ceph-mon[111958]: Reconfiguring daemon mgr.smithi064.ueciyw on smithi064 2023-12-16T03:10:58.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:58 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:58.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:58 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:58.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:58 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:58.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:58 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:10:58.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:58 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:10:58.727 INFO:tasks.cephadm:Deploying osd.0 on smithi064 with /dev/vg_nvme/lv_4... 2023-12-16T03:10:58.727 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-16T03:10:58.998 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:10:59.654 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:59 smithi064 ceph-mon[111958]: Reconfiguring crash.smithi064 (monmap changed)... 2023-12-16T03:10:59.655 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:59 smithi064 ceph-mon[111958]: Reconfiguring daemon crash.smithi064 on smithi064 2023-12-16T03:10:59.655 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:59 smithi064 ceph-mon[111958]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:59.655 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:59.655 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:10:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:59 smithi184 ceph-mon[121180]: Reconfiguring crash.smithi064 (monmap changed)... 2023-12-16T03:10:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:59 smithi184 ceph-mon[121180]: Reconfiguring daemon crash.smithi064 on smithi064 2023-12-16T03:10:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:59 smithi184 ceph-mon[121180]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:10:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:10:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:10:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:00.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:00 smithi064 ceph-mon[111958]: Reconfiguring alertmanager.smithi064 (dependencies changed)... 2023-12-16T03:11:00.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:00 smithi064 ceph-mon[111958]: Reconfiguring daemon alertmanager.smithi064 on smithi064 2023-12-16T03:11:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:00 smithi184 ceph-mon[121180]: Reconfiguring alertmanager.smithi064 (dependencies changed)... 2023-12-16T03:11:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:00 smithi184 ceph-mon[121180]: Reconfiguring daemon alertmanager.smithi064 on smithi064 2023-12-16T03:11:01.200 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-16T03:11:01.200 INFO:teuthology.orchestra.run.smithi064.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-16T03:11:01.200 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10+0 records in 2023-12-16T03:11:01.200 INFO:teuthology.orchestra.run.smithi064.stderr:10+0 records out 2023-12-16T03:11:01.200 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110783 s, 947 MB/s 2023-12-16T03:11:01.201 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping successful for: 2023-12-16T03:11:01.621 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:01 smithi064 ceph-mon[111958]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:01.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:01 smithi184 ceph-mon[121180]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:01.985 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi064:vg_nvme/lv_4 2023-12-16T03:11:02.558 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:11:02.687 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:11:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:11:03.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:03 smithi064 ceph-mon[111958]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:03.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:03.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:03.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.772+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/577426909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 msgr2=0x7f2a880fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.772+0000 7f2a8ff4b700 1 --2- 172.21.15.64:0/577426909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 0x7f2a880fd150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c004940 tx=0x7f2a7c009e30 comp rx=0 tx=0).stop 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.772+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/577426909 shutdown_connections 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.772+0000 7f2a8ff4b700 1 --2- 172.21.15.64:0/577426909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 0x7f2a880fd150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.772+0000 7f2a8ff4b700 1 --2- 172.21.15.64:0/577426909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fbaf0 0x7f2a880fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.772+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/577426909 >> 172.21.15.64:0/577426909 conn(0x7f2a880f71b0 msgr2=0x7f2a880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.772+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/577426909 shutdown_connections 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.772+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/577426909 wait complete. 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8ff4b700 1 Processor -- start 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8ff4b700 1 -- start start 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8ff4b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fbaf0 0x7f2a8810c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8ff4b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 0x7f2a8810c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8ff4b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8810cf30 con 0x7f2a880fcd00 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8ff4b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8810d7d0 con 0x7f2a880fbaf0 2023-12-16T03:11:03.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8d4e6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 0x7f2a8810c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:11:03.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8d4e6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 0x7f2a8810c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60016/0 (socket says 172.21.15.64:60016) 2023-12-16T03:11:03.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8d4e6700 1 -- 172.21.15.64:0/708218376 learned_addr learned my addr 172.21.15.64:0/708218376 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:11:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8dce7700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fbaf0 0x7f2a8810c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:11:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8d4e6700 1 -- 172.21.15.64:0/708218376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fbaf0 msgr2=0x7f2a8810c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8d4e6700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fbaf0 0x7f2a8810c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8d4e6700 1 -- 172.21.15.64:0/708218376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c005040 con 0x7f2a880fcd00 2023-12-16T03:11:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8dce7700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fbaf0 0x7f2a8810c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:11:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.773+0000 7f2a8d4e6700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 0x7f2a8810c930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009360 tx=0x7f2a7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:11:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.774+0000 7f2a867fc700 1 -- 172.21.15.64:0/708218376 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7c00e040 con 0x7f2a880fcd00 2023-12-16T03:11:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.774+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8810da50 con 0x7f2a880fcd00 2023-12-16T03:11:03.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.774+0000 7f2a867fc700 1 -- 172.21.15.64:0/708218376 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a7c00bcd0 con 0x7f2a880fcd00 2023-12-16T03:11:03.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.774+0000 7f2a867fc700 1 -- 172.21.15.64:0/708218376 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7c01c630 con 0x7f2a880fcd00 2023-12-16T03:11:03.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.774+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8810df90 con 0x7f2a880fcd00 2023-12-16T03:11:03.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.775+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8804bb80 con 0x7f2a880fcd00 2023-12-16T03:11:03.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.775+0000 7f2a867fc700 1 -- 172.21.15.64:0/708218376 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f2a7c013960 con 0x7f2a880fcd00 2023-12-16T03:11:03.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.776+0000 7f2a867fc700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a70068ed0 0x7f2a7006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:11:03.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.776+0000 7f2a867fc700 1 -- 172.21.15.64:0/708218376 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2a7c087150 con 0x7f2a880fcd00 2023-12-16T03:11:03.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.776+0000 7f2a8dce7700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a70068ed0 0x7f2a7006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:11:03.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.776+0000 7f2a8dce7700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a70068ed0 0x7f2a7006b380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2a880fcb60 tx=0x7f2a8000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:11:03.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.781+0000 7f2a867fc700 1 -- 172.21.15.64:0/708218376 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2a7c058190 con 0x7f2a880fcd00 2023-12-16T03:11:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:03 smithi184 ceph-mon[121180]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:03.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:03.990+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a8810e3e0 con 0x7f2a70068ed0 2023-12-16T03:11:04.648 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:04 smithi064 ceph-mon[111958]: Reconfiguring grafana.smithi064 (dependencies changed)... 2023-12-16T03:11:04.648 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:04 smithi064 ceph-mon[111958]: Reconfiguring daemon grafana.smithi064 on smithi064 2023-12-16T03:11:04.648 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:04 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:11:04.648 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:04 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:11:04.648 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:04 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:04.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:04 smithi184 ceph-mon[121180]: Reconfiguring grafana.smithi064 (dependencies changed)... 2023-12-16T03:11:04.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:04 smithi184 ceph-mon[121180]: Reconfiguring daemon grafana.smithi064 on smithi064 2023-12-16T03:11:04.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:04 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:11:04.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:04 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:11:04.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:04 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:05.648 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:05 smithi064 ceph-mon[111958]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:11:05.648 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:05 smithi064 ceph-mon[111958]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:05.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:05 smithi184 ceph-mon[121180]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:11:05.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:05 smithi184 ceph-mon[121180]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:07.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:07.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:07.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:07 smithi064 ceph-mon[111958]: Reconfiguring prometheus.smithi064 (dependencies changed)... 2023-12-16T03:11:07.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:07 smithi064 ceph-mon[111958]: Reconfiguring daemon prometheus.smithi064 on smithi064 2023-12-16T03:11:07.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:07 smithi064 ceph-mon[111958]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:07.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:07.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:07.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:07 smithi184 ceph-mon[121180]: Reconfiguring prometheus.smithi064 (dependencies changed)... 2023-12-16T03:11:07.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:07 smithi184 ceph-mon[121180]: Reconfiguring daemon prometheus.smithi064 on smithi064 2023-12-16T03:11:07.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:07 smithi184 ceph-mon[121180]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:08 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1357879824' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94788c05-539e-4b9d-aaa5-099f071ba934"}]: dispatch 2023-12-16T03:11:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:08 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1357879824' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94788c05-539e-4b9d-aaa5-099f071ba934"}]': finished 2023-12-16T03:11:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:08 smithi064 ceph-mon[111958]: osdmap e6: 1 total, 0 up, 1 in 2023-12-16T03:11:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:08 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2663431822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:11:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:08 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1357879824' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94788c05-539e-4b9d-aaa5-099f071ba934"}]: dispatch 2023-12-16T03:11:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:08 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1357879824' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94788c05-539e-4b9d-aaa5-099f071ba934"}]': finished 2023-12-16T03:11:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:08 smithi184 ceph-mon[121180]: osdmap e6: 1 total, 0 up, 1 in 2023-12-16T03:11:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:08 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2663431822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:11:09.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:09 smithi064 ceph-mon[111958]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:09.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:09 smithi184 ceph-mon[121180]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:11.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:11 smithi064 ceph-mon[111958]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:11.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:11 smithi184 ceph-mon[121180]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:13.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:13 smithi064 ceph-mon[111958]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:13.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:13 smithi184 ceph-mon[121180]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:15.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:15 smithi184 ceph-mon[121180]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:15.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:15 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:15.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:15 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:15.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:15 smithi184 ceph-mon[121180]: Reconfiguring crash.smithi184 (monmap changed)... 2023-12-16T03:11:15.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:15 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:11:15.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:15 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:15.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:15 smithi184 ceph-mon[121180]: Reconfiguring daemon crash.smithi184 on smithi184 2023-12-16T03:11:15.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:15 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T03:11:15.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:15 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:15 smithi064 ceph-mon[111958]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:15 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:15 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:15 smithi064 ceph-mon[111958]: Reconfiguring crash.smithi184 (monmap changed)... 2023-12-16T03:11:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:15 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:11:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:15 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:15 smithi064 ceph-mon[111958]: Reconfiguring daemon crash.smithi184 on smithi184 2023-12-16T03:11:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:15 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T03:11:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:15 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:16.787 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: Deploying daemon osd.0 on smithi064 2023-12-16T03:11:16.787 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: Reconfiguring mgr.smithi184.urtxla (monmap changed)... 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: Reconfiguring daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:11:16.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:16 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:16.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: Deploying daemon osd.0 on smithi064 2023-12-16T03:11:16.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:16.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:16.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: Reconfiguring mgr.smithi184.urtxla (monmap changed)... 2023-12-16T03:11:16.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:11:16.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:11:16.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:16.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: Reconfiguring daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:11:16.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:16.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:16.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:11:16.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:11:16.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:16 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:17.539 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:17.539 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: Reconfiguring mon.smithi184 (monmap changed)... 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: Reconfiguring daemon mon.smithi184 on smithi184 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi064.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi064.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:11:17.540 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:17 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi064.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: Reconfiguring mon.smithi184 (monmap changed)... 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: Reconfiguring daemon mon.smithi184 on smithi184 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi064.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:11:17.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi064.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T03:11:17.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:17.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:11:17.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:17 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi064.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T03:11:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:18 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:11:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:18 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi064.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T03:11:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:18 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:11:18.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:18 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi064.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T03:11:18.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:18 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:11:18.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:18 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi064.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T03:11:18.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:18 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:18.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:18 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:18 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:11:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:18 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi064.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T03:11:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:18 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:11:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:18 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi064.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T03:11:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:18 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:11:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:18 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi064.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T03:11:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:18 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:18 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:19.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:19 smithi184 ceph-mon[121180]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:19.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:19 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:19.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:19 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:19.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:19 smithi064 ceph-mon[111958]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:19.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:19 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:19.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:19 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:20.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:20 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:20.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:20 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:20.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:20 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:20.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:20 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:21 smithi064 ceph-mon[111958]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:21 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:21 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:21 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:21 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:21 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:21 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:21 smithi184 ceph-mon[121180]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:21 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:21 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:21 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:21 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:21 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:21 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:22.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.402+0000 7f2a867fc700 1 -- 172.21.15.64:0/708218376 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2a8810e3e0 con 0x7f2a70068ed0 2023-12-16T03:11:22.404 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 0 on host 'smithi064' 2023-12-16T03:11:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a70068ed0 msgr2=0x7f2a7006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a70068ed0 0x7f2a7006b380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2a880fcb60 tx=0x7f2a8000b040 comp rx=0 tx=0).stop 2023-12-16T03:11:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 msgr2=0x7f2a8810c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 0x7f2a8810c930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009360 tx=0x7f2a7c009e30 comp rx=0 tx=0).stop 2023-12-16T03:11:22.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 shutdown_connections 2023-12-16T03:11:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a70068ed0 0x7f2a7006b380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fbaf0 0x7f2a8810c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 --2- 172.21.15.64:0/708218376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd00 0x7f2a8810c930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 >> 172.21.15.64:0/708218376 conn(0x7f2a880f71b0 msgr2=0x7f2a880fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:11:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 shutdown_connections 2023-12-16T03:11:22.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:22.404+0000 7f2a8ff4b700 1 -- 172.21.15.64:0/708218376 wait complete. 2023-12-16T03:11:22.808 DEBUG:teuthology.orchestra.run.smithi064:osd.0> sudo journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.0.service 2023-12-16T03:11:22.810 INFO:tasks.cephadm:Deploying osd.1 on smithi064 with /dev/vg_nvme/lv_3... 2023-12-16T03:11:22.810 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-16T03:11:22.843 INFO:journalctl@ceph.osd.0.smithi064.stdout:-- Logs begin at Sat 2023-12-16 02:56:13 UTC. -- 2023-12-16T03:11:23.315 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:11:23.645 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:23 smithi064 ceph-mon[111958]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:23.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:23 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:23.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:23 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:23.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:23 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:23.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:23 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:23.646 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:11:23 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[135616]: 2023-12-16T03:11:23.488+0000 7ffa7dc66540 -1 osd.0 0 log_to_monitors true 2023-12-16T03:11:23.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:23 smithi184 ceph-mon[121180]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:23.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:23 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:23.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:23 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:23.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:23 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:23.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:23 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:24.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:24 smithi064 ceph-mon[111958]: from='osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T03:11:24.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:24 smithi184 ceph-mon[121180]: from='osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T03:11:24.850 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-16T03:11:24.851 INFO:teuthology.orchestra.run.smithi064.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-16T03:11:24.851 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10+0 records in 2023-12-16T03:11:24.851 INFO:teuthology.orchestra.run.smithi064.stderr:10+0 records out 2023-12-16T03:11:24.851 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110111 s, 952 MB/s 2023-12-16T03:11:24.851 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping successful for: 2023-12-16T03:11:25.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi064:vg_nvme/lv_3 2023-12-16T03:11:25.678 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:11:25 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[135616]: 2023-12-16T03:11:25.402+0000 7ffa7444b700 -1 osd.0 0 waiting for initial osdmap 2023-12-16T03:11:25.678 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:11:25 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[135616]: 2023-12-16T03:11:25.406+0000 7ffa6d242700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:11:25.678 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:25 smithi064 ceph-mon[111958]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:25.678 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:25 smithi064 ceph-mon[111958]: from='osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T03:11:25.679 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:25 smithi064 ceph-mon[111958]: osdmap e7: 1 total, 0 up, 1 in 2023-12-16T03:11:25.679 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:25 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:25.679 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:25 smithi064 ceph-mon[111958]: from='osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:11:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:25 smithi184 ceph-mon[121180]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:25 smithi184 ceph-mon[121180]: from='osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T03:11:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:25 smithi184 ceph-mon[121180]: osdmap e7: 1 total, 0 up, 1 in 2023-12-16T03:11:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:25 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:25 smithi184 ceph-mon[121180]: from='osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:11:26.026 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:11:26.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:26 smithi064 ceph-mon[111958]: from='osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2023-12-16T03:11:26.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:26 smithi064 ceph-mon[111958]: osdmap e8: 1 total, 0 up, 1 in 2023-12-16T03:11:26.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:26 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:26.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:26 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:26.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:26 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:26.562 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:26 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:26 smithi184 ceph-mon[121180]: from='osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2023-12-16T03:11:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:26 smithi184 ceph-mon[121180]: osdmap e8: 1 total, 0 up, 1 in 2023-12-16T03:11:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:26 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:26 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:26 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:26 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.163+0000 7fd0e59b1700 1 -- 172.21.15.64:0/279809133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 msgr2=0x7fd0e01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.163+0000 7fd0e59b1700 1 --2- 172.21.15.64:0/279809133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 0x7fd0e01021d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8004940 tx=0x7fd0c8009e30 comp rx=0 tx=0).stop 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.163+0000 7fd0e59b1700 1 -- 172.21.15.64:0/279809133 shutdown_connections 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.163+0000 7fd0e59b1700 1 --2- 172.21.15.64:0/279809133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 0x7fd0e01021d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.163+0000 7fd0e59b1700 1 --2- 172.21.15.64:0/279809133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0066090 0x7fd0e00ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.163+0000 7fd0e59b1700 1 -- 172.21.15.64:0/279809133 >> 172.21.15.64:0/279809133 conn(0x7fd0e00f7190 msgr2=0x7fd0e00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.163+0000 7fd0e59b1700 1 -- 172.21.15.64:0/279809133 shutdown_connections 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.163+0000 7fd0e59b1700 1 -- 172.21.15.64:0/279809133 wait complete. 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0e59b1700 1 Processor -- start 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0e59b1700 1 -- start start 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0e59b1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0066090 0x7fd0e010d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0e59b1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 0x7fd0e010da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:11:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0e59b1700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e010e070 con 0x7fd0e00ffd70 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0e59b1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e010e910 con 0x7fd0e0066090 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0de7fc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 0x7fd0e010da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0de7fc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 0x7fd0e010da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47040/0 (socket says 172.21.15.64:47040) 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0de7fc700 1 -- 172.21.15.64:0/2825124901 learned_addr learned my addr 172.21.15.64:0/2825124901 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0deffd700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0066090 0x7fd0e010d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0de7fc700 1 -- 172.21.15.64:0/2825124901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0066090 msgr2=0x7fd0e010d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0de7fc700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0066090 0x7fd0e010d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0de7fc700 1 -- 172.21.15.64:0/2825124901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8005040 con 0x7fd0e00ffd70 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0deffd700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0066090 0x7fd0e010d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.164+0000 7fd0de7fc700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 0x7fd0e010da70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8004f90 tx=0x7fd0c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.165+0000 7fd0d77fe700 1 -- 172.21.15.64:0/2825124901 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c800e040 con 0x7fd0e00ffd70 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.165+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e010eb90 con 0x7fd0e00ffd70 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.165+0000 7fd0d77fe700 1 -- 172.21.15.64:0/2825124901 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0c800bcd0 con 0x7fd0e00ffd70 2023-12-16T03:11:27.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.165+0000 7fd0d77fe700 1 -- 172.21.15.64:0/2825124901 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c801c630 con 0x7fd0e00ffd70 2023-12-16T03:11:27.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.165+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e010f0d0 con 0x7fd0e00ffd70 2023-12-16T03:11:27.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.166+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e01075c0 con 0x7fd0e00ffd70 2023-12-16T03:11:27.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.166+0000 7fd0d77fe700 1 -- 172.21.15.64:0/2825124901 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fd0c8013960 con 0x7fd0e00ffd70 2023-12-16T03:11:27.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.167+0000 7fd0d77fe700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0cc068ed0 0x7fd0cc06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:11:27.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.167+0000 7fd0d77fe700 1 -- 172.21.15.64:0/2825124901 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fd0c8087df0 con 0x7fd0e00ffd70 2023-12-16T03:11:27.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.167+0000 7fd0deffd700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0cc068ed0 0x7fd0cc06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:11:27.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.167+0000 7fd0deffd700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0cc068ed0 0x7fd0cc06b380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8004f00 tx=0x7fd0d8009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:11:27.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.171+0000 7fd0d77fe700 1 -- 172.21.15.64:0/2825124901 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd0c8058c70 con 0x7fd0e00ffd70 2023-12-16T03:11:27.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:27.391+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0e002b180 con 0x7fd0cc068ed0 2023-12-16T03:11:27.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:27 smithi064 ceph-mon[111958]: purged_snaps scrub starts 2023-12-16T03:11:27.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:27 smithi064 ceph-mon[111958]: purged_snaps scrub ok 2023-12-16T03:11:27.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:27 smithi064 ceph-mon[111958]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:27.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:27 smithi064 ceph-mon[111958]: osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] boot 2023-12-16T03:11:27.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:27 smithi064 ceph-mon[111958]: osdmap e9: 1 total, 1 up, 1 in 2023-12-16T03:11:27.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:27 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:27.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:27 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:11:27.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:27 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:11:27.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:27 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:27 smithi184 ceph-mon[121180]: purged_snaps scrub starts 2023-12-16T03:11:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:27 smithi184 ceph-mon[121180]: purged_snaps scrub ok 2023-12-16T03:11:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:27 smithi184 ceph-mon[121180]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T03:11:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:27 smithi184 ceph-mon[121180]: osd.0 [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] boot 2023-12-16T03:11:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:27 smithi184 ceph-mon[121180]: osdmap e9: 1 total, 1 up, 1 in 2023-12-16T03:11:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:27 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:11:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:27 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:11:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:27 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:11:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:27 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:28 smithi064 ceph-mon[111958]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:11:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:28 smithi064 ceph-mon[111958]: osdmap e10: 1 total, 1 up, 1 in 2023-12-16T03:11:28.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:28 smithi184 ceph-mon[121180]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:11:28.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:28 smithi184 ceph-mon[121180]: osdmap e10: 1 total, 1 up, 1 in 2023-12-16T03:11:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:29 smithi064 ceph-mon[111958]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:29 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:29 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:29 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:11:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:29 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:29 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:29 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:29 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:29 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:29 smithi184 ceph-mon[121180]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:29 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:29 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:29 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:11:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:29 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:29 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:29 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:29 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:29 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:30.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:30 smithi184 ceph-mon[121180]: Detected new or changed devices on smithi064 2023-12-16T03:11:30.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:30 smithi184 ceph-mon[121180]: Adjusting osd_memory_target on smithi064 to 12898M 2023-12-16T03:11:30.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:30 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2455725869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b08e3c59-129c-4baf-89ee-61012384a515"}]: dispatch 2023-12-16T03:11:30.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:30 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2455725869' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b08e3c59-129c-4baf-89ee-61012384a515"}]': finished 2023-12-16T03:11:30.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:30 smithi184 ceph-mon[121180]: osdmap e11: 2 total, 1 up, 2 in 2023-12-16T03:11:30.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:30 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:30.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:30 smithi064 ceph-mon[111958]: Detected new or changed devices on smithi064 2023-12-16T03:11:30.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:30 smithi064 ceph-mon[111958]: Adjusting osd_memory_target on smithi064 to 12898M 2023-12-16T03:11:30.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:30 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2455725869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b08e3c59-129c-4baf-89ee-61012384a515"}]: dispatch 2023-12-16T03:11:30.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:30 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2455725869' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b08e3c59-129c-4baf-89ee-61012384a515"}]': finished 2023-12-16T03:11:30.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:30 smithi064 ceph-mon[111958]: osdmap e11: 2 total, 1 up, 2 in 2023-12-16T03:11:30.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:30 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:31 smithi064 ceph-mon[111958]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:31 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:31 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:31 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2392168701' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:11:31.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:31 smithi184 ceph-mon[121180]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:31.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:31 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:31.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:31 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:31.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:31 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2392168701' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:11:33.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:33 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:33.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:33 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:33.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:33 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:33.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:33 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:33.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:33 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:33.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:33 smithi184 ceph-mon[121180]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:33.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:33 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:11:33.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:33.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:33.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:33.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:33.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:33.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:33 smithi064 ceph-mon[111958]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:33.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:11:35.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:35 smithi064 ceph-mon[111958]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:35.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:35 smithi184 ceph-mon[121180]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:37.358 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:37 smithi064 ceph-mon[111958]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:37.358 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T03:11:37.358 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:37 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:37.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:37 smithi184 ceph-mon[121180]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:37.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:37 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T03:11:37.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:37 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:38.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:38 smithi064 ceph-mon[111958]: Deploying daemon osd.1 on smithi064 2023-12-16T03:11:38.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:38 smithi184 ceph-mon[121180]: Deploying daemon osd.1 on smithi064 2023-12-16T03:11:39.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:39 smithi064 ceph-mon[111958]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:39.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:39 smithi184 ceph-mon[121180]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:41.495 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:41 smithi064 ceph-mon[111958]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:41.495 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:41 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:41.495 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:41 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:41.495 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:41 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:41.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:41 smithi184 ceph-mon[121180]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:41.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:41 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:41.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:41 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:41.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:41 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:42.841 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 1 on host 'smithi064' 2023-12-16T03:11:42.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.839+0000 7fd0d77fe700 1 -- 172.21.15.64:0/2825124901 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd0e002b180 con 0x7fd0cc068ed0 2023-12-16T03:11:42.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0cc068ed0 msgr2=0x7fd0cc06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:42.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0cc068ed0 0x7fd0cc06b380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8004f00 tx=0x7fd0d8009040 comp rx=0 tx=0).stop 2023-12-16T03:11:42.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 msgr2=0x7fd0e010da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:42.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 0x7fd0e010da70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8004f90 tx=0x7fd0c8009e30 comp rx=0 tx=0).stop 2023-12-16T03:11:42.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 shutdown_connections 2023-12-16T03:11:42.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0cc068ed0 0x7fd0cc06b380 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:42.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0066090 0x7fd0e010d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:42.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 --2- 172.21.15.64:0/2825124901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e00ffd70 0x7fd0e010da70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:42.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 >> 172.21.15.64:0/2825124901 conn(0x7fd0e00f7190 msgr2=0x7fd0e00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:11:42.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 shutdown_connections 2023-12-16T03:11:42.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:42.842+0000 7fd0e59b1700 1 -- 172.21.15.64:0/2825124901 wait complete. 2023-12-16T03:11:43.437 DEBUG:teuthology.orchestra.run.smithi064:osd.1> sudo journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.1.service 2023-12-16T03:11:43.480 INFO:tasks.cephadm:Deploying osd.2 on smithi064 with /dev/vg_nvme/lv_2... 2023-12-16T03:11:43.480 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-16T03:11:43.516 INFO:journalctl@ceph.osd.1.smithi064.stdout:-- Logs begin at Sat 2023-12-16 02:56:13 UTC. -- 2023-12-16T03:11:43.541 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:43 smithi064 ceph-mon[111958]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:43.541 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:43.541 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:43.809 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:11:43.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:43 smithi184 ceph-mon[121180]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:43.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:43.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:44.393 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:44 smithi064 ceph-mon[111958]: from='osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T03:11:44.393 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:11:44 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[144777]: 2023-12-16T03:11:44.277+0000 7f61c3b3d540 -1 osd.1 0 log_to_monitors true 2023-12-16T03:11:44.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:44 smithi184 ceph-mon[121180]: from='osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T03:11:45.365 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:11:45 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[144777]: 2023-12-16T03:11:45.355+0000 7f61ba322700 -1 osd.1 0 waiting for initial osdmap 2023-12-16T03:11:45.366 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:45 smithi064 ceph-mon[111958]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:45.366 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:45 smithi064 ceph-mon[111958]: from='osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T03:11:45.366 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:45 smithi064 ceph-mon[111958]: osdmap e12: 2 total, 1 up, 2 in 2023-12-16T03:11:45.366 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:45 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:45.366 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:45 smithi064 ceph-mon[111958]: from='osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:11:45.366 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:45 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:45.366 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:45 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:45.635 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-16T03:11:45.635 INFO:teuthology.orchestra.run.smithi064.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-16T03:11:45.635 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10+0 records in 2023-12-16T03:11:45.635 INFO:teuthology.orchestra.run.smithi064.stderr:10+0 records out 2023-12-16T03:11:45.635 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0154799 s, 677 MB/s 2023-12-16T03:11:45.635 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping successful for: 2023-12-16T03:11:45.675 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:11:45 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[144777]: 2023-12-16T03:11:45.363+0000 7f61b7121700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:11:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:45 smithi184 ceph-mon[121180]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:45 smithi184 ceph-mon[121180]: from='osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T03:11:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:45 smithi184 ceph-mon[121180]: osdmap e12: 2 total, 1 up, 2 in 2023-12-16T03:11:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:45 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:45 smithi184 ceph-mon[121180]: from='osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:11:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:45 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:45 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:46.021 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi064:vg_nvme/lv_2 2023-12-16T03:11:46.617 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:11:46.691 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:46 smithi064 ceph-mon[111958]: from='osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2023-12-16T03:11:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:46 smithi064 ceph-mon[111958]: osdmap e13: 2 total, 1 up, 2 in 2023-12-16T03:11:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:46 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:46 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:46.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:46 smithi184 ceph-mon[121180]: from='osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2023-12-16T03:11:46.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:46 smithi184 ceph-mon[121180]: osdmap e13: 2 total, 1 up, 2 in 2023-12-16T03:11:46.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:46 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:46.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:46 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:47.616 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:47 smithi064 ceph-mon[111958]: purged_snaps scrub starts 2023-12-16T03:11:47.616 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:47 smithi064 ceph-mon[111958]: purged_snaps scrub ok 2023-12-16T03:11:47.616 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:47 smithi064 ceph-mon[111958]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:47.616 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:47 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:47.616 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:47 smithi064 ceph-mon[111958]: osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] boot 2023-12-16T03:11:47.616 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:47 smithi064 ceph-mon[111958]: osdmap e14: 2 total, 2 up, 2 in 2023-12-16T03:11:47.616 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:47 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:47 smithi184 ceph-mon[121180]: purged_snaps scrub starts 2023-12-16T03:11:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:47 smithi184 ceph-mon[121180]: purged_snaps scrub ok 2023-12-16T03:11:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:47 smithi184 ceph-mon[121180]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T03:11:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:47 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:47 smithi184 ceph-mon[121180]: osd.1 [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] boot 2023-12-16T03:11:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:47 smithi184 ceph-mon[121180]: osdmap e14: 2 total, 2 up, 2 in 2023-12-16T03:11:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:47 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:11:47.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.952+0000 7fa25ff27700 1 -- 172.21.15.64:0/2080882410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fde00 msgr2=0x7fa2580fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:47.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.952+0000 7fa25ff27700 1 --2- 172.21.15.64:0/2080882410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fde00 0x7fa2580fe250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa248004940 tx=0x7fa248009e30 comp rx=0 tx=0).stop 2023-12-16T03:11:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.952+0000 7fa25ff27700 1 -- 172.21.15.64:0/2080882410 shutdown_connections 2023-12-16T03:11:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.952+0000 7fa25ff27700 1 --2- 172.21.15.64:0/2080882410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fde00 0x7fa2580fe250 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.952+0000 7fa25ff27700 1 --2- 172.21.15.64:0/2080882410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2580fcbf0 0x7fa2580fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.952+0000 7fa25ff27700 1 -- 172.21.15.64:0/2080882410 >> 172.21.15.64:0/2080882410 conn(0x7fa2580f82d0 msgr2=0x7fa2580fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:11:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.952+0000 7fa25ff27700 1 -- 172.21.15.64:0/2080882410 shutdown_connections 2023-12-16T03:11:47.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.952+0000 7fa25ff27700 1 -- 172.21.15.64:0/2080882410 wait complete. 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.953+0000 7fa25ff27700 1 Processor -- start 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.953+0000 7fa25ff27700 1 -- start start 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.953+0000 7fa25ff27700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fcbf0 0x7fa25810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.953+0000 7fa25ff27700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2580fde00 0x7fa25810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.953+0000 7fa25ff27700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25810e0a0 con 0x7fa2580fcbf0 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.953+0000 7fa25ff27700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25810e940 con 0x7fa2580fde00 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.953+0000 7fa25dcc3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fcbf0 0x7fa25810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa25dcc3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fcbf0 0x7fa25810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40096/0 (socket says 172.21.15.64:40096) 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa25dcc3700 1 -- 172.21.15.64:0/2795967903 learned_addr learned my addr 172.21.15.64:0/2795967903 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa25d4c2700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2580fde00 0x7fa25810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa25dcc3700 1 -- 172.21.15.64:0/2795967903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2580fde00 msgr2=0x7fa25810daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa25dcc3700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2580fde00 0x7fa25810daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:11:47.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa25dcc3700 1 -- 172.21.15.64:0/2795967903 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248005040 con 0x7fa2580fcbf0 2023-12-16T03:11:47.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa25dcc3700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fcbf0 0x7fa25810d560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa254001d00 tx=0x7fa254009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:11:47.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa24e7fc700 1 -- 172.21.15.64:0/2795967903 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa254007d10 con 0x7fa2580fcbf0 2023-12-16T03:11:47.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa24e7fc700 1 -- 172.21.15.64:0/2795967903 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa254007e70 con 0x7fa2580fcbf0 2023-12-16T03:11:47.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25810ec20 con 0x7fa2580fcbf0 2023-12-16T03:11:47.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa24e7fc700 1 -- 172.21.15.64:0/2795967903 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa254014400 con 0x7fa2580fcbf0 2023-12-16T03:11:47.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.954+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25810f160 con 0x7fa2580fcbf0 2023-12-16T03:11:47.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.955+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25804bb80 con 0x7fa2580fcbf0 2023-12-16T03:11:47.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.957+0000 7fa24e7fc700 1 -- 172.21.15.64:0/2795967903 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fa254009160 con 0x7fa2580fcbf0 2023-12-16T03:11:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.957+0000 7fa24e7fc700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa244068ed0 0x7fa24406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:11:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.957+0000 7fa24e7fc700 1 -- 172.21.15.64:0/2795967903 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fa254086340 con 0x7fa2580fcbf0 2023-12-16T03:11:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.957+0000 7fa25d4c2700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa244068ed0 0x7fa24406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:11:47.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.958+0000 7fa25d4c2700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa244068ed0 0x7fa24406b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa24800b3b0 tx=0x7fa248009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:11:47.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:47.961+0000 7fa24e7fc700 1 -- 172.21.15.64:0/2795967903 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa254056f70 con 0x7fa2580fcbf0 2023-12-16T03:11:48.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:11:48.171+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa258102750 con 0x7fa244068ed0 2023-12-16T03:11:48.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:11:48.664 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:11:48.664 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:11:48.664 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:48.664 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:48 smithi064 ceph-mon[111958]: osdmap e15: 2 total, 2 up, 2 in 2023-12-16T03:11:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:11:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:11:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:11:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:48 smithi184 ceph-mon[121180]: osdmap e15: 2 total, 2 up, 2 in 2023-12-16T03:11:49.518 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:49 smithi064 ceph-mon[111958]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:11:49.519 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:49 smithi064 ceph-mon[111958]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:49.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:49 smithi184 ceph-mon[121180]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:11:49.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:49 smithi184 ceph-mon[121180]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:50.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: Detected new or changed devices on smithi064 2023-12-16T03:11:50.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:50.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: Adjusting osd_memory_target on smithi064 to 6449M 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1800609101' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18ed018b-ab10-4041-86f5-393af106517a"}]: dispatch 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1800609101' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18ed018b-ab10-4041-86f5-393af106517a"}]': finished 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: osdmap e16: 3 total, 2 up, 3 in 2023-12-16T03:11:50.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:50 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:11:51.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: Detected new or changed devices on smithi064 2023-12-16T03:11:51.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:51.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:51.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: Adjusting osd_memory_target on smithi064 to 6449M 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1800609101' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18ed018b-ab10-4041-86f5-393af106517a"}]: dispatch 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1800609101' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18ed018b-ab10-4041-86f5-393af106517a"}]': finished 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: osdmap e16: 3 total, 2 up, 3 in 2023-12-16T03:11:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:50 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:11:52.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:52 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2467738772' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:11:52.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:52 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2467738772' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:11:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:53 smithi184 ceph-mon[121180]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:53 smithi064 ceph-mon[111958]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:11:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:11:55.671 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:55 smithi064 ceph-mon[111958]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:55.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:55 smithi184 ceph-mon[121180]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:57.484 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:57 smithi064 ceph-mon[111958]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:57.484 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T03:11:57.484 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:57.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:57 smithi184 ceph-mon[121180]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:57.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T03:11:57.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:11:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:58 smithi184 ceph-mon[121180]: Deploying daemon osd.2 on smithi064 2023-12-16T03:11:58.569 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:58 smithi064 ceph-mon[111958]: Deploying daemon osd.2 on smithi064 2023-12-16T03:11:59.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:11:59 smithi064 ceph-mon[111958]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:11:59.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:11:59 smithi184 ceph-mon[121180]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:01 smithi064 ceph-mon[111958]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:01.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:01 smithi184 ceph-mon[121180]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:01.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:01.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:02.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:12:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:12:03.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.415+0000 7fa24e7fc700 1 -- 172.21.15.64:0/2795967903 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa258102750 con 0x7fa244068ed0 2023-12-16T03:12:03.418 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 2 on host 'smithi064' 2023-12-16T03:12:03.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.417+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa244068ed0 msgr2=0x7fa24406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:03.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.417+0000 7fa25ff27700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa244068ed0 0x7fa24406b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa24800b3b0 tx=0x7fa248009e30 comp rx=0 tx=0).stop 2023-12-16T03:12:03.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.417+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fcbf0 msgr2=0x7fa25810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:03.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.417+0000 7fa25ff27700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fcbf0 0x7fa25810d560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa254001d00 tx=0x7fa254009e40 comp rx=0 tx=0).stop 2023-12-16T03:12:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.418+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 shutdown_connections 2023-12-16T03:12:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.418+0000 7fa25ff27700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa244068ed0 0x7fa24406b380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.418+0000 7fa25ff27700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2580fcbf0 0x7fa25810d560 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.418+0000 7fa25ff27700 1 --2- 172.21.15.64:0/2795967903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2580fde00 0x7fa25810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.418+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 >> 172.21.15.64:0/2795967903 conn(0x7fa2580f82d0 msgr2=0x7fa258101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:12:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.418+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 shutdown_connections 2023-12-16T03:12:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:12:03.418+0000 7fa25ff27700 1 -- 172.21.15.64:0/2795967903 wait complete. 2023-12-16T03:12:03.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:03 smithi064 ceph-mon[111958]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:03.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:03.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:03 smithi184 ceph-mon[121180]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:03.944 DEBUG:teuthology.orchestra.run.smithi064:osd.2> sudo journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.2.service 2023-12-16T03:12:03.947 INFO:tasks.cephadm:Deploying osd.3 on smithi184 with /dev/vg_nvme/lv_4... 2023-12-16T03:12:03.947 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-16T03:12:03.979 INFO:journalctl@ceph.osd.2.smithi064.stdout:-- Logs begin at Sat 2023-12-16 02:56:13 UTC. -- 2023-12-16T03:12:04.214 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi184/config 2023-12-16T03:12:04.942 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:04 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[154458]: 2023-12-16T03:12:04.862+0000 7f01ddd05540 -1 osd.2 0 log_to_monitors true 2023-12-16T03:12:05.681 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-16T03:12:05.681 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-16T03:12:05.682 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2023-12-16T03:12:05.682 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2023-12-16T03:12:05.682 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110452 s, 949 MB/s 2023-12-16T03:12:05.682 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2023-12-16T03:12:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:05 smithi064 ceph-mon[111958]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:05 smithi064 ceph-mon[111958]: from='osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T03:12:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:05 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:05.714 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:05 smithi184 ceph-mon[121180]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:05.714 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:05 smithi184 ceph-mon[121180]: from='osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T03:12:05.714 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:05 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:06.061 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_4 2023-12-16T03:12:06.321 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi184/config 2023-12-16T03:12:06.581 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:06 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[154458]: 2023-12-16T03:12:06.421+0000 7f01d44ea700 -1 osd.2 0 waiting for initial osdmap 2023-12-16T03:12:06.581 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:06 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[154458]: 2023-12-16T03:12:06.426+0000 7f01cdae2700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:12:06.581 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:06 smithi064 ceph-mon[111958]: from='osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T03:12:06.581 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:06 smithi064 ceph-mon[111958]: osdmap e17: 3 total, 2 up, 3 in 2023-12-16T03:12:06.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:06 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:06.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:06 smithi064 ceph-mon[111958]: from='osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:12:06.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:06 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:06.749 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:06 smithi184 ceph-mon[121180]: from='osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T03:12:06.749 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:06 smithi184 ceph-mon[121180]: osdmap e17: 3 total, 2 up, 3 in 2023-12-16T03:12:06.749 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:06 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:06.749 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:06 smithi184 ceph-mon[121180]: from='osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:12:06.749 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:06 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:07.263 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.261+0000 7fa03853b700 1 -- 172.21.15.184:0/3657220542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fcd10 msgr2=0x7fa0300fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:07.263 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.261+0000 7fa03853b700 1 --2- 172.21.15.184:0/3657220542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fcd10 0x7fa0300fd160 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa02c004940 tx=0x7fa02c009e30 comp rx=0 tx=0).stop 2023-12-16T03:12:07.263 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.261+0000 7fa03853b700 1 -- 172.21.15.184:0/3657220542 shutdown_connections 2023-12-16T03:12:07.263 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.261+0000 7fa03853b700 1 --2- 172.21.15.184:0/3657220542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fcd10 0x7fa0300fd160 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.261+0000 7fa03853b700 1 --2- 172.21.15.184:0/3657220542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0300fbb00 0x7fa0300fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.261+0000 7fa03853b700 1 -- 172.21.15.184:0/3657220542 >> 172.21.15.184:0/3657220542 conn(0x7fa0300f71c0 msgr2=0x7fa0300f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.261+0000 7fa03853b700 1 -- 172.21.15.184:0/3657220542 shutdown_connections 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.261+0000 7fa03853b700 1 -- 172.21.15.184:0/3657220542 wait complete. 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa03853b700 1 Processor -- start 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa03853b700 1 -- start start 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa03853b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fbb00 0x7fa0301101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa03853b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0300fcd10 0x7fa030112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa03853b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300669a0 con 0x7fa0300fcd10 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa03853b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030066ae0 con 0x7fa0300fbb00 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa0362d7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fbb00 0x7fa0301101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa0362d7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fbb00 0x7fa0301101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:38230/0 (socket says 172.21.15.184:38230) 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa0362d7700 1 -- 172.21.15.184:0/4051268481 learned_addr learned my addr 172.21.15.184:0/4051268481 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa035ad6700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0300fcd10 0x7fa030112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:12:07.264 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa0362d7700 1 -- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0300fcd10 msgr2=0x7fa030112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:07.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa0362d7700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0300fcd10 0x7fa030112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:07.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa0362d7700 1 -- 172.21.15.184:0/4051268481 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c005040 con 0x7fa0300fbb00 2023-12-16T03:12:07.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa035ad6700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0300fcd10 0x7fa030112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:12:07.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa0362d7700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fbb00 0x7fa0301101d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa02000eb70 tx=0x7fa02000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:12:07.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa026ffd700 1 -- 172.21.15.184:0/4051268481 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa020007cc0 con 0x7fa0300fbb00 2023-12-16T03:12:07.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa026ffd700 1 -- 172.21.15.184:0/4051268481 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa02000f040 con 0x7fa0300fbb00 2023-12-16T03:12:07.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa030112d20 con 0x7fa0300fbb00 2023-12-16T03:12:07.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa026ffd700 1 -- 172.21.15.184:0/4051268481 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa02000cad0 con 0x7fa0300fbb00 2023-12-16T03:12:07.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.262+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0301131b0 con 0x7fa0300fbb00 2023-12-16T03:12:07.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.263+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03004bb80 con 0x7fa0300fbb00 2023-12-16T03:12:07.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.264+0000 7fa026ffd700 1 -- 172.21.15.184:0/4051268481 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fa02000cc30 con 0x7fa0300fbb00 2023-12-16T03:12:07.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.264+0000 7fa026ffd700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa01c068fb0 0x7fa01c06b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:12:07.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.264+0000 7fa026ffd700 1 -- 172.21.15.184:0/4051268481 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2562+0+0 (secure 0 0 0) 0x7fa020085c10 con 0x7fa0300fbb00 2023-12-16T03:12:07.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.264+0000 7fa035ad6700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa01c068fb0 0x7fa01c06b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:12:07.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.265+0000 7fa035ad6700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa01c068fb0 0x7fa01c06b460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00b0d0 tx=0x7fa02c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:12:07.269 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.269+0000 7fa026ffd700 1 -- 172.21.15.184:0/4051268481 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa02004da00 con 0x7fa0300fbb00 2023-12-16T03:12:07.462 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:07.461+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa030101660 con 0x7fa01c068fb0 2023-12-16T03:12:07.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:07 smithi064 ceph-mon[111958]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:07.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:07 smithi064 ceph-mon[111958]: from='osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2023-12-16T03:12:07.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:07 smithi064 ceph-mon[111958]: osdmap e18: 3 total, 2 up, 3 in 2023-12-16T03:12:07.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:07.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:07.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:07 smithi184 ceph-mon[121180]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:07 smithi184 ceph-mon[121180]: from='osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2023-12-16T03:12:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:07 smithi184 ceph-mon[121180]: osdmap e18: 3 total, 2 up, 3 in 2023-12-16T03:12:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:09.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: purged_snaps scrub starts 2023-12-16T03:12:09.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: purged_snaps scrub ok 2023-12-16T03:12:09.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] boot 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: osdmap e19: 3 total, 3 up, 3 in 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:09.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:09.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:09.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:09.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:09.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:09.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:09.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-16T03:12:09.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: purged_snaps scrub starts 2023-12-16T03:12:09.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: purged_snaps scrub ok 2023-12-16T03:12:09.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: osd.2 [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] boot 2023-12-16T03:12:09.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: osdmap e19: 3 total, 3 up, 3 in 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:09.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:09.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:09.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:09.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:09.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:09.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: Detected new or changed devices on smithi064 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: Adjusting osd_memory_target on smithi064 to 4299M 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: osdmap e20: 3 total, 3 up, 3 in 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/3568727533' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1cc449-de96-410d-9a56-210aae20b3d9"}]: dispatch 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1cc449-de96-410d-9a56-210aae20b3d9"}]: dispatch 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de1cc449-de96-410d-9a56-210aae20b3d9"}]': finished 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: osdmap e21: 4 total, 3 up, 4 in 2023-12-16T03:12:10.144 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:09 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: Detected new or changed devices on smithi064 2023-12-16T03:12:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: Adjusting osd_memory_target on smithi064 to 4299M 2023-12-16T03:12:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T03:12:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-16T03:12:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: osdmap e20: 3 total, 3 up, 3 in 2023-12-16T03:12:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-16T03:12:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/3568727533' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1cc449-de96-410d-9a56-210aae20b3d9"}]: dispatch 2023-12-16T03:12:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de1cc449-de96-410d-9a56-210aae20b3d9"}]: dispatch 2023-12-16T03:12:10.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-16T03:12:10.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de1cc449-de96-410d-9a56-210aae20b3d9"}]': finished 2023-12-16T03:12:10.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: osdmap e21: 4 total, 3 up, 4 in 2023-12-16T03:12:10.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:09 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:10.442 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:12:10 smithi064 sudo[159936]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T03:12:10.442 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:12:10 smithi064 sudo[159936]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:10.442 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:12:10 smithi064 sudo[159936]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:10.442 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:12:10 smithi064 sudo[159936]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:10.942 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:12:10 smithi064 sudo[159939]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T03:12:10.942 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:12:10 smithi064 sudo[159939]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:10.942 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:12:10 smithi064 sudo[159939]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:10.942 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:12:10 smithi064 sudo[159939]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:10.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:10 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/2783020484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:12:10.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:10 smithi064 ceph-mon[111958]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T03:12:10.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:10 smithi064 ceph-mon[111958]: osdmap e22: 4 total, 3 up, 4 in 2023-12-16T03:12:10.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:10 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:10.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:10 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:10 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/2783020484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:12:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:10 smithi184 ceph-mon[121180]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T03:12:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:10 smithi184 ceph-mon[121180]: osdmap e22: 4 total, 3 up, 4 in 2023-12-16T03:12:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:10 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:10 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:11.445 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159942]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T03:12:11.445 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159942]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:11.445 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159942]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:11.445 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159942]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:11.628 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:11.625+0000 7fa026ffd700 1 -- 172.21.15.184:0/4051268481 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa0200530f0 con 0x7fa0300fbb00 2023-12-16T03:12:11.942 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159945]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T03:12:11.942 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159945]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:11.942 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159945]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:11.942 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159945]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:12.399 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159948]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T03:12:12.399 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159948]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:12.399 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159948]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:12.399 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:11 smithi064 sudo[159948]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:12.692 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:12 smithi064 sudo[159951]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T03:12:12.692 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:12 smithi064 sudo[159951]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:12.692 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:12 smithi064 sudo[159951]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:12.692 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:12:12 smithi064 sudo[159951]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:13.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:12 smithi064 sudo[159954]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T03:12:13.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:12 smithi064 sudo[159954]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:13.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:12 smithi064 sudo[159954]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:13.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:12 smithi064 sudo[159954]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:13.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:13 smithi064 sudo[159957]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T03:12:13.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:13 smithi064 sudo[159957]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:13.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:13 smithi064 sudo[159957]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:13.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:13 smithi064 sudo[159957]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:13.796 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 sudo[126647]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T03:12:13.796 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 sudo[126647]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:13.796 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 sudo[126647]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:13.796 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 sudo[126647]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 sudo[126725]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T03:12:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 sudo[126725]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T03:12:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 sudo[126725]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T03:12:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 sudo[126725]: pam_unix(sudo:session): session closed for user root 2023-12-16T03:12:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 ceph-mon[121180]: mgrmap e19: smithi064.ueciyw(active, since 99s), standbys: smithi184.urtxla 2023-12-16T03:12:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:13 smithi184 ceph-mon[121180]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T03:12:14.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:13 smithi064 ceph-mon[111958]: mgrmap e19: smithi064.ueciyw(active, since 99s), standbys: smithi184.urtxla 2023-12-16T03:12:14.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:13 smithi064 ceph-mon[111958]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T03:12:15.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: pgmap v60: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T03:12:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T03:12:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:12:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:12:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T03:12:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:12:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:12:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T03:12:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:14 smithi184 ceph-mon[121180]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-16T03:12:15.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: pgmap v60: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T03:12:15.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T03:12:15.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:12:15.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:12:15.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T03:12:15.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:12:15.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:12:15.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T03:12:15.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:15.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:14 smithi064 ceph-mon[111958]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-16T03:12:16.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:15 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T03:12:16.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:15 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:16.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:15 smithi064 ceph-mon[111958]: Deploying daemon osd.3 on smithi184 2023-12-16T03:12:16.205 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:15 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T03:12:16.205 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:15 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:16.205 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:15 smithi184 ceph-mon[121180]: Deploying daemon osd.3 on smithi184 2023-12-16T03:12:17.529 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:17 smithi184 ceph-mon[121180]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-16T03:12:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:17 smithi064 ceph-mon[111958]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-16T03:12:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:18 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:12:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:18 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:12:19.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:19 smithi184 ceph-mon[121180]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-12-16T03:12:19.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:19 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:19.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:19 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:19.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:19 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:19 smithi064 ceph-mon[111958]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-12-16T03:12:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:19 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:19 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:19 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:21.561 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.559+0000 7fa026ffd700 1 -- 172.21.15.184:0/4051268481 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa030101660 con 0x7fa01c068fb0 2023-12-16T03:12:21.562 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 3 on host 'smithi184' 2023-12-16T03:12:21.563 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.561+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa01c068fb0 msgr2=0x7fa01c06b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:21.563 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.561+0000 7fa03853b700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa01c068fb0 0x7fa01c06b460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00b0d0 tx=0x7fa02c009e30 comp rx=0 tx=0).stop 2023-12-16T03:12:21.563 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.562+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fbb00 msgr2=0x7fa0301101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:21.564 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.562+0000 7fa03853b700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fbb00 0x7fa0301101d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa02000eb70 tx=0x7fa02000b040 comp rx=0 tx=0).stop 2023-12-16T03:12:21.564 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.562+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 shutdown_connections 2023-12-16T03:12:21.564 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.562+0000 7fa03853b700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa01c068fb0 0x7fa01c06b460 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:21.564 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.562+0000 7fa03853b700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0300fbb00 0x7fa0301101d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:21.564 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.562+0000 7fa03853b700 1 --2- 172.21.15.184:0/4051268481 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0300fcd10 0x7fa030112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:21.564 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.562+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 >> 172.21.15.184:0/4051268481 conn(0x7fa0300f71c0 msgr2=0x7fa0300fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:12:21.564 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.562+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 shutdown_connections 2023-12-16T03:12:21.564 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:21.562+0000 7fa03853b700 1 -- 172.21.15.184:0/4051268481 wait complete. 2023-12-16T03:12:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:21 smithi064 ceph-mon[111958]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-16T03:12:21.763 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:21 smithi184 ceph-mon[121180]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-16T03:12:21.953 DEBUG:teuthology.orchestra.run.smithi184:osd.3> sudo journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.3.service 2023-12-16T03:12:21.956 INFO:tasks.cephadm:Deploying osd.4 on smithi184 with /dev/vg_nvme/lv_3... 2023-12-16T03:12:21.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-16T03:12:21.984 INFO:journalctl@ceph.osd.3.smithi184.stdout:-- Logs begin at Sat 2023-12-16 02:56:06 UTC. -- 2023-12-16T03:12:22.559 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi184/config 2023-12-16T03:12:22.729 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:22 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:22.730 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:22 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:22.730 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:22 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:22.730 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:22 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:22.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:22 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:22.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:22 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:22.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:22 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:22.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:22 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:23.310 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:12:23 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[127570]: 2023-12-16T03:12:23.069+0000 7fbba08d8540 -1 osd.3 0 log_to_monitors true 2023-12-16T03:12:23.714 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:23 smithi184 ceph-mon[121180]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-16T03:12:23.715 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:23 smithi184 ceph-mon[121180]: from='osd.3 [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T03:12:23.715 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:23 smithi184 ceph-mon[121180]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T03:12:23.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:23 smithi064 ceph-mon[111958]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-16T03:12:23.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:23 smithi064 ceph-mon[111958]: from='osd.3 [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T03:12:23.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:23 smithi064 ceph-mon[111958]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T03:12:24.209 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-16T03:12:24.210 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-16T03:12:24.210 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2023-12-16T03:12:24.210 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2023-12-16T03:12:24.210 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.012984 s, 808 MB/s 2023-12-16T03:12:24.210 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2023-12-16T03:12:24.742 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_3 2023-12-16T03:12:25.013 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi184/config 2023-12-16T03:12:25.129 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[127570]: 2023-12-16T03:12:24.869+0000 7fbb970bd700 -1 osd.3 0 waiting for initial osdmap 2023-12-16T03:12:25.129 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[127570]: 2023-12-16T03:12:24.875+0000 7fbb91eb8700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:12:25.129 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T03:12:25.129 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: osdmap e23: 4 total, 3 up, 4 in 2023-12-16T03:12:25.129 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:25.129 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='osd.3 [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:12:25.129 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:12:25.130 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-16T03:12:25.130 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:25.130 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:25.130 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:25.130 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:25.130 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:25.130 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:25.130 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:24 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:25.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: osdmap e23: 4 total, 3 up, 4 in 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='osd.3 [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:24 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:25.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.930+0000 7f03d07a7700 1 -- 172.21.15.184:0/3317079506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c80fd730 msgr2=0x7f03c80ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:25.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.930+0000 7f03d07a7700 1 --2- 172.21.15.184:0/3317079506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c80fd730 0x7f03c80ffb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f03b8004940 tx=0x7f03b8009e30 comp rx=0 tx=0).stop 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.930+0000 7f03d07a7700 1 -- 172.21.15.184:0/3317079506 shutdown_connections 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.930+0000 7f03d07a7700 1 --2- 172.21.15.184:0/3317079506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c8100050 0x7f03c8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.930+0000 7f03d07a7700 1 --2- 172.21.15.184:0/3317079506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c80fd730 0x7f03c80ffb10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.930+0000 7f03d07a7700 1 -- 172.21.15.184:0/3317079506 >> 172.21.15.184:0/3317079506 conn(0x7f03c80f7190 msgr2=0x7f03c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.930+0000 7f03d07a7700 1 -- 172.21.15.184:0/3317079506 shutdown_connections 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.930+0000 7f03d07a7700 1 -- 172.21.15.184:0/3317079506 wait complete. 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.930+0000 7f03d07a7700 1 Processor -- start 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03d07a7700 1 -- start start 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03d07a7700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c80fd730 0x7f03c80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03d07a7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c8100050 0x7f03c80fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03d07a7700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c80fbc40 con 0x7f03c80fd730 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03d07a7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c80fbdb0 con 0x7f03c8100050 2023-12-16T03:12:25.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03cdd42700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c8100050 0x7f03c80fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03cdd42700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c8100050 0x7f03c80fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:39228/0 (socket says 172.21.15.184:39228) 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03cdd42700 1 -- 172.21.15.184:0/642520980 learned_addr learned my addr 172.21.15.184:0/642520980 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03ce543700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c80fd730 0x7f03c80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03cdd42700 1 -- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c80fd730 msgr2=0x7f03c80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03cdd42700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c80fd730 0x7f03c80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03cdd42700 1 -- 172.21.15.184:0/642520980 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8005040 con 0x7f03c8100050 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03cdd42700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c8100050 0x7f03c80fb640 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03c4002a50 tx=0x7f03c40046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03beffd700 1 -- 172.21.15.184:0/642520980 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c4007cc0 con 0x7f03c8100050 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c80fc090 con 0x7f03c8100050 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03beffd700 1 -- 172.21.15.184:0/642520980 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03c400f040 con 0x7f03c8100050 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03beffd700 1 -- 172.21.15.184:0/642520980 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c400d9c0 con 0x7f03c8100050 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.931+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c8115530 con 0x7f03c8100050 2023-12-16T03:12:25.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.932+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c804bb80 con 0x7f03c8100050 2023-12-16T03:12:25.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.933+0000 7f03beffd700 1 -- 172.21.15.184:0/642520980 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f03c400db20 con 0x7f03c8100050 2023-12-16T03:12:25.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.933+0000 7f03beffd700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f03b4068fb0 0x7f03b406b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:12:25.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.934+0000 7f03beffd700 1 -- 172.21.15.184:0/642520980 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3803+0+0 (secure 0 0 0) 0x7f03c4086b00 con 0x7f03c8100050 2023-12-16T03:12:25.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.934+0000 7f03ce543700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f03b4068fb0 0x7f03b406b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:12:25.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.934+0000 7f03ce543700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f03b4068fb0 0x7f03b406b460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f03b8004890 tx=0x7f03b8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:12:25.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:25.937+0000 7f03beffd700 1 -- 172.21.15.184:0/642520980 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f03c40570f0 con 0x7f03c8100050 2023-12-16T03:12:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: Detected new or changed devices on smithi184 2023-12-16T03:12:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: Adjusting osd_memory_target on smithi184 to 15970M 2023-12-16T03:12:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-12-16T03:12:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: osdmap e24: 4 total, 3 up, 4 in 2023-12-16T03:12:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:26.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:26.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: osd.3 [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] boot 2023-12-16T03:12:26.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: osdmap e25: 4 total, 4 up, 4 in 2023-12-16T03:12:26.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:25 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:26.134 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:26.132+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f03c8100cb0 con 0x7f03b4068fb0 2023-12-16T03:12:26.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: Detected new or changed devices on smithi184 2023-12-16T03:12:26.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: Adjusting osd_memory_target on smithi184 to 15970M 2023-12-16T03:12:26.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-12-16T03:12:26.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: osdmap e24: 4 total, 3 up, 4 in 2023-12-16T03:12:26.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:26.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:26.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:26.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:26.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:26.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:26.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: osd.3 [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] boot 2023-12-16T03:12:26.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: osdmap e25: 4 total, 4 up, 4 in 2023-12-16T03:12:26.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:25 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:12:27.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:26 smithi064 ceph-mon[111958]: purged_snaps scrub starts 2023-12-16T03:12:27.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:26 smithi064 ceph-mon[111958]: purged_snaps scrub ok 2023-12-16T03:12:27.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:26 smithi064 ceph-mon[111958]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:12:27.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:26 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:12:27.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:26 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:12:27.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:26 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:27.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:26 smithi064 ceph-mon[111958]: osdmap e26: 4 total, 4 up, 4 in 2023-12-16T03:12:27.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:26 smithi064 ceph-mon[111958]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:27.210 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:26 smithi184 ceph-mon[121180]: purged_snaps scrub starts 2023-12-16T03:12:27.210 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:26 smithi184 ceph-mon[121180]: purged_snaps scrub ok 2023-12-16T03:12:27.211 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:26 smithi184 ceph-mon[121180]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:12:27.211 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:26 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:12:27.211 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:26 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:12:27.211 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:26 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:27.211 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:26 smithi184 ceph-mon[121180]: osdmap e26: 4 total, 4 up, 4 in 2023-12-16T03:12:27.211 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:26 smithi184 ceph-mon[121180]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:28 smithi184 ceph-mon[121180]: osdmap e27: 4 total, 4 up, 4 in 2023-12-16T03:12:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:28 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/2827535730' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4dda63b7-8319-476c-8bb6-60dbb2aa1e92"}]: dispatch 2023-12-16T03:12:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:28 smithi184 ceph-mon[121180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4dda63b7-8319-476c-8bb6-60dbb2aa1e92"}]: dispatch 2023-12-16T03:12:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:28 smithi184 ceph-mon[121180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4dda63b7-8319-476c-8bb6-60dbb2aa1e92"}]': finished 2023-12-16T03:12:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:28 smithi184 ceph-mon[121180]: osdmap e28: 5 total, 4 up, 5 in 2023-12-16T03:12:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:28 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:28 smithi064 ceph-mon[111958]: osdmap e27: 4 total, 4 up, 4 in 2023-12-16T03:12:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:28 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/2827535730' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4dda63b7-8319-476c-8bb6-60dbb2aa1e92"}]: dispatch 2023-12-16T03:12:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:28 smithi064 ceph-mon[111958]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4dda63b7-8319-476c-8bb6-60dbb2aa1e92"}]: dispatch 2023-12-16T03:12:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:28 smithi064 ceph-mon[111958]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4dda63b7-8319-476c-8bb6-60dbb2aa1e92"}]': finished 2023-12-16T03:12:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:28 smithi064 ceph-mon[111958]: osdmap e28: 5 total, 4 up, 5 in 2023-12-16T03:12:28.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:28 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:29.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:29 smithi184 ceph-mon[121180]: pgmap v74: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 165 KiB/s, 0 objects/s recovering 2023-12-16T03:12:29.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:29 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/2351647757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:12:29.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:29 smithi184 ceph-mon[121180]: osdmap e29: 5 total, 4 up, 5 in 2023-12-16T03:12:29.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:29 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:29 smithi064 ceph-mon[111958]: pgmap v74: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 165 KiB/s, 0 objects/s recovering 2023-12-16T03:12:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:29 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/2351647757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:12:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:29 smithi064 ceph-mon[111958]: osdmap e29: 5 total, 4 up, 5 in 2023-12-16T03:12:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:29 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:31 smithi064 ceph-mon[111958]: pgmap v76: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-12-16T03:12:31.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:31 smithi184 ceph-mon[121180]: pgmap v76: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-12-16T03:12:32.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:32 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:12:32.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:12:33.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:33 smithi184 ceph-mon[121180]: pgmap v77: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-16T03:12:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:33 smithi064 ceph-mon[111958]: pgmap v77: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-16T03:12:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:34 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T03:12:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:34 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:34.802 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:34 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T03:12:34.802 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:34 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:35.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:35 smithi064 ceph-mon[111958]: Deploying daemon osd.4 on smithi184 2023-12-16T03:12:35.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:35 smithi064 ceph-mon[111958]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2023-12-16T03:12:35.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:35 smithi184 ceph-mon[121180]: Deploying daemon osd.4 on smithi184 2023-12-16T03:12:35.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:35 smithi184 ceph-mon[121180]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2023-12-16T03:12:37.518 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:37 smithi184 ceph-mon[121180]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:37 smithi064 ceph-mon[111958]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:38.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:38 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:38.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:38 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:38.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:38 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:38.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:38 smithi184 ceph-mon[121180]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:38.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:38.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:38.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:38 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:38.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:38 smithi064 ceph-mon[111958]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:39.990 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.988+0000 7f03beffd700 1 -- 172.21.15.184:0/642520980 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f03c8100cb0 con 0x7f03b4068fb0 2023-12-16T03:12:39.990 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 4 on host 'smithi184' 2023-12-16T03:12:39.993 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.991+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f03b4068fb0 msgr2=0x7f03b406b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.991+0000 7f03d07a7700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f03b4068fb0 0x7f03b406b460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f03b8004890 tx=0x7f03b8009e30 comp rx=0 tx=0).stop 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.991+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c8100050 msgr2=0x7f03c80fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.991+0000 7f03d07a7700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c8100050 0x7f03c80fb640 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03c4002a50 tx=0x7f03c40046b0 comp rx=0 tx=0).stop 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.992+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 shutdown_connections 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.992+0000 7f03d07a7700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f03b4068fb0 0x7f03b406b460 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.992+0000 7f03d07a7700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c80fd730 0x7f03c80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.992+0000 7f03d07a7700 1 --2- 172.21.15.184:0/642520980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c8100050 0x7f03c80fb640 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.992+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 >> 172.21.15.184:0/642520980 conn(0x7f03c80f7190 msgr2=0x7f03c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.992+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 shutdown_connections 2023-12-16T03:12:39.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:39.992+0000 7f03d07a7700 1 -- 172.21.15.184:0/642520980 wait complete. 2023-12-16T03:12:40.376 DEBUG:teuthology.orchestra.run.smithi184:osd.4> sudo journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.4.service 2023-12-16T03:12:40.382 INFO:tasks.cephadm:Deploying osd.5 on smithi184 with /dev/vg_nvme/lv_2... 2023-12-16T03:12:40.382 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-16T03:12:40.411 INFO:journalctl@ceph.osd.4.smithi184.stdout:-- Logs begin at Sat 2023-12-16 02:56:06 UTC. -- 2023-12-16T03:12:40.878 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi184/config 2023-12-16T03:12:41.300 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:40 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:41.301 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:40 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:41.301 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:40 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:41.301 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:40 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:41.301 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:40 smithi184 ceph-mon[121180]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:41.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:41.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:41.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:41.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:41.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:40 smithi064 ceph-mon[111958]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:41.813 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:12:41 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[135646]: 2023-12-16T03:12:41.582+0000 7f92ebd0e540 -1 osd.4 0 log_to_monitors true 2023-12-16T03:12:42.401 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-16T03:12:42.401 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-16T03:12:42.401 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2023-12-16T03:12:42.401 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2023-12-16T03:12:42.401 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115514 s, 908 MB/s 2023-12-16T03:12:42.401 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2023-12-16T03:12:42.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:42 smithi184 ceph-mon[121180]: from='osd.4 [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T03:12:42.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:42 smithi184 ceph-mon[121180]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T03:12:42.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:42 smithi064 ceph-mon[111958]: from='osd.4 [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T03:12:42.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:42 smithi064 ceph-mon[111958]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T03:12:42.822 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_2 2023-12-16T03:12:43.093 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi184/config 2023-12-16T03:12:43.560 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[135646]: 2023-12-16T03:12:43.253+0000 7f92e24f3700 -1 osd.4 0 waiting for initial osdmap 2023-12-16T03:12:43.560 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[135646]: 2023-12-16T03:12:43.262+0000 7f92dc2ec700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:12:43.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: osdmap e30: 5 total, 4 up, 5 in 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='osd.4 [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:43.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:43 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T03:12:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: osdmap e30: 5 total, 4 up, 5 in 2023-12-16T03:12:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='osd.4 [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:12:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:12:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T03:12:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:12:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:43 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 -- 172.21.15.184:0/326751522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fde00 msgr2=0x7f76380fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 --2- 172.21.15.184:0/326751522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fde00 0x7f76380fe250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f762c004940 tx=0x7f762c009e30 comp rx=0 tx=0).stop 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 -- 172.21.15.184:0/326751522 shutdown_connections 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 --2- 172.21.15.184:0/326751522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fde00 0x7f76380fe250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 --2- 172.21.15.184:0/326751522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76380fcbf0 0x7f76380fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 -- 172.21.15.184:0/326751522 >> 172.21.15.184:0/326751522 conn(0x7f76380f82d0 msgr2=0x7f76380fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 -- 172.21.15.184:0/326751522 shutdown_connections 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 -- 172.21.15.184:0/326751522 wait complete. 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 Processor -- start 2023-12-16T03:12:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 -- start start 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fcbf0 0x7f763810d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.142+0000 7f763dca2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76380fde00 0x7f763810dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f763dca2700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763810e160 con 0x7f76380fde00 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f763dca2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763810e9a0 con 0x7f76380fcbf0 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f76377fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fcbf0 0x7f763810d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f76377fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fcbf0 0x7f763810d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:39594/0 (socket says 172.21.15.184:39594) 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f76377fe700 1 -- 172.21.15.184:0/1079055283 learned_addr learned my addr 172.21.15.184:0/1079055283 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f7636ffd700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76380fde00 0x7f763810dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f76377fe700 1 -- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76380fde00 msgr2=0x7f763810dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f76377fe700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76380fde00 0x7f763810dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f76377fe700 1 -- 172.21.15.184:0/1079055283 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c005040 con 0x7f76380fcbf0 2023-12-16T03:12:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f76377fe700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fcbf0 0x7f763810d590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f762800b790 tx=0x7f7628009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:12:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f761ffff700 1 -- 172.21.15.184:0/1079055283 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f762800f6f0 con 0x7f76380fcbf0 2023-12-16T03:12:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763810ec80 con 0x7f76380fcbf0 2023-12-16T03:12:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f761ffff700 1 -- 172.21.15.184:0/1079055283 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f762800fd00 con 0x7f76380fcbf0 2023-12-16T03:12:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f761ffff700 1 -- 172.21.15.184:0/1079055283 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76280103a0 con 0x7f76380fcbf0 2023-12-16T03:12:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.143+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763810f1c0 con 0x7f76380fcbf0 2023-12-16T03:12:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.144+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763804bb80 con 0x7f76380fcbf0 2023-12-16T03:12:44.148 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.145+0000 7f761ffff700 1 -- 172.21.15.184:0/1079055283 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f762800f850 con 0x7f76380fcbf0 2023-12-16T03:12:44.148 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.145+0000 7f761ffff700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7620068f60 0x7f762006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:12:44.148 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.145+0000 7f761ffff700 1 -- 172.21.15.184:0/1079055283 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f76280865d0 con 0x7f76380fcbf0 2023-12-16T03:12:44.148 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.145+0000 7f7636ffd700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7620068f60 0x7f762006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:12:44.148 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.146+0000 7f7636ffd700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7620068f60 0x7f762006b410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f762c004560 tx=0x7f762c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:12:44.151 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.149+0000 7f761ffff700 1 -- 172.21.15.184:0/1079055283 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7628056ab0 con 0x7f76380fcbf0 2023-12-16T03:12:44.346 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:44.344+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f763810f670 con 0x7f7620068f60 2023-12-16T03:12:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:44 smithi184 ceph-mon[121180]: Detected new or changed devices on smithi184 2023-12-16T03:12:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:44 smithi184 ceph-mon[121180]: Adjusting osd_memory_target on smithi184 to 7985M 2023-12-16T03:12:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:44 smithi184 ceph-mon[121180]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-12-16T03:12:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:44 smithi184 ceph-mon[121180]: osdmap e31: 5 total, 4 up, 5 in 2023-12-16T03:12:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:44 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:44 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:44 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:44 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:44 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:44 smithi064 ceph-mon[111958]: Detected new or changed devices on smithi184 2023-12-16T03:12:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:44 smithi064 ceph-mon[111958]: Adjusting osd_memory_target on smithi184 to 7985M 2023-12-16T03:12:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:44 smithi064 ceph-mon[111958]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-12-16T03:12:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:44 smithi064 ceph-mon[111958]: osdmap e31: 5 total, 4 up, 5 in 2023-12-16T03:12:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:44 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:44 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:44 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:44 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:12:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:44 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:45.459 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: purged_snaps scrub starts 2023-12-16T03:12:45.459 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: purged_snaps scrub ok 2023-12-16T03:12:45.459 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: osd.4 [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] boot 2023-12-16T03:12:45.459 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: osdmap e32: 5 total, 5 up, 5 in 2023-12-16T03:12:45.459 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:45.459 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:12:45.459 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:45.459 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:12:45.459 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:12:45.460 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:45 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: purged_snaps scrub starts 2023-12-16T03:12:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: purged_snaps scrub ok 2023-12-16T03:12:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: osd.4 [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] boot 2023-12-16T03:12:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: osdmap e32: 5 total, 5 up, 5 in 2023-12-16T03:12:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:12:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:12:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T03:12:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T03:12:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:45 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:46.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:46 smithi184 ceph-mon[121180]: osdmap e33: 5 total, 5 up, 5 in 2023-12-16T03:12:46.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:46 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/2865384658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55282f72-d6e4-4f91-9285-9b81aa14a948"}]: dispatch 2023-12-16T03:12:46.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:46 smithi184 ceph-mon[121180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55282f72-d6e4-4f91-9285-9b81aa14a948"}]: dispatch 2023-12-16T03:12:46.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:46 smithi184 ceph-mon[121180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55282f72-d6e4-4f91-9285-9b81aa14a948"}]': finished 2023-12-16T03:12:46.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:46 smithi184 ceph-mon[121180]: osdmap e34: 6 total, 5 up, 6 in 2023-12-16T03:12:46.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:46 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:12:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:46 smithi064 ceph-mon[111958]: osdmap e33: 5 total, 5 up, 5 in 2023-12-16T03:12:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:46 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/2865384658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55282f72-d6e4-4f91-9285-9b81aa14a948"}]: dispatch 2023-12-16T03:12:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:46 smithi064 ceph-mon[111958]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55282f72-d6e4-4f91-9285-9b81aa14a948"}]: dispatch 2023-12-16T03:12:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:46 smithi064 ceph-mon[111958]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55282f72-d6e4-4f91-9285-9b81aa14a948"}]': finished 2023-12-16T03:12:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:46 smithi064 ceph-mon[111958]: osdmap e34: 6 total, 5 up, 6 in 2023-12-16T03:12:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:46 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:12:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:47 smithi184 ceph-mon[121180]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:47 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/3901791102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:12:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:47 smithi064 ceph-mon[111958]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:47 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/3901791102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T03:12:48.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:12:48.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:12:49.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:49 smithi184 ceph-mon[121180]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:49.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:49 smithi064 ceph-mon[111958]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:51.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:51 smithi184 ceph-mon[121180]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:51.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:51 smithi064 ceph-mon[111958]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:52.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:52 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T03:12:52.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:52 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:52.789 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:52 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T03:12:52.789 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:52 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:12:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:53 smithi184 ceph-mon[121180]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:53.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:53 smithi184 ceph-mon[121180]: Deploying daemon osd.5 on smithi184 2023-12-16T03:12:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:53 smithi064 ceph-mon[111958]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:53 smithi064 ceph-mon[111958]: Deploying daemon osd.5 on smithi184 2023-12-16T03:12:55.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:55 smithi184 ceph-mon[121180]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:55.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:55 smithi064 ceph-mon[111958]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:57.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:57.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:57.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:57.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:57 smithi184 ceph-mon[121180]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:57.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:57.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:57.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:12:57.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:57 smithi064 ceph-mon[111958]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:58.400 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.399+0000 7f761ffff700 1 -- 172.21.15.184:0/1079055283 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f763810f670 con 0x7f7620068f60 2023-12-16T03:12:58.401 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 5 on host 'smithi184' 2023-12-16T03:12:58.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.402+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7620068f60 msgr2=0x7f762006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:58.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.402+0000 7f763dca2700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7620068f60 0x7f762006b410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f762c004560 tx=0x7f762c009e30 comp rx=0 tx=0).stop 2023-12-16T03:12:58.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.402+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fcbf0 msgr2=0x7f763810d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:12:58.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.402+0000 7f763dca2700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fcbf0 0x7f763810d590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f762800b790 tx=0x7f7628009220 comp rx=0 tx=0).stop 2023-12-16T03:12:58.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.402+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 shutdown_connections 2023-12-16T03:12:58.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.402+0000 7f763dca2700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7620068f60 0x7f762006b410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:58.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.402+0000 7f763dca2700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76380fcbf0 0x7f763810d590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:58.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.402+0000 7f763dca2700 1 --2- 172.21.15.184:0/1079055283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76380fde00 0x7f763810dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:12:58.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.402+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 >> 172.21.15.184:0/1079055283 conn(0x7f76380f82d0 msgr2=0x7f7638101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:12:58.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.403+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 shutdown_connections 2023-12-16T03:12:58.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:12:58.403+0000 7f763dca2700 1 -- 172.21.15.184:0/1079055283 wait complete. 2023-12-16T03:12:58.791 DEBUG:teuthology.orchestra.run.smithi184:osd.5> sudo journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.5.service 2023-12-16T03:12:58.793 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-16T03:12:58.793 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T03:12:58.826 INFO:journalctl@ceph.osd.5.smithi184.stdout:-- Logs begin at Sat 2023-12-16 02:56:06 UTC. -- 2023-12-16T03:12:59.077 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:12:59.615 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:59 smithi064 ceph-mon[111958]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:59.615 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:59.615 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:59.615 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:59.615 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:12:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:59.631 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:59 smithi184 ceph-mon[121180]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:12:59.631 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:59.631 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:59.631 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:12:59.631 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:12:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:00.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.201+0000 7f1850eab700 1 -- 172.21.15.64:0/2131904383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fbaf0 msgr2=0x7f184c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.201+0000 7f1850eab700 1 --2- 172.21.15.64:0/2131904383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fbaf0 0x7f184c0fbf00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f183c004940 tx=0x7f183c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 -- 172.21.15.64:0/2131904383 shutdown_connections 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 --2- 172.21.15.64:0/2131904383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f184c0fcd00 0x7f184c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 --2- 172.21.15.64:0/2131904383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fbaf0 0x7f184c0fbf00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 -- 172.21.15.64:0/2131904383 >> 172.21.15.64:0/2131904383 conn(0x7f184c0f7190 msgr2=0x7f184c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 -- 172.21.15.64:0/2131904383 shutdown_connections 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 -- 172.21.15.64:0/2131904383 wait complete. 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 Processor -- start 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 -- start start 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f184c0fbaf0 0x7f184c1101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:00.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fcd00 0x7f184c112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c066130 con 0x7f184c0fcd00 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.202+0000 7f1850eab700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c066270 con 0x7f184c0fbaf0 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f1849d9b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fcd00 0x7f184c112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f184a59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f184c0fbaf0 0x7f184c1101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f1849d9b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fcd00 0x7f184c112740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46094/0 (socket says 172.21.15.64:46094) 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f1849d9b700 1 -- 172.21.15.64:0/3542629260 learned_addr learned my addr 172.21.15.64:0/3542629260 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f1849d9b700 1 -- 172.21.15.64:0/3542629260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f184c0fbaf0 msgr2=0x7f184c1101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f1849d9b700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f184c0fbaf0 0x7f184c1101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f1849d9b700 1 -- 172.21.15.64:0/3542629260 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c005040 con 0x7f184c0fcd00 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f1849d9b700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fcd00 0x7f184c112740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f184000eb40 tx=0x7f184000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f183affd700 1 -- 172.21.15.64:0/3542629260 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1840007cc0 con 0x7f184c0fcd00 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c112d40 con 0x7f184c0fcd00 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f183affd700 1 -- 172.21.15.64:0/3542629260 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f184000f040 con 0x7f184c0fcd00 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f183affd700 1 -- 172.21.15.64:0/3542629260 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184000c990 con 0x7f184c0fcd00 2023-12-16T03:13:00.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.203+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c113230 con 0x7f184c0fcd00 2023-12-16T03:13:00.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.204+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c04bb80 con 0x7f184c0fcd00 2023-12-16T03:13:00.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.205+0000 7f183affd700 1 -- 172.21.15.64:0/3542629260 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f184000cc00 con 0x7f184c0fcd00 2023-12-16T03:13:00.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.205+0000 7f183affd700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1834068f60 0x7f183406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:00.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.205+0000 7f183affd700 1 -- 172.21.15.64:0/3542629260 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4317+0+0 (secure 0 0 0) 0x7f1840086510 con 0x7f184c0fcd00 2023-12-16T03:13:00.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.205+0000 7f184a59c700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1834068f60 0x7f183406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:00.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.205+0000 7f184a59c700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1834068f60 0x7f183406b410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f183c009fd0 tx=0x7f183c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:00.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.210+0000 7f183affd700 1 -- 172.21.15.64:0/3542629260 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f184004da00 con 0x7f184c0fcd00 2023-12-16T03:13:00.310 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:13:00 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[143756]: 2023-12-16T03:13:00.046+0000 7f1cb3686540 -1 osd.5 0 log_to_monitors true 2023-12-16T03:13:00.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.406+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f184c104490 con 0x7f184c0fcd00 2023-12-16T03:13:00.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.406+0000 7f183affd700 1 -- 172.21.15.64:0/3542629260 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) v1 ==== 74+0+130 (secure 0 0 0) 0x7f1840052e90 con 0x7f184c0fcd00 2023-12-16T03:13:00.408 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.408+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1834068f60 msgr2=0x7f183406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.408+0000 7f1850eab700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1834068f60 0x7f183406b410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f183c009fd0 tx=0x7f183c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.408+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fcd00 msgr2=0x7f184c112740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.408+0000 7f1850eab700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fcd00 0x7f184c112740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f184000eb40 tx=0x7f184000b040 comp rx=0 tx=0).stop 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.409+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 shutdown_connections 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.409+0000 7f1850eab700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1834068f60 0x7f183406b410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.409+0000 7f1850eab700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f184c0fbaf0 0x7f184c1101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.409+0000 7f1850eab700 1 --2- 172.21.15.64:0/3542629260 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f184c0fcd00 0x7f184c112740 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.409+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 >> 172.21.15.64:0/3542629260 conn(0x7f184c0f7190 msgr2=0x7f184c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.409+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 shutdown_connections 2023-12-16T03:13:00.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:00.409+0000 7f1850eab700 1 -- 172.21.15.64:0/3542629260 wait complete. 2023-12-16T03:13:00.647 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:00 smithi064 ceph-mon[111958]: from='osd.5 [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T03:13:00.647 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:00 smithi064 ceph-mon[111958]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T03:13:00.656 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:00 smithi184 ceph-mon[121180]: from='osd.5 [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T03:13:00.657 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:00 smithi184 ceph-mon[121180]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T03:13:00.853 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1702696364,"num_in_osds":6,"osd_in_since":1702696366,"num_remapped_pgs":0} 2023-12-16T03:13:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:13:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T03:13:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: osdmap e35: 6 total, 5 up, 6 in 2023-12-16T03:13:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:13:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='osd.5 [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:13:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3542629260' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:13:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.810 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[143756]: 2023-12-16T03:13:01.381+0000 7f1ca9e6b700 -1 osd.5 0 waiting for initial osdmap 2023-12-16T03:13:01.810 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[143756]: 2023-12-16T03:13:01.390+0000 7f1ca4c66700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:13:01.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: osdmap e35: 6 total, 5 up, 6 in 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='osd.5 [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3542629260' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:13:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:13:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:13:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:01.853 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T03:13:02.130 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:02.630 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:02 smithi064 ceph-mon[111958]: Detected new or changed devices on smithi184 2023-12-16T03:13:02.630 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:02 smithi064 ceph-mon[111958]: Adjusting osd_memory_target on smithi184 to 5323M 2023-12-16T03:13:02.630 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:02 smithi064 ceph-mon[111958]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-12-16T03:13:02.630 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:02 smithi064 ceph-mon[111958]: osdmap e36: 6 total, 5 up, 6 in 2023-12-16T03:13:02.630 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:13:02.630 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:13:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:02 smithi184 ceph-mon[121180]: Detected new or changed devices on smithi184 2023-12-16T03:13:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:02 smithi184 ceph-mon[121180]: Adjusting osd_memory_target on smithi184 to 5323M 2023-12-16T03:13:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:02 smithi184 ceph-mon[121180]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-12-16T03:13:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:02 smithi184 ceph-mon[121180]: osdmap e36: 6 total, 5 up, 6 in 2023-12-16T03:13:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:13:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:13:03.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.233+0000 7f92350c7700 1 -- 172.21.15.64:0/665347739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 msgr2=0x7f92300fbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:03.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.233+0000 7f92350c7700 1 --2- 172.21.15.64:0/665347739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 0x7f92300fbe90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9220004940 tx=0x7f9220009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:03.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.233+0000 7f92350c7700 1 -- 172.21.15.64:0/665347739 shutdown_connections 2023-12-16T03:13:03.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.233+0000 7f92350c7700 1 --2- 172.21.15.64:0/665347739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92300fcd30 0x7f92300fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:03.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.233+0000 7f92350c7700 1 --2- 172.21.15.64:0/665347739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 0x7f92300fbe90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:03.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.233+0000 7f92350c7700 1 -- 172.21.15.64:0/665347739 >> 172.21.15.64:0/665347739 conn(0x7f92300f71e0 msgr2=0x7f92300f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.233+0000 7f92350c7700 1 -- 172.21.15.64:0/665347739 shutdown_connections 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.233+0000 7f92350c7700 1 -- 172.21.15.64:0/665347739 wait complete. 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.233+0000 7f92350c7700 1 Processor -- start 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f92350c7700 1 -- start start 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f92350c7700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 0x7f923010d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f92350c7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92300fcd30 0x7f923010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f92350c7700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923010df30 con 0x7f92300fba80 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f92350c7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923010e7d0 con 0x7f92300fcd30 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f922ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 0x7f923010d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f922ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 0x7f923010d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47146/0 (socket says 172.21.15.64:47146) 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f922ed9d700 1 -- 172.21.15.64:0/783299051 learned_addr learned my addr 172.21.15.64:0/783299051 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f922e59c700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92300fcd30 0x7f923010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f922ed9d700 1 -- 172.21.15.64:0/783299051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92300fcd30 msgr2=0x7f923010d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:03.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f922ed9d700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92300fcd30 0x7f923010d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:03.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f922ed9d700 1 -- 172.21.15.64:0/783299051 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220005040 con 0x7f92300fba80 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f922ed9d700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 0x7f923010d3f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9220009fd0 tx=0x7f9220009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f92177fe700 1 -- 172.21.15.64:0/783299051 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f922000e040 con 0x7f92300fba80 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923010ea50 con 0x7f92300fba80 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f92177fe700 1 -- 172.21.15.64:0/783299051 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9220004290 con 0x7f92300fba80 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.234+0000 7f92177fe700 1 -- 172.21.15.64:0/783299051 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f922001c3f0 con 0x7f92300fba80 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.235+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923010ef90 con 0x7f92300fba80 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.235+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923004bb80 con 0x7f92300fba80 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.236+0000 7f92177fe700 1 -- 172.21.15.64:0/783299051 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f922000bc50 con 0x7f92300fba80 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.236+0000 7f92177fe700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9218068f70 0x7f921806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.236+0000 7f92177fe700 1 -- 172.21.15.64:0/783299051 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9220087e40 con 0x7f92300fba80 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.236+0000 7f922e59c700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9218068f70 0x7f921806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.237+0000 7f922e59c700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9218068f70 0x7f921806b420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92240041d0 tx=0x7f92240043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:03.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.241+0000 7f92177fe700 1 -- 172.21.15.64:0/783299051 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f92200580e0 con 0x7f92300fba80 2023-12-16T03:13:03.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.437+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9230104430 con 0x7f92300fba80 2023-12-16T03:13:03.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.437+0000 7f92177fe700 1 -- 172.21.15.64:0/783299051 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f9220057c70 con 0x7f92300fba80 2023-12-16T03:13:03.438 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9218068f70 msgr2=0x7f921806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9218068f70 0x7f921806b420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92240041d0 tx=0x7f92240043c0 comp rx=0 tx=0).stop 2023-12-16T03:13:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 msgr2=0x7f923010d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 0x7f923010d3f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9220009fd0 tx=0x7f9220009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 shutdown_connections 2023-12-16T03:13:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9218068f70 0x7f921806b420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92300fba80 0x7f923010d3f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:03.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 --2- 172.21.15.64:0/783299051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92300fcd30 0x7f923010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:03.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 >> 172.21.15.64:0/783299051 conn(0x7f92300f71e0 msgr2=0x7f9230065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:03.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 shutdown_connections 2023-12-16T03:13:03.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:03.439+0000 7f92350c7700 1 -- 172.21.15.64:0/783299051 wait complete. 2023-12-16T03:13:03.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:03 smithi064 ceph-mon[111958]: purged_snaps scrub starts 2023-12-16T03:13:03.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:03 smithi064 ceph-mon[111958]: purged_snaps scrub ok 2023-12-16T03:13:03.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:03 smithi064 ceph-mon[111958]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:13:03.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:13:03.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:03 smithi064 ceph-mon[111958]: osd.5 [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] boot 2023-12-16T03:13:03.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:03 smithi064 ceph-mon[111958]: osdmap e37: 6 total, 6 up, 6 in 2023-12-16T03:13:03.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:13:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:03 smithi184 ceph-mon[121180]: purged_snaps scrub starts 2023-12-16T03:13:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:03 smithi184 ceph-mon[121180]: purged_snaps scrub ok 2023-12-16T03:13:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:03 smithi184 ceph-mon[121180]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T03:13:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:13:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:03 smithi184 ceph-mon[121180]: osd.5 [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] boot 2023-12-16T03:13:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:03 smithi184 ceph-mon[121180]: osdmap e37: 6 total, 6 up, 6 in 2023-12-16T03:13:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:13:03.859 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1702696382,"num_in_osds":6,"osd_in_since":1702696366,"num_remapped_pgs":0} 2023-12-16T03:13:03.860 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T03:13:04.131 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:04.670 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:04 smithi064 ceph-mon[111958]: osdmap e38: 6 total, 6 up, 6 in 2023-12-16T03:13:04.670 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:04 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/783299051' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T03:13:04.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:04 smithi184 ceph-mon[121180]: osdmap e38: 6 total, 6 up, 6 in 2023-12-16T03:13:04.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:04 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/783299051' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T03:13:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.172+0000 7f176d089700 1 -- 172.21.15.64:0/3688892737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 msgr2=0x7f17680fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.172+0000 7f176d089700 1 --2- 172.21.15.64:0/3688892737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 0x7f17680fbfb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1758004940 tx=0x7f1758009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.172+0000 7f176d089700 1 -- 172.21.15.64:0/3688892737 shutdown_connections 2023-12-16T03:13:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.172+0000 7f176d089700 1 --2- 172.21.15.64:0/3688892737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 0x7f17680fbfb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.172+0000 7f176d089700 1 --2- 172.21.15.64:0/3688892737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1768101b00 0x7f1768101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.172+0000 7f176d089700 1 -- 172.21.15.64:0/3688892737 >> 172.21.15.64:0/3688892737 conn(0x7f17680719b0 msgr2=0x7f1768071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.172+0000 7f176d089700 1 -- 172.21.15.64:0/3688892737 shutdown_connections 2023-12-16T03:13:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.172+0000 7f176d089700 1 -- 172.21.15.64:0/3688892737 wait complete. 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f176d089700 1 Processor -- start 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f176d089700 1 -- start start 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f176d089700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 0x7f1768112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f176d089700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1768101b00 0x7f1768112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f176d089700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17681131d0 con 0x7f17680fbb40 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f176d089700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176810c4c0 con 0x7f1768101b00 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f1766d9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 0x7f1768112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f1766d9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 0x7f1768112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47168/0 (socket says 172.21.15.64:47168) 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f1766d9d700 1 -- 172.21.15.64:0/1754466229 learned_addr learned my addr 172.21.15.64:0/1754466229 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f176659c700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1768101b00 0x7f1768112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f1766d9d700 1 -- 172.21.15.64:0/1754466229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1768101b00 msgr2=0x7f1768112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f1766d9d700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1768101b00 0x7f1768112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f1766d9d700 1 -- 172.21.15.64:0/1754466229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758005040 con 0x7f17680fbb40 2023-12-16T03:13:05.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.173+0000 7f176659c700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1768101b00 0x7f1768112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:13:05.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.174+0000 7f1766d9d700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 0x7f1768112640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f175000ead0 tx=0x7f1750004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:05.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.174+0000 7f175f7fe700 1 -- 172.21.15.64:0/1754466229 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f175000cc60 con 0x7f17680fbb40 2023-12-16T03:13:05.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.174+0000 7f175f7fe700 1 -- 172.21.15.64:0/1754466229 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f175000cdc0 con 0x7f17680fbb40 2023-12-16T03:13:05.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.174+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176810c740 con 0x7f17680fbb40 2023-12-16T03:13:05.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.174+0000 7f175f7fe700 1 -- 172.21.15.64:0/1754466229 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17500108f0 con 0x7f17680fbb40 2023-12-16T03:13:05.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.174+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176810cc80 con 0x7f17680fbb40 2023-12-16T03:13:05.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.175+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17681122f0 con 0x7f17680fbb40 2023-12-16T03:13:05.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.175+0000 7f175f7fe700 1 -- 172.21.15.64:0/1754466229 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1750010a50 con 0x7f17680fbb40 2023-12-16T03:13:05.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.175+0000 7f175f7fe700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1754068f60 0x7f175406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:05.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.176+0000 7f175f7fe700 1 -- 172.21.15.64:0/1754466229 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1750089340 con 0x7f17680fbb40 2023-12-16T03:13:05.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.176+0000 7f176659c700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1754068f60 0x7f175406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:05.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.176+0000 7f176659c700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1754068f60 0x7f175406b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1758004560 tx=0x7f1758009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:05.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.180+0000 7f175f7fe700 1 -- 172.21.15.64:0/1754466229 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f17500595e0 con 0x7f17680fbb40 2023-12-16T03:13:05.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.375+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17680734d0 con 0x7f17680fbb40 2023-12-16T03:13:05.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.376+0000 7f175f7fe700 1 -- 172.21.15.64:0/1754466229 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11068 (secure 0 0 0) 0x7f1750059170 con 0x7f17680fbb40 2023-12-16T03:13:05.377 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:05.377 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":38,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","created":"2023-12-16T03:08:52.761746+0000","modified":"2023-12-16T03:13:03.385313+0000","last_up_change":"2023-12-16T03:13:02.379717+0000","last_in_change":"2023-12-16T03:12:46.192351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:12:08.817940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"94788c05-539e-4b9d-aaa5-099f071ba934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6803","nonce":227243716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6805","nonce":227243716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6809","nonce":227243716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6807","nonce":227243716}]},"public_addr":"172.21.15.64:6803/227243716","cluster_addr":"172.21.15.64:6805/227243716","heartbeat_back_addr":"172.21.15.64:6809/227243716","heartbeat_front_addr":"172.21.15.64:6807/227243716","state":["exists","up"]},{"osd":1,"uuid":"b08e3c59-129c-4baf-89ee-61012384a515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6811","nonce":2843022610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6813","nonce":2843022610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6817","nonce":2843022610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6815","nonce":2843022610}]},"public_addr":"172.21.15.64:6811/2843022610","cluster_addr":"172.21.15.64:6813/2843022610","heartbeat_back_addr":"172.21.15.64:6817/2843022610","heartbeat_front_addr":"172.21.15.64:6815/2843022610","state":["exists","up"]},{"osd":2,"uuid":"18ed018b-ab10-4041-86f5-393af106517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6819","nonce":2485820557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6821","nonce":2485820557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6825","nonce":2485820557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6823","nonce":2485820557}]},"public_addr":"172.21.15.64:6819/2485820557","cluster_addr":"172.21.15.64:6821/2485820557","heartbeat_back_addr":"172.21.15.64:6825/2485820557","heartbeat_front_addr":"172.21.15.64:6823/2485820557","state":["exists","up"]},{"osd":3,"uuid":"de1cc449-de96-410d-9a56-210aae20b3d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6801","nonce":222462294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6803","nonce":222462294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6807","nonce":222462294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6805","nonce":222462294}]},"public_addr":"172.21.15.184:6801/222462294","cluster_addr":"172.21.15.184:6803/222462294","heartbeat_back_addr":"172.21.15.184:6807/222462294","heartbeat_front_addr":"172.21.15.184:6805/222462294","state":["exists","up"]},{"osd":4,"uuid":"4dda63b7-8319-476c-8bb6-60dbb2aa1e92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6809","nonce":3289979784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6811","nonce":3289979784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6815","nonce":3289979784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6813","nonce":3289979784}]},"public_addr":"172.21.15.184:6809/3289979784","cluster_addr":"172.21.15.184:6811/3289979784","heartbeat_back_addr":"172.21.15.184:6815/3289979784","heartbeat_front_addr":"172.21.15.184:6813/3289979784","state":["exists","up"]},{"osd":5,"uuid":"55282f72-d6e4-4f91-9285-9b81aa14a948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6817","nonce":4080162917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6819","nonce":4080162917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6823","nonce":4080162917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6821","nonce":4080162917}]},"public_addr":"172.21.15.184:6817/4080162917","cluster_addr":"172.21.15.184:6819/4080162917","heartbeat_back_addr":"172.21.15.184:6823/4080162917","heartbeat_front_addr":"172.21.15.184:6821/4080162917","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:24.502427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:45.326372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:05.862744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:24.099546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:42.577575+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:13:01.012096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6800/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/74591443":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/1123447957":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/3738748261":"2023-12-17T03:10:32.323993+0000","172.21.15.64:6801/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6800/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/3838233490":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/4039513088":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/2708172205":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6800/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/277874032":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/1829112257":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/1577100459":"2023-12-17T03:09:16.219813+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1754068f60 msgr2=0x7f175406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1754068f60 0x7f175406b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1758004560 tx=0x7f1758009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 msgr2=0x7f1768112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 0x7f1768112640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f175000ead0 tx=0x7f1750004500 comp rx=0 tx=0).stop 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 shutdown_connections 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1754068f60 0x7f175406b410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17680fbb40 0x7f1768112640 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 --2- 172.21.15.64:0/1754466229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1768101b00 0x7f1768112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 >> 172.21.15.64:0/1754466229 conn(0x7f17680719b0 msgr2=0x7f17680fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:05.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 shutdown_connections 2023-12-16T03:13:05.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:05.378+0000 7f176d089700 1 -- 172.21.15.64:0/1754466229 wait complete. 2023-12-16T03:13:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:05 smithi064 ceph-mon[111958]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:05 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1754466229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:13:05.758 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:12:08.817940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-16T03:13:05.758 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-16T03:13:05.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:05 smithi184 ceph-mon[121180]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:05.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:05 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1754466229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:13:06.029 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.116+0000 7efe74960700 1 -- 172.21.15.64:0/3055476875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 msgr2=0x7efe700fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.116+0000 7efe74960700 1 --2- 172.21.15.64:0/3055476875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 0x7efe700fbfb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efe64004940 tx=0x7efe64009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.116+0000 7efe74960700 1 -- 172.21.15.64:0/3055476875 shutdown_connections 2023-12-16T03:13:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.116+0000 7efe74960700 1 --2- 172.21.15.64:0/3055476875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 0x7efe700fbfb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.116+0000 7efe74960700 1 --2- 172.21.15.64:0/3055476875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe70101b00 0x7efe70101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.116+0000 7efe74960700 1 -- 172.21.15.64:0/3055476875 >> 172.21.15.64:0/3055476875 conn(0x7efe700719b0 msgr2=0x7efe70071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.116+0000 7efe74960700 1 -- 172.21.15.64:0/3055476875 shutdown_connections 2023-12-16T03:13:07.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.116+0000 7efe74960700 1 -- 172.21.15.64:0/3055476875 wait complete. 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe74960700 1 Processor -- start 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe74960700 1 -- start start 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe74960700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 0x7efe701136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe74960700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe70101b00 0x7efe70113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe74960700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe70114290 con 0x7efe700fbb40 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe74960700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7010d580 con 0x7efe70101b00 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe6e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 0x7efe701136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe6e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 0x7efe701136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47186/0 (socket says 172.21.15.64:47186) 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe6e59c700 1 -- 172.21.15.64:0/2705332123 learned_addr learned my addr 172.21.15.64:0/2705332123 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe6dd9b700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe70101b00 0x7efe70113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe6e59c700 1 -- 172.21.15.64:0/2705332123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe70101b00 msgr2=0x7efe70113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe6e59c700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe70101b00 0x7efe70113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe6e59c700 1 -- 172.21.15.64:0/2705332123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe64005040 con 0x7efe700fbb40 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.117+0000 7efe6e59c700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 0x7efe701136c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c830 tx=0x7efe60004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:07.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.118+0000 7efe5effd700 1 -- 172.21.15.64:0/2705332123 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe600106f0 con 0x7efe700fbb40 2023-12-16T03:13:07.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.118+0000 7efe5effd700 1 -- 172.21.15.64:0/2705332123 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe60010d00 con 0x7efe700fbb40 2023-12-16T03:13:07.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.118+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7010d810 con 0x7efe700fbb40 2023-12-16T03:13:07.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.118+0000 7efe5effd700 1 -- 172.21.15.64:0/2705332123 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe60012e90 con 0x7efe700fbb40 2023-12-16T03:13:07.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.118+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7010dd50 con 0x7efe700fbb40 2023-12-16T03:13:07.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.118+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe700734d0 con 0x7efe700fbb40 2023-12-16T03:13:07.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.119+0000 7efe5effd700 1 -- 172.21.15.64:0/2705332123 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7efe60010850 con 0x7efe700fbb40 2023-12-16T03:13:07.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.119+0000 7efe5effd700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7efe58068f70 0x7efe5806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:07.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.119+0000 7efe5effd700 1 -- 172.21.15.64:0/2705332123 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efe600869f0 con 0x7efe700fbb40 2023-12-16T03:13:07.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.120+0000 7efe6dd9b700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7efe58068f70 0x7efe5806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:07.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.120+0000 7efe6dd9b700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7efe58068f70 0x7efe5806b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efe7010ef60 tx=0x7efe64009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:07.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.124+0000 7efe5effd700 1 -- 172.21.15.64:0/2705332123 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efe60088e60 con 0x7efe700fbb40 2023-12-16T03:13:07.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.318+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe7010ed40 con 0x7efe700fbb40 2023-12-16T03:13:07.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.318+0000 7efe5effd700 1 -- 172.21.15.64:0/2705332123 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe60056d40 con 0x7efe700fbb40 2023-12-16T03:13:07.320 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-12-16T03:13:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7efe58068f70 msgr2=0x7efe5806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7efe58068f70 0x7efe5806b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efe7010ef60 tx=0x7efe64009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 msgr2=0x7efe701136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 0x7efe701136c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c830 tx=0x7efe60004470 comp rx=0 tx=0).stop 2023-12-16T03:13:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 shutdown_connections 2023-12-16T03:13:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7efe58068f70 0x7efe5806b420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe700fbb40 0x7efe701136c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:07.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 --2- 172.21.15.64:0/2705332123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe70101b00 0x7efe70113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 >> 172.21.15.64:0/2705332123 conn(0x7efe700719b0 msgr2=0x7efe70065550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 shutdown_connections 2023-12-16T03:13:07.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:07.320+0000 7efe74960700 1 -- 172.21.15.64:0/2705332123 wait complete. 2023-12-16T03:13:07.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:07 smithi184 ceph-mon[121180]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:07.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:07 smithi064 ceph-mon[111958]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:07.692 INFO:tasks.cephadm:Setting up client nodes... 2023-12-16T03:13:07.693 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-16T03:13:07.961 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:08 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2705332123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T03:13:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:08 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2705332123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T03:13:09.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 -- 172.21.15.64:0/2326122044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fbaf0 msgr2=0x7f2a700fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:09.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 --2- 172.21.15.64:0/2326122044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fbaf0 0x7f2a700fbf00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2a64004940 tx=0x7f2a64009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:09.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 -- 172.21.15.64:0/2326122044 shutdown_connections 2023-12-16T03:13:09.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 --2- 172.21.15.64:0/2326122044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a700fcd00 0x7f2a700fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:09.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 --2- 172.21.15.64:0/2326122044 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fbaf0 0x7f2a700fbf00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:09.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 -- 172.21.15.64:0/2326122044 >> 172.21.15.64:0/2326122044 conn(0x7f2a700f71d0 msgr2=0x7f2a700f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:09.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 -- 172.21.15.64:0/2326122044 shutdown_connections 2023-12-16T03:13:09.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 -- 172.21.15.64:0/2326122044 wait complete. 2023-12-16T03:13:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 Processor -- start 2023-12-16T03:13:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.118+0000 7f2a76e32700 1 -- start start 2023-12-16T03:13:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a76e32700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a700fbaf0 0x7f2a700ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a76e32700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fcd00 0x7f2a700fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a76e32700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700fe6d0 con 0x7f2a700fcd00 2023-12-16T03:13:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a76e32700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700fe840 con 0x7f2a700fbaf0 2023-12-16T03:13:09.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fcd00 0x7f2a700fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:09.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fcd00 0x7f2a700fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47206/0 (socket says 172.21.15.64:47206) 2023-12-16T03:13:09.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6ffff700 1 -- 172.21.15.64:0/547121489 learned_addr learned my addr 172.21.15.64:0/547121489 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:09.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a74bce700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a700fbaf0 0x7f2a700ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:09.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6ffff700 1 -- 172.21.15.64:0/547121489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a700fbaf0 msgr2=0x7f2a700ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:09.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6ffff700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a700fbaf0 0x7f2a700ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:09.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6ffff700 1 -- 172.21.15.64:0/547121489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64005040 con 0x7f2a700fcd00 2023-12-16T03:13:09.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a74bce700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a700fbaf0 0x7f2a700ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:13:09.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6ffff700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fcd00 0x7f2a700fe040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00b790 tx=0x7f2a5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:09.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6d7fa700 1 -- 172.21.15.64:0/547121489 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a5c00f770 con 0x7f2a700fcd00 2023-12-16T03:13:09.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6d7fa700 1 -- 172.21.15.64:0/547121489 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a5c00fd80 con 0x7f2a700fcd00 2023-12-16T03:13:09.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a700feb20 con 0x7f2a700fcd00 2023-12-16T03:13:09.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.119+0000 7f2a6d7fa700 1 -- 172.21.15.64:0/547121489 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a5c00d310 con 0x7f2a700fcd00 2023-12-16T03:13:09.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.120+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a700feea0 con 0x7f2a700fcd00 2023-12-16T03:13:09.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.120+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7004bb80 con 0x7f2a700fcd00 2023-12-16T03:13:09.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.121+0000 7f2a6d7fa700 1 -- 172.21.15.64:0/547121489 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2a5c010420 con 0x7f2a700fcd00 2023-12-16T03:13:09.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.121+0000 7f2a6d7fa700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a60068f60 0x7f2a6006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:09.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.121+0000 7f2a6d7fa700 1 -- 172.21.15.64:0/547121489 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2a5c086a40 con 0x7f2a700fcd00 2023-12-16T03:13:09.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.121+0000 7f2a74bce700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a60068f60 0x7f2a6006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:09.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.122+0000 7f2a74bce700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a60068f60 0x7f2a6006b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a64004890 tx=0x7f2a64009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:09.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.126+0000 7f2a6d7fa700 1 -- 172.21.15.64:0/547121489 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2a5c056ce0 con 0x7f2a700fcd00 2023-12-16T03:13:09.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.398+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f2a701159e0 con 0x7f2a700fcd00 2023-12-16T03:13:09.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.402+0000 7f2a6d7fa700 1 -- 172.21.15.64:0/547121489 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f2a5c056870 con 0x7f2a700fcd00 2023-12-16T03:13:09.403 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2023-12-16T03:13:09.403 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQDFFX1lfAjKFxAAd2WSWqJu7Z8wx93ld/QWjA== 2023-12-16T03:13:09.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a60068f60 msgr2=0x7f2a6006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:09.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a60068f60 0x7f2a6006b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a64004890 tx=0x7f2a64009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:09.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fcd00 msgr2=0x7f2a700fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:09.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fcd00 0x7f2a700fe040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00b790 tx=0x7f2a5c009250 comp rx=0 tx=0).stop 2023-12-16T03:13:09.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 shutdown_connections 2023-12-16T03:13:09.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a60068f60 0x7f2a6006b410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:09.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a700fbaf0 0x7f2a700ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:09.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 --2- 172.21.15.64:0/547121489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a700fcd00 0x7f2a700fe040 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:09.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 >> 172.21.15.64:0/547121489 conn(0x7f2a700f71d0 msgr2=0x7f2a70065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:09.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 shutdown_connections 2023-12-16T03:13:09.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:09.404+0000 7f2a76e32700 1 -- 172.21.15.64:0/547121489 wait complete. 2023-12-16T03:13:09.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:09 smithi184 ceph-mon[121180]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:09.629 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:09 smithi064 ceph-mon[111958]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:09.845 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:13:09.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-16T03:13:09.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-16T03:13:09.885 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-16T03:13:10.162 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi184/config 2023-12-16T03:13:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:10 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/547121489' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T03:13:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:10 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/547121489' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T03:13:10.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:10 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/547121489' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T03:13:10.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:10 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/547121489' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T03:13:11.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.244+0000 7f8994a0d700 1 -- 172.21.15.184:0/2866866221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 msgr2=0x7f89900fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:11.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.244+0000 7f8994a0d700 1 --2- 172.21.15.184:0/2866866221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 0x7f89900fd000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8980004940 tx=0x7f8980009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:11.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.244+0000 7f8994a0d700 1 -- 172.21.15.184:0/2866866221 shutdown_connections 2023-12-16T03:13:11.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.244+0000 7f8994a0d700 1 --2- 172.21.15.184:0/2866866221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89900fde00 0x7f89900fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:11.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.244+0000 7f8994a0d700 1 --2- 172.21.15.184:0/2866866221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 0x7f89900fd000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:11.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.244+0000 7f8994a0d700 1 -- 172.21.15.184:0/2866866221 >> 172.21.15.184:0/2866866221 conn(0x7f89900f82d0 msgr2=0x7f89900fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:11.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.244+0000 7f8994a0d700 1 -- 172.21.15.184:0/2866866221 shutdown_connections 2023-12-16T03:13:11.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.244+0000 7f8994a0d700 1 -- 172.21.15.184:0/2866866221 wait complete. 2023-12-16T03:13:11.248 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f8994a0d700 1 Processor -- start 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f8994a0d700 1 -- start start 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f8994a0d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 0x7f899010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f8994a0d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89900fde00 0x7f899010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f8994a0d700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899010e010 con 0x7f89900fde00 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f8994a0d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899010e8b0 con 0x7f89900fcbf0 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f898e59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 0x7f899010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f898e59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 0x7f899010d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44340/0 (socket says 172.21.15.184:44340) 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f898e59c700 1 -- 172.21.15.184:0/3278994758 learned_addr learned my addr 172.21.15.184:0/3278994758 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f898dd9b700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89900fde00 0x7f899010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f898e59c700 1 -- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89900fde00 msgr2=0x7f899010da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f898e59c700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89900fde00 0x7f899010da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f898e59c700 1 -- 172.21.15.184:0/3278994758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8980005040 con 0x7f89900fcbf0 2023-12-16T03:13:11.249 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f898dd9b700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89900fde00 0x7f899010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:13:11.250 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.245+0000 7f898e59c700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 0x7f899010d4d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8980000c00 tx=0x7f8980009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:11.250 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.246+0000 7f897effd700 1 -- 172.21.15.184:0/3278994758 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f898000e040 con 0x7f89900fcbf0 2023-12-16T03:13:11.250 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.246+0000 7f897effd700 1 -- 172.21.15.184:0/3278994758 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f898000bc50 con 0x7f89900fcbf0 2023-12-16T03:13:11.250 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.246+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899010eb30 con 0x7f89900fcbf0 2023-12-16T03:13:11.250 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.246+0000 7f897effd700 1 -- 172.21.15.184:0/3278994758 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f898001c630 con 0x7f89900fcbf0 2023-12-16T03:13:11.250 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.246+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899010f070 con 0x7f89900fcbf0 2023-12-16T03:13:11.251 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.247+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899004bb80 con 0x7f89900fcbf0 2023-12-16T03:13:11.251 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.247+0000 7f897effd700 1 -- 172.21.15.184:0/3278994758 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8980013420 con 0x7f89900fcbf0 2023-12-16T03:13:11.251 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.248+0000 7f897effd700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8978068f70 0x7f897806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:11.251 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.248+0000 7f897effd700 1 -- 172.21.15.184:0/3278994758 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8980088920 con 0x7f89900fcbf0 2023-12-16T03:13:11.251 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.248+0000 7f898dd9b700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8978068f70 0x7f897806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:11.251 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.249+0000 7f898dd9b700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8978068f70 0x7f897806b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8984007fd0 tx=0x7f8984009f60 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:11.253 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.252+0000 7f897effd700 1 -- 172.21.15.184:0/3278994758 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8980058b60 con 0x7f89900fcbf0 2023-12-16T03:13:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:11 smithi184 ceph-mon[121180]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:11.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.509+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f899010f450 con 0x7f89900fcbf0 2023-12-16T03:13:11.518 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.516+0000 7f897effd700 1 -- 172.21.15.184:0/3278994758 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f89800586f0 con 0x7f89900fcbf0 2023-12-16T03:13:11.518 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2023-12-16T03:13:11.518 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDHFX1lSpCBHhAAFrnY7/hLrtPW1mlRI9CoZQ== 2023-12-16T03:13:11.520 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.518+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8978068f70 msgr2=0x7f897806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:11.520 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.518+0000 7f8994a0d700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8978068f70 0x7f897806b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8984007fd0 tx=0x7f8984009f60 comp rx=0 tx=0).stop 2023-12-16T03:13:11.520 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.518+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 msgr2=0x7f899010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:11.521 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.518+0000 7f8994a0d700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 0x7f899010d4d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8980000c00 tx=0x7f8980009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:11.521 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.519+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 shutdown_connections 2023-12-16T03:13:11.521 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.519+0000 7f8994a0d700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8978068f70 0x7f897806b420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:11.521 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.519+0000 7f8994a0d700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89900fcbf0 0x7f899010d4d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:11.521 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.519+0000 7f8994a0d700 1 --2- 172.21.15.184:0/3278994758 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89900fde00 0x7f899010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:11.521 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.519+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 >> 172.21.15.184:0/3278994758 conn(0x7f89900f82d0 msgr2=0x7f8990101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:11.521 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.519+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 shutdown_connections 2023-12-16T03:13:11.521 INFO:teuthology.orchestra.run.smithi184.stderr:2023-12-16T03:13:11.519+0000 7f8994a0d700 1 -- 172.21.15.184:0/3278994758 wait complete. 2023-12-16T03:13:11.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:11 smithi064 ceph-mon[111958]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:11.936 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:13:11.936 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-16T03:13:11.936 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-16T03:13:11.977 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-16T03:13:11.977 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-16T03:13:11.978 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph mgr dump --format=json 2023-12-16T03:13:12.259 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:12.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:12 smithi184 ceph-mon[121180]: from='client.? 172.21.15.184:0/3278994758' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T03:13:12.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:12 smithi184 ceph-mon[121180]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T03:13:12.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:12 smithi184 ceph-mon[121180]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T03:13:12.564 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:12 smithi064 ceph-mon[111958]: from='client.? 172.21.15.184:0/3278994758' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T03:13:12.564 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:12 smithi064 ceph-mon[111958]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T03:13:12.565 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:12 smithi064 ceph-mon[111958]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T03:13:13.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.321+0000 7f164dea9700 1 -- 172.21.15.64:0/3024285852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fe580 msgr2=0x7f1648106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:13.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.321+0000 7f164dea9700 1 --2- 172.21.15.64:0/3024285852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fe580 0x7f1648106c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f163c004940 tx=0x7f163c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:13.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.321+0000 7f164dea9700 1 -- 172.21.15.64:0/3024285852 shutdown_connections 2023-12-16T03:13:13.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.321+0000 7f164dea9700 1 --2- 172.21.15.64:0/3024285852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fe580 0x7f1648106c50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:13.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.321+0000 7f164dea9700 1 --2- 172.21.15.64:0/3024285852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16480fdbe0 0x7f16480fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.321+0000 7f164dea9700 1 -- 172.21.15.64:0/3024285852 >> 172.21.15.64:0/3024285852 conn(0x7f16480f7680 msgr2=0x7f16480f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.321+0000 7f164dea9700 1 -- 172.21.15.64:0/3024285852 shutdown_connections 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.321+0000 7f164dea9700 1 -- 172.21.15.64:0/3024285852 wait complete. 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f164dea9700 1 Processor -- start 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f164dea9700 1 -- start start 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f164dea9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fdbe0 0x7f16481136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f164dea9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16480fe580 0x7f1648113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f164dea9700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1648114280 con 0x7f16480fdbe0 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f164dea9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164810d570 con 0x7f16480fe580 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f16477fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fdbe0 0x7f16481136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f16477fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fdbe0 0x7f16481136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34600/0 (socket says 172.21.15.64:34600) 2023-12-16T03:13:13.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f16477fe700 1 -- 172.21.15.64:0/1262547057 learned_addr learned my addr 172.21.15.64:0/1262547057 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.322+0000 7f1646ffd700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16480fe580 0x7f1648113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.323+0000 7f16477fe700 1 -- 172.21.15.64:0/1262547057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16480fe580 msgr2=0x7f1648113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.323+0000 7f16477fe700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16480fe580 0x7f1648113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.323+0000 7f16477fe700 1 -- 172.21.15.64:0/1262547057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c005040 con 0x7f16480fdbe0 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.323+0000 7f16477fe700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fdbe0 0x7f16481136b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1638002a50 tx=0x7f16380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.323+0000 7f162ffff700 1 -- 172.21.15.64:0/1262547057 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1638007cc0 con 0x7f16480fdbe0 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.323+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164810d800 con 0x7f16480fdbe0 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.323+0000 7f162ffff700 1 -- 172.21.15.64:0/1262547057 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f163800f040 con 0x7f16480fdbe0 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.323+0000 7f162ffff700 1 -- 172.21.15.64:0/1262547057 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f163800d9c0 con 0x7f16480fdbe0 2023-12-16T03:13:13.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.323+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164810dd40 con 0x7f16480fdbe0 2023-12-16T03:13:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.324+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16481042b0 con 0x7f16480fdbe0 2023-12-16T03:13:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.324+0000 7f162ffff700 1 -- 172.21.15.64:0/1262547057 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f163800db20 con 0x7f16480fdbe0 2023-12-16T03:13:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.325+0000 7f162ffff700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1630068f60 0x7f163006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.325+0000 7f162ffff700 1 -- 172.21.15.64:0/1262547057 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1638086700 con 0x7f16480fdbe0 2023-12-16T03:13:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.325+0000 7f1646ffd700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1630068f60 0x7f163006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:13.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.325+0000 7f1646ffd700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1630068f60 0x7f163006b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f164810ef50 tx=0x7f163c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:13.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.329+0000 7f162ffff700 1 -- 172.21.15.64:0/1262547057 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1638056940 con 0x7f16480fdbe0 2023-12-16T03:13:13.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:13 smithi184 ceph-mon[121180]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:13.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.581+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f164804bb80 con 0x7f16480fdbe0 2023-12-16T03:13:13.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.584+0000 7f162ffff700 1 -- 172.21.15.64:0/1262547057 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166775 (secure 0 0 0) 0x7f16380564d0 con 0x7f16480fdbe0 2023-12-16T03:13:13.587 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:13.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1630068f60 msgr2=0x7f163006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:13.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1630068f60 0x7f163006b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f164810ef50 tx=0x7f163c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:13.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fdbe0 msgr2=0x7f16481136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:13.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fdbe0 0x7f16481136b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1638002a50 tx=0x7f16380046b0 comp rx=0 tx=0).stop 2023-12-16T03:13:13.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 shutdown_connections 2023-12-16T03:13:13.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1630068f60 0x7f163006b410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:13.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16480fdbe0 0x7f16481136b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:13.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 --2- 172.21.15.64:0/1262547057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16480fe580 0x7f1648113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:13.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 >> 172.21.15.64:0/1262547057 conn(0x7f16480f7680 msgr2=0x7f1648101430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:13.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 shutdown_connections 2023-12-16T03:13:13.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:13.586+0000 7f164dea9700 1 -- 172.21.15.64:0/1262547057 wait complete. 2023-12-16T03:13:13.617 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:13 smithi064 ceph-mon[111958]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:13.968 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":19,"active_gid":14208,"active_name":"smithi064.ueciyw","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2069535093},{"type":"v1","addr":"172.21.15.64:6801","nonce":2069535093}]},"active_addr":"172.21.15.64:6801/2069535093","active_change":"2023-12-16T03:10:32.324101+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14228,"name":"smithi184.urtxla","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.64:8443/","prometheus":"http://172.21.15.64:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.64:0","nonce":2114099737}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.64:0","nonce":443331071}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.64:0","nonce":2508480563}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.64:0","nonce":724630608}]}]} 2023-12-16T03:13:13.971 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-16T03:13:13.972 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-16T03:13:13.972 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T03:13:14.242 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:14.552 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:14 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1262547057' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-16T03:13:14.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:14 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1262547057' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-16T03:13:15.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.261+0000 7f5cd5b78700 1 -- 172.21.15.64:0/89424588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd00fb1e0 msgr2=0x7f5cd00fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:15.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.261+0000 7f5cd5b78700 1 --2- 172.21.15.64:0/89424588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd00fb1e0 0x7f5cd00fb630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4004940 tx=0x7f5cc4009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:15.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.261+0000 7f5cd5b78700 1 -- 172.21.15.64:0/89424588 shutdown_connections 2023-12-16T03:13:15.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.261+0000 7f5cd5b78700 1 --2- 172.21.15.64:0/89424588 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd00fb1e0 0x7f5cd00fb630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:15.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.261+0000 7f5cd5b78700 1 --2- 172.21.15.64:0/89424588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd0102c70 0x7f5cd0103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:15.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.261+0000 7f5cd5b78700 1 -- 172.21.15.64:0/89424588 >> 172.21.15.64:0/89424588 conn(0x7f5cd00711a0 msgr2=0x7f5cd00715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:15.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.261+0000 7f5cd5b78700 1 -- 172.21.15.64:0/89424588 shutdown_connections 2023-12-16T03:13:15.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.261+0000 7f5cd5b78700 1 -- 172.21.15.64:0/89424588 wait complete. 2023-12-16T03:13:15.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.262+0000 7f5cd5b78700 1 Processor -- start 2023-12-16T03:13:15.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.262+0000 7f5cd5b78700 1 -- start start 2023-12-16T03:13:15.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.262+0000 7f5cd5b78700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd00fb1e0 0x7f5cd0113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:15.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.262+0000 7f5cd5b78700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd0102c70 0x7f5cd0113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:15.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.262+0000 7f5cd5b78700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd01142b0 con 0x7f5cd0102c70 2023-12-16T03:13:15.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.262+0000 7f5cd5b78700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd010d570 con 0x7f5cd00fb1e0 2023-12-16T03:13:15.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.262+0000 7f5cceffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd0102c70 0x7f5cd0113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:15.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.262+0000 7f5cceffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd0102c70 0x7f5cd0113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34622/0 (socket says 172.21.15.64:34622) 2023-12-16T03:13:15.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.262+0000 7f5cceffd700 1 -- 172.21.15.64:0/2301769362 learned_addr learned my addr 172.21.15.64:0/2301769362 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:15.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5ccf7fe700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd00fb1e0 0x7f5cd0113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:15.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5cceffd700 1 -- 172.21.15.64:0/2301769362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd00fb1e0 msgr2=0x7f5cd0113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:15.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5cceffd700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd00fb1e0 0x7f5cd0113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:15.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5cceffd700 1 -- 172.21.15.64:0/2301769362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4005040 con 0x7f5cd0102c70 2023-12-16T03:13:15.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5cceffd700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd0102c70 0x7f5cd0113bd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400b3b0 tx=0x7f5cc4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:15.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5cb7fff700 1 -- 172.21.15.64:0/2301769362 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc400e030 con 0x7f5cd0102c70 2023-12-16T03:13:15.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd010d7f0 con 0x7f5cd0102c70 2023-12-16T03:13:15.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5cb7fff700 1 -- 172.21.15.64:0/2301769362 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5cc400be50 con 0x7f5cd0102c70 2023-12-16T03:13:15.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5cb7fff700 1 -- 172.21.15.64:0/2301769362 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc4013d90 con 0x7f5cd0102c70 2023-12-16T03:13:15.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.263+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd010dd30 con 0x7f5cd0102c70 2023-12-16T03:13:15.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.265+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd00fff10 con 0x7f5cd0102c70 2023-12-16T03:13:15.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.265+0000 7f5cb7fff700 1 -- 172.21.15.64:0/2301769362 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5cc4013620 con 0x7f5cd0102c70 2023-12-16T03:13:15.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.265+0000 7f5cb7fff700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5cb8068f60 0x7f5cb806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:15.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.265+0000 7f5cb7fff700 1 -- 172.21.15.64:0/2301769362 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5cc40885c0 con 0x7f5cd0102c70 2023-12-16T03:13:15.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.265+0000 7f5ccf7fe700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5cb8068f60 0x7f5cb806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:15.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.266+0000 7f5ccf7fe700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5cb8068f60 0x7f5cb806b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8006fd0 tx=0x7f5cc8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:15.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.271+0000 7f5cb7fff700 1 -- 172.21.15.64:0/2301769362 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5cc40587e0 con 0x7f5cd0102c70 2023-12-16T03:13:15.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.468+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cd0072cc0 con 0x7f5cd0102c70 2023-12-16T03:13:15.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.469+0000 7f5cb7fff700 1 -- 172.21.15.64:0/2301769362 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11068 (secure 0 0 0) 0x7f5cc4058370 con 0x7f5cd0102c70 2023-12-16T03:13:15.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:15.471 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":38,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","created":"2023-12-16T03:08:52.761746+0000","modified":"2023-12-16T03:13:03.385313+0000","last_up_change":"2023-12-16T03:13:02.379717+0000","last_in_change":"2023-12-16T03:12:46.192351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:12:08.817940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"94788c05-539e-4b9d-aaa5-099f071ba934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6803","nonce":227243716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6805","nonce":227243716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6809","nonce":227243716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6807","nonce":227243716}]},"public_addr":"172.21.15.64:6803/227243716","cluster_addr":"172.21.15.64:6805/227243716","heartbeat_back_addr":"172.21.15.64:6809/227243716","heartbeat_front_addr":"172.21.15.64:6807/227243716","state":["exists","up"]},{"osd":1,"uuid":"b08e3c59-129c-4baf-89ee-61012384a515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6811","nonce":2843022610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6813","nonce":2843022610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6817","nonce":2843022610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6815","nonce":2843022610}]},"public_addr":"172.21.15.64:6811/2843022610","cluster_addr":"172.21.15.64:6813/2843022610","heartbeat_back_addr":"172.21.15.64:6817/2843022610","heartbeat_front_addr":"172.21.15.64:6815/2843022610","state":["exists","up"]},{"osd":2,"uuid":"18ed018b-ab10-4041-86f5-393af106517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6819","nonce":2485820557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6821","nonce":2485820557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6825","nonce":2485820557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6823","nonce":2485820557}]},"public_addr":"172.21.15.64:6819/2485820557","cluster_addr":"172.21.15.64:6821/2485820557","heartbeat_back_addr":"172.21.15.64:6825/2485820557","heartbeat_front_addr":"172.21.15.64:6823/2485820557","state":["exists","up"]},{"osd":3,"uuid":"de1cc449-de96-410d-9a56-210aae20b3d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6801","nonce":222462294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6803","nonce":222462294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6807","nonce":222462294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6805","nonce":222462294}]},"public_addr":"172.21.15.184:6801/222462294","cluster_addr":"172.21.15.184:6803/222462294","heartbeat_back_addr":"172.21.15.184:6807/222462294","heartbeat_front_addr":"172.21.15.184:6805/222462294","state":["exists","up"]},{"osd":4,"uuid":"4dda63b7-8319-476c-8bb6-60dbb2aa1e92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6809","nonce":3289979784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6811","nonce":3289979784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6815","nonce":3289979784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6813","nonce":3289979784}]},"public_addr":"172.21.15.184:6809/3289979784","cluster_addr":"172.21.15.184:6811/3289979784","heartbeat_back_addr":"172.21.15.184:6815/3289979784","heartbeat_front_addr":"172.21.15.184:6813/3289979784","state":["exists","up"]},{"osd":5,"uuid":"55282f72-d6e4-4f91-9285-9b81aa14a948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6817","nonce":4080162917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6819","nonce":4080162917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6823","nonce":4080162917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6821","nonce":4080162917}]},"public_addr":"172.21.15.184:6817/4080162917","cluster_addr":"172.21.15.184:6819/4080162917","heartbeat_back_addr":"172.21.15.184:6823/4080162917","heartbeat_front_addr":"172.21.15.184:6821/4080162917","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:24.502427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:45.326372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:05.862744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:24.099546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:42.577575+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:13:01.012096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6800/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/74591443":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/1123447957":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/3738748261":"2023-12-17T03:10:32.323993+0000","172.21.15.64:6801/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6800/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/3838233490":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/4039513088":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/2708172205":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6800/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/277874032":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/1829112257":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/1577100459":"2023-12-17T03:09:16.219813+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:13:15.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5cb8068f60 msgr2=0x7f5cb806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:15.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5cb8068f60 0x7f5cb806b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8006fd0 tx=0x7f5cc8008040 comp rx=0 tx=0).stop 2023-12-16T03:13:15.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd0102c70 msgr2=0x7f5cd0113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:15.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd0102c70 0x7f5cd0113bd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400b3b0 tx=0x7f5cc4009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:15.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 shutdown_connections 2023-12-16T03:13:15.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5cb8068f60 0x7f5cb806b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:15.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cd00fb1e0 0x7f5cd0113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:15.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 --2- 172.21.15.64:0/2301769362 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cd0102c70 0x7f5cd0113bd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:15.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 >> 172.21.15.64:0/2301769362 conn(0x7f5cd00711a0 msgr2=0x7f5cd00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:15.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 shutdown_connections 2023-12-16T03:13:15.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:15.471+0000 7f5cd5b78700 1 -- 172.21.15.64:0/2301769362 wait complete. 2023-12-16T03:13:15.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:15 smithi184 ceph-mon[121180]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:15 smithi064 ceph-mon[111958]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:15.909 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-16T03:13:15.909 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T03:13:16.180 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:16.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:16 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2301769362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:13:16.687 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:16 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2301769362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:13:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.272+0000 7fef111e2700 1 -- 172.21.15.64:0/1041510556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c101b00 msgr2=0x7fef0c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:17.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.272+0000 7fef111e2700 1 --2- 172.21.15.64:0/1041510556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c101b00 0x7fef0c101ed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feefc004940 tx=0x7feefc009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.272+0000 7fef111e2700 1 -- 172.21.15.64:0/1041510556 shutdown_connections 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.272+0000 7fef111e2700 1 --2- 172.21.15.64:0/1041510556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef0c0fbb40 0x7fef0c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.272+0000 7fef111e2700 1 --2- 172.21.15.64:0/1041510556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c101b00 0x7fef0c101ed0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.272+0000 7fef111e2700 1 -- 172.21.15.64:0/1041510556 >> 172.21.15.64:0/1041510556 conn(0x7fef0c0719b0 msgr2=0x7fef0c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.272+0000 7fef111e2700 1 -- 172.21.15.64:0/1041510556 shutdown_connections 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.272+0000 7fef111e2700 1 -- 172.21.15.64:0/1041510556 wait complete. 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.273+0000 7fef111e2700 1 Processor -- start 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.273+0000 7fef111e2700 1 -- start start 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.273+0000 7fef111e2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c0fbb40 0x7fef0c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.273+0000 7fef111e2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef0c101b00 0x7fef0c113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.273+0000 7fef111e2700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c114350 con 0x7fef0c0fbb40 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.273+0000 7fef111e2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c10d5f0 con 0x7fef0c101b00 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.273+0000 7fef0ad9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c0fbb40 0x7fef0c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:17.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.273+0000 7fef0ad9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c0fbb40 0x7fef0c113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34644/0 (socket says 172.21.15.64:34644) 2023-12-16T03:13:17.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.273+0000 7fef0ad9d700 1 -- 172.21.15.64:0/704503482 learned_addr learned my addr 172.21.15.64:0/704503482 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.274+0000 7fef0ad9d700 1 -- 172.21.15.64:0/704503482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef0c101b00 msgr2=0x7fef0c113c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.274+0000 7fef0ad9d700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef0c101b00 0x7fef0c113c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.274+0000 7fef0ad9d700 1 -- 172.21.15.64:0/704503482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc005040 con 0x7fef0c0fbb40 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.274+0000 7fef0ad9d700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c0fbb40 0x7fef0c113730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feefc00b3b0 tx=0x7feefc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.274+0000 7fef037fe700 1 -- 172.21.15.64:0/704503482 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feefc00e030 con 0x7fef0c0fbb40 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.274+0000 7fef037fe700 1 -- 172.21.15.64:0/704503482 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feefc00be50 con 0x7fef0c0fbb40 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.274+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c10d870 con 0x7fef0c0fbb40 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.274+0000 7fef037fe700 1 -- 172.21.15.64:0/704503482 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feefc013d90 con 0x7fef0c0fbb40 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.275+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c10ddb0 con 0x7fef0c0fbb40 2023-12-16T03:13:17.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.276+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c0734d0 con 0x7fef0c0fbb40 2023-12-16T03:13:17.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.278+0000 7fef037fe700 1 -- 172.21.15.64:0/704503482 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7feefc013620 con 0x7fef0c0fbb40 2023-12-16T03:13:17.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.278+0000 7fef037fe700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feef8068f60 0x7feef806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:17.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.278+0000 7fef037fe700 1 -- 172.21.15.64:0/704503482 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7feefc088ad0 con 0x7fef0c0fbb40 2023-12-16T03:13:17.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.278+0000 7fef0a59c700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feef8068f60 0x7feef806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:17.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.278+0000 7fef0a59c700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feef8068f60 0x7feef806b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef0c10e800 tx=0x7feef4006c60 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:17.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.282+0000 7fef037fe700 1 -- 172.21.15.64:0/704503482 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7feefc058d70 con 0x7fef0c0fbb40 2023-12-16T03:13:17.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:17 smithi064 ceph-mon[111958]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:17.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.479+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef0c10dfa0 con 0x7fef0c0fbb40 2023-12-16T03:13:17.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.480+0000 7fef037fe700 1 -- 172.21.15.64:0/704503482 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11068 (secure 0 0 0) 0x7feefc02ce60 con 0x7fef0c0fbb40 2023-12-16T03:13:17.481 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:17.481 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":38,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","created":"2023-12-16T03:08:52.761746+0000","modified":"2023-12-16T03:13:03.385313+0000","last_up_change":"2023-12-16T03:13:02.379717+0000","last_in_change":"2023-12-16T03:12:46.192351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:12:08.817940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"94788c05-539e-4b9d-aaa5-099f071ba934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6803","nonce":227243716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6805","nonce":227243716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6809","nonce":227243716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6807","nonce":227243716}]},"public_addr":"172.21.15.64:6803/227243716","cluster_addr":"172.21.15.64:6805/227243716","heartbeat_back_addr":"172.21.15.64:6809/227243716","heartbeat_front_addr":"172.21.15.64:6807/227243716","state":["exists","up"]},{"osd":1,"uuid":"b08e3c59-129c-4baf-89ee-61012384a515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6811","nonce":2843022610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6813","nonce":2843022610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6817","nonce":2843022610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6815","nonce":2843022610}]},"public_addr":"172.21.15.64:6811/2843022610","cluster_addr":"172.21.15.64:6813/2843022610","heartbeat_back_addr":"172.21.15.64:6817/2843022610","heartbeat_front_addr":"172.21.15.64:6815/2843022610","state":["exists","up"]},{"osd":2,"uuid":"18ed018b-ab10-4041-86f5-393af106517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6819","nonce":2485820557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6821","nonce":2485820557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6825","nonce":2485820557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6823","nonce":2485820557}]},"public_addr":"172.21.15.64:6819/2485820557","cluster_addr":"172.21.15.64:6821/2485820557","heartbeat_back_addr":"172.21.15.64:6825/2485820557","heartbeat_front_addr":"172.21.15.64:6823/2485820557","state":["exists","up"]},{"osd":3,"uuid":"de1cc449-de96-410d-9a56-210aae20b3d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6801","nonce":222462294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6803","nonce":222462294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6807","nonce":222462294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6805","nonce":222462294}]},"public_addr":"172.21.15.184:6801/222462294","cluster_addr":"172.21.15.184:6803/222462294","heartbeat_back_addr":"172.21.15.184:6807/222462294","heartbeat_front_addr":"172.21.15.184:6805/222462294","state":["exists","up"]},{"osd":4,"uuid":"4dda63b7-8319-476c-8bb6-60dbb2aa1e92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6809","nonce":3289979784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6811","nonce":3289979784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6815","nonce":3289979784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6813","nonce":3289979784}]},"public_addr":"172.21.15.184:6809/3289979784","cluster_addr":"172.21.15.184:6811/3289979784","heartbeat_back_addr":"172.21.15.184:6815/3289979784","heartbeat_front_addr":"172.21.15.184:6813/3289979784","state":["exists","up"]},{"osd":5,"uuid":"55282f72-d6e4-4f91-9285-9b81aa14a948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6817","nonce":4080162917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6819","nonce":4080162917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6823","nonce":4080162917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6821","nonce":4080162917}]},"public_addr":"172.21.15.184:6817/4080162917","cluster_addr":"172.21.15.184:6819/4080162917","heartbeat_back_addr":"172.21.15.184:6823/4080162917","heartbeat_front_addr":"172.21.15.184:6821/4080162917","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:24.502427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:45.326372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:05.862744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:24.099546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:42.577575+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:13:01.012096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6800/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/74591443":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/1123447957":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/3738748261":"2023-12-17T03:10:32.323993+0000","172.21.15.64:6801/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6800/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/3838233490":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/4039513088":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/2708172205":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6800/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/277874032":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/1829112257":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/1577100459":"2023-12-17T03:09:16.219813+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:13:17.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feef8068f60 msgr2=0x7feef806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:17.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feef8068f60 0x7feef806b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef0c10e800 tx=0x7feef4006c60 comp rx=0 tx=0).stop 2023-12-16T03:13:17.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c0fbb40 msgr2=0x7fef0c113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:17.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c0fbb40 0x7fef0c113730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feefc00b3b0 tx=0x7feefc009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:17.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 shutdown_connections 2023-12-16T03:13:17.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feef8068f60 0x7feef806b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:17.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef0c0fbb40 0x7fef0c113730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:17.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 --2- 172.21.15.64:0/704503482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef0c101b00 0x7fef0c113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:17.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 >> 172.21.15.64:0/704503482 conn(0x7fef0c0719b0 msgr2=0x7fef0c065490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:17.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 shutdown_connections 2023-12-16T03:13:17.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:17.482+0000 7fef111e2700 1 -- 172.21.15.64:0/704503482 wait complete. 2023-12-16T03:13:17.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:17 smithi184 ceph-mon[121180]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:17.911 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-16T03:13:17.912 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-16T03:13:17.912 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-16T03:13:17.913 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-16T03:13:17.913 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-16T03:13:17.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-16T03:13:18.241 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:18.265 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:18.344 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:18 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:13:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:18 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/704503482' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:13:18.566 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:18 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:13:18.566 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:18 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/704503482' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:13:19.248 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:19.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:19 smithi064 ceph-mon[111958]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:19.514 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:19.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:19 smithi184 ceph-mon[121180]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:19.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 -- 172.21.15.64:0/133949142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c1035a0 msgr2=0x7f6d4c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/133949142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c1035a0 0x7f6d4c0fcc10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6d40004940 tx=0x7f6d40009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 -- 172.21.15.64:0/133949142 shutdown_connections 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/133949142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c1035a0 0x7f6d4c0fcc10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/133949142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d4c102c00 0x7f6d4c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 -- 172.21.15.64:0/133949142 >> 172.21.15.64:0/133949142 conn(0x7f6d4c0f8790 msgr2=0x7f6d4c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 -- 172.21.15.64:0/133949142 shutdown_connections 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 -- 172.21.15.64:0/133949142 wait complete. 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 Processor -- start 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.871+0000 7f6d50a7f700 1 -- start start 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d50a7f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c102c00 0x7f6d4c1135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d50a7f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d4c1035a0 0x7f6d4c113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d50a7f700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c114160 con 0x7f6d4c102c00 2023-12-16T03:13:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d50a7f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c10d490 con 0x7f6d4c1035a0 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d4a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c102c00 0x7f6d4c1135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d4a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c102c00 0x7f6d4c1135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34674/0 (socket says 172.21.15.64:34674) 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d4a59c700 1 -- 172.21.15.64:0/43344272 learned_addr learned my addr 172.21.15.64:0/43344272 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d49d9b700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d4c1035a0 0x7f6d4c113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d4a59c700 1 -- 172.21.15.64:0/43344272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d4c1035a0 msgr2=0x7f6d4c113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d4a59c700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d4c1035a0 0x7f6d4c113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d4a59c700 1 -- 172.21.15.64:0/43344272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40005040 con 0x7f6d4c102c00 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d4a59c700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c102c00 0x7f6d4c1135d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c830 tx=0x7f6d3c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d3affd700 1 -- 172.21.15.64:0/43344272 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d3c00a760 con 0x7f6d4c102c00 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c10d770 con 0x7f6d4c102c00 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d3affd700 1 -- 172.21.15.64:0/43344272 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6d3c00ad70 con 0x7f6d4c102c00 2023-12-16T03:13:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d3affd700 1 -- 172.21.15.64:0/43344272 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d3c0113a0 con 0x7f6d4c102c00 2023-12-16T03:13:19.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.872+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c10dc80 con 0x7f6d4c102c00 2023-12-16T03:13:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.873+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d4c10e200 con 0x7f6d4c102c00 2023-12-16T03:13:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.874+0000 7f6d3affd700 1 -- 172.21.15.64:0/43344272 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6d3c012400 con 0x7f6d4c102c00 2023-12-16T03:13:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.874+0000 7f6d3affd700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6d34068f70 0x7f6d3406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.874+0000 7f6d3affd700 1 -- 172.21.15.64:0/43344272 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6d3c086ad0 con 0x7f6d4c102c00 2023-12-16T03:13:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.874+0000 7f6d49d9b700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6d34068f70 0x7f6d3406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.874+0000 7f6d3affd700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] conn(0x7f6d3406ec40 0x7f6d34071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.874+0000 7f6d3affd700 1 -- 172.21.15.64:0/43344272 --> [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d34071700 con 0x7f6d3406ec40 2023-12-16T03:13:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.874+0000 7f6d3affd700 1 -- 172.21.15.64:0/43344272 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d3c08b220 con 0x7f6d4c102c00 2023-12-16T03:13:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.874+0000 7f6d4ad9d700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] conn(0x7f6d3406ec40 0x7f6d34071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.875+0000 7f6d49d9b700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6d34068f70 0x7f6d3406b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c10e7c0 tx=0x7f6d40009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.875+0000 7f6d4ad9d700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] conn(0x7f6d3406ec40 0x7f6d34071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.875+0000 7f6d3affd700 1 -- 172.21.15.64:0/43344272 <== osd.1 v2:172.21.15.64:6810/2843022610 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6d34071700 con 0x7f6d3406ec40 2023-12-16T03:13:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.890+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 --> [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6d4c05e340 con 0x7f6d3406ec40 2023-12-16T03:13:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d3affd700 1 -- 172.21.15.64:0/43344272 <== osd.1 v2:172.21.15.64:6810/2843022610 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6d4c05e340 con 0x7f6d3406ec40 2023-12-16T03:13:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] conn(0x7f6d3406ec40 msgr2=0x7f6d34071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] conn(0x7f6d3406ec40 0x7f6d34071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6d34068f70 msgr2=0x7f6d3406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6d34068f70 0x7f6d3406b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c10e7c0 tx=0x7f6d40009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c102c00 msgr2=0x7f6d4c1135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c102c00 0x7f6d4c1135d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c830 tx=0x7f6d3c004470 comp rx=0 tx=0).stop 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 shutdown_connections 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6810/2843022610,v1:172.21.15.64:6811/2843022610] conn(0x7f6d3406ec40 0x7f6d34071050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6d34068f70 0x7f6d3406b420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d4c102c00 0x7f6d4c1135d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 --2- 172.21.15.64:0/43344272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d4c1035a0 0x7f6d4c113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 >> 172.21.15.64:0/43344272 conn(0x7f6d4c0f8790 msgr2=0x7f6d4c0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 shutdown_connections 2023-12-16T03:13:19.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:19.891+0000 7f6d50a7f700 1 -- 172.21.15.64:0/43344272 wait complete. 2023-12-16T03:13:20.929 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.587+0000 7fe036ee5700 1 -- 172.21.15.64:0/1592760836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe030101b00 msgr2=0x7fe030101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.587+0000 7fe036ee5700 1 --2- 172.21.15.64:0/1592760836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe030101b00 0x7fe030101ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe024004940 tx=0x7fe024009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.587+0000 7fe036ee5700 1 -- 172.21.15.64:0/1592760836 shutdown_connections 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.587+0000 7fe036ee5700 1 --2- 172.21.15.64:0/1592760836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0300fbb40 0x7fe0300fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.587+0000 7fe036ee5700 1 --2- 172.21.15.64:0/1592760836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe030101b00 0x7fe030101ed0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.587+0000 7fe036ee5700 1 -- 172.21.15.64:0/1592760836 >> 172.21.15.64:0/1592760836 conn(0x7fe0300719b0 msgr2=0x7fe030071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.587+0000 7fe036ee5700 1 -- 172.21.15.64:0/1592760836 shutdown_connections 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.587+0000 7fe036ee5700 1 -- 172.21.15.64:0/1592760836 wait complete. 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe036ee5700 1 Processor -- start 2023-12-16T03:13:21.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe036ee5700 1 -- start start 2023-12-16T03:13:21.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe036ee5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0300fbb40 0x7fe03010e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:21.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe036ee5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe030101b00 0x7fe03010ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:21.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe036ee5700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03010f2d0 con 0x7fe0300fbb40 2023-12-16T03:13:21.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe036ee5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03010f440 con 0x7fe030101b00 2023-12-16T03:13:21.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe034c81700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0300fbb40 0x7fe03010e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:21.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe034c81700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0300fbb40 0x7fe03010e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34696/0 (socket says 172.21.15.64:34696) 2023-12-16T03:13:21.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe034c81700 1 -- 172.21.15.64:0/2955309494 learned_addr learned my addr 172.21.15.64:0/2955309494 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:21.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe034c81700 1 -- 172.21.15.64:0/2955309494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe030101b00 msgr2=0x7fe03010ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:21.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe034c81700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe030101b00 0x7fe03010ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:21.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.588+0000 7fe034c81700 1 -- 172.21.15.64:0/2955309494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024005040 con 0x7fe0300fbb40 2023-12-16T03:13:21.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.589+0000 7fe034c81700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0300fbb40 0x7fe03010e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe024000c00 tx=0x7fe024009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:21.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.589+0000 7fe02d7fa700 1 -- 172.21.15.64:0/2955309494 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe02400e030 con 0x7fe0300fbb40 2023-12-16T03:13:21.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.589+0000 7fe02d7fa700 1 -- 172.21.15.64:0/2955309494 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe02400be50 con 0x7fe0300fbb40 2023-12-16T03:13:21.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.589+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe030117730 con 0x7fe0300fbb40 2023-12-16T03:13:21.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.589+0000 7fe02d7fa700 1 -- 172.21.15.64:0/2955309494 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe024013d90 con 0x7fe0300fbb40 2023-12-16T03:13:21.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.589+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe030117c40 con 0x7fe0300fbb40 2023-12-16T03:13:21.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.590+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe03005e380 con 0x7fe0300fbb40 2023-12-16T03:13:21.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.591+0000 7fe02d7fa700 1 -- 172.21.15.64:0/2955309494 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe024013620 con 0x7fe0300fbb40 2023-12-16T03:13:21.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.591+0000 7fe02d7fa700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fe020068f60 0x7fe02006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:21.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.591+0000 7fe02d7fa700 1 -- 172.21.15.64:0/2955309494 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe024088d10 con 0x7fe0300fbb40 2023-12-16T03:13:21.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.591+0000 7fe02ffff700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fe020068f60 0x7fe02006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:21.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.591+0000 7fe02d7fa700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] conn(0x7fe02006ec30 0x7fe020071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:21.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.591+0000 7fe02d7fa700 1 -- 172.21.15.64:0/2955309494 --> [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0200716f0 con 0x7fe02006ec30 2023-12-16T03:13:21.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.591+0000 7fe02d7fa700 1 -- 172.21.15.64:0/2955309494 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0240890f0 con 0x7fe0300fbb40 2023-12-16T03:13:21.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.591+0000 7fe02ffff700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fe020068f60 0x7fe02006b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe030065e50 tx=0x7fe01c006ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:21.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.592+0000 7fe035482700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] conn(0x7fe02006ec30 0x7fe020071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:21.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.592+0000 7fe035482700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] conn(0x7fe02006ec30 0x7fe020071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:21.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.593+0000 7fe02d7fa700 1 -- 172.21.15.64:0/2955309494 <== osd.5 v2:172.21.15.184:6816/4080162917 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe0200716f0 con 0x7fe02006ec30 2023-12-16T03:13:21.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.608+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 --> [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe03005e800 con 0x7fe02006ec30 2023-12-16T03:13:21.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.608+0000 7fe02d7fa700 1 -- 172.21.15.64:0/2955309494 <== osd.5 v2:172.21.15.184:6816/4080162917 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe03005e800 con 0x7fe02006ec30 2023-12-16T03:13:21.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 >> [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] conn(0x7fe02006ec30 msgr2=0x7fe020071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:21.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] conn(0x7fe02006ec30 0x7fe020071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fe020068f60 msgr2=0x7fe02006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fe020068f60 0x7fe02006b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe030065e50 tx=0x7fe01c006ce0 comp rx=0 tx=0).stop 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0300fbb40 msgr2=0x7fe03010e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0300fbb40 0x7fe03010e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe024000c00 tx=0x7fe024009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 shutdown_connections 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.184:6816/4080162917,v1:172.21.15.184:6817/4080162917] conn(0x7fe02006ec30 0x7fe020071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fe020068f60 0x7fe02006b410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0300fbb40 0x7fe03010e770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 --2- 172.21.15.64:0/2955309494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe030101b00 0x7fe03010ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 >> 172.21.15.64:0/2955309494 conn(0x7fe0300719b0 msgr2=0x7fe0300fabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 shutdown_connections 2023-12-16T03:13:21.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:21.609+0000 7fe036ee5700 1 -- 172.21.15.64:0/2955309494 wait complete. 2023-12-16T03:13:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:21 smithi064 ceph-mon[111958]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:21 smithi184 ceph-mon[121180]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:21.832 INFO:teuthology.orchestra.run.smithi064.stdout:60129542166 2023-12-16T03:13:21.833 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-16T03:13:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 -- 172.21.15.64:0/2612646474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac80101b60 msgr2=0x7fac80101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 --2- 172.21.15.64:0/2612646474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac80101b60 0x7fac80101f30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fac68004940 tx=0x7fac68009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 -- 172.21.15.64:0/2612646474 shutdown_connections 2023-12-16T03:13:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 --2- 172.21.15.64:0/2612646474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac800fbb00 0x7fac800fbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 --2- 172.21.15.64:0/2612646474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac80101b60 0x7fac80101f30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 -- 172.21.15.64:0/2612646474 >> 172.21.15.64:0/2612646474 conn(0x7fac800f7680 msgr2=0x7fac800f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:22.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 -- 172.21.15.64:0/2612646474 shutdown_connections 2023-12-16T03:13:22.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 -- 172.21.15.64:0/2612646474 wait complete. 2023-12-16T03:13:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 Processor -- start 2023-12-16T03:13:22.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 -- start start 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.811+0000 7fac84a1d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac800fbb00 0x7fac80113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac84a1d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac80101b60 0x7fac80113c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac84a1d700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac801142d0 con 0x7fac800fbb00 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac84a1d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8010d600 con 0x7fac80101b60 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac7e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac800fbb00 0x7fac80113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac7e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac800fbb00 0x7fac80113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39826/0 (socket says 172.21.15.64:39826) 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac7e59c700 1 -- 172.21.15.64:0/504348506 learned_addr learned my addr 172.21.15.64:0/504348506 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac7dd9b700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac80101b60 0x7fac80113c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac7e59c700 1 -- 172.21.15.64:0/504348506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac80101b60 msgr2=0x7fac80113c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac7e59c700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac80101b60 0x7fac80113c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac7e59c700 1 -- 172.21.15.64:0/504348506 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68005040 con 0x7fac800fbb00 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac7e59c700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac800fbb00 0x7fac80113740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac68009180 tx=0x7fac68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:22.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac76ffd700 1 -- 172.21.15.64:0/504348506 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac6800e040 con 0x7fac800fbb00 2023-12-16T03:13:22.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8010d880 con 0x7fac800fbb00 2023-12-16T03:13:22.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac76ffd700 1 -- 172.21.15.64:0/504348506 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fac68013420 con 0x7fac800fbb00 2023-12-16T03:13:22.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac76ffd700 1 -- 172.21.15.64:0/504348506 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac6801c630 con 0x7fac800fbb00 2023-12-16T03:13:22.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.812+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8010ddc0 con 0x7fac800fbb00 2023-12-16T03:13:22.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.813+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac8010e320 con 0x7fac800fbb00 2023-12-16T03:13:22.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.814+0000 7fac76ffd700 1 -- 172.21.15.64:0/504348506 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fac680139e0 con 0x7fac800fbb00 2023-12-16T03:13:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.814+0000 7fac76ffd700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fac6c068f60 0x7fac6c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.814+0000 7fac76ffd700 1 -- 172.21.15.64:0/504348506 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fac680888e0 con 0x7fac800fbb00 2023-12-16T03:13:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.814+0000 7fac7dd9b700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fac6c068f60 0x7fac6c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.814+0000 7fac76ffd700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] conn(0x7fac6c06ec30 0x7fac6c071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.814+0000 7fac76ffd700 1 -- 172.21.15.64:0/504348506 --> [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac6c0716f0 con 0x7fac6c06ec30 2023-12-16T03:13:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.814+0000 7fac76ffd700 1 -- 172.21.15.64:0/504348506 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac68088c20 con 0x7fac800fbb00 2023-12-16T03:13:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.814+0000 7fac7ed9d700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] conn(0x7fac6c06ec30 0x7fac6c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:22.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.815+0000 7fac7dd9b700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fac6c068f60 0x7fac6c06b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac8010e810 tx=0x7fac70009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:22.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.815+0000 7fac7ed9d700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] conn(0x7fac6c06ec30 0x7fac6c071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:22.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.815+0000 7fac76ffd700 1 -- 172.21.15.64:0/504348506 <== osd.0 v2:172.21.15.64:6802/227243716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fac6c0716f0 con 0x7fac6c06ec30 2023-12-16T03:13:22.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.831+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 --> [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac8005e2c0 con 0x7fac6c06ec30 2023-12-16T03:13:22.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.831+0000 7fac76ffd700 1 -- 172.21.15.64:0/504348506 <== osd.0 v2:172.21.15.64:6802/227243716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fac8005e2c0 con 0x7fac6c06ec30 2023-12-16T03:13:22.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] conn(0x7fac6c06ec30 msgr2=0x7fac6c071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:22.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] conn(0x7fac6c06ec30 0x7fac6c071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:22.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fac6c068f60 msgr2=0x7fac6c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fac6c068f60 0x7fac6c06b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac8010e810 tx=0x7fac70009ee0 comp rx=0 tx=0).stop 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac800fbb00 msgr2=0x7fac80113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac800fbb00 0x7fac80113740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac68009180 tx=0x7fac68009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 shutdown_connections 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6802/227243716,v1:172.21.15.64:6803/227243716] conn(0x7fac6c06ec30 0x7fac6c071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fac6c068f60 0x7fac6c06b410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac800fbb00 0x7fac80113740 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 --2- 172.21.15.64:0/504348506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac80101b60 0x7fac80113c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 >> 172.21.15.64:0/504348506 conn(0x7fac800f7680 msgr2=0x7fac80065ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 shutdown_connections 2023-12-16T03:13:22.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.832+0000 7fac84a1d700 1 -- 172.21.15.64:0/504348506 wait complete. 2023-12-16T03:13:23.241 INFO:teuthology.orchestra.run.smithi064.stdout:158913789958 2023-12-16T03:13:23.241 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-16T03:13:23.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.369+0000 7f8378173700 1 -- 172.21.15.64:0/4233197161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370102c20 msgr2=0x7f8370102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:23.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.369+0000 7f8378173700 1 --2- 172.21.15.64:0/4233197161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370102c20 0x7f8370102ff0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f836c004940 tx=0x7f836c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:23.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.369+0000 7f8378173700 1 -- 172.21.15.64:0/4233197161 shutdown_connections 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.369+0000 7f8378173700 1 --2- 172.21.15.64:0/4233197161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8370065390 0x7f8370065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.369+0000 7f8378173700 1 --2- 172.21.15.64:0/4233197161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370102c20 0x7f8370102ff0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.369+0000 7f8378173700 1 -- 172.21.15.64:0/4233197161 >> 172.21.15.64:0/4233197161 conn(0x7f83700719b0 msgr2=0x7f8370071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.369+0000 7f8378173700 1 -- 172.21.15.64:0/4233197161 shutdown_connections 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.369+0000 7f8378173700 1 -- 172.21.15.64:0/4233197161 wait complete. 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.370+0000 7f8378173700 1 Processor -- start 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.370+0000 7f8378173700 1 -- start start 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.370+0000 7f8378173700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370065390 0x7f83700fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.370+0000 7f8378173700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8370102c20 0x7f83700fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.370+0000 7f8378173700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700fc7c0 con 0x7f8370065390 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.370+0000 7f8378173700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700fc930 con 0x7f8370102c20 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.370+0000 7f8375f0f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370065390 0x7f83700fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:23.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.370+0000 7f8375f0f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370065390 0x7f83700fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39854/0 (socket says 172.21.15.64:39854) 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.370+0000 7f8375f0f700 1 -- 172.21.15.64:0/1567842720 learned_addr learned my addr 172.21.15.64:0/1567842720 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.371+0000 7f8375f0f700 1 -- 172.21.15.64:0/1567842720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8370102c20 msgr2=0x7f83700fc130 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.371+0000 7f8375f0f700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8370102c20 0x7f83700fc130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.371+0000 7f8375f0f700 1 -- 172.21.15.64:0/1567842720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c005040 con 0x7f8370065390 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.371+0000 7f8375f0f700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370065390 0x7f83700fbbf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f836c008d00 tx=0x7f836c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.371+0000 7f83667fc700 1 -- 172.21.15.64:0/1567842720 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f836c00e070 con 0x7f8370065390 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.371+0000 7f83667fc700 1 -- 172.21.15.64:0/1567842720 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f836c0093b0 con 0x7f8370065390 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.371+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83701199b0 con 0x7f8370065390 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.371+0000 7f83667fc700 1 -- 172.21.15.64:0/1567842720 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f836c01c400 con 0x7f8370065390 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.371+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8370119e40 con 0x7f8370065390 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.372+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f837005e300 con 0x7f8370065390 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.373+0000 7f83667fc700 1 -- 172.21.15.64:0/1567842720 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f836c013420 con 0x7f8370065390 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.373+0000 7f83667fc700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f835c068f70 0x7f835c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.373+0000 7f83667fc700 1 -- 172.21.15.64:0/1567842720 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f836c0881a0 con 0x7f8370065390 2023-12-16T03:13:23.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.373+0000 7f837570e700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f835c068f70 0x7f835c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.373+0000 7f83667fc700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] conn(0x7f835c06ec40 0x7f835c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.373+0000 7f83667fc700 1 -- 172.21.15.64:0/1567842720 --> [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f835c071700 con 0x7f835c06ec40 2023-12-16T03:13:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.373+0000 7f83667fc700 1 -- 172.21.15.64:0/1567842720 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f836c08a7f0 con 0x7f8370065390 2023-12-16T03:13:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.373+0000 7f837570e700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f835c068f70 0x7f835c06b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83700fd5f0 tx=0x7f8360006c60 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.374+0000 7f8376710700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] conn(0x7f835c06ec40 0x7f835c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.375+0000 7f8376710700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] conn(0x7f835c06ec40 0x7f835c071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.376+0000 7f83667fc700 1 -- 172.21.15.64:0/1567842720 <== osd.3 v2:172.21.15.184:6800/222462294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f835c071700 con 0x7f835c06ec40 2023-12-16T03:13:23.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.391+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 --> [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f837005e730 con 0x7f835c06ec40 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f83667fc700 1 -- 172.21.15.64:0/1567842720 <== osd.3 v2:172.21.15.184:6800/222462294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f837005e730 con 0x7f835c06ec40 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 >> [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] conn(0x7f835c06ec40 msgr2=0x7f835c071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] conn(0x7f835c06ec40 0x7f835c071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f835c068f70 msgr2=0x7f835c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f835c068f70 0x7f835c06b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83700fd5f0 tx=0x7f8360006c60 comp rx=0 tx=0).stop 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370065390 msgr2=0x7f83700fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370065390 0x7f83700fbbf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f836c008d00 tx=0x7f836c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 shutdown_connections 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.184:6800/222462294,v1:172.21.15.184:6801/222462294] conn(0x7f835c06ec40 0x7f835c071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f835c068f70 0x7f835c06b420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8370065390 0x7f83700fbbf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 --2- 172.21.15.64:0/1567842720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8370102c20 0x7f83700fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 >> 172.21.15.64:0/1567842720 conn(0x7f83700719b0 msgr2=0x7f83700fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:23.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 shutdown_connections 2023-12-16T03:13:23.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:23.392+0000 7f8378173700 1 -- 172.21.15.64:0/1567842720 wait complete. 2023-12-16T03:13:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.424+0000 7f1886666700 1 -- 172.21.15.64:0/584040614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 msgr2=0x7f1880102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.424+0000 7f1886666700 1 --2- 172.21.15.64:0/584040614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 0x7f1880102fd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1870004940 tx=0x7f1870009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.424+0000 7f1886666700 1 -- 172.21.15.64:0/584040614 shutdown_connections 2023-12-16T03:13:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.424+0000 7f1886666700 1 --2- 172.21.15.64:0/584040614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18801035a0 0x7f18800fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.424+0000 7f1886666700 1 --2- 172.21.15.64:0/584040614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 0x7f1880102fd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.424+0000 7f1886666700 1 -- 172.21.15.64:0/584040614 >> 172.21.15.64:0/584040614 conn(0x7f18800f8790 msgr2=0x7f18800faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.424+0000 7f1886666700 1 -- 172.21.15.64:0/584040614 shutdown_connections 2023-12-16T03:13:23.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.424+0000 7f1886666700 1 -- 172.21.15.64:0/584040614 wait complete. 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.424+0000 7f1886666700 1 Processor -- start 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f1886666700 1 -- start start 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f1886666700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 0x7f18801136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f1886666700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18801035a0 0x7f1880113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f1886666700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18801142d0 con 0x7f1880102c00 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f1886666700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188010d590 con 0x7f18801035a0 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 0x7f18801136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 0x7f18801136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39806/0 (socket says 172.21.15.64:39806) 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187ffff700 1 -- 172.21.15.64:0/1632950463 learned_addr learned my addr 172.21.15.64:0/1632950463 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187ffff700 1 -- 172.21.15.64:0/1632950463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18801035a0 msgr2=0x7f1880113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187ffff700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18801035a0 0x7f1880113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187ffff700 1 -- 172.21.15.64:0/1632950463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870005040 con 0x7f1880102c00 2023-12-16T03:13:23.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187ffff700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 0x7f18801136b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f187000b3b0 tx=0x7f1870009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187cff9700 1 -- 172.21.15.64:0/1632950463 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f187000e040 con 0x7f1880102c00 2023-12-16T03:13:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187cff9700 1 -- 172.21.15.64:0/1632950463 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f187000bc50 con 0x7f1880102c00 2023-12-16T03:13:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188010d810 con 0x7f1880102c00 2023-12-16T03:13:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f187cff9700 1 -- 172.21.15.64:0/1632950463 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1870013420 con 0x7f1880102c00 2023-12-16T03:13:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.425+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188010dd50 con 0x7f1880102c00 2023-12-16T03:13:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.426+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f188010e1b0 con 0x7f1880102c00 2023-12-16T03:13:23.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.427+0000 7f187cff9700 1 -- 172.21.15.64:0/1632950463 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f187001c430 con 0x7f1880102c00 2023-12-16T03:13:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.427+0000 7f187cff9700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1868068f60 0x7f186806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.427+0000 7f187cff9700 1 -- 172.21.15.64:0/1632950463 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1870088340 con 0x7f1880102c00 2023-12-16T03:13:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.427+0000 7f187f7fe700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1868068f60 0x7f186806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.427+0000 7f187cff9700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] conn(0x7f186806ec30 0x7f1868071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.427+0000 7f187cff9700 1 -- 172.21.15.64:0/1632950463 --> [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18680716f0 con 0x7f186806ec30 2023-12-16T03:13:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.427+0000 7f187cff9700 1 -- 172.21.15.64:0/1632950463 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1870088720 con 0x7f1880102c00 2023-12-16T03:13:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.428+0000 7f187f7fe700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1868068f60 0x7f186806b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1874006fd0 tx=0x7f1874006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:23.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.428+0000 7f1884c03700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] conn(0x7f186806ec30 0x7f1868071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:23.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.428+0000 7f1884c03700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] conn(0x7f186806ec30 0x7f1868071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:23.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.428+0000 7f187cff9700 1 -- 172.21.15.64:0/1632950463 <== osd.2 v2:172.21.15.64:6818/2485820557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f18680716f0 con 0x7f186806ec30 2023-12-16T03:13:23.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.444+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 --> [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f188005e340 con 0x7f186806ec30 2023-12-16T03:13:23.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.444+0000 7f187cff9700 1 -- 172.21.15.64:0/1632950463 <== osd.2 v2:172.21.15.64:6818/2485820557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f188005e340 con 0x7f186806ec30 2023-12-16T03:13:23.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] conn(0x7f186806ec30 msgr2=0x7f1868071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:23.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] conn(0x7f186806ec30 0x7f1868071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1868068f60 msgr2=0x7f186806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:23.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1868068f60 0x7f186806b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1874006fd0 tx=0x7f1874006db0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 msgr2=0x7f18801136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:23.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 0x7f18801136b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f187000b3b0 tx=0x7f1870009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 shutdown_connections 2023-12-16T03:13:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f1868068f60 0x7f186806b410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:6818/2485820557,v1:172.21.15.64:6819/2485820557] conn(0x7f186806ec30 0x7f1868071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1880102c00 0x7f18801136b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 --2- 172.21.15.64:0/1632950463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18801035a0 0x7f1880113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 >> 172.21.15.64:0/1632950463 conn(0x7f18800f8790 msgr2=0x7f18800fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 shutdown_connections 2023-12-16T03:13:23.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:22.445+0000 7f1886666700 1 -- 172.21.15.64:0/1632950463 wait complete. 2023-12-16T03:13:23.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:23 smithi064 ceph-mon[111958]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:23.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:23 smithi184 ceph-mon[121180]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:24.448 INFO:teuthology.orchestra.run.smithi064.stdout:107374182414 2023-12-16T03:13:24.449 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-16T03:13:24.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.377+0000 7f9068667700 1 -- 172.21.15.64:0/860810271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 msgr2=0x7f9060102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:24.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.377+0000 7f9068667700 1 --2- 172.21.15.64:0/860810271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 0x7f9060102ff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f905c004940 tx=0x7f905c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:24.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.377+0000 7f9068667700 1 -- 172.21.15.64:0/860810271 shutdown_connections 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.377+0000 7f9068667700 1 --2- 172.21.15.64:0/860810271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060065390 0x7f9060065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.377+0000 7f9068667700 1 --2- 172.21.15.64:0/860810271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 0x7f9060102ff0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.377+0000 7f9068667700 1 -- 172.21.15.64:0/860810271 >> 172.21.15.64:0/860810271 conn(0x7f90600719b0 msgr2=0x7f9060071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.378+0000 7f9068667700 1 -- 172.21.15.64:0/860810271 shutdown_connections 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.378+0000 7f9068667700 1 -- 172.21.15.64:0/860810271 wait complete. 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.378+0000 7f9068667700 1 Processor -- start 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.378+0000 7f9068667700 1 -- start start 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9068667700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060065390 0x7f90601136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9068667700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 0x7f9060113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9068667700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9060114240 con 0x7f9060102c20 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9068667700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906010d590 con 0x7f9060065390 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9065c02700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 0x7f9060113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9065c02700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 0x7f9060113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39864/0 (socket says 172.21.15.64:39864) 2023-12-16T03:13:24.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9065c02700 1 -- 172.21.15.64:0/1361755760 learned_addr learned my addr 172.21.15.64:0/1361755760 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9066403700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060065390 0x7f90601136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9065c02700 1 -- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060065390 msgr2=0x7f90601136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9065c02700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060065390 0x7f90601136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9065c02700 1 -- 172.21.15.64:0/1361755760 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c005040 con 0x7f9060102c20 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9065c02700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 0x7f9060113bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9050002a50 tx=0x7f90500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9056ffd700 1 -- 172.21.15.64:0/1361755760 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9050007cc0 con 0x7f9060102c20 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906010d870 con 0x7f9060102c20 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9056ffd700 1 -- 172.21.15.64:0/1361755760 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f905000f040 con 0x7f9060102c20 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.379+0000 7f9056ffd700 1 -- 172.21.15.64:0/1361755760 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f905000da70 con 0x7f9060102c20 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.380+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906010ddb0 con 0x7f9060102c20 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.380+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f906010e250 con 0x7f9060102c20 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.381+0000 7f9056ffd700 1 -- 172.21.15.64:0/1361755760 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f905000dbd0 con 0x7f9060102c20 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.381+0000 7f9056ffd700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f904c068f70 0x7f904c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.381+0000 7f9056ffd700 1 -- 172.21.15.64:0/1361755760 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9050086610 con 0x7f9060102c20 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.381+0000 7f9066403700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f904c068f70 0x7f904c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:24.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.381+0000 7f9056ffd700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] conn(0x7f904c06ec40 0x7f904c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:24.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.381+0000 7f9056ffd700 1 -- 172.21.15.64:0/1361755760 --> [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f904c071700 con 0x7f904c06ec40 2023-12-16T03:13:24.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.381+0000 7f9056ffd700 1 -- 172.21.15.64:0/1361755760 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90500869f0 con 0x7f9060102c20 2023-12-16T03:13:24.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.382+0000 7f9066403700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f904c068f70 0x7f904c06b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f905c00b3b0 tx=0x7f905c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:24.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.382+0000 7f9066c04700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] conn(0x7f904c06ec40 0x7f904c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:24.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.382+0000 7f9066c04700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] conn(0x7f904c06ec40 0x7f904c071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:24.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.383+0000 7f9056ffd700 1 -- 172.21.15.64:0/1361755760 <== osd.4 v2:172.21.15.184:6808/3289979784 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f904c071700 con 0x7f904c06ec40 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.398+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 --> [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f906005e340 con 0x7f904c06ec40 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9056ffd700 1 -- 172.21.15.64:0/1361755760 <== osd.4 v2:172.21.15.184:6808/3289979784 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f906005e340 con 0x7f904c06ec40 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] conn(0x7f904c06ec40 msgr2=0x7f904c071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] conn(0x7f904c06ec40 0x7f904c071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f904c068f70 msgr2=0x7f904c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f904c068f70 0x7f904c06b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f905c00b3b0 tx=0x7f905c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 msgr2=0x7f9060113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 0x7f9060113bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9050002a50 tx=0x7f90500046b0 comp rx=0 tx=0).stop 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 shutdown_connections 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:6808/3289979784,v1:172.21.15.184:6809/3289979784] conn(0x7f904c06ec40 0x7f904c071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f904c068f70 0x7f904c06b420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060065390 0x7f90601136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 --2- 172.21.15.64:0/1361755760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9060102c20 0x7f9060113bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 >> 172.21.15.64:0/1361755760 conn(0x7f90600719b0 msgr2=0x7f90600fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:24.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 shutdown_connections 2023-12-16T03:13:24.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:24.399+0000 7f9068667700 1 -- 172.21.15.64:0/1361755760 wait complete. 2023-12-16T03:13:24.649 INFO:teuthology.orchestra.run.smithi064.stdout:38654705690 2023-12-16T03:13:24.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-16T03:13:24.915 INFO:teuthology.orchestra.run.smithi064.stdout:81604378642 2023-12-16T03:13:24.916 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-16T03:13:25.099 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:25.100 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:25.353 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:25.587 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:25 smithi064 ceph-mon[111958]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:25 smithi184 ceph-mon[121180]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:26.590 INFO:teuthology.orchestra.run.smithi064.stdout:137438953482 2023-12-16T03:13:26.590 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-16T03:13:26.913 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:27.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 -- 172.21.15.64:0/2793309209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a41035a0 msgr2=0x7f05a40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:27.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 --2- 172.21.15.64:0/2793309209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a41035a0 0x7f05a40fcc10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0598004940 tx=0x7f0598009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:27.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 -- 172.21.15.64:0/2793309209 shutdown_connections 2023-12-16T03:13:27.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 --2- 172.21.15.64:0/2793309209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a41035a0 0x7f05a40fcc10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 --2- 172.21.15.64:0/2793309209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05a4102c00 0x7f05a4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 -- 172.21.15.64:0/2793309209 >> 172.21.15.64:0/2793309209 conn(0x7f05a40f8790 msgr2=0x7f05a40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:27.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 -- 172.21.15.64:0/2793309209 shutdown_connections 2023-12-16T03:13:27.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 -- 172.21.15.64:0/2793309209 wait complete. 2023-12-16T03:13:27.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 Processor -- start 2023-12-16T03:13:27.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.070+0000 7f05a8eac700 1 -- start start 2023-12-16T03:13:27.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a8eac700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a4102c00 0x7f05a406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:27.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a8eac700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05a41035a0 0x7f05a4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a8eac700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4070a80 con 0x7f05a4102c00 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a8eac700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4070bf0 con 0x7f05a41035a0 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a4102c00 0x7f05a406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a4102c00 0x7f05a406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39876/0 (socket says 172.21.15.64:39876) 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a259c700 1 -- 172.21.15.64:0/3270013248 learned_addr learned my addr 172.21.15.64:0/3270013248 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a1d9b700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05a41035a0 0x7f05a4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a259c700 1 -- 172.21.15.64:0/3270013248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05a41035a0 msgr2=0x7f05a4070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a259c700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05a41035a0 0x7f05a4070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a259c700 1 -- 172.21.15.64:0/3270013248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0598005040 con 0x7f05a4102c00 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a259c700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a4102c00 0x7f05a406ff40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f059400c830 tx=0x7f0594004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f0592ffd700 1 -- 172.21.15.64:0/3270013248 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05940106f0 con 0x7f05a4102c00 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a4119850 con 0x7f05a4102c00 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f0592ffd700 1 -- 172.21.15.64:0/3270013248 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0594010d00 con 0x7f05a4102c00 2023-12-16T03:13:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f0592ffd700 1 -- 172.21.15.64:0/3270013248 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0594012e90 con 0x7f05a4102c00 2023-12-16T03:13:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.071+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a4119d00 con 0x7f05a4102c00 2023-12-16T03:13:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.072+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a41050d0 con 0x7f05a4102c00 2023-12-16T03:13:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.073+0000 7f0592ffd700 1 -- 172.21.15.64:0/3270013248 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0594010850 con 0x7f05a4102c00 2023-12-16T03:13:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.073+0000 7f0592ffd700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f058c068f60 0x7f058c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.073+0000 7f0592ffd700 1 -- 172.21.15.64:0/3270013248 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0594086a20 con 0x7f05a4102c00 2023-12-16T03:13:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.073+0000 7f05a1d9b700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f058c068f60 0x7f058c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:27.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.074+0000 7f05a1d9b700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f058c068f60 0x7f058c06b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f059800b3b0 tx=0x7f0598009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:27.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.078+0000 7f0592ffd700 1 -- 172.21.15.64:0/3270013248 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0594053230 con 0x7f05a4102c00 2023-12-16T03:13:27.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.283+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f05a40fc390 con 0x7f05a4102c00 2023-12-16T03:13:27.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.284+0000 7f0592ffd700 1 -- 172.21.15.64:0/3270013248 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0594056850 con 0x7f05a4102c00 2023-12-16T03:13:27.286 INFO:teuthology.orchestra.run.smithi064.stdout:60129542167 2023-12-16T03:13:27.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f058c068f60 msgr2=0x7f058c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:27.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f058c068f60 0x7f058c06b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f059800b3b0 tx=0x7f0598009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:27.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a4102c00 msgr2=0x7f05a406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:27.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a4102c00 0x7f05a406ff40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f059400c830 tx=0x7f0594004470 comp rx=0 tx=0).stop 2023-12-16T03:13:27.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 shutdown_connections 2023-12-16T03:13:27.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f058c068f60 0x7f058c06b410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05a4102c00 0x7f05a406ff40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 --2- 172.21.15.64:0/3270013248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05a41035a0 0x7f05a4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 >> 172.21.15.64:0/3270013248 conn(0x7f05a40f8790 msgr2=0x7f05a40fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:27.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 shutdown_connections 2023-12-16T03:13:27.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.286+0000 7f05a8eac700 1 -- 172.21.15.64:0/3270013248 wait complete. 2023-12-16T03:13:27.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.395+0000 7f8045828700 1 -- 172.21.15.64:0/4073227366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040103590 msgr2=0x7f80400fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:27.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.395+0000 7f8045828700 1 --2- 172.21.15.64:0/4073227366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040103590 0x7f80400fcc00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8034004940 tx=0x7f8034009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.395+0000 7f8045828700 1 -- 172.21.15.64:0/4073227366 shutdown_connections 2023-12-16T03:13:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.395+0000 7f8045828700 1 --2- 172.21.15.64:0/4073227366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040103590 0x7f80400fcc00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.395+0000 7f8045828700 1 --2- 172.21.15.64:0/4073227366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8040102bf0 0x7f8040102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.395+0000 7f8045828700 1 -- 172.21.15.64:0/4073227366 >> 172.21.15.64:0/4073227366 conn(0x7f80400f87a0 msgr2=0x7f80400fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.395+0000 7f8045828700 1 -- 172.21.15.64:0/4073227366 shutdown_connections 2023-12-16T03:13:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.395+0000 7f8045828700 1 -- 172.21.15.64:0/4073227366 wait complete. 2023-12-16T03:13:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.396+0000 7f8045828700 1 Processor -- start 2023-12-16T03:13:27.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.396+0000 7f8045828700 1 -- start start 2023-12-16T03:13:27.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.396+0000 7f8045828700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040102bf0 0x7f804006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:27.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.396+0000 7f8045828700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8040103590 0x7f8040070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:27.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.396+0000 7f8045828700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8040070a80 con 0x7f8040102bf0 2023-12-16T03:13:27.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.396+0000 7f8045828700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8040070bf0 con 0x7f8040103590 2023-12-16T03:13:27.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.396+0000 7f803effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040102bf0 0x7f804006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:27.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.397+0000 7f803effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040102bf0 0x7f804006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39896/0 (socket says 172.21.15.64:39896) 2023-12-16T03:13:27.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.397+0000 7f803effd700 1 -- 172.21.15.64:0/872084584 learned_addr learned my addr 172.21.15.64:0/872084584 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:27.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.397+0000 7f803effd700 1 -- 172.21.15.64:0/872084584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8040103590 msgr2=0x7f8040070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:27.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.397+0000 7f803e7fc700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8040103590 0x7f8040070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:27.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.397+0000 7f803effd700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8040103590 0x7f8040070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.397+0000 7f803effd700 1 -- 172.21.15.64:0/872084584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8034005040 con 0x7f8040102bf0 2023-12-16T03:13:27.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.397+0000 7f803effd700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040102bf0 0x7f804006ff40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f803000eb70 tx=0x7f803000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:27.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.398+0000 7f80277fe700 1 -- 172.21.15.64:0/872084584 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8030007cc0 con 0x7f8040102bf0 2023-12-16T03:13:27.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.398+0000 7f80277fe700 1 -- 172.21.15.64:0/872084584 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f803000f040 con 0x7f8040102bf0 2023-12-16T03:13:27.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.398+0000 7f80277fe700 1 -- 172.21.15.64:0/872084584 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80300095f0 con 0x7f8040102bf0 2023-12-16T03:13:27.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.398+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8040119800 con 0x7f8040102bf0 2023-12-16T03:13:27.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.398+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8040119c60 con 0x7f8040102bf0 2023-12-16T03:13:27.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.400+0000 7f80277fe700 1 -- 172.21.15.64:0/872084584 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8030009750 con 0x7f8040102bf0 2023-12-16T03:13:27.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.400+0000 7f80277fe700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8028068f60 0x7f802806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:27.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.400+0000 7f80277fe700 1 -- 172.21.15.64:0/872084584 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f80300866a0 con 0x7f8040102bf0 2023-12-16T03:13:27.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.400+0000 7f803e7fc700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8028068f60 0x7f802806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:27.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.401+0000 7f803e7fc700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8028068f60 0x7f802806b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8040071940 tx=0x7f8034009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:27.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.401+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80401050c0 con 0x7f8040102bf0 2023-12-16T03:13:27.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.407+0000 7f80277fe700 1 -- 172.21.15.64:0/872084584 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8030052e10 con 0x7f8040102bf0 2023-12-16T03:13:27.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:27 smithi064 ceph-mon[111958]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:27.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:27 smithi184 ceph-mon[121180]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:27.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.608+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f804004bb80 con 0x7f8040102bf0 2023-12-16T03:13:27.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.608+0000 7f80277fe700 1 -- 172.21.15.64:0/872084584 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8030019030 con 0x7f8040102bf0 2023-12-16T03:13:27.610 INFO:teuthology.orchestra.run.smithi064.stdout:107374182415 2023-12-16T03:13:27.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8028068f60 msgr2=0x7f802806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8028068f60 0x7f802806b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8040071940 tx=0x7f8034009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040102bf0 msgr2=0x7f804006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040102bf0 0x7f804006ff40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f803000eb70 tx=0x7f803000b040 comp rx=0 tx=0).stop 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 shutdown_connections 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8028068f60 0x7f802806b410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8040102bf0 0x7f804006ff40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 --2- 172.21.15.64:0/872084584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8040103590 0x7f8040070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 >> 172.21.15.64:0/872084584 conn(0x7f80400f87a0 msgr2=0x7f80400fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 shutdown_connections 2023-12-16T03:13:27.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:27.610+0000 7f8045828700 1 -- 172.21.15.64:0/872084584 wait complete. 2023-12-16T03:13:27.990 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542166 got 60129542167 for osd.1 2023-12-16T03:13:27.991 DEBUG:teuthology.parallel:result is None 2023-12-16T03:13:28.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:28 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3270013248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-16T03:13:28.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:28 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/872084584' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-16T03:13:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.510+0000 7f99e2873700 1 -- 172.21.15.64:0/2522491316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc102c00 msgr2=0x7f99dc102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.510+0000 7f99e2873700 1 --2- 172.21.15.64:0/2522491316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc102c00 0x7f99dc102fd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99cc004940 tx=0x7f99cc009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.510+0000 7f99e2873700 1 -- 172.21.15.64:0/2522491316 shutdown_connections 2023-12-16T03:13:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.510+0000 7f99e2873700 1 --2- 172.21.15.64:0/2522491316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99dc1035a0 0x7f99dc0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.510+0000 7f99e2873700 1 --2- 172.21.15.64:0/2522491316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc102c00 0x7f99dc102fd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:28.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.510+0000 7f99e2873700 1 -- 172.21.15.64:0/2522491316 >> 172.21.15.64:0/2522491316 conn(0x7f99dc0f8790 msgr2=0x7f99dc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:28.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.510+0000 7f99e2873700 1 -- 172.21.15.64:0/2522491316 shutdown_connections 2023-12-16T03:13:28.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.510+0000 7f99e2873700 1 -- 172.21.15.64:0/2522491316 wait complete. 2023-12-16T03:13:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.510+0000 7f99e2873700 1 Processor -- start 2023-12-16T03:13:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99e2873700 1 -- start start 2023-12-16T03:13:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99e2873700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99dc102c00 0x7f99dc1136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99e2873700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc1035a0 0x7f99dc113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99e2873700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc1142d0 con 0x7f99dc1035a0 2023-12-16T03:13:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99e2873700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc10d590 con 0x7f99dc102c00 2023-12-16T03:13:28.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99db7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc1035a0 0x7f99dc113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99db7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc1035a0 0x7f99dc113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39916/0 (socket says 172.21.15.64:39916) 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99db7fe700 1 -- 172.21.15.64:0/1151656266 learned_addr learned my addr 172.21.15.64:0/1151656266 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99dbfff700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99dc102c00 0x7f99dc1136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99db7fe700 1 -- 172.21.15.64:0/1151656266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99dc102c00 msgr2=0x7f99dc1136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99db7fe700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99dc102c00 0x7f99dc1136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99db7fe700 1 -- 172.21.15.64:0/1151656266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc005040 con 0x7f99dc1035a0 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99dbfff700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99dc102c00 0x7f99dc1136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.511+0000 7f99db7fe700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc1035a0 0x7f99dc113bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d000b790 tx=0x7f99d0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.512+0000 7f99d8ff9700 1 -- 172.21.15.64:0/1151656266 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d000f6f0 con 0x7f99dc1035a0 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.512+0000 7f99d8ff9700 1 -- 172.21.15.64:0/1151656266 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99d000fd00 con 0x7f99dc1035a0 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.512+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc10d870 con 0x7f99dc1035a0 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.512+0000 7f99d8ff9700 1 -- 172.21.15.64:0/1151656266 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d00103a0 con 0x7f99dc1035a0 2023-12-16T03:13:28.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.512+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc10ddb0 con 0x7f99dc1035a0 2023-12-16T03:13:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.513+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc0fff10 con 0x7f99dc1035a0 2023-12-16T03:13:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.513+0000 7f99d8ff9700 1 -- 172.21.15.64:0/1151656266 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f99d000f850 con 0x7f99dc1035a0 2023-12-16T03:13:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.513+0000 7f99d8ff9700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f99c4068f70 0x7f99c406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.514+0000 7f99d8ff9700 1 -- 172.21.15.64:0/1151656266 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f99d00868e0 con 0x7f99dc1035a0 2023-12-16T03:13:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.514+0000 7f99dbfff700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f99c4068f70 0x7f99c406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:28.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.514+0000 7f99dbfff700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f99c4068f70 0x7f99c406b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00b3b0 tx=0x7f99cc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:28.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.518+0000 7f99d8ff9700 1 -- 172.21.15.64:0/1151656266 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f99d0056b00 con 0x7f99dc1035a0 2023-12-16T03:13:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:28 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3270013248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-16T03:13:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:28 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/872084584' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-16T03:13:28.674 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182414 got 107374182415 for osd.3 2023-12-16T03:13:28.674 DEBUG:teuthology.parallel:result is None 2023-12-16T03:13:28.700 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:28.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.722+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f99dc04bb80 con 0x7f99dc1035a0 2023-12-16T03:13:28.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.722+0000 7f99d8ff9700 1 -- 172.21.15.64:0/1151656266 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99d0056690 con 0x7f99dc1035a0 2023-12-16T03:13:28.725 INFO:teuthology.orchestra.run.smithi064.stdout:158913789959 2023-12-16T03:13:28.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f99c4068f70 msgr2=0x7f99c406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f99c4068f70 0x7f99c406b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00b3b0 tx=0x7f99cc009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc1035a0 msgr2=0x7f99dc113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc1035a0 0x7f99dc113bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d000b790 tx=0x7f99d0009220 comp rx=0 tx=0).stop 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 shutdown_connections 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f99c4068f70 0x7f99c406b420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99dc102c00 0x7f99dc1136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 --2- 172.21.15.64:0/1151656266 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99dc1035a0 0x7f99dc113bf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 >> 172.21.15.64:0/1151656266 conn(0x7f99dc0f8790 msgr2=0x7f99dc0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 shutdown_connections 2023-12-16T03:13:28.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:28.724+0000 7f99e2873700 1 -- 172.21.15.64:0/1151656266 wait complete. 2023-12-16T03:13:28.749 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:29.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:29 smithi064 ceph-mon[111958]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:29.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:29 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1151656266' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-16T03:13:29.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:29 smithi184 ceph-mon[121180]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:29.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:29 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1151656266' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-16T03:13:29.798 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789958 got 158913789959 for osd.5 2023-12-16T03:13:29.799 DEBUG:teuthology.parallel:result is None 2023-12-16T03:13:30.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.016+0000 7f62030e1700 1 -- 172.21.15.64:0/3500583341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc065390 msgr2=0x7f61fc065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:30.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.016+0000 7f62030e1700 1 --2- 172.21.15.64:0/3500583341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc065390 0x7f61fc065800 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f61e8004940 tx=0x7f61e8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:30.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.016+0000 7f62030e1700 1 -- 172.21.15.64:0/3500583341 shutdown_connections 2023-12-16T03:13:30.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.016+0000 7f62030e1700 1 --2- 172.21.15.64:0/3500583341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc065390 0x7f61fc065800 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.016+0000 7f62030e1700 1 --2- 172.21.15.64:0/3500583341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc102c20 0x7f61fc102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.016+0000 7f62030e1700 1 -- 172.21.15.64:0/3500583341 >> 172.21.15.64:0/3500583341 conn(0x7f61fc0719b0 msgr2=0x7f61fc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:30.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.016+0000 7f62030e1700 1 -- 172.21.15.64:0/3500583341 shutdown_connections 2023-12-16T03:13:30.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.016+0000 7f62030e1700 1 -- 172.21.15.64:0/3500583341 wait complete. 2023-12-16T03:13:30.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.017+0000 7f62030e1700 1 Processor -- start 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.017+0000 7f62030e1700 1 -- start start 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.017+0000 7f62030e1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc065390 0x7f61fc0fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.017+0000 7f62030e1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc102c20 0x7f61fc0fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.017+0000 7f62030e1700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc0fc730 con 0x7f61fc102c20 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.017+0000 7f62030e1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc0fc8a0 con 0x7f61fc065390 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.017+0000 7f61fbfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc102c20 0x7f61fc0fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f61fbfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc102c20 0x7f61fc0fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39940/0 (socket says 172.21.15.64:39940) 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f61fbfff700 1 -- 172.21.15.64:0/2629485463 learned_addr learned my addr 172.21.15.64:0/2629485463 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f6200e7d700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc065390 0x7f61fc0fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f61fbfff700 1 -- 172.21.15.64:0/2629485463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc065390 msgr2=0x7f61fc0fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f61fbfff700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc065390 0x7f61fc0fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f61fbfff700 1 -- 172.21.15.64:0/2629485463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e8005040 con 0x7f61fc102c20 2023-12-16T03:13:30.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f61fbfff700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc102c20 0x7f61fc0fc130 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009180 tx=0x7f61e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:30.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f61f97fa700 1 -- 172.21.15.64:0/2629485463 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e800e040 con 0x7f61fc102c20 2023-12-16T03:13:30.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f61f97fa700 1 -- 172.21.15.64:0/2629485463 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61e8013420 con 0x7f61fc102c20 2023-12-16T03:13:30.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61fc119820 con 0x7f61fc102c20 2023-12-16T03:13:30.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f61f97fa700 1 -- 172.21.15.64:0/2629485463 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e801c630 con 0x7f61fc102c20 2023-12-16T03:13:30.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.018+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61fc119c80 con 0x7f61fc102c20 2023-12-16T03:13:30.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.019+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61fc0fff40 con 0x7f61fc102c20 2023-12-16T03:13:30.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.020+0000 7f61f97fa700 1 -- 172.21.15.64:0/2629485463 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f61e80139e0 con 0x7f61fc102c20 2023-12-16T03:13:30.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.020+0000 7f61f97fa700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f61ec068f60 0x7f61ec06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:30.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.020+0000 7f61f97fa700 1 -- 172.21.15.64:0/2629485463 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f61e8087cf0 con 0x7f61fc102c20 2023-12-16T03:13:30.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.020+0000 7f6200e7d700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f61ec068f60 0x7f61ec06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:30.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.021+0000 7f6200e7d700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f61ec068f60 0x7f61ec06b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009fd0 tx=0x7f61f0009f60 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:30.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.029+0000 7f61f97fa700 1 -- 172.21.15.64:0/2629485463 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f61e80545a0 con 0x7f61fc102c20 2023-12-16T03:13:30.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.247+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61fc0fff40 con 0x7f61fc102c20 2023-12-16T03:13:30.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.248+0000 7f61f97fa700 1 -- 172.21.15.64:0/2629485463 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61e8057bc0 con 0x7f61fc102c20 2023-12-16T03:13:30.251 INFO:teuthology.orchestra.run.smithi064.stdout:38654705691 2023-12-16T03:13:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.250+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f61ec068f60 msgr2=0x7f61ec06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.250+0000 7f62030e1700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f61ec068f60 0x7f61ec06b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009fd0 tx=0x7f61f0009f60 comp rx=0 tx=0).stop 2023-12-16T03:13:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.250+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc102c20 msgr2=0x7f61fc0fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.250+0000 7f62030e1700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc102c20 0x7f61fc0fc130 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009180 tx=0x7f61e8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.250+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 shutdown_connections 2023-12-16T03:13:30.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.250+0000 7f62030e1700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f61ec068f60 0x7f61ec06b410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.250+0000 7f62030e1700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc065390 0x7f61fc0fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.250+0000 7f62030e1700 1 --2- 172.21.15.64:0/2629485463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61fc102c20 0x7f61fc0fc130 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.250+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 >> 172.21.15.64:0/2629485463 conn(0x7f61fc0719b0 msgr2=0x7f61fc0fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.251+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 shutdown_connections 2023-12-16T03:13:30.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.251+0000 7f62030e1700 1 -- 172.21.15.64:0/2629485463 wait complete. 2023-12-16T03:13:30.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 -- 172.21.15.64:0/2387098099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 msgr2=0x7f65780fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:30.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 --2- 172.21.15.64:0/2387098099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 0x7f65780fbfb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6568004940 tx=0x7f6568009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:30.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 -- 172.21.15.64:0/2387098099 shutdown_connections 2023-12-16T03:13:30.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 --2- 172.21.15.64:0/2387098099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 0x7f65780fbfb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 --2- 172.21.15.64:0/2387098099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6578101b00 0x7f6578101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 -- 172.21.15.64:0/2387098099 >> 172.21.15.64:0/2387098099 conn(0x7f65780719b0 msgr2=0x7f6578071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:30.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 -- 172.21.15.64:0/2387098099 shutdown_connections 2023-12-16T03:13:30.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 -- 172.21.15.64:0/2387098099 wait complete. 2023-12-16T03:13:30.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 Processor -- start 2023-12-16T03:13:30.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.427+0000 7f657f598700 1 -- start start 2023-12-16T03:13:30.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657f598700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 0x7f657810e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:30.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657f598700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6578101b00 0x7f657810ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:30.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657f598700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657810f1e0 con 0x7f65780fbb40 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657f598700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657810f350 con 0x7f6578101b00 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657d334700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 0x7f657810e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657d334700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 0x7f657810e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39960/0 (socket says 172.21.15.64:39960) 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657d334700 1 -- 172.21.15.64:0/4164465492 learned_addr learned my addr 172.21.15.64:0/4164465492 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657d334700 1 -- 172.21.15.64:0/4164465492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6578101b00 msgr2=0x7f657810ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657d334700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6578101b00 0x7f657810ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657d334700 1 -- 172.21.15.64:0/4164465492 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568005040 con 0x7f65780fbb40 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657d334700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 0x7f657810e710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f657400c810 tx=0x7f6574004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f656dffb700 1 -- 172.21.15.64:0/4164465492 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6574012810 con 0x7f65780fbb40 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f656dffb700 1 -- 172.21.15.64:0/4164465492 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6574012e20 con 0x7f65780fbb40 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65781176e0 con 0x7f65780fbb40 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.428+0000 7f656dffb700 1 -- 172.21.15.64:0/4164465492 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f657400a370 con 0x7f65780fbb40 2023-12-16T03:13:30.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.429+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6578117ba0 con 0x7f65780fbb40 2023-12-16T03:13:30.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.430+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6578103fb0 con 0x7f65780fbb40 2023-12-16T03:13:30.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.430+0000 7f656dffb700 1 -- 172.21.15.64:0/4164465492 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6574011780 con 0x7f65780fbb40 2023-12-16T03:13:30.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.430+0000 7f656dffb700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6564068f60 0x7f656406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:30.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.430+0000 7f656dffb700 1 -- 172.21.15.64:0/4164465492 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6574086e30 con 0x7f65780fbb40 2023-12-16T03:13:30.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.431+0000 7f657cb33700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6564068f60 0x7f656406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:30.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.431+0000 7f657cb33700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6564068f60 0x7f656406b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6568004f90 tx=0x7f6568009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:30.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.435+0000 7f656dffb700 1 -- 172.21.15.64:0/4164465492 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6574053640 con 0x7f65780fbb40 2023-12-16T03:13:30.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:30 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2629485463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-16T03:13:30.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.636+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f65780734d0 con 0x7f65780fbb40 2023-12-16T03:13:30.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.637+0000 7f656dffb700 1 -- 172.21.15.64:0/4164465492 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6574056c60 con 0x7f65780fbb40 2023-12-16T03:13:30.639 INFO:teuthology.orchestra.run.smithi064.stdout:137438953482 2023-12-16T03:13:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6564068f60 msgr2=0x7f656406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6564068f60 0x7f656406b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6568004f90 tx=0x7f6568009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 msgr2=0x7f657810e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 0x7f657810e710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f657400c810 tx=0x7f6574004470 comp rx=0 tx=0).stop 2023-12-16T03:13:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 shutdown_connections 2023-12-16T03:13:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6564068f60 0x7f656406b410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65780fbb40 0x7f657810e710 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 --2- 172.21.15.64:0/4164465492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6578101b00 0x7f657810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 >> 172.21.15.64:0/4164465492 conn(0x7f65780719b0 msgr2=0x7f65780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:30.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 shutdown_connections 2023-12-16T03:13:30.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:30.639+0000 7f657f598700 1 -- 172.21.15.64:0/4164465492 wait complete. 2023-12-16T03:13:30.664 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:30 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2629485463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-16T03:13:31.248 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705690 got 38654705691 for osd.0 2023-12-16T03:13:31.249 DEBUG:teuthology.parallel:result is None 2023-12-16T03:13:31.324 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953482 got 137438953482 for osd.4 2023-12-16T03:13:31.324 DEBUG:teuthology.parallel:result is None 2023-12-16T03:13:31.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:31 smithi184 ceph-mon[121180]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:31.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:31 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/4164465492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-16T03:13:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.575+0000 7f2ad8bba700 1 -- 172.21.15.64:0/2715062526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4103590 msgr2=0x7f2ad40fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.575+0000 7f2ad8bba700 1 --2- 172.21.15.64:0/2715062526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4103590 0x7f2ad40fcc00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8004940 tx=0x7f2ac8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.575+0000 7f2ad8bba700 1 -- 172.21.15.64:0/2715062526 shutdown_connections 2023-12-16T03:13:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.575+0000 7f2ad8bba700 1 --2- 172.21.15.64:0/2715062526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4103590 0x7f2ad40fcc00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.575+0000 7f2ad8bba700 1 --2- 172.21.15.64:0/2715062526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad4102bf0 0x7f2ad4102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.575+0000 7f2ad8bba700 1 -- 172.21.15.64:0/2715062526 >> 172.21.15.64:0/2715062526 conn(0x7f2ad40f87a0 msgr2=0x7f2ad40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.575+0000 7f2ad8bba700 1 -- 172.21.15.64:0/2715062526 shutdown_connections 2023-12-16T03:13:31.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.575+0000 7f2ad8bba700 1 -- 172.21.15.64:0/2715062526 wait complete. 2023-12-16T03:13:31.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.576+0000 7f2ad8bba700 1 Processor -- start 2023-12-16T03:13:31.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.576+0000 7f2ad8bba700 1 -- start start 2023-12-16T03:13:31.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.576+0000 7f2ad8bba700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4102bf0 0x7f2ad4113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:31.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.576+0000 7f2ad8bba700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad4103590 0x7f2ad4113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:31.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.576+0000 7f2ad8bba700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad410d520 con 0x7f2ad4102bf0 2023-12-16T03:13:31.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.576+0000 7f2ad8bba700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad410d690 con 0x7f2ad4103590 2023-12-16T03:13:31.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.576+0000 7f2ad259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4102bf0 0x7f2ad4113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:31.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.576+0000 7f2ad259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4102bf0 0x7f2ad4113660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39974/0 (socket says 172.21.15.64:39974) 2023-12-16T03:13:31.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.576+0000 7f2ad259c700 1 -- 172.21.15.64:0/3062810407 learned_addr learned my addr 172.21.15.64:0/3062810407 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:31.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.577+0000 7f2ad259c700 1 -- 172.21.15.64:0/3062810407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad4103590 msgr2=0x7f2ad4113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:31.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.577+0000 7f2ad259c700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad4103590 0x7f2ad4113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:31.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.577+0000 7f2ad259c700 1 -- 172.21.15.64:0/3062810407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8005040 con 0x7f2ad4102bf0 2023-12-16T03:13:31.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.577+0000 7f2ad259c700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4102bf0 0x7f2ad4113660 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400b790 tx=0x7f2ac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:31.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.577+0000 7f2ac2ffd700 1 -- 172.21.15.64:0/3062810407 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac400f770 con 0x7f2ad4102bf0 2023-12-16T03:13:31.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.577+0000 7f2ac2ffd700 1 -- 172.21.15.64:0/3062810407 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ac400fd80 con 0x7f2ad4102bf0 2023-12-16T03:13:31.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.577+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad410d970 con 0x7f2ad4102bf0 2023-12-16T03:13:31.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.577+0000 7f2ac2ffd700 1 -- 172.21.15.64:0/3062810407 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac400d310 con 0x7f2ad4102bf0 2023-12-16T03:13:31.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.577+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad410deb0 con 0x7f2ad4102bf0 2023-12-16T03:13:31.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.578+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad40fff00 con 0x7f2ad4102bf0 2023-12-16T03:13:31.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.578+0000 7f2ac2ffd700 1 -- 172.21.15.64:0/3062810407 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2ac4010420 con 0x7f2ad4102bf0 2023-12-16T03:13:31.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.579+0000 7f2ac2ffd700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2abc068f60 0x7f2abc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:31.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.579+0000 7f2ac2ffd700 1 -- 172.21.15.64:0/3062810407 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2ac4086a40 con 0x7f2ad4102bf0 2023-12-16T03:13:31.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.579+0000 7f2ad1d9b700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2abc068f60 0x7f2abc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:31.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.579+0000 7f2ad1d9b700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2abc068f60 0x7f2abc06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8004f90 tx=0x7f2ac8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:31.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.583+0000 7f2ac2ffd700 1 -- 172.21.15.64:0/3062810407 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2ac4056ce0 con 0x7f2ad4102bf0 2023-12-16T03:13:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:31 smithi064 ceph-mon[111958]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:31 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/4164465492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-16T03:13:31.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.779+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2ad404bb80 con 0x7f2ad4102bf0 2023-12-16T03:13:31.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.779+0000 7f2ac2ffd700 1 -- 172.21.15.64:0/3062810407 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ac4056870 con 0x7f2ad4102bf0 2023-12-16T03:13:31.781 INFO:teuthology.orchestra.run.smithi064.stdout:81604378644 2023-12-16T03:13:31.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2abc068f60 msgr2=0x7f2abc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:31.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2abc068f60 0x7f2abc06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8004f90 tx=0x7f2ac8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:31.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4102bf0 msgr2=0x7f2ad4113660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:31.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4102bf0 0x7f2ad4113660 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400b790 tx=0x7f2ac4009250 comp rx=0 tx=0).stop 2023-12-16T03:13:31.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 shutdown_connections 2023-12-16T03:13:31.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2abc068f60 0x7f2abc06b410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:31.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ad4102bf0 0x7f2ad4113660 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:31.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 --2- 172.21.15.64:0/3062810407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad4103590 0x7f2ad4113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:31.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 >> 172.21.15.64:0/3062810407 conn(0x7f2ad40f87a0 msgr2=0x7f2ad40fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:31.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 shutdown_connections 2023-12-16T03:13:31.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:31.781+0000 7f2ad8bba700 1 -- 172.21.15.64:0/3062810407 wait complete. 2023-12-16T03:13:32.198 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378642 got 81604378644 for osd.2 2023-12-16T03:13:32.198 DEBUG:teuthology.parallel:result is None 2023-12-16T03:13:32.198 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-16T03:13:32.198 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-16T03:13:32.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:32 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3062810407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-16T03:13:32.480 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:32.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:32 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3062810407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-16T03:13:33.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:33 smithi184 ceph-mon[121180]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:33.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:33 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:13:33.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.603+0000 7fd0fb488700 1 -- 172.21.15.64:0/3116806693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f40fbb40 msgr2=0x7fd0f40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:33.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.603+0000 7fd0fb488700 1 --2- 172.21.15.64:0/3116806693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f40fbb40 0x7fd0f40fbfb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4004940 tx=0x7fd0e4009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:33.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.603+0000 7fd0fb488700 1 -- 172.21.15.64:0/3116806693 shutdown_connections 2023-12-16T03:13:33.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.603+0000 7fd0fb488700 1 --2- 172.21.15.64:0/3116806693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f40fbb40 0x7fd0f40fbfb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:33.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.603+0000 7fd0fb488700 1 --2- 172.21.15.64:0/3116806693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0f4101b00 0x7fd0f4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:33.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.603+0000 7fd0fb488700 1 -- 172.21.15.64:0/3116806693 >> 172.21.15.64:0/3116806693 conn(0x7fd0f40719b0 msgr2=0x7fd0f4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:33.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.603+0000 7fd0fb488700 1 -- 172.21.15.64:0/3116806693 shutdown_connections 2023-12-16T03:13:33.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.603+0000 7fd0fb488700 1 -- 172.21.15.64:0/3116806693 wait complete. 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0fb488700 1 Processor -- start 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0fb488700 1 -- start start 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0fb488700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0f40fbb40 0x7fd0f4112560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0fb488700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f4101b00 0x7fd0f4112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0fb488700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4113180 con 0x7fd0f4101b00 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0fb488700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f410c420 con 0x7fd0f40fbb40 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0f8a23700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f4101b00 0x7fd0f4112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0f8a23700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f4101b00 0x7fd0f4112aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37890/0 (socket says 172.21.15.64:37890) 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0f8a23700 1 -- 172.21.15.64:0/2469222198 learned_addr learned my addr 172.21.15.64:0/2469222198 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0f9224700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0f40fbb40 0x7fd0f4112560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0f8a23700 1 -- 172.21.15.64:0/2469222198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0f40fbb40 msgr2=0x7fd0f4112560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0f8a23700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0f40fbb40 0x7fd0f4112560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:33.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.604+0000 7fd0f8a23700 1 -- 172.21.15.64:0/2469222198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4005040 con 0x7fd0f4101b00 2023-12-16T03:13:33.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.605+0000 7fd0f8a23700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f4101b00 0x7fd0f4112aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009fd0 tx=0x7fd0e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:33.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.605+0000 7fd0e9ffb700 1 -- 172.21.15.64:0/2469222198 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0e400e040 con 0x7fd0f4101b00 2023-12-16T03:13:33.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.605+0000 7fd0e9ffb700 1 -- 172.21.15.64:0/2469222198 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0e400bd90 con 0x7fd0f4101b00 2023-12-16T03:13:33.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.605+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f410c6a0 con 0x7fd0f4101b00 2023-12-16T03:13:33.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.605+0000 7fd0e9ffb700 1 -- 172.21.15.64:0/2469222198 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0e4013660 con 0x7fd0f4101b00 2023-12-16T03:13:33.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.605+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f410cb80 con 0x7fd0f4101b00 2023-12-16T03:13:33.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.606+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f40734d0 con 0x7fd0f4101b00 2023-12-16T03:13:33.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.606+0000 7fd0e9ffb700 1 -- 172.21.15.64:0/2469222198 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd0e401ea60 con 0x7fd0f4101b00 2023-12-16T03:13:33.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.607+0000 7fd0e9ffb700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0e0068f70 0x7fd0e006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:33.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.607+0000 7fd0e9ffb700 1 -- 172.21.15.64:0/2469222198 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd0e408a940 con 0x7fd0f4101b00 2023-12-16T03:13:33.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.607+0000 7fd0f9224700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0e0068f70 0x7fd0e006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:33.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.607+0000 7fd0f9224700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0e0068f70 0x7fd0e006b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0006fd0 tx=0x7fd0f0008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:33.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.611+0000 7fd0e9ffb700 1 -- 172.21.15.64:0/2469222198 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd0e405ab60 con 0x7fd0f4101b00 2023-12-16T03:13:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:33 smithi064 ceph-mon[111958]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:33 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:13:33.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.803+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0f410dbb0 con 0x7fd0e0068f70 2023-12-16T03:13:33.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.804+0000 7fd0e9ffb700 1 -- 172.21.15.64:0/2469222198 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+22911 (secure 0 0 0) 0x7fd0f410dbb0 con 0x7fd0e0068f70 2023-12-16T03:13:33.806 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0e0068f70 msgr2=0x7fd0e006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0e0068f70 0x7fd0e006b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0006fd0 tx=0x7fd0f0008040 comp rx=0 tx=0).stop 2023-12-16T03:13:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f4101b00 msgr2=0x7fd0f4112aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f4101b00 0x7fd0f4112aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009fd0 tx=0x7fd0e4009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 shutdown_connections 2023-12-16T03:13:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd0e0068f70 0x7fd0e006b420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0f40fbb40 0x7fd0f4112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 --2- 172.21.15.64:0/2469222198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0f4101b00 0x7fd0f4112aa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 >> 172.21.15.64:0/2469222198 conn(0x7fd0f40719b0 msgr2=0x7fd0f40faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 shutdown_connections 2023-12-16T03:13:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:33.806+0000 7fd0fb488700 1 -- 172.21.15.64:0/2469222198 wait complete. 2023-12-16T03:13:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-12-16T03:13:34.205 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-12-16T03:13:32.357235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787508,"kb_used_data":3780,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683404,"statfs":{"total":575970213888,"available":574139805696,"internally_reserved":0,"allocated":3870720,"data_stored":2563350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001843"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:13:01.491270+0000","last_change":"2023-12-16T03:12:44.252330+0000","last_active":"2023-12-16T03:13:01.491270+0000","last_peered":"2023-12-16T03:13:01.491270+0000","last_clean":"2023-12-16T03:13:01.491270+0000","last_became_active":"2023-12-16T03:12:44.251938+0000","last_became_peered":"2023-12-16T03:12:44.251938+0000","last_unstale":"2023-12-16T03:13:01.491270+0000","last_undegraded":"2023-12-16T03:13:01.491270+0000","last_fullsized":"2023-12-16T03:13:01.491270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:12:08.892308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:12:08.892308+0000","last_clean_scrub_stamp":"2023-12-16T03:12:08.892308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:44.837240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":4,"up_from":32,"seq":137438953483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182416,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.443},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29399999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.37},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.247},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.26000000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.27600000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:13:34.206 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-16T03:13:34.477 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:35.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.634+0000 7f73dccad700 1 -- 172.21.15.64:0/1474411837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 msgr2=0x7f73d80fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:35.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.634+0000 7f73dccad700 1 --2- 172.21.15.64:0/1474411837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 0x7f73d80fdfb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f73c8004940 tx=0x7f73c8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:35.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.634+0000 7f73dccad700 1 -- 172.21.15.64:0/1474411837 shutdown_connections 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.634+0000 7f73dccad700 1 --2- 172.21.15.64:0/1474411837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73d80fe580 0x7f73d8106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.634+0000 7f73dccad700 1 --2- 172.21.15.64:0/1474411837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 0x7f73d80fdfb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.634+0000 7f73dccad700 1 -- 172.21.15.64:0/1474411837 >> 172.21.15.64:0/1474411837 conn(0x7f73d80f7680 msgr2=0x7f73d80f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.634+0000 7f73dccad700 1 -- 172.21.15.64:0/1474411837 shutdown_connections 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.634+0000 7f73dccad700 1 -- 172.21.15.64:0/1474411837 wait complete. 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73dccad700 1 Processor -- start 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73dccad700 1 -- start start 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73dccad700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 0x7f73d81136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73dccad700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73d80fe580 0x7f73d8113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73dccad700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d8114280 con 0x7f73d80fdbe0 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73dccad700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d810d570 con 0x7f73d80fe580 2023-12-16T03:13:35.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73d659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 0x7f73d81136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:35.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73d659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 0x7f73d81136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37920/0 (socket says 172.21.15.64:37920) 2023-12-16T03:13:35.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73d659c700 1 -- 172.21.15.64:0/1263799693 learned_addr learned my addr 172.21.15.64:0/1263799693 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:35.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73d659c700 1 -- 172.21.15.64:0/1263799693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73d80fe580 msgr2=0x7f73d8113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:35.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73d659c700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73d80fe580 0x7f73d8113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:35.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73d659c700 1 -- 172.21.15.64:0/1263799693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8005040 con 0x7f73d80fdbe0 2023-12-16T03:13:35.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.635+0000 7f73d659c700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 0x7f73d81136b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f73c800b3b0 tx=0x7f73c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:35.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.636+0000 7f73c6ffd700 1 -- 172.21.15.64:0/1263799693 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c800e040 con 0x7f73d80fdbe0 2023-12-16T03:13:35.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.636+0000 7f73c6ffd700 1 -- 172.21.15.64:0/1263799693 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73c8004290 con 0x7f73d80fdbe0 2023-12-16T03:13:35.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.636+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d810d7a0 con 0x7f73d80fdbe0 2023-12-16T03:13:35.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.636+0000 7f73c6ffd700 1 -- 172.21.15.64:0/1263799693 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c801c3f0 con 0x7f73d80fdbe0 2023-12-16T03:13:35.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.636+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d810dce0 con 0x7f73d80fdbe0 2023-12-16T03:13:35.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.637+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d81042b0 con 0x7f73d80fdbe0 2023-12-16T03:13:35.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.637+0000 7f73c6ffd700 1 -- 172.21.15.64:0/1263799693 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f73c800bc50 con 0x7f73d80fdbe0 2023-12-16T03:13:35.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.637+0000 7f73c6ffd700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f73c0068f60 0x7f73c006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:35.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.638+0000 7f73c6ffd700 1 -- 172.21.15.64:0/1263799693 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f73c8087de0 con 0x7f73d80fdbe0 2023-12-16T03:13:35.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.638+0000 7f73d5d9b700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f73c0068f60 0x7f73c006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:35.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.638+0000 7f73d5d9b700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f73c0068f60 0x7f73c006b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f73d810ef50 tx=0x7f73cc007d40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:35.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.642+0000 7f73c6ffd700 1 -- 172.21.15.64:0/1263799693 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f73c8058120 con 0x7f73d80fdbe0 2023-12-16T03:13:35.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:35 smithi064 ceph-mon[111958]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T03:13:35.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:35 smithi064 ceph-mon[111958]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:35.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:35 smithi184 ceph-mon[121180]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T03:13:35.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:35 smithi184 ceph-mon[121180]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:35.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.832+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73d804bb80 con 0x7f73c0068f60 2023-12-16T03:13:35.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.833+0000 7f73c6ffd700 1 -- 172.21.15.64:0/1263799693 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24135 (secure 0 0 0) 0x7f73d804bb80 con 0x7f73c0068f60 2023-12-16T03:13:35.836 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.835+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f73c0068f60 msgr2=0x7f73c006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.835+0000 7f73dccad700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f73c0068f60 0x7f73c006b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f73d810ef50 tx=0x7f73cc007d40 comp rx=0 tx=0).stop 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.835+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 msgr2=0x7f73d81136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.835+0000 7f73dccad700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 0x7f73d81136b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f73c800b3b0 tx=0x7f73c8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.835+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 shutdown_connections 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.835+0000 7f73dccad700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f73c0068f60 0x7f73c006b410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.835+0000 7f73dccad700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f73d80fdbe0 0x7f73d81136b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.835+0000 7f73dccad700 1 --2- 172.21.15.64:0/1263799693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73d80fe580 0x7f73d8113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.835+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 >> 172.21.15.64:0/1263799693 conn(0x7f73d80f7680 msgr2=0x7f73d8101430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.836+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 shutdown_connections 2023-12-16T03:13:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:35.836+0000 7f73dccad700 1 -- 172.21.15.64:0/1263799693 wait complete. 2023-12-16T03:13:35.839 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-12-16T03:13:36.269 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-12-16T03:13:34.357498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787508,"kb_used_data":3780,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683404,"statfs":{"total":575970213888,"available":574139805696,"internally_reserved":0,"allocated":3870720,"data_stored":2563350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001869"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:13:01.491270+0000","last_change":"2023-12-16T03:12:44.252330+0000","last_active":"2023-12-16T03:13:01.491270+0000","last_peered":"2023-12-16T03:13:01.491270+0000","last_clean":"2023-12-16T03:13:01.491270+0000","last_became_active":"2023-12-16T03:12:44.251938+0000","last_became_peered":"2023-12-16T03:12:44.251938+0000","last_unstale":"2023-12-16T03:13:01.491270+0000","last_undegraded":"2023-12-16T03:13:01.491270+0000","last_fullsized":"2023-12-16T03:13:01.491270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:12:08.892308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:12:08.892308+0000","last_clean_scrub_stamp":"2023-12-16T03:12:08.892308+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:20:44.837240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]}]},{"osd":4,"up_from":32,"seq":137438953484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182416,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.443},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378645,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.28899999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.372}]},{"osd":2,"last update":"Sat Dec 16 03:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.34799999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.33100000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:13:36.270 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-16T03:13:36.270 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-16T03:13:36.270 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-16T03:13:36.270 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph health --format=json 2023-12-16T03:13:36.540 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:37.434 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:37 smithi064 ceph-mon[111958]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T03:13:37.434 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:37 smithi064 ceph-mon[111958]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:37.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:37 smithi184 ceph-mon[121180]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T03:13:37.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:37 smithi184 ceph-mon[121180]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:37.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.632+0000 7fbf06637700 1 -- 172.21.15.64:0/3069328258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf000fbb40 msgr2=0x7fbf000fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:37.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.632+0000 7fbf06637700 1 --2- 172.21.15.64:0/3069328258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf000fbb40 0x7fbf000fbfb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbef4004940 tx=0x7fbef4009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:37.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.632+0000 7fbf06637700 1 -- 172.21.15.64:0/3069328258 shutdown_connections 2023-12-16T03:13:37.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.632+0000 7fbf06637700 1 --2- 172.21.15.64:0/3069328258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf000fbb40 0x7fbf000fbfb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:37.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.632+0000 7fbf06637700 1 --2- 172.21.15.64:0/3069328258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf00101b00 0x7fbf00101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:37.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.632+0000 7fbf06637700 1 -- 172.21.15.64:0/3069328258 >> 172.21.15.64:0/3069328258 conn(0x7fbf000719b0 msgr2=0x7fbf00071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:37.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.632+0000 7fbf06637700 1 -- 172.21.15.64:0/3069328258 shutdown_connections 2023-12-16T03:13:37.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.632+0000 7fbf06637700 1 -- 172.21.15.64:0/3069328258 wait complete. 2023-12-16T03:13:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.633+0000 7fbf06637700 1 Processor -- start 2023-12-16T03:13:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.633+0000 7fbf06637700 1 -- start start 2023-12-16T03:13:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.633+0000 7fbf06637700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf000fbb40 0x7fbf00115890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.633+0000 7fbf06637700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf00101b00 0x7fbf00115dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.633+0000 7fbf06637700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf00116420 con 0x7fbf00101b00 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.633+0000 7fbf06637700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0010f750 con 0x7fbf000fbb40 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.633+0000 7fbeff7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf00101b00 0x7fbf00115dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.633+0000 7fbeff7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf00101b00 0x7fbf00115dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37934/0 (socket says 172.21.15.64:37934) 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.633+0000 7fbeff7fe700 1 -- 172.21.15.64:0/1711972735 learned_addr learned my addr 172.21.15.64:0/1711972735 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbefffff700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf000fbb40 0x7fbf00115890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbeff7fe700 1 -- 172.21.15.64:0/1711972735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf000fbb40 msgr2=0x7fbf00115890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbeff7fe700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf000fbb40 0x7fbf00115890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbeff7fe700 1 -- 172.21.15.64:0/1711972735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef4005040 con 0x7fbf00101b00 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbeff7fe700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf00101b00 0x7fbf00115dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbef400b3b0 tx=0x7fbef4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbefcff9700 1 -- 172.21.15.64:0/1711972735 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef400e040 con 0x7fbf00101b00 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbefcff9700 1 -- 172.21.15.64:0/1711972735 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbef400bc50 con 0x7fbf00101b00 2023-12-16T03:13:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0010f9d0 con 0x7fbf00101b00 2023-12-16T03:13:37.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbefcff9700 1 -- 172.21.15.64:0/1711972735 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef4013420 con 0x7fbf00101b00 2023-12-16T03:13:37.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.634+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0010ff10 con 0x7fbf00101b00 2023-12-16T03:13:37.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.635+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf000734d0 con 0x7fbf00101b00 2023-12-16T03:13:37.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.636+0000 7fbefcff9700 1 -- 172.21.15.64:0/1711972735 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbef401c430 con 0x7fbf00101b00 2023-12-16T03:13:37.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.636+0000 7fbefcff9700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fbee8068f60 0x7fbee806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:37.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.636+0000 7fbefcff9700 1 -- 172.21.15.64:0/1711972735 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbef4087830 con 0x7fbf00101b00 2023-12-16T03:13:37.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.636+0000 7fbefffff700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fbee8068f60 0x7fbee806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:37.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.636+0000 7fbefffff700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fbee8068f60 0x7fbee806b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbef0007fd0 tx=0x7fbef0009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:37.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.641+0000 7fbefcff9700 1 -- 172.21.15.64:0/1711972735 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbef4057b80 con 0x7fbf00101b00 2023-12-16T03:13:37.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.876+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbf00108ab0 con 0x7fbf00101b00 2023-12-16T03:13:37.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.876+0000 7fbefcff9700 1 -- 172.21.15.64:0/1711972735 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbef4057710 con 0x7fbf00101b00 2023-12-16T03:13:37.879 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:37.879 INFO:teuthology.orchestra.run.smithi064.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-16T03:13:37.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fbee8068f60 msgr2=0x7fbee806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fbee8068f60 0x7fbee806b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbef0007fd0 tx=0x7fbef0009040 comp rx=0 tx=0).stop 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf00101b00 msgr2=0x7fbf00115dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf00101b00 0x7fbf00115dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbef400b3b0 tx=0x7fbef4009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 shutdown_connections 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fbee8068f60 0x7fbee806b410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf000fbb40 0x7fbf00115890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 --2- 172.21.15.64:0/1711972735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf00101b00 0x7fbf00115dd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 >> 172.21.15.64:0/1711972735 conn(0x7fbf000719b0 msgr2=0x7fbf000654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 shutdown_connections 2023-12-16T03:13:37.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:37.878+0000 7fbf06637700 1 -- 172.21.15.64:0/1711972735 wait complete. 2023-12-16T03:13:38.273 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-16T03:13:38.273 INFO:tasks.cephadm:Setup complete, yielding 2023-12-16T03:13:38.273 INFO:teuthology.run_tasks:Running task print... 2023-12-16T03:13:38.283 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-16T03:13:38.283 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T03:13:38.291 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:13:38.291 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-16T03:13:38.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:38 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1711972735' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-16T03:13:38.560 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:38.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:38 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1711972735' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-16T03:13:39.385 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:39 smithi064 ceph-mon[111958]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:39.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:39 smithi184 ceph-mon[121180]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:39.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.615+0000 7f4c2bafc700 1 -- 172.21.15.64:0/875336252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c24100050 msgr2=0x7f4c24102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:39.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.615+0000 7f4c2bafc700 1 --2- 172.21.15.64:0/875336252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c24100050 0x7f4c24102430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4c14004940 tx=0x7f4c14009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:39.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.615+0000 7f4c2bafc700 1 -- 172.21.15.64:0/875336252 shutdown_connections 2023-12-16T03:13:39.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.615+0000 7f4c2bafc700 1 --2- 172.21.15.64:0/875336252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c24100050 0x7f4c24102430 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:39.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.615+0000 7f4c2bafc700 1 --2- 172.21.15.64:0/875336252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c240fd730 0x7f4c240ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:39.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.615+0000 7f4c2bafc700 1 -- 172.21.15.64:0/875336252 >> 172.21.15.64:0/875336252 conn(0x7f4c240f7190 msgr2=0x7f4c240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:39.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.615+0000 7f4c2bafc700 1 -- 172.21.15.64:0/875336252 shutdown_connections 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c2bafc700 1 -- 172.21.15.64:0/875336252 wait complete. 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c2bafc700 1 Processor -- start 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c2bafc700 1 -- start start 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c2bafc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c240fd730 0x7f4c2410d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c2bafc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c24100050 0x7f4c2410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c2bafc700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2410e070 con 0x7f4c240fd730 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c2bafc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2410e910 con 0x7f4c24100050 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c29898700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c240fd730 0x7f4c2410d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c29898700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c240fd730 0x7f4c2410d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37956/0 (socket says 172.21.15.64:37956) 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c29898700 1 -- 172.21.15.64:0/307043536 learned_addr learned my addr 172.21.15.64:0/307043536 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.616+0000 7f4c29097700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c24100050 0x7f4c2410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.617+0000 7f4c29898700 1 -- 172.21.15.64:0/307043536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c24100050 msgr2=0x7f4c2410da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.617+0000 7f4c29898700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c24100050 0x7f4c2410da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.617+0000 7f4c29898700 1 -- 172.21.15.64:0/307043536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14005040 con 0x7f4c240fd730 2023-12-16T03:13:39.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.617+0000 7f4c29898700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c240fd730 0x7f4c2410d530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4c20002a50 tx=0x7f4c200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:39.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.617+0000 7f4c1a7fc700 1 -- 172.21.15.64:0/307043536 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c20007cc0 con 0x7f4c240fd730 2023-12-16T03:13:39.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.617+0000 7f4c1a7fc700 1 -- 172.21.15.64:0/307043536 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c2000f040 con 0x7f4c240fd730 2023-12-16T03:13:39.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.617+0000 7f4c1a7fc700 1 -- 172.21.15.64:0/307043536 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c2000d9c0 con 0x7f4c240fd730 2023-12-16T03:13:39.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.617+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2410ebf0 con 0x7f4c240fd730 2023-12-16T03:13:39.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.617+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2410f130 con 0x7f4c240fd730 2023-12-16T03:13:39.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.618+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c241075c0 con 0x7f4c240fd730 2023-12-16T03:13:39.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.618+0000 7f4c1a7fc700 1 -- 172.21.15.64:0/307043536 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4c2000db20 con 0x7f4c240fd730 2023-12-16T03:13:39.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.619+0000 7f4c1a7fc700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4c10068f60 0x7f4c1006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:39.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.619+0000 7f4c1a7fc700 1 -- 172.21.15.64:0/307043536 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4c20086700 con 0x7f4c240fd730 2023-12-16T03:13:39.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.619+0000 7f4c29097700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4c10068f60 0x7f4c1006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:39.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.619+0000 7f4c29097700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4c10068f60 0x7f4c1006b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400b3b0 tx=0x7f4c14009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:39.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.623+0000 7f4c1a7fc700 1 -- 172.21.15.64:0/307043536 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4c20056940 con 0x7f4c240fd730 2023-12-16T03:13:39.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.820+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f4c2404bb80 con 0x7f4c240fd730 2023-12-16T03:13:39.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.824+0000 7f4c1a7fc700 1 -- 172.21.15.64:0/307043536 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f4c200564d0 con 0x7f4c240fd730 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.826+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4c10068f60 msgr2=0x7f4c1006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.826+0000 7f4c2bafc700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4c10068f60 0x7f4c1006b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400b3b0 tx=0x7f4c14009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.826+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c240fd730 msgr2=0x7f4c2410d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.826+0000 7f4c2bafc700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c240fd730 0x7f4c2410d530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4c20002a50 tx=0x7f4c200046b0 comp rx=0 tx=0).stop 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.826+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 shutdown_connections 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.826+0000 7f4c2bafc700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4c10068f60 0x7f4c1006b410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.826+0000 7f4c2bafc700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c240fd730 0x7f4c2410d530 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.826+0000 7f4c2bafc700 1 --2- 172.21.15.64:0/307043536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c24100050 0x7f4c2410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.826+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 >> 172.21.15.64:0/307043536 conn(0x7f4c240f7190 msgr2=0x7f4c240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.827+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 shutdown_connections 2023-12-16T03:13:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:39.827+0000 7f4c2bafc700 1 -- 172.21.15.64:0/307043536 wait complete. 2023-12-16T03:13:40.220 INFO:teuthology.run_tasks:Running task print... 2023-12-16T03:13:40.230 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-16T03:13:40.230 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T03:13:40.281 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:13:40.281 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph orch status' 2023-12-16T03:13:40.554 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:40.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:40 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/307043536' entity='client.admin' 2023-12-16T03:13:40.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:13:40.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:40.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:13:40.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:40 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:40.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:40 smithi064 ceph-mon[111958]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:41.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:40 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/307043536' entity='client.admin' 2023-12-16T03:13:41.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:40 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:13:41.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:40 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:41.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:40 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:13:41.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:40 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:41.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:40 smithi184 ceph-mon[121180]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:41.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.599+0000 7fb94f301700 1 -- 172.21.15.64:0/872840651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fbb00 msgr2=0x7fb9480fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:41.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.599+0000 7fb94f301700 1 --2- 172.21.15.64:0/872840651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fbb00 0x7fb9480fbf10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb944004940 tx=0x7fb944009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:41.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 -- 172.21.15.64:0/872840651 shutdown_connections 2023-12-16T03:13:41.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 --2- 172.21.15.64:0/872840651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9480fcd10 0x7fb9480fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:41.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 --2- 172.21.15.64:0/872840651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fbb00 0x7fb9480fbf10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:41.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 -- 172.21.15.64:0/872840651 >> 172.21.15.64:0/872840651 conn(0x7fb9480f71c0 msgr2=0x7fb9480f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:41.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 -- 172.21.15.64:0/872840651 shutdown_connections 2023-12-16T03:13:41.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 -- 172.21.15.64:0/872840651 wait complete. 2023-12-16T03:13:41.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 Processor -- start 2023-12-16T03:13:41.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 -- start start 2023-12-16T03:13:41.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9480fbb00 0x7fb94810d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:41.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fcd10 0x7fb94810da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:41.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94810e090 con 0x7fb9480fcd10 2023-12-16T03:13:41.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.600+0000 7fb94f301700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94810e930 con 0x7fb9480fbb00 2023-12-16T03:13:41.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb94c89c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fcd10 0x7fb94810da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:41.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb94c89c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fcd10 0x7fb94810da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37978/0 (socket says 172.21.15.64:37978) 2023-12-16T03:13:41.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb94c89c700 1 -- 172.21.15.64:0/3319474878 learned_addr learned my addr 172.21.15.64:0/3319474878 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:41.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb94d09d700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9480fbb00 0x7fb94810d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:41.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb94c89c700 1 -- 172.21.15.64:0/3319474878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9480fbb00 msgr2=0x7fb94810d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:41.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb94c89c700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9480fbb00 0x7fb94810d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:41.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb94c89c700 1 -- 172.21.15.64:0/3319474878 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb944005040 con 0x7fb9480fcd10 2023-12-16T03:13:41.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb94c89c700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fcd10 0x7fb94810da90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb938002a50 tx=0x7fb9380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:41.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb93dffb700 1 -- 172.21.15.64:0/3319474878 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb938007cc0 con 0x7fb9480fcd10 2023-12-16T03:13:41.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb93dffb700 1 -- 172.21.15.64:0/3319474878 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb93800f040 con 0x7fb9480fcd10 2023-12-16T03:13:41.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94810ec10 con 0x7fb9480fcd10 2023-12-16T03:13:41.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.601+0000 7fb93dffb700 1 -- 172.21.15.64:0/3319474878 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93800d9c0 con 0x7fb9480fcd10 2023-12-16T03:13:41.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.602+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94810f150 con 0x7fb9480fcd10 2023-12-16T03:13:41.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.602+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94804bb80 con 0x7fb9480fcd10 2023-12-16T03:13:41.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.603+0000 7fb93dffb700 1 -- 172.21.15.64:0/3319474878 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb93800db20 con 0x7fb9480fcd10 2023-12-16T03:13:41.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.603+0000 7fb93dffb700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb934068f60 0x7fb93406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:41.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.603+0000 7fb93dffb700 1 -- 172.21.15.64:0/3319474878 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb9380866a0 con 0x7fb9480fcd10 2023-12-16T03:13:41.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.603+0000 7fb94d09d700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb934068f60 0x7fb93406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:41.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.604+0000 7fb94d09d700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb934068f60 0x7fb93406b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb944004890 tx=0x7fb944009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:41.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.608+0000 7fb93dffb700 1 -- 172.21.15.64:0/3319474878 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb938056940 con 0x7fb9480fcd10 2023-12-16T03:13:41.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.819+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb94810f5f0 con 0x7fb934068f60 2023-12-16T03:13:41.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.820+0000 7fb93dffb700 1 -- 172.21.15.64:0/3319474878 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb94810f5f0 con 0x7fb934068f60 2023-12-16T03:13:41.822 INFO:teuthology.orchestra.run.smithi064.stdout:Backend: cephadm 2023-12-16T03:13:41.822 INFO:teuthology.orchestra.run.smithi064.stdout:Available: Yes 2023-12-16T03:13:41.822 INFO:teuthology.orchestra.run.smithi064.stdout:Paused: No 2023-12-16T03:13:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb934068f60 msgr2=0x7fb93406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb934068f60 0x7fb93406b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb944004890 tx=0x7fb944009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fcd10 msgr2=0x7fb94810da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fcd10 0x7fb94810da90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb938002a50 tx=0x7fb9380046b0 comp rx=0 tx=0).stop 2023-12-16T03:13:41.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 shutdown_connections 2023-12-16T03:13:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb934068f60 0x7fb93406b410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9480fbb00 0x7fb94810d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 --2- 172.21.15.64:0/3319474878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9480fcd10 0x7fb94810da90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 >> 172.21.15.64:0/3319474878 conn(0x7fb9480f71c0 msgr2=0x7fb948065be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 shutdown_connections 2023-12-16T03:13:41.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:41.822+0000 7fb94f301700 1 -- 172.21.15.64:0/3319474878 wait complete. 2023-12-16T03:13:42.254 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-16T03:13:42.525 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:43.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.544+0000 7f4277b1a700 1 -- 172.21.15.64:0/2892330729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 msgr2=0x7f42700fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.544+0000 7f4277b1a700 1 --2- 172.21.15.64:0/2892330729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 0x7f42700fe3b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4260004940 tx=0x7f4260009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 -- 172.21.15.64:0/2892330729 shutdown_connections 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 --2- 172.21.15.64:0/2892330729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 0x7f42700fe3b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 --2- 172.21.15.64:0/2892330729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42700faed0 0x7f42700fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 -- 172.21.15.64:0/2892330729 >> 172.21.15.64:0/2892330729 conn(0x7f42700f6950 msgr2=0x7f42700f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 -- 172.21.15.64:0/2892330729 shutdown_connections 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 -- 172.21.15.64:0/2892330729 wait complete. 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 Processor -- start 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 -- start start 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42700faed0 0x7f427010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:43.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 0x7f427010dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:43.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427010e1b0 con 0x7f42700fdf60 2023-12-16T03:13:43.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.545+0000 7f4277b1a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427010ea50 con 0x7f42700faed0 2023-12-16T03:13:43.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42750b5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 0x7f427010dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:43.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42750b5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 0x7f427010dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36984/0 (socket says 172.21.15.64:36984) 2023-12-16T03:13:43.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42750b5700 1 -- 172.21.15.64:0/2820454502 learned_addr learned my addr 172.21.15.64:0/2820454502 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:43.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42758b6700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42700faed0 0x7f427010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:43.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42750b5700 1 -- 172.21.15.64:0/2820454502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42700faed0 msgr2=0x7f427010d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:43.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42750b5700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42700faed0 0x7f427010d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:43.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42750b5700 1 -- 172.21.15.64:0/2820454502 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260005040 con 0x7f42700fdf60 2023-12-16T03:13:43.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42750b5700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 0x7f427010dbb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f426000b3b0 tx=0x7f4260009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:43.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42667fc700 1 -- 172.21.15.64:0/2820454502 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f426000e040 con 0x7f42700fdf60 2023-12-16T03:13:43.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42667fc700 1 -- 172.21.15.64:0/2820454502 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f426000bc50 con 0x7f42700fdf60 2023-12-16T03:13:43.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f42667fc700 1 -- 172.21.15.64:0/2820454502 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4260013660 con 0x7f42700fdf60 2023-12-16T03:13:43.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427010ecd0 con 0x7f42700fdf60 2023-12-16T03:13:43.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.546+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427010f1c0 con 0x7f42700fdf60 2023-12-16T03:13:43.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.547+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42701075f0 con 0x7f42700fdf60 2023-12-16T03:13:43.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.548+0000 7f42667fc700 1 -- 172.21.15.64:0/2820454502 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f42600138d0 con 0x7f42700fdf60 2023-12-16T03:13:43.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.548+0000 7f42667fc700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f425c068f60 0x7f425c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:43.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.548+0000 7f42667fc700 1 -- 172.21.15.64:0/2820454502 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4260087840 con 0x7f42700fdf60 2023-12-16T03:13:43.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.548+0000 7f42758b6700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f425c068f60 0x7f425c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:43.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.549+0000 7f42758b6700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f425c068f60 0x7f425c06b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f426c007fd0 tx=0x7f426c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:43.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.553+0000 7f42667fc700 1 -- 172.21.15.64:0/2820454502 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4260057b90 con 0x7f42700fdf60 2023-12-16T03:13:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:43 smithi064 ceph-mon[111958]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:43 smithi064 ceph-mon[111958]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:43.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.763+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f427010f430 con 0x7f425c068f60 2023-12-16T03:13:43.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.771+0000 7f42667fc700 1 -- 172.21.15.64:0/2820454502 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7f427010f430 con 0x7f425c068f60 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (2m) 98s ago 3m 29.3M - 0.25.0 c8568f914cd2 14aee4a706e2 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (3m) 98s ago 3m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (3m) 45s ago 3m 7478k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (2m) 98s ago 3m 81.3M - 9.4.7 954c08fa6188 697184eb15a8 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:9283 running (4m) 98s ago 4m 485M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f40249c90cfb 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283 running (2m) 45s ago 2m 439M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9516ab376976 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (4m) 98s ago 4m 56.6M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (2m) 45s ago 2m 53.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (3m) 98s ago 3m 16.4M - 1.5.0 0da6a335fe13 c8706c3a2b59 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (3m) 45s ago 3m 17.8M - 1.5.0 0da6a335fe13 67ad2f701450 2023-12-16T03:13:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (2m) 98s ago 2m 42.6M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:13:43.775 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (2m) 98s ago 2m 39.6M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:13:43.775 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (103s) 98s ago 102s 14.3M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:13:43.775 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (84s) 45s ago 84s 46.6M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:13:43.775 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (66s) 45s ago 66s 41.2M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:13:43.775 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (48s) 45s ago 47s 12.0M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:13:43.775 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (2m) 98s ago 3m 36.5M - 2.43.0 a07b618ecd1d 91a18452d564 2023-12-16T03:13:43.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f425c068f60 msgr2=0x7f425c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f425c068f60 0x7f425c06b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f426c007fd0 tx=0x7f426c009040 comp rx=0 tx=0).stop 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 msgr2=0x7f427010dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 0x7f427010dbb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f426000b3b0 tx=0x7f4260009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 shutdown_connections 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f425c068f60 0x7f425c06b410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42700faed0 0x7f427010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 --2- 172.21.15.64:0/2820454502 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42700fdf60 0x7f427010dbb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 >> 172.21.15.64:0/2820454502 conn(0x7f42700f6950 msgr2=0x7f42700f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 shutdown_connections 2023-12-16T03:13:43.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:43.773+0000 7f4277b1a700 1 -- 172.21.15.64:0/2820454502 wait complete. 2023-12-16T03:13:43.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:43 smithi184 ceph-mon[121180]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:43.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:43 smithi184 ceph-mon[121180]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:44.153 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-16T03:13:44.424 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 -- 172.21.15.64:0/3224779932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 msgr2=0x7fb0b40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 --2- 172.21.15.64:0/3224779932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 0x7fb0b40fe250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4004940 tx=0x7fb0a4009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 -- 172.21.15.64:0/3224779932 shutdown_connections 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 --2- 172.21.15.64:0/3224779932 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 0x7fb0b40fe250 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 --2- 172.21.15.64:0/3224779932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b40fcbf0 0x7fb0b40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 -- 172.21.15.64:0/3224779932 >> 172.21.15.64:0/3224779932 conn(0x7fb0b40f82d0 msgr2=0x7fb0b40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 -- 172.21.15.64:0/3224779932 shutdown_connections 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 -- 172.21.15.64:0/3224779932 wait complete. 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 Processor -- start 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 -- start start 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b40fcbf0 0x7fb0b4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:45.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 0x7fb0b406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4070590 con 0x7fb0b40fde00 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.508+0000 7fb0b8925700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4070700 con 0x7fb0b40fcbf0 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b1d9b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 0x7fb0b406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b1d9b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 0x7fb0b406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37006/0 (socket says 172.21.15.64:37006) 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b1d9b700 1 -- 172.21.15.64:0/414158354 learned_addr learned my addr 172.21.15.64:0/414158354 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b259c700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b40fcbf0 0x7fb0b4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b1d9b700 1 -- 172.21.15.64:0/414158354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b40fcbf0 msgr2=0x7fb0b4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b1d9b700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b40fcbf0 0x7fb0b4071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b1d9b700 1 -- 172.21.15.64:0/414158354 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4005040 con 0x7fb0b40fde00 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b1d9b700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 0x7fb0b406ff90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009380 tx=0x7fb0a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0a2ffd700 1 -- 172.21.15.64:0/414158354 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a400e040 con 0x7fb0b40fde00 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0a2ffd700 1 -- 172.21.15.64:0/414158354 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0a400bda0 con 0x7fb0b40fde00 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b4070980 con 0x7fb0b40fde00 2023-12-16T03:13:45.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0a2ffd700 1 -- 172.21.15.64:0/414158354 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a401c630 con 0x7fb0b40fde00 2023-12-16T03:13:45.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.509+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b41155b0 con 0x7fb0b40fde00 2023-12-16T03:13:45.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.510+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b404bb80 con 0x7fb0b40fde00 2023-12-16T03:13:45.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.511+0000 7fb0a2ffd700 1 -- 172.21.15.64:0/414158354 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb0a40139d0 con 0x7fb0b40fde00 2023-12-16T03:13:45.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.511+0000 7fb0a2ffd700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb09c068f60 0x7fb09c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:45.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.511+0000 7fb0a2ffd700 1 -- 172.21.15.64:0/414158354 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb0a4087df0 con 0x7fb0b40fde00 2023-12-16T03:13:45.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.511+0000 7fb0b259c700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb09c068f60 0x7fb09c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:45.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.512+0000 7fb0b259c700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb09c068f60 0x7fb09c06b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8007fd0 tx=0x7fb0a8009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:45.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.516+0000 7fb0a2ffd700 1 -- 172.21.15.64:0/414158354 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb0a4058130 con 0x7fb0b40fde00 2023-12-16T03:13:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:45 smithi064 ceph-mon[111958]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:45 smithi064 ceph-mon[111958]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:45.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.721+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0b4102770 con 0x7fb09c068f60 2023-12-16T03:13:45.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.725+0000 7fb0a2ffd700 1 -- 172.21.15.64:0/414158354 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7fb0b4102770 con 0x7fb09c068f60 2023-12-16T03:13:45.728 INFO:teuthology.orchestra.run.smithi064.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-16T03:13:45.728 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager ?:9093,9094 1/1 100s ago 4m count:1 2023-12-16T03:13:45.728 INFO:teuthology.orchestra.run.smithi064.stdout:crash 2/2 100s ago 4m * 2023-12-16T03:13:45.728 INFO:teuthology.orchestra.run.smithi064.stdout:grafana ?:3000 1/1 100s ago 4m count:1 2023-12-16T03:13:45.729 INFO:teuthology.orchestra.run.smithi064.stdout:mgr 2/2 100s ago 4m count:2 2023-12-16T03:13:45.729 INFO:teuthology.orchestra.run.smithi064.stdout:mon 2/2 100s ago 3m smithi064:172.21.15.64=smithi064;smithi184:172.21.15.184=smithi184;count:2 2023-12-16T03:13:45.729 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter ?:9100 2/2 100s ago 4m * 2023-12-16T03:13:45.729 INFO:teuthology.orchestra.run.smithi064.stdout:osd 6 100s ago - 2023-12-16T03:13:45.729 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus ?:9095 1/1 100s ago 4m count:1 2023-12-16T03:13:45.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.727+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb09c068f60 msgr2=0x7fb09c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:45.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.727+0000 7fb0b8925700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb09c068f60 0x7fb09c06b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8007fd0 tx=0x7fb0a8009040 comp rx=0 tx=0).stop 2023-12-16T03:13:45.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.727+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 msgr2=0x7fb0b406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:45.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.727+0000 7fb0b8925700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 0x7fb0b406ff90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009380 tx=0x7fb0a4009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:45.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.728+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 shutdown_connections 2023-12-16T03:13:45.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.728+0000 7fb0b8925700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb09c068f60 0x7fb09c06b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:45.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.728+0000 7fb0b8925700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b40fcbf0 0x7fb0b4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:45.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.728+0000 7fb0b8925700 1 --2- 172.21.15.64:0/414158354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0b40fde00 0x7fb0b406ff90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:45.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.728+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 >> 172.21.15.64:0/414158354 conn(0x7fb0b40f82d0 msgr2=0x7fb0b4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:45.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.728+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 shutdown_connections 2023-12-16T03:13:45.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:45.728+0000 7fb0b8925700 1 -- 172.21.15.64:0/414158354 wait complete. 2023-12-16T03:13:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:45 smithi184 ceph-mon[121180]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:45 smithi184 ceph-mon[121180]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:46.112 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-16T03:13:46.382 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:47.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.467+0000 7f57208a8700 1 -- 172.21.15.64:0/3205156675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c071b40 msgr2=0x7f571c06ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:47.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.467+0000 7f57208a8700 1 --2- 172.21.15.64:0/3205156675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c071b40 0x7f571c06ffb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f570c004940 tx=0x7f570c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:47.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.467+0000 7f57208a8700 1 -- 172.21.15.64:0/3205156675 shutdown_connections 2023-12-16T03:13:47.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.467+0000 7f57208a8700 1 --2- 172.21.15.64:0/3205156675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f571c0704f0 0x7f571c070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:47.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.467+0000 7f57208a8700 1 --2- 172.21.15.64:0/3205156675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c071b40 0x7f571c06ffb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:47.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.467+0000 7f57208a8700 1 -- 172.21.15.64:0/3205156675 >> 172.21.15.64:0/3205156675 conn(0x7f571c0f82d0 msgr2=0x7f571c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:47.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.467+0000 7f57208a8700 1 -- 172.21.15.64:0/3205156675 shutdown_connections 2023-12-16T03:13:47.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.467+0000 7f57208a8700 1 -- 172.21.15.64:0/3205156675 wait complete. 2023-12-16T03:13:47.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.468+0000 7f57208a8700 1 Processor -- start 2023-12-16T03:13:47.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.468+0000 7f57208a8700 1 -- start start 2023-12-16T03:13:47.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.468+0000 7f57208a8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c0704f0 0x7f571c10f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:47.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.468+0000 7f57208a8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f571c071b40 0x7f571c10fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:47.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.468+0000 7f57208a8700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c110300 con 0x7f571c0704f0 2023-12-16T03:13:47.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.468+0000 7f57208a8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c110b40 con 0x7f571c071b40 2023-12-16T03:13:47.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.468+0000 7f571a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c0704f0 0x7f571c10f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:47.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.468+0000 7f571a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c0704f0 0x7f571c10f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37036/0 (socket says 172.21.15.64:37036) 2023-12-16T03:13:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.468+0000 7f571a59c700 1 -- 172.21.15.64:0/164314963 learned_addr learned my addr 172.21.15.64:0/164314963 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f5719d9b700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f571c071b40 0x7f571c10fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f571a59c700 1 -- 172.21.15.64:0/164314963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f571c071b40 msgr2=0x7f571c10fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f571a59c700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f571c071b40 0x7f571c10fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f571a59c700 1 -- 172.21.15.64:0/164314963 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c005040 con 0x7f571c0704f0 2023-12-16T03:13:47.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f5719d9b700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f571c071b40 0x7f571c10fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:13:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f571a59c700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c0704f0 0x7f571c10f730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f570c009380 tx=0x7f570c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f5712ffd700 1 -- 172.21.15.64:0/164314963 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570c00e040 con 0x7f571c0704f0 2023-12-16T03:13:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f5712ffd700 1 -- 172.21.15.64:0/164314963 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f570c00bda0 con 0x7f571c0704f0 2023-12-16T03:13:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c110dc0 con 0x7f571c0704f0 2023-12-16T03:13:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f5712ffd700 1 -- 172.21.15.64:0/164314963 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570c01c630 con 0x7f571c0704f0 2023-12-16T03:13:47.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.469+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c111300 con 0x7f571c0704f0 2023-12-16T03:13:47.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.470+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c04bb80 con 0x7f571c0704f0 2023-12-16T03:13:47.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.471+0000 7f5712ffd700 1 -- 172.21.15.64:0/164314963 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f570c0139d0 con 0x7f571c0704f0 2023-12-16T03:13:47.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.471+0000 7f5712ffd700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5708068f60 0x7f570806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:47.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.471+0000 7f5712ffd700 1 -- 172.21.15.64:0/164314963 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f570c087df0 con 0x7f571c0704f0 2023-12-16T03:13:47.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.471+0000 7f5719d9b700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5708068f60 0x7f570806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:47.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.471+0000 7f5719d9b700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5708068f60 0x7f570806b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5704006fd0 tx=0x7f5704008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:47.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.476+0000 7f5712ffd700 1 -- 172.21.15.64:0/164314963 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f570c058130 con 0x7f571c0704f0 2023-12-16T03:13:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:47 smithi184 ceph-mon[121180]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:47 smithi184 ceph-mon[121180]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:47.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.676+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f571c104220 con 0x7f5708068f60 2023-12-16T03:13:47.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.677+0000 7f5712ffd700 1 -- 172.21.15.64:0/164314963 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f571c104220 con 0x7f5708068f60 2023-12-16T03:13:47.679 INFO:teuthology.orchestra.run.smithi064.stdout:HOST ADDR LABELS STATUS 2023-12-16T03:13:47.679 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064 172.21.15.64 2023-12-16T03:13:47.679 INFO:teuthology.orchestra.run.smithi064.stdout:smithi184 172.21.15.184 2023-12-16T03:13:47.679 INFO:teuthology.orchestra.run.smithi064.stdout:2 hosts in cluster 2023-12-16T03:13:47.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5708068f60 msgr2=0x7f570806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5708068f60 0x7f570806b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5704006fd0 tx=0x7f5704008040 comp rx=0 tx=0).stop 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c0704f0 msgr2=0x7f571c10f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c0704f0 0x7f571c10f730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f570c009380 tx=0x7f570c009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 shutdown_connections 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5708068f60 0x7f570806b410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f571c0704f0 0x7f571c10f730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 --2- 172.21.15.64:0/164314963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f571c071b40 0x7f571c10fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 >> 172.21.15.64:0/164314963 conn(0x7f571c0f82d0 msgr2=0x7f571c102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 shutdown_connections 2023-12-16T03:13:47.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:47.679+0000 7f57208a8700 1 -- 172.21.15.64:0/164314963 wait complete. 2023-12-16T03:13:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:47 smithi064 ceph-mon[111958]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:47 smithi064 ceph-mon[111958]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:48.130 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-16T03:13:48.398 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:48.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:13:48.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:13:49.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:49 smithi184 ceph-mon[121180]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:49.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:49 smithi184 ceph-mon[121180]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:49.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.592+0000 7f762937a700 1 -- 172.21.15.64:0/2404350726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 msgr2=0x7f76240fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:49.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.592+0000 7f762937a700 1 --2- 172.21.15.64:0/2404350726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 0x7f76240fb2e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7614004940 tx=0x7f7614009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:49.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.592+0000 7f762937a700 1 -- 172.21.15.64:0/2404350726 shutdown_connections 2023-12-16T03:13:49.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.592+0000 7f762937a700 1 --2- 172.21.15.64:0/2404350726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76240fdf60 0x7f76240fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:49.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.592+0000 7f762937a700 1 --2- 172.21.15.64:0/2404350726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 0x7f76240fb2e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:49.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.592+0000 7f762937a700 1 -- 172.21.15.64:0/2404350726 >> 172.21.15.64:0/2404350726 conn(0x7f76240f6950 msgr2=0x7f76240f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:49.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.592+0000 7f762937a700 1 -- 172.21.15.64:0/2404350726 shutdown_connections 2023-12-16T03:13:49.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.592+0000 7f762937a700 1 -- 172.21.15.64:0/2404350726 wait complete. 2023-12-16T03:13:49.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.593+0000 7f762937a700 1 Processor -- start 2023-12-16T03:13:49.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.593+0000 7f762937a700 1 -- start start 2023-12-16T03:13:49.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.593+0000 7f762937a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 0x7f76240fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:49.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.593+0000 7f762937a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76240fdf60 0x7f76240fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:49.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.593+0000 7f762937a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76240fc500 con 0x7f76240faed0 2023-12-16T03:13:49.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.593+0000 7f762937a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76240fc670 con 0x7f76240fdf60 2023-12-16T03:13:49.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.593+0000 7f7622ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 0x7f76240fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.593+0000 7f7622ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 0x7f76240fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37064/0 (socket says 172.21.15.64:37064) 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.593+0000 7f7622ffd700 1 -- 172.21.15.64:0/1502926736 learned_addr learned my addr 172.21.15.64:0/1502926736 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f76227fc700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76240fdf60 0x7f76240fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f7622ffd700 1 -- 172.21.15.64:0/1502926736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76240fdf60 msgr2=0x7f76240fbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f7622ffd700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76240fdf60 0x7f76240fbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f7622ffd700 1 -- 172.21.15.64:0/1502926736 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614005040 con 0x7f76240faed0 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f7622ffd700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 0x7f76240fd9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7614009fd0 tx=0x7f7614009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f760b7fe700 1 -- 172.21.15.64:0/1502926736 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761400e040 con 0x7f76240faed0 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f760b7fe700 1 -- 172.21.15.64:0/1502926736 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f761400bc50 con 0x7f76240faed0 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76240fc8f0 con 0x7f76240faed0 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f760b7fe700 1 -- 172.21.15.64:0/1502926736 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761401c630 con 0x7f76240faed0 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.594+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7624115640 con 0x7f76240faed0 2023-12-16T03:13:49.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.595+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762404bb80 con 0x7f76240faed0 2023-12-16T03:13:49.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.596+0000 7f760b7fe700 1 -- 172.21.15.64:0/1502926736 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7614013420 con 0x7f76240faed0 2023-12-16T03:13:49.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.596+0000 7f760b7fe700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f760c068f60 0x7f760c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:49.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.596+0000 7f760b7fe700 1 -- 172.21.15.64:0/1502926736 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7614087d20 con 0x7f76240faed0 2023-12-16T03:13:49.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.596+0000 7f76227fc700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f760c068f60 0x7f760c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:49.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.597+0000 7f76227fc700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f760c068f60 0x7f760c06b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7618006fd0 tx=0x7f7618008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:49.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.601+0000 7f760b7fe700 1 -- 172.21.15.64:0/1502926736 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7614058060 con 0x7f76240faed0 2023-12-16T03:13:49.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:49 smithi064 ceph-mon[111958]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:49.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:49 smithi064 ceph-mon[111958]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:49.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.804+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f76241028b0 con 0x7f760c068f60 2023-12-16T03:13:49.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.805+0000 7f760b7fe700 1 -- 172.21.15.64:0/1502926736 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f76241028b0 con 0x7f760c068f60 2023-12-16T03:13:49.807 INFO:teuthology.orchestra.run.smithi064.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-16T03:13:49.807 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT534400C2400BGN 372G No 101s ago Has a FileSystem, LVM detected 2023-12-16T03:13:49.807 INFO:teuthology.orchestra.run.smithi064.stdout:smithi184 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT626500CE400BGN 372G No 48s ago Has a FileSystem, LVM detected 2023-12-16T03:13:49.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f760c068f60 msgr2=0x7f760c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:49.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f760c068f60 0x7f760c06b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7618006fd0 tx=0x7f7618008040 comp rx=0 tx=0).stop 2023-12-16T03:13:49.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 msgr2=0x7f76240fd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:49.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 0x7f76240fd9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7614009fd0 tx=0x7f7614009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:49.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 shutdown_connections 2023-12-16T03:13:49.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f760c068f60 0x7f760c06b410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:49.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76240faed0 0x7f76240fd9f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:49.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 --2- 172.21.15.64:0/1502926736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76240fdf60 0x7f76240fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:49.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 >> 172.21.15.64:0/1502926736 conn(0x7f76240f6950 msgr2=0x7f7624101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:49.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 shutdown_connections 2023-12-16T03:13:49.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:49.808+0000 7f762937a700 1 -- 172.21.15.64:0/1502926736 wait complete. 2023-12-16T03:13:50.237 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T03:13:50.247 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:13:50.247 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-16T03:13:50.518 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:51.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 -- 172.21.15.64:0/489772639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fde00 msgr2=0x7f6cd00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 --2- 172.21.15.64:0/489772639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fde00 0x7f6cd00fe250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8004940 tx=0x7f6cb8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 -- 172.21.15.64:0/489772639 shutdown_connections 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 --2- 172.21.15.64:0/489772639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fde00 0x7f6cd00fe250 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 --2- 172.21.15.64:0/489772639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd00fcbf0 0x7f6cd00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 -- 172.21.15.64:0/489772639 >> 172.21.15.64:0/489772639 conn(0x7f6cd00f82d0 msgr2=0x7f6cd00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 -- 172.21.15.64:0/489772639 shutdown_connections 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 -- 172.21.15.64:0/489772639 wait complete. 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 Processor -- start 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 -- start start 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fcbf0 0x7f6cd0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.648+0000 7f6cd62a0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd00fde00 0x7f6cd006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6cd62a0700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0070590 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6cd62a0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0070700 con 0x7f6cd00fde00 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6ccffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fcbf0 0x7f6cd0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6ccffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fcbf0 0x7f6cd0071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37080/0 (socket says 172.21.15.64:37080) 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6ccffff700 1 -- 172.21.15.64:0/344187443 learned_addr learned my addr 172.21.15.64:0/344187443 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6ccf7fe700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd00fde00 0x7f6cd006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6ccffff700 1 -- 172.21.15.64:0/344187443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd00fde00 msgr2=0x7f6cd006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6ccffff700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd00fde00 0x7f6cd006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6ccffff700 1 -- 172.21.15.64:0/344187443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb8005040 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6ccffff700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fcbf0 0x7f6cd0071b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0002a80 tx=0x7f6cc0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6cccff9700 1 -- 172.21.15.64:0/344187443 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cc0007cc0 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd00709e0 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6cccff9700 1 -- 172.21.15.64:0/344187443 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6cc000f040 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6cccff9700 1 -- 172.21.15.64:0/344187443 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cc000da20 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.649+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd01155b0 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.650+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd004bb80 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.651+0000 7f6cccff9700 1 -- 172.21.15.64:0/344187443 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6cc000db80 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.651+0000 7f6cccff9700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6cbc068f70 0x7f6cbc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.651+0000 7f6cccff9700 1 -- 172.21.15.64:0/344187443 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6cc0086840 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.651+0000 7f6ccf7fe700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6cbc068f70 0x7f6cbc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.652+0000 7f6ccf7fe700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6cbc068f70 0x7f6cbc06b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8004f90 tx=0x7f6cb8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:51.656 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.656+0000 7f6cccff9700 1 -- 172.21.15.64:0/344187443 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6cc0056a60 con 0x7f6cd00fcbf0 2023-12-16T03:13:51.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:51 smithi064 ceph-mon[111958]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:51.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:51 smithi064 ceph-mon[111958]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:51.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:51 smithi184 ceph-mon[121180]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:51.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:51 smithi184 ceph-mon[121180]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:51.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:51.882+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cd0102770 con 0x7f6cbc068f70 2023-12-16T03:13:52.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:52 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-16T03:13:52.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:52 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-16T03:13:53.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.469+0000 7f6cccff9700 1 -- 172.21.15.64:0/344187443 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6cd0102770 con 0x7f6cbc068f70 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6cbc068f70 msgr2=0x7f6cbc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6cbc068f70 0x7f6cbc06b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8004f90 tx=0x7f6cb8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fcbf0 msgr2=0x7f6cd0071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fcbf0 0x7f6cd0071b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0002a80 tx=0x7f6cc0004600 comp rx=0 tx=0).stop 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 shutdown_connections 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6cbc068f70 0x7f6cbc06b420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cd00fcbf0 0x7f6cd0071b10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 --2- 172.21.15.64:0/344187443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd00fde00 0x7f6cd006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 >> 172.21.15.64:0/344187443 conn(0x7f6cd00f82d0 msgr2=0x7f6cd0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:53.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 shutdown_connections 2023-12-16T03:13:53.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:53.472+0000 7f6cd62a0700 1 -- 172.21.15.64:0/344187443 wait complete. 2023-12-16T03:13:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:53 smithi064 ceph-mon[111958]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:53 smithi064 ceph-mon[111958]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-16T03:13:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:53 smithi064 ceph-mon[111958]: osdmap e39: 6 total, 6 up, 6 in 2023-12-16T03:13:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:53 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-16T03:13:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:53 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064[111935]: 2023-12-16T03:13:53.443+0000 7f55e4047700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:13:53.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:53 smithi184 ceph-mon[121180]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:13:53.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:53 smithi184 ceph-mon[121180]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:53.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-16T03:13:53.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:53 smithi184 ceph-mon[121180]: osdmap e39: 6 total, 6 up, 6 in 2023-12-16T03:13:53.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:53 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-16T03:13:53.924 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-16T03:13:54.209 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-16T03:13:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: osdmap e40: 6 total, 6 up, 6 in 2023-12-16T03:13:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-16T03:13:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:13:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T03:13:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: osdmap e41: 6 total, 6 up, 6 in 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: fsmap cephfs:0 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: Saving service mds.cephfs spec with placement count:4 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.jaepzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.jaepzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T03:13:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:54 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:54.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-16T03:13:54.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: osdmap e40: 6 total, 6 up, 6 in 2023-12-16T03:13:54.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-16T03:13:54.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:13:54.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: osdmap e41: 6 total, 6 up, 6 in 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: fsmap cephfs:0 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: Saving service mds.cephfs spec with placement count:4 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.jaepzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.jaepzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T03:13:54.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:54 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:55.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:55 smithi064 ceph-mon[111958]: Deploying daemon mds.cephfs.smithi064.jaepzs on smithi064 2023-12-16T03:13:55.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:55 smithi064 ceph-mon[111958]: pgmap v130: 65 pgs: 10 creating+peering, 7 active+clean, 48 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:55.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:55 smithi064 ceph-mon[111958]: osdmap e42: 6 total, 6 up, 6 in 2023-12-16T03:13:55.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:55 smithi184 ceph-mon[121180]: Deploying daemon mds.cephfs.smithi064.jaepzs on smithi064 2023-12-16T03:13:55.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:55 smithi184 ceph-mon[121180]: pgmap v130: 65 pgs: 10 creating+peering, 7 active+clean, 48 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:55.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:55 smithi184 ceph-mon[121180]: osdmap e42: 6 total, 6 up, 6 in 2023-12-16T03:13:56.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.117+0000 7f57f9f98700 1 -- 172.21.15.64:0/3258232492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f41020e0 msgr2=0x7f57f41044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:56.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.117+0000 7f57f9f98700 1 --2- 172.21.15.64:0/3258232492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f41020e0 0x7f57f41044c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f57e8004940 tx=0x7f57e8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:56.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.117+0000 7f57f9f98700 1 -- 172.21.15.64:0/3258232492 shutdown_connections 2023-12-16T03:13:56.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.117+0000 7f57f9f98700 1 --2- 172.21.15.64:0/3258232492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f41020e0 0x7f57f41044c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.117+0000 7f57f9f98700 1 --2- 172.21.15.64:0/3258232492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f4066090 0x7f57f4101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.117+0000 7f57f9f98700 1 -- 172.21.15.64:0/3258232492 >> 172.21.15.64:0/3258232492 conn(0x7f57f40f7190 msgr2=0x7f57f40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.118+0000 7f57f9f98700 1 -- 172.21.15.64:0/3258232492 shutdown_connections 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.118+0000 7f57f9f98700 1 -- 172.21.15.64:0/3258232492 wait complete. 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.118+0000 7f57f9f98700 1 Processor -- start 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.118+0000 7f57f9f98700 1 -- start start 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f9f98700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f4066090 0x7f57f410f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f9f98700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f41020e0 0x7f57f410fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f9f98700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f41102e0 con 0x7f57f4066090 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f9f98700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4110b80 con 0x7f57f41020e0 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f37fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f4066090 0x7f57f410f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f37fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f4066090 0x7f57f410f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56598/0 (socket says 172.21.15.64:56598) 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f37fe700 1 -- 172.21.15.64:0/3371347879 learned_addr learned my addr 172.21.15.64:0/3371347879 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:56.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f2ffd700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f41020e0 0x7f57f410fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f37fe700 1 -- 172.21.15.64:0/3371347879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f41020e0 msgr2=0x7f57f410fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f37fe700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f41020e0 0x7f57f410fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f37fe700 1 -- 172.21.15.64:0/3371347879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8005040 con 0x7f57f4066090 2023-12-16T03:13:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.119+0000 7f57f37fe700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f4066090 0x7f57f410f7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57e4002a50 tx=0x7f57e40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.120+0000 7f57dbfff700 1 -- 172.21.15.64:0/3371347879 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57e4007cc0 con 0x7f57f4066090 2023-12-16T03:13:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.120+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f4110e60 con 0x7f57f4066090 2023-12-16T03:13:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.120+0000 7f57dbfff700 1 -- 172.21.15.64:0/3371347879 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f57e400f040 con 0x7f57f4066090 2023-12-16T03:13:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.120+0000 7f57dbfff700 1 -- 172.21.15.64:0/3371347879 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57e400d9c0 con 0x7f57f4066090 2023-12-16T03:13:56.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.120+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f41113a0 con 0x7f57f4066090 2023-12-16T03:13:56.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.121+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f41097e0 con 0x7f57f4066090 2023-12-16T03:13:56.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.121+0000 7f57dbfff700 1 -- 172.21.15.64:0/3371347879 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f57e400db60 con 0x7f57f4066090 2023-12-16T03:13:56.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.122+0000 7f57dbfff700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f57dc068f60 0x7f57dc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:56.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.122+0000 7f57dbfff700 1 -- 172.21.15.64:0/3371347879 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f57e4086420 con 0x7f57f4066090 2023-12-16T03:13:56.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.122+0000 7f57f2ffd700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f57dc068f60 0x7f57dc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:56.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.122+0000 7f57f2ffd700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f57dc068f60 0x7f57dc06b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57e8004890 tx=0x7f57e8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:56.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.127+0000 7f57dbfff700 1 -- 172.21.15.64:0/3371347879 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f57e404ca00 con 0x7f57f4066090 2023-12-16T03:13:56.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.370+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f57f4111660 con 0x7f57f4066090 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.370+0000 7f57dbfff700 1 -- 172.21.15.64:0/3371347879 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f57e4056300 con 0x7f57f4066090 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:e2 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:legacy client fscid: 1 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:Filesystem 'cephfs' (1) 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:fs_name cephfs 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 2 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:13:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:modified 2023-12-16T03:13:53.443617+0000 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:tableserver 0 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:root 0 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:session_timeout 60 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:session_autoclose 300 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:max_file_size 1099511627776 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:required_client_features {} 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure 0 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure_osd_epoch 0 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:max_mds 1 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:in 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:up {} 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:failed 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:damaged 2023-12-16T03:13:56.373 INFO:teuthology.orchestra.run.smithi064.stdout:stopped 2023-12-16T03:13:56.374 INFO:teuthology.orchestra.run.smithi064.stdout:data_pools [3] 2023-12-16T03:13:56.374 INFO:teuthology.orchestra.run.smithi064.stdout:metadata_pool 2 2023-12-16T03:13:56.374 INFO:teuthology.orchestra.run.smithi064.stdout:inline_data disabled 2023-12-16T03:13:56.374 INFO:teuthology.orchestra.run.smithi064.stdout:balancer 2023-12-16T03:13:56.374 INFO:teuthology.orchestra.run.smithi064.stdout:standby_count_wanted 0 2023-12-16T03:13:56.374 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:56.374 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.372+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f57dc068f60 msgr2=0x7f57dc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.372+0000 7f57f9f98700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f57dc068f60 0x7f57dc06b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57e8004890 tx=0x7f57e8009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.372+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f4066090 msgr2=0x7f57f410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.372+0000 7f57f9f98700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f4066090 0x7f57f410f7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57e4002a50 tx=0x7f57e40046b0 comp rx=0 tx=0).stop 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.372+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 shutdown_connections 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.372+0000 7f57f9f98700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f57dc068f60 0x7f57dc06b410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.372+0000 7f57f9f98700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f4066090 0x7f57f410f7a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.372+0000 7f57f9f98700 1 --2- 172.21.15.64:0/3371347879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f41020e0 0x7f57f410fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.372+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 >> 172.21.15.64:0/3371347879 conn(0x7f57f40f7190 msgr2=0x7f57f40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.373+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 shutdown_connections 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:56.373+0000 7f57f9f98700 1 -- 172.21.15.64:0/3371347879 wait complete. 2023-12-16T03:13:56.375 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 2 2023-12-16T03:13:56.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:56 smithi064 ceph-mon[111958]: osdmap e43: 6 total, 6 up, 6 in 2023-12-16T03:13:56.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:56 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3371347879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:13:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:56 smithi184 ceph-mon[121180]: osdmap e43: 6 total, 6 up, 6 in 2023-12-16T03:13:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:56 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3371347879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:13:56.879 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T03:13:56.889 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:13:56.889 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2023-12-16T03:13:57.161 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:13:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:57 smithi064 ceph-mon[111958]: pgmap v133: 65 pgs: 10 creating+peering, 22 active+clean, 33 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.jfpiqk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:13:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.jfpiqk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T03:13:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:57.775 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:57 smithi184 ceph-mon[121180]: pgmap v133: 65 pgs: 10 creating+peering, 22 active+clean, 33 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:57.775 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:57.775 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:57.775 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:57.775 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.jfpiqk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:13:57.775 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.jfpiqk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T03:13:57.775 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 -- 172.21.15.64:0/2176283046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fcd00 msgr2=0x7f65d80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 --2- 172.21.15.64:0/2176283046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fcd00 0x7f65d80fd150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f65cc004940 tx=0x7f65cc009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 -- 172.21.15.64:0/2176283046 shutdown_connections 2023-12-16T03:13:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 --2- 172.21.15.64:0/2176283046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fcd00 0x7f65d80fd150 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 --2- 172.21.15.64:0/2176283046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d80fbaf0 0x7f65d80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 -- 172.21.15.64:0/2176283046 >> 172.21.15.64:0/2176283046 conn(0x7f65d80f71b0 msgr2=0x7f65d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:58.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 -- 172.21.15.64:0/2176283046 shutdown_connections 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 -- 172.21.15.64:0/2176283046 wait complete. 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 Processor -- start 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.318+0000 7f65de029700 1 -- start start 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65de029700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fbaf0 0x7f65d8110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65de029700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d80fcd00 0x7f65d8112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65de029700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80669a0 con 0x7f65d80fbaf0 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65de029700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d8066ae0 con 0x7f65d80fcd00 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65d77fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fbaf0 0x7f65d8110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65d77fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fbaf0 0x7f65d8110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56608/0 (socket says 172.21.15.64:56608) 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65d77fe700 1 -- 172.21.15.64:0/1249714811 learned_addr learned my addr 172.21.15.64:0/1249714811 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65d6ffd700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d80fcd00 0x7f65d8112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65d77fe700 1 -- 172.21.15.64:0/1249714811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d80fcd00 msgr2=0x7f65d8112760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65d77fe700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d80fcd00 0x7f65d8112760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:58.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65d77fe700 1 -- 172.21.15.64:0/1249714811 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc005040 con 0x7f65d80fbaf0 2023-12-16T03:13:58.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65d77fe700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fbaf0 0x7f65d8110210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f65c8002a80 tx=0x7f65c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:58.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65bffff700 1 -- 172.21.15.64:0/1249714811 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65c8007cc0 con 0x7f65d80fbaf0 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65bffff700 1 -- 172.21.15.64:0/1249714811 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65c800f040 con 0x7f65d80fbaf0 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d810c050 con 0x7f65d80fbaf0 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65bffff700 1 -- 172.21.15.64:0/1249714811 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65c800d9c0 con 0x7f65d80fbaf0 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.319+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d810c590 con 0x7f65d80fbaf0 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.321+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d804bb80 con 0x7f65d80fbaf0 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.321+0000 7f65bffff700 1 -- 172.21.15.64:0/1249714811 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f65c800db40 con 0x7f65d80fbaf0 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.321+0000 7f65bffff700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f65c0068f60 0x7f65c006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.322+0000 7f65bffff700 1 -- 172.21.15.64:0/1249714811 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f65c8086ae0 con 0x7f65d80fbaf0 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.322+0000 7f65d6ffd700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f65c0068f60 0x7f65c006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:13:58.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.322+0000 7f65d6ffd700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f65c0068f60 0x7f65c006b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00b3b0 tx=0x7f65cc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:13:58.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.330+0000 7f65bffff700 1 -- 172.21.15.64:0/1249714811 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f65c8052f30 con 0x7f65d80fbaf0 2023-12-16T03:13:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: Deploying daemon mds.cephfs.smithi184.jfpiqk on smithi184 2023-12-16T03:13:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] up:boot 2023-12-16T03:13:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: daemon mds.cephfs.smithi064.jaepzs assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-16T03:13:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-16T03:13:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T03:13:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: Cluster is now healthy 2023-12-16T03:13:58.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: fsmap cephfs:0 1 up:standby 2023-12-16T03:13:58.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.jaepzs"}]: dispatch 2023-12-16T03:13:58.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: fsmap cephfs:1 {0=cephfs.smithi064.jaepzs=up:creating} 2023-12-16T03:13:58.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:58 smithi184 ceph-mon[121180]: daemon mds.cephfs.smithi064.jaepzs is now active in filesystem cephfs as rank 0 2023-12-16T03:13:58.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:58.578+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f65d810ca50 con 0x7f65d80fbaf0 2023-12-16T03:13:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: Deploying daemon mds.cephfs.smithi184.jfpiqk on smithi184 2023-12-16T03:13:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] up:boot 2023-12-16T03:13:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: daemon mds.cephfs.smithi064.jaepzs assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-16T03:13:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-16T03:13:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T03:13:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: Cluster is now healthy 2023-12-16T03:13:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: fsmap cephfs:0 1 up:standby 2023-12-16T03:13:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.jaepzs"}]: dispatch 2023-12-16T03:13:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: fsmap cephfs:1 {0=cephfs.smithi064.jaepzs=up:creating} 2023-12-16T03:13:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:58 smithi064 ceph-mon[111958]: daemon mds.cephfs.smithi064.jaepzs is now active in filesystem cephfs as rank 0 2023-12-16T03:13:59.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.579+0000 7f65bffff700 1 -- 172.21.15.64:0/1249714811 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f65c8056550 con 0x7f65d80fbaf0 2023-12-16T03:13:59.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f65c0068f60 msgr2=0x7f65c006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:59.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f65c0068f60 0x7f65c006b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00b3b0 tx=0x7f65cc009e30 comp rx=0 tx=0).stop 2023-12-16T03:13:59.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fbaf0 msgr2=0x7f65d8110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:13:59.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fbaf0 0x7f65d8110210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f65c8002a80 tx=0x7f65c8004600 comp rx=0 tx=0).stop 2023-12-16T03:13:59.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 shutdown_connections 2023-12-16T03:13:59.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f65c0068f60 0x7f65c006b410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:59.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65d80fbaf0 0x7f65d8110210 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:59.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 --2- 172.21.15.64:0/1249714811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65d80fcd00 0x7f65d8112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:13:59.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 >> 172.21.15.64:0/1249714811 conn(0x7f65d80f71b0 msgr2=0x7f65d80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:13:59.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 shutdown_connections 2023-12-16T03:13:59.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:13:59.581+0000 7f65de029700 1 -- 172.21.15.64:0/1249714811 wait complete. 2023-12-16T03:13:59.801 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: pgmap v134: 65 pgs: 10 creating+peering, 43 active+clean, 12 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:59.801 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] up:active 2023-12-16T03:13:59.801 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] up:boot 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: fsmap cephfs:1 {0=cephfs.smithi064.jaepzs=up:active} 1 up:standby 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.jfpiqk"}]: dispatch 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: fsmap cephfs:1 {0=cephfs.smithi064.jaepzs=up:active} 1 up:standby 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.edrjyd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.edrjyd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:59.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:13:59 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1249714811' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: pgmap v134: 65 pgs: 10 creating+peering, 43 active+clean, 12 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] up:active 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] up:boot 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: fsmap cephfs:1 {0=cephfs.smithi064.jaepzs=up:active} 1 up:standby 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.jfpiqk"}]: dispatch 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: fsmap cephfs:1 {0=cephfs.smithi064.jaepzs=up:active} 1 up:standby 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:13:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.edrjyd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:13:59.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.edrjyd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T03:13:59.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:13:59.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:13:59 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1249714811' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-16T03:14:00.133 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T03:14:00.145 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:14:00.145 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-16T03:14:00.592 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:00.762 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:00 smithi064 ceph-mon[111958]: Deploying daemon mds.cephfs.smithi064.edrjyd on smithi064 2023-12-16T03:14:00.762 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:00 smithi064 ceph-mon[111958]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T03:14:00.762 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:00 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1249714811' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-16T03:14:00.763 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:00 smithi064 ceph-mon[111958]: daemon mds.cephfs.smithi184.jfpiqk assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-16T03:14:00.763 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:00 smithi064 ceph-mon[111958]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-16T03:14:00.763 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:00 smithi064 ceph-mon[111958]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T03:14:00.763 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:00 smithi064 ceph-mon[111958]: fsmap cephfs:1 {0=cephfs.smithi064.jaepzs=up:active} 1 up:standby 2023-12-16T03:14:00.763 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:00 smithi064 ceph-mon[111958]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:creating} 2023-12-16T03:14:00.763 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:00 smithi064 ceph-mon[111958]: daemon mds.cephfs.smithi184.jfpiqk is now active in filesystem cephfs as rank 1 2023-12-16T03:14:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:00 smithi184 ceph-mon[121180]: Deploying daemon mds.cephfs.smithi064.edrjyd on smithi064 2023-12-16T03:14:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:00 smithi184 ceph-mon[121180]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T03:14:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:00 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1249714811' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-16T03:14:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:00 smithi184 ceph-mon[121180]: daemon mds.cephfs.smithi184.jfpiqk assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-16T03:14:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:00 smithi184 ceph-mon[121180]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-16T03:14:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:00 smithi184 ceph-mon[121180]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T03:14:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:00 smithi184 ceph-mon[121180]: fsmap cephfs:1 {0=cephfs.smithi064.jaepzs=up:active} 1 up:standby 2023-12-16T03:14:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:00 smithi184 ceph-mon[121180]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:creating} 2023-12-16T03:14:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:00 smithi184 ceph-mon[121180]: daemon mds.cephfs.smithi184.jfpiqk is now active in filesystem cephfs as rank 1 2023-12-16T03:14:01.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.646+0000 7f47b3160700 1 -- 172.21.15.64:0/690016385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fcd00 msgr2=0x7f47ac0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.646+0000 7f47b3160700 1 --2- 172.21.15.64:0/690016385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fcd00 0x7f47ac0fd150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4798004940 tx=0x7f4798009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.646+0000 7f47b3160700 1 -- 172.21.15.64:0/690016385 shutdown_connections 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.646+0000 7f47b3160700 1 --2- 172.21.15.64:0/690016385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fcd00 0x7f47ac0fd150 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.646+0000 7f47b3160700 1 --2- 172.21.15.64:0/690016385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47ac0fbaf0 0x7f47ac0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.646+0000 7f47b3160700 1 -- 172.21.15.64:0/690016385 >> 172.21.15.64:0/690016385 conn(0x7f47ac0f7190 msgr2=0x7f47ac0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.646+0000 7f47b3160700 1 -- 172.21.15.64:0/690016385 shutdown_connections 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.646+0000 7f47b3160700 1 -- 172.21.15.64:0/690016385 wait complete. 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47b3160700 1 Processor -- start 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47b3160700 1 -- start start 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47b3160700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fbaf0 0x7f47ac10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47b3160700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47ac0fcd00 0x7f47ac10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47b3160700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac10e010 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47b3160700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac10e8b0 con 0x7f47ac0fcd00 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47b0efc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fbaf0 0x7f47ac10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47b0efc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fbaf0 0x7f47ac10d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56638/0 (socket says 172.21.15.64:56638) 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47b0efc700 1 -- 172.21.15.64:0/2329821985 learned_addr learned my addr 172.21.15.64:0/2329821985 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.647+0000 7f47abfff700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47ac0fcd00 0x7f47ac10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.648+0000 7f47b0efc700 1 -- 172.21.15.64:0/2329821985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47ac0fcd00 msgr2=0x7f47ac10da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.648+0000 7f47b0efc700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47ac0fcd00 0x7f47ac10da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.648+0000 7f47b0efc700 1 -- 172.21.15.64:0/2329821985 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798005040 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.648+0000 7f47b0efc700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fbaf0 0x7f47ac10d4d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47a000eb70 tx=0x7f47a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.648+0000 7f47a97fa700 1 -- 172.21.15.64:0/2329821985 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47a0007cc0 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.648+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ac10eb30 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.648+0000 7f47a97fa700 1 -- 172.21.15.64:0/2329821985 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f47a000f040 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.648+0000 7f47a97fa700 1 -- 172.21.15.64:0/2329821985 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47a000c9d0 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.648+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac10f070 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.649+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ac04bb80 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.649+0000 7f47a97fa700 1 -- 172.21.15.64:0/2329821985 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f47a000cc40 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.650+0000 7f47a97fa700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f479c068f70 0x7f479c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.650+0000 7f47a97fa700 1 -- 172.21.15.64:0/2329821985 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f47a0086850 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.650+0000 7f47abfff700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f479c068f70 0x7f479c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.650+0000 7f47abfff700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f479c068f70 0x7f479c06b420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4798013680 tx=0x7f4798009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:01.655 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.654+0000 7f47a97fa700 1 -- 172.21.15.64:0/2329821985 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f47a004da00 con 0x7f47ac0fbaf0 2023-12-16T03:14:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: pgmap v135: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 148 B/s wr, 2 op/s 2023-12-16T03:14:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-16T03:14:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: Cluster is now healthy 2023-12-16T03:14:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] up:active 2023-12-16T03:14:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] up:boot 2023-12-16T03:14:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 1 up:standby 2023-12-16T03:14:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.edrjyd"}]: dispatch 2023-12-16T03:14:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.uqpwjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:14:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.uqpwjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T03:14:01.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:14:01.784 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: pgmap v135: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 148 B/s wr, 2 op/s 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: Cluster is now healthy 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] up:active 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] up:boot 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 1 up:standby 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.edrjyd"}]: dispatch 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.uqpwjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.uqpwjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T03:14:01.785 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:14:01.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:01.895+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f47ac104490 con 0x7f47ac0fbaf0 2023-12-16T03:14:02.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.484+0000 7f47a97fa700 1 -- 172.21.15.64:0/2329821985 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f47a00567e0 con 0x7f47ac0fbaf0 2023-12-16T03:14:02.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f479c068f70 msgr2=0x7f479c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:02.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f479c068f70 0x7f479c06b420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4798013680 tx=0x7f4798009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:02.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fbaf0 msgr2=0x7f47ac10d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:02.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fbaf0 0x7f47ac10d4d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47a000eb70 tx=0x7f47a000b040 comp rx=0 tx=0).stop 2023-12-16T03:14:02.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 shutdown_connections 2023-12-16T03:14:02.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f479c068f70 0x7f479c06b420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:02.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47ac0fbaf0 0x7f47ac10d4d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:02.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 --2- 172.21.15.64:0/2329821985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47ac0fcd00 0x7f47ac10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:02.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 >> 172.21.15.64:0/2329821985 conn(0x7f47ac0f7190 msgr2=0x7f47ac065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:02.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 shutdown_connections 2023-12-16T03:14:02.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:02.487+0000 7f47b3160700 1 -- 172.21.15.64:0/2329821985 wait complete. 2023-12-16T03:14:02.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:02 smithi184 ceph-mon[121180]: Deploying daemon mds.cephfs.smithi184.uqpwjn on smithi184 2023-12-16T03:14:02.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:02 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2329821985' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-16T03:14:02.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:14:02.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:02 smithi064 ceph-mon[111958]: Deploying daemon mds.cephfs.smithi184.uqpwjn on smithi184 2023-12-16T03:14:02.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:02 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2329821985' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-16T03:14:02.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:14:02.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:02.955 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T03:14:02.965 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:14:02.965 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2023-12-16T03:14:03.315 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:03.620 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:03 smithi064 ceph-mon[111958]: pgmap v136: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 639 B/s wr, 5 op/s 2023-12-16T03:14:03.620 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:03 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2329821985' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-16T03:14:03.620 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:03 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] up:boot 2023-12-16T03:14:03.620 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:03 smithi064 ceph-mon[111958]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:14:03.620 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.uqpwjn"}]: dispatch 2023-12-16T03:14:03.620 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:14:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:03 smithi184 ceph-mon[121180]: pgmap v136: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 639 B/s wr, 5 op/s 2023-12-16T03:14:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:03 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2329821985' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-16T03:14:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:03 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] up:boot 2023-12-16T03:14:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:03 smithi184 ceph-mon[121180]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:14:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.uqpwjn"}]: dispatch 2023-12-16T03:14:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:14:05.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.033+0000 7f5e34985700 1 -- 172.21.15.64:0/2609464070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fcd10 msgr2=0x7f5e300fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:05.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.033+0000 7f5e34985700 1 --2- 172.21.15.64:0/2609464070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fcd10 0x7f5e300fd160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5e24004940 tx=0x7f5e24009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:05.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.033+0000 7f5e34985700 1 -- 172.21.15.64:0/2609464070 shutdown_connections 2023-12-16T03:14:05.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.033+0000 7f5e34985700 1 --2- 172.21.15.64:0/2609464070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fcd10 0x7f5e300fd160 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:05.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.033+0000 7f5e34985700 1 --2- 172.21.15.64:0/2609464070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e300fbb00 0x7f5e300fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:05.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.033+0000 7f5e34985700 1 -- 172.21.15.64:0/2609464070 >> 172.21.15.64:0/2609464070 conn(0x7f5e300f71c0 msgr2=0x7f5e300f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:05.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.033+0000 7f5e34985700 1 -- 172.21.15.64:0/2609464070 shutdown_connections 2023-12-16T03:14:05.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.033+0000 7f5e34985700 1 -- 172.21.15.64:0/2609464070 wait complete. 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e34985700 1 Processor -- start 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e34985700 1 -- start start 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e34985700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fbb00 0x7f5e30110200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e34985700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e300fcd10 0x7f5e30112750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e34985700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300669c0 con 0x7f5e300fbb00 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e34985700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30066b00 con 0x7f5e300fcd10 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fbb00 0x7f5e30110200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fbb00 0x7f5e30110200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43626/0 (socket says 172.21.15.64:43626) 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e2e59c700 1 -- 172.21.15.64:0/218821654 learned_addr learned my addr 172.21.15.64:0/218821654 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.034+0000 7f5e2dd9b700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e300fcd10 0x7f5e30112750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.035+0000 7f5e2e59c700 1 -- 172.21.15.64:0/218821654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e300fcd10 msgr2=0x7f5e30112750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:05.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.035+0000 7f5e2e59c700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e300fcd10 0x7f5e30112750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:05.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.035+0000 7f5e2e59c700 1 -- 172.21.15.64:0/218821654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e24005040 con 0x7f5e300fbb00 2023-12-16T03:14:05.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.035+0000 7f5e2e59c700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fbb00 0x7f5e30110200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5e20002a80 tx=0x7f5e20004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:05.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.035+0000 7f5e1effd700 1 -- 172.21.15.64:0/218821654 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e20007cc0 con 0x7f5e300fbb00 2023-12-16T03:14:05.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.035+0000 7f5e1effd700 1 -- 172.21.15.64:0/218821654 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e2000f040 con 0x7f5e300fbb00 2023-12-16T03:14:05.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.035+0000 7f5e1effd700 1 -- 172.21.15.64:0/218821654 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e2000d9c0 con 0x7f5e300fbb00 2023-12-16T03:14:05.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.035+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e30112db0 con 0x7f5e300fbb00 2023-12-16T03:14:05.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.035+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e30113240 con 0x7f5e300fbb00 2023-12-16T03:14:05.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.036+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3004bb80 con 0x7f5e300fbb00 2023-12-16T03:14:05.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.037+0000 7f5e1effd700 1 -- 172.21.15.64:0/218821654 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5e2000db20 con 0x7f5e300fbb00 2023-12-16T03:14:05.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.037+0000 7f5e1effd700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5e18068f70 0x7f5e1806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:05.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.037+0000 7f5e1effd700 1 -- 172.21.15.64:0/218821654 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5e20086ac0 con 0x7f5e300fbb00 2023-12-16T03:14:05.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.037+0000 7f5e2dd9b700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5e18068f70 0x7f5e1806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:05.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.037+0000 7f5e2dd9b700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5e18068f70 0x7f5e1806b420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400b3b0 tx=0x7f5e24009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:05.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.042+0000 7f5e1effd700 1 -- 172.21.15.64:0/218821654 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5e20052f10 con 0x7f5e300fbb00 2023-12-16T03:14:05.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:04 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:05.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:04 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:05.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:04 smithi064 ceph-mon[111958]: pgmap v137: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-16T03:14:05.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:04 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] up:active 2023-12-16T03:14:05.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:04 smithi064 ceph-mon[111958]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:14:05.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.293+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5e301044a0 con 0x7f5e300fbb00 2023-12-16T03:14:05.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:04 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:05.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:04 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:05.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:04 smithi184 ceph-mon[121180]: pgmap v137: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-16T03:14:05.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:04 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] up:active 2023-12-16T03:14:05.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:04 smithi184 ceph-mon[121180]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:14:05.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.492+0000 7f5e1effd700 1 -- 172.21.15.64:0/218821654 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v12) v1 ==== 168+0+0 (secure 0 0 0) 0x7f5e20056530 con 0x7f5e300fbb00 2023-12-16T03:14:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5e18068f70 msgr2=0x7f5e1806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5e18068f70 0x7f5e1806b420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400b3b0 tx=0x7f5e24009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fbb00 msgr2=0x7f5e30110200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fbb00 0x7f5e30110200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5e20002a80 tx=0x7f5e20004600 comp rx=0 tx=0).stop 2023-12-16T03:14:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 shutdown_connections 2023-12-16T03:14:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f5e18068f70 0x7f5e1806b420 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e300fbb00 0x7f5e30110200 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 --2- 172.21.15.64:0/218821654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e300fcd10 0x7f5e30112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 >> 172.21.15.64:0/218821654 conn(0x7f5e300f71c0 msgr2=0x7f5e300fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 shutdown_connections 2023-12-16T03:14:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:05.494+0000 7f5e34985700 1 -- 172.21.15.64:0/218821654 wait complete. 2023-12-16T03:14:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:inline data enabled 2023-12-16T03:14:06.119 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T03:14:06.129 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:14:06.129 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-16T03:14:06.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:05 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/218821654' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-16T03:14:06.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:05 smithi064 ceph-mon[111958]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-16T03:14:06.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:05 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] up:standby 2023-12-16T03:14:06.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:05 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/218821654' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-16T03:14:06.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:05 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] up:active 2023-12-16T03:14:06.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:05 smithi064 ceph-mon[111958]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:14:06.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:05 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/218821654' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-16T03:14:06.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:05 smithi184 ceph-mon[121180]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-16T03:14:06.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:05 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] up:standby 2023-12-16T03:14:06.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:05 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/218821654' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-16T03:14:06.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:05 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] up:active 2023-12-16T03:14:06.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:05 smithi184 ceph-mon[121180]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:14:06.462 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:07.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:07 smithi064 ceph-mon[111958]: pgmap v138: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2023-12-16T03:14:07.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:07 smithi184 ceph-mon[121180]: pgmap v138: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2023-12-16T03:14:07.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.848+0000 7f6af00f0700 1 -- 172.21.15.64:0/731429452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fbe10 msgr2=0x7f6ae80fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:07.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.848+0000 7f6af00f0700 1 --2- 172.21.15.64:0/731429452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fbe10 0x7f6ae80fc280 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8004940 tx=0x7f6ad8009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:07.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.848+0000 7f6af00f0700 1 -- 172.21.15.64:0/731429452 shutdown_connections 2023-12-16T03:14:07.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.848+0000 7f6af00f0700 1 --2- 172.21.15.64:0/731429452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fbe10 0x7f6ae80fc280 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:07.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.848+0000 7f6af00f0700 1 --2- 172.21.15.64:0/731429452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae80fd190 0x7f6ae80fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:07.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.848+0000 7f6af00f0700 1 -- 172.21.15.64:0/731429452 >> 172.21.15.64:0/731429452 conn(0x7f6ae80f6950 msgr2=0x7f6ae80f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:07.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.848+0000 7f6af00f0700 1 -- 172.21.15.64:0/731429452 shutdown_connections 2023-12-16T03:14:07.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.848+0000 7f6af00f0700 1 -- 172.21.15.64:0/731429452 wait complete. 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.849+0000 7f6af00f0700 1 Processor -- start 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.849+0000 7f6af00f0700 1 -- start start 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.849+0000 7f6af00f0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae80fbe10 0x7f6ae81102d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.849+0000 7f6af00f0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fd190 0x7f6ae8112820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.849+0000 7f6af00f0700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80fbaa0 con 0x7f6ae80fd190 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.849+0000 7f6af00f0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80fbbe0 con 0x7f6ae80fbe10 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.849+0000 7f6aed68b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fd190 0x7f6ae8112820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.849+0000 7f6aed68b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fd190 0x7f6ae8112820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43632/0 (socket says 172.21.15.64:43632) 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.849+0000 7f6aed68b700 1 -- 172.21.15.64:0/2497356164 learned_addr learned my addr 172.21.15.64:0/2497356164 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:07.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6aede8c700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae80fbe10 0x7f6ae81102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:07.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6aed68b700 1 -- 172.21.15.64:0/2497356164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae80fbe10 msgr2=0x7f6ae81102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:07.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6aed68b700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae80fbe10 0x7f6ae81102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:07.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6aed68b700 1 -- 172.21.15.64:0/2497356164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad8005040 con 0x7f6ae80fd190 2023-12-16T03:14:07.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6aed68b700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fd190 0x7f6ae8112820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009380 tx=0x7f6ad8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:07.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6ade7fc700 1 -- 172.21.15.64:0/2497356164 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ad800e040 con 0x7f6ae80fd190 2023-12-16T03:14:07.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6ade7fc700 1 -- 172.21.15.64:0/2497356164 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ad800bc50 con 0x7f6ae80fd190 2023-12-16T03:14:07.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8112e20 con 0x7f6ae80fd190 2023-12-16T03:14:07.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6ade7fc700 1 -- 172.21.15.64:0/2497356164 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ad8013420 con 0x7f6ae80fd190 2023-12-16T03:14:07.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.850+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae81132d0 con 0x7f6ae80fd190 2023-12-16T03:14:07.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.851+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae804bb80 con 0x7f6ae80fd190 2023-12-16T03:14:07.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.852+0000 7f6ade7fc700 1 -- 172.21.15.64:0/2497356164 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6ad801c430 con 0x7f6ae80fd190 2023-12-16T03:14:07.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.852+0000 7f6ade7fc700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6ad4068f60 0x7f6ad406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:07.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.852+0000 7f6ade7fc700 1 -- 172.21.15.64:0/2497356164 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6ad8087a50 con 0x7f6ae80fd190 2023-12-16T03:14:07.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.852+0000 7f6aede8c700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6ad4068f60 0x7f6ad406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:07.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.853+0000 7f6aede8c700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6ad4068f60 0x7f6ad406b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40041d0 tx=0x7f6ae4009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:07.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:07.857+0000 7f6ade7fc700 1 -- 172.21.15.64:0/2497356164 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6ad8053fd0 con 0x7f6ae80fd190 2023-12-16T03:14:08.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.103+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6ae8104550 con 0x7f6ae80fd190 2023-12-16T03:14:08.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.103+0000 7f6ade7fc700 1 -- 172.21.15.64:0/2497356164 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1816 (secure 0 0 0) 0x7f6ad8021730 con 0x7f6ae80fd190 2023-12-16T03:14:08.105 INFO:teuthology.orchestra.run.smithi064.stdout:e13 2023-12-16T03:14:08.105 INFO:teuthology.orchestra.run.smithi064.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:14:08.105 INFO:teuthology.orchestra.run.smithi064.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:14:08.105 INFO:teuthology.orchestra.run.smithi064.stdout:legacy client fscid: 1 2023-12-16T03:14:08.105 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:14:08.105 INFO:teuthology.orchestra.run.smithi064.stdout:Filesystem 'cephfs' (1) 2023-12-16T03:14:08.105 INFO:teuthology.orchestra.run.smithi064.stdout:fs_name cephfs 2023-12-16T03:14:08.105 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 12 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:modified 2023-12-16T03:14:05.488963+0000 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:tableserver 0 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:root 0 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:session_timeout 60 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:session_autoclose 300 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:max_file_size 1099511627776 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:required_client_features {} 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure 0 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure_osd_epoch 0 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:max_mds 2 2023-12-16T03:14:08.106 INFO:teuthology.orchestra.run.smithi064.stdout:in 0,1 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:up {0=14460,1=24269} 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:failed 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:damaged 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:stopped 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:data_pools [3] 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:metadata_pool 2 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:inline_data enabled 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:balancer 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:standby_count_wanted 1 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:14:08.107 INFO:teuthology.orchestra.run.smithi064.stdout:Standby daemons: 2023-12-16T03:14:08.108 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:14:08.108 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:14:08.108 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:14:08.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6ad4068f60 msgr2=0x7f6ad406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:08.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6ad4068f60 0x7f6ad406b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40041d0 tx=0x7f6ae4009040 comp rx=0 tx=0).stop 2023-12-16T03:14:08.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fd190 msgr2=0x7f6ae8112820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:08.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fd190 0x7f6ae8112820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009380 tx=0x7f6ad8009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:08.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 shutdown_connections 2023-12-16T03:14:08.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f6ad4068f60 0x7f6ad406b410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:08.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae80fbe10 0x7f6ae81102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:08.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 --2- 172.21.15.64:0/2497356164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ae80fd190 0x7f6ae8112820 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:08.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 >> 172.21.15.64:0/2497356164 conn(0x7f6ae80f6950 msgr2=0x7f6ae8100050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:08.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 shutdown_connections 2023-12-16T03:14:08.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:08.106+0000 7f6af00f0700 1 -- 172.21.15.64:0/2497356164 wait complete. 2023-12-16T03:14:08.109 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 13 2023-12-16T03:14:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:08 smithi064 ceph-mon[111958]: mds.? [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] up:standby 2023-12-16T03:14:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:08 smithi064 ceph-mon[111958]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:14:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:08 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:08.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:08 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2497356164' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:14:08.485 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-16T03:14:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:08 smithi184 ceph-mon[121180]: mds.? [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] up:standby 2023-12-16T03:14:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:08 smithi184 ceph-mon[121180]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:14:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:08 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:08.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:08 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2497356164' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:14:08.815 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:09.505 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:09 smithi184 ceph-mon[121180]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2023-12-16T03:14:09.505 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:09 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:14:09.505 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:09 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:14:09.505 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:09 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:09.505 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:09 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:14:09.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:09 smithi064 ceph-mon[111958]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2023-12-16T03:14:09.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:09 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:14:09.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:09 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:14:09.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:09 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:09.663 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:09 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:14:10.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.363+0000 7f23d9475700 1 -- 172.21.15.64:0/495862167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 msgr2=0x7f23d40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:10.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.363+0000 7f23d9475700 1 --2- 172.21.15.64:0/495862167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 0x7f23d40fbf00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f23c4004940 tx=0x7f23c4009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:10.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.363+0000 7f23d9475700 1 -- 172.21.15.64:0/495862167 shutdown_connections 2023-12-16T03:14:10.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.363+0000 7f23d9475700 1 --2- 172.21.15.64:0/495862167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d40fcd00 0x7f23d40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:10.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.363+0000 7f23d9475700 1 --2- 172.21.15.64:0/495862167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 0x7f23d40fbf00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:10.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.363+0000 7f23d9475700 1 -- 172.21.15.64:0/495862167 >> 172.21.15.64:0/495862167 conn(0x7f23d40f71d0 msgr2=0x7f23d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:10.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.363+0000 7f23d9475700 1 -- 172.21.15.64:0/495862167 shutdown_connections 2023-12-16T03:14:10.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.363+0000 7f23d9475700 1 -- 172.21.15.64:0/495862167 wait complete. 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d9475700 1 Processor -- start 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d9475700 1 -- start start 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d9475700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 0x7f23d41101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d9475700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d40fcd00 0x7f23d4112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d9475700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40669a0 con 0x7f23d40fbaf0 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d9475700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4066ae0 con 0x7f23d40fcd00 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d2ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 0x7f23d41101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d2ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 0x7f23d41101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43636/0 (socket says 172.21.15.64:43636) 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d2ffd700 1 -- 172.21.15.64:0/1465304896 learned_addr learned my addr 172.21.15.64:0/1465304896 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d27fc700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d40fcd00 0x7f23d4112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d2ffd700 1 -- 172.21.15.64:0/1465304896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d40fcd00 msgr2=0x7f23d4112740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d2ffd700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d40fcd00 0x7f23d4112740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d2ffd700 1 -- 172.21.15.64:0/1465304896 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c4005040 con 0x7f23d40fbaf0 2023-12-16T03:14:10.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d27fc700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d40fcd00 0x7f23d4112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:14:10.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.364+0000 7f23d2ffd700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 0x7f23d41101f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009fd0 tx=0x7f23c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:10.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.365+0000 7f23cb7fe700 1 -- 172.21.15.64:0/1465304896 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c4021070 con 0x7f23d40fbaf0 2023-12-16T03:14:10.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.365+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d4112ce0 con 0x7f23d40fbaf0 2023-12-16T03:14:10.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.365+0000 7f23cb7fe700 1 -- 172.21.15.64:0/1465304896 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23c401c400 con 0x7f23d40fbaf0 2023-12-16T03:14:10.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.365+0000 7f23cb7fe700 1 -- 172.21.15.64:0/1465304896 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c400e070 con 0x7f23d40fbaf0 2023-12-16T03:14:10.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.365+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d4113170 con 0x7f23d40fbaf0 2023-12-16T03:14:10.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.366+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d404bb80 con 0x7f23d40fbaf0 2023-12-16T03:14:10.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.366+0000 7f23cb7fe700 1 -- 172.21.15.64:0/1465304896 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f23c4013a50 con 0x7f23d40fbaf0 2023-12-16T03:14:10.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.366+0000 7f23cb7fe700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f23c0068f70 0x7f23c006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:10.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.367+0000 7f23cb7fe700 1 -- 172.21.15.64:0/1465304896 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f23c4088020 con 0x7f23d40fbaf0 2023-12-16T03:14:10.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.367+0000 7f23d27fc700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f23c0068f70 0x7f23c006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:10.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.367+0000 7f23d27fc700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f23c0068f70 0x7f23c006b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f23bc004600 tx=0x7f23bc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:10.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.371+0000 7f23cb7fe700 1 -- 172.21.15.64:0/1465304896 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f23c40544f0 con 0x7f23d40fbaf0 2023-12-16T03:14:10.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.644+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23d4104490 con 0x7f23d40fbaf0 2023-12-16T03:14:10.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.645+0000 7f23cb7fe700 1 -- 172.21.15.64:0/1465304896 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4704 (secure 0 0 0) 0x7f23c4057b10 con 0x7f23d40fbaf0 2023-12-16T03:14:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f23c0068f70 msgr2=0x7f23c006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f23c0068f70 0x7f23c006b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f23bc004600 tx=0x7f23bc00b040 comp rx=0 tx=0).stop 2023-12-16T03:14:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 msgr2=0x7f23d41101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 0x7f23d41101f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009fd0 tx=0x7f23c4009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 shutdown_connections 2023-12-16T03:14:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f23c0068f70 0x7f23c006b420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23d40fbaf0 0x7f23d41101f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 --2- 172.21.15.64:0/1465304896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d40fcd00 0x7f23d4112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 >> 172.21.15.64:0/1465304896 conn(0x7f23d40f71d0 msgr2=0x7f23d40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 shutdown_connections 2023-12-16T03:14:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:10.647+0000 7f23d9475700 1 -- 172.21.15.64:0/1465304896 wait complete. 2023-12-16T03:14:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 13 2023-12-16T03:14:10.658 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:14:11.209 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-16T03:14:11.237 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:10 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:11.237 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:10 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:11.237 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:10 smithi064 ceph-mon[111958]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2023-12-16T03:14:11.237 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:10 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1465304896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T03:14:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:10 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:10 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:10 smithi184 ceph-mon[121180]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2023-12-16T03:14:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:10 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1465304896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T03:14:11.673 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.730+0000 7fa20a1e4700 1 -- 172.21.15.64:0/1748432000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fbaf0 msgr2=0x7fa2040fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.730+0000 7fa20a1e4700 1 --2- 172.21.15.64:0/1748432000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fbaf0 0x7fa2040fbf00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4004940 tx=0x7fa1f4009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.730+0000 7fa20a1e4700 1 -- 172.21.15.64:0/1748432000 shutdown_connections 2023-12-16T03:14:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.730+0000 7fa20a1e4700 1 --2- 172.21.15.64:0/1748432000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2040fcd00 0x7fa2040fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.730+0000 7fa20a1e4700 1 --2- 172.21.15.64:0/1748432000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fbaf0 0x7fa2040fbf00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.730+0000 7fa20a1e4700 1 -- 172.21.15.64:0/1748432000 >> 172.21.15.64:0/1748432000 conn(0x7fa2040f7190 msgr2=0x7fa2040f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.730+0000 7fa20a1e4700 1 -- 172.21.15.64:0/1748432000 shutdown_connections 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.730+0000 7fa20a1e4700 1 -- 172.21.15.64:0/1748432000 wait complete. 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa20a1e4700 1 Processor -- start 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa20a1e4700 1 -- start start 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa20a1e4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2040fbaf0 0x7fa20410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa20a1e4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fcd00 0x7fa20410dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa20a1e4700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20410e0c0 con 0x7fa2040fcd00 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa20a1e4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20410e960 con 0x7fa2040fbaf0 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa202ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fcd00 0x7fa20410dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa202ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fcd00 0x7fa20410dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40798/0 (socket says 172.21.15.64:40798) 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa202ffd700 1 -- 172.21.15.64:0/2924929648 learned_addr learned my addr 172.21.15.64:0/2924929648 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa2037fe700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2040fbaf0 0x7fa20410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa202ffd700 1 -- 172.21.15.64:0/2924929648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2040fbaf0 msgr2=0x7fa20410d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa202ffd700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2040fbaf0 0x7fa20410d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa202ffd700 1 -- 172.21.15.64:0/2924929648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4005040 con 0x7fa2040fcd00 2023-12-16T03:14:12.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.731+0000 7fa2037fe700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2040fbaf0 0x7fa20410d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:14:12.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.732+0000 7fa202ffd700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fcd00 0x7fa20410dac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8002a50 tx=0x7fa1f80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:12.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.732+0000 7fa1ebfff700 1 -- 172.21.15.64:0/2924929648 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f8007cc0 con 0x7fa2040fcd00 2023-12-16T03:14:12.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.732+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20410ec40 con 0x7fa2040fcd00 2023-12-16T03:14:12.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.732+0000 7fa1ebfff700 1 -- 172.21.15.64:0/2924929648 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa1f800f040 con 0x7fa2040fcd00 2023-12-16T03:14:12.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.732+0000 7fa1ebfff700 1 -- 172.21.15.64:0/2924929648 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f8009540 con 0x7fa2040fcd00 2023-12-16T03:14:12.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.732+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20410f180 con 0x7fa2040fcd00 2023-12-16T03:14:12.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.733+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20404bb80 con 0x7fa2040fcd00 2023-12-16T03:14:12.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.733+0000 7fa1ebfff700 1 -- 172.21.15.64:0/2924929648 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa1f80096a0 con 0x7fa2040fcd00 2023-12-16T03:14:12.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.734+0000 7fa1ebfff700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa1ec068f60 0x7fa1ec06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:12.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.734+0000 7fa1ebfff700 1 -- 172.21.15.64:0/2924929648 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa1f8086bd0 con 0x7fa2040fcd00 2023-12-16T03:14:12.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.734+0000 7fa2037fe700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa1ec068f60 0x7fa1ec06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:12.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.734+0000 7fa2037fe700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa1ec068f60 0x7fa1ec06b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009fd0 tx=0x7fa1f4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:12.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:12.738+0000 7fa1ebfff700 1 -- 172.21.15.64:0/2924929648 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa1f8056ab0 con 0x7fa2040fcd00 2023-12-16T03:14:13.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.022+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fa20410f560 con 0x7fa2040fcd00 2023-12-16T03:14:13.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.023+0000 7fa1ebfff700 1 -- 172.21.15.64:0/2924929648 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+99 (secure 0 0 0) 0x7fa1f8056640 con 0x7fa2040fcd00 2023-12-16T03:14:13.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa1ec068f60 msgr2=0x7fa1ec06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:13.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa1ec068f60 0x7fa1ec06b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009fd0 tx=0x7fa1f4009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:13.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fcd00 msgr2=0x7fa20410dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:13.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fcd00 0x7fa20410dac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8002a50 tx=0x7fa1f80046b0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 shutdown_connections 2023-12-16T03:14:13.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa1ec068f60 0x7fa1ec06b410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2040fbaf0 0x7fa20410d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 --2- 172.21.15.64:0/2924929648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2040fcd00 0x7fa20410dac0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 >> 172.21.15.64:0/2924929648 conn(0x7fa2040f7190 msgr2=0x7fa204065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:13.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 shutdown_connections 2023-12-16T03:14:13.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.025+0000 7fa20a1e4700 1 -- 172.21.15.64:0/2924929648 wait complete. 2023-12-16T03:14:13.037 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:14:13.462 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-16T03:14:13.474 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3922596805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fcc00 msgr2=0x7fba9c0fd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 --2- 172.21.15.64:0/3922596805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fcc00 0x7fba9c0fd050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba8c004940 tx=0x7fba8c009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3922596805 shutdown_connections 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 --2- 172.21.15.64:0/3922596805 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fcc00 0x7fba9c0fd050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 --2- 172.21.15.64:0/3922596805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0fb9f0 0x7fba9c0fbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3922596805 >> 172.21.15.64:0/3922596805 conn(0x7fba9c0f7070 msgr2=0x7fba9c0f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3922596805 shutdown_connections 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3922596805 wait complete. 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 Processor -- start 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 -- start start 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fb9f0 0x7fba9c10d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:13.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0fcc00 0x7fba9c10d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c10dd80 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.642+0000 7fbaa44d7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c10def0 con 0x7fba9c0fcc00 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa2273700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fb9f0 0x7fba9c10d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa2273700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fb9f0 0x7fba9c10d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40818/0 (socket says 172.21.15.64:40818) 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa2273700 1 -- 172.21.15.64:0/3470267132 learned_addr learned my addr 172.21.15.64:0/3470267132 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa1a72700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0fcc00 0x7fba9c10d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa2273700 1 -- 172.21.15.64:0/3470267132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0fcc00 msgr2=0x7fba9c10d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa2273700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0fcc00 0x7fba9c10d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa2273700 1 -- 172.21.15.64:0/3470267132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c005040 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa1a72700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0fcc00 0x7fba9c10d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa2273700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fb9f0 0x7fba9c10d240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fba9800eb40 tx=0x7fba9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fba92ffd700 1 -- 172.21.15.64:0/3470267132 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba98007cc0 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fba92ffd700 1 -- 172.21.15.64:0/3470267132 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba9800f040 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c112940 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fba92ffd700 1 -- 172.21.15.64:0/3470267132 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba9800cad0 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.643+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c112f00 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.644+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c1043b0 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.645+0000 7fba92ffd700 1 -- 172.21.15.64:0/3470267132 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fba9800cc30 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.645+0000 7fba92ffd700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fba88068f60 0x7fba8806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:13.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.645+0000 7fba92ffd700 1 -- 172.21.15.64:0/3470267132 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fba980868d0 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.645+0000 7fbaa1a72700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fba88068f60 0x7fba8806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:13.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.646+0000 7fbaa1a72700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fba88068f60 0x7fba8806b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba8c004560 tx=0x7fba8c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:13.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.649+0000 7fba92ffd700 1 -- 172.21.15.64:0/3470267132 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fba98056830 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:13 smithi064 ceph-mon[111958]: pgmap v141: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s wr, 5 op/s 2023-12-16T03:14:13.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:13 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2924929648' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-16T03:14:13.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:13 smithi184 ceph-mon[121180]: pgmap v141: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s wr, 5 op/s 2023-12-16T03:14:13.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:13 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2924929648' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-16T03:14:13.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.847+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba9c1132a0 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.848+0000 7fba92ffd700 1 -- 172.21.15.64:0/3470267132 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14253 (secure 0 0 0) 0x7fba980563c0 con 0x7fba9c0fb9f0 2023-12-16T03:14:13.849 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:14:13.849 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":43,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","created":"2023-12-16T03:08:52.761746+0000","modified":"2023-12-16T03:13:55.454083+0000","last_up_change":"2023-12-16T03:13:02.379717+0000","last_in_change":"2023-12-16T03:12:46.192351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:12:08.817940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T03:13:52.316878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T03:13:52.858683+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94788c05-539e-4b9d-aaa5-099f071ba934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6803","nonce":227243716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6805","nonce":227243716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6809","nonce":227243716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":227243716},{"type":"v1","addr":"172.21.15.64:6807","nonce":227243716}]},"public_addr":"172.21.15.64:6803/227243716","cluster_addr":"172.21.15.64:6805/227243716","heartbeat_back_addr":"172.21.15.64:6809/227243716","heartbeat_front_addr":"172.21.15.64:6807/227243716","state":["exists","up"]},{"osd":1,"uuid":"b08e3c59-129c-4baf-89ee-61012384a515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6811","nonce":2843022610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6813","nonce":2843022610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6817","nonce":2843022610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2843022610},{"type":"v1","addr":"172.21.15.64:6815","nonce":2843022610}]},"public_addr":"172.21.15.64:6811/2843022610","cluster_addr":"172.21.15.64:6813/2843022610","heartbeat_back_addr":"172.21.15.64:6817/2843022610","heartbeat_front_addr":"172.21.15.64:6815/2843022610","state":["exists","up"]},{"osd":2,"uuid":"18ed018b-ab10-4041-86f5-393af106517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6819","nonce":2485820557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6821","nonce":2485820557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6825","nonce":2485820557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2485820557},{"type":"v1","addr":"172.21.15.64:6823","nonce":2485820557}]},"public_addr":"172.21.15.64:6819/2485820557","cluster_addr":"172.21.15.64:6821/2485820557","heartbeat_back_addr":"172.21.15.64:6825/2485820557","heartbeat_front_addr":"172.21.15.64:6823/2485820557","state":["exists","up"]},{"osd":3,"uuid":"de1cc449-de96-410d-9a56-210aae20b3d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6801","nonce":222462294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6803","nonce":222462294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6807","nonce":222462294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":222462294},{"type":"v1","addr":"172.21.15.184:6805","nonce":222462294}]},"public_addr":"172.21.15.184:6801/222462294","cluster_addr":"172.21.15.184:6803/222462294","heartbeat_back_addr":"172.21.15.184:6807/222462294","heartbeat_front_addr":"172.21.15.184:6805/222462294","state":["exists","up"]},{"osd":4,"uuid":"4dda63b7-8319-476c-8bb6-60dbb2aa1e92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6809","nonce":3289979784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6811","nonce":3289979784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6815","nonce":3289979784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3289979784},{"type":"v1","addr":"172.21.15.184:6813","nonce":3289979784}]},"public_addr":"172.21.15.184:6809/3289979784","cluster_addr":"172.21.15.184:6811/3289979784","heartbeat_back_addr":"172.21.15.184:6815/3289979784","heartbeat_front_addr":"172.21.15.184:6813/3289979784","state":["exists","up"]},{"osd":5,"uuid":"55282f72-d6e4-4f91-9285-9b81aa14a948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6817","nonce":4080162917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6819","nonce":4080162917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6823","nonce":4080162917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":4080162917},{"type":"v1","addr":"172.21.15.184:6821","nonce":4080162917}]},"public_addr":"172.21.15.184:6817/4080162917","cluster_addr":"172.21.15.184:6819/4080162917","heartbeat_back_addr":"172.21.15.184:6823/4080162917","heartbeat_front_addr":"172.21.15.184:6821/4080162917","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:24.502427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:45.326372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:05.862744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:24.099546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:42.577575+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:13:01.012096+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6800/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/74591443":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/1123447957":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/3738748261":"2023-12-17T03:10:32.323993+0000","172.21.15.64:6801/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6800/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/3838233490":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/4039513088":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/2708172205":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6800/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/277874032":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/1829112257":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/1577100459":"2023-12-17T03:09:16.219813+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:14:13.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fba88068f60 msgr2=0x7fba8806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fba88068f60 0x7fba8806b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba8c004560 tx=0x7fba8c009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fb9f0 msgr2=0x7fba9c10d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fb9f0 0x7fba9c10d240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fba9800eb40 tx=0x7fba9800b040 comp rx=0 tx=0).stop 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 shutdown_connections 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fba88068f60 0x7fba8806b410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba9c0fb9f0 0x7fba9c10d240 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 --2- 172.21.15.64:0/3470267132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0fcc00 0x7fba9c10d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 >> 172.21.15.64:0/3470267132 conn(0x7fba9c0f7070 msgr2=0x7fba9c064b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 shutdown_connections 2023-12-16T03:14:13.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.850+0000 7fbaa44d7700 1 -- 172.21.15.64:0/3470267132 wait complete. 2023-12-16T03:14:13.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:12:08.817940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T03:13:52.316878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T03:13:52.858683+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T03:14:13.864 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:14:13.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.989+0000 7fdc82a89700 1 -- 172.21.15.64:0/2172796258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fca90 msgr2=0x7fdc7c0fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:13.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.989+0000 7fdc82a89700 1 --2- 172.21.15.64:0/2172796258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fca90 0x7fdc7c0fcea0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdc70004940 tx=0x7fdc70009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:13.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.989+0000 7fdc82a89700 1 -- 172.21.15.64:0/2172796258 shutdown_connections 2023-12-16T03:14:13.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.989+0000 7fdc82a89700 1 --2- 172.21.15.64:0/2172796258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc7c0fdca0 0x7fdc7c0fe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.989+0000 7fdc82a89700 1 --2- 172.21.15.64:0/2172796258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fca90 0x7fdc7c0fcea0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.989+0000 7fdc82a89700 1 -- 172.21.15.64:0/2172796258 >> 172.21.15.64:0/2172796258 conn(0x7fdc7c0f8150 msgr2=0x7fdc7c0fa580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.989+0000 7fdc82a89700 1 -- 172.21.15.64:0/2172796258 shutdown_connections 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.989+0000 7fdc82a89700 1 -- 172.21.15.64:0/2172796258 wait complete. 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc82a89700 1 Processor -- start 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc82a89700 1 -- start start 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc82a89700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc7c0fca90 0x7fdc7c10d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc82a89700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fdca0 0x7fdc7c10d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc82a89700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c10de30 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc82a89700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c10dfa0 con 0x7fdc7c0fca90 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc7bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fdca0 0x7fdc7c10d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc7bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fdca0 0x7fdc7c10d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40848/0 (socket says 172.21.15.64:40848) 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc7bfff700 1 -- 172.21.15.64:0/1171258981 learned_addr learned my addr 172.21.15.64:0/1171258981 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc7bfff700 1 -- 172.21.15.64:0/1171258981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc7c0fca90 msgr2=0x7fdc7c10d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc7bfff700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc7c0fca90 0x7fdc7c10d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc7bfff700 1 -- 172.21.15.64:0/1171258981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70005040 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.990+0000 7fdc7bfff700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fdca0 0x7fdc7c10d830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c830 tx=0x7fdc68004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.991+0000 7fdc797fa700 1 -- 172.21.15.64:0/1171258981 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6800a760 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.991+0000 7fdc797fa700 1 -- 172.21.15.64:0/1171258981 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc6800ad70 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.991+0000 7fdc797fa700 1 -- 172.21.15.64:0/1171258981 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc680113a0 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.991+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c112a50 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.991+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c113010 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.991+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c105430 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.992+0000 7fdc797fa700 1 -- 172.21.15.64:0/1171258981 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdc68012400 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.992+0000 7fdc797fa700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fdc6c068f60 0x7fdc6c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.993+0000 7fdc797fa700 1 -- 172.21.15.64:0/1171258981 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fdc68086d40 con 0x7fdc7c0fdca0 2023-12-16T03:14:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.993+0000 7fdc80825700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fdc6c068f60 0x7fdc6c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.993+0000 7fdc80825700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fdc6c068f60 0x7fdc6c06b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000b3b0 tx=0x7fdc70009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:13.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:13.997+0000 7fdc797fa700 1 -- 172.21.15.64:0/1171258981 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdc68056d40 con 0x7fdc7c0fdca0 2023-12-16T03:14:14.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.190+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc7c1132f0 con 0x7fdc7c0fdca0 2023-12-16T03:14:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.190+0000 7fdc797fa700 1 -- 172.21.15.64:0/1171258981 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc680568d0 con 0x7fdc7c0fdca0 2023-12-16T03:14:14.192 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-12-16T03:14:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fdc6c068f60 msgr2=0x7fdc6c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fdc6c068f60 0x7fdc6c06b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000b3b0 tx=0x7fdc70009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fdca0 msgr2=0x7fdc7c10d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fdca0 0x7fdc7c10d830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c830 tx=0x7fdc68004470 comp rx=0 tx=0).stop 2023-12-16T03:14:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 shutdown_connections 2023-12-16T03:14:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fdc6c068f60 0x7fdc6c06b410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc7c0fca90 0x7fdc7c10d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 --2- 172.21.15.64:0/1171258981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc7c0fdca0 0x7fdc7c10d830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 >> 172.21.15.64:0/1171258981 conn(0x7fdc7c0f8150 msgr2=0x7fdc7c100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:14.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 shutdown_connections 2023-12-16T03:14:14.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.193+0000 7fdc82a89700 1 -- 172.21.15.64:0/1171258981 wait complete. 2023-12-16T03:14:14.206 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 -- 172.21.15.64:0/3885174064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80ffbf0 msgr2=0x7fb9b8102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 --2- 172.21.15.64:0/3885174064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80ffbf0 0x7fb9b8102050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4004940 tx=0x7fb9b4009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 -- 172.21.15.64:0/3885174064 shutdown_connections 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 --2- 172.21.15.64:0/3885174064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80ffbf0 0x7fb9b8102050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 --2- 172.21.15.64:0/3885174064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80658a0 0x7fb9b80ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 -- 172.21.15.64:0/3885174064 >> 172.21.15.64:0/3885174064 conn(0x7fb9b80f7010 msgr2=0x7fb9b80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 -- 172.21.15.64:0/3885174064 shutdown_connections 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 -- 172.21.15.64:0/3885174064 wait complete. 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 Processor -- start 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.329+0000 7fb9c03be700 1 -- start start 2023-12-16T03:14:14.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9c03be700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80658a0 0x7fb9b80fcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9c03be700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80ffbf0 0x7fb9b80fb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9c03be700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80fd4c0 con 0x7fb9b80658a0 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9c03be700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80fba90 con 0x7fb9b80ffbf0 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9be15a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80658a0 0x7fb9b80fcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9be15a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80658a0 0x7fb9b80fcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40872/0 (socket says 172.21.15.64:40872) 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9be15a700 1 -- 172.21.15.64:0/2985185579 learned_addr learned my addr 172.21.15.64:0/2985185579 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9bd959700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80ffbf0 0x7fb9b80fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9be15a700 1 -- 172.21.15.64:0/2985185579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80ffbf0 msgr2=0x7fb9b80fb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9be15a700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80ffbf0 0x7fb9b80fb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9be15a700 1 -- 172.21.15.64:0/2985185579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4005040 con 0x7fb9b80658a0 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9be15a700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80658a0 0x7fb9b80fcec0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac002a50 tx=0x7fb9ac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9aaffd700 1 -- 172.21.15.64:0/2985185579 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9ac007cc0 con 0x7fb9b80658a0 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b80fbd70 con 0x7fb9b80658a0 2023-12-16T03:14:14.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9aaffd700 1 -- 172.21.15.64:0/2985185579 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb9ac00f040 con 0x7fb9b80658a0 2023-12-16T03:14:14.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9aaffd700 1 -- 172.21.15.64:0/2985185579 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9ac009540 con 0x7fb9b80658a0 2023-12-16T03:14:14.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.330+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b80fc330 con 0x7fb9b80658a0 2023-12-16T03:14:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.331+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b8107440 con 0x7fb9b80658a0 2023-12-16T03:14:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.332+0000 7fb9aaffd700 1 -- 172.21.15.64:0/2985185579 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb9ac0096a0 con 0x7fb9b80658a0 2023-12-16T03:14:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.332+0000 7fb9aaffd700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb9a4068f60 0x7fb9a406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.332+0000 7fb9aaffd700 1 -- 172.21.15.64:0/2985185579 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb9ac086bd0 con 0x7fb9b80658a0 2023-12-16T03:14:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.332+0000 7fb9bd959700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb9a4068f60 0x7fb9a406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:14.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.333+0000 7fb9bd959700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb9a4068f60 0x7fb9a406b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400b3b0 tx=0x7fb9b4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:14.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.336+0000 7fb9aaffd700 1 -- 172.21.15.64:0/2985185579 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb9ac056ab0 con 0x7fb9b80658a0 2023-12-16T03:14:14.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.530+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fb9b802b320 con 0x7fb9b80658a0 2023-12-16T03:14:14.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.530+0000 7fb9aaffd700 1 -- 172.21.15.64:0/2985185579 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb9ac056640 con 0x7fb9b80658a0 2023-12-16T03:14:14.532 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-12-16T03:14:14.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb9a4068f60 msgr2=0x7fb9a406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb9a4068f60 0x7fb9a406b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400b3b0 tx=0x7fb9b4009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80658a0 msgr2=0x7fb9b80fcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80658a0 0x7fb9b80fcec0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac002a50 tx=0x7fb9ac0046b0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 shutdown_connections 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb9a4068f60 0x7fb9a406b410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80658a0 0x7fb9b80fcec0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 --2- 172.21.15.64:0/2985185579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80ffbf0 0x7fb9b80fb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 >> 172.21.15.64:0/2985185579 conn(0x7fb9b80f7010 msgr2=0x7fb9b80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 shutdown_connections 2023-12-16T03:14:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.533+0000 7fb9c03be700 1 -- 172.21.15.64:0/2985185579 wait complete. 2023-12-16T03:14:14.546 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T03:14:14.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 -- 172.21.15.64:0/1163246157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fb990 msgr2=0x7fccf00fbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 --2- 172.21.15.64:0/1163246157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fb990 0x7fccf00fbda0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fccec004940 tx=0x7fccec009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:14.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 -- 172.21.15.64:0/1163246157 shutdown_connections 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 --2- 172.21.15.64:0/1163246157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccf00fcba0 0x7fccf00fcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 --2- 172.21.15.64:0/1163246157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fb990 0x7fccf00fbda0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 -- 172.21.15.64:0/1163246157 >> 172.21.15.64:0/1163246157 conn(0x7fccf00f7030 msgr2=0x7fccf00f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 -- 172.21.15.64:0/1163246157 shutdown_connections 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 -- 172.21.15.64:0/1163246157 wait complete. 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 Processor -- start 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 -- start start 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccf00fb990 0x7fccf010d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fcba0 0x7fccf010d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf010dd90 con 0x7fccf00fcba0 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf75a9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf010df00 con 0x7fccf00fb990 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf4b44700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fcba0 0x7fccf010d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:14.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.670+0000 7fccf4b44700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fcba0 0x7fccf010d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40888/0 (socket says 172.21.15.64:40888) 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fccf4b44700 1 -- 172.21.15.64:0/641258046 learned_addr learned my addr 172.21.15.64:0/641258046 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fccf4b44700 1 -- 172.21.15.64:0/641258046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccf00fb990 msgr2=0x7fccf010d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fccf4b44700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccf00fb990 0x7fccf010d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fccf4b44700 1 -- 172.21.15.64:0/641258046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec005040 con 0x7fccf00fcba0 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fccf4b44700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fcba0 0x7fccf010d790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcce0002a80 tx=0x7fcce00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fcce5ffb700 1 -- 172.21.15.64:0/641258046 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce0007cc0 con 0x7fccf00fcba0 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fcce5ffb700 1 -- 172.21.15.64:0/641258046 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcce000f040 con 0x7fccf00fcba0 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf01129b0 con 0x7fccf00fcba0 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fcce5ffb700 1 -- 172.21.15.64:0/641258046 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce0009640 con 0x7fccf00fcba0 2023-12-16T03:14:14.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.671+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf0112f70 con 0x7fccf00fcba0 2023-12-16T03:14:14.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.672+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf0104330 con 0x7fccf00fcba0 2023-12-16T03:14:14.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.672+0000 7fcce5ffb700 1 -- 172.21.15.64:0/641258046 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcce00097a0 con 0x7fccf00fcba0 2023-12-16T03:14:14.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.673+0000 7fcce5ffb700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fccdc068f70 0x7fccdc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:14.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.673+0000 7fcce5ffb700 1 -- 172.21.15.64:0/641258046 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcce00864a0 con 0x7fccf00fcba0 2023-12-16T03:14:14.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.673+0000 7fccf5345700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fccdc068f70 0x7fccdc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:14.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.673+0000 7fccf5345700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fccdc068f70 0x7fccdc06b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fccec000c00 tx=0x7fccec009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:14.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.677+0000 7fcce5ffb700 1 -- 172.21.15.64:0/641258046 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcce0056400 con 0x7fccf00fcba0 2023-12-16T03:14:14.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:14.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:14.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:14:14.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:14:14.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:14 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:14.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:14 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3470267132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:14:14.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:14 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1171258981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T03:14:14.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:14 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2985185579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T03:14:14.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.871+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fccf0113220 con 0x7fccf00fcba0 2023-12-16T03:14:14.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.871+0000 7fcce5ffb700 1 -- 172.21.15.64:0/641258046 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcce0055f90 con 0x7fccf00fcba0 2023-12-16T03:14:14.873 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-12-16T03:14:14.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fccdc068f70 msgr2=0x7fccdc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fccdc068f70 0x7fccdc06b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fccec000c00 tx=0x7fccec009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:14.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fcba0 msgr2=0x7fccf010d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:14.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fcba0 0x7fccf010d790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcce0002a80 tx=0x7fcce00046b0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 shutdown_connections 2023-12-16T03:14:14.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fccdc068f70 0x7fccdc06b420 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccf00fb990 0x7fccf010d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 --2- 172.21.15.64:0/641258046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccf00fcba0 0x7fccf010d790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:14.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 >> 172.21.15.64:0/641258046 conn(0x7fccf00f7030 msgr2=0x7fccf00658b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:14.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 shutdown_connections 2023-12-16T03:14:14.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:14.873+0000 7fccf75a9700 1 -- 172.21.15.64:0/641258046 wait complete. 2023-12-16T03:14:14.885 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:14.885 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:14.886 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:14:14.886 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:14:14.886 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:14 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:14.886 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:14 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3470267132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:14:14.886 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:14 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1171258981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T03:14:14.886 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:14 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2985185579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T03:14:14.887 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:14:15.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 -- 172.21.15.64:0/3604272442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 msgr2=0x7f85940ff6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:15.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 --2- 172.21.15.64:0/3604272442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 0x7f85940ff6c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8590004940 tx=0x7f8590009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 -- 172.21.15.64:0/3604272442 shutdown_connections 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 --2- 172.21.15.64:0/3604272442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85940ffc90 0x7f85941020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 --2- 172.21.15.64:0/3604272442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 0x7f85940ff6c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 -- 172.21.15.64:0/3604272442 >> 172.21.15.64:0/3604272442 conn(0x7f85940f7070 msgr2=0x7f85940f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 -- 172.21.15.64:0/3604272442 shutdown_connections 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 -- 172.21.15.64:0/3604272442 wait complete. 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 Processor -- start 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.007+0000 7f859b2c2700 1 -- start start 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859b2c2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 0x7f85940fcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859b2c2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85940ffc90 0x7f85940fb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859b2c2700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940fd560 con 0x7f8594065880 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859b2c2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940fbb30 con 0x7f85940ffc90 2023-12-16T03:14:15.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859905e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 0x7f85940fcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859905e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 0x7f85940fcf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40914/0 (socket says 172.21.15.64:40914) 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859905e700 1 -- 172.21.15.64:0/3182590914 learned_addr learned my addr 172.21.15.64:0/3182590914 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859885d700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85940ffc90 0x7f85940fb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859905e700 1 -- 172.21.15.64:0/3182590914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85940ffc90 msgr2=0x7f85940fb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859905e700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85940ffc90 0x7f85940fb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859905e700 1 -- 172.21.15.64:0/3182590914 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590005040 con 0x7f8594065880 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859885d700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85940ffc90 0x7f85940fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859905e700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 0x7f85940fcf60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8590000c00 tx=0x7f8590009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f8589ffb700 1 -- 172.21.15.64:0/3182590914 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8590021070 con 0x7f8594065880 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f8589ffb700 1 -- 172.21.15.64:0/3182590914 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f859001c400 con 0x7f8594065880 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85940fbdb0 con 0x7f8594065880 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.008+0000 7f8589ffb700 1 -- 172.21.15.64:0/3182590914 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859000e070 con 0x7f8594065880 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.009+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85940fc310 con 0x7f8594065880 2023-12-16T03:14:15.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.009+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8594107420 con 0x7f8594065880 2023-12-16T03:14:15.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.010+0000 7f8589ffb700 1 -- 172.21.15.64:0/3182590914 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f859001c570 con 0x7f8594065880 2023-12-16T03:14:15.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.010+0000 7f8589ffb700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8580068f60 0x7f858006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:15.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.011+0000 7f8589ffb700 1 -- 172.21.15.64:0/3182590914 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8590088130 con 0x7f8594065880 2023-12-16T03:14:15.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.011+0000 7f859885d700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8580068f60 0x7f858006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:15.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.011+0000 7f859885d700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8580068f60 0x7f858006b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8584004600 tx=0x7f858400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:15.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.015+0000 7f8589ffb700 1 -- 172.21.15.64:0/3182590914 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8590057ff0 con 0x7f8594065880 2023-12-16T03:14:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.255+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85941054b0 con 0x7f8594065880 2023-12-16T03:14:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.255+0000 7f8589ffb700 1 -- 172.21.15.64:0/3182590914 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4704 (secure 0 0 0) 0x7f8590057b80 con 0x7f8594065880 2023-12-16T03:14:15.256 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:14:15.257 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi064.edrjyd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6829/1065201064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1065201064},{"type":"v1","addr":"172.21.15.64:6829","nonce":1065201064}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24279,"name":"cephfs.smithi184.uqpwjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.184:6827/2576924937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":2576924937},{"type":"v1","addr":"172.21.15.184:6827","nonce":2576924937}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:13:53.443533+0000","modified":"2023-12-16T03:14:05.488963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14460,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14460":{"gid":14460,"name":"cephfs.smithi064.jaepzs","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6827/3506550972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":3506550972},{"type":"v1","addr":"172.21.15.64:6827","nonce":3506550972}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi184.jfpiqk","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6825/885772583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":885772583},{"type":"v1","addr":"172.21.15.184:6825","nonce":885772583}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-16T03:14:15.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8580068f60 msgr2=0x7f858006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:15.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8580068f60 0x7f858006b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8584004600 tx=0x7f858400b040 comp rx=0 tx=0).stop 2023-12-16T03:14:15.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 msgr2=0x7f85940fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:15.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 0x7f85940fcf60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8590000c00 tx=0x7f8590009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:15.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 shutdown_connections 2023-12-16T03:14:15.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8580068f60 0x7f858006b410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:15.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8594065880 0x7f85940fcf60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:15.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 --2- 172.21.15.64:0/3182590914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85940ffc90 0x7f85940fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:15.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 >> 172.21.15.64:0/3182590914 conn(0x7f85940f7070 msgr2=0x7f85940f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:15.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 shutdown_connections 2023-12-16T03:14:15.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:15.257+0000 7f859b2c2700 1 -- 172.21.15.64:0/3182590914 wait complete. 2023-12-16T03:14:15.259 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 13 2023-12-16T03:14:15.270 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 2, 'flags': 18} 2023-12-16T03:14:15.270 INFO:teuthology.run_tasks:Running task kclient... 2023-12-16T03:14:15.301 INFO:tasks.kclient:Mounting kernel clients... 2023-12-16T03:14:15.302 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-16T03:14:15.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:15.302 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-12-16T03:14:15.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:15.321 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2023-12-16T03:14:15.391 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2023-12-16T03:14:15.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:14:15.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:15.392 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-12-16T03:14:15.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:15.416 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-12-16T03:14:15.498 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-12-16T03:14:15.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:14:15.500 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-16T03:14:15.500 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T03:14:15.500 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:14:15.500 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-16T03:14:15.772 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:15.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:15 smithi184 ceph-mon[121180]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 3 op/s 2023-12-16T03:14:15.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:15 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/641258046' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T03:14:15.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:15 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3182590914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T03:14:15.901 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:15 smithi064 ceph-mon[111958]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 3 op/s 2023-12-16T03:14:15.901 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:15 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/641258046' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T03:14:15.901 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:15 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3182590914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.821+0000 7f4d76828700 1 -- 172.21.15.64:0/2163348133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 msgr2=0x7f4d70102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.821+0000 7f4d76828700 1 --2- 172.21.15.64:0/2163348133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 0x7f4d70102ff0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4d60004940 tx=0x7f4d60009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.821+0000 7f4d76828700 1 -- 172.21.15.64:0/2163348133 shutdown_connections 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.821+0000 7f4d76828700 1 --2- 172.21.15.64:0/2163348133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d70065390 0x7f4d70065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.821+0000 7f4d76828700 1 --2- 172.21.15.64:0/2163348133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 0x7f4d70102ff0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.821+0000 7f4d76828700 1 -- 172.21.15.64:0/2163348133 >> 172.21.15.64:0/2163348133 conn(0x7f4d700719b0 msgr2=0x7f4d70071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.821+0000 7f4d76828700 1 -- 172.21.15.64:0/2163348133 shutdown_connections 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.821+0000 7f4d76828700 1 -- 172.21.15.64:0/2163348133 wait complete. 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d76828700 1 Processor -- start 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d76828700 1 -- start start 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d76828700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d70065390 0x7f4d70113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d76828700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 0x7f4d70113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d76828700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70114220 con 0x7f4d70102c20 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d76828700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7010d570 con 0x7f4d70065390 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 0x7f4d70113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 0x7f4d70113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40938/0 (socket says 172.21.15.64:40938) 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d6f7fe700 1 -- 172.21.15.64:0/1168828010 learned_addr learned my addr 172.21.15.64:0/1168828010 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d6ffff700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d70065390 0x7f4d70113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d6f7fe700 1 -- 172.21.15.64:0/1168828010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d70065390 msgr2=0x7f4d70113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d6f7fe700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d70065390 0x7f4d70113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.822+0000 7f4d6f7fe700 1 -- 172.21.15.64:0/1168828010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60005040 con 0x7f4d70102c20 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.823+0000 7f4d6f7fe700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 0x7f4d70113bd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800c830 tx=0x7f4d58004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.823+0000 7f4d6cff9700 1 -- 172.21.15.64:0/1168828010 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d580106f0 con 0x7f4d70102c20 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.823+0000 7f4d6cff9700 1 -- 172.21.15.64:0/1168828010 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d58010d00 con 0x7f4d70102c20 2023-12-16T03:14:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.823+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7010d850 con 0x7f4d70102c20 2023-12-16T03:14:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.823+0000 7f4d6cff9700 1 -- 172.21.15.64:0/1168828010 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d58012e90 con 0x7f4d70102c20 2023-12-16T03:14:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.823+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7010dd90 con 0x7f4d70102c20 2023-12-16T03:14:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.824+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d700fff40 con 0x7f4d70102c20 2023-12-16T03:14:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.824+0000 7f4d6cff9700 1 -- 172.21.15.64:0/1168828010 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4d58010850 con 0x7f4d70102c20 2023-12-16T03:14:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.825+0000 7f4d6cff9700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4d5c068f60 0x7f4d5c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.825+0000 7f4d6cff9700 1 -- 172.21.15.64:0/1168828010 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4d58086d60 con 0x7f4d70102c20 2023-12-16T03:14:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.825+0000 7f4d6ffff700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4d5c068f60 0x7f4d5c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.825+0000 7f4d6ffff700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4d5c068f60 0x7f4d5c06b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d60004f90 tx=0x7f4d60009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:16.829+0000 7f4d6cff9700 1 -- 172.21.15.64:0/1168828010 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4d58056cc0 con 0x7f4d70102c20 2023-12-16T03:14:17.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.070+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d7004bb80 con 0x7f4d70102c20 2023-12-16T03:14:17.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.071+0000 7f4d6cff9700 1 -- 172.21.15.64:0/1168828010 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f4d58056850 con 0x7f4d70102c20 2023-12-16T03:14:17.073 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-16T03:14:17.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4d5c068f60 msgr2=0x7f4d5c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:17.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4d5c068f60 0x7f4d5c06b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d60004f90 tx=0x7f4d60009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:17.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 msgr2=0x7f4d70113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:17.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 0x7f4d70113bd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800c830 tx=0x7f4d58004470 comp rx=0 tx=0).stop 2023-12-16T03:14:17.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 shutdown_connections 2023-12-16T03:14:17.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4d5c068f60 0x7f4d5c06b410 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:17.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d70065390 0x7f4d70113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:17.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 --2- 172.21.15.64:0/1168828010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d70102c20 0x7f4d70113bd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:17.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 >> 172.21.15.64:0/1168828010 conn(0x7f4d700719b0 msgr2=0x7f4d700fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:17.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 shutdown_connections 2023-12-16T03:14:17.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:17.073+0000 7f4d76828700 1 -- 172.21.15.64:0/1168828010 wait complete. 2023-12-16T03:14:17.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:17 smithi064 ceph-mon[111958]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-16T03:14:17.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:17 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1168828010' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T03:14:17.458 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T03:14:17.458 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:14:17.458 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2023-12-16T03:14:17.459 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T03:14:17.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:14:17.459 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T03:14:17.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T03:14:17.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:14:17.459 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:14:17.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:17.459 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:14:17.479 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2023-12-16T03:14:17.480 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T03:14:17.480 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2023-12-16T03:14:17.480 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:14:17.480 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2023-12-16T03:14:17.480 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T03:14:17.480 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42130sec preferred_lft 42130sec 2023-12-16T03:14:17.480 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2023-12-16T03:14:17.480 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:14:17.480 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T03:14:17.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:17.481 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-12-16T03:14:17.481 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-12-16T03:14:17.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add name ceph-brx type bridge 2023-12-16T03:14:17.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr flush dev ceph-brx 2023-12-16T03:14:17.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set ceph-brx up 2023-12-16T03:14:17.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T03:14:17.481 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-12-16T03:14:17.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:17 smithi184 ceph-mon[121180]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-16T03:14:17.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:17 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1168828010' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T03:14:17.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:17.648 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:14:17.678 INFO:teuthology.orchestra.run.smithi064.stdout:1 2023-12-16T03:14:17.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:17.679 DEBUG:teuthology.orchestra.run.smithi064:> route 2023-12-16T03:14:17.755 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2023-12-16T03:14:17.755 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:14:17.755 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:14:17.756 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:14:17.756 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:14:17.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:17.757 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-12-16T03:14:17.757 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-12-16T03:14:17.757 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:14:17.757 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:14:17.757 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:14:17.758 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-12-16T03:14:18.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:18.042 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-12-16T03:14:18.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:18.062 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2023-12-16T03:14:18.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:18.121 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-12-16T03:14:18.121 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-12-16T03:14:18.121 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:14:18.121 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-16T03:14:18.121 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-12-16T03:14:18.217 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-16T03:14:18.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:18.218 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-12-16T03:14:18.218 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-12-16T03:14:18.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-16T03:14:18.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T03:14:18.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-16T03:14:18.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-16T03:14:18.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-16T03:14:18.218 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-12-16T03:14:18.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:18.427 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-12-16T03:14:18.427 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-12-16T03:14:18.427 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2023-12-16T03:14:18.427 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T03:14:18.427 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-12-16T03:14:18.467 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:18 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:18.467 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:18 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:14:18.526 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:14:18.526 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T03:14:18.585 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:14:18.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:14:18.585 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:14:18.643 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-16T03:14:18.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:18.643 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T03:14:18.743 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T03:14:18.743 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T03:14:18.743 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2023-12-16T03:14:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:18 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:14:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:18 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:14:18.820 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T03:14:18.820 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T03:14:18.820 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2023-12-16T03:14:18.821 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.184:3300" 2023-12-16T03:14:18.821 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T03:14:18.839 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T03:14:18.839 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T03:14:18.839 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2023-12-16T03:14:18.839 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.184:3300" 2023-12-16T03:14:18.839 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T03:14:18.839 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.64:6789,172.21.15.184:6789" 2023-12-16T03:14:18.839 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.64:6789,172.21.15.184:6789:/ 2023-12-16T03:14:18.839 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5b4de048-9bc0-11ee-95a5-87774f69a715" will pass to kernel 2023-12-16T03:14:18.842 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:14:18.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:18.842 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:14:18.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:18.872 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:14:18.956 INFO:teuthology.orchestra.run.smithi064.stdout:client14518 2023-12-16T03:14:18.957 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:14:18.957 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:14:19.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:19.019 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:14:19.103 INFO:teuthology.orchestra.run.smithi064.stdout:client14518 2023-12-16T03:14:19.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:19.104 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:14:19.152 INFO:teuthology.orchestra.run.smithi064.stdout:client14518 2023-12-16T03:14:19.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:19.153 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715.client14518/status') 2023-12-16T03:14:19.206 INFO:teuthology.orchestra.run.smithi064.stdout:instance: client.14518 (3)192.168.0.1:0/3723997757 2023-12-16T03:14:19.206 INFO:teuthology.orchestra.run.smithi064.stdout:blocklisted: false 2023-12-16T03:14:19.207 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records in 2023-12-16T03:14:19.207 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records out 2023-12-16T03:14:19.207 INFO:teuthology.orchestra.run.smithi064.stderr:70 bytes copied, 2.5719e-05 s, 2.7 MB/s 2023-12-16T03:14:19.208 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-16T03:14:19.208 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T03:14:19.208 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:14:19.208 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-16T03:14:19.480 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:19.610 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:19 smithi064 ceph-mon[111958]: pgmap v144: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-16T03:14:19.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:19 smithi184 ceph-mon[121180]: pgmap v144: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-16T03:14:20.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.628+0000 7fc675250700 1 -- 172.21.15.64:0/3987580316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 msgr2=0x7fc6700fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:20.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.628+0000 7fc675250700 1 --2- 172.21.15.64:0/3987580316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 0x7fc6700fbfb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc664004940 tx=0x7fc664009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:20.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.628+0000 7fc675250700 1 -- 172.21.15.64:0/3987580316 shutdown_connections 2023-12-16T03:14:20.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.628+0000 7fc675250700 1 --2- 172.21.15.64:0/3987580316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 0x7fc6700fbfb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:20.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.628+0000 7fc675250700 1 --2- 172.21.15.64:0/3987580316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc670101b00 0x7fc670101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:20.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.628+0000 7fc675250700 1 -- 172.21.15.64:0/3987580316 >> 172.21.15.64:0/3987580316 conn(0x7fc6700719b0 msgr2=0x7fc670071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:20.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.628+0000 7fc675250700 1 -- 172.21.15.64:0/3987580316 shutdown_connections 2023-12-16T03:14:20.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.628+0000 7fc675250700 1 -- 172.21.15.64:0/3987580316 wait complete. 2023-12-16T03:14:20.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc675250700 1 Processor -- start 2023-12-16T03:14:20.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc675250700 1 -- start start 2023-12-16T03:14:20.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc675250700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 0x7fc67010e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:20.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc675250700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc670101b00 0x7fc67010ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:20.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc675250700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67010f290 con 0x7fc6700fbb40 2023-12-16T03:14:20.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc675250700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67010f400 con 0x7fc670101b00 2023-12-16T03:14:20.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc66ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 0x7fc67010e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:20.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc66ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 0x7fc67010e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40962/0 (socket says 172.21.15.64:40962) 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc66ed9d700 1 -- 172.21.15.64:0/1919204394 learned_addr learned my addr 172.21.15.64:0/1919204394 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc66e59c700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc670101b00 0x7fc67010ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc66ed9d700 1 -- 172.21.15.64:0/1919204394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc670101b00 msgr2=0x7fc67010ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc66ed9d700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc670101b00 0x7fc67010ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc66ed9d700 1 -- 172.21.15.64:0/1919204394 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664005040 con 0x7fc6700fbb40 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.629+0000 7fc66e59c700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc670101b00 0x7fc67010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.630+0000 7fc66ed9d700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 0x7fc67010e7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc660002a50 tx=0x7fc6600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.630+0000 7fc6577fe700 1 -- 172.21.15.64:0/1919204394 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc660007cc0 con 0x7fc6700fbb40 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.630+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc670117770 con 0x7fc6700fbb40 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.630+0000 7fc6577fe700 1 -- 172.21.15.64:0/1919204394 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc66000f040 con 0x7fc6700fbb40 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.630+0000 7fc6577fe700 1 -- 172.21.15.64:0/1919204394 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc660009540 con 0x7fc6700fbb40 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.630+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc670117c80 con 0x7fc6700fbb40 2023-12-16T03:14:20.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.631+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc670103fb0 con 0x7fc6700fbb40 2023-12-16T03:14:20.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.631+0000 7fc6577fe700 1 -- 172.21.15.64:0/1919204394 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc6600096a0 con 0x7fc6700fbb40 2023-12-16T03:14:20.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.632+0000 7fc6577fe700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fc658068f60 0x7fc65806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:20.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.632+0000 7fc6577fe700 1 -- 172.21.15.64:0/1919204394 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc660086bd0 con 0x7fc6700fbb40 2023-12-16T03:14:20.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.632+0000 7fc66e59c700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fc658068f60 0x7fc65806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:20.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.632+0000 7fc66e59c700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fc658068f60 0x7fc65806b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc664000c00 tx=0x7fc664009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:20.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.636+0000 7fc6577fe700 1 -- 172.21.15.64:0/1919204394 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc660053020 con 0x7fc6700fbb40 2023-12-16T03:14:20.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.877+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc670065b70 con 0x7fc6700fbb40 2023-12-16T03:14:20.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.877+0000 7fc6577fe700 1 -- 172.21.15.64:0/1919204394 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7fc660056640 con 0x7fc6700fbb40 2023-12-16T03:14:20.880 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.879+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fc658068f60 msgr2=0x7fc65806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.879+0000 7fc675250700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fc658068f60 0x7fc65806b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc664000c00 tx=0x7fc664009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.880+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 msgr2=0x7fc67010e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.880+0000 7fc675250700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 0x7fc67010e7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc660002a50 tx=0x7fc6600046b0 comp rx=0 tx=0).stop 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.880+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 shutdown_connections 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.880+0000 7fc675250700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fc658068f60 0x7fc65806b410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.880+0000 7fc675250700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6700fbb40 0x7fc67010e7a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.880+0000 7fc675250700 1 --2- 172.21.15.64:0/1919204394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc670101b00 0x7fc67010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.880+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 >> 172.21.15.64:0/1919204394 conn(0x7fc6700719b0 msgr2=0x7fc6700fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:20.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.880+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 shutdown_connections 2023-12-16T03:14:20.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:20.880+0000 7fc675250700 1 -- 172.21.15.64:0/1919204394 wait complete. 2023-12-16T03:14:21.326 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T03:14:21.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:14:21.326 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-12-16T03:14:21.326 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T03:14:21.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:14:21.326 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T03:14:21.327 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T03:14:21.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:14:21.327 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:14:21.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:21.327 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-12-16T03:14:21.350 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:14:21.350 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:14:21.350 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:14:21.350 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:14:21.350 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-12-16T03:14:21.350 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:14:21.350 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T03:14:21.350 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42119sec preferred_lft 42119sec 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-12-16T03:14:21.351 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:14:21.352 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T03:14:21.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:21.352 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-12-16T03:14:21.352 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-12-16T03:14:21.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2023-12-16T03:14:21.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2023-12-16T03:14:21.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2023-12-16T03:14:21.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T03:14:21.352 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-12-16T03:14:21.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:21.531 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:14:21.559 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-12-16T03:14:21.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:21.560 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-12-16T03:14:21.645 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-12-16T03:14:21.646 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:14:21.646 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:14:21.646 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:14:21.646 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:14:21.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:21.646 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-12-16T03:14:21.646 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-12-16T03:14:21.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:14:21.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:14:21.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:14:21.647 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-12-16T03:14:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:21 smithi064 ceph-mon[111958]: pgmap v145: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:21 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1919204394' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T03:14:21.726 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:21 smithi184 ceph-mon[121180]: pgmap v145: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:21.726 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:21 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1919204394' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T03:14:21.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:21.980 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-12-16T03:14:22.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:22.038 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-12-16T03:14:22.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:22.096 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-12-16T03:14:22.096 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-12-16T03:14:22.096 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:14:22.096 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-16T03:14:22.096 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-12-16T03:14:22.191 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-16T03:14:22.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:22.191 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-12-16T03:14:22.191 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-12-16T03:14:22.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-16T03:14:22.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T03:14:22.192 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-16T03:14:22.192 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-16T03:14:22.192 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-16T03:14:22.192 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-12-16T03:14:22.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:22.405 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-12-16T03:14:22.405 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-12-16T03:14:22.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-12-16T03:14:22.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T03:14:22.406 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-12-16T03:14:22.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:14:22.502 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T03:14:22.519 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:14:22.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:14:22.520 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:14:22.578 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-16T03:14:22.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:22.578 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T03:14:22.672 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T03:14:22.673 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T03:14:22.673 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-12-16T03:14:22.756 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T03:14:22.756 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T03:14:22.756 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-12-16T03:14:22.756 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.184:3300" 2023-12-16T03:14:22.756 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T03:14:22.774 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T03:14:22.774 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T03:14:22.775 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-12-16T03:14:22.775 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.64:3300,172.21.15.184:3300" 2023-12-16T03:14:22.775 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T03:14:22.775 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.64:6789,172.21.15.184:6789" 2023-12-16T03:14:22.775 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.64:6789,172.21.15.184:6789:/ 2023-12-16T03:14:22.775 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5b4de048-9bc0-11ee-95a5-87774f69a715" will pass to kernel 2023-12-16T03:14:22.777 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:14:22.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:22.777 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:14:22.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:22.805 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:14:22.878 INFO:teuthology.orchestra.run.smithi184.stdout:client14524 2023-12-16T03:14:22.878 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:14:22.878 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:14:22.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:22.939 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:14:23.011 INFO:teuthology.orchestra.run.smithi184.stdout:client14524 2023-12-16T03:14:23.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:23.012 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:14:23.085 INFO:teuthology.orchestra.run.smithi184.stdout:client14524 2023-12-16T03:14:23.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:14:23.085 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715.client14524/status') 2023-12-16T03:14:23.165 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.14524 (3)172.21.15.184:0/2007514637 2023-12-16T03:14:23.166 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-12-16T03:14:23.166 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-12-16T03:14:23.166 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-12-16T03:14:23.166 INFO:teuthology.orchestra.run.smithi184.stderr:72 bytes copied, 2.1423e-05 s, 3.4 MB/s 2023-12-16T03:14:23.167 INFO:teuthology.run_tasks:Running task print... 2023-12-16T03:14:23.206 INFO:teuthology.task.print:**** done client 2023-12-16T03:14:23.206 INFO:teuthology.run_tasks:Running task parallel... 2023-12-16T03:14:23.216 INFO:teuthology.task.parallel:starting parallel... 2023-12-16T03:14:23.217 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-16T03:14:23.217 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T03:14:23.217 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:14:23.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-16T03:14:23.218 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-16T03:14:23.218 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-16T03:14:23.222 INFO:tasks.workunit:Pulling workunits from ref 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:14:23.222 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-16T03:14:23.222 INFO:tasks.workunit:timeout=3h 2023-12-16T03:14:23.222 INFO:tasks.workunit:cleanup=True 2023-12-16T03:14:23.222 DEBUG:teuthology.orchestra.run.smithi064:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-16T03:14:23.248 INFO:teuthology.orchestra.run.smithi064.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-16T03:14:23.248 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-16T03:14:23.248 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 99h/153d Inode: 1 Links: 2 2023-12-16T03:14:23.248 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:14:23.248 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-16T03:14:23.248 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T03:14:23.249 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-12-16 03:13:57.476534733 +0000 2023-12-16T03:14:23.249 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-12-16 03:14:18.866963670 +0000 2023-12-16T03:14:23.249 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2023-12-16 03:13:57.476534733 +0000 2023-12-16T03:14:23.249 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-16T03:14:23.249 DEBUG:teuthology.orchestra.run.smithi064:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-16T03:14:23.325 DEBUG:teuthology.orchestra.run.smithi184:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-16T03:14:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-16T03:14:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-16T03:14:23.344 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 78h/120d Inode: 1 Links: 3 2023-12-16T03:14:23.345 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:14:23.345 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-16T03:14:23.345 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T03:14:23.345 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-12-16 03:14:23.317876687 +0000 2023-12-16T03:14:23.345 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-12-16 03:14:23.317876687 +0000 2023-12-16T03:14:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2023-12-16 03:13:57.476534733 +0000 2023-12-16T03:14:23.345 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-16T03:14:23.346 DEBUG:teuthology.orchestra.run.smithi184:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-16T03:14:23.417 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:23 smithi184 ceph-mon[121180]: pgmap v146: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-16T03:14:23.419 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:14:23.419 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:14:23.438 INFO:tasks.workunit.client.0.smithi064.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-16T03:14:23.477 INFO:tasks.workunit.client.1.smithi184.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-16T03:14:23.516 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:23.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:23 smithi064 ceph-mon[111958]: pgmap v146: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-16T03:14:24.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 -- 172.21.15.64:0/1539433557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 msgr2=0x7f46f00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:24.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 --2- 172.21.15.64:0/1539433557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 0x7f46f00fd150 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f46dc004940 tx=0x7f46dc009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:24.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 -- 172.21.15.64:0/1539433557 shutdown_connections 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 --2- 172.21.15.64:0/1539433557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 0x7f46f00fd150 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 --2- 172.21.15.64:0/1539433557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46f00fbaf0 0x7f46f00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 -- 172.21.15.64:0/1539433557 >> 172.21.15.64:0/1539433557 conn(0x7f46f00f7190 msgr2=0x7f46f00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 -- 172.21.15.64:0/1539433557 shutdown_connections 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 -- 172.21.15.64:0/1539433557 wait complete. 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 Processor -- start 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.702+0000 7f46f6d65700 1 -- start start 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46f6d65700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46f00fbaf0 0x7f46f01125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46f6d65700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 0x7f46f0114b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46f6d65700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0066000 con 0x7f46f00fcd00 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46f6d65700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0066140 con 0x7f46f00fbaf0 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46effff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 0x7f46f0114b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46effff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 0x7f46f0114b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49270/0 (socket says 172.21.15.64:49270) 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46effff700 1 -- 172.21.15.64:0/2746154478 learned_addr learned my addr 172.21.15.64:0/2746154478 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:24.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46f4b01700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46f00fbaf0 0x7f46f01125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:24.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46effff700 1 -- 172.21.15.64:0/2746154478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46f00fbaf0 msgr2=0x7f46f01125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:24.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46effff700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46f00fbaf0 0x7f46f01125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:24.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46effff700 1 -- 172.21.15.64:0/2746154478 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc005040 con 0x7f46f00fcd00 2023-12-16T03:14:24.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46effff700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 0x7f46f0114b40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00b3b0 tx=0x7f46dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:24.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.703+0000 7f46ed7fa700 1 -- 172.21.15.64:0/2746154478 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46dc00e040 con 0x7f46f00fcd00 2023-12-16T03:14:24.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.704+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f0115080 con 0x7f46f00fcd00 2023-12-16T03:14:24.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.704+0000 7f46ed7fa700 1 -- 172.21.15.64:0/2746154478 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f46dc00bc50 con 0x7f46f00fcd00 2023-12-16T03:14:24.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.704+0000 7f46ed7fa700 1 -- 172.21.15.64:0/2746154478 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46dc01c630 con 0x7f46f00fcd00 2023-12-16T03:14:24.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.704+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f0115420 con 0x7f46f00fcd00 2023-12-16T03:14:24.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.705+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f004bb80 con 0x7f46f00fcd00 2023-12-16T03:14:24.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.705+0000 7f46ed7fa700 1 -- 172.21.15.64:0/2746154478 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f46dc013420 con 0x7f46f00fcd00 2023-12-16T03:14:24.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.706+0000 7f46ed7fa700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46e0068f70 0x7f46e006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:24.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.706+0000 7f46ed7fa700 1 -- 172.21.15.64:0/2746154478 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f46dc088250 con 0x7f46f00fcd00 2023-12-16T03:14:24.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.706+0000 7f46f4b01700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46e0068f70 0x7f46e006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:24.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.706+0000 7f46f4b01700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46e0068f70 0x7f46e006b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46f0065d90 tx=0x7f46e400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:24.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.710+0000 7f46ed7fa700 1 -- 172.21.15.64:0/2746154478 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f46dc054680 con 0x7f46f00fcd00 2023-12-16T03:14:24.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.904+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f46f01155b0 con 0x7f46f00fcd00 2023-12-16T03:14:24.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.905+0000 7f46ed7fa700 1 -- 172.21.15.64:0/2746154478 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f46dc057ca0 con 0x7f46f00fcd00 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.906+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46e0068f70 msgr2=0x7f46e006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.906+0000 7f46f6d65700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46e0068f70 0x7f46e006b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46f0065d90 tx=0x7f46e400b040 comp rx=0 tx=0).stop 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.906+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 msgr2=0x7f46f0114b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.906+0000 7f46f6d65700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 0x7f46f0114b40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00b3b0 tx=0x7f46dc009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.907+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 shutdown_connections 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.907+0000 7f46f6d65700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46e0068f70 0x7f46e006b420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.907+0000 7f46f6d65700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46f00fbaf0 0x7f46f01125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.907+0000 7f46f6d65700 1 --2- 172.21.15.64:0/2746154478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46f00fcd00 0x7f46f0114b40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.907+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 >> 172.21.15.64:0/2746154478 conn(0x7f46f00f7190 msgr2=0x7f46f00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:24.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.907+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 shutdown_connections 2023-12-16T03:14:24.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:24.907+0000 7f46f6d65700 1 -- 172.21.15.64:0/2746154478 wait complete. 2023-12-16T03:14:25.308 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-16T03:14:25.627 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:25.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:25 smithi064 ceph-mon[111958]: pgmap v147: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:14:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:25 smithi184 ceph-mon[121180]: pgmap v147: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:14:27.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.246+0000 7f739386b700 1 -- 172.21.15.64:0/1142223757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 msgr2=0x7f738c0fd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:27.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.246+0000 7f739386b700 1 --2- 172.21.15.64:0/1142223757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 0x7f738c0fd4b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7388004940 tx=0x7f7388009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:27.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.246+0000 7f739386b700 1 -- 172.21.15.64:0/1142223757 shutdown_connections 2023-12-16T03:14:27.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.246+0000 7f739386b700 1 --2- 172.21.15.64:0/1142223757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0fbdf0 0x7f738c0fc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:27.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.246+0000 7f739386b700 1 --2- 172.21.15.64:0/1142223757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 0x7f738c0fd4b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:27.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.246+0000 7f739386b700 1 -- 172.21.15.64:0/1142223757 >> 172.21.15.64:0/1142223757 conn(0x7f738c0f6950 msgr2=0x7f738c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:27.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f739386b700 1 -- 172.21.15.64:0/1142223757 shutdown_connections 2023-12-16T03:14:27.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f739386b700 1 -- 172.21.15.64:0/1142223757 wait complete. 2023-12-16T03:14:27.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f739386b700 1 Processor -- start 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f739386b700 1 -- start start 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f739386b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0fbdf0 0x7f738c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f739386b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 0x7f738c10db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f739386b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c10e130 con 0x7f738c0fd0a0 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f739386b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c10e9d0 con 0x7f738c0fbdf0 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f7390e06700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 0x7f738c10db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f7390e06700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 0x7f738c10db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49286/0 (socket says 172.21.15.64:49286) 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.247+0000 7f7390e06700 1 -- 172.21.15.64:0/2895520555 learned_addr learned my addr 172.21.15.64:0/2895520555 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f7391607700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0fbdf0 0x7f738c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f7390e06700 1 -- 172.21.15.64:0/2895520555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0fbdf0 msgr2=0x7f738c10d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f7390e06700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0fbdf0 0x7f738c10d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f7390e06700 1 -- 172.21.15.64:0/2895520555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388005040 con 0x7f738c0fd0a0 2023-12-16T03:14:27.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f7390e06700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 0x7f738c10db30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f738000c830 tx=0x7f7380004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:27.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f737dffb700 1 -- 172.21.15.64:0/2895520555 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f738000a760 con 0x7f738c0fd0a0 2023-12-16T03:14:27.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f737dffb700 1 -- 172.21.15.64:0/2895520555 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f738000ad70 con 0x7f738c0fd0a0 2023-12-16T03:14:27.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c10ecb0 con 0x7f738c0fd0a0 2023-12-16T03:14:27.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f737dffb700 1 -- 172.21.15.64:0/2895520555 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73800113a0 con 0x7f738c0fd0a0 2023-12-16T03:14:27.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.248+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c10f1f0 con 0x7f738c0fd0a0 2023-12-16T03:14:27.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.249+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c04bb80 con 0x7f738c0fd0a0 2023-12-16T03:14:27.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.250+0000 7f737dffb700 1 -- 172.21.15.64:0/2895520555 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7380012400 con 0x7f738c0fd0a0 2023-12-16T03:14:27.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.250+0000 7f737dffb700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7378068f60 0x7f737806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:27.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.250+0000 7f737dffb700 1 -- 172.21.15.64:0/2895520555 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7380086d20 con 0x7f738c0fd0a0 2023-12-16T03:14:27.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.250+0000 7f7391607700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7378068f60 0x7f737806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:27.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.251+0000 7f7391607700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7378068f60 0x7f737806b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7388004f90 tx=0x7f7388009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:27.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.254+0000 7f737dffb700 1 -- 172.21.15.64:0/2895520555 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7380056d20 con 0x7f738c0fd0a0 2023-12-16T03:14:27.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.452+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f738c1044a0 con 0x7f738c0fd0a0 2023-12-16T03:14:27.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.453+0000 7f737dffb700 1 -- 172.21.15.64:0/2895520555 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f73800568b0 con 0x7f738c0fd0a0 2023-12-16T03:14:27.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7378068f60 msgr2=0x7f737806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:27.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7378068f60 0x7f737806b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7388004f90 tx=0x7f7388009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:27.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 msgr2=0x7f738c10db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:27.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 0x7f738c10db30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f738000c830 tx=0x7f7380004470 comp rx=0 tx=0).stop 2023-12-16T03:14:27.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 shutdown_connections 2023-12-16T03:14:27.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f7378068f60 0x7f737806b410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:27.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0fbdf0 0x7f738c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:27.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 --2- 172.21.15.64:0/2895520555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f738c0fd0a0 0x7f738c10db30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:27.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 >> 172.21.15.64:0/2895520555 conn(0x7f738c0f6950 msgr2=0x7f738c0face0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:27.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 shutdown_connections 2023-12-16T03:14:27.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:27.455+0000 7f739386b700 1 -- 172.21.15.64:0/2895520555 wait complete. 2023-12-16T03:14:27.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:27 smithi184 ceph-mon[121180]: pgmap v148: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T03:14:27.660 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:27 smithi064 ceph-mon[111958]: pgmap v148: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T03:14:27.887 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-16T03:14:28.161 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:29.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 -- 172.21.15.64:0/461659869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 msgr2=0x7fb08c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:29.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 --2- 172.21.15.64:0/461659869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 0x7fb08c0fd000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb080004940 tx=0x7fb080009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:29.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 -- 172.21.15.64:0/461659869 shutdown_connections 2023-12-16T03:14:29.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 --2- 172.21.15.64:0/461659869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0fde00 0x7fb08c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:29.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 --2- 172.21.15.64:0/461659869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 0x7fb08c0fd000 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 -- 172.21.15.64:0/461659869 >> 172.21.15.64:0/461659869 conn(0x7fb08c0f82d0 msgr2=0x7fb08c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 -- 172.21.15.64:0/461659869 shutdown_connections 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 -- 172.21.15.64:0/461659869 wait complete. 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 Processor -- start 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.369+0000 7fb092f9d700 1 -- start start 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb092f9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 0x7fb08c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb092f9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0fde00 0x7fb08c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb092f9d700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c10e010 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb092f9d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c10e8b0 con 0x7fb08c0fde00 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb090d39700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 0x7fb08c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb08bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0fde00 0x7fb08c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb090d39700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 0x7fb08c10d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49310/0 (socket says 172.21.15.64:49310) 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb090d39700 1 -- 172.21.15.64:0/1792269501 learned_addr learned my addr 172.21.15.64:0/1792269501 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb090d39700 1 -- 172.21.15.64:0/1792269501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0fde00 msgr2=0x7fb08c10da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:29.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb090d39700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0fde00 0x7fb08c10da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:29.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb090d39700 1 -- 172.21.15.64:0/1792269501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080005040 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.370+0000 7fb08bfff700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0fde00 0x7fb08c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:14:29.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.371+0000 7fb090d39700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 0x7fb08c10d4d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb080008f90 tx=0x7fb080009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:29.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.371+0000 7fb0897fa700 1 -- 172.21.15.64:0/1792269501 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb080021070 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.371+0000 7fb0897fa700 1 -- 172.21.15.64:0/1792269501 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb08001c400 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.371+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c10eb30 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.371+0000 7fb0897fa700 1 -- 172.21.15.64:0/1792269501 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08000e030 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.371+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c10f070 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.372+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c04bb80 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.373+0000 7fb0897fa700 1 -- 172.21.15.64:0/1792269501 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb08001c9e0 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.373+0000 7fb0897fa700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb07c068f70 0x7fb07c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:29.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.374+0000 7fb0897fa700 1 -- 172.21.15.64:0/1792269501 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb080088010 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.374+0000 7fb08bfff700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb07c068f70 0x7fb07c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:29.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.374+0000 7fb08bfff700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb07c068f70 0x7fb07c06b420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb078009b80 tx=0x7fb07800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:29.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.378+0000 7fb0897fa700 1 -- 172.21.15.64:0/1792269501 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb080057f70 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:29 smithi064 ceph-mon[111958]: pgmap v149: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-16T03:14:29.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.594+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fb08c105590 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.595+0000 7fb0897fa700 1 -- 172.21.15.64:0/1792269501 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb080057b00 con 0x7fb08c0fcbf0 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb07c068f70 msgr2=0x7fb07c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb07c068f70 0x7fb07c06b420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb078009b80 tx=0x7fb07800b040 comp rx=0 tx=0).stop 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 msgr2=0x7fb08c10d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 0x7fb08c10d4d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb080008f90 tx=0x7fb080009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 shutdown_connections 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fb07c068f70 0x7fb07c06b420 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb08c0fcbf0 0x7fb08c10d4d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 --2- 172.21.15.64:0/1792269501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0fde00 0x7fb08c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 >> 172.21.15.64:0/1792269501 conn(0x7fb08c0f82d0 msgr2=0x7fb08c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:29.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 shutdown_connections 2023-12-16T03:14:29.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:29.598+0000 7fb092f9d700 1 -- 172.21.15.64:0/1792269501 wait complete. 2023-12-16T03:14:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:29 smithi184 ceph-mon[121180]: pgmap v149: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-16T03:14:30.044 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2023-12-16T03:14:30.336 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:14:31.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.500+0000 7f46c848d700 1 -- 172.21.15.64:0/1288441087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 msgr2=0x7f46c00fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:31.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.500+0000 7f46c848d700 1 --2- 172.21.15.64:0/1288441087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 0x7f46c00fb2e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f46bc004940 tx=0x7f46bc009e30 comp rx=0 tx=0).stop 2023-12-16T03:14:31.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.500+0000 7f46c848d700 1 -- 172.21.15.64:0/1288441087 shutdown_connections 2023-12-16T03:14:31.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.500+0000 7f46c848d700 1 --2- 172.21.15.64:0/1288441087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c00fdf60 0x7f46c00fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:31.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.500+0000 7f46c848d700 1 --2- 172.21.15.64:0/1288441087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 0x7f46c00fb2e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:31.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.500+0000 7f46c848d700 1 -- 172.21.15.64:0/1288441087 >> 172.21.15.64:0/1288441087 conn(0x7f46c00f6950 msgr2=0x7f46c00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:14:31.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.500+0000 7f46c848d700 1 -- 172.21.15.64:0/1288441087 shutdown_connections 2023-12-16T03:14:31.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.500+0000 7f46c848d700 1 -- 172.21.15.64:0/1288441087 wait complete. 2023-12-16T03:14:31.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c848d700 1 Processor -- start 2023-12-16T03:14:31.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c848d700 1 -- start start 2023-12-16T03:14:31.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c848d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 0x7f46c010f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:31.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c848d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c00fdf60 0x7f46c010fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:31.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c848d700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0110300 con 0x7f46c00faed0 2023-12-16T03:14:31.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c848d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0110ba0 con 0x7f46c00fdf60 2023-12-16T03:14:31.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c6229700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 0x7f46c010f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:31.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c6229700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 0x7f46c010f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49318/0 (socket says 172.21.15.64:49318) 2023-12-16T03:14:31.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c6229700 1 -- 172.21.15.64:0/1823395409 learned_addr learned my addr 172.21.15.64:0/1823395409 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:14:31.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c5a28700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c00fdf60 0x7f46c010fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:31.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c6229700 1 -- 172.21.15.64:0/1823395409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c00fdf60 msgr2=0x7f46c010fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:14:31.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c6229700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c00fdf60 0x7f46c010fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:14:31.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.501+0000 7f46c6229700 1 -- 172.21.15.64:0/1823395409 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc005040 con 0x7f46c00faed0 2023-12-16T03:14:31.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.502+0000 7f46c6229700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 0x7f46c010f7c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46bc000c00 tx=0x7f46bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:31.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.502+0000 7f46b6ffd700 1 -- 172.21.15.64:0/1823395409 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc021070 con 0x7f46c00faed0 2023-12-16T03:14:31.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.502+0000 7f46b6ffd700 1 -- 172.21.15.64:0/1823395409 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f46bc01c400 con 0x7f46c00faed0 2023-12-16T03:14:31.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.502+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c0110e20 con 0x7f46c00faed0 2023-12-16T03:14:31.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.502+0000 7f46b6ffd700 1 -- 172.21.15.64:0/1823395409 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc00e070 con 0x7f46c00faed0 2023-12-16T03:14:31.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.502+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0111300 con 0x7f46c00faed0 2023-12-16T03:14:31.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.503+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0102000 con 0x7f46c00faed0 2023-12-16T03:14:31.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.503+0000 7f46b6ffd700 1 -- 172.21.15.64:0/1823395409 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f46bc01c9c0 con 0x7f46c00faed0 2023-12-16T03:14:31.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.504+0000 7f46b6ffd700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46ac068f60 0x7f46ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:14:31.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.504+0000 7f46b6ffd700 1 -- 172.21.15.64:0/1823395409 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f46bc087e20 con 0x7f46c00faed0 2023-12-16T03:14:31.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.504+0000 7f46c5a28700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46ac068f60 0x7f46ac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:14:31.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.504+0000 7f46c5a28700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46ac068f60 0x7f46ac06b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009b80 tx=0x7f46b000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:14:31.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.508+0000 7f46b6ffd700 1 -- 172.21.15.64:0/1823395409 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f46bc057e20 con 0x7f46c00faed0 2023-12-16T03:14:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:31 smithi064 ceph-mon[111958]: pgmap v150: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-16T03:14:31.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:14:31.732+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f46c002b200 con 0x7f46ac068f60 2023-12-16T03:14:31.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:31 smithi184 ceph-mon[121180]: pgmap v150: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-16T03:14:32.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:14:32.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:32 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:14:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:33 smithi064 ceph-mon[111958]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:14:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:33 smithi064 ceph-mon[111958]: pgmap v151: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-16T03:14:33.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:33 smithi184 ceph-mon[121180]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:14:33.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:33 smithi184 ceph-mon[121180]: pgmap v151: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-16T03:14:35.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:35 smithi064 ceph-mon[111958]: pgmap v152: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-16T03:14:35.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:35 smithi184 ceph-mon[121180]: pgmap v152: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-16T03:14:37.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:37 smithi184 ceph-mon[121180]: pgmap v153: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T03:14:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:37 smithi064 ceph-mon[111958]: pgmap v153: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T03:14:39.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:39 smithi064 ceph-mon[111958]: pgmap v154: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:14:39.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:39 smithi184 ceph-mon[121180]: pgmap v154: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:14:41.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:41 smithi064 ceph-mon[111958]: pgmap v155: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:41.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:41 smithi184 ceph-mon[121180]: pgmap v155: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:43.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:43 smithi064 ceph-mon[111958]: pgmap v156: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:43.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:43 smithi184 ceph-mon[121180]: pgmap v156: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:45 smithi064 ceph-mon[111958]: pgmap v157: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:45 smithi184 ceph-mon[121180]: pgmap v157: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:47 smithi184 ceph-mon[121180]: pgmap v158: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:47 smithi064 ceph-mon[111958]: pgmap v158: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:48.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:14:48.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:14:49.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:49 smithi184 ceph-mon[121180]: pgmap v159: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:49.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:49 smithi064 ceph-mon[111958]: pgmap v159: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:51.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:51 smithi064 ceph-mon[111958]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:51.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:51 smithi184 ceph-mon[121180]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:53 smithi064 ceph-mon[111958]: pgmap v161: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:53.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:53 smithi184 ceph-mon[121180]: pgmap v161: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:55.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:55 smithi064 ceph-mon[111958]: pgmap v162: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:55.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:55 smithi184 ceph-mon[121180]: pgmap v162: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:14:57.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:57 smithi184 ceph-mon[121180]: pgmap v163: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:14:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:57 smithi064 ceph-mon[111958]: pgmap v163: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:14:59.629 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:14:59 smithi064 ceph-mon[111958]: pgmap v164: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T03:14:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:14:59 smithi184 ceph-mon[121180]: pgmap v164: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T03:15:00.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.068+0000 7f46b6ffd700 1 -- 172.21.15.64:0/1823395409 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f46c002b200 con 0x7f46ac068f60 2023-12-16T03:15:00.073 INFO:teuthology.orchestra.run.smithi064.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:15:00.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.071+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46ac068f60 msgr2=0x7f46ac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:00.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.071+0000 7f46c848d700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46ac068f60 0x7f46ac06b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009b80 tx=0x7f46b000b040 comp rx=0 tx=0).stop 2023-12-16T03:15:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.071+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 msgr2=0x7f46c010f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.071+0000 7f46c848d700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 0x7f46c010f7c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46bc000c00 tx=0x7f46bc009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.071+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 shutdown_connections 2023-12-16T03:15:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.071+0000 7f46c848d700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f46ac068f60 0x7f46ac06b410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.071+0000 7f46c848d700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c00faed0 0x7f46c010f7c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.071+0000 7f46c848d700 1 --2- 172.21.15.64:0/1823395409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46c00fdf60 0x7f46c010fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.071+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 >> 172.21.15.64:0/1823395409 conn(0x7f46c00f6950 msgr2=0x7f46c00ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.072+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 shutdown_connections 2023-12-16T03:15:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:00.072+0000 7f46c848d700 1 -- 172.21.15.64:0/1823395409 wait complete. 2023-12-16T03:15:00.518 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2023-12-16T03:15:00.867 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:15:01.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:01 smithi064 ceph-mon[111958]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:15:01.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:01.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:15:01.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:01 smithi064 ceph-mon[111958]: pgmap v165: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T03:15:01.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:15:01.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:15:01.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:01 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:01.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:01 smithi184 ceph-mon[121180]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:15:01.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:01.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:15:01.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:01 smithi184 ceph-mon[121180]: pgmap v165: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T03:15:01.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:15:01.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:15:01.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:01 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:02.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:02 smithi064 ceph-mon[111958]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:15:02.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.509+0000 7f0e0a468700 1 -- 172.21.15.64:0/1469694981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 msgr2=0x7f0e040fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:02.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.509+0000 7f0e0a468700 1 --2- 172.21.15.64:0/1469694981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 0x7f0e040fd150 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0df8004940 tx=0x7f0df8009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:02.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.509+0000 7f0e0a468700 1 -- 172.21.15.64:0/1469694981 shutdown_connections 2023-12-16T03:15:02.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.509+0000 7f0e0a468700 1 --2- 172.21.15.64:0/1469694981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 0x7f0e040fd150 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:02.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.509+0000 7f0e0a468700 1 --2- 172.21.15.64:0/1469694981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e040fbaf0 0x7f0e040fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:02.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.509+0000 7f0e0a468700 1 -- 172.21.15.64:0/1469694981 >> 172.21.15.64:0/1469694981 conn(0x7f0e040f7190 msgr2=0x7f0e040f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.509+0000 7f0e0a468700 1 -- 172.21.15.64:0/1469694981 shutdown_connections 2023-12-16T03:15:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.509+0000 7f0e0a468700 1 -- 172.21.15.64:0/1469694981 wait complete. 2023-12-16T03:15:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.510+0000 7f0e0a468700 1 Processor -- start 2023-12-16T03:15:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.510+0000 7f0e0a468700 1 -- start start 2023-12-16T03:15:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e0a468700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e040fbaf0 0x7f0e0410d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e0a468700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 0x7f0e0410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e0a468700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0410e020 con 0x7f0e040fcd00 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e0a468700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0410e8c0 con 0x7f0e040fbaf0 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e037fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 0x7f0e0410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e03fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e040fbaf0 0x7f0e0410d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e037fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 0x7f0e0410da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56300/0 (socket says 172.21.15.64:56300) 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e037fe700 1 -- 172.21.15.64:0/816284890 learned_addr learned my addr 172.21.15.64:0/816284890 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e037fe700 1 -- 172.21.15.64:0/816284890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e040fbaf0 msgr2=0x7f0e0410d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e037fe700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e040fbaf0 0x7f0e0410d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.511+0000 7f0e037fe700 1 -- 172.21.15.64:0/816284890 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8005040 con 0x7f0e040fcd00 2023-12-16T03:15:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.512+0000 7f0e037fe700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 0x7f0e0410da20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0df8000c00 tx=0x7f0df8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.512+0000 7f0e00ff9700 1 -- 172.21.15.64:0/816284890 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df8021070 con 0x7f0e040fcd00 2023-12-16T03:15:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.512+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0410eb40 con 0x7f0e040fcd00 2023-12-16T03:15:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.512+0000 7f0e00ff9700 1 -- 172.21.15.64:0/816284890 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0df801c400 con 0x7f0e040fcd00 2023-12-16T03:15:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.512+0000 7f0e00ff9700 1 -- 172.21.15.64:0/816284890 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df800e070 con 0x7f0e040fcd00 2023-12-16T03:15:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.513+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0410f020 con 0x7f0e040fcd00 2023-12-16T03:15:02.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.514+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0404bb80 con 0x7f0e040fcd00 2023-12-16T03:15:02.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.514+0000 7f0e00ff9700 1 -- 172.21.15.64:0/816284890 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0df801c9c0 con 0x7f0e040fcd00 2023-12-16T03:15:02.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.515+0000 7f0e00ff9700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0dec068f60 0x7f0dec06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:02.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.515+0000 7f0e00ff9700 1 -- 172.21.15.64:0/816284890 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0df808a030 con 0x7f0e040fcd00 2023-12-16T03:15:02.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.515+0000 7f0e03fff700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0dec068f60 0x7f0dec06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:02.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.515+0000 7f0e03fff700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0dec068f60 0x7f0dec06b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009b80 tx=0x7f0df400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:02.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.519+0000 7f0e00ff9700 1 -- 172.21.15.64:0/816284890 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0df8057640 con 0x7f0e040fcd00 2023-12-16T03:15:02.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:02 smithi184 ceph-mon[121180]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:15:02.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.802+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e0410f520 con 0x7f0dec068f60 2023-12-16T03:15:02.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.804+0000 7f0e00ff9700 1 -- 172.21.15.64:0/816284890 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f0e0410f520 con 0x7f0dec068f60 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0dec068f60 msgr2=0x7f0dec06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0dec068f60 0x7f0dec06b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009b80 tx=0x7f0df400b040 comp rx=0 tx=0).stop 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 msgr2=0x7f0e0410da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 0x7f0e0410da20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0df8000c00 tx=0x7f0df8009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 shutdown_connections 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0dec068f60 0x7f0dec06b410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e040fbaf0 0x7f0e0410d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 --2- 172.21.15.64:0/816284890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e040fcd00 0x7f0e0410da20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 >> 172.21.15.64:0/816284890 conn(0x7f0e040f7190 msgr2=0x7f0e040fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 shutdown_connections 2023-12-16T03:15:02.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.806+0000 7f0e0a468700 1 -- 172.21.15.64:0/816284890 wait complete. 2023-12-16T03:15:02.818 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:15:02.921 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.919+0000 7f2bf34aa700 1 -- 172.21.15.64:0/3432730738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bec100050 msgr2=0x7f2bec102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:02.921 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.919+0000 7f2bf34aa700 1 --2- 172.21.15.64:0/3432730738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bec100050 0x7f2bec102430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2be8004880 tx=0x7f2be8009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:02.921 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.919+0000 7f2bf34aa700 1 -- 172.21.15.64:0/3432730738 shutdown_connections 2023-12-16T03:15:02.921 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.919+0000 7f2bf34aa700 1 --2- 172.21.15.64:0/3432730738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bec100050 0x7f2bec102430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:02.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.919+0000 7f2bf34aa700 1 --2- 172.21.15.64:0/3432730738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bec0fd730 0x7f2bec0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:02.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.919+0000 7f2bf34aa700 1 -- 172.21.15.64:0/3432730738 >> 172.21.15.64:0/3432730738 conn(0x7f2bec0f71b0 msgr2=0x7f2bec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:02.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.919+0000 7f2bf34aa700 1 -- 172.21.15.64:0/3432730738 shutdown_connections 2023-12-16T03:15:02.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.919+0000 7f2bf34aa700 1 -- 172.21.15.64:0/3432730738 wait complete. 2023-12-16T03:15:02.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.920+0000 7f2bf34aa700 1 Processor -- start 2023-12-16T03:15:02.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.920+0000 7f2bf34aa700 1 -- start start 2023-12-16T03:15:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.920+0000 7f2bf34aa700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bec0fd730 0x7f2bec10d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.920+0000 7f2bf34aa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bec100050 0x7f2bec10d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.920+0000 7f2bf34aa700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec10dfa0 con 0x7f2bec0fd730 2023-12-16T03:15:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.920+0000 7f2bf34aa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec10e840 con 0x7f2bec100050 2023-12-16T03:15:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.920+0000 7f2bf1246700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bec0fd730 0x7f2bec10d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.921+0000 7f2bf1246700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bec0fd730 0x7f2bec10d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56322/0 (socket says 172.21.15.64:56322) 2023-12-16T03:15:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.921+0000 7f2bf1246700 1 -- 172.21.15.64:0/2303365839 learned_addr learned my addr 172.21.15.64:0/2303365839 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.921+0000 7f2bf1246700 1 -- 172.21.15.64:0/2303365839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bec100050 msgr2=0x7f2bec10d9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:15:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.921+0000 7f2bf1246700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bec100050 0x7f2bec10d9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.921+0000 7f2bf1246700 1 -- 172.21.15.64:0/2303365839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be8005040 con 0x7f2bec0fd730 2023-12-16T03:15:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.921+0000 7f2bf1246700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bec0fd730 0x7f2bec10d460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2be00041d0 tx=0x7f2be000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.921+0000 7f2bddffb700 1 -- 172.21.15.64:0/2303365839 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be0007cc0 con 0x7f2bec0fd730 2023-12-16T03:15:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.921+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec10eac0 con 0x7f2bec0fd730 2023-12-16T03:15:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.921+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec10ef20 con 0x7f2bec0fd730 2023-12-16T03:15:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.922+0000 7f2bddffb700 1 -- 172.21.15.64:0/2303365839 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2be000f040 con 0x7f2bec0fd730 2023-12-16T03:15:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.922+0000 7f2bddffb700 1 -- 172.21.15.64:0/2303365839 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be000cae0 con 0x7f2bec0fd730 2023-12-16T03:15:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.923+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec04bb80 con 0x7f2bec0fd730 2023-12-16T03:15:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.924+0000 7f2bddffb700 1 -- 172.21.15.64:0/2303365839 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2be000cc40 con 0x7f2bec0fd730 2023-12-16T03:15:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.925+0000 7f2bddffb700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2bd8068f60 0x7f2bd806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.925+0000 7f2bddffb700 1 -- 172.21.15.64:0/2303365839 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2be0086aa0 con 0x7f2bec0fd730 2023-12-16T03:15:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.925+0000 7f2bf0a45700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2bd8068f60 0x7f2bd806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.925+0000 7f2bf0a45700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2bd8068f60 0x7f2bd806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009fd0 tx=0x7f2be8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:02.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:02.929+0000 7f2bddffb700 1 -- 172.21.15.64:0/2303365839 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2be004da00 con 0x7f2bec0fd730 2023-12-16T03:15:03.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.144+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bec10f640 con 0x7f2bd8068f60 2023-12-16T03:15:03.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.145+0000 7f2bddffb700 1 -- 172.21.15.64:0/2303365839 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f2bec10f640 con 0x7f2bd8068f60 2023-12-16T03:15:03.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.147+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2bd8068f60 msgr2=0x7f2bd806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.147+0000 7f2bf34aa700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2bd8068f60 0x7f2bd806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009fd0 tx=0x7f2be8009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:03.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.148+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bec0fd730 msgr2=0x7f2bec10d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.148+0000 7f2bf34aa700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bec0fd730 0x7f2bec10d460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2be00041d0 tx=0x7f2be000b040 comp rx=0 tx=0).stop 2023-12-16T03:15:03.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.148+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 shutdown_connections 2023-12-16T03:15:03.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.148+0000 7f2bf34aa700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2bd8068f60 0x7f2bd806b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.148+0000 7f2bf34aa700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bec0fd730 0x7f2bec10d460 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.148+0000 7f2bf34aa700 1 --2- 172.21.15.64:0/2303365839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bec100050 0x7f2bec10d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.148+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 >> 172.21.15.64:0/2303365839 conn(0x7f2bec0f71b0 msgr2=0x7f2bec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:03.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.148+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 shutdown_connections 2023-12-16T03:15:03.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.148+0000 7f2bf34aa700 1 -- 172.21.15.64:0/2303365839 wait complete. 2023-12-16T03:15:03.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.309+0000 7f80e4b84700 1 -- 172.21.15.64:0/3302913091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 msgr2=0x7f80e00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.309+0000 7f80e4b84700 1 --2- 172.21.15.64:0/3302913091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 0x7f80e00fbf00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f80d0004940 tx=0x7f80d0009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:03.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.309+0000 7f80e4b84700 1 -- 172.21.15.64:0/3302913091 shutdown_connections 2023-12-16T03:15:03.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.309+0000 7f80e4b84700 1 --2- 172.21.15.64:0/3302913091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80e00fcd00 0x7f80e00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.309+0000 7f80e4b84700 1 --2- 172.21.15.64:0/3302913091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 0x7f80e00fbf00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.309+0000 7f80e4b84700 1 -- 172.21.15.64:0/3302913091 >> 172.21.15.64:0/3302913091 conn(0x7f80e00f7190 msgr2=0x7f80e00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:03.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.309+0000 7f80e4b84700 1 -- 172.21.15.64:0/3302913091 shutdown_connections 2023-12-16T03:15:03.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.309+0000 7f80e4b84700 1 -- 172.21.15.64:0/3302913091 wait complete. 2023-12-16T03:15:03.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80e4b84700 1 Processor -- start 2023-12-16T03:15:03.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80e4b84700 1 -- start start 2023-12-16T03:15:03.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80e4b84700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 0x7f80e006eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80e4b84700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80e00fcd00 0x7f80e006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80e4b84700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e006f830 con 0x7f80e00fcd00 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80e4b84700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e0115fd0 con 0x7f80e00fbaf0 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80de59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 0x7f80e006eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80de59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 0x7f80e006eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.64:48962/0 (socket says 172.21.15.64:48962) 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80de59c700 1 -- 172.21.15.64:0/1709477432 learned_addr learned my addr 172.21.15.64:0/1709477432 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.310+0000 7f80de59c700 1 -- 172.21.15.64:0/1709477432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80e00fcd00 msgr2=0x7f80e006f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.311+0000 7f80de59c700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80e00fcd00 0x7f80e006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.311+0000 7f80de59c700 1 -- 172.21.15.64:0/1709477432 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0005040 con 0x7f80e00fbaf0 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.311+0000 7f80de59c700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 0x7f80e006eca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f80d0000c00 tx=0x7f80d0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.311+0000 7f80ceffd700 1 -- 172.21.15.64:0/1709477432 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d000e040 con 0x7f80e00fbaf0 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.311+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e0116250 con 0x7f80e00fbaf0 2023-12-16T03:15:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.311+0000 7f80ceffd700 1 -- 172.21.15.64:0/1709477432 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f80d0009af0 con 0x7f80e00fbaf0 2023-12-16T03:15:03.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.311+0000 7f80ceffd700 1 -- 172.21.15.64:0/1709477432 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d001c630 con 0x7f80e00fbaf0 2023-12-16T03:15:03.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.311+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e0116790 con 0x7f80e00fbaf0 2023-12-16T03:15:03.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.312+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e004bb80 con 0x7f80e00fbaf0 2023-12-16T03:15:03.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.314+0000 7f80ceffd700 1 -- 172.21.15.64:0/1709477432 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f80d001c8a0 con 0x7f80e00fbaf0 2023-12-16T03:15:03.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.314+0000 7f80ceffd700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f80c8068f60 0x7f80c806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:03.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.314+0000 7f80ceffd700 1 -- 172.21.15.64:0/1709477432 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f80d0088580 con 0x7f80e00fbaf0 2023-12-16T03:15:03.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.315+0000 7f80ddd9b700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f80c8068f60 0x7f80c806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:03.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.315+0000 7f80ddd9b700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f80c8068f60 0x7f80c806b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b80 tx=0x7f80d4009d60 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:03.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.322+0000 7f80ceffd700 1 -- 172.21.15.64:0/1709477432 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f80d0054af0 con 0x7f80e00fbaf0 2023-12-16T03:15:03.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.545+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f80e0101650 con 0x7f80c8068f60 2023-12-16T03:15:03.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.555+0000 7f80ceffd700 1 -- 172.21.15.64:0/1709477432 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f80e0101650 con 0x7f80c8068f60 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (4m) 50s ago 4m 29.3M - 0.25.0 c8568f914cd2 14aee4a706e2 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (5m) 50s ago 5m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (4m) 53s ago 4m 7482k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (3m) 50s ago 4m 88.2M - 9.4.7 954c08fa6188 697184eb15a8 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (63s) 50s ago 62s 12.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (67s) 50s ago 66s 16.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (65s) 53s ago 65s 16.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (61s) 53s ago 61s 13.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:9283 running (6m) 50s ago 6m 496M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f40249c90cfb 2023-12-16T03:15:03.557 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283 running (4m) 53s ago 4m 440M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9516ab376976 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (6m) 50s ago 6m 75.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (4m) 53s ago 4m 60.7M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (5m) 50s ago 5m 16.1M - 1.5.0 0da6a335fe13 c8706c3a2b59 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (4m) 53s ago 4m 18.3M - 1.5.0 0da6a335fe13 67ad2f701450 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (3m) 50s ago 3m 58.6M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (3m) 50s ago 3m 59.5M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (3m) 50s ago 3m 57.0M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (2m) 53s ago 2m 57.1M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (2m) 53s ago 2m 52.5M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (2m) 53s ago 2m 50.3M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:15:03.558 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (3m) 50s ago 4m 46.5M - 2.43.0 a07b618ecd1d 91a18452d564 2023-12-16T03:15:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.557+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f80c8068f60 msgr2=0x7f80c806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.557+0000 7f80e4b84700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f80c8068f60 0x7f80c806b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b80 tx=0x7f80d4009d60 comp rx=0 tx=0).stop 2023-12-16T03:15:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.557+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 msgr2=0x7f80e006eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.557+0000 7f80e4b84700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 0x7f80e006eca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f80d0000c00 tx=0x7f80d0009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.557+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 shutdown_connections 2023-12-16T03:15:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.557+0000 7f80e4b84700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f80c8068f60 0x7f80c806b410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.557+0000 7f80e4b84700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e00fbaf0 0x7f80e006eca0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.557+0000 7f80e4b84700 1 --2- 172.21.15.64:0/1709477432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80e00fcd00 0x7f80e006f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.557+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 >> 172.21.15.64:0/1709477432 conn(0x7f80e00f7190 msgr2=0x7f80e00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:03.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.558+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 shutdown_connections 2023-12-16T03:15:03.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.558+0000 7f80e4b84700 1 -- 172.21.15.64:0/1709477432 wait complete. 2023-12-16T03:15:03.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:03 smithi184 ceph-mon[121180]: pgmap v166: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:15:03.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:15:03.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:03.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:15:03.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:03.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.671+0000 7f303b86f700 1 -- 172.21.15.64:0/2105886186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 msgr2=0x7f30340fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.671+0000 7f303b86f700 1 --2- 172.21.15.64:0/2105886186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 0x7f30340fbf00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3030004940 tx=0x7f3030009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.671+0000 7f303b86f700 1 -- 172.21.15.64:0/2105886186 shutdown_connections 2023-12-16T03:15:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.671+0000 7f303b86f700 1 --2- 172.21.15.64:0/2105886186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30340fcd00 0x7f30340fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.671+0000 7f303b86f700 1 --2- 172.21.15.64:0/2105886186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 0x7f30340fbf00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.671+0000 7f303b86f700 1 -- 172.21.15.64:0/2105886186 >> 172.21.15.64:0/2105886186 conn(0x7f30340f7190 msgr2=0x7f30340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.671+0000 7f303b86f700 1 -- 172.21.15.64:0/2105886186 shutdown_connections 2023-12-16T03:15:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.671+0000 7f303b86f700 1 -- 172.21.15.64:0/2105886186 wait complete. 2023-12-16T03:15:03.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f303b86f700 1 Processor -- start 2023-12-16T03:15:03.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f303b86f700 1 -- start start 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f303b86f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 0x7f303410dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f303b86f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30340fcd00 0x7f30341104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f303b86f700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034066170 con 0x7f30340fbaf0 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f303b86f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340662b0 con 0x7f30340fcd00 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f3038e0a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30340fcd00 0x7f30341104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f303960b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 0x7f303410dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f303960b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 0x7f303410dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56380/0 (socket says 172.21.15.64:56380) 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f303960b700 1 -- 172.21.15.64:0/1122159967 learned_addr learned my addr 172.21.15.64:0/1122159967 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.672+0000 7f3038e0a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30340fcd00 0x7f30341104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.64:48988/0 (socket says 172.21.15.64:48988) 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f3038e0a700 1 -- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 msgr2=0x7f303410dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f3038e0a700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 0x7f303410dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f3038e0a700 1 -- 172.21.15.64:0/1122159967 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030005040 con 0x7f30340fcd00 2023-12-16T03:15:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f303960b700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 0x7f303410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:15:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f3038e0a700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30340fcd00 0x7f30341104f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3024009fd0 tx=0x7f302400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f3029ffb700 1 -- 172.21.15.64:0/1122159967 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3024004e90 con 0x7f30340fcd00 2023-12-16T03:15:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3034110af0 con 0x7f30340fcd00 2023-12-16T03:15:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f3029ffb700 1 -- 172.21.15.64:0/1122159967 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f302400f040 con 0x7f30340fcd00 2023-12-16T03:15:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f3029ffb700 1 -- 172.21.15.64:0/1122159967 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f302400c9b0 con 0x7f30340fcd00 2023-12-16T03:15:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.673+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3034111030 con 0x7f30340fcd00 2023-12-16T03:15:03.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.674+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303404bb80 con 0x7f30340fcd00 2023-12-16T03:15:03.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.675+0000 7f3029ffb700 1 -- 172.21.15.64:0/1122159967 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f30240090d0 con 0x7f30340fcd00 2023-12-16T03:15:03.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.676+0000 7f3029ffb700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f3020068f70 0x7f302006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:03.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.676+0000 7f3029ffb700 1 -- 172.21.15.64:0/1122159967 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f30240867d0 con 0x7f30340fcd00 2023-12-16T03:15:03.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.676+0000 7f303960b700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f3020068f70 0x7f302006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:03.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.676+0000 7f303960b700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f3020068f70 0x7f302006b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3030013680 tx=0x7f3030009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:03.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.684+0000 7f3029ffb700 1 -- 172.21.15.64:0/1122159967 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f302404da00 con 0x7f30340fcd00 2023-12-16T03:15:03.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:03 smithi064 ceph-mon[111958]: pgmap v166: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:15:03.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:15:03.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:03.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:15:03.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:03.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.964+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3034104490 con 0x7f30340fcd00 2023-12-16T03:15:03.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.965+0000 7f3029ffb700 1 -- 172.21.15.64:0/1122159967 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f3024019290 con 0x7f30340fcd00 2023-12-16T03:15:03.968 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:15:03.968 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:15:03.968 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:15:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:15:03.970 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:15:03.970 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-16T03:15:03.970 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:15:03.970 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:15:03.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.967+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f3020068f70 msgr2=0x7f302006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.967+0000 7f303b86f700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f3020068f70 0x7f302006b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3030013680 tx=0x7f3030009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:03.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.967+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30340fcd00 msgr2=0x7f30341104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:03.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.967+0000 7f303b86f700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30340fcd00 0x7f30341104f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3024009fd0 tx=0x7f302400b040 comp rx=0 tx=0).stop 2023-12-16T03:15:03.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.967+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 shutdown_connections 2023-12-16T03:15:03.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.967+0000 7f303b86f700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f3020068f70 0x7f302006b420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.967+0000 7f303b86f700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30340fbaf0 0x7f303410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.967+0000 7f303b86f700 1 --2- 172.21.15.64:0/1122159967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30340fcd00 0x7f30341104f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:03.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.967+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 >> 172.21.15.64:0/1122159967 conn(0x7f30340f7190 msgr2=0x7f30340fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:03.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.968+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 shutdown_connections 2023-12-16T03:15:03.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:03.968+0000 7f303b86f700 1 -- 172.21.15.64:0/1122159967 wait complete. 2023-12-16T03:15:04.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.119+0000 7fef1a616700 1 -- 172.21.15.64:0/4211654938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fcd00 msgr2=0x7fef140fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:04.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.119+0000 7fef1a616700 1 --2- 172.21.15.64:0/4211654938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fcd00 0x7fef140fd150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fef08004940 tx=0x7fef08009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:04.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.119+0000 7fef1a616700 1 -- 172.21.15.64:0/4211654938 shutdown_connections 2023-12-16T03:15:04.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.119+0000 7fef1a616700 1 --2- 172.21.15.64:0/4211654938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fcd00 0x7fef140fd150 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:04.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.119+0000 7fef1a616700 1 --2- 172.21.15.64:0/4211654938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef140fbaf0 0x7fef140fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:04.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.119+0000 7fef1a616700 1 -- 172.21.15.64:0/4211654938 >> 172.21.15.64:0/4211654938 conn(0x7fef140f71d0 msgr2=0x7fef140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:04.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.119+0000 7fef1a616700 1 -- 172.21.15.64:0/4211654938 shutdown_connections 2023-12-16T03:15:04.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.119+0000 7fef1a616700 1 -- 172.21.15.64:0/4211654938 wait complete. 2023-12-16T03:15:04.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef1a616700 1 Processor -- start 2023-12-16T03:15:04.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef1a616700 1 -- start start 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef1a616700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fbaf0 0x7fef141101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef1a616700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef140fcd00 0x7fef141126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef1a616700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef140669a0 con 0x7fef140fbaf0 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef1a616700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef14066ae0 con 0x7fef140fcd00 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef13fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fbaf0 0x7fef141101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef13fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fbaf0 0x7fef141101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:56390/0 (socket says 172.21.15.64:56390) 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef13fff700 1 -- 172.21.15.64:0/3684242711 learned_addr learned my addr 172.21.15.64:0/3684242711 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.120+0000 7fef137fe700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef140fcd00 0x7fef141126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.121+0000 7fef13fff700 1 -- 172.21.15.64:0/3684242711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef140fcd00 msgr2=0x7fef141126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.121+0000 7fef13fff700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef140fcd00 0x7fef141126f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.121+0000 7fef13fff700 1 -- 172.21.15.64:0/3684242711 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08005040 con 0x7fef140fbaf0 2023-12-16T03:15:04.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.121+0000 7fef13fff700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fbaf0 0x7fef141101a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fef04002a80 tx=0x7fef040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:04.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.121+0000 7fef10ff9700 1 -- 172.21.15.64:0/3684242711 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef04007cc0 con 0x7fef140fbaf0 2023-12-16T03:15:04.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.121+0000 7fef10ff9700 1 -- 172.21.15.64:0/3684242711 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef0400f040 con 0x7fef140fbaf0 2023-12-16T03:15:04.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.121+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef14112cf0 con 0x7fef140fbaf0 2023-12-16T03:15:04.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.121+0000 7fef10ff9700 1 -- 172.21.15.64:0/3684242711 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef0400d9e0 con 0x7fef140fbaf0 2023-12-16T03:15:04.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.121+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef14113180 con 0x7fef140fbaf0 2023-12-16T03:15:04.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.122+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1404bb80 con 0x7fef140fbaf0 2023-12-16T03:15:04.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.123+0000 7fef10ff9700 1 -- 172.21.15.64:0/3684242711 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fef0400dc50 con 0x7fef140fbaf0 2023-12-16T03:15:04.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.123+0000 7fef10ff9700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feefc068f60 0x7feefc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:04.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.123+0000 7fef10ff9700 1 -- 172.21.15.64:0/3684242711 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fef040865a0 con 0x7fef140fbaf0 2023-12-16T03:15:04.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.123+0000 7fef137fe700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feefc068f60 0x7feefc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:04.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.124+0000 7fef137fe700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feefc068f60 0x7feefc06b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef08004890 tx=0x7fef08009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:04.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.127+0000 7fef10ff9700 1 -- 172.21.15.64:0/3684242711 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fef0404ca00 con 0x7fef140fbaf0 2023-12-16T03:15:04.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.437+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef14101650 con 0x7feefc068f60 2023-12-16T03:15:04.442 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:15:04.442 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:15:04.442 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:15:04.442 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T03:15:04.442 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [], 2023-12-16T03:15:04.442 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "0/2 daemons upgraded", 2023-12-16T03:15:04.442 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 image on host smithi184", 2023-12-16T03:15:04.442 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:15:04.442 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:15:04.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.438+0000 7fef10ff9700 1 -- 172.21.15.64:0/3684242711 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fef14101650 con 0x7feefc068f60 2023-12-16T03:15:04.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feefc068f60 msgr2=0x7feefc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:04.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feefc068f60 0x7feefc06b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef08004890 tx=0x7fef08009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:04.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fbaf0 msgr2=0x7fef141101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:04.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fbaf0 0x7fef141101a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fef04002a80 tx=0x7fef040046b0 comp rx=0 tx=0).stop 2023-12-16T03:15:04.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 shutdown_connections 2023-12-16T03:15:04.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7feefc068f60 0x7feefc06b410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef140fbaf0 0x7fef141101a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 --2- 172.21.15.64:0/3684242711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef140fcd00 0x7fef141126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 >> 172.21.15.64:0/3684242711 conn(0x7fef140f71d0 msgr2=0x7fef140fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 shutdown_connections 2023-12-16T03:15:04.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:04.441+0000 7fef1a616700 1 -- 172.21.15.64:0/3684242711 wait complete. 2023-12-16T03:15:04.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:04 smithi184 ceph-mon[121180]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:04.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:04 smithi184 ceph-mon[121180]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T03:15:04.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:04 smithi184 ceph-mon[121180]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T03:15:04.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:04 smithi184 ceph-mon[121180]: Upgrade: Need to upgrade myself (mgr.smithi064.ueciyw) 2023-12-16T03:15:04.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:04 smithi184 ceph-mon[121180]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:04.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:04 smithi184 ceph-mon[121180]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 on smithi184 2023-12-16T03:15:04.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:04 smithi184 ceph-mon[121180]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:04.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:04 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1122159967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:15:04.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:04 smithi064 ceph-mon[111958]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:04.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:04 smithi064 ceph-mon[111958]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T03:15:04.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:04 smithi064 ceph-mon[111958]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T03:15:04.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:04 smithi064 ceph-mon[111958]: Upgrade: Need to upgrade myself (mgr.smithi064.ueciyw) 2023-12-16T03:15:04.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:04 smithi064 ceph-mon[111958]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:04.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:04 smithi064 ceph-mon[111958]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 on smithi184 2023-12-16T03:15:04.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:04 smithi064 ceph-mon[111958]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:04.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:04 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1122159967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:15:05.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:05 smithi184 ceph-mon[121180]: pgmap v167: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:15:05.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:05 smithi184 ceph-mon[121180]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:05 smithi064 ceph-mon[111958]: pgmap v167: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:15:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:05 smithi064 ceph-mon[111958]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:07.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:07 smithi184 ceph-mon[121180]: pgmap v168: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:15:07.603 INFO:tasks.workunit.client.1.smithi184.stderr:Updating files: 98% (11482/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-12-16T03:15:07.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:07 smithi064 ceph-mon[111958]: pgmap v168: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:15:08.469 INFO:tasks.workunit.client.1.smithi184.stderr:Note: switching to '6d933094a156ec7587742e5aa25fba5ba27ec678'. 2023-12-16T03:15:08.469 INFO:tasks.workunit.client.1.smithi184.stderr: 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr: 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr: 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr: git switch -c 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr: 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr:Or undo this operation with: 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr: 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr: git switch - 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr: 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T03:15:08.470 INFO:tasks.workunit.client.1.smithi184.stderr: 2023-12-16T03:15:08.471 INFO:tasks.workunit.client.1.smithi184.stderr:HEAD is now at 6d933094a15 Merge PR #52196 into main 2023-12-16T03:15:08.474 DEBUG:teuthology.orchestra.run.smithi184:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-16T03:15:08.545 INFO:tasks.workunit.client.1.smithi184.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T03:15:08.546 INFO:tasks.workunit.client.1.smithi184.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-16T03:15:08.546 INFO:tasks.workunit.client.1.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T03:15:09.074 INFO:tasks.workunit.client.1.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T03:15:09.127 INFO:tasks.workunit.client.1.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T03:15:09.166 INFO:tasks.workunit.client.1.smithi184.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-16T03:15:09.168 INFO:tasks.workunit.client.1.smithi184.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-16T03:15:09.168 INFO:tasks.workunit.client.1.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T03:15:09.209 INFO:tasks.workunit.client.1.smithi184.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-16T03:15:09.212 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:15:09.212 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-16T03:15:09.271 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-16T03:15:09.272 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-16T03:15:09.272 DEBUG:teuthology.orchestra.run.smithi184:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d933094a156ec7587742e5aa25fba5ba27ec678 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-16T03:15:09.339 INFO:tasks.workunit.client.1.smithi184.stderr:+ mkdir -p fsstress 2023-12-16T03:15:09.342 INFO:tasks.workunit.client.1.smithi184.stderr:+ pushd fsstress 2023-12-16T03:15:09.342 INFO:tasks.workunit.client.1.smithi184.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T03:15:09.342 INFO:tasks.workunit.client.1.smithi184.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-16T03:15:09.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:09 smithi064 ceph-mon[111958]: pgmap v169: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-16T03:15:09.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:09 smithi184 ceph-mon[121180]: pgmap v169: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-16T03:15:10.024 INFO:tasks.workunit.client.1.smithi184.stderr:+ tar xzf ltp-full.tgz 2023-12-16T03:15:11.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:11 smithi064 ceph-mon[111958]: pgmap v170: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T03:15:11.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:11 smithi184 ceph-mon[121180]: pgmap v170: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T03:15:13.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:13 smithi064 ceph-mon[111958]: pgmap v171: 65 pgs: 65 active+clean; 1.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s wr, 1 op/s 2023-12-16T03:15:13.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:13 smithi184 ceph-mon[121180]: pgmap v171: 65 pgs: 65 active+clean; 1.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s wr, 1 op/s 2023-12-16T03:15:15.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:15 smithi064 ceph-mon[111958]: pgmap v172: 65 pgs: 65 active+clean; 1.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s wr, 0 op/s 2023-12-16T03:15:15.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:15 smithi184 ceph-mon[121180]: pgmap v172: 65 pgs: 65 active+clean; 1.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s wr, 0 op/s 2023-12-16T03:15:17.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:17 smithi184 ceph-mon[121180]: pgmap v173: 65 pgs: 65 active+clean; 7.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 655 KiB/s wr, 50 op/s 2023-12-16T03:15:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:17 smithi064 ceph-mon[111958]: pgmap v173: 65 pgs: 65 active+clean; 7.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 655 KiB/s wr, 50 op/s 2023-12-16T03:15:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:18 smithi184 ceph-mon[121180]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:15:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:18 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:15:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:18 smithi064 ceph-mon[111958]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:15:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:18 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:15:19.052 INFO:tasks.workunit.client.0.smithi064.stderr:Updating files: 97% (11385/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-12-16T03:15:19.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:19 smithi184 ceph-mon[121180]: pgmap v174: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s wr, 151 op/s 2023-12-16T03:15:19.652 INFO:tasks.workunit.client.0.smithi064.stderr:Note: switching to '6d933094a156ec7587742e5aa25fba5ba27ec678'. 2023-12-16T03:15:19.652 INFO:tasks.workunit.client.0.smithi064.stderr: 2023-12-16T03:15:19.652 INFO:tasks.workunit.client.0.smithi064.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T03:15:19.652 INFO:tasks.workunit.client.0.smithi064.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T03:15:19.652 INFO:tasks.workunit.client.0.smithi064.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T03:15:19.652 INFO:tasks.workunit.client.0.smithi064.stderr: 2023-12-16T03:15:19.652 INFO:tasks.workunit.client.0.smithi064.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr: 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr: git switch -c 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr: 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr:Or undo this operation with: 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr: 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr: git switch - 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr: 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr: 2023-12-16T03:15:19.653 INFO:tasks.workunit.client.0.smithi064.stderr:HEAD is now at 6d933094a15 Merge PR #52196 into main 2023-12-16T03:15:19.657 DEBUG:teuthology.orchestra.run.smithi064:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-16T03:15:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:19 smithi064 ceph-mon[111958]: pgmap v174: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s wr, 151 op/s 2023-12-16T03:15:19.752 INFO:tasks.workunit.client.0.smithi064.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T03:15:19.755 INFO:tasks.workunit.client.0.smithi064.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T03:15:19.755 INFO:tasks.workunit.client.0.smithi064.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T03:15:21.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:21 smithi064 ceph-mon[111958]: pgmap v175: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s wr, 277 op/s 2023-12-16T03:15:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:21 smithi184 ceph-mon[121180]: pgmap v175: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s wr, 277 op/s 2023-12-16T03:15:23.521 INFO:tasks.workunit.client.0.smithi064.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T03:15:23.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:23 smithi064 ceph-mon[111958]: pgmap v176: 65 pgs: 65 active+clean; 45 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s wr, 279 op/s 2023-12-16T03:15:23.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:23 smithi184 ceph-mon[121180]: pgmap v176: 65 pgs: 65 active+clean; 45 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s wr, 279 op/s 2023-12-16T03:15:23.824 INFO:tasks.workunit.client.0.smithi064.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T03:15:23.870 INFO:tasks.workunit.client.0.smithi064.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T03:15:23.872 INFO:tasks.workunit.client.0.smithi064.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T03:15:23.872 INFO:tasks.workunit.client.0.smithi064.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T03:15:24.007 INFO:tasks.workunit.client.0.smithi064.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T03:15:24.010 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:15:24.010 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-16T03:15:24.068 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-16T03:15:24.069 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-16T03:15:24.070 DEBUG:teuthology.orchestra.run.smithi064:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d933094a156ec7587742e5aa25fba5ba27ec678 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-16T03:15:24.134 INFO:tasks.workunit.client.0.smithi064.stderr:+ mkdir -p fsstress 2023-12-16T03:15:24.136 INFO:tasks.workunit.client.0.smithi064.stderr:+ pushd fsstress 2023-12-16T03:15:24.136 INFO:tasks.workunit.client.0.smithi064.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T03:15:24.137 INFO:tasks.workunit.client.0.smithi064.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-16T03:15:25.321 INFO:tasks.workunit.client.0.smithi064.stderr:+ tar xzf ltp-full.tgz 2023-12-16T03:15:25.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:25 smithi064 ceph-mon[111958]: pgmap v177: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.3 MiB/s wr, 285 op/s 2023-12-16T03:15:25.778 INFO:tasks.workunit.client.1.smithi184.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-16T03:15:25.778 INFO:tasks.workunit.client.1.smithi184.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T03:15:25.779 INFO:tasks.workunit.client.1.smithi184.stderr:+ make 2023-12-16T03:15:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:25 smithi184 ceph-mon[121180]: pgmap v177: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.3 MiB/s wr, 285 op/s 2023-12-16T03:15:26.130 INFO:tasks.workunit.client.1.smithi184.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-16T03:15:26.381 INFO:tasks.workunit.client.1.smithi184.stderr:++ readlink -f fsstress 2023-12-16T03:15:26.382 INFO:tasks.workunit.client.1.smithi184.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-16T03:15:26.382 INFO:tasks.workunit.client.1.smithi184.stderr:+ popd 2023-12-16T03:15:26.382 INFO:tasks.workunit.client.1.smithi184.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T03:15:26.382 INFO:tasks.workunit.client.1.smithi184.stderr:+ popd 2023-12-16T03:15:26.383 INFO:tasks.workunit.client.1.smithi184.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-16T03:15:26.383 INFO:tasks.workunit.client.1.smithi184.stderr:++ mktemp -d -p . 2023-12-16T03:15:26.383 INFO:tasks.workunit.client.1.smithi184.stderr:+ T=./tmp.N1pUYskN62 2023-12-16T03:15:26.384 INFO:tasks.workunit.client.1.smithi184.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.N1pUYskN62 -l 1 -n 1000 -p 10 -v 2023-12-16T03:15:26.385 INFO:tasks.workunit.client.1.smithi184.stdout:seed = 1702426265 2023-12-16T03:15:26.388 INFO:tasks.workunit.client.1.smithi184.stdout:0/0: write - no filename 2023-12-16T03:15:26.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/0: write - no filename 2023-12-16T03:15:26.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/1: dwrite - no filename 2023-12-16T03:15:26.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/2: rmdir - no directory 2023-12-16T03:15:26.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/3: fsync - no filename 2023-12-16T03:15:26.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/4: rename - no filename 2023-12-16T03:15:26.390 INFO:tasks.workunit.client.1.smithi184.stdout:0/1: mknod c0 0 2023-12-16T03:15:26.390 INFO:tasks.workunit.client.1.smithi184.stdout:0/2: readlink - no filename 2023-12-16T03:15:26.390 INFO:tasks.workunit.client.1.smithi184.stdout:0/3: stat c0 0 2023-12-16T03:15:26.390 INFO:tasks.workunit.client.1.smithi184.stdout:0/4: dread - no filename 2023-12-16T03:15:26.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/0: dread - no filename 2023-12-16T03:15:26.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/1: truncate - no filename 2023-12-16T03:15:26.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/2: write - no filename 2023-12-16T03:15:26.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/3: getdents . 0 2023-12-16T03:15:26.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/4: link - no file 2023-12-16T03:15:26.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/5: dread - no filename 2023-12-16T03:15:26.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/6: rmdir - no directory 2023-12-16T03:15:26.405 INFO:tasks.workunit.client.1.smithi184.stdout:1/5: creat f0 x:0 0 0 2023-12-16T03:15:26.405 INFO:tasks.workunit.client.1.smithi184.stdout:0/5: unlink c0 0 2023-12-16T03:15:26.405 INFO:tasks.workunit.client.1.smithi184.stdout:3/0: dwrite - no filename 2023-12-16T03:15:26.419 INFO:tasks.workunit.client.1.smithi184.stdout:3/1: creat f0 x:0 0 0 2023-12-16T03:15:26.419 INFO:tasks.workunit.client.1.smithi184.stdout:3/2: rmdir - no directory 2023-12-16T03:15:26.419 INFO:tasks.workunit.client.1.smithi184.stdout:0/6: creat f1 x:0 0 0 2023-12-16T03:15:26.437 INFO:tasks.workunit.client.1.smithi184.stdout:3/3: mknod c1 0 2023-12-16T03:15:26.437 INFO:tasks.workunit.client.1.smithi184.stdout:4/0: symlink l0 0 2023-12-16T03:15:26.438 INFO:tasks.workunit.client.1.smithi184.stdout:4/1: write - no filename 2023-12-16T03:15:26.438 INFO:tasks.workunit.client.1.smithi184.stdout:4/2: read - no filename 2023-12-16T03:15:26.438 INFO:tasks.workunit.client.1.smithi184.stdout:4/3: dwrite - no filename 2023-12-16T03:15:26.438 INFO:tasks.workunit.client.1.smithi184.stdout:4/4: dread - no filename 2023-12-16T03:15:26.458 INFO:tasks.workunit.client.1.smithi184.stdout:4/5: mkdir d1 0 2023-12-16T03:15:26.458 INFO:tasks.workunit.client.1.smithi184.stdout:4/6: read - no filename 2023-12-16T03:15:26.458 INFO:tasks.workunit.client.1.smithi184.stdout:5/0: mknod c0 0 2023-12-16T03:15:26.458 INFO:tasks.workunit.client.1.smithi184.stdout:6/0: chown . 8491 1 2023-12-16T03:15:26.458 INFO:tasks.workunit.client.1.smithi184.stdout:6/1: truncate - no filename 2023-12-16T03:15:26.512 INFO:tasks.workunit.client.1.smithi184.stdout:4/7: symlink d1/l2 0 2023-12-16T03:15:26.512 INFO:tasks.workunit.client.1.smithi184.stdout:4/8: write - no filename 2023-12-16T03:15:26.512 INFO:tasks.workunit.client.1.smithi184.stdout:4/9: stat d1/l2 0 2023-12-16T03:15:26.512 INFO:tasks.workunit.client.1.smithi184.stdout:4/10: write - no filename 2023-12-16T03:15:26.512 INFO:tasks.workunit.client.1.smithi184.stdout:4/11: truncate - no filename 2023-12-16T03:15:26.513 INFO:tasks.workunit.client.1.smithi184.stdout:4/12: rename d1 to d1/d3 22 2023-12-16T03:15:26.513 INFO:tasks.workunit.client.1.smithi184.stdout:4/13: dwrite - no filename 2023-12-16T03:15:26.513 INFO:tasks.workunit.client.1.smithi184.stdout:4/14: dread - no filename 2023-12-16T03:15:26.513 INFO:tasks.workunit.client.1.smithi184.stdout:4/15: dread - no filename 2023-12-16T03:15:26.513 INFO:tasks.workunit.client.1.smithi184.stdout:4/16: write - no filename 2023-12-16T03:15:26.513 INFO:tasks.workunit.client.1.smithi184.stdout:4/17: dread - no filename 2023-12-16T03:15:26.514 INFO:tasks.workunit.client.1.smithi184.stdout:4/18: dwrite - no filename 2023-12-16T03:15:26.514 INFO:tasks.workunit.client.1.smithi184.stdout:4/19: fsync - no filename 2023-12-16T03:15:26.514 INFO:tasks.workunit.client.1.smithi184.stdout:4/20: stat d1 0 2023-12-16T03:15:26.514 INFO:tasks.workunit.client.1.smithi184.stdout:4/21: fsync - no filename 2023-12-16T03:15:26.521 INFO:tasks.workunit.client.1.smithi184.stdout:6/2: mkdir d0 0 2023-12-16T03:15:26.521 INFO:tasks.workunit.client.1.smithi184.stdout:6/3: read - no filename 2023-12-16T03:15:26.521 INFO:tasks.workunit.client.1.smithi184.stdout:6/4: dread - no filename 2023-12-16T03:15:26.521 INFO:tasks.workunit.client.1.smithi184.stdout:6/5: getdents d0 0 2023-12-16T03:15:26.521 INFO:tasks.workunit.client.1.smithi184.stdout:6/6: fsync - no filename 2023-12-16T03:15:26.522 INFO:tasks.workunit.client.1.smithi184.stdout:6/7: readlink - no filename 2023-12-16T03:15:26.522 INFO:tasks.workunit.client.1.smithi184.stdout:6/8: write - no filename 2023-12-16T03:15:26.522 INFO:tasks.workunit.client.1.smithi184.stdout:6/9: dread - no filename 2023-12-16T03:15:26.522 INFO:tasks.workunit.client.1.smithi184.stdout:6/10: dwrite - no filename 2023-12-16T03:15:26.572 INFO:tasks.workunit.client.1.smithi184.stdout:4/22: rmdir d1 39 2023-12-16T03:15:26.649 INFO:tasks.workunit.client.1.smithi184.stdout:4/23: creat d1/f4 x:0 0 0 2023-12-16T03:15:26.650 INFO:tasks.workunit.client.1.smithi184.stdout:4/24: fdatasync d1/f4 0 2023-12-16T03:15:26.995 INFO:tasks.workunit.client.1.smithi184.stdout:4/25: symlink d1/l5 0 2023-12-16T03:15:27.260 INFO:tasks.workunit.client.1.smithi184.stdout:1/6: getdents . 0 2023-12-16T03:15:27.301 INFO:tasks.workunit.client.1.smithi184.stdout:0/7: getdents . 0 2023-12-16T03:15:27.301 INFO:tasks.workunit.client.1.smithi184.stdout:0/8: readlink - no filename 2023-12-16T03:15:27.301 INFO:tasks.workunit.client.1.smithi184.stdout:0/9: dread - f1 zero size 2023-12-16T03:15:27.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:27 smithi064 ceph-mon[111958]: pgmap v178: 65 pgs: 65 active+clean; 59 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s wr, 285 op/s 2023-12-16T03:15:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:27 smithi184 ceph-mon[121180]: pgmap v178: 65 pgs: 65 active+clean; 59 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s wr, 285 op/s 2023-12-16T03:15:27.895 INFO:tasks.workunit.client.1.smithi184.stdout:4/26: symlink d1/l6 0 2023-12-16T03:15:27.895 INFO:tasks.workunit.client.1.smithi184.stdout:4/27: write d1/f4 [99016,110451] 0 2023-12-16T03:15:27.932 INFO:tasks.workunit.client.1.smithi184.stdout:4/28: fsync d1/f4 0 2023-12-16T03:15:27.933 INFO:tasks.workunit.client.1.smithi184.stdout:4/29: write d1/f4 [33201,27977] 0 2023-12-16T03:15:27.933 INFO:tasks.workunit.client.1.smithi184.stdout:4/30: rename d1 to d1/d7 22 2023-12-16T03:15:28.156 INFO:tasks.workunit.client.1.smithi184.stdout:5/1: unlink c0 0 2023-12-16T03:15:28.156 INFO:tasks.workunit.client.1.smithi184.stdout:5/2: rename - no filename 2023-12-16T03:15:28.156 INFO:tasks.workunit.client.1.smithi184.stdout:5/3: unlink - no file 2023-12-16T03:15:28.157 INFO:tasks.workunit.client.1.smithi184.stdout:7/0: link - no file 2023-12-16T03:15:28.157 INFO:tasks.workunit.client.1.smithi184.stdout:9/0: read - no filename 2023-12-16T03:15:28.157 INFO:tasks.workunit.client.1.smithi184.stdout:7/1: link - no file 2023-12-16T03:15:28.157 INFO:tasks.workunit.client.1.smithi184.stdout:9/1: write - no filename 2023-12-16T03:15:28.157 INFO:tasks.workunit.client.1.smithi184.stdout:7/2: write - no filename 2023-12-16T03:15:28.157 INFO:tasks.workunit.client.1.smithi184.stdout:7/3: read - no filename 2023-12-16T03:15:28.168 INFO:tasks.workunit.client.1.smithi184.stdout:0/10: dwrite f1 [0,4194304] 0 2023-12-16T03:15:28.188 INFO:tasks.workunit.client.1.smithi184.stdout:0/11: dwrite f1 [0,4194304] 0 2023-12-16T03:15:28.540 INFO:tasks.workunit.client.1.smithi184.stdout:1/7: mknod c1 0 2023-12-16T03:15:28.556 INFO:tasks.workunit.client.1.smithi184.stdout:1/8: dwrite f0 [0,4194304] 0 2023-12-16T03:15:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:29 smithi064 ceph-mon[111958]: pgmap v179: 65 pgs: 65 active+clean; 67 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 411 op/s 2023-12-16T03:15:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:29 smithi184 ceph-mon[121180]: pgmap v179: 65 pgs: 65 active+clean; 67 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 411 op/s 2023-12-16T03:15:30.913 INFO:tasks.workunit.client.1.smithi184.stdout:4/31: creat d1/f8 x:0 0 0 2023-12-16T03:15:30.917 INFO:tasks.workunit.client.1.smithi184.stdout:4/32: dread d1/f4 [0,4194304] 0 2023-12-16T03:15:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:31 smithi064 ceph-mon[111958]: pgmap v180: 65 pgs: 65 active+clean; 94 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 602 op/s 2023-12-16T03:15:31.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:31 smithi184 ceph-mon[121180]: pgmap v180: 65 pgs: 65 active+clean; 94 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 602 op/s 2023-12-16T03:15:31.930 INFO:tasks.workunit.client.1.smithi184.stdout:5/4: mkdir d1 0 2023-12-16T03:15:31.931 INFO:tasks.workunit.client.1.smithi184.stdout:5/5: readlink - no filename 2023-12-16T03:15:31.932 INFO:tasks.workunit.client.1.smithi184.stdout:7/4: mkdir d0 0 2023-12-16T03:15:31.932 INFO:tasks.workunit.client.1.smithi184.stdout:7/5: readlink - no filename 2023-12-16T03:15:31.932 INFO:tasks.workunit.client.1.smithi184.stdout:7/6: getdents d0 0 2023-12-16T03:15:31.932 INFO:tasks.workunit.client.1.smithi184.stdout:7/7: dread - no filename 2023-12-16T03:15:31.932 INFO:tasks.workunit.client.1.smithi184.stdout:7/8: read - no filename 2023-12-16T03:15:31.933 INFO:tasks.workunit.client.1.smithi184.stdout:9/2: mkdir d0 0 2023-12-16T03:15:31.933 INFO:tasks.workunit.client.1.smithi184.stdout:9/3: readlink - no filename 2023-12-16T03:15:31.933 INFO:tasks.workunit.client.1.smithi184.stdout:9/4: link - no file 2023-12-16T03:15:31.933 INFO:tasks.workunit.client.1.smithi184.stdout:9/5: rename d0 to d0/d1 22 2023-12-16T03:15:31.934 INFO:tasks.workunit.client.1.smithi184.stdout:9/6: dread - no filename 2023-12-16T03:15:31.934 INFO:tasks.workunit.client.1.smithi184.stdout:9/7: dwrite - no filename 2023-12-16T03:15:31.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/0: mknod c0 0 2023-12-16T03:15:31.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/1: write - no filename 2023-12-16T03:15:31.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/2: readlink - no filename 2023-12-16T03:15:31.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/3: truncate - no filename 2023-12-16T03:15:32.029 INFO:tasks.workunit.client.1.smithi184.stdout:0/12: rename f1 to f2 0 2023-12-16T03:15:32.030 INFO:tasks.workunit.client.1.smithi184.stdout:0/13: write f2 [3000085,56062] 0 2023-12-16T03:15:32.036 INFO:tasks.workunit.client.1.smithi184.stdout:1/9: mknod c2 0 2023-12-16T03:15:32.036 INFO:tasks.workunit.client.1.smithi184.stdout:1/10: chown c1 0 1 2023-12-16T03:15:32.043 INFO:tasks.workunit.client.1.smithi184.stdout:4/33: mkdir d1/d9 0 2023-12-16T03:15:32.047 INFO:tasks.workunit.client.1.smithi184.stdout:5/6: creat d1/f2 x:0 0 0 2023-12-16T03:15:32.047 INFO:tasks.workunit.client.1.smithi184.stdout:5/7: write d1/f2 [461570,126672] 0 2023-12-16T03:15:32.050 INFO:tasks.workunit.client.1.smithi184.stdout:7/9: symlink d0/l1 0 2023-12-16T03:15:32.050 INFO:tasks.workunit.client.1.smithi184.stdout:7/10: chown d0/l1 231 1 2023-12-16T03:15:32.050 INFO:tasks.workunit.client.1.smithi184.stdout:7/11: stat d0 0 2023-12-16T03:15:32.050 INFO:tasks.workunit.client.1.smithi184.stdout:0/14: dwrite f2 [0,4194304] 0 2023-12-16T03:15:32.050 INFO:tasks.workunit.client.1.smithi184.stdout:5/8: fdatasync d1/f2 0 2023-12-16T03:15:32.052 INFO:tasks.workunit.client.1.smithi184.stdout:9/8: mknod d0/c2 0 2023-12-16T03:15:32.052 INFO:tasks.workunit.client.1.smithi184.stdout:9/9: readlink - no filename 2023-12-16T03:15:32.053 INFO:tasks.workunit.client.1.smithi184.stdout:5/9: dread d1/f2 [0,4194304] 0 2023-12-16T03:15:32.055 INFO:tasks.workunit.client.1.smithi184.stdout:8/4: symlink l1 0 2023-12-16T03:15:32.055 INFO:tasks.workunit.client.1.smithi184.stdout:8/5: dread - no filename 2023-12-16T03:15:32.055 INFO:tasks.workunit.client.1.smithi184.stdout:8/6: truncate - no filename 2023-12-16T03:15:32.056 INFO:tasks.workunit.client.1.smithi184.stdout:1/11: mkdir d3 0 2023-12-16T03:15:32.057 INFO:tasks.workunit.client.1.smithi184.stdout:4/34: rmdir d1/d9 0 2023-12-16T03:15:32.061 INFO:tasks.workunit.client.1.smithi184.stdout:7/12: symlink d0/l2 0 2023-12-16T03:15:32.062 INFO:tasks.workunit.client.1.smithi184.stdout:0/15: symlink l3 0 2023-12-16T03:15:32.062 INFO:tasks.workunit.client.1.smithi184.stdout:0/16: readlink l3 0 2023-12-16T03:15:32.063 INFO:tasks.workunit.client.1.smithi184.stdout:0/17: fdatasync f2 0 2023-12-16T03:15:32.064 INFO:tasks.workunit.client.1.smithi184.stdout:9/10: symlink d0/l3 0 2023-12-16T03:15:32.066 INFO:tasks.workunit.client.1.smithi184.stdout:5/10: mkdir d1/d3 0 2023-12-16T03:15:32.066 INFO:tasks.workunit.client.1.smithi184.stdout:5/11: write d1/f2 [1352731,81167] 0 2023-12-16T03:15:32.068 INFO:tasks.workunit.client.1.smithi184.stdout:8/7: mkdir d2 0 2023-12-16T03:15:32.069 INFO:tasks.workunit.client.1.smithi184.stdout:0/18: dread f2 [0,4194304] 0 2023-12-16T03:15:32.072 INFO:tasks.workunit.client.1.smithi184.stdout:4/35: mknod d1/ca 0 2023-12-16T03:15:32.074 INFO:tasks.workunit.client.1.smithi184.stdout:7/13: mkdir d0/d3 0 2023-12-16T03:15:32.074 INFO:tasks.workunit.client.1.smithi184.stdout:7/14: readlink d0/l2 0 2023-12-16T03:15:32.075 INFO:tasks.workunit.client.1.smithi184.stdout:9/11: symlink d0/l4 0 2023-12-16T03:15:32.077 INFO:tasks.workunit.client.1.smithi184.stdout:8/8: symlink d2/l3 0 2023-12-16T03:15:32.083 INFO:tasks.workunit.client.1.smithi184.stdout:4/36: symlink d1/lb 0 2023-12-16T03:15:32.083 INFO:tasks.workunit.client.1.smithi184.stdout:0/19: dwrite f2 [0,4194304] 0 2023-12-16T03:15:32.085 INFO:tasks.workunit.client.1.smithi184.stdout:7/15: mkdir d0/d3/d4 0 2023-12-16T03:15:32.087 INFO:tasks.workunit.client.1.smithi184.stdout:9/12: mknod d0/c5 0 2023-12-16T03:15:32.091 INFO:tasks.workunit.client.1.smithi184.stdout:8/9: mkdir d2/d4 0 2023-12-16T03:15:32.094 INFO:tasks.workunit.client.1.smithi184.stdout:4/37: rename d1/ca to d1/cc 0 2023-12-16T03:15:32.094 INFO:tasks.workunit.client.1.smithi184.stdout:4/38: dread - d1/f8 zero size 2023-12-16T03:15:32.095 INFO:tasks.workunit.client.1.smithi184.stdout:4/39: dread d1/f4 [0,4194304] 0 2023-12-16T03:15:32.100 INFO:tasks.workunit.client.1.smithi184.stdout:7/16: creat d0/d3/f5 x:0 0 0 2023-12-16T03:15:32.100 INFO:tasks.workunit.client.1.smithi184.stdout:7/17: truncate d0/d3/f5 389639 0 2023-12-16T03:15:32.100 INFO:tasks.workunit.client.1.smithi184.stdout:7/18: write d0/d3/f5 [712957,108894] 0 2023-12-16T03:15:32.100 INFO:tasks.workunit.client.1.smithi184.stdout:7/19: getdents d0/d3/d4 0 2023-12-16T03:15:32.102 INFO:tasks.workunit.client.1.smithi184.stdout:9/13: creat d0/f6 x:0 0 0 2023-12-16T03:15:32.104 INFO:tasks.workunit.client.1.smithi184.stdout:8/10: symlink d2/d4/l5 0 2023-12-16T03:15:32.104 INFO:tasks.workunit.client.1.smithi184.stdout:8/11: truncate - no filename 2023-12-16T03:15:32.108 INFO:tasks.workunit.client.1.smithi184.stdout:7/20: mknod d0/c6 0 2023-12-16T03:15:32.109 INFO:tasks.workunit.client.1.smithi184.stdout:7/21: read d0/d3/f5 [694928,41822] 0 2023-12-16T03:15:32.109 INFO:tasks.workunit.client.1.smithi184.stdout:9/14: creat d0/f7 x:0 0 0 2023-12-16T03:15:32.112 INFO:tasks.workunit.client.1.smithi184.stdout:8/12: mknod d2/d4/c6 0 2023-12-16T03:15:32.119 INFO:tasks.workunit.client.1.smithi184.stdout:8/13: unlink d2/d4/c6 0 2023-12-16T03:15:32.119 INFO:tasks.workunit.client.1.smithi184.stdout:8/14: fdatasync - no filename 2023-12-16T03:15:32.119 INFO:tasks.workunit.client.1.smithi184.stdout:8/15: stat d2/d4 0 2023-12-16T03:15:32.124 INFO:tasks.workunit.client.1.smithi184.stdout:8/16: rename c0 to d2/d4/c7 0 2023-12-16T03:15:32.124 INFO:tasks.workunit.client.1.smithi184.stdout:8/17: chown d2/d4/c7 505244 1 2023-12-16T03:15:32.124 INFO:tasks.workunit.client.1.smithi184.stdout:8/18: dread - no filename 2023-12-16T03:15:32.124 INFO:tasks.workunit.client.1.smithi184.stdout:8/19: rename d2 to d2/d8 22 2023-12-16T03:15:32.127 INFO:tasks.workunit.client.1.smithi184.stdout:8/20: creat d2/d4/f9 x:0 0 0 2023-12-16T03:15:32.127 INFO:tasks.workunit.client.1.smithi184.stdout:8/21: write d2/d4/f9 [356551,110903] 0 2023-12-16T03:15:32.128 INFO:tasks.workunit.client.1.smithi184.stdout:9/15: dwrite d0/f6 [0,4194304] 0 2023-12-16T03:15:32.130 INFO:tasks.workunit.client.1.smithi184.stdout:8/22: mknod d2/ca 0 2023-12-16T03:15:32.136 INFO:tasks.workunit.client.1.smithi184.stdout:8/23: symlink d2/d4/lb 0 2023-12-16T03:15:32.139 INFO:tasks.workunit.client.1.smithi184.stdout:9/16: dread d0/f6 [0,4194304] 0 2023-12-16T03:15:32.139 INFO:tasks.workunit.client.1.smithi184.stdout:9/17: rename d0 to d0/d8 22 2023-12-16T03:15:32.145 INFO:tasks.workunit.client.1.smithi184.stdout:9/18: rename d0/l4 to d0/l9 0 2023-12-16T03:15:32.148 INFO:tasks.workunit.client.1.smithi184.stdout:9/19: creat d0/fa x:0 0 0 2023-12-16T03:15:32.148 INFO:tasks.workunit.client.1.smithi184.stdout:9/20: write d0/fa [793527,100660] 0 2023-12-16T03:15:32.150 INFO:tasks.workunit.client.1.smithi184.stdout:9/21: unlink d0/f7 0 2023-12-16T03:15:32.150 INFO:tasks.workunit.client.1.smithi184.stdout:9/22: readlink d0/l9 0 2023-12-16T03:15:32.152 INFO:tasks.workunit.client.1.smithi184.stdout:9/23: rename d0/l3 to d0/lb 0 2023-12-16T03:15:32.154 INFO:tasks.workunit.client.1.smithi184.stdout:9/24: rename d0/c5 to d0/cc 0 2023-12-16T03:15:32.156 INFO:tasks.workunit.client.1.smithi184.stdout:8/24: dwrite d2/d4/f9 [0,4194304] 0 2023-12-16T03:15:32.156 INFO:tasks.workunit.client.1.smithi184.stdout:8/25: stat d2/d4/f9 0 2023-12-16T03:15:32.156 INFO:tasks.workunit.client.1.smithi184.stdout:9/25: creat d0/fd x:0 0 0 2023-12-16T03:15:32.159 INFO:tasks.workunit.client.1.smithi184.stdout:8/26: creat d2/fc x:0 0 0 2023-12-16T03:15:32.161 INFO:tasks.workunit.client.1.smithi184.stdout:9/26: creat d0/fe x:0 0 0 2023-12-16T03:15:32.161 INFO:tasks.workunit.client.1.smithi184.stdout:9/27: write d0/fd [830472,4076] 0 2023-12-16T03:15:32.161 INFO:tasks.workunit.client.1.smithi184.stdout:9/28: stat d0/fd 0 2023-12-16T03:15:32.161 INFO:tasks.workunit.client.1.smithi184.stdout:9/29: read d0/fd [482260,84212] 0 2023-12-16T03:15:32.162 INFO:tasks.workunit.client.1.smithi184.stdout:8/27: mkdir d2/dd 0 2023-12-16T03:15:32.163 INFO:tasks.workunit.client.1.smithi184.stdout:9/30: symlink d0/lf 0 2023-12-16T03:15:32.163 INFO:tasks.workunit.client.1.smithi184.stdout:9/31: write d0/fe [844275,7244] 0 2023-12-16T03:15:32.165 INFO:tasks.workunit.client.1.smithi184.stdout:8/28: creat d2/fe x:0 0 0 2023-12-16T03:15:32.165 INFO:tasks.workunit.client.1.smithi184.stdout:9/32: fdatasync d0/fa 0 2023-12-16T03:15:32.167 INFO:tasks.workunit.client.1.smithi184.stdout:8/29: rmdir d2/dd 0 2023-12-16T03:15:32.180 INFO:tasks.workunit.client.1.smithi184.stdout:8/30: dwrite d2/fe [0,4194304] 0 2023-12-16T03:15:32.185 INFO:tasks.workunit.client.1.smithi184.stdout:8/31: rename l1 to d2/d4/lf 0 2023-12-16T03:15:32.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:32 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:15:32.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:32 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:15:32.888 INFO:tasks.workunit.client.1.smithi184.stdout:0/20: rename f2 to f4 0 2023-12-16T03:15:32.889 INFO:tasks.workunit.client.1.smithi184.stdout:0/21: creat f5 x:0 0 0 2023-12-16T03:15:32.889 INFO:tasks.workunit.client.1.smithi184.stdout:0/22: write f5 [143083,17319] 0 2023-12-16T03:15:32.892 INFO:tasks.workunit.client.1.smithi184.stdout:1/12: truncate f0 1557888 0 2023-12-16T03:15:32.894 INFO:tasks.workunit.client.1.smithi184.stdout:1/13: rename c2 to d3/c4 0 2023-12-16T03:15:32.909 INFO:tasks.workunit.client.1.smithi184.stdout:7/22: fsync d0/d3/f5 0 2023-12-16T03:15:32.931 INFO:tasks.workunit.client.1.smithi184.stdout:9/33: getdents d0 0 2023-12-16T03:15:32.932 INFO:tasks.workunit.client.1.smithi184.stdout:7/23: dwrite d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:32.932 INFO:tasks.workunit.client.1.smithi184.stdout:7/24: fdatasync d0/d3/f5 0 2023-12-16T03:15:32.932 INFO:tasks.workunit.client.1.smithi184.stdout:9/34: mknod d0/c10 0 2023-12-16T03:15:32.937 INFO:tasks.workunit.client.1.smithi184.stdout:9/35: mknod d0/c11 0 2023-12-16T03:15:32.938 INFO:tasks.workunit.client.1.smithi184.stdout:9/36: chown d0/fa 11618590 1 2023-12-16T03:15:32.940 INFO:tasks.workunit.client.1.smithi184.stdout:7/25: dread d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:32.940 INFO:tasks.workunit.client.1.smithi184.stdout:7/26: fdatasync d0/d3/f5 0 2023-12-16T03:15:32.941 INFO:tasks.workunit.client.1.smithi184.stdout:7/27: creat d0/d3/f7 x:0 0 0 2023-12-16T03:15:32.942 INFO:tasks.workunit.client.1.smithi184.stdout:9/37: dread d0/fa [0,4194304] 0 2023-12-16T03:15:32.945 INFO:tasks.workunit.client.1.smithi184.stdout:7/28: mkdir d0/d3/d4/d8 0 2023-12-16T03:15:32.945 INFO:tasks.workunit.client.1.smithi184.stdout:7/29: dread - d0/d3/f7 zero size 2023-12-16T03:15:32.945 INFO:tasks.workunit.client.1.smithi184.stdout:7/30: fsync d0/d3/f5 0 2023-12-16T03:15:32.945 INFO:tasks.workunit.client.1.smithi184.stdout:7/31: truncate d0/d3/f7 505861 0 2023-12-16T03:15:32.946 INFO:tasks.workunit.client.1.smithi184.stdout:7/32: fdatasync d0/d3/f7 0 2023-12-16T03:15:32.946 INFO:tasks.workunit.client.1.smithi184.stdout:7/33: readlink d0/l2 0 2023-12-16T03:15:32.946 INFO:tasks.workunit.client.1.smithi184.stdout:9/38: mknod d0/c12 0 2023-12-16T03:15:32.947 INFO:tasks.workunit.client.1.smithi184.stdout:9/39: write d0/f6 [2959779,69433] 0 2023-12-16T03:15:32.950 INFO:tasks.workunit.client.1.smithi184.stdout:9/40: mkdir d0/d13 0 2023-12-16T03:15:32.951 INFO:tasks.workunit.client.1.smithi184.stdout:9/41: creat d0/f14 x:0 0 0 2023-12-16T03:15:32.951 INFO:tasks.workunit.client.1.smithi184.stdout:9/42: write d0/f14 [524933,3336] 0 2023-12-16T03:15:32.954 INFO:tasks.workunit.client.1.smithi184.stdout:9/43: dread d0/fd [0,4194304] 0 2023-12-16T03:15:32.955 INFO:tasks.workunit.client.1.smithi184.stdout:9/44: mknod d0/c15 0 2023-12-16T03:15:32.958 INFO:tasks.workunit.client.1.smithi184.stdout:9/45: link d0/cc d0/c16 0 2023-12-16T03:15:33.099 INFO:tasks.workunit.client.1.smithi184.stdout:0/23: truncate f4 2074754 0 2023-12-16T03:15:33.100 INFO:tasks.workunit.client.1.smithi184.stdout:0/24: link l3 l6 0 2023-12-16T03:15:33.101 INFO:tasks.workunit.client.1.smithi184.stdout:0/25: creat f7 x:0 0 0 2023-12-16T03:15:33.102 INFO:tasks.workunit.client.1.smithi184.stdout:0/26: unlink l6 0 2023-12-16T03:15:33.103 INFO:tasks.workunit.client.1.smithi184.stdout:0/27: rmdir - no directory 2023-12-16T03:15:33.103 INFO:tasks.workunit.client.1.smithi184.stdout:0/28: creat f8 x:0 0 0 2023-12-16T03:15:33.104 INFO:tasks.workunit.client.1.smithi184.stdout:1/14: write f0 [1233310,52192] 0 2023-12-16T03:15:33.104 INFO:tasks.workunit.client.1.smithi184.stdout:1/15: rename d3 to d3/d5 22 2023-12-16T03:15:33.108 INFO:tasks.workunit.client.1.smithi184.stdout:9/46: rmdir d0 39 2023-12-16T03:15:33.108 INFO:tasks.workunit.client.1.smithi184.stdout:9/47: write d0/fd [857607,112423] 0 2023-12-16T03:15:33.113 INFO:tasks.workunit.client.1.smithi184.stdout:9/48: symlink d0/l17 0 2023-12-16T03:15:33.130 INFO:tasks.workunit.client.1.smithi184.stdout:0/29: dwrite f7 [0,4194304] 0 2023-12-16T03:15:33.130 INFO:tasks.workunit.client.1.smithi184.stdout:1/16: dwrite f0 [0,4194304] 0 2023-12-16T03:15:33.142 INFO:tasks.workunit.client.1.smithi184.stdout:0/30: unlink f8 0 2023-12-16T03:15:33.143 INFO:tasks.workunit.client.1.smithi184.stdout:1/17: mkdir d3/d6 0 2023-12-16T03:15:33.144 INFO:tasks.workunit.client.1.smithi184.stdout:0/31: symlink l9 0 2023-12-16T03:15:33.145 INFO:tasks.workunit.client.1.smithi184.stdout:1/18: creat d3/d6/f7 x:0 0 0 2023-12-16T03:15:33.150 INFO:tasks.workunit.client.1.smithi184.stdout:0/32: creat fa x:0 0 0 2023-12-16T03:15:33.151 INFO:tasks.workunit.client.1.smithi184.stdout:1/19: creat d3/f8 x:0 0 0 2023-12-16T03:15:33.151 INFO:tasks.workunit.client.1.smithi184.stdout:1/20: creat d3/f9 x:0 0 0 2023-12-16T03:15:33.151 INFO:tasks.workunit.client.1.smithi184.stdout:1/21: stat d3/d6 0 2023-12-16T03:15:33.167 INFO:tasks.workunit.client.1.smithi184.stdout:9/49: getdents d0 0 2023-12-16T03:15:33.167 INFO:tasks.workunit.client.1.smithi184.stdout:9/50: truncate d0/f6 5189750 0 2023-12-16T03:15:33.169 INFO:tasks.workunit.client.1.smithi184.stdout:9/51: getdents d0 0 2023-12-16T03:15:33.169 INFO:tasks.workunit.client.1.smithi184.stdout:9/52: chown d0/lb 131 1 2023-12-16T03:15:33.178 INFO:tasks.workunit.client.1.smithi184.stdout:1/22: dwrite d3/f9 [0,4194304] 0 2023-12-16T03:15:33.185 INFO:tasks.workunit.client.1.smithi184.stdout:9/53: dwrite d0/fd [0,4194304] 0 2023-12-16T03:15:33.188 INFO:tasks.workunit.client.1.smithi184.stdout:9/54: mknod d0/c18 0 2023-12-16T03:15:33.192 INFO:tasks.workunit.client.1.smithi184.stdout:9/55: rename d0/l9 to d0/l19 0 2023-12-16T03:15:33.193 INFO:tasks.workunit.client.1.smithi184.stdout:9/56: read d0/fe [847890,129687] 0 2023-12-16T03:15:33.193 INFO:tasks.workunit.client.1.smithi184.stdout:9/57: write d0/fa [1707113,55335] 0 2023-12-16T03:15:33.193 INFO:tasks.workunit.client.1.smithi184.stdout:1/23: dwrite f0 [0,4194304] 0 2023-12-16T03:15:33.193 INFO:tasks.workunit.client.1.smithi184.stdout:1/24: fdatasync f0 0 2023-12-16T03:15:33.193 INFO:tasks.workunit.client.1.smithi184.stdout:9/58: write d0/fa [921373,123438] 0 2023-12-16T03:15:33.195 INFO:tasks.workunit.client.1.smithi184.stdout:1/25: creat d3/fa x:0 0 0 2023-12-16T03:15:33.195 INFO:tasks.workunit.client.1.smithi184.stdout:1/26: readlink - no filename 2023-12-16T03:15:33.195 INFO:tasks.workunit.client.1.smithi184.stdout:1/27: creat d3/d6/fb x:0 0 0 2023-12-16T03:15:33.195 INFO:tasks.workunit.client.1.smithi184.stdout:1/28: dread - d3/f8 zero size 2023-12-16T03:15:33.195 INFO:tasks.workunit.client.1.smithi184.stdout:1/29: truncate d3/d6/fb 815430 0 2023-12-16T03:15:33.197 INFO:tasks.workunit.client.1.smithi184.stdout:1/30: write f0 [917966,44463] 0 2023-12-16T03:15:33.199 INFO:tasks.workunit.client.1.smithi184.stdout:9/59: dread d0/fd [0,4194304] 0 2023-12-16T03:15:33.200 INFO:tasks.workunit.client.1.smithi184.stdout:9/60: getdents d0/d13 0 2023-12-16T03:15:33.200 INFO:tasks.workunit.client.1.smithi184.stdout:9/61: write d0/fe [1084172,126374] 0 2023-12-16T03:15:33.201 INFO:tasks.workunit.client.1.smithi184.stdout:9/62: mkdir d0/d13/d1a 0 2023-12-16T03:15:33.202 INFO:tasks.workunit.client.1.smithi184.stdout:9/63: rmdir d0/d13/d1a 0 2023-12-16T03:15:33.204 INFO:tasks.workunit.client.1.smithi184.stdout:9/64: mknod d0/d13/c1b 0 2023-12-16T03:15:33.205 INFO:tasks.workunit.client.1.smithi184.stdout:9/65: write d0/fd [1357453,124081] 0 2023-12-16T03:15:33.228 INFO:tasks.workunit.client.1.smithi184.stdout:1/31: dwrite d3/d6/f7 [0,4194304] 0 2023-12-16T03:15:33.238 INFO:tasks.workunit.client.1.smithi184.stdout:9/66: dwrite d0/fe [0,4194304] 0 2023-12-16T03:15:33.238 INFO:tasks.workunit.client.1.smithi184.stdout:9/67: write d0/fe [2425176,59864] 0 2023-12-16T03:15:33.257 INFO:tasks.workunit.client.1.smithi184.stdout:9/68: dwrite d0/f6 [0,4194304] 0 2023-12-16T03:15:33.260 INFO:tasks.workunit.client.1.smithi184.stdout:1/32: symlink d3/d6/lc 0 2023-12-16T03:15:33.262 INFO:tasks.workunit.client.1.smithi184.stdout:9/69: creat d0/f1c x:0 0 0 2023-12-16T03:15:33.263 INFO:tasks.workunit.client.1.smithi184.stdout:1/33: unlink d3/f8 0 2023-12-16T03:15:33.264 INFO:tasks.workunit.client.1.smithi184.stdout:9/70: creat d0/f1d x:0 0 0 2023-12-16T03:15:33.265 INFO:tasks.workunit.client.1.smithi184.stdout:1/34: unlink d3/d6/fb 0 2023-12-16T03:15:33.267 INFO:tasks.workunit.client.1.smithi184.stdout:9/71: symlink d0/l1e 0 2023-12-16T03:15:33.267 INFO:tasks.workunit.client.1.smithi184.stdout:9/72: dread - d0/f1d zero size 2023-12-16T03:15:33.268 INFO:tasks.workunit.client.1.smithi184.stdout:9/73: rename d0/fa to d0/f1f 0 2023-12-16T03:15:33.272 INFO:tasks.workunit.client.1.smithi184.stdout:1/35: read d3/d6/f7 [3753818,103418] 0 2023-12-16T03:15:33.273 INFO:tasks.workunit.client.1.smithi184.stdout:1/36: mknod d3/d6/cd 0 2023-12-16T03:15:33.273 INFO:tasks.workunit.client.1.smithi184.stdout:1/37: chown d3/c4 21 1 2023-12-16T03:15:33.274 INFO:tasks.workunit.client.1.smithi184.stdout:1/38: write f0 [1495487,72913] 0 2023-12-16T03:15:33.298 INFO:tasks.workunit.client.1.smithi184.stdout:9/74: dwrite d0/f1c [0,4194304] 0 2023-12-16T03:15:33.298 INFO:tasks.workunit.client.1.smithi184.stdout:1/39: dread d3/d6/f7 [0,4194304] 0 2023-12-16T03:15:33.299 INFO:tasks.workunit.client.1.smithi184.stdout:1/40: write d3/f9 [263528,18073] 0 2023-12-16T03:15:33.299 INFO:tasks.workunit.client.1.smithi184.stdout:1/41: write d3/fa [898495,49645] 0 2023-12-16T03:15:33.301 INFO:tasks.workunit.client.1.smithi184.stdout:1/42: fsync f0 0 2023-12-16T03:15:33.304 INFO:tasks.workunit.client.1.smithi184.stdout:1/43: creat d3/d6/fe x:0 0 0 2023-12-16T03:15:33.304 INFO:tasks.workunit.client.1.smithi184.stdout:1/44: chown d3/d6/f7 201 1 2023-12-16T03:15:33.305 INFO:tasks.workunit.client.1.smithi184.stdout:1/45: creat d3/ff x:0 0 0 2023-12-16T03:15:33.307 INFO:tasks.workunit.client.1.smithi184.stdout:1/46: rename c1 to d3/c10 0 2023-12-16T03:15:33.308 INFO:tasks.workunit.client.1.smithi184.stdout:1/47: write d3/fa [1508867,96479] 0 2023-12-16T03:15:33.320 INFO:tasks.workunit.client.1.smithi184.stdout:9/75: dwrite d0/fe [0,4194304] 0 2023-12-16T03:15:33.339 INFO:tasks.workunit.client.1.smithi184.stdout:1/48: dwrite d3/f9 [0,4194304] 0 2023-12-16T03:15:33.341 INFO:tasks.workunit.client.1.smithi184.stdout:9/76: dwrite d0/fe [0,4194304] 0 2023-12-16T03:15:33.342 INFO:tasks.workunit.client.1.smithi184.stdout:9/77: mkdir d0/d13/d20 0 2023-12-16T03:15:33.347 INFO:tasks.workunit.client.1.smithi184.stdout:9/78: read d0/f6 [1201513,56440] 0 2023-12-16T03:15:33.349 INFO:tasks.workunit.client.1.smithi184.stdout:9/79: creat d0/d13/f21 x:0 0 0 2023-12-16T03:15:33.349 INFO:tasks.workunit.client.1.smithi184.stdout:9/80: creat d0/d13/d20/f22 x:0 0 0 2023-12-16T03:15:33.353 INFO:tasks.workunit.client.1.smithi184.stdout:1/49: dwrite d3/d6/fe [0,4194304] 0 2023-12-16T03:15:33.353 INFO:tasks.workunit.client.1.smithi184.stdout:9/81: write d0/f1c [406348,117933] 0 2023-12-16T03:15:33.358 INFO:tasks.workunit.client.1.smithi184.stdout:1/50: symlink d3/l11 0 2023-12-16T03:15:33.360 INFO:tasks.workunit.client.1.smithi184.stdout:9/82: dread d0/f1f [0,4194304] 0 2023-12-16T03:15:33.360 INFO:tasks.workunit.client.1.smithi184.stdout:9/83: truncate d0/f14 728681 0 2023-12-16T03:15:33.360 INFO:tasks.workunit.client.1.smithi184.stdout:9/84: fsync d0/fe 0 2023-12-16T03:15:33.363 INFO:tasks.workunit.client.1.smithi184.stdout:1/51: dread f0 [0,4194304] 0 2023-12-16T03:15:33.364 INFO:tasks.workunit.client.1.smithi184.stdout:1/52: write d3/d6/f7 [240797,70240] 0 2023-12-16T03:15:33.364 INFO:tasks.workunit.client.1.smithi184.stdout:1/53: stat d3/d6/cd 0 2023-12-16T03:15:33.364 INFO:tasks.workunit.client.1.smithi184.stdout:9/85: truncate d0/f1c 1297513 0 2023-12-16T03:15:33.366 INFO:tasks.workunit.client.1.smithi184.stdout:1/54: fsync d3/d6/f7 0 2023-12-16T03:15:33.366 INFO:tasks.workunit.client.1.smithi184.stdout:9/86: mknod d0/d13/c23 0 2023-12-16T03:15:33.369 INFO:tasks.workunit.client.1.smithi184.stdout:1/55: rename d3/fa to d3/d6/f12 0 2023-12-16T03:15:33.369 INFO:tasks.workunit.client.1.smithi184.stdout:9/87: dread d0/f1f [0,4194304] 0 2023-12-16T03:15:33.371 INFO:tasks.workunit.client.1.smithi184.stdout:9/88: creat d0/d13/f24 x:0 0 0 2023-12-16T03:15:33.379 INFO:tasks.workunit.client.1.smithi184.stdout:9/89: dread d0/f6 [0,4194304] 0 2023-12-16T03:15:33.379 INFO:tasks.workunit.client.1.smithi184.stdout:9/90: chown d0 134174189 1 2023-12-16T03:15:33.381 INFO:tasks.workunit.client.1.smithi184.stdout:9/91: rename d0/f6 to d0/d13/d20/f25 0 2023-12-16T03:15:33.381 INFO:tasks.workunit.client.1.smithi184.stdout:9/92: dread - d0/d13/f21 zero size 2023-12-16T03:15:33.382 INFO:tasks.workunit.client.1.smithi184.stdout:9/93: mknod d0/c26 0 2023-12-16T03:15:33.383 INFO:tasks.workunit.client.1.smithi184.stdout:9/94: truncate d0/f1c 907316 0 2023-12-16T03:15:33.383 INFO:tasks.workunit.client.1.smithi184.stdout:9/95: fdatasync d0/d13/f21 0 2023-12-16T03:15:33.383 INFO:tasks.workunit.client.1.smithi184.stdout:9/96: fdatasync d0/d13/d20/f25 0 2023-12-16T03:15:33.384 INFO:tasks.workunit.client.1.smithi184.stdout:9/97: link d0/c2 d0/d13/d20/c27 0 2023-12-16T03:15:33.384 INFO:tasks.workunit.client.1.smithi184.stdout:9/98: fdatasync d0/f14 0 2023-12-16T03:15:33.386 INFO:tasks.workunit.client.1.smithi184.stdout:9/99: dread d0/f1f [0,4194304] 0 2023-12-16T03:15:33.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:33 smithi184 ceph-mon[121180]: pgmap v181: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6.9 MiB/s wr, 620 op/s 2023-12-16T03:15:33.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:33 smithi064 ceph-mon[111958]: pgmap v181: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6.9 MiB/s wr, 620 op/s 2023-12-16T03:15:34.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.549+0000 7f0348d35700 1 -- 172.21.15.64:0/778417433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 msgr2=0x7f03440fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:34.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.549+0000 7f0348d35700 1 --2- 172.21.15.64:0/778417433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 0x7f03440fbf00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0334009ce0 tx=0x7f0334004d10 comp rx=0 tx=0).stop 2023-12-16T03:15:34.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.549+0000 7f0348d35700 1 -- 172.21.15.64:0/778417433 shutdown_connections 2023-12-16T03:15:34.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.549+0000 7f0348d35700 1 --2- 172.21.15.64:0/778417433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440fcd00 0x7f03440fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:34.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.549+0000 7f0348d35700 1 --2- 172.21.15.64:0/778417433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 0x7f03440fbf00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.549+0000 7f0348d35700 1 -- 172.21.15.64:0/778417433 >> 172.21.15.64:0/778417433 conn(0x7f03440f7190 msgr2=0x7f03440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.549+0000 7f0348d35700 1 -- 172.21.15.64:0/778417433 shutdown_connections 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.549+0000 7f0348d35700 1 -- 172.21.15.64:0/778417433 wait complete. 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f0348d35700 1 Processor -- start 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f0348d35700 1 -- start start 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f0348d35700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 0x7f03441126d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f0348d35700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440fcd00 0x7f0344114c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f0348d35700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344066000 con 0x7f03440fbaf0 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f0348d35700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344066140 con 0x7f03440fcd00 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f034259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 0x7f03441126d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f034259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 0x7f03441126d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59738/0 (socket says 172.21.15.64:59738) 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f034259c700 1 -- 172.21.15.64:0/1044040158 learned_addr learned my addr 172.21.15.64:0/1044040158 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:34.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f0341d9b700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440fcd00 0x7f0344114c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:34.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f034259c700 1 -- 172.21.15.64:0/1044040158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440fcd00 msgr2=0x7f0344114c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:34.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f034259c700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440fcd00 0x7f0344114c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:34.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.550+0000 7f034259c700 1 -- 172.21.15.64:0/1044040158 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0334009940 con 0x7f03440fbaf0 2023-12-16T03:15:34.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.551+0000 7f034259c700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 0x7f03441126d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0334004f60 tx=0x7f0334004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:34.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.551+0000 7f033affd700 1 -- 172.21.15.64:0/1044040158 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f033400e040 con 0x7f03440fbaf0 2023-12-16T03:15:34.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.551+0000 7f033affd700 1 -- 172.21.15.64:0/1044040158 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f033401cce0 con 0x7f03440fbaf0 2023-12-16T03:15:34.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.551+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0344115160 con 0x7f03440fbaf0 2023-12-16T03:15:34.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.551+0000 7f033affd700 1 -- 172.21.15.64:0/1044040158 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0334012bf0 con 0x7f03440fbaf0 2023-12-16T03:15:34.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.551+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0344115500 con 0x7f03440fbaf0 2023-12-16T03:15:34.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.552+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03441064d0 con 0x7f03440fbaf0 2023-12-16T03:15:34.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.552+0000 7f033affd700 1 -- 172.21.15.64:0/1044040158 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f033401c830 con 0x7f03440fbaf0 2023-12-16T03:15:34.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.553+0000 7f033affd700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0330068f70 0x7f033006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:34.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.553+0000 7f033affd700 1 -- 172.21.15.64:0/1044040158 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0334089230 con 0x7f03440fbaf0 2023-12-16T03:15:34.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.553+0000 7f0341d9b700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0330068f70 0x7f033006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:34.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.553+0000 7f0341d9b700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0330068f70 0x7f033006b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f032c009b80 tx=0x7f032c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:34.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.557+0000 7f033affd700 1 -- 172.21.15.64:0/1044040158 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f03340555e0 con 0x7f03440fbaf0 2023-12-16T03:15:34.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.775+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f034402b1f0 con 0x7f0330068f70 2023-12-16T03:15:34.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.776+0000 7f033affd700 1 -- 172.21.15.64:0/1044040158 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f034402b1f0 con 0x7f0330068f70 2023-12-16T03:15:34.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0330068f70 msgr2=0x7f033006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0330068f70 0x7f033006b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f032c009b80 tx=0x7f032c00b040 comp rx=0 tx=0).stop 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 msgr2=0x7f03441126d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 0x7f03441126d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0334004f60 tx=0x7f0334004d10 comp rx=0 tx=0).stop 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 shutdown_connections 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f0330068f70 0x7f033006b420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03440fbaf0 0x7f03441126d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 --2- 172.21.15.64:0/1044040158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03440fcd00 0x7f0344114c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 >> 172.21.15.64:0/1044040158 conn(0x7f03440f7190 msgr2=0x7f03440f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 shutdown_connections 2023-12-16T03:15:34.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.778+0000 7f0348d35700 1 -- 172.21.15.64:0/1044040158 wait complete. 2023-12-16T03:15:34.790 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:15:34.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.897+0000 7fd0b5da0700 1 -- 172.21.15.64:0/3747366797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fde00 msgr2=0x7fd0b00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:34.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.897+0000 7fd0b5da0700 1 --2- 172.21.15.64:0/3747366797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fde00 0x7fd0b00fe250 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4004940 tx=0x7fd0a4009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:34.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.897+0000 7fd0b5da0700 1 -- 172.21.15.64:0/3747366797 shutdown_connections 2023-12-16T03:15:34.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.897+0000 7fd0b5da0700 1 --2- 172.21.15.64:0/3747366797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fde00 0x7fd0b00fe250 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:34.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.897+0000 7fd0b5da0700 1 --2- 172.21.15.64:0/3747366797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0b00fcbf0 0x7fd0b00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:34.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.897+0000 7fd0b5da0700 1 -- 172.21.15.64:0/3747366797 >> 172.21.15.64:0/3747366797 conn(0x7fd0b00f82d0 msgr2=0x7fd0b00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:34.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.898+0000 7fd0b5da0700 1 -- 172.21.15.64:0/3747366797 shutdown_connections 2023-12-16T03:15:34.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.898+0000 7fd0b5da0700 1 -- 172.21.15.64:0/3747366797 wait complete. 2023-12-16T03:15:34.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.898+0000 7fd0b5da0700 1 Processor -- start 2023-12-16T03:15:34.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.898+0000 7fd0b5da0700 1 -- start start 2023-12-16T03:15:34.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.898+0000 7fd0b5da0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fcbf0 0x7fd0b010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:34.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.898+0000 7fd0b5da0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0b00fde00 0x7fd0b010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:34.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.898+0000 7fd0b5da0700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b010e030 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.898+0000 7fd0b5da0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b010e8d0 con 0x7fd0b00fde00 2023-12-16T03:15:34.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0af7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fcbf0 0x7fd0b010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:34.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0aeffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0b00fde00 0x7fd0b010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0af7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fcbf0 0x7fd0b010d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59752/0 (socket says 172.21.15.64:59752) 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0aeffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0b00fde00 0x7fd0b010da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.64:53926/0 (socket says 172.21.15.64:53926) 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0af7fe700 1 -- 172.21.15.64:0/4263425276 learned_addr learned my addr 172.21.15.64:0/4263425276 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0af7fe700 1 -- 172.21.15.64:0/4263425276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0b00fde00 msgr2=0x7fd0b010da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0af7fe700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0b00fde00 0x7fd0b010da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0af7fe700 1 -- 172.21.15.64:0/4263425276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a4005040 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0af7fe700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fcbf0 0x7fd0b010d4f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000eb70 tx=0x7fd0a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd097fff700 1 -- 172.21.15.64:0/4263425276 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0a0007cc0 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd097fff700 1 -- 172.21.15.64:0/4263425276 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0a000f040 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd097fff700 1 -- 172.21.15.64:0/4263425276 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0a000c9d0 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b010eb50 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.899+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b010f090 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.900+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b004bb80 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.901+0000 7fd097fff700 1 -- 172.21.15.64:0/4263425276 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd0a000cb30 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.901+0000 7fd097fff700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd098068f60 0x7fd09806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:34.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.901+0000 7fd097fff700 1 -- 172.21.15.64:0/4263425276 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd0a00867b0 con 0x7fd0b00fcbf0 2023-12-16T03:15:34.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.901+0000 7fd0aeffd700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd098068f60 0x7fd09806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:34.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.902+0000 7fd0aeffd700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd098068f60 0x7fd09806b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4013600 tx=0x7fd0a4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:34.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:34.906+0000 7fd097fff700 1 -- 172.21.15.64:0/4263425276 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd0a004da00 con 0x7fd0b00fcbf0 2023-12-16T03:15:35.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.118+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0b010f530 con 0x7fd098068f60 2023-12-16T03:15:35.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.120+0000 7fd097fff700 1 -- 172.21.15.64:0/4263425276 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fd0b010f530 con 0x7fd098068f60 2023-12-16T03:15:35.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd098068f60 msgr2=0x7fd09806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd098068f60 0x7fd09806b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4013600 tx=0x7fd0a4009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:35.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fcbf0 msgr2=0x7fd0b010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fcbf0 0x7fd0b010d4f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000eb70 tx=0x7fd0a000b040 comp rx=0 tx=0).stop 2023-12-16T03:15:35.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 shutdown_connections 2023-12-16T03:15:35.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fd098068f60 0x7fd09806b410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0b00fcbf0 0x7fd0b010d4f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 --2- 172.21.15.64:0/4263425276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0b00fde00 0x7fd0b010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 >> 172.21.15.64:0/4263425276 conn(0x7fd0b00f82d0 msgr2=0x7fd0b0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:35.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 shutdown_connections 2023-12-16T03:15:35.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.122+0000 7fd0b5da0700 1 -- 172.21.15.64:0/4263425276 wait complete. 2023-12-16T03:15:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.226+0000 7f4790b1e700 1 -- 172.21.15.64:0/112632655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0fd730 msgr2=0x7f478c0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.226+0000 7f4790b1e700 1 --2- 172.21.15.64:0/112632655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0fd730 0x7f478c0ffb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f477c004940 tx=0x7f477c009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.226+0000 7f4790b1e700 1 -- 172.21.15.64:0/112632655 shutdown_connections 2023-12-16T03:15:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.226+0000 7f4790b1e700 1 --2- 172.21.15.64:0/112632655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f478c100050 0x7f478c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.226+0000 7f4790b1e700 1 --2- 172.21.15.64:0/112632655 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c0fd730 0x7f478c0ffb10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.226+0000 7f4790b1e700 1 -- 172.21.15.64:0/112632655 >> 172.21.15.64:0/112632655 conn(0x7f478c0f71d0 msgr2=0x7f478c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.226+0000 7f4790b1e700 1 -- 172.21.15.64:0/112632655 shutdown_connections 2023-12-16T03:15:35.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.226+0000 7f4790b1e700 1 -- 172.21.15.64:0/112632655 wait complete. 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.227+0000 7f4790b1e700 1 Processor -- start 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.227+0000 7f4790b1e700 1 -- start start 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.227+0000 7f4790b1e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f478c0fd730 0x7f478c10d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.227+0000 7f4790b1e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c100050 0x7f478c10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.227+0000 7f4790b1e700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c10dfb0 con 0x7f478c100050 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.227+0000 7f4790b1e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c10e850 con 0x7f478c0fd730 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.227+0000 7f4789d9b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c100050 0x7f478c10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.227+0000 7f478a59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f478c0fd730 0x7f478c10d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.227+0000 7f4789d9b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c100050 0x7f478c10d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59772/0 (socket says 172.21.15.64:59772) 2023-12-16T03:15:35.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f4789d9b700 1 -- 172.21.15.64:0/1606506400 learned_addr learned my addr 172.21.15.64:0/1606506400 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f4789d9b700 1 -- 172.21.15.64:0/1606506400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f478c0fd730 msgr2=0x7f478c10d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f4789d9b700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f478c0fd730 0x7f478c10d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f4789d9b700 1 -- 172.21.15.64:0/1606506400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c005040 con 0x7f478c100050 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f478a59c700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f478c0fd730 0x7f478c10d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f4789d9b700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c100050 0x7f478c10d9b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f478000eb40 tx=0x7f478000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f477affd700 1 -- 172.21.15.64:0/1606506400 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4780007cc0 con 0x7f478c100050 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478c10ead0 con 0x7f478c100050 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f477affd700 1 -- 172.21.15.64:0/1606506400 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f478000f040 con 0x7f478c100050 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f477affd700 1 -- 172.21.15.64:0/1606506400 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f478000c990 con 0x7f478c100050 2023-12-16T03:15:35.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.228+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c10f010 con 0x7f478c100050 2023-12-16T03:15:35.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.229+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478c04bb80 con 0x7f478c100050 2023-12-16T03:15:35.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.230+0000 7f477affd700 1 -- 172.21.15.64:0/1606506400 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f478000cc00 con 0x7f478c100050 2023-12-16T03:15:35.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.230+0000 7f477affd700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4774068f70 0x7f477406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:35.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.230+0000 7f477affd700 1 -- 172.21.15.64:0/1606506400 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4780086990 con 0x7f478c100050 2023-12-16T03:15:35.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.230+0000 7f478a59c700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4774068f70 0x7f477406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:35.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.231+0000 7f478a59c700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4774068f70 0x7f477406b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f477c013680 tx=0x7f477c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:35.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.235+0000 7f477affd700 1 -- 172.21.15.64:0/1606506400 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f478004da00 con 0x7f478c100050 2023-12-16T03:15:35.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.443+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f478c10f460 con 0x7f4774068f70 2023-12-16T03:15:35.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.453+0000 7f477affd700 1 -- 172.21.15.64:0/1606506400 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f478c10f460 con 0x7f4774068f70 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (4m) 81s ago 5m 29.3M - 0.25.0 c8568f914cd2 14aee4a706e2 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (5m) 81s ago 5m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (4m) 85s ago 4m 7482k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (4m) 81s ago 5m 88.2M - 9.4.7 954c08fa6188 697184eb15a8 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (95s) 81s ago 94s 12.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (99s) 81s ago 98s 16.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (97s) 85s ago 96s 16.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (93s) 85s ago 93s 13.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:9283 running (6m) 81s ago 6m 496M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f40249c90cfb 2023-12-16T03:15:35.455 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283 running (4m) 85s ago 4m 440M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 9516ab376976 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (6m) 81s ago 6m 75.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (4m) 85s ago 4m 60.7M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (5m) 81s ago 5m 16.1M - 1.5.0 0da6a335fe13 c8706c3a2b59 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (4m) 85s ago 4m 18.3M - 1.5.0 0da6a335fe13 67ad2f701450 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (4m) 81s ago 4m 58.6M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (3m) 81s ago 3m 59.5M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (3m) 81s ago 3m 57.0M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (3m) 85s ago 3m 57.1M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (2m) 85s ago 2m 52.5M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (2m) 85s ago 2m 50.3M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:15:35.456 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (4m) 81s ago 5m 46.5M - 2.43.0 a07b618ecd1d 91a18452d564 2023-12-16T03:15:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4774068f70 msgr2=0x7f477406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4774068f70 0x7f477406b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f477c013680 tx=0x7f477c009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c100050 msgr2=0x7f478c10d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c100050 0x7f478c10d9b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f478000eb40 tx=0x7f478000b040 comp rx=0 tx=0).stop 2023-12-16T03:15:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 shutdown_connections 2023-12-16T03:15:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f4774068f70 0x7f477406b420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f478c0fd730 0x7f478c10d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 --2- 172.21.15.64:0/1606506400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f478c100050 0x7f478c10d9b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 >> 172.21.15.64:0/1606506400 conn(0x7f478c0f71d0 msgr2=0x7f478c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:35.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 shutdown_connections 2023-12-16T03:15:35.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.455+0000 7f4790b1e700 1 -- 172.21.15.64:0/1606506400 wait complete. 2023-12-16T03:15:35.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.564+0000 7fa7587b3700 1 -- 172.21.15.64:0/3223619512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fcd00 msgr2=0x7fa7500fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.564+0000 7fa7587b3700 1 --2- 172.21.15.64:0/3223619512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fcd00 0x7fa7500fd150 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa740004940 tx=0x7fa740009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:35.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.564+0000 7fa7587b3700 1 -- 172.21.15.64:0/3223619512 shutdown_connections 2023-12-16T03:15:35.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.564+0000 7fa7587b3700 1 --2- 172.21.15.64:0/3223619512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fcd00 0x7fa7500fd150 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.564+0000 7fa7587b3700 1 --2- 172.21.15.64:0/3223619512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7500fbaf0 0x7fa7500fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.564+0000 7fa7587b3700 1 -- 172.21.15.64:0/3223619512 >> 172.21.15.64:0/3223619512 conn(0x7fa7500f7190 msgr2=0x7fa7500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:35.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.564+0000 7fa7587b3700 1 -- 172.21.15.64:0/3223619512 shutdown_connections 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.564+0000 7fa7587b3700 1 -- 172.21.15.64:0/3223619512 wait complete. 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.564+0000 7fa7587b3700 1 Processor -- start 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa7587b3700 1 -- start start 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa7587b3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fbaf0 0x7fa75010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa7587b3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7500fcd00 0x7fa75010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa7587b3700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75010e010 con 0x7fa7500fbaf0 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa7587b3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75010e8b0 con 0x7fa7500fcd00 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa75654f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fbaf0 0x7fa75010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa75654f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fbaf0 0x7fa75010d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59804/0 (socket says 172.21.15.64:59804) 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa75654f700 1 -- 172.21.15.64:0/3050460302 learned_addr learned my addr 172.21.15.64:0/3050460302 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa755d4e700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7500fcd00 0x7fa75010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa75654f700 1 -- 172.21.15.64:0/3050460302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7500fcd00 msgr2=0x7fa75010da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa75654f700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7500fcd00 0x7fa75010da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa75654f700 1 -- 172.21.15.64:0/3050460302 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740005040 con 0x7fa7500fbaf0 2023-12-16T03:15:35.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa75654f700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fbaf0 0x7fa75010d4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00eb70 tx=0x7fa74c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:35.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.565+0000 7fa746ffd700 1 -- 172.21.15.64:0/3050460302 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa74c007cc0 con 0x7fa7500fbaf0 2023-12-16T03:15:35.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.566+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75010eb30 con 0x7fa7500fbaf0 2023-12-16T03:15:35.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.566+0000 7fa746ffd700 1 -- 172.21.15.64:0/3050460302 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa74c00f040 con 0x7fa7500fbaf0 2023-12-16T03:15:35.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.566+0000 7fa746ffd700 1 -- 172.21.15.64:0/3050460302 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa74c00c9d0 con 0x7fa7500fbaf0 2023-12-16T03:15:35.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.566+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75010f070 con 0x7fa7500fbaf0 2023-12-16T03:15:35.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.567+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75004bb80 con 0x7fa7500fbaf0 2023-12-16T03:15:35.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.567+0000 7fa746ffd700 1 -- 172.21.15.64:0/3050460302 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa74c00cc40 con 0x7fa7500fbaf0 2023-12-16T03:15:35.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.568+0000 7fa746ffd700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa73c068f60 0x7fa73c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:35.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.568+0000 7fa746ffd700 1 -- 172.21.15.64:0/3050460302 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa74c086850 con 0x7fa7500fbaf0 2023-12-16T03:15:35.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.568+0000 7fa755d4e700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa73c068f60 0x7fa73c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:35.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.568+0000 7fa755d4e700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa73c068f60 0x7fa73c06b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa740000c00 tx=0x7fa740009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:35.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.572+0000 7fa746ffd700 1 -- 172.21.15.64:0/3050460302 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa74c04da00 con 0x7fa7500fbaf0 2023-12-16T03:15:35.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:35 smithi064 ceph-mon[111958]: pgmap v182: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 13 MiB/s wr, 777 op/s 2023-12-16T03:15:35.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:35 smithi184 ceph-mon[121180]: pgmap v182: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 13 MiB/s wr, 777 op/s 2023-12-16T03:15:35.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.854+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa75010f450 con 0x7fa7500fbaf0 2023-12-16T03:15:35.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.855+0000 7fa746ffd700 1 -- 172.21.15.64:0/3050460302 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fa74c0567e0 con 0x7fa7500fbaf0 2023-12-16T03:15:35.856 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:15:35.856 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:15:35.856 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:15:35.856 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:15:35.856 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:15:35.856 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:15:35.857 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:15:35.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa73c068f60 msgr2=0x7fa73c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa73c068f60 0x7fa73c06b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa740000c00 tx=0x7fa740009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:35.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fbaf0 msgr2=0x7fa75010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fbaf0 0x7fa75010d4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00eb70 tx=0x7fa74c00b040 comp rx=0 tx=0).stop 2023-12-16T03:15:35.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 shutdown_connections 2023-12-16T03:15:35.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7fa73c068f60 0x7fa73c06b410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7500fbaf0 0x7fa75010d4d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 --2- 172.21.15.64:0/3050460302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7500fcd00 0x7fa75010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 >> 172.21.15.64:0/3050460302 conn(0x7fa7500f7190 msgr2=0x7fa750065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:35.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 shutdown_connections 2023-12-16T03:15:35.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.857+0000 7fa7587b3700 1 -- 172.21.15.64:0/3050460302 wait complete. 2023-12-16T03:15:35.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/1794059365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fbb00 msgr2=0x7f9d240fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 --2- 172.21.15.64:0/1794059365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fbb00 0x7f9d240fbf10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9d18004940 tx=0x7f9d18009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/1794059365 shutdown_connections 2023-12-16T03:15:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 --2- 172.21.15.64:0/1794059365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d240fcd10 0x7f9d240fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 --2- 172.21.15.64:0/1794059365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fbb00 0x7f9d240fbf10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/1794059365 >> 172.21.15.64:0/1794059365 conn(0x7f9d240f71c0 msgr2=0x7f9d240f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/1794059365 shutdown_connections 2023-12-16T03:15:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/1794059365 wait complete. 2023-12-16T03:15:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 Processor -- start 2023-12-16T03:15:35.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.963+0000 7f9d2b1e2700 1 -- start start 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d2b1e2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d240fbb00 0x7f9d2410c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d2b1e2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fcd10 0x7f9d2410c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d2b1e2700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2410cfb0 con 0x7f9d240fcd10 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d2b1e2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2410d850 con 0x7f9d240fbb00 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d23fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fcd10 0x7f9d2410c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d23fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fcd10 0x7f9d2410c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59826/0 (socket says 172.21.15.64:59826) 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d23fff700 1 -- 172.21.15.64:0/4282532904 learned_addr learned my addr 172.21.15.64:0/4282532904 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d28f7e700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d240fbb00 0x7f9d2410c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d23fff700 1 -- 172.21.15.64:0/4282532904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d240fbb00 msgr2=0x7f9d2410c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d23fff700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d240fbb00 0x7f9d2410c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d23fff700 1 -- 172.21.15.64:0/4282532904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18005040 con 0x7f9d240fcd10 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.964+0000 7f9d23fff700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fcd10 0x7f9d2410c9b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000fce0 tx=0x7f9d100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.965+0000 7f9d217fa700 1 -- 172.21.15.64:0/4282532904 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d10007ea0 con 0x7f9d240fcd10 2023-12-16T03:15:35.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.965+0000 7f9d217fa700 1 -- 172.21.15.64:0/4282532904 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d1000dd80 con 0x7f9d240fcd10 2023-12-16T03:15:35.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.965+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2410dad0 con 0x7f9d240fcd10 2023-12-16T03:15:35.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.965+0000 7f9d217fa700 1 -- 172.21.15.64:0/4282532904 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d10012460 con 0x7f9d240fcd10 2023-12-16T03:15:35.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.965+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2410e010 con 0x7f9d240fcd10 2023-12-16T03:15:35.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.966+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2404bb80 con 0x7f9d240fcd10 2023-12-16T03:15:35.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.966+0000 7f9d217fa700 1 -- 172.21.15.64:0/4282532904 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9d1000d8d0 con 0x7f9d240fcd10 2023-12-16T03:15:35.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.966+0000 7f9d217fa700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9d14068f60 0x7f9d1406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:15:35.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.966+0000 7f9d217fa700 1 -- 172.21.15.64:0/4282532904 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9d100894b0 con 0x7f9d240fcd10 2023-12-16T03:15:35.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.966+0000 7f9d28f7e700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9d14068f60 0x7f9d1406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:15:35.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.967+0000 7f9d28f7e700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9d14068f60 0x7f9d1406b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d18004890 tx=0x7f9d18009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:15:35.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:35.971+0000 7f9d217fa700 1 -- 172.21.15.64:0/4282532904 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9d10059390 con 0x7f9d240fcd10 2023-12-16T03:15:36.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.326+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d2410e4a0 con 0x7f9d14068f60 2023-12-16T03:15:36.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.330+0000 7f9d217fa700 1 -- 172.21.15.64:0/4282532904 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f9d2410e4a0 con 0x7f9d14068f60 2023-12-16T03:15:36.332 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:15:36.332 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:15:36.333 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:15:36.333 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T03:15:36.333 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [], 2023-12-16T03:15:36.333 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "0/2 daemons upgraded", 2023-12-16T03:15:36.333 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 image on host smithi184", 2023-12-16T03:15:36.333 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:15:36.333 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:15:36.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.339+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9d14068f60 msgr2=0x7f9d1406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:36.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.339+0000 7f9d2b1e2700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9d14068f60 0x7f9d1406b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d18004890 tx=0x7f9d18009e30 comp rx=0 tx=0).stop 2023-12-16T03:15:36.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.339+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fcd10 msgr2=0x7f9d2410c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:15:36.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.339+0000 7f9d2b1e2700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fcd10 0x7f9d2410c9b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000fce0 tx=0x7f9d100046b0 comp rx=0 tx=0).stop 2023-12-16T03:15:36.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.340+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 shutdown_connections 2023-12-16T03:15:36.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.340+0000 7f9d2b1e2700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f9d14068f60 0x7f9d1406b410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:36.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.340+0000 7f9d2b1e2700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d240fbb00 0x7f9d2410c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:36.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.340+0000 7f9d2b1e2700 1 --2- 172.21.15.64:0/4282532904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d240fcd10 0x7f9d2410c9b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:15:36.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.340+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 >> 172.21.15.64:0/4282532904 conn(0x7f9d240f71c0 msgr2=0x7f9d240f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:15:36.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.341+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 shutdown_connections 2023-12-16T03:15:36.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:15:36.341+0000 7f9d2b1e2700 1 -- 172.21.15.64:0/4282532904 wait complete. 2023-12-16T03:15:36.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:36 smithi184 ceph-mon[121180]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:36.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:36 smithi184 ceph-mon[121180]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:36.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:36 smithi184 ceph-mon[121180]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:36.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:36 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3050460302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:15:36.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:36 smithi064 ceph-mon[111958]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:36.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:36 smithi064 ceph-mon[111958]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:36.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:36 smithi064 ceph-mon[111958]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:36.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:36 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3050460302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:15:37.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:37 smithi184 ceph-mon[121180]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:37.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:37 smithi184 ceph-mon[121180]: pgmap v183: 65 pgs: 65 active+clean; 181 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 777 op/s 2023-12-16T03:15:37.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:37 smithi064 ceph-mon[111958]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:15:37.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:37 smithi064 ceph-mon[111958]: pgmap v183: 65 pgs: 65 active+clean; 181 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 777 op/s 2023-12-16T03:15:39.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:39 smithi184 ceph-mon[121180]: pgmap v184: 65 pgs: 65 active+clean; 202 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 861 op/s 2023-12-16T03:15:39.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:39 smithi064 ceph-mon[111958]: pgmap v184: 65 pgs: 65 active+clean; 202 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 861 op/s 2023-12-16T03:15:41.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:41 smithi184 ceph-mon[121180]: pgmap v185: 65 pgs: 65 active+clean; 219 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 783 op/s 2023-12-16T03:15:41.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:41 smithi064 ceph-mon[111958]: pgmap v185: 65 pgs: 65 active+clean; 219 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 783 op/s 2023-12-16T03:15:43.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:43 smithi184 ceph-mon[121180]: pgmap v186: 65 pgs: 65 active+clean; 225 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 535 op/s 2023-12-16T03:15:43.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:43 smithi064 ceph-mon[111958]: pgmap v186: 65 pgs: 65 active+clean; 225 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 535 op/s 2023-12-16T03:15:45.055 INFO:tasks.workunit.client.0.smithi064.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-16T03:15:45.057 INFO:tasks.workunit.client.0.smithi064.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T03:15:45.057 INFO:tasks.workunit.client.0.smithi064.stderr:+ make 2023-12-16T03:15:45.101 INFO:tasks.workunit.client.0.smithi064.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-16T03:15:45.326 INFO:tasks.workunit.client.0.smithi064.stderr:++ readlink -f fsstress 2023-12-16T03:15:45.326 INFO:tasks.workunit.client.0.smithi064.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-16T03:15:45.326 INFO:tasks.workunit.client.0.smithi064.stderr:+ popd 2023-12-16T03:15:45.327 INFO:tasks.workunit.client.0.smithi064.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T03:15:45.327 INFO:tasks.workunit.client.0.smithi064.stderr:+ popd 2023-12-16T03:15:45.328 INFO:tasks.workunit.client.0.smithi064.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-16T03:15:45.328 INFO:tasks.workunit.client.0.smithi064.stderr:++ mktemp -d -p . 2023-12-16T03:15:45.329 INFO:tasks.workunit.client.0.smithi064.stderr:+ T=./tmp.RvMpVPfdoc 2023-12-16T03:15:45.329 INFO:tasks.workunit.client.0.smithi064.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.RvMpVPfdoc -l 1 -n 1000 -p 10 -v 2023-12-16T03:15:45.330 INFO:tasks.workunit.client.0.smithi064.stdout:seed = 1702371240 2023-12-16T03:15:45.332 INFO:tasks.workunit.client.0.smithi064.stdout:0/0: dread - no filename 2023-12-16T03:15:45.333 INFO:tasks.workunit.client.0.smithi064.stdout:1/0: dread - no filename 2023-12-16T03:15:45.333 INFO:tasks.workunit.client.0.smithi064.stdout:0/1: symlink l0 0 2023-12-16T03:15:45.333 INFO:tasks.workunit.client.0.smithi064.stdout:0/2: stat l0 0 2023-12-16T03:15:45.335 INFO:tasks.workunit.client.0.smithi064.stdout:0/3: unlink l0 0 2023-12-16T03:15:45.335 INFO:tasks.workunit.client.0.smithi064.stdout:0/4: fsync - no filename 2023-12-16T03:15:45.335 INFO:tasks.workunit.client.0.smithi064.stdout:0/5: write - no filename 2023-12-16T03:15:45.335 INFO:tasks.workunit.client.0.smithi064.stdout:3/0: write - no filename 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:3/1: dread - no filename 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:3/2: rename - no filename 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:3/3: write - no filename 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:3/4: chown . 2028 1 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:3/5: chown . 1 1 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:3/6: truncate - no filename 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:2/0: mknod c0 0 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:2/1: write - no filename 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:2/2: write - no filename 2023-12-16T03:15:45.336 INFO:tasks.workunit.client.0.smithi064.stdout:2/3: rmdir - no directory 2023-12-16T03:15:45.337 INFO:tasks.workunit.client.0.smithi064.stdout:0/6: creat f1 x:0 0 0 2023-12-16T03:15:45.337 INFO:tasks.workunit.client.0.smithi064.stdout:0/7: dread - f1 zero size 2023-12-16T03:15:45.337 INFO:tasks.workunit.client.0.smithi064.stdout:4/0: stat - no entries 2023-12-16T03:15:45.337 INFO:tasks.workunit.client.0.smithi064.stdout:4/1: write - no filename 2023-12-16T03:15:45.340 INFO:tasks.workunit.client.0.smithi064.stdout:3/7: creat f0 x:0 0 0 2023-12-16T03:15:45.340 INFO:tasks.workunit.client.0.smithi064.stdout:2/4: mkdir d1 0 2023-12-16T03:15:45.340 INFO:tasks.workunit.client.0.smithi064.stdout:3/8: dread - f0 zero size 2023-12-16T03:15:45.340 INFO:tasks.workunit.client.0.smithi064.stdout:3/9: read - f0 zero size 2023-12-16T03:15:45.340 INFO:tasks.workunit.client.0.smithi064.stdout:3/10: rmdir - no directory 2023-12-16T03:15:45.340 INFO:tasks.workunit.client.0.smithi064.stdout:0/8: mkdir d2 0 2023-12-16T03:15:45.343 INFO:tasks.workunit.client.0.smithi064.stdout:4/2: mkdir d0 0 2023-12-16T03:15:45.343 INFO:tasks.workunit.client.0.smithi064.stdout:4/3: write - no filename 2023-12-16T03:15:45.344 INFO:tasks.workunit.client.0.smithi064.stdout:4/4: unlink - no file 2023-12-16T03:15:45.344 INFO:tasks.workunit.client.0.smithi064.stdout:4/5: readlink - no filename 2023-12-16T03:15:45.344 INFO:tasks.workunit.client.0.smithi064.stdout:2/5: mknod d1/c2 0 2023-12-16T03:15:45.344 INFO:tasks.workunit.client.0.smithi064.stdout:2/6: dread - no filename 2023-12-16T03:15:45.344 INFO:tasks.workunit.client.0.smithi064.stdout:2/7: truncate - no filename 2023-12-16T03:15:45.346 INFO:tasks.workunit.client.0.smithi064.stdout:4/6: creat d0/f1 x:0 0 0 2023-12-16T03:15:45.346 INFO:tasks.workunit.client.0.smithi064.stdout:4/7: chown d0/f1 3789 1 2023-12-16T03:15:45.346 INFO:tasks.workunit.client.0.smithi064.stdout:4/8: dread - d0/f1 zero size 2023-12-16T03:15:45.346 INFO:tasks.workunit.client.0.smithi064.stdout:4/9: read - d0/f1 zero size 2023-12-16T03:15:45.348 INFO:tasks.workunit.client.0.smithi064.stdout:3/11: creat f1 x:0 0 0 2023-12-16T03:15:45.348 INFO:tasks.workunit.client.0.smithi064.stdout:3/12: truncate f1 95649 0 2023-12-16T03:15:45.354 INFO:tasks.workunit.client.0.smithi064.stdout:5/0: mkdir d0 0 2023-12-16T03:15:45.354 INFO:tasks.workunit.client.0.smithi064.stdout:5/1: dwrite - no filename 2023-12-16T03:15:45.354 INFO:tasks.workunit.client.0.smithi064.stdout:5/2: rename d0 to d0/d1 22 2023-12-16T03:15:45.355 INFO:tasks.workunit.client.0.smithi064.stdout:4/10: creat d0/f2 x:0 0 0 2023-12-16T03:15:45.356 INFO:tasks.workunit.client.0.smithi064.stdout:3/13: symlink l2 0 2023-12-16T03:15:45.369 INFO:tasks.workunit.client.0.smithi064.stdout:5/3: creat d0/f2 x:0 0 0 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:5/4: creat d0/f3 x:0 0 0 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:4/11: symlink d0/l3 0 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:6/0: symlink l0 0 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:6/1: dread - no filename 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:5/5: write d0/f2 [229306,44232] 0 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:6/2: chown l0 3 1 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:6/3: dwrite - no filename 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:6/4: write - no filename 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:5/6: write d0/f3 [4723,22841] 0 2023-12-16T03:15:45.375 INFO:tasks.workunit.client.0.smithi064.stdout:5/7: readlink - no filename 2023-12-16T03:15:45.376 INFO:tasks.workunit.client.0.smithi064.stdout:7/0: rename - no filename 2023-12-16T03:15:45.376 INFO:tasks.workunit.client.0.smithi064.stdout:7/1: rename - no filename 2023-12-16T03:15:45.381 INFO:tasks.workunit.client.0.smithi064.stdout:4/12: mknod d0/c4 0 2023-12-16T03:15:45.381 INFO:tasks.workunit.client.0.smithi064.stdout:4/13: read - d0/f1 zero size 2023-12-16T03:15:45.381 INFO:tasks.workunit.client.0.smithi064.stdout:4/14: fdatasync d0/f1 0 2023-12-16T03:15:45.381 INFO:tasks.workunit.client.0.smithi064.stdout:6/5: creat f1 x:0 0 0 2023-12-16T03:15:45.388 INFO:tasks.workunit.client.0.smithi064.stdout:8/0: truncate - no filename 2023-12-16T03:15:45.388 INFO:tasks.workunit.client.0.smithi064.stdout:8/1: chown . 57639 1 2023-12-16T03:15:45.389 INFO:tasks.workunit.client.0.smithi064.stdout:7/2: symlink l0 0 2023-12-16T03:15:45.389 INFO:tasks.workunit.client.0.smithi064.stdout:4/15: creat d0/f5 x:0 0 0 2023-12-16T03:15:45.392 INFO:tasks.workunit.client.0.smithi064.stdout:6/6: creat f2 x:0 0 0 2023-12-16T03:15:45.392 INFO:tasks.workunit.client.0.smithi064.stdout:6/7: stat l0 0 2023-12-16T03:15:45.395 INFO:tasks.workunit.client.0.smithi064.stdout:8/2: mkdir d0 0 2023-12-16T03:15:45.395 INFO:tasks.workunit.client.0.smithi064.stdout:8/3: dwrite - no filename 2023-12-16T03:15:45.395 INFO:tasks.workunit.client.0.smithi064.stdout:8/4: dwrite - no filename 2023-12-16T03:15:45.395 INFO:tasks.workunit.client.0.smithi064.stdout:8/5: stat d0 0 2023-12-16T03:15:45.397 INFO:tasks.workunit.client.0.smithi064.stdout:7/3: creat f1 x:0 0 0 2023-12-16T03:15:45.398 INFO:tasks.workunit.client.0.smithi064.stdout:9/0: dread - no filename 2023-12-16T03:15:45.398 INFO:tasks.workunit.client.0.smithi064.stdout:9/1: write - no filename 2023-12-16T03:15:45.400 INFO:tasks.workunit.client.0.smithi064.stdout:4/16: symlink d0/l6 0 2023-12-16T03:15:45.401 INFO:tasks.workunit.client.0.smithi064.stdout:8/6: symlink d0/l1 0 2023-12-16T03:15:45.402 INFO:tasks.workunit.client.0.smithi064.stdout:9/2: symlink l0 0 2023-12-16T03:15:45.410 INFO:tasks.workunit.client.0.smithi064.stdout:4/17: mknod d0/c7 0 2023-12-16T03:15:45.410 INFO:tasks.workunit.client.0.smithi064.stdout:8/7: rmdir d0 39 2023-12-16T03:15:45.410 INFO:tasks.workunit.client.0.smithi064.stdout:9/3: creat f1 x:0 0 0 2023-12-16T03:15:45.415 INFO:tasks.workunit.client.0.smithi064.stdout:4/18: creat d0/f8 x:0 0 0 2023-12-16T03:15:45.415 INFO:tasks.workunit.client.0.smithi064.stdout:4/19: chown d0/c4 13449806 1 2023-12-16T03:15:45.421 INFO:tasks.workunit.client.0.smithi064.stdout:4/20: symlink d0/l9 0 2023-12-16T03:15:45.421 INFO:tasks.workunit.client.0.smithi064.stdout:4/21: chown d0 171663 1 2023-12-16T03:15:45.421 INFO:tasks.workunit.client.0.smithi064.stdout:4/22: dread - d0/f5 zero size 2023-12-16T03:15:45.436 INFO:tasks.workunit.client.0.smithi064.stdout:4/23: mkdir d0/da 0 2023-12-16T03:15:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:45 smithi064 ceph-mon[111958]: pgmap v187: 65 pgs: 65 active+clean; 229 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 394 op/s 2023-12-16T03:15:45.741 INFO:tasks.workunit.client.0.smithi064.stdout:0/9: dwrite f1 [0,4194304] 0 2023-12-16T03:15:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:45 smithi184 ceph-mon[121180]: pgmap v187: 65 pgs: 65 active+clean; 229 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 394 op/s 2023-12-16T03:15:46.097 INFO:tasks.workunit.client.0.smithi064.stdout:2/8: getdents d1 0 2023-12-16T03:15:46.097 INFO:tasks.workunit.client.0.smithi064.stdout:2/9: truncate - no filename 2023-12-16T03:15:46.097 INFO:tasks.workunit.client.0.smithi064.stdout:2/10: write - no filename 2023-12-16T03:15:46.097 INFO:tasks.workunit.client.0.smithi064.stdout:2/11: dread - no filename 2023-12-16T03:15:46.097 INFO:tasks.workunit.client.0.smithi064.stdout:2/12: fdatasync - no filename 2023-12-16T03:15:46.097 INFO:tasks.workunit.client.0.smithi064.stdout:2/13: read - no filename 2023-12-16T03:15:46.097 INFO:tasks.workunit.client.0.smithi064.stdout:2/14: dread - no filename 2023-12-16T03:15:46.097 INFO:tasks.workunit.client.0.smithi064.stdout:2/15: stat d1 0 2023-12-16T03:15:46.098 INFO:tasks.workunit.client.0.smithi064.stdout:2/16: truncate - no filename 2023-12-16T03:15:46.102 INFO:tasks.workunit.client.0.smithi064.stdout:3/14: getdents . 0 2023-12-16T03:15:46.312 INFO:tasks.workunit.client.0.smithi064.stdout:8/8: rmdir d0 39 2023-12-16T03:15:46.312 INFO:tasks.workunit.client.0.smithi064.stdout:8/9: read - no filename 2023-12-16T03:15:46.342 INFO:tasks.workunit.client.0.smithi064.stdout:9/4: fsync f1 0 2023-12-16T03:15:46.342 INFO:tasks.workunit.client.0.smithi064.stdout:9/5: write f1 [307407,88665] 0 2023-12-16T03:15:46.387 INFO:tasks.workunit.client.0.smithi064.stdout:5/8: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:15:46.621 INFO:tasks.workunit.client.0.smithi064.stdout:0/10: dread f1 [0,4194304] 0 2023-12-16T03:15:46.629 INFO:tasks.workunit.client.0.smithi064.stdout:5/9: dread d0/f3 [0,4194304] 0 2023-12-16T03:15:46.630 INFO:tasks.workunit.client.0.smithi064.stdout:5/10: dread d0/f3 [0,4194304] 0 2023-12-16T03:15:46.630 INFO:tasks.workunit.client.0.smithi064.stdout:5/11: chown d0/f2 838987 1 2023-12-16T03:15:46.630 INFO:tasks.workunit.client.0.smithi064.stdout:5/12: fdatasync d0/f3 0 2023-12-16T03:15:46.630 INFO:tasks.workunit.client.0.smithi064.stdout:5/13: fdatasync d0/f3 0 2023-12-16T03:15:46.959 INFO:tasks.workunit.client.0.smithi064.stdout:7/4: dwrite f1 [0,4194304] 0 2023-12-16T03:15:46.979 INFO:tasks.workunit.client.0.smithi064.stdout:7/5: dread f1 [0,4194304] 0 2023-12-16T03:15:46.998 INFO:tasks.workunit.client.0.smithi064.stdout:7/6: dwrite f1 [0,4194304] 0 2023-12-16T03:15:46.998 INFO:tasks.workunit.client.0.smithi064.stdout:7/7: chown f1 36690 1 2023-12-16T03:15:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:47 smithi184 ceph-mon[121180]: pgmap v188: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 6.6 MiB/s wr, 281 op/s 2023-12-16T03:15:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:47 smithi064 ceph-mon[111958]: pgmap v188: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 6.6 MiB/s wr, 281 op/s 2023-12-16T03:15:47.915 INFO:tasks.workunit.client.1.smithi184.stdout:9/100: sync 2023-12-16T03:15:47.915 INFO:tasks.workunit.client.1.smithi184.stdout:0/33: sync 2023-12-16T03:15:47.915 INFO:tasks.workunit.client.1.smithi184.stdout:1/56: sync 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:6/11: sync 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:0/34: readlink l3 0 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:6/12: stat d0 0 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:6/13: dwrite - no filename 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:6/14: chown d0 42699 1 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:6/15: unlink - no file 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:6/16: truncate - no filename 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:4/40: sync 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:3/4: sync 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:5/12: sync 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:7/34: sync 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:8/32: sync 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:2/7: sync 2023-12-16T03:15:47.916 INFO:tasks.workunit.client.1.smithi184.stdout:8/33: chown d2/d4/lf 55 1 2023-12-16T03:15:47.919 INFO:tasks.workunit.client.1.smithi184.stdout:1/57: mkdir d3/d13 0 2023-12-16T03:15:47.919 INFO:tasks.workunit.client.1.smithi184.stdout:9/101: rename d0/d13/d20/f25 to d0/d13/d20/f28 0 2023-12-16T03:15:47.919 INFO:tasks.workunit.client.1.smithi184.stdout:6/17: mknod d0/c1 0 2023-12-16T03:15:47.920 INFO:tasks.workunit.client.1.smithi184.stdout:0/35: dread f5 [0,4194304] 0 2023-12-16T03:15:47.920 INFO:tasks.workunit.client.1.smithi184.stdout:0/36: truncate f5 909123 0 2023-12-16T03:15:47.920 INFO:tasks.workunit.client.1.smithi184.stdout:4/41: getdents d1 0 2023-12-16T03:15:47.921 INFO:tasks.workunit.client.1.smithi184.stdout:4/42: chown l0 2044454 1 2023-12-16T03:15:47.923 INFO:tasks.workunit.client.1.smithi184.stdout:3/5: rename f0 to f2 0 2023-12-16T03:15:47.923 INFO:tasks.workunit.client.1.smithi184.stdout:3/6: write f2 [513837,1463] 0 2023-12-16T03:15:47.923 INFO:tasks.workunit.client.1.smithi184.stdout:3/7: chown f2 43 1 2023-12-16T03:15:47.923 INFO:tasks.workunit.client.1.smithi184.stdout:3/8: stat c1 0 2023-12-16T03:15:47.924 INFO:tasks.workunit.client.1.smithi184.stdout:7/35: truncate d0/d3/f7 1107866 0 2023-12-16T03:15:47.925 INFO:tasks.workunit.client.1.smithi184.stdout:8/34: dread d2/fe [0,4194304] 0 2023-12-16T03:15:47.925 INFO:tasks.workunit.client.1.smithi184.stdout:4/43: dread d1/f4 [0,4194304] 0 2023-12-16T03:15:47.926 INFO:tasks.workunit.client.1.smithi184.stdout:2/8: creat f0 x:0 0 0 2023-12-16T03:15:47.928 INFO:tasks.workunit.client.1.smithi184.stdout:1/58: symlink d3/l14 0 2023-12-16T03:15:47.929 INFO:tasks.workunit.client.1.smithi184.stdout:9/102: creat d0/d13/d20/f29 x:0 0 0 2023-12-16T03:15:47.929 INFO:tasks.workunit.client.1.smithi184.stdout:9/103: readlink d0/l19 0 2023-12-16T03:15:47.930 INFO:tasks.workunit.client.1.smithi184.stdout:6/18: link d0/c1 d0/c2 0 2023-12-16T03:15:47.930 INFO:tasks.workunit.client.1.smithi184.stdout:6/19: rename d0 to d0/d3 22 2023-12-16T03:15:47.930 INFO:tasks.workunit.client.1.smithi184.stdout:6/20: read - no filename 2023-12-16T03:15:47.931 INFO:tasks.workunit.client.1.smithi184.stdout:0/37: symlink lb 0 2023-12-16T03:15:47.931 INFO:tasks.workunit.client.1.smithi184.stdout:0/38: chown f5 1641925545 1 2023-12-16T03:15:47.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/9: symlink l3 0 2023-12-16T03:15:47.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/10: chown c1 38665565 1 2023-12-16T03:15:47.933 INFO:tasks.workunit.client.1.smithi184.stdout:7/36: rename d0/d3/d4/d8 to d0/d3/d4/d9 0 2023-12-16T03:15:47.933 INFO:tasks.workunit.client.1.smithi184.stdout:7/37: chown d0/l2 163029 1 2023-12-16T03:15:47.934 INFO:tasks.workunit.client.1.smithi184.stdout:7/38: chown d0 982312727 1 2023-12-16T03:15:47.935 INFO:tasks.workunit.client.1.smithi184.stdout:5/13: dwrite d1/f2 [0,4194304] 0 2023-12-16T03:15:47.936 INFO:tasks.workunit.client.1.smithi184.stdout:4/44: creat d1/fd x:0 0 0 2023-12-16T03:15:47.937 INFO:tasks.workunit.client.1.smithi184.stdout:2/9: symlink l1 0 2023-12-16T03:15:47.937 INFO:tasks.workunit.client.1.smithi184.stdout:2/10: dread - f0 zero size 2023-12-16T03:15:47.938 INFO:tasks.workunit.client.1.smithi184.stdout:6/21: symlink d0/l4 0 2023-12-16T03:15:47.938 INFO:tasks.workunit.client.1.smithi184.stdout:6/22: write - no filename 2023-12-16T03:15:47.938 INFO:tasks.workunit.client.1.smithi184.stdout:6/23: dwrite - no filename 2023-12-16T03:15:47.938 INFO:tasks.workunit.client.1.smithi184.stdout:6/24: truncate - no filename 2023-12-16T03:15:47.938 INFO:tasks.workunit.client.1.smithi184.stdout:6/25: write - no filename 2023-12-16T03:15:47.939 INFO:tasks.workunit.client.1.smithi184.stdout:1/59: dread d3/d6/f7 [0,4194304] 0 2023-12-16T03:15:47.940 INFO:tasks.workunit.client.1.smithi184.stdout:0/39: mkdir dc 0 2023-12-16T03:15:47.940 INFO:tasks.workunit.client.1.smithi184.stdout:9/104: dread d0/fe [0,4194304] 0 2023-12-16T03:15:47.940 INFO:tasks.workunit.client.1.smithi184.stdout:9/105: readlink d0/l1e 0 2023-12-16T03:15:47.940 INFO:tasks.workunit.client.1.smithi184.stdout:0/40: truncate f4 2504305 0 2023-12-16T03:15:47.940 INFO:tasks.workunit.client.1.smithi184.stdout:9/106: chown d0/lb 668631067 1 2023-12-16T03:15:47.942 INFO:tasks.workunit.client.1.smithi184.stdout:3/11: creat f4 x:0 0 0 2023-12-16T03:15:47.942 INFO:tasks.workunit.client.1.smithi184.stdout:3/12: write f2 [1427387,111460] 0 2023-12-16T03:15:47.942 INFO:tasks.workunit.client.1.smithi184.stdout:3/13: write f4 [922990,31148] 0 2023-12-16T03:15:47.947 INFO:tasks.workunit.client.1.smithi184.stdout:4/45: creat d1/fe x:0 0 0 2023-12-16T03:15:47.949 INFO:tasks.workunit.client.1.smithi184.stdout:3/14: write f2 [240642,93345] 0 2023-12-16T03:15:47.952 INFO:tasks.workunit.client.1.smithi184.stdout:8/35: write d2/d4/f9 [3389711,128915] 0 2023-12-16T03:15:47.952 INFO:tasks.workunit.client.1.smithi184.stdout:8/36: chown d2/fc 3384 1 2023-12-16T03:15:47.954 INFO:tasks.workunit.client.1.smithi184.stdout:8/37: write d2/d4/f9 [2695637,112067] 0 2023-12-16T03:15:47.955 INFO:tasks.workunit.client.1.smithi184.stdout:1/60: symlink d3/d6/l15 0 2023-12-16T03:15:47.955 INFO:tasks.workunit.client.1.smithi184.stdout:3/15: mknod c5 0 2023-12-16T03:15:47.955 INFO:tasks.workunit.client.1.smithi184.stdout:9/107: creat d0/d13/f2a x:0 0 0 2023-12-16T03:15:47.955 INFO:tasks.workunit.client.1.smithi184.stdout:9/108: dread - d0/f1d zero size 2023-12-16T03:15:47.957 INFO:tasks.workunit.client.1.smithi184.stdout:1/61: creat d3/f16 x:0 0 0 2023-12-16T03:15:47.958 INFO:tasks.workunit.client.1.smithi184.stdout:4/46: mknod d1/cf 0 2023-12-16T03:15:47.963 INFO:tasks.workunit.client.1.smithi184.stdout:9/109: mknod d0/d13/d20/c2b 0 2023-12-16T03:15:47.963 INFO:tasks.workunit.client.1.smithi184.stdout:1/62: mknod d3/c17 0 2023-12-16T03:15:47.963 INFO:tasks.workunit.client.1.smithi184.stdout:9/110: fsync d0/d13/d20/f22 0 2023-12-16T03:15:47.963 INFO:tasks.workunit.client.1.smithi184.stdout:9/111: chown d0/d13/f21 6453 1 2023-12-16T03:15:47.963 INFO:tasks.workunit.client.1.smithi184.stdout:1/63: truncate d3/f16 731295 0 2023-12-16T03:15:47.963 INFO:tasks.workunit.client.1.smithi184.stdout:9/112: read d0/d13/d20/f28 [5030032,59107] 0 2023-12-16T03:15:47.964 INFO:tasks.workunit.client.1.smithi184.stdout:1/64: mknod d3/c18 0 2023-12-16T03:15:47.964 INFO:tasks.workunit.client.1.smithi184.stdout:1/65: write d3/d6/f7 [4771404,52662] 0 2023-12-16T03:15:47.979 INFO:tasks.workunit.client.1.smithi184.stdout:0/41: dwrite f7 [0,4194304] 0 2023-12-16T03:15:47.979 INFO:tasks.workunit.client.1.smithi184.stdout:0/42: rename dc to dc/dd 22 2023-12-16T03:15:47.981 INFO:tasks.workunit.client.1.smithi184.stdout:0/43: creat dc/fe x:0 0 0 2023-12-16T03:15:47.984 INFO:tasks.workunit.client.1.smithi184.stdout:0/44: link l3 dc/lf 0 2023-12-16T03:15:47.992 INFO:tasks.workunit.client.1.smithi184.stdout:7/39: dwrite d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:47.992 INFO:tasks.workunit.client.1.smithi184.stdout:2/11: dwrite f0 [0,4194304] 0 2023-12-16T03:15:47.992 INFO:tasks.workunit.client.1.smithi184.stdout:8/38: dwrite d2/fe [0,4194304] 0 2023-12-16T03:15:47.993 INFO:tasks.workunit.client.1.smithi184.stdout:9/113: dwrite d0/f1f [0,4194304] 0 2023-12-16T03:15:47.993 INFO:tasks.workunit.client.1.smithi184.stdout:7/40: mknod d0/d3/ca 0 2023-12-16T03:15:47.994 INFO:tasks.workunit.client.1.smithi184.stdout:6/26: getdents d0 0 2023-12-16T03:15:47.994 INFO:tasks.workunit.client.1.smithi184.stdout:3/16: dread f4 [0,4194304] 0 2023-12-16T03:15:47.996 INFO:tasks.workunit.client.1.smithi184.stdout:0/45: dread f7 [0,4194304] 0 2023-12-16T03:15:47.996 INFO:tasks.workunit.client.1.smithi184.stdout:0/46: truncate fa 23959 0 2023-12-16T03:15:47.996 INFO:tasks.workunit.client.1.smithi184.stdout:5/14: write d1/f2 [5028306,120139] 0 2023-12-16T03:15:48.002 INFO:tasks.workunit.client.1.smithi184.stdout:2/12: unlink l1 0 2023-12-16T03:15:48.002 INFO:tasks.workunit.client.1.smithi184.stdout:8/39: mkdir d2/d4/d10 0 2023-12-16T03:15:48.002 INFO:tasks.workunit.client.1.smithi184.stdout:1/66: getdents d3/d6 0 2023-12-16T03:15:48.004 INFO:tasks.workunit.client.1.smithi184.stdout:9/114: truncate d0/fd 1844193 0 2023-12-16T03:15:48.004 INFO:tasks.workunit.client.1.smithi184.stdout:9/115: chown d0/f1d 362 1 2023-12-16T03:15:48.004 INFO:tasks.workunit.client.1.smithi184.stdout:9/116: dread - d0/d13/d20/f29 zero size 2023-12-16T03:15:48.004 INFO:tasks.workunit.client.1.smithi184.stdout:9/117: write d0/f1c [1645147,90053] 0 2023-12-16T03:15:48.007 INFO:tasks.workunit.client.1.smithi184.stdout:4/47: getdents d1 0 2023-12-16T03:15:48.008 INFO:tasks.workunit.client.1.smithi184.stdout:6/27: mkdir d0/d5 0 2023-12-16T03:15:48.009 INFO:tasks.workunit.client.1.smithi184.stdout:3/17: dwrite f4 [0,4194304] 0 2023-12-16T03:15:48.017 INFO:tasks.workunit.client.1.smithi184.stdout:6/28: mkdir d0/d5/d6 0 2023-12-16T03:15:48.018 INFO:tasks.workunit.client.1.smithi184.stdout:0/47: dread fa [0,4194304] 0 2023-12-16T03:15:48.022 INFO:tasks.workunit.client.1.smithi184.stdout:2/13: getdents . 0 2023-12-16T03:15:48.023 INFO:tasks.workunit.client.1.smithi184.stdout:9/118: rename d0/c16 to d0/c2c 0 2023-12-16T03:15:48.023 INFO:tasks.workunit.client.1.smithi184.stdout:9/119: fdatasync d0/f14 0 2023-12-16T03:15:48.023 INFO:tasks.workunit.client.1.smithi184.stdout:9/120: write d0/d13/f2a [687975,19603] 0 2023-12-16T03:15:48.025 INFO:tasks.workunit.client.1.smithi184.stdout:6/29: creat d0/f7 x:0 0 0 2023-12-16T03:15:48.026 INFO:tasks.workunit.client.1.smithi184.stdout:7/41: write d0/d3/f7 [750401,127141] 0 2023-12-16T03:15:48.027 INFO:tasks.workunit.client.1.smithi184.stdout:0/48: mkdir dc/d10 0 2023-12-16T03:15:48.028 INFO:tasks.workunit.client.1.smithi184.stdout:2/14: mknod c2 0 2023-12-16T03:15:48.029 INFO:tasks.workunit.client.1.smithi184.stdout:0/49: write f5 [795820,16719] 0 2023-12-16T03:15:48.032 INFO:tasks.workunit.client.1.smithi184.stdout:6/30: mknod d0/d5/d6/c8 0 2023-12-16T03:15:48.032 INFO:tasks.workunit.client.1.smithi184.stdout:6/31: write d0/f7 [164914,95959] 0 2023-12-16T03:15:48.032 INFO:tasks.workunit.client.1.smithi184.stdout:6/32: chown d0/c2 13 1 2023-12-16T03:15:48.032 INFO:tasks.workunit.client.1.smithi184.stdout:8/40: dread d2/d4/f9 [0,4194304] 0 2023-12-16T03:15:48.033 INFO:tasks.workunit.client.1.smithi184.stdout:4/48: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:48.034 INFO:tasks.workunit.client.1.smithi184.stdout:0/50: creat dc/d10/f11 x:0 0 0 2023-12-16T03:15:48.036 INFO:tasks.workunit.client.1.smithi184.stdout:6/33: symlink d0/l9 0 2023-12-16T03:15:48.037 INFO:tasks.workunit.client.1.smithi184.stdout:6/34: stat d0 0 2023-12-16T03:15:48.037 INFO:tasks.workunit.client.1.smithi184.stdout:8/41: mkdir d2/d4/d10/d11 0 2023-12-16T03:15:48.041 INFO:tasks.workunit.client.1.smithi184.stdout:4/49: rename d1/l5 to d1/l10 0 2023-12-16T03:15:48.042 INFO:tasks.workunit.client.1.smithi184.stdout:3/18: truncate f4 3991378 0 2023-12-16T03:15:48.045 INFO:tasks.workunit.client.1.smithi184.stdout:0/51: stat dc/lf 0 2023-12-16T03:15:48.045 INFO:tasks.workunit.client.1.smithi184.stdout:0/52: truncate f5 1051137 0 2023-12-16T03:15:48.045 INFO:tasks.workunit.client.1.smithi184.stdout:6/35: unlink d0/c1 0 2023-12-16T03:15:48.048 INFO:tasks.workunit.client.1.smithi184.stdout:3/19: symlink l6 0 2023-12-16T03:15:48.048 INFO:tasks.workunit.client.1.smithi184.stdout:0/53: creat dc/f12 x:0 0 0 2023-12-16T03:15:48.048 INFO:tasks.workunit.client.1.smithi184.stdout:1/67: dwrite d3/ff [0,4194304] 0 2023-12-16T03:15:48.048 INFO:tasks.workunit.client.1.smithi184.stdout:2/15: dread f0 [0,4194304] 0 2023-12-16T03:15:48.048 INFO:tasks.workunit.client.1.smithi184.stdout:8/42: dread d2/fe [0,4194304] 0 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:4/50: read d1/f4 [1585260,110047] 0 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:4/51: write d1/fd [474333,131017] 0 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:4/52: write d1/f8 [502484,30494] 0 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:6/36: unlink d0/d5/d6/c8 0 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:6/37: write d0/f7 [499713,98867] 0 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:6/38: chown d0 14264186 1 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:9/121: dwrite d0/d13/f21 [0,4194304] 0 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:9/122: fsync d0/d13/d20/f22 0 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:9/123: truncate d0/d13/d20/f22 934571 0 2023-12-16T03:15:48.051 INFO:tasks.workunit.client.1.smithi184.stdout:9/124: fsync d0/fe 0 2023-12-16T03:15:48.052 INFO:tasks.workunit.client.1.smithi184.stdout:9/125: fsync d0/f1d 0 2023-12-16T03:15:48.052 INFO:tasks.workunit.client.1.smithi184.stdout:0/54: dread fa [0,4194304] 0 2023-12-16T03:15:48.052 INFO:tasks.workunit.client.1.smithi184.stdout:0/55: dread - dc/d10/f11 zero size 2023-12-16T03:15:48.052 INFO:tasks.workunit.client.1.smithi184.stdout:0/56: write f4 [3421486,28716] 0 2023-12-16T03:15:48.052 INFO:tasks.workunit.client.1.smithi184.stdout:2/16: mkdir d3 0 2023-12-16T03:15:48.053 INFO:tasks.workunit.client.1.smithi184.stdout:0/57: write f7 [3084547,76663] 0 2023-12-16T03:15:48.053 INFO:tasks.workunit.client.1.smithi184.stdout:8/43: mkdir d2/d12 0 2023-12-16T03:15:48.054 INFO:tasks.workunit.client.1.smithi184.stdout:3/20: write f2 [1133281,6052] 0 2023-12-16T03:15:48.055 INFO:tasks.workunit.client.1.smithi184.stdout:3/21: chown l3 5621 1 2023-12-16T03:15:48.055 INFO:tasks.workunit.client.1.smithi184.stdout:6/39: creat d0/d5/d6/fa x:0 0 0 2023-12-16T03:15:48.060 INFO:tasks.workunit.client.1.smithi184.stdout:2/17: creat d3/f4 x:0 0 0 2023-12-16T03:15:48.061 INFO:tasks.workunit.client.1.smithi184.stdout:0/58: unlink fa 0 2023-12-16T03:15:48.064 INFO:tasks.workunit.client.1.smithi184.stdout:8/44: creat d2/f13 x:0 0 0 2023-12-16T03:15:48.065 INFO:tasks.workunit.client.1.smithi184.stdout:9/126: rename d0/c18 to d0/c2d 0 2023-12-16T03:15:48.066 INFO:tasks.workunit.client.1.smithi184.stdout:9/127: read d0/fe [2371278,20215] 0 2023-12-16T03:15:48.067 INFO:tasks.workunit.client.1.smithi184.stdout:2/18: mkdir d3/d5 0 2023-12-16T03:15:48.067 INFO:tasks.workunit.client.1.smithi184.stdout:0/59: mkdir dc/d10/d13 0 2023-12-16T03:15:48.074 INFO:tasks.workunit.client.1.smithi184.stdout:7/42: dwrite d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:48.075 INFO:tasks.workunit.client.1.smithi184.stdout:2/19: rename f0 to d3/f6 0 2023-12-16T03:15:48.076 INFO:tasks.workunit.client.1.smithi184.stdout:3/22: dread f2 [0,4194304] 0 2023-12-16T03:15:48.079 INFO:tasks.workunit.client.1.smithi184.stdout:7/43: mkdir d0/db 0 2023-12-16T03:15:48.083 INFO:tasks.workunit.client.1.smithi184.stdout:3/23: symlink l7 0 2023-12-16T03:15:48.083 INFO:tasks.workunit.client.1.smithi184.stdout:1/68: dwrite d3/ff [0,4194304] 0 2023-12-16T03:15:48.086 INFO:tasks.workunit.client.1.smithi184.stdout:7/44: creat d0/d3/d4/fc x:0 0 0 2023-12-16T03:15:48.091 INFO:tasks.workunit.client.1.smithi184.stdout:3/24: link f4 f8 0 2023-12-16T03:15:48.092 INFO:tasks.workunit.client.1.smithi184.stdout:1/69: link d3/c18 d3/d13/c19 0 2023-12-16T03:15:48.092 INFO:tasks.workunit.client.1.smithi184.stdout:1/70: chown d3/ff 58 1 2023-12-16T03:15:48.092 INFO:tasks.workunit.client.1.smithi184.stdout:1/71: write d3/d6/fe [5093138,62683] 0 2023-12-16T03:15:48.094 INFO:tasks.workunit.client.1.smithi184.stdout:7/45: rmdir d0/d3 39 2023-12-16T03:15:48.095 INFO:tasks.workunit.client.1.smithi184.stdout:3/25: creat f9 x:0 0 0 2023-12-16T03:15:48.095 INFO:tasks.workunit.client.1.smithi184.stdout:3/26: fdatasync f8 0 2023-12-16T03:15:48.097 INFO:tasks.workunit.client.1.smithi184.stdout:3/27: write f4 [1516030,125759] 0 2023-12-16T03:15:48.099 INFO:tasks.workunit.client.1.smithi184.stdout:7/46: rename d0/d3/d4/d9 to d0/db/dd 0 2023-12-16T03:15:48.100 INFO:tasks.workunit.client.1.smithi184.stdout:4/53: dwrite d1/f8 [0,4194304] 0 2023-12-16T03:15:48.101 INFO:tasks.workunit.client.1.smithi184.stdout:0/60: rmdir dc/d10 39 2023-12-16T03:15:48.102 INFO:tasks.workunit.client.1.smithi184.stdout:3/28: link c1 ca 0 2023-12-16T03:15:48.105 INFO:tasks.workunit.client.1.smithi184.stdout:4/54: mkdir d1/d11 0 2023-12-16T03:15:48.107 INFO:tasks.workunit.client.1.smithi184.stdout:0/61: rename f5 to dc/d10/f14 0 2023-12-16T03:15:48.108 INFO:tasks.workunit.client.1.smithi184.stdout:3/29: mknod cb 0 2023-12-16T03:15:48.109 INFO:tasks.workunit.client.1.smithi184.stdout:4/55: mkdir d1/d12 0 2023-12-16T03:15:48.111 INFO:tasks.workunit.client.1.smithi184.stdout:0/62: getdents dc 0 2023-12-16T03:15:48.112 INFO:tasks.workunit.client.1.smithi184.stdout:6/40: dwrite d0/d5/d6/fa [0,4194304] 0 2023-12-16T03:15:48.112 INFO:tasks.workunit.client.1.smithi184.stdout:3/30: link c5 cc 0 2023-12-16T03:15:48.113 INFO:tasks.workunit.client.1.smithi184.stdout:4/56: truncate d1/f4 3777804 0 2023-12-16T03:15:48.113 INFO:tasks.workunit.client.1.smithi184.stdout:8/45: dwrite d2/f13 [0,4194304] 0 2023-12-16T03:15:48.114 INFO:tasks.workunit.client.1.smithi184.stdout:9/128: dwrite d0/d13/f21 [0,4194304] 0 2023-12-16T03:15:48.114 INFO:tasks.workunit.client.1.smithi184.stdout:9/129: truncate d0/f1d 910562 0 2023-12-16T03:15:48.115 INFO:tasks.workunit.client.1.smithi184.stdout:2/20: dwrite d3/f4 [0,4194304] 0 2023-12-16T03:15:48.115 INFO:tasks.workunit.client.1.smithi184.stdout:2/21: chown d3/f6 856551 1 2023-12-16T03:15:48.115 INFO:tasks.workunit.client.1.smithi184.stdout:0/63: link dc/f12 dc/f15 0 2023-12-16T03:15:48.117 INFO:tasks.workunit.client.1.smithi184.stdout:8/46: dread d2/fe [0,4194304] 0 2023-12-16T03:15:48.120 INFO:tasks.workunit.client.1.smithi184.stdout:8/47: write d2/f13 [3885296,121749] 0 2023-12-16T03:15:48.124 INFO:tasks.workunit.client.1.smithi184.stdout:1/72: truncate d3/d6/fe 1753227 0 2023-12-16T03:15:48.124 INFO:tasks.workunit.client.1.smithi184.stdout:1/73: getdents d3/d6 0 2023-12-16T03:15:48.125 INFO:tasks.workunit.client.1.smithi184.stdout:1/74: read d3/d6/f12 [276800,5540] 0 2023-12-16T03:15:48.127 INFO:tasks.workunit.client.1.smithi184.stdout:9/130: link d0/fd d0/d13/f2e 0 2023-12-16T03:15:48.128 INFO:tasks.workunit.client.1.smithi184.stdout:2/22: dread d3/f4 [0,4194304] 0 2023-12-16T03:15:48.129 INFO:tasks.workunit.client.1.smithi184.stdout:0/64: stat dc/d10/d13 0 2023-12-16T03:15:48.131 INFO:tasks.workunit.client.1.smithi184.stdout:8/48: creat d2/d4/d10/f14 x:0 0 0 2023-12-16T03:15:48.136 INFO:tasks.workunit.client.1.smithi184.stdout:0/65: rename dc/d10/d13 to dc/d10/d16 0 2023-12-16T03:15:48.137 INFO:tasks.workunit.client.1.smithi184.stdout:0/66: rename dc to dc/d10/d17 22 2023-12-16T03:15:48.137 INFO:tasks.workunit.client.1.smithi184.stdout:7/47: dwrite d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:48.137 INFO:tasks.workunit.client.1.smithi184.stdout:2/23: dread d3/f4 [0,4194304] 0 2023-12-16T03:15:48.138 INFO:tasks.workunit.client.1.smithi184.stdout:3/31: getdents . 0 2023-12-16T03:15:48.138 INFO:tasks.workunit.client.1.smithi184.stdout:3/32: write f9 [288400,63328] 0 2023-12-16T03:15:48.138 INFO:tasks.workunit.client.1.smithi184.stdout:2/24: read d3/f4 [2971719,84187] 0 2023-12-16T03:15:48.140 INFO:tasks.workunit.client.1.smithi184.stdout:0/67: dread - dc/f12 zero size 2023-12-16T03:15:48.143 INFO:tasks.workunit.client.1.smithi184.stdout:3/33: creat fd x:0 0 0 2023-12-16T03:15:48.143 INFO:tasks.workunit.client.1.smithi184.stdout:2/25: truncate d3/f6 3506876 0 2023-12-16T03:15:48.143 INFO:tasks.workunit.client.1.smithi184.stdout:2/26: fdatasync d3/f6 0 2023-12-16T03:15:48.146 INFO:tasks.workunit.client.1.smithi184.stdout:3/34: creat fe x:0 0 0 2023-12-16T03:15:48.150 INFO:tasks.workunit.client.1.smithi184.stdout:3/35: write f4 [4939527,128147] 0 2023-12-16T03:15:48.150 INFO:tasks.workunit.client.1.smithi184.stdout:3/36: write fe [32271,22112] 0 2023-12-16T03:15:48.150 INFO:tasks.workunit.client.1.smithi184.stdout:3/37: chown fe 314 1 2023-12-16T03:15:48.150 INFO:tasks.workunit.client.1.smithi184.stdout:0/68: fsync dc/fe 0 2023-12-16T03:15:48.151 INFO:tasks.workunit.client.1.smithi184.stdout:9/131: getdents d0/d13 0 2023-12-16T03:15:48.153 INFO:tasks.workunit.client.1.smithi184.stdout:7/48: dread d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:48.153 INFO:tasks.workunit.client.1.smithi184.stdout:1/75: dwrite d3/d6/f12 [0,4194304] 0 2023-12-16T03:15:48.153 INFO:tasks.workunit.client.1.smithi184.stdout:1/76: chown d3/f9 3427 1 2023-12-16T03:15:48.153 INFO:tasks.workunit.client.1.smithi184.stdout:2/27: write d3/f4 [1053726,65837] 0 2023-12-16T03:15:48.155 INFO:tasks.workunit.client.1.smithi184.stdout:8/49: dread d2/f13 [0,4194304] 0 2023-12-16T03:15:48.157 INFO:tasks.workunit.client.1.smithi184.stdout:7/49: symlink d0/db/dd/le 0 2023-12-16T03:15:48.158 INFO:tasks.workunit.client.1.smithi184.stdout:8/50: creat d2/d4/d10/d11/f15 x:0 0 0 2023-12-16T03:15:48.158 INFO:tasks.workunit.client.1.smithi184.stdout:8/51: stat d2/d4/d10/d11/f15 0 2023-12-16T03:15:48.159 INFO:tasks.workunit.client.1.smithi184.stdout:8/52: read - d2/fc zero size 2023-12-16T03:15:48.161 INFO:tasks.workunit.client.1.smithi184.stdout:8/53: getdents d2/d4/d10 0 2023-12-16T03:15:48.161 INFO:tasks.workunit.client.1.smithi184.stdout:8/54: dread - d2/d4/d10/d11/f15 zero size 2023-12-16T03:15:48.164 INFO:tasks.workunit.client.1.smithi184.stdout:6/41: dwrite d0/d5/d6/fa [4194304,4194304] 0 2023-12-16T03:15:48.165 INFO:tasks.workunit.client.1.smithi184.stdout:1/77: dread d3/d6/f7 [0,4194304] 0 2023-12-16T03:15:48.165 INFO:tasks.workunit.client.1.smithi184.stdout:2/28: read d3/f6 [2157701,50010] 0 2023-12-16T03:15:48.167 INFO:tasks.workunit.client.1.smithi184.stdout:1/78: mknod d3/c1a 0 2023-12-16T03:15:48.168 INFO:tasks.workunit.client.1.smithi184.stdout:2/29: creat d3/d5/f7 x:0 0 0 2023-12-16T03:15:48.168 INFO:tasks.workunit.client.1.smithi184.stdout:2/30: chown d3 117250936 1 2023-12-16T03:15:48.169 INFO:tasks.workunit.client.1.smithi184.stdout:1/79: rename d3/l11 to d3/l1b 0 2023-12-16T03:15:48.170 INFO:tasks.workunit.client.1.smithi184.stdout:8/55: read d2/f13 [2541759,100044] 0 2023-12-16T03:15:48.170 INFO:tasks.workunit.client.1.smithi184.stdout:8/56: write d2/d4/d10/d11/f15 [696381,32657] 0 2023-12-16T03:15:48.170 INFO:tasks.workunit.client.1.smithi184.stdout:4/57: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:48.171 INFO:tasks.workunit.client.1.smithi184.stdout:2/31: creat d3/d5/f8 x:0 0 0 2023-12-16T03:15:48.173 INFO:tasks.workunit.client.1.smithi184.stdout:1/80: rename d3/d13/c19 to d3/d6/c1c 0 2023-12-16T03:15:48.174 INFO:tasks.workunit.client.1.smithi184.stdout:8/57: creat d2/f16 x:0 0 0 2023-12-16T03:15:48.175 INFO:tasks.workunit.client.1.smithi184.stdout:4/58: mkdir d1/d12/d13 0 2023-12-16T03:15:48.175 INFO:tasks.workunit.client.1.smithi184.stdout:4/59: write d1/f4 [4970200,89030] 0 2023-12-16T03:15:48.175 INFO:tasks.workunit.client.1.smithi184.stdout:4/60: chown d1/d12/d13 50 1 2023-12-16T03:15:48.176 INFO:tasks.workunit.client.1.smithi184.stdout:2/32: mkdir d3/d9 0 2023-12-16T03:15:48.180 INFO:tasks.workunit.client.1.smithi184.stdout:7/50: rename d0/db to d0/df 0 2023-12-16T03:15:48.180 INFO:tasks.workunit.client.1.smithi184.stdout:0/69: dwrite dc/f15 [0,4194304] 0 2023-12-16T03:15:48.180 INFO:tasks.workunit.client.1.smithi184.stdout:3/38: dwrite fe [0,4194304] 0 2023-12-16T03:15:48.181 INFO:tasks.workunit.client.1.smithi184.stdout:1/81: rename d3/l14 to d3/l1d 0 2023-12-16T03:15:48.182 INFO:tasks.workunit.client.1.smithi184.stdout:6/42: truncate d0/d5/d6/fa 5200535 0 2023-12-16T03:15:48.182 INFO:tasks.workunit.client.1.smithi184.stdout:6/43: stat d0/d5/d6 0 2023-12-16T03:15:48.184 INFO:tasks.workunit.client.1.smithi184.stdout:8/58: creat d2/d4/d10/f17 x:0 0 0 2023-12-16T03:15:48.184 INFO:tasks.workunit.client.1.smithi184.stdout:3/39: write f9 [131377,2067] 0 2023-12-16T03:15:48.185 INFO:tasks.workunit.client.1.smithi184.stdout:4/61: symlink d1/l14 0 2023-12-16T03:15:48.186 INFO:tasks.workunit.client.1.smithi184.stdout:7/51: creat d0/df/dd/f10 x:0 0 0 2023-12-16T03:15:48.186 INFO:tasks.workunit.client.1.smithi184.stdout:7/52: readlink d0/l1 0 2023-12-16T03:15:48.187 INFO:tasks.workunit.client.1.smithi184.stdout:7/53: write d0/d3/f7 [1909290,77025] 0 2023-12-16T03:15:48.190 INFO:tasks.workunit.client.1.smithi184.stdout:0/70: mknod dc/d10/d16/c18 0 2023-12-16T03:15:48.190 INFO:tasks.workunit.client.1.smithi184.stdout:9/132: dwrite d0/d13/f2e [0,4194304] 0 2023-12-16T03:15:48.196 INFO:tasks.workunit.client.1.smithi184.stdout:8/59: getdents d2 0 2023-12-16T03:15:48.196 INFO:tasks.workunit.client.1.smithi184.stdout:1/82: rmdir d3 39 2023-12-16T03:15:48.201 INFO:tasks.workunit.client.1.smithi184.stdout:3/40: rename l3 to lf 0 2023-12-16T03:15:48.203 INFO:tasks.workunit.client.1.smithi184.stdout:4/62: symlink d1/d11/l15 0 2023-12-16T03:15:48.206 INFO:tasks.workunit.client.1.smithi184.stdout:7/54: creat d0/d3/f11 x:0 0 0 2023-12-16T03:15:48.207 INFO:tasks.workunit.client.1.smithi184.stdout:6/44: dwrite d0/f7 [0,4194304] 0 2023-12-16T03:15:48.208 INFO:tasks.workunit.client.1.smithi184.stdout:9/133: stat d0/lf 0 2023-12-16T03:15:48.209 INFO:tasks.workunit.client.1.smithi184.stdout:8/60: symlink d2/d4/d10/d11/l18 0 2023-12-16T03:15:48.209 INFO:tasks.workunit.client.1.smithi184.stdout:8/61: dread - d2/d4/d10/f14 zero size 2023-12-16T03:15:48.210 INFO:tasks.workunit.client.1.smithi184.stdout:1/83: symlink d3/d6/l1e 0 2023-12-16T03:15:48.210 INFO:tasks.workunit.client.1.smithi184.stdout:1/84: chown d3/c10 1624203 1 2023-12-16T03:15:48.210 INFO:tasks.workunit.client.1.smithi184.stdout:1/85: chown d3/c1a 660348 1 2023-12-16T03:15:48.212 INFO:tasks.workunit.client.1.smithi184.stdout:3/41: link cb c10 0 2023-12-16T03:15:48.212 INFO:tasks.workunit.client.1.smithi184.stdout:8/62: write d2/d4/f9 [3607539,56962] 0 2023-12-16T03:15:48.213 INFO:tasks.workunit.client.1.smithi184.stdout:0/71: link f4 dc/f19 0 2023-12-16T03:15:48.214 INFO:tasks.workunit.client.1.smithi184.stdout:1/86: rename d3/d6/f12 to d3/d13/f1f 0 2023-12-16T03:15:48.216 INFO:tasks.workunit.client.1.smithi184.stdout:8/63: symlink d2/d4/l19 0 2023-12-16T03:15:48.217 INFO:tasks.workunit.client.1.smithi184.stdout:7/55: write d0/d3/f5 [465071,85700] 0 2023-12-16T03:15:48.217 INFO:tasks.workunit.client.1.smithi184.stdout:7/56: write d0/df/dd/f10 [625160,5094] 0 2023-12-16T03:15:48.217 INFO:tasks.workunit.client.1.smithi184.stdout:1/87: rmdir d3 39 2023-12-16T03:15:48.219 INFO:tasks.workunit.client.1.smithi184.stdout:8/64: rename d2/d4/l19 to d2/l1a 0 2023-12-16T03:15:48.220 INFO:tasks.workunit.client.1.smithi184.stdout:3/42: dread f8 [0,4194304] 0 2023-12-16T03:15:48.220 INFO:tasks.workunit.client.1.smithi184.stdout:3/43: truncate fd 947745 0 2023-12-16T03:15:48.220 INFO:tasks.workunit.client.1.smithi184.stdout:3/44: fsync f2 0 2023-12-16T03:15:48.221 INFO:tasks.workunit.client.1.smithi184.stdout:1/88: creat d3/f20 x:0 0 0 2023-12-16T03:15:48.224 INFO:tasks.workunit.client.1.smithi184.stdout:8/65: write d2/d4/f9 [2927097,101557] 0 2023-12-16T03:15:48.225 INFO:tasks.workunit.client.1.smithi184.stdout:8/66: read - d2/d4/d10/f17 zero size 2023-12-16T03:15:48.225 INFO:tasks.workunit.client.1.smithi184.stdout:8/67: dread - d2/fc zero size 2023-12-16T03:15:48.225 INFO:tasks.workunit.client.1.smithi184.stdout:8/68: write d2/fc [934237,112804] 0 2023-12-16T03:15:48.225 INFO:tasks.workunit.client.1.smithi184.stdout:1/89: write d3/ff [716069,46716] 0 2023-12-16T03:15:48.225 INFO:tasks.workunit.client.1.smithi184.stdout:3/45: rename cb to c11 0 2023-12-16T03:15:48.225 INFO:tasks.workunit.client.1.smithi184.stdout:3/46: write f9 [1085440,129354] 0 2023-12-16T03:15:48.226 INFO:tasks.workunit.client.1.smithi184.stdout:3/47: stat fd 0 2023-12-16T03:15:48.228 INFO:tasks.workunit.client.1.smithi184.stdout:8/69: link d2/d4/lb d2/l1b 0 2023-12-16T03:15:48.231 INFO:tasks.workunit.client.1.smithi184.stdout:3/48: mkdir d12 0 2023-12-16T03:15:48.231 INFO:tasks.workunit.client.1.smithi184.stdout:3/49: stat fe 0 2023-12-16T03:15:48.233 INFO:tasks.workunit.client.1.smithi184.stdout:3/50: mknod d12/c13 0 2023-12-16T03:15:48.234 INFO:tasks.workunit.client.1.smithi184.stdout:3/51: mknod d12/c14 0 2023-12-16T03:15:48.234 INFO:tasks.workunit.client.1.smithi184.stdout:3/52: chown l6 293 1 2023-12-16T03:15:48.234 INFO:tasks.workunit.client.1.smithi184.stdout:3/53: write f9 [2050317,86172] 0 2023-12-16T03:15:48.236 INFO:tasks.workunit.client.1.smithi184.stdout:4/63: dwrite d1/f8 [0,4194304] 0 2023-12-16T03:15:48.236 INFO:tasks.workunit.client.1.smithi184.stdout:4/64: write d1/fe [933432,58308] 0 2023-12-16T03:15:48.237 INFO:tasks.workunit.client.1.smithi184.stdout:3/54: link f8 d12/f15 0 2023-12-16T03:15:48.239 INFO:tasks.workunit.client.1.smithi184.stdout:4/65: rename d1/d11/l15 to d1/d12/l16 0 2023-12-16T03:15:48.239 INFO:tasks.workunit.client.1.smithi184.stdout:0/72: dwrite dc/d10/f14 [0,4194304] 0 2023-12-16T03:15:48.240 INFO:tasks.workunit.client.1.smithi184.stdout:3/55: creat d12/f16 x:0 0 0 2023-12-16T03:15:48.246 INFO:tasks.workunit.client.1.smithi184.stdout:0/73: dread f4 [0,4194304] 0 2023-12-16T03:15:48.246 INFO:tasks.workunit.client.1.smithi184.stdout:3/56: dread f8 [0,4194304] 0 2023-12-16T03:15:48.247 INFO:tasks.workunit.client.1.smithi184.stdout:3/57: readlink l7 0 2023-12-16T03:15:48.247 INFO:tasks.workunit.client.1.smithi184.stdout:8/70: dwrite d2/f13 [0,4194304] 0 2023-12-16T03:15:48.247 INFO:tasks.workunit.client.1.smithi184.stdout:8/71: chown d2/d4/l5 420 1 2023-12-16T03:15:48.247 INFO:tasks.workunit.client.1.smithi184.stdout:8/72: readlink d2/d4/d10/d11/l18 0 2023-12-16T03:15:48.247 INFO:tasks.workunit.client.1.smithi184.stdout:0/74: mkdir dc/d10/d16/d1a 0 2023-12-16T03:15:48.247 INFO:tasks.workunit.client.1.smithi184.stdout:0/75: write dc/d10/f11 [74278,9672] 0 2023-12-16T03:15:48.248 INFO:tasks.workunit.client.1.smithi184.stdout:3/58: unlink d12/f15 0 2023-12-16T03:15:48.250 INFO:tasks.workunit.client.1.smithi184.stdout:8/73: link d2/d4/lb d2/d4/d10/d11/l1c 0 2023-12-16T03:15:48.252 INFO:tasks.workunit.client.1.smithi184.stdout:0/76: symlink dc/d10/l1b 0 2023-12-16T03:15:48.254 INFO:tasks.workunit.client.1.smithi184.stdout:8/74: creat d2/d4/d10/d11/f1d x:0 0 0 2023-12-16T03:15:48.255 INFO:tasks.workunit.client.1.smithi184.stdout:1/90: truncate d3/f16 383390 0 2023-12-16T03:15:48.255 INFO:tasks.workunit.client.1.smithi184.stdout:1/91: chown d3/l1d 522368687 1 2023-12-16T03:15:48.255 INFO:tasks.workunit.client.1.smithi184.stdout:1/92: chown d3/c10 1068812600 1 2023-12-16T03:15:48.255 INFO:tasks.workunit.client.1.smithi184.stdout:1/93: chown d3/c10 249142036 1 2023-12-16T03:15:48.255 INFO:tasks.workunit.client.1.smithi184.stdout:1/94: chown d3/d6/c1c 23091 1 2023-12-16T03:15:48.255 INFO:tasks.workunit.client.1.smithi184.stdout:8/75: mknod d2/d4/d10/c1e 0 2023-12-16T03:15:48.256 INFO:tasks.workunit.client.1.smithi184.stdout:8/76: read d2/d4/f9 [1097571,4070] 0 2023-12-16T03:15:48.256 INFO:tasks.workunit.client.1.smithi184.stdout:0/77: dread dc/d10/f11 [0,4194304] 0 2023-12-16T03:15:48.257 INFO:tasks.workunit.client.1.smithi184.stdout:1/95: rename d3/d6/cd to d3/c21 0 2023-12-16T03:15:48.257 INFO:tasks.workunit.client.1.smithi184.stdout:1/96: chown d3/d13 1 1 2023-12-16T03:15:48.257 INFO:tasks.workunit.client.1.smithi184.stdout:1/97: chown d3/d6/f7 1377158 1 2023-12-16T03:15:48.258 INFO:tasks.workunit.client.1.smithi184.stdout:8/77: symlink d2/d4/l1f 0 2023-12-16T03:15:48.258 INFO:tasks.workunit.client.1.smithi184.stdout:8/78: write d2/d4/d10/d11/f1d [863207,94467] 0 2023-12-16T03:15:48.258 INFO:tasks.workunit.client.1.smithi184.stdout:8/79: fsync d2/fe 0 2023-12-16T03:15:48.259 INFO:tasks.workunit.client.1.smithi184.stdout:0/78: mkdir dc/d10/d1c 0 2023-12-16T03:15:48.261 INFO:tasks.workunit.client.1.smithi184.stdout:8/80: stat d2/d4/lb 0 2023-12-16T03:15:48.262 INFO:tasks.workunit.client.1.smithi184.stdout:0/79: unlink dc/d10/l1b 0 2023-12-16T03:15:48.263 INFO:tasks.workunit.client.1.smithi184.stdout:0/80: write dc/d10/f14 [2118894,39074] 0 2023-12-16T03:15:48.264 INFO:tasks.workunit.client.1.smithi184.stdout:8/81: creat d2/d4/d10/d11/f20 x:0 0 0 2023-12-16T03:15:48.264 INFO:tasks.workunit.client.1.smithi184.stdout:8/82: write d2/d4/d10/d11/f1d [1392221,93360] 0 2023-12-16T03:15:48.265 INFO:tasks.workunit.client.1.smithi184.stdout:4/66: truncate d1/fe 483099 0 2023-12-16T03:15:48.265 INFO:tasks.workunit.client.1.smithi184.stdout:4/67: readlink d1/l10 0 2023-12-16T03:15:48.265 INFO:tasks.workunit.client.1.smithi184.stdout:4/68: fdatasync d1/f4 0 2023-12-16T03:15:48.266 INFO:tasks.workunit.client.1.smithi184.stdout:0/81: truncate f7 2450998 0 2023-12-16T03:15:48.267 INFO:tasks.workunit.client.1.smithi184.stdout:8/83: mkdir d2/d12/d21 0 2023-12-16T03:15:48.267 INFO:tasks.workunit.client.1.smithi184.stdout:0/82: dread dc/d10/f11 [0,4194304] 0 2023-12-16T03:15:48.267 INFO:tasks.workunit.client.1.smithi184.stdout:3/59: getdents d12 0 2023-12-16T03:15:48.269 INFO:tasks.workunit.client.1.smithi184.stdout:4/69: creat d1/d12/f17 x:0 0 0 2023-12-16T03:15:48.271 INFO:tasks.workunit.client.1.smithi184.stdout:0/83: mkdir dc/d10/d16/d1d 0 2023-12-16T03:15:48.272 INFO:tasks.workunit.client.1.smithi184.stdout:0/84: stat dc/d10/d16/c18 0 2023-12-16T03:15:48.272 INFO:tasks.workunit.client.1.smithi184.stdout:3/60: creat d12/f17 x:0 0 0 2023-12-16T03:15:48.273 INFO:tasks.workunit.client.1.smithi184.stdout:4/70: mknod d1/d12/c18 0 2023-12-16T03:15:48.273 INFO:tasks.workunit.client.1.smithi184.stdout:4/71: getdents d1/d12/d13 0 2023-12-16T03:15:48.274 INFO:tasks.workunit.client.1.smithi184.stdout:0/85: unlink dc/f15 0 2023-12-16T03:15:48.276 INFO:tasks.workunit.client.1.smithi184.stdout:4/72: dread d1/fd [0,4194304] 0 2023-12-16T03:15:48.276 INFO:tasks.workunit.client.1.smithi184.stdout:4/73: chown d1/d12/f17 4 1 2023-12-16T03:15:48.276 INFO:tasks.workunit.client.1.smithi184.stdout:4/74: getdents d1/d12/d13 0 2023-12-16T03:15:48.277 INFO:tasks.workunit.client.1.smithi184.stdout:1/98: write d3/f9 [4662536,113533] 0 2023-12-16T03:15:48.287 INFO:tasks.workunit.client.1.smithi184.stdout:8/84: dwrite d2/d4/d10/d11/f15 [0,4194304] 0 2023-12-16T03:15:48.287 INFO:tasks.workunit.client.1.smithi184.stdout:8/85: readlink d2/d4/d10/d11/l18 0 2023-12-16T03:15:48.290 INFO:tasks.workunit.client.1.smithi184.stdout:8/86: mknod d2/d4/d10/c22 0 2023-12-16T03:15:48.290 INFO:tasks.workunit.client.1.smithi184.stdout:8/87: write d2/d4/d10/d11/f20 [1031110,127143] 0 2023-12-16T03:15:48.292 INFO:tasks.workunit.client.1.smithi184.stdout:8/88: symlink d2/d4/l23 0 2023-12-16T03:15:48.292 INFO:tasks.workunit.client.1.smithi184.stdout:8/89: write d2/d4/d10/f17 [930805,101946] 0 2023-12-16T03:15:48.295 INFO:tasks.workunit.client.1.smithi184.stdout:8/90: mknod d2/d4/d10/c24 0 2023-12-16T03:15:48.297 INFO:tasks.workunit.client.1.smithi184.stdout:8/91: mknod d2/c25 0 2023-12-16T03:15:48.301 INFO:tasks.workunit.client.1.smithi184.stdout:8/92: symlink d2/d12/l26 0 2023-12-16T03:15:48.302 INFO:tasks.workunit.client.1.smithi184.stdout:0/86: dread f7 [0,4194304] 0 2023-12-16T03:15:48.302 INFO:tasks.workunit.client.1.smithi184.stdout:0/87: fdatasync dc/f19 0 2023-12-16T03:15:48.305 INFO:tasks.workunit.client.1.smithi184.stdout:0/88: read dc/d10/f14 [2220734,5946] 0 2023-12-16T03:15:48.306 INFO:tasks.workunit.client.1.smithi184.stdout:0/89: creat dc/d10/d16/d1d/f1e x:0 0 0 2023-12-16T03:15:48.311 INFO:tasks.workunit.client.1.smithi184.stdout:3/61: dwrite f9 [0,4194304] 0 2023-12-16T03:15:48.311 INFO:tasks.workunit.client.1.smithi184.stdout:1/99: dwrite f0 [0,4194304] 0 2023-12-16T03:15:48.311 INFO:tasks.workunit.client.1.smithi184.stdout:0/90: dread dc/f19 [0,4194304] 0 2023-12-16T03:15:48.311 INFO:tasks.workunit.client.1.smithi184.stdout:1/100: write d3/f20 [884887,1380] 0 2023-12-16T03:15:48.311 INFO:tasks.workunit.client.1.smithi184.stdout:1/101: fsync d3/d6/f7 0 2023-12-16T03:15:48.312 INFO:tasks.workunit.client.1.smithi184.stdout:4/75: dwrite d1/fe [0,4194304] 0 2023-12-16T03:15:48.317 INFO:tasks.workunit.client.1.smithi184.stdout:0/91: symlink dc/d10/d16/l1f 0 2023-12-16T03:15:48.317 INFO:tasks.workunit.client.1.smithi184.stdout:8/93: dread d2/fc [0,4194304] 0 2023-12-16T03:15:48.317 INFO:tasks.workunit.client.1.smithi184.stdout:8/94: dread - d2/d4/d10/f14 zero size 2023-12-16T03:15:48.318 INFO:tasks.workunit.client.1.smithi184.stdout:1/102: write f0 [1578477,116404] 0 2023-12-16T03:15:48.322 INFO:tasks.workunit.client.1.smithi184.stdout:4/76: write d1/f4 [648825,22667] 0 2023-12-16T03:15:48.331 INFO:tasks.workunit.client.1.smithi184.stdout:8/95: write d2/d4/d10/d11/f15 [333611,39955] 0 2023-12-16T03:15:48.335 INFO:tasks.workunit.client.1.smithi184.stdout:0/92: dwrite dc/d10/d16/d1d/f1e [0,4194304] 0 2023-12-16T03:15:48.337 INFO:tasks.workunit.client.1.smithi184.stdout:3/62: dwrite f2 [0,4194304] 0 2023-12-16T03:15:48.338 INFO:tasks.workunit.client.1.smithi184.stdout:4/77: truncate d1/f4 1664611 0 2023-12-16T03:15:48.339 INFO:tasks.workunit.client.1.smithi184.stdout:0/93: getdents dc 0 2023-12-16T03:15:48.343 INFO:tasks.workunit.client.1.smithi184.stdout:3/63: mkdir d12/d18 0 2023-12-16T03:15:48.349 INFO:tasks.workunit.client.1.smithi184.stdout:8/96: dwrite d2/d4/d10/f14 [0,4194304] 0 2023-12-16T03:15:48.349 INFO:tasks.workunit.client.1.smithi184.stdout:8/97: dread - d2/f16 zero size 2023-12-16T03:15:48.350 INFO:tasks.workunit.client.1.smithi184.stdout:3/64: read fe [643000,96804] 0 2023-12-16T03:15:48.350 INFO:tasks.workunit.client.1.smithi184.stdout:8/98: mknod d2/d12/d21/c27 0 2023-12-16T03:15:48.350 INFO:tasks.workunit.client.1.smithi184.stdout:8/99: chown d2/ca 323896326 1 2023-12-16T03:15:48.351 INFO:tasks.workunit.client.1.smithi184.stdout:8/100: fdatasync d2/fc 0 2023-12-16T03:15:48.351 INFO:tasks.workunit.client.1.smithi184.stdout:8/101: write d2/fc [1010156,96859] 0 2023-12-16T03:15:48.351 INFO:tasks.workunit.client.1.smithi184.stdout:3/65: creat d12/f19 x:0 0 0 2023-12-16T03:15:48.363 INFO:tasks.workunit.client.1.smithi184.stdout:0/94: dwrite f7 [0,4194304] 0 2023-12-16T03:15:48.367 INFO:tasks.workunit.client.1.smithi184.stdout:0/95: write dc/d10/f14 [1378591,45475] 0 2023-12-16T03:15:48.368 INFO:tasks.workunit.client.1.smithi184.stdout:8/102: truncate d2/fc 840542 0 2023-12-16T03:15:48.370 INFO:tasks.workunit.client.1.smithi184.stdout:8/103: creat d2/f28 x:0 0 0 2023-12-16T03:15:48.373 INFO:tasks.workunit.client.1.smithi184.stdout:3/66: dwrite f4 [0,4194304] 0 2023-12-16T03:15:48.374 INFO:tasks.workunit.client.1.smithi184.stdout:3/67: rename d12 to d12/d18/d1a 22 2023-12-16T03:15:48.375 INFO:tasks.workunit.client.1.smithi184.stdout:3/68: creat d12/f1b x:0 0 0 2023-12-16T03:15:48.375 INFO:tasks.workunit.client.1.smithi184.stdout:3/69: dread - d12/f1b zero size 2023-12-16T03:15:48.376 INFO:tasks.workunit.client.1.smithi184.stdout:8/104: write d2/d4/d10/f14 [4150745,36367] 0 2023-12-16T03:15:48.379 INFO:tasks.workunit.client.1.smithi184.stdout:3/70: creat d12/d18/f1c x:0 0 0 2023-12-16T03:15:48.380 INFO:tasks.workunit.client.1.smithi184.stdout:8/105: getdents d2/d4/d10/d11 0 2023-12-16T03:15:48.381 INFO:tasks.workunit.client.1.smithi184.stdout:8/106: dread d2/d4/d10/d11/f20 [0,4194304] 0 2023-12-16T03:15:48.382 INFO:tasks.workunit.client.1.smithi184.stdout:8/107: write d2/fe [3104191,115558] 0 2023-12-16T03:15:48.386 INFO:tasks.workunit.client.1.smithi184.stdout:8/108: unlink d2/d4/d10/d11/f20 0 2023-12-16T03:15:48.388 INFO:tasks.workunit.client.1.smithi184.stdout:8/109: rename d2/f16 to d2/d4/d10/d11/f29 0 2023-12-16T03:15:48.388 INFO:tasks.workunit.client.1.smithi184.stdout:8/110: write d2/f28 [279468,23495] 0 2023-12-16T03:15:48.390 INFO:tasks.workunit.client.1.smithi184.stdout:0/96: dwrite dc/d10/d16/d1d/f1e [0,4194304] 0 2023-12-16T03:15:48.395 INFO:tasks.workunit.client.1.smithi184.stdout:8/111: rmdir d2/d4 39 2023-12-16T03:15:48.405 INFO:tasks.workunit.client.1.smithi184.stdout:3/71: dwrite d12/f1b [0,4194304] 0 2023-12-16T03:15:48.406 INFO:tasks.workunit.client.1.smithi184.stdout:3/72: chown d12/f16 2 1 2023-12-16T03:15:48.415 INFO:tasks.workunit.client.1.smithi184.stdout:0/97: dwrite dc/f12 [4194304,4194304] 0 2023-12-16T03:15:48.415 INFO:tasks.workunit.client.1.smithi184.stdout:8/112: dwrite d2/fc [0,4194304] 0 2023-12-16T03:15:48.416 INFO:tasks.workunit.client.1.smithi184.stdout:0/98: rmdir dc 39 2023-12-16T03:15:48.418 INFO:tasks.workunit.client.1.smithi184.stdout:8/113: fdatasync d2/fe 0 2023-12-16T03:15:48.418 INFO:tasks.workunit.client.1.smithi184.stdout:8/114: chown d2/f13 2893471 1 2023-12-16T03:15:48.418 INFO:tasks.workunit.client.1.smithi184.stdout:8/115: fdatasync d2/d4/d10/d11/f1d 0 2023-12-16T03:15:48.418 INFO:tasks.workunit.client.1.smithi184.stdout:3/73: truncate f4 2474387 0 2023-12-16T03:15:48.419 INFO:tasks.workunit.client.1.smithi184.stdout:0/99: mknod dc/d10/d16/c20 0 2023-12-16T03:15:48.420 INFO:tasks.workunit.client.1.smithi184.stdout:3/74: symlink d12/d18/l1d 0 2023-12-16T03:15:48.421 INFO:tasks.workunit.client.1.smithi184.stdout:0/100: creat dc/d10/d1c/f21 x:0 0 0 2023-12-16T03:15:48.426 INFO:tasks.workunit.client.1.smithi184.stdout:0/101: rename dc/d10/d16 to dc/d22 0 2023-12-16T03:15:48.429 INFO:tasks.workunit.client.1.smithi184.stdout:0/102: creat dc/f23 x:0 0 0 2023-12-16T03:15:48.429 INFO:tasks.workunit.client.1.smithi184.stdout:0/103: stat dc/d22/d1a 0 2023-12-16T03:15:48.432 INFO:tasks.workunit.client.1.smithi184.stdout:3/75: dread f8 [0,4194304] 0 2023-12-16T03:15:48.434 INFO:tasks.workunit.client.1.smithi184.stdout:3/76: mkdir d12/d1e 0 2023-12-16T03:15:48.434 INFO:tasks.workunit.client.1.smithi184.stdout:3/77: write d12/f19 [702143,87336] 0 2023-12-16T03:15:48.436 INFO:tasks.workunit.client.1.smithi184.stdout:8/116: dwrite d2/f13 [0,4194304] 0 2023-12-16T03:15:48.436 INFO:tasks.workunit.client.1.smithi184.stdout:3/78: mkdir d12/d18/d1f 0 2023-12-16T03:15:48.436 INFO:tasks.workunit.client.1.smithi184.stdout:3/79: getdents d12/d1e 0 2023-12-16T03:15:48.436 INFO:tasks.workunit.client.1.smithi184.stdout:8/117: read d2/d4/d10/f17 [918398,60984] 0 2023-12-16T03:15:48.436 INFO:tasks.workunit.client.1.smithi184.stdout:8/118: dread - d2/d4/d10/d11/f29 zero size 2023-12-16T03:15:48.436 INFO:tasks.workunit.client.1.smithi184.stdout:8/119: read d2/d4/d10/d11/f1d [1154303,128084] 0 2023-12-16T03:15:48.437 INFO:tasks.workunit.client.1.smithi184.stdout:8/120: mkdir d2/d4/d10/d2a 0 2023-12-16T03:15:48.442 INFO:tasks.workunit.client.1.smithi184.stdout:3/80: dread d12/f19 [0,4194304] 0 2023-12-16T03:15:48.442 INFO:tasks.workunit.client.1.smithi184.stdout:3/81: chown cc 490 1 2023-12-16T03:15:48.442 INFO:tasks.workunit.client.1.smithi184.stdout:3/82: creat d12/d1e/f20 x:0 0 0 2023-12-16T03:15:48.443 INFO:tasks.workunit.client.1.smithi184.stdout:3/83: creat d12/d18/f21 x:0 0 0 2023-12-16T03:15:48.444 INFO:tasks.workunit.client.1.smithi184.stdout:3/84: symlink d12/l22 0 2023-12-16T03:15:48.446 INFO:tasks.workunit.client.1.smithi184.stdout:3/85: mkdir d12/d18/d1f/d23 0 2023-12-16T03:15:48.446 INFO:tasks.workunit.client.1.smithi184.stdout:3/86: rename d12 to d12/d18/d24 22 2023-12-16T03:15:48.446 INFO:tasks.workunit.client.1.smithi184.stdout:3/87: write d12/f16 [162963,64430] 0 2023-12-16T03:15:48.446 INFO:tasks.workunit.client.1.smithi184.stdout:3/88: creat d12/f25 x:0 0 0 2023-12-16T03:15:48.446 INFO:tasks.workunit.client.1.smithi184.stdout:0/104: dread dc/d10/f14 [0,4194304] 0 2023-12-16T03:15:48.447 INFO:tasks.workunit.client.1.smithi184.stdout:0/105: getdents dc/d22/d1d 0 2023-12-16T03:15:48.449 INFO:tasks.workunit.client.1.smithi184.stdout:0/106: mknod dc/d10/c24 0 2023-12-16T03:15:48.449 INFO:tasks.workunit.client.1.smithi184.stdout:0/107: truncate dc/d10/f11 465771 0 2023-12-16T03:15:48.449 INFO:tasks.workunit.client.1.smithi184.stdout:0/108: write f4 [2063090,54774] 0 2023-12-16T03:15:48.452 INFO:tasks.workunit.client.1.smithi184.stdout:3/89: getdents d12 0 2023-12-16T03:15:48.455 INFO:tasks.workunit.client.1.smithi184.stdout:0/109: dread f4 [0,4194304] 0 2023-12-16T03:15:48.455 INFO:tasks.workunit.client.1.smithi184.stdout:0/110: readlink l3 0 2023-12-16T03:15:48.455 INFO:tasks.workunit.client.1.smithi184.stdout:0/111: fsync dc/d22/d1d/f1e 0 2023-12-16T03:15:48.456 INFO:tasks.workunit.client.1.smithi184.stdout:0/112: unlink f7 0 2023-12-16T03:15:48.456 INFO:tasks.workunit.client.1.smithi184.stdout:0/113: dread - dc/f23 zero size 2023-12-16T03:15:48.456 INFO:tasks.workunit.client.1.smithi184.stdout:0/114: creat dc/d10/f25 x:0 0 0 2023-12-16T03:15:48.457 INFO:tasks.workunit.client.1.smithi184.stdout:3/90: dread d12/f16 [0,4194304] 0 2023-12-16T03:15:48.458 INFO:tasks.workunit.client.1.smithi184.stdout:3/91: stat d12/d18 0 2023-12-16T03:15:48.458 INFO:tasks.workunit.client.1.smithi184.stdout:3/92: chown d12/d1e 366410 1 2023-12-16T03:15:48.458 INFO:tasks.workunit.client.1.smithi184.stdout:3/93: symlink d12/l26 0 2023-12-16T03:15:48.459 INFO:tasks.workunit.client.1.smithi184.stdout:3/94: dread d12/f16 [0,4194304] 0 2023-12-16T03:15:48.459 INFO:tasks.workunit.client.1.smithi184.stdout:3/95: dread - d12/d18/f21 zero size 2023-12-16T03:15:48.465 INFO:tasks.workunit.client.1.smithi184.stdout:3/96: getdents d12 0 2023-12-16T03:15:48.466 INFO:tasks.workunit.client.1.smithi184.stdout:3/97: symlink d12/d18/d1f/d23/l27 0 2023-12-16T03:15:48.467 INFO:tasks.workunit.client.1.smithi184.stdout:3/98: unlink fe 0 2023-12-16T03:15:48.468 INFO:tasks.workunit.client.1.smithi184.stdout:3/99: dread - d12/d18/f21 zero size 2023-12-16T03:15:48.469 INFO:tasks.workunit.client.1.smithi184.stdout:3/100: rename ca to d12/d18/d1f/c28 0 2023-12-16T03:15:48.472 INFO:tasks.workunit.client.1.smithi184.stdout:0/115: dwrite dc/fe [0,4194304] 0 2023-12-16T03:15:48.472 INFO:tasks.workunit.client.1.smithi184.stdout:0/116: chown dc/d10/f25 1 1 2023-12-16T03:15:48.475 INFO:tasks.workunit.client.1.smithi184.stdout:0/117: mknod dc/d10/d1c/c26 0 2023-12-16T03:15:48.477 INFO:tasks.workunit.client.1.smithi184.stdout:0/118: mknod dc/c27 0 2023-12-16T03:15:48.481 INFO:tasks.workunit.client.1.smithi184.stdout:0/119: truncate dc/d10/f14 1405929 0 2023-12-16T03:15:48.482 INFO:tasks.workunit.client.1.smithi184.stdout:0/120: write f4 [1026704,103896] 0 2023-12-16T03:15:48.488 INFO:tasks.workunit.client.1.smithi184.stdout:3/101: dwrite d12/d1e/f20 [0,4194304] 0 2023-12-16T03:15:48.490 INFO:tasks.workunit.client.1.smithi184.stdout:3/102: read d12/f1b [2513129,93456] 0 2023-12-16T03:15:48.490 INFO:tasks.workunit.client.1.smithi184.stdout:3/103: chown d12/d1e/f20 585 1 2023-12-16T03:15:48.491 INFO:tasks.workunit.client.1.smithi184.stdout:3/104: chown d12/d18/d1f/c28 51718 1 2023-12-16T03:15:48.492 INFO:tasks.workunit.client.1.smithi184.stdout:3/105: write d12/f1b [4175233,89750] 0 2023-12-16T03:15:48.493 INFO:tasks.workunit.client.1.smithi184.stdout:0/121: write dc/fe [1176574,16881] 0 2023-12-16T03:15:48.494 INFO:tasks.workunit.client.1.smithi184.stdout:3/106: rename lf to d12/d18/d1f/l29 0 2023-12-16T03:15:48.495 INFO:tasks.workunit.client.1.smithi184.stdout:0/122: rmdir dc 39 2023-12-16T03:15:48.495 INFO:tasks.workunit.client.1.smithi184.stdout:0/123: write dc/d10/d1c/f21 [466499,103970] 0 2023-12-16T03:15:48.496 INFO:tasks.workunit.client.1.smithi184.stdout:3/107: truncate f4 842319 0 2023-12-16T03:15:48.496 INFO:tasks.workunit.client.1.smithi184.stdout:3/108: chown d12/f1b 12869 1 2023-12-16T03:15:48.497 INFO:tasks.workunit.client.1.smithi184.stdout:3/109: mkdir d12/d18/d1f/d23/d2a 0 2023-12-16T03:15:48.503 INFO:tasks.workunit.client.1.smithi184.stdout:3/110: dread f8 [0,4194304] 0 2023-12-16T03:15:48.504 INFO:tasks.workunit.client.1.smithi184.stdout:3/111: symlink d12/d18/d1f/d23/l2b 0 2023-12-16T03:15:48.505 INFO:tasks.workunit.client.1.smithi184.stdout:3/112: creat d12/d18/d1f/d23/f2c x:0 0 0 2023-12-16T03:15:48.506 INFO:tasks.workunit.client.1.smithi184.stdout:3/113: creat d12/d1e/f2d x:0 0 0 2023-12-16T03:15:48.507 INFO:tasks.workunit.client.1.smithi184.stdout:3/114: creat d12/d18/d1f/f2e x:0 0 0 2023-12-16T03:15:48.508 INFO:tasks.workunit.client.1.smithi184.stdout:3/115: creat d12/d18/d1f/d23/d2a/f2f x:0 0 0 2023-12-16T03:15:48.511 INFO:tasks.workunit.client.1.smithi184.stdout:0/124: dwrite dc/f12 [4194304,4194304] 0 2023-12-16T03:15:48.511 INFO:tasks.workunit.client.1.smithi184.stdout:0/125: fdatasync dc/d10/f14 0 2023-12-16T03:15:48.513 INFO:tasks.workunit.client.1.smithi184.stdout:0/126: symlink dc/d22/d1d/l28 0 2023-12-16T03:15:48.514 INFO:tasks.workunit.client.1.smithi184.stdout:0/127: read dc/d10/f14 [925577,109907] 0 2023-12-16T03:15:48.515 INFO:tasks.workunit.client.1.smithi184.stdout:0/128: rmdir dc/d10 39 2023-12-16T03:15:48.517 INFO:tasks.workunit.client.1.smithi184.stdout:0/129: read dc/d10/f14 [682304,15311] 0 2023-12-16T03:15:48.532 INFO:tasks.workunit.client.1.smithi184.stdout:3/116: dwrite f2 [0,4194304] 0 2023-12-16T03:15:48.534 INFO:tasks.workunit.client.1.smithi184.stdout:0/130: dwrite dc/d22/d1d/f1e [0,4194304] 0 2023-12-16T03:15:48.535 INFO:tasks.workunit.client.1.smithi184.stdout:0/131: read dc/d10/d1c/f21 [80503,41525] 0 2023-12-16T03:15:48.536 INFO:tasks.workunit.client.1.smithi184.stdout:0/132: creat dc/d22/f29 x:0 0 0 2023-12-16T03:15:48.536 INFO:tasks.workunit.client.1.smithi184.stdout:3/117: getdents d12/d18/d1f/d23 0 2023-12-16T03:15:48.549 INFO:tasks.workunit.client.1.smithi184.stdout:0/133: dread f4 [0,4194304] 0 2023-12-16T03:15:48.549 INFO:tasks.workunit.client.1.smithi184.stdout:0/134: truncate dc/d10/f25 573538 0 2023-12-16T03:15:48.549 INFO:tasks.workunit.client.1.smithi184.stdout:0/135: write dc/f19 [1287911,28503] 0 2023-12-16T03:15:48.550 INFO:tasks.workunit.client.1.smithi184.stdout:3/118: dwrite f4 [0,4194304] 0 2023-12-16T03:15:48.551 INFO:tasks.workunit.client.1.smithi184.stdout:3/119: creat d12/d18/f30 x:0 0 0 2023-12-16T03:15:48.551 INFO:tasks.workunit.client.1.smithi184.stdout:3/120: truncate d12/f16 961157 0 2023-12-16T03:15:48.558 INFO:tasks.workunit.client.1.smithi184.stdout:0/136: dread dc/f12 [0,4194304] 0 2023-12-16T03:15:48.558 INFO:tasks.workunit.client.1.smithi184.stdout:0/137: fdatasync dc/f12 0 2023-12-16T03:15:48.559 INFO:tasks.workunit.client.1.smithi184.stdout:0/138: write dc/f19 [2432476,12541] 0 2023-12-16T03:15:48.564 INFO:tasks.workunit.client.1.smithi184.stdout:0/139: rmdir dc/d22 39 2023-12-16T03:15:48.565 INFO:tasks.workunit.client.1.smithi184.stdout:3/121: dwrite d12/d1e/f20 [4194304,4194304] 0 2023-12-16T03:15:48.565 INFO:tasks.workunit.client.1.smithi184.stdout:3/122: write d12/d1e/f2d [320187,4831] 0 2023-12-16T03:15:48.566 INFO:tasks.workunit.client.1.smithi184.stdout:3/123: mknod d12/d18/d1f/d23/c31 0 2023-12-16T03:15:48.566 INFO:tasks.workunit.client.1.smithi184.stdout:3/124: dread - d12/d18/f21 zero size 2023-12-16T03:15:48.567 INFO:tasks.workunit.client.1.smithi184.stdout:3/125: creat d12/d18/f32 x:0 0 0 2023-12-16T03:15:48.568 INFO:tasks.workunit.client.1.smithi184.stdout:3/126: symlink d12/l33 0 2023-12-16T03:15:48.568 INFO:tasks.workunit.client.1.smithi184.stdout:3/127: dread - d12/d18/d1f/d23/f2c zero size 2023-12-16T03:15:48.569 INFO:tasks.workunit.client.1.smithi184.stdout:3/128: rename d12/d18/d1f/d23/f2c to d12/d18/d1f/d23/d2a/f34 0 2023-12-16T03:15:48.570 INFO:tasks.workunit.client.1.smithi184.stdout:3/129: dread d12/f16 [0,4194304] 0 2023-12-16T03:15:48.577 INFO:tasks.workunit.client.1.smithi184.stdout:3/130: dread d12/d1e/f20 [4194304,4194304] 0 2023-12-16T03:15:48.577 INFO:tasks.workunit.client.1.smithi184.stdout:3/131: write d12/f16 [1722269,109337] 0 2023-12-16T03:15:48.593 INFO:tasks.workunit.client.1.smithi184.stdout:0/140: dwrite dc/d10/f14 [0,4194304] 0 2023-12-16T03:15:48.594 INFO:tasks.workunit.client.1.smithi184.stdout:0/141: truncate dc/d10/f11 623998 0 2023-12-16T03:15:48.594 INFO:tasks.workunit.client.1.smithi184.stdout:3/132: dwrite fd [0,4194304] 0 2023-12-16T03:15:48.594 INFO:tasks.workunit.client.1.smithi184.stdout:3/133: chown fd 0 1 2023-12-16T03:15:48.594 INFO:tasks.workunit.client.1.smithi184.stdout:3/134: stat f8 0 2023-12-16T03:15:48.594 INFO:tasks.workunit.client.1.smithi184.stdout:3/135: stat l7 0 2023-12-16T03:15:48.595 INFO:tasks.workunit.client.1.smithi184.stdout:0/142: mkdir dc/d2a 0 2023-12-16T03:15:48.596 INFO:tasks.workunit.client.1.smithi184.stdout:3/136: read d12/f1b [2734733,62159] 0 2023-12-16T03:15:48.603 INFO:tasks.workunit.client.0.smithi064.stdout:2/17: creat d1/f3 x:0 0 0 2023-12-16T03:15:48.603 INFO:tasks.workunit.client.0.smithi064.stdout:2/18: write d1/f3 [364054,37042] 0 2023-12-16T03:15:48.603 INFO:tasks.workunit.client.0.smithi064.stdout:2/19: readlink - no filename 2023-12-16T03:15:48.610 INFO:tasks.workunit.client.1.smithi184.stdout:0/143: dread dc/fe [0,4194304] 0 2023-12-16T03:15:48.611 INFO:tasks.workunit.client.1.smithi184.stdout:0/144: mknod dc/d22/c2b 0 2023-12-16T03:15:48.613 INFO:tasks.workunit.client.1.smithi184.stdout:3/137: dwrite d12/d18/f1c [0,4194304] 0 2023-12-16T03:15:48.613 INFO:tasks.workunit.client.1.smithi184.stdout:3/138: truncate f8 4492870 0 2023-12-16T03:15:48.616 INFO:tasks.workunit.client.0.smithi064.stdout:3/15: link f1 f3 0 2023-12-16T03:15:48.621 INFO:tasks.workunit.client.1.smithi184.stdout:3/139: rename d12/l22 to d12/d18/l35 0 2023-12-16T03:15:48.622 INFO:tasks.workunit.client.1.smithi184.stdout:3/140: mkdir d12/d18/d1f/d23/d2a/d36 0 2023-12-16T03:15:48.622 INFO:tasks.workunit.client.1.smithi184.stdout:3/141: mkdir d12/d37 0 2023-12-16T03:15:48.624 INFO:tasks.workunit.client.1.smithi184.stdout:3/142: rename d12/d18/f1c to d12/d18/d1f/d23/d2a/f38 0 2023-12-16T03:15:48.625 INFO:tasks.workunit.client.1.smithi184.stdout:3/143: symlink d12/d18/d1f/d23/l39 0 2023-12-16T03:15:48.625 INFO:tasks.workunit.client.1.smithi184.stdout:3/144: mkdir d12/d18/d1f/d3a 0 2023-12-16T03:15:48.626 INFO:tasks.workunit.client.1.smithi184.stdout:3/145: mkdir d12/d18/d1f/d3b 0 2023-12-16T03:15:48.627 INFO:tasks.workunit.client.1.smithi184.stdout:0/145: dwrite dc/d22/d1d/f1e [0,4194304] 0 2023-12-16T03:15:48.627 INFO:tasks.workunit.client.1.smithi184.stdout:0/146: mkdir dc/d22/d1d/d2c 0 2023-12-16T03:15:48.629 INFO:tasks.workunit.client.1.smithi184.stdout:0/147: mkdir dc/d10/d2d 0 2023-12-16T03:15:48.630 INFO:tasks.workunit.client.1.smithi184.stdout:0/148: rename dc/d22/c20 to dc/d2a/c2e 0 2023-12-16T03:15:48.636 INFO:tasks.workunit.client.1.smithi184.stdout:3/146: dread d12/d18/d1f/d23/d2a/f38 [0,4194304] 0 2023-12-16T03:15:48.638 INFO:tasks.workunit.client.1.smithi184.stdout:0/149: unlink dc/d2a/c2e 0 2023-12-16T03:15:48.638 INFO:tasks.workunit.client.1.smithi184.stdout:0/150: write dc/f23 [408832,125080] 0 2023-12-16T03:15:48.639 INFO:tasks.workunit.client.1.smithi184.stdout:0/151: rmdir dc/d22 39 2023-12-16T03:15:48.640 INFO:tasks.workunit.client.1.smithi184.stdout:0/152: creat dc/d10/d1c/f2f x:0 0 0 2023-12-16T03:15:48.641 INFO:tasks.workunit.client.1.smithi184.stdout:0/153: truncate dc/f12 3740877 0 2023-12-16T03:15:48.643 INFO:tasks.workunit.client.1.smithi184.stdout:3/147: dread f4 [0,4194304] 0 2023-12-16T03:15:48.647 INFO:tasks.workunit.client.1.smithi184.stdout:3/148: rmdir d12/d18/d1f/d3b 0 2023-12-16T03:15:48.647 INFO:tasks.workunit.client.1.smithi184.stdout:3/149: stat d12/d18/d1f/d23/l27 0 2023-12-16T03:15:48.649 INFO:tasks.workunit.client.1.smithi184.stdout:0/154: truncate f4 3397306 0 2023-12-16T03:15:48.660 INFO:tasks.workunit.client.1.smithi184.stdout:0/155: rename l9 to dc/d22/d1d/d2c/l30 0 2023-12-16T03:15:48.661 INFO:tasks.workunit.client.1.smithi184.stdout:0/156: link dc/d10/d1c/c26 dc/d10/d2d/c31 0 2023-12-16T03:15:48.661 INFO:tasks.workunit.client.1.smithi184.stdout:0/157: readlink dc/lf 0 2023-12-16T03:15:48.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:15:48.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:48.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:15:48.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:15:48.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:48 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:15:48.714 INFO:tasks.workunit.client.1.smithi184.stdout:0/158: read dc/d10/d1c/f21 [448222,748] 0 2023-12-16T03:15:48.715 INFO:tasks.workunit.client.1.smithi184.stdout:0/159: write dc/d22/d1d/f1e [2933714,95712] 0 2023-12-16T03:15:48.715 INFO:tasks.workunit.client.1.smithi184.stdout:0/160: write dc/f23 [1474126,25509] 0 2023-12-16T03:15:48.716 INFO:tasks.workunit.client.1.smithi184.stdout:3/150: truncate f9 2304994 0 2023-12-16T03:15:48.716 INFO:tasks.workunit.client.1.smithi184.stdout:3/151: stat d12/d1e 0 2023-12-16T03:15:48.716 INFO:tasks.workunit.client.1.smithi184.stdout:3/152: write d12/f16 [2024376,106070] 0 2023-12-16T03:15:48.717 INFO:tasks.workunit.client.1.smithi184.stdout:3/153: write f8 [3612609,75558] 0 2023-12-16T03:15:48.718 INFO:tasks.workunit.client.1.smithi184.stdout:3/154: write d12/d18/d1f/d23/d2a/f38 [817142,47606] 0 2023-12-16T03:15:48.720 INFO:tasks.workunit.client.1.smithi184.stdout:3/155: write fd [230883,15585] 0 2023-12-16T03:15:48.721 INFO:tasks.workunit.client.1.smithi184.stdout:3/156: creat d12/d18/d1f/d3a/f3c x:0 0 0 2023-12-16T03:15:48.724 INFO:tasks.workunit.client.1.smithi184.stdout:3/157: creat d12/d18/d1f/f3d x:0 0 0 2023-12-16T03:15:48.726 INFO:tasks.workunit.client.1.smithi184.stdout:3/158: read d12/f1b [2189804,43753] 0 2023-12-16T03:15:48.726 INFO:tasks.workunit.client.1.smithi184.stdout:3/159: chown d12/d18/d1f/f3d 7 1 2023-12-16T03:15:48.726 INFO:tasks.workunit.client.1.smithi184.stdout:3/160: chown d12/d18/d1f/c28 408 1 2023-12-16T03:15:48.726 INFO:tasks.workunit.client.1.smithi184.stdout:3/161: read d12/d1e/f20 [8244547,73101] 0 2023-12-16T03:15:48.727 INFO:tasks.workunit.client.1.smithi184.stdout:3/162: getdents d12/d18/d1f/d23 0 2023-12-16T03:15:48.728 INFO:tasks.workunit.client.1.smithi184.stdout:3/163: mkdir d12/d18/d1f/d23/d2a/d3e 0 2023-12-16T03:15:48.739 INFO:tasks.workunit.client.1.smithi184.stdout:0/161: dwrite dc/f23 [0,4194304] 0 2023-12-16T03:15:48.741 INFO:tasks.workunit.client.1.smithi184.stdout:0/162: rename dc/c27 to dc/d2a/c32 0 2023-12-16T03:15:48.741 INFO:tasks.workunit.client.1.smithi184.stdout:0/163: chown dc/fe 1784916 1 2023-12-16T03:15:48.742 INFO:tasks.workunit.client.1.smithi184.stdout:0/164: mkdir dc/d10/d1c/d33 0 2023-12-16T03:15:48.742 INFO:tasks.workunit.client.1.smithi184.stdout:0/165: truncate dc/d10/f25 1349445 0 2023-12-16T03:15:48.743 INFO:tasks.workunit.client.1.smithi184.stdout:0/166: symlink dc/d10/l34 0 2023-12-16T03:15:48.743 INFO:tasks.workunit.client.1.smithi184.stdout:0/167: stat dc/d22/d1a 0 2023-12-16T03:15:48.743 INFO:tasks.workunit.client.1.smithi184.stdout:0/168: mkdir dc/d22/d1d/d35 0 2023-12-16T03:15:48.749 INFO:tasks.workunit.client.1.smithi184.stdout:3/164: dwrite fd [0,4194304] 0 2023-12-16T03:15:48.750 INFO:tasks.workunit.client.1.smithi184.stdout:3/165: creat d12/d37/f3f x:0 0 0 2023-12-16T03:15:48.752 INFO:tasks.workunit.client.1.smithi184.stdout:3/166: getdents d12/d18 0 2023-12-16T03:15:48.753 INFO:tasks.workunit.client.1.smithi184.stdout:3/167: mknod d12/d18/d1f/d3a/c40 0 2023-12-16T03:15:48.753 INFO:tasks.workunit.client.1.smithi184.stdout:3/168: write d12/d18/f21 [622430,72183] 0 2023-12-16T03:15:48.753 INFO:tasks.workunit.client.1.smithi184.stdout:3/169: stat c10 0 2023-12-16T03:15:48.755 INFO:tasks.workunit.client.1.smithi184.stdout:3/170: symlink d12/d1e/l41 0 2023-12-16T03:15:48.756 INFO:tasks.workunit.client.1.smithi184.stdout:3/171: mkdir d12/d18/d1f/d23/d2a/d42 0 2023-12-16T03:15:48.756 INFO:tasks.workunit.client.1.smithi184.stdout:3/172: dread - d12/f25 zero size 2023-12-16T03:15:48.757 INFO:tasks.workunit.client.1.smithi184.stdout:3/173: link d12/d18/d1f/d23/l2b d12/d18/d1f/d3a/l43 0 2023-12-16T03:15:48.771 INFO:tasks.workunit.client.1.smithi184.stdout:3/174: dread d12/f1b [0,4194304] 0 2023-12-16T03:15:48.772 INFO:tasks.workunit.client.1.smithi184.stdout:3/175: unlink d12/f17 0 2023-12-16T03:15:48.801 INFO:tasks.workunit.client.1.smithi184.stdout:3/176: read f4 [2051737,31183] 0 2023-12-16T03:15:48.806 INFO:tasks.workunit.client.1.smithi184.stdout:3/177: dread d12/f16 [0,4194304] 0 2023-12-16T03:15:48.807 INFO:tasks.workunit.client.1.smithi184.stdout:0/169: dwrite dc/d22/d1d/f1e [0,4194304] 0 2023-12-16T03:15:48.809 INFO:tasks.workunit.client.1.smithi184.stdout:0/170: unlink dc/d22/d1d/f1e 0 2023-12-16T03:15:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:15:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:15:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:15:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:48 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:15:48.810 INFO:tasks.workunit.client.1.smithi184.stdout:0/171: mknod dc/d22/c36 0 2023-12-16T03:15:48.812 INFO:tasks.workunit.client.1.smithi184.stdout:3/178: dread f4 [0,4194304] 0 2023-12-16T03:15:48.813 INFO:tasks.workunit.client.1.smithi184.stdout:3/179: link d12/f25 d12/d18/d1f/f44 0 2023-12-16T03:15:48.815 INFO:tasks.workunit.client.1.smithi184.stdout:3/180: creat d12/d18/d1f/d23/d2a/d42/f45 x:0 0 0 2023-12-16T03:15:48.823 INFO:tasks.workunit.client.1.smithi184.stdout:3/181: dread d12/d18/d1f/d23/d2a/f38 [0,4194304] 0 2023-12-16T03:15:48.823 INFO:tasks.workunit.client.1.smithi184.stdout:3/182: truncate d12/d18/f30 535707 0 2023-12-16T03:15:48.824 INFO:tasks.workunit.client.1.smithi184.stdout:0/172: dwrite dc/d10/d1c/f21 [0,4194304] 0 2023-12-16T03:15:48.826 INFO:tasks.workunit.client.1.smithi184.stdout:0/173: mknod dc/d22/d1d/d2c/c37 0 2023-12-16T03:15:48.828 INFO:tasks.workunit.client.1.smithi184.stdout:0/174: rmdir dc/d10/d1c/d33 0 2023-12-16T03:15:48.830 INFO:tasks.workunit.client.1.smithi184.stdout:3/183: rmdir d12/d18/d1f/d23/d2a 39 2023-12-16T03:15:48.831 INFO:tasks.workunit.client.1.smithi184.stdout:3/184: creat d12/d18/d1f/d23/d2a/d42/f46 x:0 0 0 2023-12-16T03:15:48.832 INFO:tasks.workunit.client.1.smithi184.stdout:3/185: truncate d12/f1b 1389878 0 2023-12-16T03:15:48.834 INFO:tasks.workunit.client.1.smithi184.stdout:3/186: write d12/d18/d1f/d23/d2a/f38 [130803,64069] 0 2023-12-16T03:15:48.836 INFO:tasks.workunit.client.1.smithi184.stdout:3/187: creat d12/d1e/f47 x:0 0 0 2023-12-16T03:15:48.836 INFO:tasks.workunit.client.1.smithi184.stdout:3/188: read - d12/d37/f3f zero size 2023-12-16T03:15:48.841 INFO:tasks.workunit.client.1.smithi184.stdout:3/189: mkdir d12/d18/d1f/d23/d2a/d3e/d48 0 2023-12-16T03:15:48.841 INFO:tasks.workunit.client.1.smithi184.stdout:3/190: dread - d12/d18/d1f/f3d zero size 2023-12-16T03:15:48.841 INFO:tasks.workunit.client.1.smithi184.stdout:3/191: chown d12/d18 328041469 1 2023-12-16T03:15:48.842 INFO:tasks.workunit.client.1.smithi184.stdout:3/192: symlink d12/d18/l49 0 2023-12-16T03:15:48.842 INFO:tasks.workunit.client.1.smithi184.stdout:3/193: truncate d12/d18/d1f/d23/d2a/d42/f46 914022 0 2023-12-16T03:15:48.843 INFO:tasks.workunit.client.1.smithi184.stdout:3/194: mkdir d12/d18/d1f/d23/d2a/d4a 0 2023-12-16T03:15:48.843 INFO:tasks.workunit.client.1.smithi184.stdout:3/195: readlink d12/d18/d1f/d23/l27 0 2023-12-16T03:15:48.844 INFO:tasks.workunit.client.1.smithi184.stdout:3/196: rename d12/c14 to d12/d18/d1f/d3a/c4b 0 2023-12-16T03:15:48.844 INFO:tasks.workunit.client.1.smithi184.stdout:3/197: readlink d12/d18/d1f/d23/l2b 0 2023-12-16T03:15:48.845 INFO:tasks.workunit.client.1.smithi184.stdout:3/198: link d12/d18/d1f/l29 d12/l4c 0 2023-12-16T03:15:48.849 INFO:tasks.workunit.client.1.smithi184.stdout:0/175: dwrite dc/fe [0,4194304] 0 2023-12-16T03:15:48.849 INFO:tasks.workunit.client.1.smithi184.stdout:0/176: fsync dc/f12 0 2023-12-16T03:15:48.849 INFO:tasks.workunit.client.1.smithi184.stdout:0/177: chown dc/d22/d1d 63504 1 2023-12-16T03:15:48.850 INFO:tasks.workunit.client.1.smithi184.stdout:0/178: rename dc/f23 to dc/d22/d1d/d35/f38 0 2023-12-16T03:15:48.851 INFO:tasks.workunit.client.1.smithi184.stdout:0/179: symlink dc/d10/d1c/l39 0 2023-12-16T03:15:48.853 INFO:tasks.workunit.client.1.smithi184.stdout:0/180: mknod dc/d2a/c3a 0 2023-12-16T03:15:48.854 INFO:tasks.workunit.client.1.smithi184.stdout:0/181: write dc/d10/d1c/f21 [266109,89624] 0 2023-12-16T03:15:48.856 INFO:tasks.workunit.client.1.smithi184.stdout:0/182: symlink dc/d22/d1d/d2c/l3b 0 2023-12-16T03:15:48.856 INFO:tasks.workunit.client.1.smithi184.stdout:0/183: chown dc/d22/c2b 322267 1 2023-12-16T03:15:48.868 INFO:tasks.workunit.client.1.smithi184.stdout:3/199: dwrite d12/f25 [0,4194304] 0 2023-12-16T03:15:48.868 INFO:tasks.workunit.client.1.smithi184.stdout:3/200: chown d12/d18/d1f/d23/l27 211 1 2023-12-16T03:15:48.869 INFO:tasks.workunit.client.1.smithi184.stdout:3/201: read f8 [1186617,7770] 0 2023-12-16T03:15:48.870 INFO:tasks.workunit.client.1.smithi184.stdout:3/202: dread d12/d18/f30 [0,4194304] 0 2023-12-16T03:15:48.871 INFO:tasks.workunit.client.1.smithi184.stdout:3/203: write d12/d18/d1f/d23/d2a/f34 [159164,41655] 0 2023-12-16T03:15:48.872 INFO:tasks.workunit.client.1.smithi184.stdout:3/204: mkdir d12/d18/d1f/d23/d2a/d4a/d4d 0 2023-12-16T03:15:48.873 INFO:tasks.workunit.client.1.smithi184.stdout:3/205: write f2 [2867778,57018] 0 2023-12-16T03:15:48.873 INFO:tasks.workunit.client.1.smithi184.stdout:3/206: stat d12/d18/d1f/d23/d2a/d42 0 2023-12-16T03:15:48.874 INFO:tasks.workunit.client.1.smithi184.stdout:3/207: creat d12/d18/d1f/d23/d2a/f4e x:0 0 0 2023-12-16T03:15:48.874 INFO:tasks.workunit.client.1.smithi184.stdout:3/208: dread - d12/d18/d1f/d3a/f3c zero size 2023-12-16T03:15:48.874 INFO:tasks.workunit.client.1.smithi184.stdout:3/209: truncate d12/d18/d1f/d23/d2a/d42/f45 910291 0 2023-12-16T03:15:48.875 INFO:tasks.workunit.client.1.smithi184.stdout:3/210: chown d12/d18/d1f/l29 321486694 1 2023-12-16T03:15:48.875 INFO:tasks.workunit.client.1.smithi184.stdout:3/211: rename d12/d18/l49 to d12/d18/d1f/d23/d2a/d3e/d48/l4f 0 2023-12-16T03:15:48.876 INFO:tasks.workunit.client.1.smithi184.stdout:3/212: truncate d12/d18/f30 587756 0 2023-12-16T03:15:48.876 INFO:tasks.workunit.client.1.smithi184.stdout:3/213: chown d12/l4c 5685833 1 2023-12-16T03:15:48.876 INFO:tasks.workunit.client.1.smithi184.stdout:3/214: creat d12/d18/d1f/d3a/f50 x:0 0 0 2023-12-16T03:15:48.878 INFO:tasks.workunit.client.1.smithi184.stdout:3/215: rename d12/d18/d1f/d23/d2a/d4a/d4d to d12/d18/d1f/d23/d51 0 2023-12-16T03:15:49.110 INFO:tasks.workunit.client.1.smithi184.stdout:5/15: sync 2023-12-16T03:15:49.112 INFO:tasks.workunit.client.1.smithi184.stdout:5/16: symlink d1/d3/l4 0 2023-12-16T03:15:49.112 INFO:tasks.workunit.client.1.smithi184.stdout:5/17: truncate d1/f2 1091079 0 2023-12-16T03:15:49.118 INFO:tasks.workunit.client.1.smithi184.stdout:6/45: sync 2023-12-16T03:15:49.118 INFO:tasks.workunit.client.1.smithi184.stdout:2/33: sync 2023-12-16T03:15:49.118 INFO:tasks.workunit.client.1.smithi184.stdout:2/34: creat d3/d5/fa x:0 0 0 2023-12-16T03:15:49.129 INFO:tasks.workunit.client.1.smithi184.stdout:6/46: dread d0/f7 [0,4194304] 0 2023-12-16T03:15:49.129 INFO:tasks.workunit.client.1.smithi184.stdout:2/35: dread d3/f4 [0,4194304] 0 2023-12-16T03:15:49.129 INFO:tasks.workunit.client.1.smithi184.stdout:6/47: creat d0/d5/d6/fb x:0 0 0 2023-12-16T03:15:49.129 INFO:tasks.workunit.client.1.smithi184.stdout:2/36: link d3/d5/fa d3/d5/fb 0 2023-12-16T03:15:49.129 INFO:tasks.workunit.client.1.smithi184.stdout:2/37: write d3/d5/fb [627957,86568] 0 2023-12-16T03:15:49.131 INFO:tasks.workunit.client.1.smithi184.stdout:2/38: creat d3/d9/fc x:0 0 0 2023-12-16T03:15:49.131 INFO:tasks.workunit.client.1.smithi184.stdout:2/39: chown d3/d5/fa 0 1 2023-12-16T03:15:49.131 INFO:tasks.workunit.client.1.smithi184.stdout:2/40: chown d3/d5/fa 379 1 2023-12-16T03:15:49.133 INFO:tasks.workunit.client.1.smithi184.stdout:6/48: rmdir d0/d5/d6 39 2023-12-16T03:15:49.133 INFO:tasks.workunit.client.1.smithi184.stdout:6/49: getdents d0/d5/d6 0 2023-12-16T03:15:49.138 INFO:tasks.workunit.client.1.smithi184.stdout:6/50: dread d0/f7 [0,4194304] 0 2023-12-16T03:15:49.141 INFO:tasks.workunit.client.1.smithi184.stdout:6/51: dread d0/f7 [0,4194304] 0 2023-12-16T03:15:49.142 INFO:tasks.workunit.client.1.smithi184.stdout:6/52: creat d0/d5/fc x:0 0 0 2023-12-16T03:15:49.147 INFO:tasks.workunit.client.1.smithi184.stdout:2/41: dwrite d3/d5/fb [0,4194304] 0 2023-12-16T03:15:49.149 INFO:tasks.workunit.client.1.smithi184.stdout:2/42: link d3/d9/fc d3/fd 0 2023-12-16T03:15:49.163 INFO:tasks.workunit.client.1.smithi184.stdout:6/53: dwrite d0/d5/d6/fa [4194304,4194304] 0 2023-12-16T03:15:49.163 INFO:tasks.workunit.client.1.smithi184.stdout:6/54: read - d0/d5/fc zero size 2023-12-16T03:15:49.163 INFO:tasks.workunit.client.1.smithi184.stdout:2/43: dwrite d3/d5/f7 [0,4194304] 0 2023-12-16T03:15:49.164 INFO:tasks.workunit.client.1.smithi184.stdout:6/55: mknod d0/d5/d6/cd 0 2023-12-16T03:15:49.165 INFO:tasks.workunit.client.1.smithi184.stdout:6/56: readlink d0/l9 0 2023-12-16T03:15:49.166 INFO:tasks.workunit.client.1.smithi184.stdout:6/57: symlink d0/d5/le 0 2023-12-16T03:15:49.166 INFO:tasks.workunit.client.1.smithi184.stdout:6/58: truncate d0/d5/d6/fb 849369 0 2023-12-16T03:15:49.167 INFO:tasks.workunit.client.1.smithi184.stdout:6/59: truncate d0/d5/d6/fa 4870282 0 2023-12-16T03:15:49.178 INFO:tasks.workunit.client.1.smithi184.stdout:6/60: write d0/d5/d6/fa [1538227,115733] 0 2023-12-16T03:15:49.180 INFO:tasks.workunit.client.1.smithi184.stdout:6/61: mkdir d0/df 0 2023-12-16T03:15:49.181 INFO:tasks.workunit.client.1.smithi184.stdout:6/62: rmdir d0/df 0 2023-12-16T03:15:49.182 INFO:tasks.workunit.client.1.smithi184.stdout:6/63: write d0/f7 [720368,9121] 0 2023-12-16T03:15:49.182 INFO:tasks.workunit.client.1.smithi184.stdout:6/64: dread - d0/d5/fc zero size 2023-12-16T03:15:49.182 INFO:tasks.workunit.client.1.smithi184.stdout:6/65: fdatasync d0/d5/fc 0 2023-12-16T03:15:49.183 INFO:tasks.workunit.client.1.smithi184.stdout:6/66: symlink d0/d5/l10 0 2023-12-16T03:15:49.184 INFO:tasks.workunit.client.1.smithi184.stdout:6/67: symlink d0/d5/d6/l11 0 2023-12-16T03:15:49.185 INFO:tasks.workunit.client.1.smithi184.stdout:6/68: write d0/d5/d6/fa [4014387,55087] 0 2023-12-16T03:15:49.185 INFO:tasks.workunit.client.1.smithi184.stdout:6/69: readlink d0/d5/le 0 2023-12-16T03:15:49.186 INFO:tasks.workunit.client.1.smithi184.stdout:6/70: dread d0/d5/d6/fb [0,4194304] 0 2023-12-16T03:15:49.187 INFO:tasks.workunit.client.1.smithi184.stdout:6/71: mkdir d0/d5/d12 0 2023-12-16T03:15:49.187 INFO:tasks.workunit.client.1.smithi184.stdout:6/72: chown d0/d5/d6/fa 30 1 2023-12-16T03:15:49.187 INFO:tasks.workunit.client.1.smithi184.stdout:6/73: readlink d0/d5/le 0 2023-12-16T03:15:49.188 INFO:tasks.workunit.client.1.smithi184.stdout:6/74: creat d0/d5/d6/f13 x:0 0 0 2023-12-16T03:15:49.193 INFO:tasks.workunit.client.1.smithi184.stdout:6/75: rename d0/d5/d6 to d0/d5/d14 0 2023-12-16T03:15:49.195 INFO:tasks.workunit.client.1.smithi184.stdout:6/76: fsync d0/d5/d14/fa 0 2023-12-16T03:15:49.196 INFO:tasks.workunit.client.1.smithi184.stdout:6/77: write d0/d5/d14/f13 [614663,85135] 0 2023-12-16T03:15:49.196 INFO:tasks.workunit.client.1.smithi184.stdout:6/78: write d0/f7 [4663425,54338] 0 2023-12-16T03:15:49.197 INFO:tasks.workunit.client.1.smithi184.stdout:6/79: creat d0/d5/d12/f15 x:0 0 0 2023-12-16T03:15:49.197 INFO:tasks.workunit.client.1.smithi184.stdout:6/80: read d0/d5/d14/fb [562636,10879] 0 2023-12-16T03:15:49.197 INFO:tasks.workunit.client.1.smithi184.stdout:6/81: dread - d0/d5/d12/f15 zero size 2023-12-16T03:15:49.213 INFO:tasks.workunit.client.1.smithi184.stdout:6/82: dwrite d0/d5/d14/fb [0,4194304] 0 2023-12-16T03:15:49.213 INFO:tasks.workunit.client.1.smithi184.stdout:6/83: stat d0/d5/d14 0 2023-12-16T03:15:49.213 INFO:tasks.workunit.client.1.smithi184.stdout:6/84: read d0/d5/d14/f13 [551734,44324] 0 2023-12-16T03:15:49.216 INFO:tasks.workunit.client.1.smithi184.stdout:6/85: getdents d0/d5/d12 0 2023-12-16T03:15:49.217 INFO:tasks.workunit.client.1.smithi184.stdout:6/86: chown d0/d5/d14/l11 1268 1 2023-12-16T03:15:49.217 INFO:tasks.workunit.client.1.smithi184.stdout:6/87: readlink d0/d5/le 0 2023-12-16T03:15:49.217 INFO:tasks.workunit.client.1.smithi184.stdout:6/88: readlink d0/d5/le 0 2023-12-16T03:15:49.217 INFO:tasks.workunit.client.1.smithi184.stdout:6/89: write d0/d5/fc [522983,80741] 0 2023-12-16T03:15:49.218 INFO:tasks.workunit.client.1.smithi184.stdout:6/90: rename d0/f7 to d0/d5/d12/f16 0 2023-12-16T03:15:49.218 INFO:tasks.workunit.client.1.smithi184.stdout:6/91: fdatasync d0/d5/d14/fa 0 2023-12-16T03:15:49.218 INFO:tasks.workunit.client.1.smithi184.stdout:6/92: read d0/d5/d14/f13 [616228,59569] 0 2023-12-16T03:15:49.218 INFO:tasks.workunit.client.1.smithi184.stdout:6/93: chown d0/d5/l10 62308 1 2023-12-16T03:15:49.237 INFO:tasks.workunit.client.1.smithi184.stdout:6/94: dwrite d0/d5/fc [0,4194304] 0 2023-12-16T03:15:49.237 INFO:tasks.workunit.client.1.smithi184.stdout:6/95: truncate d0/d5/d14/fb 4441048 0 2023-12-16T03:15:49.238 INFO:tasks.workunit.client.1.smithi184.stdout:6/96: chown d0/c2 4 1 2023-12-16T03:15:49.238 INFO:tasks.workunit.client.1.smithi184.stdout:6/97: chown d0/d5/d12/f15 7546026 1 2023-12-16T03:15:49.239 INFO:tasks.workunit.client.1.smithi184.stdout:6/98: symlink d0/d5/d14/l17 0 2023-12-16T03:15:49.240 INFO:tasks.workunit.client.1.smithi184.stdout:6/99: creat d0/f18 x:0 0 0 2023-12-16T03:15:49.241 INFO:tasks.workunit.client.1.smithi184.stdout:6/100: fdatasync d0/d5/d14/fa 0 2023-12-16T03:15:49.242 INFO:tasks.workunit.client.1.smithi184.stdout:6/101: symlink d0/d5/d14/l19 0 2023-12-16T03:15:49.242 INFO:tasks.workunit.client.1.smithi184.stdout:6/102: symlink d0/d5/d14/l1a 0 2023-12-16T03:15:49.242 INFO:tasks.workunit.client.1.smithi184.stdout:6/103: chown d0/d5/d14/l17 6250 1 2023-12-16T03:15:49.243 INFO:tasks.workunit.client.1.smithi184.stdout:6/104: write d0/d5/d14/fa [4574675,84502] 0 2023-12-16T03:15:49.243 INFO:tasks.workunit.client.1.smithi184.stdout:6/105: chown d0/c2 1488141 1 2023-12-16T03:15:49.371 INFO:tasks.workunit.client.1.smithi184.stdout:7/57: sync 2023-12-16T03:15:49.371 INFO:tasks.workunit.client.1.smithi184.stdout:9/134: sync 2023-12-16T03:15:49.372 INFO:tasks.workunit.client.1.smithi184.stdout:9/135: chown d0/c2d 156398 1 2023-12-16T03:15:49.372 INFO:tasks.workunit.client.1.smithi184.stdout:9/136: write d0/d13/d20/f22 [1328943,11245] 0 2023-12-16T03:15:49.372 INFO:tasks.workunit.client.1.smithi184.stdout:7/58: getdents d0/d3/d4 0 2023-12-16T03:15:49.373 INFO:tasks.workunit.client.1.smithi184.stdout:7/59: mkdir d0/d3/d12 0 2023-12-16T03:15:49.375 INFO:tasks.workunit.client.1.smithi184.stdout:7/60: mkdir d0/d13 0 2023-12-16T03:15:49.375 INFO:tasks.workunit.client.1.smithi184.stdout:7/61: dread - d0/d3/f11 zero size 2023-12-16T03:15:49.375 INFO:tasks.workunit.client.1.smithi184.stdout:7/62: chown d0/d13 327055284 1 2023-12-16T03:15:49.376 INFO:tasks.workunit.client.1.smithi184.stdout:7/63: write d0/d3/f7 [2833327,68170] 0 2023-12-16T03:15:49.402 INFO:tasks.workunit.client.1.smithi184.stdout:7/64: dwrite d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:49.403 INFO:tasks.workunit.client.1.smithi184.stdout:9/137: dwrite d0/d13/d20/f22 [0,4194304] 0 2023-12-16T03:15:49.403 INFO:tasks.workunit.client.1.smithi184.stdout:9/138: fdatasync d0/f14 0 2023-12-16T03:15:49.404 INFO:tasks.workunit.client.1.smithi184.stdout:7/65: mknod d0/df/dd/c14 0 2023-12-16T03:15:49.405 INFO:tasks.workunit.client.1.smithi184.stdout:9/139: truncate d0/d13/f21 2509828 0 2023-12-16T03:15:49.407 INFO:tasks.workunit.client.1.smithi184.stdout:7/66: unlink d0/df/dd/f10 0 2023-12-16T03:15:49.407 INFO:tasks.workunit.client.1.smithi184.stdout:7/67: symlink d0/d3/l15 0 2023-12-16T03:15:49.434 INFO:tasks.workunit.client.1.smithi184.stdout:9/140: dwrite d0/f1c [0,4194304] 0 2023-12-16T03:15:49.434 INFO:tasks.workunit.client.1.smithi184.stdout:9/141: stat d0/f1d 0 2023-12-16T03:15:49.434 INFO:tasks.workunit.client.1.smithi184.stdout:7/68: dwrite d0/d3/d4/fc [0,4194304] 0 2023-12-16T03:15:49.435 INFO:tasks.workunit.client.1.smithi184.stdout:9/142: creat d0/f2f x:0 0 0 2023-12-16T03:15:49.437 INFO:tasks.workunit.client.1.smithi184.stdout:9/143: mkdir d0/d30 0 2023-12-16T03:15:49.438 INFO:tasks.workunit.client.1.smithi184.stdout:9/144: truncate d0/d13/d20/f22 2722266 0 2023-12-16T03:15:49.438 INFO:tasks.workunit.client.1.smithi184.stdout:9/145: chown d0/c12 3 1 2023-12-16T03:15:49.438 INFO:tasks.workunit.client.1.smithi184.stdout:9/146: chown d0/lb 58146 1 2023-12-16T03:15:49.439 INFO:tasks.workunit.client.1.smithi184.stdout:9/147: unlink d0/c10 0 2023-12-16T03:15:49.444 INFO:tasks.workunit.client.1.smithi184.stdout:7/69: dread d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:49.457 INFO:tasks.workunit.client.1.smithi184.stdout:9/148: dwrite d0/d13/f21 [0,4194304] 0 2023-12-16T03:15:49.458 INFO:tasks.workunit.client.1.smithi184.stdout:9/149: mkdir d0/d30/d31 0 2023-12-16T03:15:49.459 INFO:tasks.workunit.client.1.smithi184.stdout:9/150: link d0/d13/d20/f29 d0/d13/d20/f32 0 2023-12-16T03:15:49.459 INFO:tasks.workunit.client.1.smithi184.stdout:9/151: readlink d0/l17 0 2023-12-16T03:15:49.460 INFO:tasks.workunit.client.1.smithi184.stdout:9/152: dread - d0/d13/f24 zero size 2023-12-16T03:15:49.461 INFO:tasks.workunit.client.1.smithi184.stdout:9/153: link d0/c12 d0/c33 0 2023-12-16T03:15:49.461 INFO:tasks.workunit.client.1.smithi184.stdout:9/154: chown d0/cc 50 1 2023-12-16T03:15:49.461 INFO:tasks.workunit.client.1.smithi184.stdout:9/155: truncate d0/d13/d20/f22 2224812 0 2023-12-16T03:15:49.468 INFO:tasks.workunit.client.1.smithi184.stdout:7/70: dwrite d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:49.469 INFO:tasks.workunit.client.1.smithi184.stdout:9/156: fsync d0/d13/d20/f29 0 2023-12-16T03:15:49.471 INFO:tasks.workunit.client.1.smithi184.stdout:9/157: link d0/d13/c1b d0/d13/c34 0 2023-12-16T03:15:49.472 INFO:tasks.workunit.client.1.smithi184.stdout:9/158: symlink d0/d13/l35 0 2023-12-16T03:15:49.475 INFO:tasks.workunit.client.1.smithi184.stdout:9/159: rename d0/fd to d0/f36 0 2023-12-16T03:15:49.476 INFO:tasks.workunit.client.1.smithi184.stdout:9/160: write d0/f14 [842015,118011] 0 2023-12-16T03:15:49.476 INFO:tasks.workunit.client.1.smithi184.stdout:9/161: readlink d0/lf 0 2023-12-16T03:15:49.476 INFO:tasks.workunit.client.1.smithi184.stdout:9/162: symlink d0/d13/d20/l37 0 2023-12-16T03:15:49.477 INFO:tasks.workunit.client.1.smithi184.stdout:9/163: mkdir d0/d13/d20/d38 0 2023-12-16T03:15:49.478 INFO:tasks.workunit.client.1.smithi184.stdout:9/164: fdatasync d0/f36 0 2023-12-16T03:15:49.483 INFO:tasks.workunit.client.1.smithi184.stdout:7/71: dwrite d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:49.483 INFO:tasks.workunit.client.1.smithi184.stdout:7/72: chown d0/c6 77726 1 2023-12-16T03:15:49.483 INFO:tasks.workunit.client.1.smithi184.stdout:7/73: write d0/d3/f5 [4282308,10990] 0 2023-12-16T03:15:49.483 INFO:tasks.workunit.client.1.smithi184.stdout:7/74: readlink d0/l2 0 2023-12-16T03:15:49.487 INFO:tasks.workunit.client.1.smithi184.stdout:7/75: rmdir d0/d3/d12 0 2023-12-16T03:15:49.490 INFO:tasks.workunit.client.1.smithi184.stdout:7/76: dread d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:49.499 INFO:tasks.workunit.client.1.smithi184.stdout:7/77: dread d0/d3/d4/fc [0,4194304] 0 2023-12-16T03:15:49.500 INFO:tasks.workunit.client.1.smithi184.stdout:7/78: link d0/l1 d0/df/l16 0 2023-12-16T03:15:49.501 INFO:tasks.workunit.client.1.smithi184.stdout:7/79: mknod d0/d3/c17 0 2023-12-16T03:15:49.516 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:49 smithi184 ceph-mon[121180]: Upgrade: Updating mgr.smithi184.urtxla 2023-12-16T03:15:49.516 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:49 smithi184 ceph-mon[121180]: Deploying daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:15:49.516 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:49 smithi184 ceph-mon[121180]: pgmap v189: 65 pgs: 65 active+clean; 253 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 7.3 MiB/s wr, 463 op/s 2023-12-16T03:15:49.529 INFO:tasks.workunit.client.1.smithi184.stdout:7/80: dwrite d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:49.530 INFO:tasks.workunit.client.1.smithi184.stdout:7/81: rmdir d0/d3/d4 39 2023-12-16T03:15:49.530 INFO:tasks.workunit.client.1.smithi184.stdout:7/82: rename d0/df/dd to d0/df/dd/d18 22 2023-12-16T03:15:49.530 INFO:tasks.workunit.client.1.smithi184.stdout:7/83: readlink d0/d3/l15 0 2023-12-16T03:15:49.531 INFO:tasks.workunit.client.1.smithi184.stdout:7/84: read d0/d3/d4/fc [306882,33636] 0 2023-12-16T03:15:49.531 INFO:tasks.workunit.client.1.smithi184.stdout:7/85: chown d0/d3/f7 69 1 2023-12-16T03:15:49.531 INFO:tasks.workunit.client.1.smithi184.stdout:7/86: write d0/d3/f11 [5087158,24335] 0 2023-12-16T03:15:49.531 INFO:tasks.workunit.client.1.smithi184.stdout:7/87: creat d0/df/f19 x:0 0 0 2023-12-16T03:15:49.537 INFO:tasks.workunit.client.1.smithi184.stdout:3/216: sync 2023-12-16T03:15:49.537 INFO:tasks.workunit.client.1.smithi184.stdout:3/217: mkdir d12/d18/d1f/d23/d2a/d42/d52 0 2023-12-16T03:15:49.554 INFO:tasks.workunit.client.1.smithi184.stdout:3/218: dwrite d12/d1e/f2d [0,4194304] 0 2023-12-16T03:15:49.554 INFO:tasks.workunit.client.1.smithi184.stdout:7/88: dwrite d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:49.563 INFO:tasks.workunit.client.1.smithi184.stdout:7/89: dread d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:49.564 INFO:tasks.workunit.client.1.smithi184.stdout:7/90: creat d0/d3/f1a x:0 0 0 2023-12-16T03:15:49.579 INFO:tasks.workunit.client.1.smithi184.stdout:7/91: dwrite d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:49.579 INFO:tasks.workunit.client.1.smithi184.stdout:7/92: truncate d0/d3/f5 4509266 0 2023-12-16T03:15:49.639 INFO:tasks.workunit.client.0.smithi064.stdout:8/10: creat d0/f2 x:0 0 0 2023-12-16T03:15:49.639 INFO:tasks.workunit.client.0.smithi064.stdout:8/11: truncate d0/f2 16991 0 2023-12-16T03:15:49.652 INFO:tasks.workunit.client.1.smithi184.stdout:0/184: sync 2023-12-16T03:15:49.653 INFO:tasks.workunit.client.1.smithi184.stdout:0/185: truncate dc/d10/f14 1373486 0 2023-12-16T03:15:49.653 INFO:tasks.workunit.client.1.smithi184.stdout:0/186: dread - dc/d10/d1c/f2f zero size 2023-12-16T03:15:49.653 INFO:tasks.workunit.client.1.smithi184.stdout:0/187: fsync dc/fe 0 2023-12-16T03:15:49.656 INFO:tasks.workunit.client.1.smithi184.stdout:0/188: dread dc/f19 [0,4194304] 0 2023-12-16T03:15:49.657 INFO:tasks.workunit.client.1.smithi184.stdout:0/189: truncate dc/f12 3613770 0 2023-12-16T03:15:49.659 INFO:tasks.workunit.client.1.smithi184.stdout:0/190: write dc/d10/d1c/f21 [3119319,13728] 0 2023-12-16T03:15:49.659 INFO:tasks.workunit.client.1.smithi184.stdout:0/191: chown dc/d22/d1d/d2c/l30 46 1 2023-12-16T03:15:49.664 INFO:tasks.workunit.client.1.smithi184.stdout:0/192: dread dc/f12 [0,4194304] 0 2023-12-16T03:15:49.665 INFO:tasks.workunit.client.1.smithi184.stdout:0/193: dread dc/d10/f25 [0,4194304] 0 2023-12-16T03:15:49.665 INFO:tasks.workunit.client.1.smithi184.stdout:0/194: fdatasync dc/d10/f11 0 2023-12-16T03:15:49.666 INFO:tasks.workunit.client.1.smithi184.stdout:0/195: mkdir dc/d22/d1d/d35/d3c 0 2023-12-16T03:15:49.667 INFO:tasks.workunit.client.1.smithi184.stdout:0/196: rmdir dc/d22/d1d/d35/d3c 0 2023-12-16T03:15:49.667 INFO:tasks.workunit.client.1.smithi184.stdout:0/197: read - dc/d22/f29 zero size 2023-12-16T03:15:49.668 INFO:tasks.workunit.client.1.smithi184.stdout:0/198: symlink dc/d22/l3d 0 2023-12-16T03:15:49.668 INFO:tasks.workunit.client.1.smithi184.stdout:0/199: write f4 [3896739,3659] 0 2023-12-16T03:15:49.691 INFO:tasks.workunit.client.1.smithi184.stdout:0/200: dwrite dc/d10/d1c/f2f [0,4194304] 0 2023-12-16T03:15:49.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:49 smithi064 ceph-mon[111958]: Upgrade: Updating mgr.smithi184.urtxla 2023-12-16T03:15:49.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:49 smithi064 ceph-mon[111958]: Deploying daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:15:49.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:49 smithi064 ceph-mon[111958]: pgmap v189: 65 pgs: 65 active+clean; 253 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 7.3 MiB/s wr, 463 op/s 2023-12-16T03:15:49.694 INFO:tasks.workunit.client.1.smithi184.stdout:0/201: creat dc/d22/d1a/f3e x:0 0 0 2023-12-16T03:15:49.697 INFO:tasks.workunit.client.1.smithi184.stdout:0/202: dread dc/d10/f11 [0,4194304] 0 2023-12-16T03:15:49.716 INFO:tasks.workunit.client.1.smithi184.stdout:0/203: dwrite dc/d10/f14 [0,4194304] 0 2023-12-16T03:15:49.716 INFO:tasks.workunit.client.1.smithi184.stdout:0/204: chown dc/d10/c24 2191 1 2023-12-16T03:15:49.716 INFO:tasks.workunit.client.1.smithi184.stdout:0/205: creat dc/d10/d1c/f3f x:0 0 0 2023-12-16T03:15:49.717 INFO:tasks.workunit.client.1.smithi184.stdout:0/206: creat dc/d22/d1d/f40 x:0 0 0 2023-12-16T03:15:49.729 INFO:tasks.workunit.client.1.smithi184.stdout:0/207: dread dc/d10/d1c/f2f [0,4194304] 0 2023-12-16T03:15:49.730 INFO:tasks.workunit.client.1.smithi184.stdout:0/208: creat dc/d10/d2d/f41 x:0 0 0 2023-12-16T03:15:49.730 INFO:tasks.workunit.client.1.smithi184.stdout:0/209: rmdir dc/d22/d1d/d35 39 2023-12-16T03:15:49.731 INFO:tasks.workunit.client.0.smithi064.stdout:9/6: mkdir d2 0 2023-12-16T03:15:49.731 INFO:tasks.workunit.client.1.smithi184.stdout:0/210: creat dc/f42 x:0 0 0 2023-12-16T03:15:49.732 INFO:tasks.workunit.client.1.smithi184.stdout:0/211: stat dc/d10/c24 0 2023-12-16T03:15:49.735 INFO:tasks.workunit.client.1.smithi184.stdout:0/212: rmdir dc/d22/d1d 39 2023-12-16T03:15:49.740 INFO:tasks.workunit.client.1.smithi184.stdout:0/213: truncate dc/d10/f14 3571536 0 2023-12-16T03:15:49.741 INFO:tasks.workunit.client.1.smithi184.stdout:0/214: stat dc/d2a/c32 0 2023-12-16T03:15:49.757 INFO:tasks.workunit.client.1.smithi184.stdout:0/215: dwrite dc/d22/d1a/f3e [0,4194304] 0 2023-12-16T03:15:49.760 INFO:tasks.workunit.client.1.smithi184.stdout:0/216: mkdir dc/d22/d1d/d43 0 2023-12-16T03:15:49.760 INFO:tasks.workunit.client.1.smithi184.stdout:0/217: chown dc/d10/c24 0 1 2023-12-16T03:15:49.765 INFO:tasks.workunit.client.1.smithi184.stdout:0/218: dread f4 [0,4194304] 0 2023-12-16T03:15:49.767 INFO:tasks.workunit.client.1.smithi184.stdout:0/219: getdents dc/d10/d2d 0 2023-12-16T03:15:49.769 INFO:tasks.workunit.client.1.smithi184.stdout:0/220: symlink dc/d22/d1d/l44 0 2023-12-16T03:15:49.770 INFO:tasks.workunit.client.1.smithi184.stdout:0/221: mkdir dc/d22/d45 0 2023-12-16T03:15:49.772 INFO:tasks.workunit.client.1.smithi184.stdout:0/222: mkdir dc/d22/d46 0 2023-12-16T03:15:49.788 INFO:tasks.workunit.client.1.smithi184.stdout:0/223: dwrite dc/d10/d1c/f3f [0,4194304] 0 2023-12-16T03:15:49.792 INFO:tasks.workunit.client.1.smithi184.stdout:0/224: rename dc/d22/d1d/d2c/c37 to dc/d22/d1d/c47 0 2023-12-16T03:15:49.794 INFO:tasks.workunit.client.1.smithi184.stdout:0/225: mkdir dc/d22/d48 0 2023-12-16T03:15:49.795 INFO:tasks.workunit.client.1.smithi184.stdout:0/226: rmdir dc/d22 39 2023-12-16T03:15:49.797 INFO:tasks.workunit.client.1.smithi184.stdout:0/227: link dc/d10/d2d/f41 dc/d10/d1c/f49 0 2023-12-16T03:15:49.800 INFO:tasks.workunit.client.1.smithi184.stdout:0/228: rename dc/d10/d1c/f3f to dc/d10/d2d/f4a 0 2023-12-16T03:15:49.804 INFO:tasks.workunit.client.1.smithi184.stdout:0/229: getdents dc/d22 0 2023-12-16T03:15:49.806 INFO:tasks.workunit.client.1.smithi184.stdout:0/230: rename dc/d22/c18 to dc/d2a/c4b 0 2023-12-16T03:15:49.807 INFO:tasks.workunit.client.1.smithi184.stdout:0/231: write dc/d10/d1c/f21 [1639605,66840] 0 2023-12-16T03:15:49.808 INFO:tasks.workunit.client.1.smithi184.stdout:0/232: stat dc/d22/d1d/d43 0 2023-12-16T03:15:49.808 INFO:tasks.workunit.client.1.smithi184.stdout:0/233: write f4 [2711616,24667] 0 2023-12-16T03:15:49.810 INFO:tasks.workunit.client.1.smithi184.stdout:0/234: symlink dc/d22/d46/l4c 0 2023-12-16T03:15:49.812 INFO:tasks.workunit.client.1.smithi184.stdout:0/235: mknod dc/d22/d45/c4d 0 2023-12-16T03:15:49.834 INFO:tasks.workunit.client.1.smithi184.stdout:8/121: sync 2023-12-16T03:15:49.835 INFO:tasks.workunit.client.1.smithi184.stdout:4/78: sync 2023-12-16T03:15:49.835 INFO:tasks.workunit.client.1.smithi184.stdout:5/18: sync 2023-12-16T03:15:49.835 INFO:tasks.workunit.client.1.smithi184.stdout:1/103: sync 2023-12-16T03:15:49.835 INFO:tasks.workunit.client.1.smithi184.stdout:4/79: dread - d1/d12/f17 zero size 2023-12-16T03:15:49.836 INFO:tasks.workunit.client.1.smithi184.stdout:1/104: symlink d3/l22 0 2023-12-16T03:15:49.836 INFO:tasks.workunit.client.1.smithi184.stdout:8/122: write d2/d4/d10/d11/f15 [3834596,20735] 0 2023-12-16T03:15:49.836 INFO:tasks.workunit.client.1.smithi184.stdout:8/123: dread - d2/d4/d10/d11/f29 zero size 2023-12-16T03:15:49.836 INFO:tasks.workunit.client.1.smithi184.stdout:8/124: stat d2/d12/d21 0 2023-12-16T03:15:49.836 INFO:tasks.workunit.client.1.smithi184.stdout:8/125: rename d2 to d2/d4/d2b 22 2023-12-16T03:15:49.836 INFO:tasks.workunit.client.1.smithi184.stdout:8/126: chown d2/d4/lb 8971585 1 2023-12-16T03:15:49.836 INFO:tasks.workunit.client.1.smithi184.stdout:8/127: write d2/f13 [4432348,73446] 0 2023-12-16T03:15:49.837 INFO:tasks.workunit.client.1.smithi184.stdout:4/80: link l0 d1/d12/l19 0 2023-12-16T03:15:49.837 INFO:tasks.workunit.client.1.smithi184.stdout:5/19: dread d1/f2 [0,4194304] 0 2023-12-16T03:15:49.837 INFO:tasks.workunit.client.1.smithi184.stdout:1/105: truncate d3/d6/f7 3611519 0 2023-12-16T03:15:49.838 INFO:tasks.workunit.client.1.smithi184.stdout:4/81: rename d1/d12/l16 to d1/l1a 0 2023-12-16T03:15:49.839 INFO:tasks.workunit.client.1.smithi184.stdout:5/20: symlink d1/d3/l5 0 2023-12-16T03:15:49.840 INFO:tasks.workunit.client.1.smithi184.stdout:1/106: mknod d3/d13/c23 0 2023-12-16T03:15:49.840 INFO:tasks.workunit.client.1.smithi184.stdout:4/82: dread d1/fd [0,4194304] 0 2023-12-16T03:15:49.840 INFO:tasks.workunit.client.1.smithi184.stdout:5/21: mknod d1/c6 0 2023-12-16T03:15:49.843 INFO:tasks.workunit.client.1.smithi184.stdout:4/83: mkdir d1/d11/d1b 0 2023-12-16T03:15:49.844 INFO:tasks.workunit.client.1.smithi184.stdout:4/84: symlink d1/d12/d13/l1c 0 2023-12-16T03:15:49.844 INFO:tasks.workunit.client.1.smithi184.stdout:4/85: stat d1/fe 0 2023-12-16T03:15:49.845 INFO:tasks.workunit.client.1.smithi184.stdout:8/128: dread d2/d4/d10/f14 [0,4194304] 0 2023-12-16T03:15:49.845 INFO:tasks.workunit.client.1.smithi184.stdout:4/86: creat d1/d11/f1d x:0 0 0 2023-12-16T03:15:49.846 INFO:tasks.workunit.client.1.smithi184.stdout:8/129: read d2/f28 [245244,31655] 0 2023-12-16T03:15:49.847 INFO:tasks.workunit.client.1.smithi184.stdout:8/130: write d2/fc [2832466,29864] 0 2023-12-16T03:15:49.848 INFO:tasks.workunit.client.1.smithi184.stdout:4/87: mkdir d1/d11/d1b/d1e 0 2023-12-16T03:15:49.855 INFO:tasks.workunit.client.1.smithi184.stdout:4/88: dread d1/f4 [0,4194304] 0 2023-12-16T03:15:49.855 INFO:tasks.workunit.client.1.smithi184.stdout:4/89: write d1/d11/f1d [186200,115346] 0 2023-12-16T03:15:49.862 INFO:tasks.workunit.client.1.smithi184.stdout:8/131: dread d2/d4/d10/d11/f15 [0,4194304] 0 2023-12-16T03:15:49.864 INFO:tasks.workunit.client.1.smithi184.stdout:1/107: dwrite d3/ff [4194304,4194304] 0 2023-12-16T03:15:49.867 INFO:tasks.workunit.client.1.smithi184.stdout:5/22: dwrite d1/f2 [0,4194304] 0 2023-12-16T03:15:49.869 INFO:tasks.workunit.client.1.smithi184.stdout:8/132: dread d2/fe [0,4194304] 0 2023-12-16T03:15:49.869 INFO:tasks.workunit.client.1.smithi184.stdout:8/133: write d2/f13 [5532711,59455] 0 2023-12-16T03:15:49.869 INFO:tasks.workunit.client.1.smithi184.stdout:1/108: dread d3/f20 [0,4194304] 0 2023-12-16T03:15:49.872 INFO:tasks.workunit.client.1.smithi184.stdout:1/109: mkdir d3/d6/d24 0 2023-12-16T03:15:49.873 INFO:tasks.workunit.client.1.smithi184.stdout:4/90: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:49.879 INFO:tasks.workunit.client.1.smithi184.stdout:1/110: unlink d3/d6/f7 0 2023-12-16T03:15:49.879 INFO:tasks.workunit.client.1.smithi184.stdout:1/111: write d3/f16 [341974,50058] 0 2023-12-16T03:15:49.879 INFO:tasks.workunit.client.1.smithi184.stdout:1/112: fsync d3/d6/fe 0 2023-12-16T03:15:49.879 INFO:tasks.workunit.client.1.smithi184.stdout:4/91: getdents d1/d12 0 2023-12-16T03:15:49.881 INFO:tasks.workunit.client.1.smithi184.stdout:1/113: creat d3/d6/f25 x:0 0 0 2023-12-16T03:15:49.896 INFO:tasks.workunit.client.1.smithi184.stdout:1/114: dwrite d3/f20 [0,4194304] 0 2023-12-16T03:15:49.899 INFO:tasks.workunit.client.1.smithi184.stdout:1/115: write f0 [332888,63483] 0 2023-12-16T03:15:49.900 INFO:tasks.workunit.client.1.smithi184.stdout:1/116: mknod d3/d6/d24/c26 0 2023-12-16T03:15:49.902 INFO:tasks.workunit.client.1.smithi184.stdout:1/117: write d3/f9 [356879,14650] 0 2023-12-16T03:15:49.903 INFO:tasks.workunit.client.1.smithi184.stdout:1/118: write d3/f9 [4137385,86383] 0 2023-12-16T03:15:49.933 INFO:tasks.workunit.client.1.smithi184.stdout:8/134: dwrite d2/f28 [0,4194304] 0 2023-12-16T03:15:49.940 INFO:tasks.workunit.client.1.smithi184.stdout:1/119: truncate d3/f20 3559853 0 2023-12-16T03:15:49.951 INFO:tasks.workunit.client.1.smithi184.stdout:8/135: dwrite d2/d4/d10/d11/f1d [0,4194304] 0 2023-12-16T03:15:49.951 INFO:tasks.workunit.client.1.smithi184.stdout:8/136: readlink d2/d4/d10/d11/l1c 0 2023-12-16T03:15:49.954 INFO:tasks.workunit.client.1.smithi184.stdout:8/137: truncate d2/d4/d10/f14 3154405 0 2023-12-16T03:15:49.955 INFO:tasks.workunit.client.1.smithi184.stdout:8/138: truncate d2/d4/d10/f17 449323 0 2023-12-16T03:15:49.958 INFO:tasks.workunit.client.1.smithi184.stdout:1/120: dwrite d3/d6/f25 [0,4194304] 0 2023-12-16T03:15:49.959 INFO:tasks.workunit.client.1.smithi184.stdout:8/139: dread d2/fe [0,4194304] 0 2023-12-16T03:15:49.962 INFO:tasks.workunit.client.1.smithi184.stdout:8/140: unlink d2/d4/lf 0 2023-12-16T03:15:49.962 INFO:tasks.workunit.client.1.smithi184.stdout:8/141: readlink d2/d4/l1f 0 2023-12-16T03:15:49.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/142: link d2/d4/c7 d2/c2c 0 2023-12-16T03:15:49.987 INFO:tasks.workunit.client.1.smithi184.stdout:8/143: dwrite d2/d4/d10/f14 [0,4194304] 0 2023-12-16T03:15:49.987 INFO:tasks.workunit.client.1.smithi184.stdout:1/121: dwrite d3/d6/fe [0,4194304] 0 2023-12-16T03:15:49.988 INFO:tasks.workunit.client.1.smithi184.stdout:8/144: mkdir d2/d12/d21/d2d 0 2023-12-16T03:15:49.989 INFO:tasks.workunit.client.1.smithi184.stdout:1/122: rename d3/d6/c1c to d3/d6/d24/c27 0 2023-12-16T03:15:49.989 INFO:tasks.workunit.client.1.smithi184.stdout:1/123: chown d3/c10 544 1 2023-12-16T03:15:49.991 INFO:tasks.workunit.client.1.smithi184.stdout:1/124: getdents d3 0 2023-12-16T03:15:49.992 INFO:tasks.workunit.client.1.smithi184.stdout:1/125: write d3/ff [5268350,102502] 0 2023-12-16T03:15:49.993 INFO:tasks.workunit.client.1.smithi184.stdout:1/126: mkdir d3/d28 0 2023-12-16T03:15:49.994 INFO:tasks.workunit.client.1.smithi184.stdout:1/127: stat d3/d6/lc 0 2023-12-16T03:15:49.994 INFO:tasks.workunit.client.1.smithi184.stdout:1/128: write d3/d6/fe [3513584,77412] 0 2023-12-16T03:15:50.003 INFO:tasks.workunit.client.1.smithi184.stdout:1/129: dread d3/d6/fe [0,4194304] 0 2023-12-16T03:15:50.004 INFO:tasks.workunit.client.1.smithi184.stdout:1/130: unlink d3/c1a 0 2023-12-16T03:15:50.005 INFO:tasks.workunit.client.1.smithi184.stdout:1/131: creat d3/d13/f29 x:0 0 0 2023-12-16T03:15:50.006 INFO:tasks.workunit.client.1.smithi184.stdout:1/132: unlink d3/c4 0 2023-12-16T03:15:50.006 INFO:tasks.workunit.client.1.smithi184.stdout:1/133: chown d3/d28 142681148 1 2023-12-16T03:15:50.007 INFO:tasks.workunit.client.1.smithi184.stdout:1/134: mknod d3/d6/c2a 0 2023-12-16T03:15:50.010 INFO:tasks.workunit.client.1.smithi184.stdout:1/135: fsync d3/d13/f29 0 2023-12-16T03:15:50.028 INFO:tasks.workunit.client.1.smithi184.stdout:1/136: dwrite d3/ff [4194304,4194304] 0 2023-12-16T03:15:50.028 INFO:tasks.workunit.client.1.smithi184.stdout:1/137: symlink d3/d28/l2b 0 2023-12-16T03:15:50.032 INFO:tasks.workunit.client.1.smithi184.stdout:1/138: truncate d3/ff 6165177 0 2023-12-16T03:15:50.032 INFO:tasks.workunit.client.1.smithi184.stdout:1/139: chown d3/d6/fe 1117 1 2023-12-16T03:15:50.033 INFO:tasks.workunit.client.1.smithi184.stdout:1/140: getdents d3 0 2023-12-16T03:15:50.034 INFO:tasks.workunit.client.1.smithi184.stdout:1/141: mkdir d3/d13/d2c 0 2023-12-16T03:15:50.035 INFO:tasks.workunit.client.1.smithi184.stdout:1/142: creat d3/d13/f2d x:0 0 0 2023-12-16T03:15:50.036 INFO:tasks.workunit.client.1.smithi184.stdout:1/143: mknod d3/d6/c2e 0 2023-12-16T03:15:50.037 INFO:tasks.workunit.client.1.smithi184.stdout:1/144: link d3/d6/c2e d3/d6/d24/c2f 0 2023-12-16T03:15:50.038 INFO:tasks.workunit.client.1.smithi184.stdout:1/145: symlink d3/d6/d24/l30 0 2023-12-16T03:15:50.040 INFO:tasks.workunit.client.1.smithi184.stdout:1/146: write d3/d6/f25 [967789,48600] 0 2023-12-16T03:15:50.054 INFO:tasks.workunit.client.1.smithi184.stdout:1/147: dwrite d3/f20 [0,4194304] 0 2023-12-16T03:15:50.055 INFO:tasks.workunit.client.1.smithi184.stdout:1/148: stat d3/d6/c2a 0 2023-12-16T03:15:50.078 INFO:tasks.workunit.client.1.smithi184.stdout:1/149: dwrite d3/ff [0,4194304] 0 2023-12-16T03:15:50.079 INFO:tasks.workunit.client.1.smithi184.stdout:1/150: mknod d3/d6/c31 0 2023-12-16T03:15:50.088 INFO:tasks.workunit.client.1.smithi184.stdout:1/151: dread f0 [0,4194304] 0 2023-12-16T03:15:50.088 INFO:tasks.workunit.client.1.smithi184.stdout:1/152: chown d3/d6/fe 9184 1 2023-12-16T03:15:50.088 INFO:tasks.workunit.client.1.smithi184.stdout:1/153: write d3/f16 [321400,43073] 0 2023-12-16T03:15:50.089 INFO:tasks.workunit.client.1.smithi184.stdout:1/154: symlink d3/d6/d24/l32 0 2023-12-16T03:15:50.089 INFO:tasks.workunit.client.1.smithi184.stdout:1/155: truncate d3/d13/f2d 161037 0 2023-12-16T03:15:50.097 INFO:tasks.workunit.client.1.smithi184.stdout:1/156: dread d3/ff [0,4194304] 0 2023-12-16T03:15:50.104 INFO:tasks.workunit.client.1.smithi184.stdout:1/157: dread d3/d13/f1f [0,4194304] 0 2023-12-16T03:15:50.109 INFO:tasks.workunit.client.1.smithi184.stdout:1/158: dread d3/ff [0,4194304] 0 2023-12-16T03:15:50.109 INFO:tasks.workunit.client.1.smithi184.stdout:1/159: fdatasync d3/d13/f2d 0 2023-12-16T03:15:50.110 INFO:tasks.workunit.client.1.smithi184.stdout:1/160: creat d3/d6/f33 x:0 0 0 2023-12-16T03:15:50.111 INFO:tasks.workunit.client.1.smithi184.stdout:1/161: mkdir d3/d34 0 2023-12-16T03:15:50.112 INFO:tasks.workunit.client.1.smithi184.stdout:1/162: creat d3/d6/f35 x:0 0 0 2023-12-16T03:15:50.115 INFO:tasks.workunit.client.1.smithi184.stdout:1/163: dread f0 [0,4194304] 0 2023-12-16T03:15:50.117 INFO:tasks.workunit.client.1.smithi184.stdout:1/164: mkdir d3/d28/d36 0 2023-12-16T03:15:50.117 INFO:tasks.workunit.client.1.smithi184.stdout:1/165: chown d3/d28 9 1 2023-12-16T03:15:50.123 INFO:tasks.workunit.client.1.smithi184.stdout:1/166: getdents d3/d28 0 2023-12-16T03:15:50.125 INFO:tasks.workunit.client.1.smithi184.stdout:1/167: link d3/f9 d3/d13/d2c/f37 0 2023-12-16T03:15:50.145 INFO:tasks.workunit.client.1.smithi184.stdout:1/168: dwrite d3/d6/f25 [0,4194304] 0 2023-12-16T03:15:50.146 INFO:tasks.workunit.client.1.smithi184.stdout:1/169: mkdir d3/d28/d38 0 2023-12-16T03:15:50.147 INFO:tasks.workunit.client.1.smithi184.stdout:1/170: write d3/d13/d2c/f37 [2860602,113755] 0 2023-12-16T03:15:50.148 INFO:tasks.workunit.client.1.smithi184.stdout:1/171: unlink d3/d13/f2d 0 2023-12-16T03:15:50.163 INFO:tasks.workunit.client.1.smithi184.stdout:1/172: dwrite f0 [0,4194304] 0 2023-12-16T03:15:50.163 INFO:tasks.workunit.client.1.smithi184.stdout:1/173: getdents d3/d28/d36 0 2023-12-16T03:15:50.164 INFO:tasks.workunit.client.1.smithi184.stdout:1/174: mkdir d3/d34/d39 0 2023-12-16T03:15:50.177 INFO:tasks.workunit.client.1.smithi184.stdout:1/175: dwrite d3/d6/f33 [0,4194304] 0 2023-12-16T03:15:50.179 INFO:tasks.workunit.client.1.smithi184.stdout:3/219: sync 2023-12-16T03:15:50.179 INFO:tasks.workunit.client.1.smithi184.stdout:6/106: sync 2023-12-16T03:15:50.179 INFO:tasks.workunit.client.1.smithi184.stdout:9/165: sync 2023-12-16T03:15:50.179 INFO:tasks.workunit.client.1.smithi184.stdout:2/44: sync 2023-12-16T03:15:50.179 INFO:tasks.workunit.client.1.smithi184.stdout:6/107: stat d0/d5/d12/f15 0 2023-12-16T03:15:50.179 INFO:tasks.workunit.client.1.smithi184.stdout:1/176: unlink d3/d6/c2a 0 2023-12-16T03:15:50.180 INFO:tasks.workunit.client.1.smithi184.stdout:1/177: stat d3/d13/d2c/f37 0 2023-12-16T03:15:50.180 INFO:tasks.workunit.client.1.smithi184.stdout:1/178: getdents d3/d34/d39 0 2023-12-16T03:15:50.180 INFO:tasks.workunit.client.1.smithi184.stdout:1/179: dread - d3/d6/f35 zero size 2023-12-16T03:15:50.180 INFO:tasks.workunit.client.1.smithi184.stdout:9/166: read d0/d13/f21 [3022232,15452] 0 2023-12-16T03:15:50.181 INFO:tasks.workunit.client.1.smithi184.stdout:3/220: creat d12/d18/d1f/d23/d2a/f53 x:0 0 0 2023-12-16T03:15:50.181 INFO:tasks.workunit.client.1.smithi184.stdout:3/221: write d12/d1e/f47 [654,103657] 0 2023-12-16T03:15:50.181 INFO:tasks.workunit.client.1.smithi184.stdout:3/222: dread - d12/d18/d1f/d23/d2a/f53 zero size 2023-12-16T03:15:50.181 INFO:tasks.workunit.client.1.smithi184.stdout:3/223: fdatasync d12/d1e/f2d 0 2023-12-16T03:15:50.184 INFO:tasks.workunit.client.1.smithi184.stdout:9/167: rename d0/c2 to d0/d30/d31/c39 0 2023-12-16T03:15:50.184 INFO:tasks.workunit.client.1.smithi184.stdout:1/180: creat d3/d6/f3a x:0 0 0 2023-12-16T03:15:50.194 INFO:tasks.workunit.client.1.smithi184.stdout:1/181: rename d3/c17 to d3/d28/c3b 0 2023-12-16T03:15:50.197 INFO:tasks.workunit.client.1.smithi184.stdout:9/168: mkdir d0/d3a 0 2023-12-16T03:15:50.198 INFO:tasks.workunit.client.1.smithi184.stdout:1/182: getdents d3/d6/d24 0 2023-12-16T03:15:50.208 INFO:tasks.workunit.client.1.smithi184.stdout:1/183: write d3/f20 [961706,53040] 0 2023-12-16T03:15:50.216 INFO:tasks.workunit.client.1.smithi184.stdout:3/224: dwrite d12/d37/f3f [0,4194304] 0 2023-12-16T03:15:50.217 INFO:tasks.workunit.client.1.smithi184.stdout:3/225: chown d12/f19 1890377 1 2023-12-16T03:15:50.217 INFO:tasks.workunit.client.1.smithi184.stdout:6/108: dwrite d0/d5/d14/f13 [0,4194304] 0 2023-12-16T03:15:50.217 INFO:tasks.workunit.client.1.smithi184.stdout:2/45: dwrite d3/fd [0,4194304] 0 2023-12-16T03:15:50.219 INFO:tasks.workunit.client.1.smithi184.stdout:3/226: symlink d12/d18/d1f/d3a/l54 0 2023-12-16T03:15:50.220 INFO:tasks.workunit.client.1.smithi184.stdout:2/46: write d3/d5/fb [3684979,128701] 0 2023-12-16T03:15:50.222 INFO:tasks.workunit.client.1.smithi184.stdout:6/109: dread d0/d5/d12/f16 [0,4194304] 0 2023-12-16T03:15:50.222 INFO:tasks.workunit.client.1.smithi184.stdout:9/169: dwrite d0/f2f [0,4194304] 0 2023-12-16T03:15:50.222 INFO:tasks.workunit.client.1.smithi184.stdout:9/170: fsync d0/f2f 0 2023-12-16T03:15:50.222 INFO:tasks.workunit.client.1.smithi184.stdout:9/171: read d0/d13/f2a [563203,7445] 0 2023-12-16T03:15:50.223 INFO:tasks.workunit.client.1.smithi184.stdout:9/172: readlink d0/d13/d20/l37 0 2023-12-16T03:15:50.223 INFO:tasks.workunit.client.1.smithi184.stdout:1/184: rename d3/d6 to d3/d28/d3c 0 2023-12-16T03:15:50.224 INFO:tasks.workunit.client.1.smithi184.stdout:6/110: write d0/d5/d14/fa [3405919,30895] 0 2023-12-16T03:15:50.230 INFO:tasks.workunit.client.1.smithi184.stdout:9/173: mknod d0/d30/d31/c3b 0 2023-12-16T03:15:50.231 INFO:tasks.workunit.client.1.smithi184.stdout:1/185: mknod d3/d28/d38/c3d 0 2023-12-16T03:15:50.233 INFO:tasks.workunit.client.1.smithi184.stdout:9/174: mknod d0/d3a/c3c 0 2023-12-16T03:15:50.234 INFO:tasks.workunit.client.1.smithi184.stdout:1/186: mknod d3/c3e 0 2023-12-16T03:15:50.234 INFO:tasks.workunit.client.1.smithi184.stdout:1/187: chown d3/f9 5 1 2023-12-16T03:15:50.236 INFO:tasks.workunit.client.1.smithi184.stdout:6/111: mkdir d0/d5/d12/d1b 0 2023-12-16T03:15:50.236 INFO:tasks.workunit.client.1.smithi184.stdout:3/227: dwrite d12/d18/d1f/f2e [0,4194304] 0 2023-12-16T03:15:50.238 INFO:tasks.workunit.client.1.smithi184.stdout:9/175: unlink d0/d13/f2e 0 2023-12-16T03:15:50.239 INFO:tasks.workunit.client.1.smithi184.stdout:1/188: mknod d3/d28/d3c/d24/c3f 0 2023-12-16T03:15:50.239 INFO:tasks.workunit.client.1.smithi184.stdout:1/189: write d3/d28/d3c/fe [4203147,29996] 0 2023-12-16T03:15:50.240 INFO:tasks.workunit.client.1.smithi184.stdout:6/112: creat d0/d5/d12/f1c x:0 0 0 2023-12-16T03:15:50.242 INFO:tasks.workunit.client.1.smithi184.stdout:3/228: getdents d12 0 2023-12-16T03:15:50.243 INFO:tasks.workunit.client.1.smithi184.stdout:1/190: mknod d3/d13/c40 0 2023-12-16T03:15:50.243 INFO:tasks.workunit.client.1.smithi184.stdout:1/191: read - d3/d13/f29 zero size 2023-12-16T03:15:50.243 INFO:tasks.workunit.client.1.smithi184.stdout:1/192: truncate d3/d28/d3c/f3a 674671 0 2023-12-16T03:15:50.244 INFO:tasks.workunit.client.1.smithi184.stdout:3/229: link fd d12/d18/d1f/d23/d2a/f55 0 2023-12-16T03:15:50.244 INFO:tasks.workunit.client.1.smithi184.stdout:3/230: fsync d12/f25 0 2023-12-16T03:15:50.251 INFO:tasks.workunit.client.1.smithi184.stdout:9/176: write d0/f1c [4087890,123032] 0 2023-12-16T03:15:50.253 INFO:tasks.workunit.client.1.smithi184.stdout:9/177: read d0/d13/d20/f28 [3854721,56097] 0 2023-12-16T03:15:50.253 INFO:tasks.workunit.client.1.smithi184.stdout:9/178: write d0/d13/d20/f32 [612923,78037] 0 2023-12-16T03:15:50.260 INFO:tasks.workunit.client.1.smithi184.stdout:9/179: write d0/f1f [951081,57067] 0 2023-12-16T03:15:50.262 INFO:tasks.workunit.client.1.smithi184.stdout:9/180: rename d0/c2c to d0/c3d 0 2023-12-16T03:15:50.271 INFO:tasks.workunit.client.1.smithi184.stdout:2/47: dwrite d3/fd [4194304,4194304] 0 2023-12-16T03:15:50.271 INFO:tasks.workunit.client.1.smithi184.stdout:2/48: chown d3/d5 1723 1 2023-12-16T03:15:50.271 INFO:tasks.workunit.client.1.smithi184.stdout:2/49: chown d3/f4 581248689 1 2023-12-16T03:15:50.272 INFO:tasks.workunit.client.1.smithi184.stdout:1/193: dwrite d3/f9 [4194304,4194304] 0 2023-12-16T03:15:50.272 INFO:tasks.workunit.client.1.smithi184.stdout:6/113: dwrite d0/d5/d12/f1c [0,4194304] 0 2023-12-16T03:15:50.273 INFO:tasks.workunit.client.1.smithi184.stdout:6/114: chown d0/d5/d12 218660 1 2023-12-16T03:15:50.273 INFO:tasks.workunit.client.1.smithi184.stdout:3/231: dwrite d12/d1e/f47 [0,4194304] 0 2023-12-16T03:15:50.273 INFO:tasks.workunit.client.1.smithi184.stdout:3/232: chown l7 3 1 2023-12-16T03:15:50.273 INFO:tasks.workunit.client.1.smithi184.stdout:2/50: mknod d3/d9/ce 0 2023-12-16T03:15:50.276 INFO:tasks.workunit.client.1.smithi184.stdout:6/115: write d0/d5/d14/fa [2879148,84446] 0 2023-12-16T03:15:50.276 INFO:tasks.workunit.client.1.smithi184.stdout:2/51: symlink d3/d5/lf 0 2023-12-16T03:15:50.278 INFO:tasks.workunit.client.1.smithi184.stdout:6/116: symlink d0/d5/d14/l1d 0 2023-12-16T03:15:50.283 INFO:tasks.workunit.client.1.smithi184.stdout:2/52: symlink d3/l10 0 2023-12-16T03:15:50.285 INFO:tasks.workunit.client.1.smithi184.stdout:1/194: dread d3/d28/d3c/f25 [0,4194304] 0 2023-12-16T03:15:50.286 INFO:tasks.workunit.client.1.smithi184.stdout:6/117: rename d0/l4 to d0/d5/d12/d1b/l1e 0 2023-12-16T03:15:50.287 INFO:tasks.workunit.client.1.smithi184.stdout:2/53: creat d3/d9/f11 x:0 0 0 2023-12-16T03:15:50.288 INFO:tasks.workunit.client.1.smithi184.stdout:1/195: mkdir d3/d28/d3c/d41 0 2023-12-16T03:15:50.288 INFO:tasks.workunit.client.1.smithi184.stdout:1/196: readlink d3/d28/d3c/d24/l32 0 2023-12-16T03:15:50.288 INFO:tasks.workunit.client.1.smithi184.stdout:1/197: readlink d3/d28/d3c/d24/l32 0 2023-12-16T03:15:50.289 INFO:tasks.workunit.client.1.smithi184.stdout:2/54: truncate d3/d5/fb 3119842 0 2023-12-16T03:15:50.290 INFO:tasks.workunit.client.1.smithi184.stdout:1/198: symlink d3/d28/l42 0 2023-12-16T03:15:50.290 INFO:tasks.workunit.client.1.smithi184.stdout:2/55: link d3/d9/f11 d3/d5/f12 0 2023-12-16T03:15:50.291 INFO:tasks.workunit.client.1.smithi184.stdout:1/199: write d3/d28/d3c/f33 [1005933,31044] 0 2023-12-16T03:15:50.301 INFO:tasks.workunit.client.1.smithi184.stdout:9/181: dwrite d0/d13/d20/f29 [0,4194304] 0 2023-12-16T03:15:50.301 INFO:tasks.workunit.client.1.smithi184.stdout:9/182: fsync d0/f36 0 2023-12-16T03:15:50.306 INFO:tasks.workunit.client.1.smithi184.stdout:3/233: dwrite d12/d18/d1f/d23/d2a/f38 [0,4194304] 0 2023-12-16T03:15:50.308 INFO:tasks.workunit.client.1.smithi184.stdout:2/56: getdents d3 0 2023-12-16T03:15:50.309 INFO:tasks.workunit.client.1.smithi184.stdout:6/118: dwrite d0/d5/d12/f16 [0,4194304] 0 2023-12-16T03:15:50.309 INFO:tasks.workunit.client.1.smithi184.stdout:6/119: fdatasync d0/d5/d12/f16 0 2023-12-16T03:15:50.309 INFO:tasks.workunit.client.1.smithi184.stdout:6/120: write d0/d5/d14/f13 [4707607,100833] 0 2023-12-16T03:15:50.309 INFO:tasks.workunit.client.1.smithi184.stdout:6/121: chown d0/d5/d14/fa 636761 1 2023-12-16T03:15:50.309 INFO:tasks.workunit.client.1.smithi184.stdout:2/57: truncate d3/d5/f7 387007 0 2023-12-16T03:15:50.314 INFO:tasks.workunit.client.1.smithi184.stdout:6/122: creat d0/d5/f1f x:0 0 0 2023-12-16T03:15:50.314 INFO:tasks.workunit.client.1.smithi184.stdout:6/123: truncate d0/f18 374569 0 2023-12-16T03:15:50.314 INFO:tasks.workunit.client.1.smithi184.stdout:6/124: chown d0/d5/d14/l1a 0 1 2023-12-16T03:15:50.315 INFO:tasks.workunit.client.1.smithi184.stdout:2/58: mkdir d3/d13 0 2023-12-16T03:15:50.315 INFO:tasks.workunit.client.1.smithi184.stdout:2/59: readlink d3/d5/lf 0 2023-12-16T03:15:50.317 INFO:tasks.workunit.client.1.smithi184.stdout:6/125: unlink d0/d5/d12/f15 0 2023-12-16T03:15:50.318 INFO:tasks.workunit.client.1.smithi184.stdout:2/60: unlink d3/d5/f8 0 2023-12-16T03:15:50.320 INFO:tasks.workunit.client.1.smithi184.stdout:6/126: unlink d0/d5/d14/f13 0 2023-12-16T03:15:50.321 INFO:tasks.workunit.client.1.smithi184.stdout:9/183: dwrite d0/f1d [0,4194304] 0 2023-12-16T03:15:50.321 INFO:tasks.workunit.client.1.smithi184.stdout:9/184: chown d0/fe 1373834 1 2023-12-16T03:15:50.322 INFO:tasks.workunit.client.1.smithi184.stdout:2/61: creat d3/f14 x:0 0 0 2023-12-16T03:15:50.322 INFO:tasks.workunit.client.1.smithi184.stdout:9/185: read d0/f14 [388833,20673] 0 2023-12-16T03:15:50.325 INFO:tasks.workunit.client.1.smithi184.stdout:3/234: dwrite d12/d18/d1f/d23/d2a/d42/f46 [0,4194304] 0 2023-12-16T03:15:50.325 INFO:tasks.workunit.client.1.smithi184.stdout:3/235: readlink d12/l33 0 2023-12-16T03:15:50.327 INFO:tasks.workunit.client.1.smithi184.stdout:2/62: write d3/d9/fc [1501979,68860] 0 2023-12-16T03:15:50.332 INFO:tasks.workunit.client.1.smithi184.stdout:2/63: symlink d3/d13/l15 0 2023-12-16T03:15:50.337 INFO:tasks.workunit.client.1.smithi184.stdout:2/64: mknod d3/d9/c16 0 2023-12-16T03:15:50.337 INFO:tasks.workunit.client.1.smithi184.stdout:2/65: dread - d3/d9/f11 zero size 2023-12-16T03:15:50.337 INFO:tasks.workunit.client.1.smithi184.stdout:9/186: truncate d0/d13/d20/f29 1960028 0 2023-12-16T03:15:50.337 INFO:tasks.workunit.client.1.smithi184.stdout:2/66: readlink d3/l10 0 2023-12-16T03:15:50.337 INFO:tasks.workunit.client.1.smithi184.stdout:2/67: dread - d3/f14 zero size 2023-12-16T03:15:50.337 INFO:tasks.workunit.client.1.smithi184.stdout:9/187: fdatasync d0/d13/f21 0 2023-12-16T03:15:50.338 INFO:tasks.workunit.client.1.smithi184.stdout:2/68: mknod d3/d9/c17 0 2023-12-16T03:15:50.338 INFO:tasks.workunit.client.1.smithi184.stdout:9/188: creat d0/f3e x:0 0 0 2023-12-16T03:15:50.339 INFO:tasks.workunit.client.1.smithi184.stdout:2/69: creat d3/d13/f18 x:0 0 0 2023-12-16T03:15:50.340 INFO:tasks.workunit.client.1.smithi184.stdout:2/70: truncate d3/f6 2636785 0 2023-12-16T03:15:50.343 INFO:tasks.workunit.client.1.smithi184.stdout:9/189: dread d0/d13/f2a [0,4194304] 0 2023-12-16T03:15:50.344 INFO:tasks.workunit.client.1.smithi184.stdout:9/190: unlink d0/d13/d20/l37 0 2023-12-16T03:15:50.346 INFO:tasks.workunit.client.1.smithi184.stdout:9/191: creat d0/d13/f3f x:0 0 0 2023-12-16T03:15:50.347 INFO:tasks.workunit.client.1.smithi184.stdout:9/192: mkdir d0/d13/d40 0 2023-12-16T03:15:50.349 INFO:tasks.workunit.client.1.smithi184.stdout:9/193: rename d0/d13/d20/f22 to d0/d30/f41 0 2023-12-16T03:15:50.357 INFO:tasks.workunit.client.1.smithi184.stdout:3/236: dwrite d12/d1e/f2d [0,4194304] 0 2023-12-16T03:15:50.357 INFO:tasks.workunit.client.1.smithi184.stdout:6/127: dwrite d0/d5/f1f [0,4194304] 0 2023-12-16T03:15:50.357 INFO:tasks.workunit.client.1.smithi184.stdout:2/71: dwrite d3/d5/f7 [0,4194304] 0 2023-12-16T03:15:50.359 INFO:tasks.workunit.client.1.smithi184.stdout:3/237: mknod d12/d18/d1f/d23/d2a/d4a/c56 0 2023-12-16T03:15:50.364 INFO:tasks.workunit.client.1.smithi184.stdout:2/72: mkdir d3/d9/d19 0 2023-12-16T03:15:50.366 INFO:tasks.workunit.client.1.smithi184.stdout:3/238: mknod d12/d18/d1f/d23/d2a/d42/c57 0 2023-12-16T03:15:50.366 INFO:tasks.workunit.client.1.smithi184.stdout:3/239: stat f4 0 2023-12-16T03:15:50.368 INFO:tasks.workunit.client.1.smithi184.stdout:3/240: read d12/d37/f3f [2133997,116686] 0 2023-12-16T03:15:50.368 INFO:tasks.workunit.client.1.smithi184.stdout:9/194: rmdir d0/d13 39 2023-12-16T03:15:50.369 INFO:tasks.workunit.client.1.smithi184.stdout:9/195: fsync d0/d13/f21 0 2023-12-16T03:15:50.375 INFO:tasks.workunit.client.1.smithi184.stdout:2/73: rmdir d3/d5 39 2023-12-16T03:15:50.376 INFO:tasks.workunit.client.1.smithi184.stdout:6/128: truncate d0/d5/f1f 452169 0 2023-12-16T03:15:50.378 INFO:tasks.workunit.client.1.smithi184.stdout:3/241: creat d12/d18/d1f/d23/d2a/d42/d52/f58 x:0 0 0 2023-12-16T03:15:50.379 INFO:tasks.workunit.client.1.smithi184.stdout:9/196: creat d0/d13/d40/f42 x:0 0 0 2023-12-16T03:15:50.381 INFO:tasks.workunit.client.1.smithi184.stdout:2/74: creat d3/d5/f1a x:0 0 0 2023-12-16T03:15:50.381 INFO:tasks.workunit.client.1.smithi184.stdout:2/75: write d3/d5/f12 [888935,105888] 0 2023-12-16T03:15:50.381 INFO:tasks.workunit.client.1.smithi184.stdout:9/197: write d0/d30/f41 [441848,73315] 0 2023-12-16T03:15:50.383 INFO:tasks.workunit.client.1.smithi184.stdout:3/242: getdents d12/d18/d1f/d23/d2a/d42 0 2023-12-16T03:15:50.383 INFO:tasks.workunit.client.1.smithi184.stdout:3/243: fdatasync d12/d18/d1f/d23/d2a/f53 0 2023-12-16T03:15:50.386 INFO:tasks.workunit.client.1.smithi184.stdout:3/244: unlink d12/d18/d1f/d23/d2a/d42/c57 0 2023-12-16T03:15:50.389 INFO:tasks.workunit.client.1.smithi184.stdout:3/245: mknod d12/d18/d1f/d23/d2a/d3e/d48/c59 0 2023-12-16T03:15:50.389 INFO:tasks.workunit.client.1.smithi184.stdout:3/246: dread - d12/d18/d1f/d23/d2a/f4e zero size 2023-12-16T03:15:50.390 INFO:tasks.workunit.client.1.smithi184.stdout:6/129: dread d0/d5/fc [0,4194304] 0 2023-12-16T03:15:50.393 INFO:tasks.workunit.client.1.smithi184.stdout:6/130: link d0/d5/d14/l17 d0/d5/d12/l20 0 2023-12-16T03:15:50.433 INFO:tasks.workunit.client.1.smithi184.stdout:2/76: dwrite d3/d5/f7 [4194304,4194304] 0 2023-12-16T03:15:50.477 INFO:tasks.workunit.client.1.smithi184.stdout:2/77: write d3/d5/f12 [1372412,57101] 0 2023-12-16T03:15:50.477 INFO:tasks.workunit.client.1.smithi184.stdout:3/247: dwrite d12/d18/f30 [0,4194304] 0 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:6/131: dwrite d0/d5/fc [4194304,4194304] 0 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:6/132: fsync d0/d5/d12/f16 0 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:9/198: dwrite d0/f1c [0,4194304] 0 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:2/78: link d3/f6 d3/d5/f1b 0 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:2/79: dread - d3/d13/f18 zero size 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:6/133: mknod d0/d5/d12/d1b/c21 0 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:6/134: write d0/d5/d14/fa [5566497,61190] 0 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:6/135: write d0/f18 [19416,61054] 0 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:3/248: creat d12/d18/d1f/d23/d51/f5a x:0 0 0 2023-12-16T03:15:50.482 INFO:tasks.workunit.client.1.smithi184.stdout:3/249: write d12/d18/f21 [1568834,47365] 0 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:9/199: mkdir d0/d13/d20/d38/d43 0 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:6/136: read d0/d5/d12/f1c [1900720,95837] 0 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:2/80: creat d3/d9/d19/f1c x:0 0 0 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:3/250: creat d12/d18/d1f/d23/d2a/d36/f5b x:0 0 0 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:3/251: write d12/d18/d1f/d23/d2a/f38 [89592,5441] 0 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:9/200: link d0/d13/d20/f29 d0/d30/f44 0 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:9/201: dread - d0/f3e zero size 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:9/202: write d0/fe [1428638,42862] 0 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:1/200: sync 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:4/92: sync 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:8/145: sync 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:0/236: sync 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:5/23: sync 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:6/137: rename d0/d5/d14 to d0/d5/d22 0 2023-12-16T03:15:50.483 INFO:tasks.workunit.client.1.smithi184.stdout:2/81: rename d3/d9/c17 to d3/d9/d19/c1d 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:9/203: mknod d0/d13/d20/c45 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:1/201: getdents d3/d13/d2c 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:7/93: sync 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:4/93: write d1/f8 [2646572,1928] 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:8/146: creat d2/d4/f2e x:0 0 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:1/202: dread d3/f16 [0,4194304] 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:6/138: unlink d0/d5/d22/l1a 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:6/139: stat d0/c2 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:6/140: stat d0/d5/d12 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:6/141: chown d0/d5/d12/d1b/c21 6726 1 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:2/82: unlink d3/d9/f11 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:9/204: link d0/lf d0/d3a/l46 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:0/237: symlink dc/d22/d48/l4e 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:7/94: creat d0/d13/f1b x:0 0 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:4/94: symlink d1/d11/d1b/d1e/l1f 0 2023-12-16T03:15:50.484 INFO:tasks.workunit.client.1.smithi184.stdout:8/147: getdents d2/d12 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:1/203: creat d3/d28/d3c/d24/f43 x:0 0 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:6/142: unlink d0/d5/d22/l17 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:2/83: getdents d3/d5 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:9/205: unlink d0/d13/d20/c2b 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:2/84: write d3/f6 [652694,119396] 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:4/95: unlink d1/d11/f1d 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:5/24: dwrite d1/f2 [0,4194304] 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:1/204: rename d3/f9 to d3/d28/f44 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:9/206: mkdir d0/d3a/d47 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:2/85: truncate d3/fd 170856 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:1/205: read d3/f20 [2323778,103484] 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:7/95: dwrite d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:4/96: unlink d1/fe 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:0/238: rename dc/d22/d45/c4d to dc/d22/d1a/c4f 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:3/252: dwrite d12/f1b [0,4194304] 0 2023-12-16T03:15:50.485 INFO:tasks.workunit.client.1.smithi184.stdout:6/143: mknod d0/d5/d12/c23 0 2023-12-16T03:15:50.486 INFO:tasks.workunit.client.1.smithi184.stdout:8/148: dread d2/f13 [0,4194304] 0 2023-12-16T03:15:50.486 INFO:tasks.workunit.client.1.smithi184.stdout:8/149: readlink d2/d4/l5 0 2023-12-16T03:15:50.486 INFO:tasks.workunit.client.1.smithi184.stdout:9/207: creat d0/d30/d31/f48 x:0 0 0 2023-12-16T03:15:50.486 INFO:tasks.workunit.client.1.smithi184.stdout:2/86: mkdir d3/d13/d1e 0 2023-12-16T03:15:50.486 INFO:tasks.workunit.client.1.smithi184.stdout:7/96: getdents d0/d3 0 2023-12-16T03:15:50.486 INFO:tasks.workunit.client.1.smithi184.stdout:7/97: dread - d0/d13/f1b zero size 2023-12-16T03:15:50.486 INFO:tasks.workunit.client.1.smithi184.stdout:7/98: write d0/d13/f1b [878756,61802] 0 2023-12-16T03:15:50.486 INFO:tasks.workunit.client.1.smithi184.stdout:4/97: creat d1/d11/d1b/d1e/f20 x:0 0 0 2023-12-16T03:15:50.487 INFO:tasks.workunit.client.1.smithi184.stdout:5/25: rename d1/d3/l5 to d1/l7 0 2023-12-16T03:15:50.488 INFO:tasks.workunit.client.1.smithi184.stdout:0/239: rmdir dc/d22/d46 39 2023-12-16T03:15:50.490 INFO:tasks.workunit.client.1.smithi184.stdout:6/144: creat d0/d5/f24 x:0 0 0 2023-12-16T03:15:50.492 INFO:tasks.workunit.client.1.smithi184.stdout:3/253: symlink d12/d18/d1f/d23/d2a/d36/l5c 0 2023-12-16T03:15:50.495 INFO:tasks.workunit.client.1.smithi184.stdout:8/150: truncate d2/f13 2941873 0 2023-12-16T03:15:50.495 INFO:tasks.workunit.client.1.smithi184.stdout:7/99: creat d0/d3/d4/f1c x:0 0 0 2023-12-16T03:15:50.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/98: link d1/l14 d1/d12/d13/l21 0 2023-12-16T03:15:50.500 INFO:tasks.workunit.client.1.smithi184.stdout:1/206: rename d3/d28/d38/c3d to d3/d34/c45 0 2023-12-16T03:15:50.503 INFO:tasks.workunit.client.1.smithi184.stdout:5/26: mkdir d1/d8 0 2023-12-16T03:15:50.503 INFO:tasks.workunit.client.1.smithi184.stdout:5/27: readlink d1/d3/l4 0 2023-12-16T03:15:50.505 INFO:tasks.workunit.client.1.smithi184.stdout:0/240: creat dc/d10/d2d/f50 x:0 0 0 2023-12-16T03:15:50.507 INFO:tasks.workunit.client.1.smithi184.stdout:0/241: write dc/f12 [1801767,93799] 0 2023-12-16T03:15:50.507 INFO:tasks.workunit.client.1.smithi184.stdout:0/242: write dc/d22/d1d/f40 [835932,52575] 0 2023-12-16T03:15:50.509 INFO:tasks.workunit.client.1.smithi184.stdout:8/151: link d2/l1a d2/d12/d21/l2f 0 2023-12-16T03:15:50.509 INFO:tasks.workunit.client.1.smithi184.stdout:8/152: getdents d2/d12/d21/d2d 0 2023-12-16T03:15:50.511 INFO:tasks.workunit.client.1.smithi184.stdout:1/207: mkdir d3/d28/d3c/d41/d46 0 2023-12-16T03:15:50.511 INFO:tasks.workunit.client.1.smithi184.stdout:4/99: creat d1/d12/d13/f22 x:0 0 0 2023-12-16T03:15:50.513 INFO:tasks.workunit.client.1.smithi184.stdout:1/208: creat d3/f47 x:0 0 0 2023-12-16T03:15:50.513 INFO:tasks.workunit.client.1.smithi184.stdout:1/209: stat d3/d28/d3c/c31 0 2023-12-16T03:15:50.517 INFO:tasks.workunit.client.1.smithi184.stdout:1/210: creat d3/d28/d36/f48 x:0 0 0 2023-12-16T03:15:50.517 INFO:tasks.workunit.client.1.smithi184.stdout:5/28: dread d1/f2 [0,4194304] 0 2023-12-16T03:15:50.517 INFO:tasks.workunit.client.1.smithi184.stdout:5/29: fsync d1/f2 0 2023-12-16T03:15:50.521 INFO:tasks.workunit.client.1.smithi184.stdout:0/243: dread dc/fe [0,4194304] 0 2023-12-16T03:15:50.522 INFO:tasks.workunit.client.1.smithi184.stdout:5/30: dread d1/f2 [0,4194304] 0 2023-12-16T03:15:50.522 INFO:tasks.workunit.client.1.smithi184.stdout:1/211: write d3/ff [2995640,24727] 0 2023-12-16T03:15:50.522 INFO:tasks.workunit.client.1.smithi184.stdout:5/31: readlink d1/l7 0 2023-12-16T03:15:50.523 INFO:tasks.workunit.client.1.smithi184.stdout:1/212: truncate d3/d28/d3c/f35 465414 0 2023-12-16T03:15:50.523 INFO:tasks.workunit.client.1.smithi184.stdout:1/213: write d3/f47 [1007562,124615] 0 2023-12-16T03:15:50.524 INFO:tasks.workunit.client.1.smithi184.stdout:9/208: dwrite d0/fe [0,4194304] 0 2023-12-16T03:15:50.525 INFO:tasks.workunit.client.1.smithi184.stdout:7/100: dwrite d0/df/f19 [0,4194304] 0 2023-12-16T03:15:50.525 INFO:tasks.workunit.client.1.smithi184.stdout:7/101: fdatasync d0/d3/f7 0 2023-12-16T03:15:50.527 INFO:tasks.workunit.client.1.smithi184.stdout:3/254: dwrite d12/f16 [0,4194304] 0 2023-12-16T03:15:50.529 INFO:tasks.workunit.client.1.smithi184.stdout:1/214: truncate d3/f20 2960286 0 2023-12-16T03:15:50.529 INFO:tasks.workunit.client.1.smithi184.stdout:1/215: chown d3/l22 97085 1 2023-12-16T03:15:50.530 INFO:tasks.workunit.client.1.smithi184.stdout:5/32: rename d1/d8 to d1/d3/d9 0 2023-12-16T03:15:50.530 INFO:tasks.workunit.client.1.smithi184.stdout:5/33: getdents d1/d3/d9 0 2023-12-16T03:15:50.531 INFO:tasks.workunit.client.1.smithi184.stdout:9/209: symlink d0/d13/l49 0 2023-12-16T03:15:50.531 INFO:tasks.workunit.client.1.smithi184.stdout:9/210: write d0/d13/f2a [1689996,94489] 0 2023-12-16T03:15:50.531 INFO:tasks.workunit.client.1.smithi184.stdout:6/145: dwrite d0/d5/d12/f16 [0,4194304] 0 2023-12-16T03:15:50.533 INFO:tasks.workunit.client.1.smithi184.stdout:3/255: creat d12/d18/d1f/f5d x:0 0 0 2023-12-16T03:15:50.533 INFO:tasks.workunit.client.1.smithi184.stdout:5/34: creat d1/d3/fa x:0 0 0 2023-12-16T03:15:50.534 INFO:tasks.workunit.client.1.smithi184.stdout:2/87: dread d3/d9/fc [0,4194304] 0 2023-12-16T03:15:50.535 INFO:tasks.workunit.client.1.smithi184.stdout:2/88: readlink d3/l10 0 2023-12-16T03:15:50.536 INFO:tasks.workunit.client.1.smithi184.stdout:7/102: rename d0/d3/d4/fc to d0/df/dd/f1d 0 2023-12-16T03:15:50.541 INFO:tasks.workunit.client.1.smithi184.stdout:9/211: unlink d0/c11 0 2023-12-16T03:15:50.541 INFO:tasks.workunit.client.1.smithi184.stdout:6/146: rmdir d0/d5/d22 39 2023-12-16T03:15:50.546 INFO:tasks.workunit.client.1.smithi184.stdout:5/35: symlink d1/lb 0 2023-12-16T03:15:50.548 INFO:tasks.workunit.client.1.smithi184.stdout:2/89: getdents d3/d9/d19 0 2023-12-16T03:15:50.551 INFO:tasks.workunit.client.1.smithi184.stdout:6/147: mkdir d0/d5/d22/d25 0 2023-12-16T03:15:50.552 INFO:tasks.workunit.client.1.smithi184.stdout:5/36: creat d1/d3/fc x:0 0 0 2023-12-16T03:15:50.554 INFO:tasks.workunit.client.1.smithi184.stdout:7/103: dread d0/df/f19 [0,4194304] 0 2023-12-16T03:15:50.555 INFO:tasks.workunit.client.1.smithi184.stdout:0/244: dwrite dc/f19 [0,4194304] 0 2023-12-16T03:15:50.555 INFO:tasks.workunit.client.1.smithi184.stdout:0/245: fdatasync dc/d22/d1d/d35/f38 0 2023-12-16T03:15:50.555 INFO:tasks.workunit.client.1.smithi184.stdout:0/246: chown dc/d2a/c4b 781628 1 2023-12-16T03:15:50.556 INFO:tasks.workunit.client.1.smithi184.stdout:6/148: truncate d0/d5/d12/f16 4767968 0 2023-12-16T03:15:50.557 INFO:tasks.workunit.client.1.smithi184.stdout:6/149: write d0/d5/d22/fa [1599745,47797] 0 2023-12-16T03:15:50.557 INFO:tasks.workunit.client.1.smithi184.stdout:6/150: readlink d0/l9 0 2023-12-16T03:15:50.560 INFO:tasks.workunit.client.1.smithi184.stdout:2/90: write d3/d5/fa [2219195,86452] 0 2023-12-16T03:15:50.560 INFO:tasks.workunit.client.1.smithi184.stdout:7/104: rename d0/d13 to d0/df/d1e 0 2023-12-16T03:15:50.561 INFO:tasks.workunit.client.1.smithi184.stdout:7/105: chown d0/d3/f1a 931143 1 2023-12-16T03:15:50.561 INFO:tasks.workunit.client.1.smithi184.stdout:7/106: fdatasync d0/d3/f7 0 2023-12-16T03:15:50.561 INFO:tasks.workunit.client.1.smithi184.stdout:0/247: symlink dc/l51 0 2023-12-16T03:15:50.562 INFO:tasks.workunit.client.1.smithi184.stdout:6/151: mkdir d0/d5/d26 0 2023-12-16T03:15:50.562 INFO:tasks.workunit.client.1.smithi184.stdout:2/91: mkdir d3/d13/d1e/d1f 0 2023-12-16T03:15:50.563 INFO:tasks.workunit.client.1.smithi184.stdout:0/248: mknod dc/d10/d2d/c52 0 2023-12-16T03:15:50.566 INFO:tasks.workunit.client.1.smithi184.stdout:4/100: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:50.566 INFO:tasks.workunit.client.1.smithi184.stdout:4/101: truncate d1/d12/d13/f22 11765 0 2023-12-16T03:15:50.567 INFO:tasks.workunit.client.1.smithi184.stdout:0/249: write dc/d10/f11 [416430,20814] 0 2023-12-16T03:15:50.567 INFO:tasks.workunit.client.1.smithi184.stdout:0/250: fdatasync dc/d10/d2d/f50 0 2023-12-16T03:15:50.567 INFO:tasks.workunit.client.1.smithi184.stdout:2/92: rename d3/d5/lf to d3/d13/d1e/d1f/l20 0 2023-12-16T03:15:50.567 INFO:tasks.workunit.client.1.smithi184.stdout:3/256: dwrite d12/d18/d1f/d23/d2a/f53 [0,4194304] 0 2023-12-16T03:15:50.568 INFO:tasks.workunit.client.1.smithi184.stdout:3/257: dread - d12/d18/d1f/f3d zero size 2023-12-16T03:15:50.570 INFO:tasks.workunit.client.1.smithi184.stdout:9/212: dwrite d0/d13/d20/f32 [0,4194304] 0 2023-12-16T03:15:50.571 INFO:tasks.workunit.client.1.smithi184.stdout:6/152: write d0/d5/d12/f1c [2962760,56908] 0 2023-12-16T03:15:50.572 INFO:tasks.workunit.client.1.smithi184.stdout:4/102: dread d1/fd [0,4194304] 0 2023-12-16T03:15:50.572 INFO:tasks.workunit.client.1.smithi184.stdout:4/103: chown d1/l2 125893780 1 2023-12-16T03:15:50.572 INFO:tasks.workunit.client.1.smithi184.stdout:1/216: dwrite d3/d28/d3c/f3a [0,4194304] 0 2023-12-16T03:15:50.572 INFO:tasks.workunit.client.1.smithi184.stdout:4/104: write d1/d12/d13/f22 [576697,3721] 0 2023-12-16T03:15:50.572 INFO:tasks.workunit.client.1.smithi184.stdout:1/217: read - d3/d13/f29 zero size 2023-12-16T03:15:50.576 INFO:tasks.workunit.client.1.smithi184.stdout:3/258: mknod d12/d18/d1f/d23/c5e 0 2023-12-16T03:15:50.576 INFO:tasks.workunit.client.1.smithi184.stdout:9/213: mknod d0/d30/c4a 0 2023-12-16T03:15:50.577 INFO:tasks.workunit.client.1.smithi184.stdout:2/93: mknod d3/d5/c21 0 2023-12-16T03:15:50.577 INFO:tasks.workunit.client.1.smithi184.stdout:0/251: mkdir dc/d22/d53 0 2023-12-16T03:15:50.581 INFO:tasks.workunit.client.1.smithi184.stdout:7/107: dwrite d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:50.581 INFO:tasks.workunit.client.1.smithi184.stdout:7/108: chown d0/d3/f5 2 1 2023-12-16T03:15:50.581 INFO:tasks.workunit.client.1.smithi184.stdout:4/105: getdents d1 0 2023-12-16T03:15:50.584 INFO:tasks.workunit.client.1.smithi184.stdout:1/218: unlink d3/f16 0 2023-12-16T03:15:50.584 INFO:tasks.workunit.client.1.smithi184.stdout:1/219: truncate d3/d28/f44 9048901 0 2023-12-16T03:15:50.585 INFO:tasks.workunit.client.1.smithi184.stdout:3/259: symlink d12/d18/d1f/d23/d51/l5f 0 2023-12-16T03:15:50.585 INFO:tasks.workunit.client.1.smithi184.stdout:3/260: chown d12/d18/d1f/d23/d2a/d4a/c56 1058 1 2023-12-16T03:15:50.585 INFO:tasks.workunit.client.1.smithi184.stdout:3/261: chown fd 9648638 1 2023-12-16T03:15:50.586 INFO:tasks.workunit.client.1.smithi184.stdout:9/214: link d0/d13/c1b d0/d3a/d47/c4b 0 2023-12-16T03:15:50.590 INFO:tasks.workunit.client.1.smithi184.stdout:6/153: creat d0/d5/d12/d1b/f27 x:0 0 0 2023-12-16T03:15:50.590 INFO:tasks.workunit.client.1.smithi184.stdout:7/109: creat d0/df/d1e/f1f x:0 0 0 2023-12-16T03:15:50.591 INFO:tasks.workunit.client.1.smithi184.stdout:7/110: stat d0/df/d1e 0 2023-12-16T03:15:50.591 INFO:tasks.workunit.client.1.smithi184.stdout:4/106: creat d1/d11/f23 x:0 0 0 2023-12-16T03:15:50.592 INFO:tasks.workunit.client.1.smithi184.stdout:1/220: link d3/d13/f29 d3/d13/d2c/f49 0 2023-12-16T03:15:50.593 INFO:tasks.workunit.client.1.smithi184.stdout:1/221: chown d3/d28/d3c/d41/d46 499727135 1 2023-12-16T03:15:50.593 INFO:tasks.workunit.client.1.smithi184.stdout:1/222: readlink d3/l1d 0 2023-12-16T03:15:50.594 INFO:tasks.workunit.client.1.smithi184.stdout:3/262: rename d12/d18/d1f/d23/d2a/d42/f45 to d12/d18/d1f/d3a/f60 0 2023-12-16T03:15:50.594 INFO:tasks.workunit.client.1.smithi184.stdout:3/263: chown d12/d1e/f47 15029901 1 2023-12-16T03:15:50.594 INFO:tasks.workunit.client.1.smithi184.stdout:3/264: readlink d12/d18/d1f/d23/d2a/d36/l5c 0 2023-12-16T03:15:50.595 INFO:tasks.workunit.client.1.smithi184.stdout:2/94: write d3/d5/f7 [4606558,76572] 0 2023-12-16T03:15:50.595 INFO:tasks.workunit.client.1.smithi184.stdout:5/37: getdents d1/d3 0 2023-12-16T03:15:50.603 INFO:tasks.workunit.client.1.smithi184.stdout:5/38: write d1/f2 [1777698,113200] 0 2023-12-16T03:15:50.606 INFO:tasks.workunit.client.1.smithi184.stdout:5/39: creat d1/d3/fd x:0 0 0 2023-12-16T03:15:50.606 INFO:tasks.workunit.client.1.smithi184.stdout:7/111: write d0/d3/f11 [310139,29691] 0 2023-12-16T03:15:50.609 INFO:tasks.workunit.client.1.smithi184.stdout:7/112: creat d0/df/d1e/f20 x:0 0 0 2023-12-16T03:15:50.613 INFO:tasks.workunit.client.1.smithi184.stdout:6/154: dread d0/d5/d22/fb [0,4194304] 0 2023-12-16T03:15:50.613 INFO:tasks.workunit.client.1.smithi184.stdout:6/155: dread - d0/d5/f24 zero size 2023-12-16T03:15:50.613 INFO:tasks.workunit.client.1.smithi184.stdout:6/156: rename d0 to d0/d5/d26/d28 22 2023-12-16T03:15:50.613 INFO:tasks.workunit.client.1.smithi184.stdout:2/95: write d3/d5/f1b [2296942,58250] 0 2023-12-16T03:15:50.613 INFO:tasks.workunit.client.1.smithi184.stdout:2/96: write d3/d5/f1b [3185373,274] 0 2023-12-16T03:15:50.613 INFO:tasks.workunit.client.1.smithi184.stdout:0/252: dwrite dc/f42 [0,4194304] 0 2023-12-16T03:15:50.615 INFO:tasks.workunit.client.1.smithi184.stdout:9/215: dwrite d0/d13/f24 [0,4194304] 0 2023-12-16T03:15:50.616 INFO:tasks.workunit.client.1.smithi184.stdout:6/157: creat d0/d5/d22/f29 x:0 0 0 2023-12-16T03:15:50.616 INFO:tasks.workunit.client.1.smithi184.stdout:6/158: dread - d0/d5/f24 zero size 2023-12-16T03:15:50.616 INFO:tasks.workunit.client.1.smithi184.stdout:6/159: write d0/d5/d12/d1b/f27 [899619,20609] 0 2023-12-16T03:15:50.617 INFO:tasks.workunit.client.1.smithi184.stdout:2/97: getdents d3/d5 0 2023-12-16T03:15:50.617 INFO:tasks.workunit.client.1.smithi184.stdout:2/98: chown d3/d13 44243868 1 2023-12-16T03:15:50.617 INFO:tasks.workunit.client.1.smithi184.stdout:2/99: fdatasync d3/fd 0 2023-12-16T03:15:50.617 INFO:tasks.workunit.client.1.smithi184.stdout:2/100: dread - d3/d5/f1a zero size 2023-12-16T03:15:50.617 INFO:tasks.workunit.client.1.smithi184.stdout:2/101: readlink d3/d13/d1e/d1f/l20 0 2023-12-16T03:15:50.618 INFO:tasks.workunit.client.1.smithi184.stdout:0/253: mknod dc/d22/d1a/c54 0 2023-12-16T03:15:50.621 INFO:tasks.workunit.client.1.smithi184.stdout:6/160: mknod d0/d5/d26/c2a 0 2023-12-16T03:15:50.622 INFO:tasks.workunit.client.1.smithi184.stdout:6/161: fsync d0/d5/d12/f1c 0 2023-12-16T03:15:50.622 INFO:tasks.workunit.client.1.smithi184.stdout:6/162: chown d0/d5/l10 1089021 1 2023-12-16T03:15:50.623 INFO:tasks.workunit.client.1.smithi184.stdout:2/102: rmdir d3/d5 39 2023-12-16T03:15:50.628 INFO:tasks.workunit.client.1.smithi184.stdout:2/103: creat d3/d13/d1e/f22 x:0 0 0 2023-12-16T03:15:50.628 INFO:tasks.workunit.client.1.smithi184.stdout:9/216: dread d0/d13/d20/f32 [0,4194304] 0 2023-12-16T03:15:50.629 INFO:tasks.workunit.client.1.smithi184.stdout:3/265: dwrite f2 [0,4194304] 0 2023-12-16T03:15:50.629 INFO:tasks.workunit.client.1.smithi184.stdout:4/107: dwrite d1/fd [0,4194304] 0 2023-12-16T03:15:50.630 INFO:tasks.workunit.client.1.smithi184.stdout:2/104: symlink d3/d13/l23 0 2023-12-16T03:15:50.631 INFO:tasks.workunit.client.1.smithi184.stdout:0/254: dread dc/d10/d1c/f21 [0,4194304] 0 2023-12-16T03:15:50.631 INFO:tasks.workunit.client.1.smithi184.stdout:1/223: dwrite d3/f20 [0,4194304] 0 2023-12-16T03:15:50.631 INFO:tasks.workunit.client.1.smithi184.stdout:0/255: fdatasync dc/d10/d1c/f21 0 2023-12-16T03:15:50.631 INFO:tasks.workunit.client.1.smithi184.stdout:0/256: write dc/d10/f25 [1930798,82278] 0 2023-12-16T03:15:50.631 INFO:tasks.workunit.client.1.smithi184.stdout:0/257: write dc/d10/d1c/f21 [4579535,96812] 0 2023-12-16T03:15:50.631 INFO:tasks.workunit.client.1.smithi184.stdout:0/258: chown dc/d10 889 1 2023-12-16T03:15:50.632 INFO:tasks.workunit.client.1.smithi184.stdout:6/163: dread d0/d5/d12/d1b/f27 [0,4194304] 0 2023-12-16T03:15:50.632 INFO:tasks.workunit.client.1.smithi184.stdout:6/164: truncate d0/d5/d22/f29 193254 0 2023-12-16T03:15:50.632 INFO:tasks.workunit.client.1.smithi184.stdout:7/113: getdents d0/df/d1e 0 2023-12-16T03:15:50.639 INFO:tasks.workunit.client.1.smithi184.stdout:9/217: symlink d0/d13/d40/l4c 0 2023-12-16T03:15:50.639 INFO:tasks.workunit.client.1.smithi184.stdout:3/266: mkdir d12/d18/d1f/d23/d2a/d4a/d61 0 2023-12-16T03:15:50.640 INFO:tasks.workunit.client.1.smithi184.stdout:2/105: mknod d3/d9/d19/c24 0 2023-12-16T03:15:50.641 INFO:tasks.workunit.client.1.smithi184.stdout:1/224: mkdir d3/d28/d3c/d41/d46/d4a 0 2023-12-16T03:15:50.643 INFO:tasks.workunit.client.1.smithi184.stdout:0/259: getdents dc/d10/d2d 0 2023-12-16T03:15:50.644 INFO:tasks.workunit.client.1.smithi184.stdout:7/114: mknod d0/d3/c21 0 2023-12-16T03:15:50.645 INFO:tasks.workunit.client.1.smithi184.stdout:3/267: creat d12/d18/d1f/d23/d2a/d3e/f62 x:0 0 0 2023-12-16T03:15:50.647 INFO:tasks.workunit.client.1.smithi184.stdout:1/225: creat d3/d28/d3c/d41/f4b x:0 0 0 2023-12-16T03:15:50.647 INFO:tasks.workunit.client.1.smithi184.stdout:1/226: read - d3/d28/d3c/d24/f43 zero size 2023-12-16T03:15:50.648 INFO:tasks.workunit.client.1.smithi184.stdout:0/260: creat dc/d22/d1d/d43/f55 x:0 0 0 2023-12-16T03:15:50.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/218: dread d0/f1f [0,4194304] 0 2023-12-16T03:15:50.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/219: stat d0/d30/f44 0 2023-12-16T03:15:50.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/220: stat d0/d30/d31/f48 0 2023-12-16T03:15:50.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/221: stat d0/d13/d20/c45 0 2023-12-16T03:15:50.650 INFO:tasks.workunit.client.1.smithi184.stdout:7/115: mknod d0/d3/d4/c22 0 2023-12-16T03:15:50.650 INFO:tasks.workunit.client.1.smithi184.stdout:3/268: mknod d12/d18/d1f/d23/d2a/d4a/d61/c63 0 2023-12-16T03:15:50.650 INFO:tasks.workunit.client.1.smithi184.stdout:1/227: link d3/d28/d3c/f35 d3/d13/d2c/f4c 0 2023-12-16T03:15:50.650 INFO:tasks.workunit.client.1.smithi184.stdout:1/228: chown d3/d28/l2b 12078 1 2023-12-16T03:15:50.652 INFO:tasks.workunit.client.1.smithi184.stdout:1/229: dread d3/d13/d2c/f4c [0,4194304] 0 2023-12-16T03:15:50.655 INFO:tasks.workunit.client.1.smithi184.stdout:4/108: dwrite d1/d11/d1b/d1e/f20 [0,4194304] 0 2023-12-16T03:15:50.655 INFO:tasks.workunit.client.1.smithi184.stdout:3/269: write f2 [136525,56900] 0 2023-12-16T03:15:50.659 INFO:tasks.workunit.client.1.smithi184.stdout:3/270: creat d12/d18/d1f/d3a/f64 x:0 0 0 2023-12-16T03:15:50.659 INFO:tasks.workunit.client.1.smithi184.stdout:3/271: readlink d12/d18/d1f/d23/l27 0 2023-12-16T03:15:50.659 INFO:tasks.workunit.client.1.smithi184.stdout:1/230: write d3/d28/f44 [7374265,38019] 0 2023-12-16T03:15:50.659 INFO:tasks.workunit.client.1.smithi184.stdout:1/231: creat d3/d28/d3c/d41/f4d x:0 0 0 2023-12-16T03:15:50.661 INFO:tasks.workunit.client.1.smithi184.stdout:1/232: creat d3/d34/f4e x:0 0 0 2023-12-16T03:15:50.663 INFO:tasks.workunit.client.1.smithi184.stdout:4/109: dread d1/d11/d1b/d1e/f20 [0,4194304] 0 2023-12-16T03:15:50.663 INFO:tasks.workunit.client.1.smithi184.stdout:1/233: link d3/d13/d2c/f4c d3/d28/d3c/f4f 0 2023-12-16T03:15:50.664 INFO:tasks.workunit.client.1.smithi184.stdout:4/110: truncate d1/f8 3175494 0 2023-12-16T03:15:50.665 INFO:tasks.workunit.client.1.smithi184.stdout:4/111: creat d1/d11/d1b/d1e/f24 x:0 0 0 2023-12-16T03:15:50.667 INFO:tasks.workunit.client.1.smithi184.stdout:4/112: getdents d1/d12/d13 0 2023-12-16T03:15:50.668 INFO:tasks.workunit.client.1.smithi184.stdout:3/272: dread d12/d18/d1f/d23/d2a/f38 [0,4194304] 0 2023-12-16T03:15:50.668 INFO:tasks.workunit.client.1.smithi184.stdout:3/273: write d12/d37/f3f [4219514,4559] 0 2023-12-16T03:15:50.668 INFO:tasks.workunit.client.1.smithi184.stdout:3/274: chown d12/d18/d1f/d23/d2a/d3e/f62 1 1 2023-12-16T03:15:50.669 INFO:tasks.workunit.client.1.smithi184.stdout:3/275: mknod d12/c65 0 2023-12-16T03:15:50.678 INFO:tasks.workunit.client.1.smithi184.stdout:1/234: dread d3/d28/d3c/f33 [0,4194304] 0 2023-12-16T03:15:50.680 INFO:tasks.workunit.client.1.smithi184.stdout:1/235: creat d3/d28/d3c/d41/d46/d4a/f50 x:0 0 0 2023-12-16T03:15:50.685 INFO:tasks.workunit.client.1.smithi184.stdout:1/236: rename d3/l1b to d3/d28/l51 0 2023-12-16T03:15:50.686 INFO:tasks.workunit.client.1.smithi184.stdout:6/165: dwrite d0/d5/d12/d1b/f27 [0,4194304] 0 2023-12-16T03:15:50.687 INFO:tasks.workunit.client.1.smithi184.stdout:6/166: read d0/f18 [373777,83353] 0 2023-12-16T03:15:50.688 INFO:tasks.workunit.client.1.smithi184.stdout:6/167: fdatasync d0/d5/d22/f29 0 2023-12-16T03:15:50.695 INFO:tasks.workunit.client.1.smithi184.stdout:4/113: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:50.695 INFO:tasks.workunit.client.1.smithi184.stdout:4/114: chown d1/fd 3654758 1 2023-12-16T03:15:50.696 INFO:tasks.workunit.client.1.smithi184.stdout:4/115: mknod d1/c25 0 2023-12-16T03:15:50.697 INFO:tasks.workunit.client.1.smithi184.stdout:4/116: truncate d1/d11/d1b/d1e/f24 852450 0 2023-12-16T03:15:50.697 INFO:tasks.workunit.client.1.smithi184.stdout:4/117: write d1/d11/d1b/d1e/f24 [1345476,783] 0 2023-12-16T03:15:50.697 INFO:tasks.workunit.client.1.smithi184.stdout:0/261: dwrite dc/f19 [0,4194304] 0 2023-12-16T03:15:50.698 INFO:tasks.workunit.client.1.smithi184.stdout:1/237: fsync d3/d13/d2c/f37 0 2023-12-16T03:15:50.701 INFO:tasks.workunit.client.1.smithi184.stdout:1/238: mkdir d3/d28/d38/d52 0 2023-12-16T03:15:50.701 INFO:tasks.workunit.client.1.smithi184.stdout:1/239: rmdir d3/d28 39 2023-12-16T03:15:50.702 INFO:tasks.workunit.client.1.smithi184.stdout:1/240: chown d3/d13 27 1 2023-12-16T03:15:50.702 INFO:tasks.workunit.client.1.smithi184.stdout:4/118: dread d1/d11/d1b/d1e/f20 [0,4194304] 0 2023-12-16T03:15:50.702 INFO:tasks.workunit.client.1.smithi184.stdout:4/119: rename d1 to d1/d12/d13/d26 22 2023-12-16T03:15:50.703 INFO:tasks.workunit.client.1.smithi184.stdout:1/241: mknod d3/d13/d2c/c53 0 2023-12-16T03:15:50.703 INFO:tasks.workunit.client.1.smithi184.stdout:1/242: write d3/d28/d36/f48 [604371,113175] 0 2023-12-16T03:15:50.703 INFO:tasks.workunit.client.1.smithi184.stdout:1/243: readlink d3/d28/d3c/d24/l30 0 2023-12-16T03:15:50.703 INFO:tasks.workunit.client.1.smithi184.stdout:4/120: mkdir d1/d12/d27 0 2023-12-16T03:15:50.705 INFO:tasks.workunit.client.1.smithi184.stdout:4/121: link d1/d12/f17 d1/f28 0 2023-12-16T03:15:50.714 INFO:tasks.workunit.client.1.smithi184.stdout:0/262: dread dc/f19 [0,4194304] 0 2023-12-16T03:15:50.715 INFO:tasks.workunit.client.1.smithi184.stdout:0/263: write dc/d22/f29 [20131,118929] 0 2023-12-16T03:15:50.716 INFO:tasks.workunit.client.1.smithi184.stdout:0/264: mknod dc/d10/d1c/c56 0 2023-12-16T03:15:50.719 INFO:tasks.workunit.client.1.smithi184.stdout:7/116: dwrite d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:50.720 INFO:tasks.workunit.client.1.smithi184.stdout:3/276: dwrite d12/f1b [0,4194304] 0 2023-12-16T03:15:50.720 INFO:tasks.workunit.client.1.smithi184.stdout:7/117: chown d0/d3/l15 829232200 1 2023-12-16T03:15:50.720 INFO:tasks.workunit.client.1.smithi184.stdout:7/118: truncate d0/d3/d4/f1c 759923 0 2023-12-16T03:15:50.722 INFO:tasks.workunit.client.1.smithi184.stdout:3/277: rename d12/d18/d1f/d23/c31 to d12/d18/d1f/d23/d51/c66 0 2023-12-16T03:15:50.723 INFO:tasks.workunit.client.1.smithi184.stdout:3/278: chown d12/d18/d1f/f44 0 1 2023-12-16T03:15:50.725 INFO:tasks.workunit.client.1.smithi184.stdout:3/279: creat d12/d37/f67 x:0 0 0 2023-12-16T03:15:50.730 INFO:tasks.workunit.client.1.smithi184.stdout:9/222: dwrite d0/d30/f44 [0,4194304] 0 2023-12-16T03:15:50.737 INFO:tasks.workunit.client.1.smithi184.stdout:3/280: dread d12/f1b [0,4194304] 0 2023-12-16T03:15:50.738 INFO:tasks.workunit.client.1.smithi184.stdout:3/281: mkdir d12/d18/d68 0 2023-12-16T03:15:50.739 INFO:tasks.workunit.client.1.smithi184.stdout:6/168: dwrite d0/d5/d12/d1b/f27 [0,4194304] 0 2023-12-16T03:15:50.741 INFO:tasks.workunit.client.1.smithi184.stdout:3/282: rename d12/d18/d1f/d23/d2a/d3e/f62 to d12/d18/d68/f69 0 2023-12-16T03:15:50.743 INFO:tasks.workunit.client.1.smithi184.stdout:6/169: rename d0/d5/fc to d0/d5/d22/d25/f2b 0 2023-12-16T03:15:50.743 INFO:tasks.workunit.client.1.smithi184.stdout:6/170: creat d0/d5/f2c x:0 0 0 2023-12-16T03:15:50.744 INFO:tasks.workunit.client.1.smithi184.stdout:3/283: write f2 [1491937,97067] 0 2023-12-16T03:15:50.745 INFO:tasks.workunit.client.1.smithi184.stdout:6/171: symlink d0/d5/l2d 0 2023-12-16T03:15:50.746 INFO:tasks.workunit.client.1.smithi184.stdout:6/172: symlink d0/d5/d22/d25/l2e 0 2023-12-16T03:15:50.747 INFO:tasks.workunit.client.1.smithi184.stdout:6/173: creat d0/d5/d12/d1b/f2f x:0 0 0 2023-12-16T03:15:50.747 INFO:tasks.workunit.client.1.smithi184.stdout:6/174: fdatasync d0/d5/f2c 0 2023-12-16T03:15:50.748 INFO:tasks.workunit.client.1.smithi184.stdout:6/175: fsync d0/d5/d12/d1b/f27 0 2023-12-16T03:15:50.748 INFO:tasks.workunit.client.1.smithi184.stdout:6/176: fsync d0/d5/d12/f16 0 2023-12-16T03:15:50.755 INFO:tasks.workunit.client.1.smithi184.stdout:0/265: dwrite dc/d22/d1d/f40 [0,4194304] 0 2023-12-16T03:15:50.757 INFO:tasks.workunit.client.1.smithi184.stdout:4/122: dwrite d1/d12/f17 [0,4194304] 0 2023-12-16T03:15:50.757 INFO:tasks.workunit.client.1.smithi184.stdout:1/244: dwrite d3/ff [0,4194304] 0 2023-12-16T03:15:50.757 INFO:tasks.workunit.client.1.smithi184.stdout:3/284: dread d12/d18/d1f/f44 [0,4194304] 0 2023-12-16T03:15:50.757 INFO:tasks.workunit.client.1.smithi184.stdout:7/119: dwrite d0/d3/f11 [4194304,4194304] 0 2023-12-16T03:15:50.760 INFO:tasks.workunit.client.1.smithi184.stdout:0/266: write dc/f42 [2978547,112870] 0 2023-12-16T03:15:50.760 INFO:tasks.workunit.client.1.smithi184.stdout:9/223: dwrite d0/d30/d31/f48 [0,4194304] 0 2023-12-16T03:15:50.761 INFO:tasks.workunit.client.1.smithi184.stdout:1/245: symlink d3/d28/l54 0 2023-12-16T03:15:50.761 INFO:tasks.workunit.client.1.smithi184.stdout:6/177: dread d0/d5/d12/d1b/f27 [0,4194304] 0 2023-12-16T03:15:50.762 INFO:tasks.workunit.client.1.smithi184.stdout:6/178: write d0/d5/d12/d1b/f27 [1474699,19875] 0 2023-12-16T03:15:50.763 INFO:tasks.workunit.client.1.smithi184.stdout:7/120: getdents d0/df 0 2023-12-16T03:15:50.763 INFO:tasks.workunit.client.1.smithi184.stdout:7/121: truncate d0/d3/f1a 634482 0 2023-12-16T03:15:50.766 INFO:tasks.workunit.client.1.smithi184.stdout:9/224: dread d0/f1f [0,4194304] 0 2023-12-16T03:15:50.766 INFO:tasks.workunit.client.1.smithi184.stdout:9/225: readlink d0/d13/d40/l4c 0 2023-12-16T03:15:50.766 INFO:tasks.workunit.client.1.smithi184.stdout:0/267: link dc/lf dc/l57 0 2023-12-16T03:15:50.766 INFO:tasks.workunit.client.1.smithi184.stdout:0/268: chown dc/l57 23844544 1 2023-12-16T03:15:50.770 INFO:tasks.workunit.client.1.smithi184.stdout:1/246: creat d3/d28/d3c/d24/f55 x:0 0 0 2023-12-16T03:15:50.776 INFO:tasks.workunit.client.1.smithi184.stdout:6/179: mknod d0/d5/d26/c30 0 2023-12-16T03:15:50.778 INFO:tasks.workunit.client.1.smithi184.stdout:9/226: truncate d0/d13/d20/f28 2210989 0 2023-12-16T03:15:50.780 INFO:tasks.workunit.client.1.smithi184.stdout:7/122: dwrite d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:50.781 INFO:tasks.workunit.client.1.smithi184.stdout:0/269: creat dc/f58 x:0 0 0 2023-12-16T03:15:50.783 INFO:tasks.workunit.client.1.smithi184.stdout:1/247: link d3/d28/l54 d3/d34/l56 0 2023-12-16T03:15:50.784 INFO:tasks.workunit.client.1.smithi184.stdout:9/227: symlink d0/d13/d40/l4d 0 2023-12-16T03:15:50.784 INFO:tasks.workunit.client.1.smithi184.stdout:9/228: fdatasync d0/d13/f2a 0 2023-12-16T03:15:50.785 INFO:tasks.workunit.client.1.smithi184.stdout:7/123: mknod d0/df/d1e/c23 0 2023-12-16T03:15:50.785 INFO:tasks.workunit.client.1.smithi184.stdout:7/124: fdatasync d0/df/d1e/f1f 0 2023-12-16T03:15:50.788 INFO:tasks.workunit.client.1.smithi184.stdout:1/248: rename d3/d28/l51 to d3/d28/d36/l57 0 2023-12-16T03:15:50.791 INFO:tasks.workunit.client.1.smithi184.stdout:9/229: symlink d0/d13/d40/l4e 0 2023-12-16T03:15:50.794 INFO:tasks.workunit.client.1.smithi184.stdout:7/125: unlink d0/df/f19 0 2023-12-16T03:15:50.795 INFO:tasks.workunit.client.1.smithi184.stdout:7/126: creat d0/d3/f24 x:0 0 0 2023-12-16T03:15:50.797 INFO:tasks.workunit.client.1.smithi184.stdout:7/127: creat d0/d3/d4/f25 x:0 0 0 2023-12-16T03:15:50.799 INFO:tasks.workunit.client.1.smithi184.stdout:7/128: unlink d0/df/d1e/f1f 0 2023-12-16T03:15:50.799 INFO:tasks.workunit.client.1.smithi184.stdout:7/129: chown d0/d3/ca 11 1 2023-12-16T03:15:50.801 INFO:tasks.workunit.client.1.smithi184.stdout:7/130: getdents d0 0 2023-12-16T03:15:50.803 INFO:tasks.workunit.client.1.smithi184.stdout:6/180: dwrite d0/d5/d12/f1c [4194304,4194304] 0 2023-12-16T03:15:50.803 INFO:tasks.workunit.client.1.smithi184.stdout:9/230: dread d0/f1d [0,4194304] 0 2023-12-16T03:15:50.803 INFO:tasks.workunit.client.1.smithi184.stdout:9/231: chown d0/c3d 118530 1 2023-12-16T03:15:50.804 INFO:tasks.workunit.client.1.smithi184.stdout:6/181: unlink d0/d5/d12/d1b/f27 0 2023-12-16T03:15:50.805 INFO:tasks.workunit.client.1.smithi184.stdout:9/232: mknod d0/d13/d20/d38/d43/c4f 0 2023-12-16T03:15:50.805 INFO:tasks.workunit.client.1.smithi184.stdout:6/182: creat d0/f31 x:0 0 0 2023-12-16T03:15:50.806 INFO:tasks.workunit.client.1.smithi184.stdout:9/233: mknod d0/d13/d20/d38/c50 0 2023-12-16T03:15:50.807 INFO:tasks.workunit.client.1.smithi184.stdout:6/183: creat d0/d5/d12/f32 x:0 0 0 2023-12-16T03:15:50.808 INFO:tasks.workunit.client.1.smithi184.stdout:9/234: rmdir d0/d3a/d47 39 2023-12-16T03:15:50.808 INFO:tasks.workunit.client.1.smithi184.stdout:9/235: fdatasync d0/d13/d20/f28 0 2023-12-16T03:15:50.808 INFO:tasks.workunit.client.1.smithi184.stdout:9/236: read - d0/f3e zero size 2023-12-16T03:15:50.808 INFO:tasks.workunit.client.1.smithi184.stdout:6/184: mkdir d0/d5/d12/d1b/d33 0 2023-12-16T03:15:50.811 INFO:tasks.workunit.client.1.smithi184.stdout:6/185: unlink d0/d5/d12/c23 0 2023-12-16T03:15:50.813 INFO:tasks.workunit.client.1.smithi184.stdout:6/186: write d0/d5/d12/f16 [1065216,87759] 0 2023-12-16T03:15:50.814 INFO:tasks.workunit.client.1.smithi184.stdout:1/249: dwrite d3/f20 [0,4194304] 0 2023-12-16T03:15:50.815 INFO:tasks.workunit.client.1.smithi184.stdout:7/131: dread d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:50.815 INFO:tasks.workunit.client.1.smithi184.stdout:7/132: read - d0/df/d1e/f20 zero size 2023-12-16T03:15:50.815 INFO:tasks.workunit.client.1.smithi184.stdout:7/133: fdatasync d0/d3/f7 0 2023-12-16T03:15:50.815 INFO:tasks.workunit.client.1.smithi184.stdout:6/187: write d0/d5/d12/f1c [5333765,69913] 0 2023-12-16T03:15:50.815 INFO:tasks.workunit.client.1.smithi184.stdout:6/188: readlink d0/l9 0 2023-12-16T03:15:50.815 INFO:tasks.workunit.client.1.smithi184.stdout:6/189: stat d0/d5/d22/fb 0 2023-12-16T03:15:50.817 INFO:tasks.workunit.client.1.smithi184.stdout:1/250: creat d3/d28/f58 x:0 0 0 2023-12-16T03:15:50.818 INFO:tasks.workunit.client.1.smithi184.stdout:0/270: dwrite dc/d10/d1c/f49 [0,4194304] 0 2023-12-16T03:15:50.819 INFO:tasks.workunit.client.1.smithi184.stdout:6/190: mkdir d0/d5/d22/d34 0 2023-12-16T03:15:50.819 INFO:tasks.workunit.client.1.smithi184.stdout:6/191: write d0/f18 [953769,47799] 0 2023-12-16T03:15:50.820 INFO:tasks.workunit.client.1.smithi184.stdout:1/251: symlink d3/d28/d3c/d41/l59 0 2023-12-16T03:15:50.827 INFO:tasks.workunit.client.1.smithi184.stdout:0/271: unlink dc/d22/f29 0 2023-12-16T03:15:50.829 INFO:tasks.workunit.client.1.smithi184.stdout:6/192: mknod d0/d5/d22/d34/c35 0 2023-12-16T03:15:50.829 INFO:tasks.workunit.client.1.smithi184.stdout:0/272: creat dc/d22/d1d/d43/f59 x:0 0 0 2023-12-16T03:15:50.832 INFO:tasks.workunit.client.1.smithi184.stdout:6/193: getdents d0/d5 0 2023-12-16T03:15:50.832 INFO:tasks.workunit.client.1.smithi184.stdout:1/252: dread d3/d28/f44 [0,4194304] 0 2023-12-16T03:15:50.832 INFO:tasks.workunit.client.1.smithi184.stdout:1/253: chown d3/l1d 2767056 1 2023-12-16T03:15:50.834 INFO:tasks.workunit.client.1.smithi184.stdout:1/254: unlink d3/d28/d3c/c31 0 2023-12-16T03:15:50.836 INFO:tasks.workunit.client.1.smithi184.stdout:6/194: mkdir d0/d36 0 2023-12-16T03:15:50.836 INFO:tasks.workunit.client.1.smithi184.stdout:6/195: fsync d0/d5/d22/f29 0 2023-12-16T03:15:50.838 INFO:tasks.workunit.client.1.smithi184.stdout:9/237: dwrite d0/f2f [0,4194304] 0 2023-12-16T03:15:50.838 INFO:tasks.workunit.client.1.smithi184.stdout:9/238: write d0/d13/d40/f42 [456150,29389] 0 2023-12-16T03:15:50.838 INFO:tasks.workunit.client.1.smithi184.stdout:7/134: dwrite d0/d3/f24 [0,4194304] 0 2023-12-16T03:15:50.838 INFO:tasks.workunit.client.1.smithi184.stdout:7/135: fsync d0/d3/d4/f1c 0 2023-12-16T03:15:50.838 INFO:tasks.workunit.client.1.smithi184.stdout:1/255: rmdir d3/d28/d38 39 2023-12-16T03:15:50.839 INFO:tasks.workunit.client.1.smithi184.stdout:6/196: mkdir d0/d5/d22/d37 0 2023-12-16T03:15:50.840 INFO:tasks.workunit.client.1.smithi184.stdout:6/197: fsync d0/d5/d22/fa 0 2023-12-16T03:15:50.840 INFO:tasks.workunit.client.1.smithi184.stdout:6/198: chown d0/d5/d26 14 1 2023-12-16T03:15:50.842 INFO:tasks.workunit.client.1.smithi184.stdout:0/273: dread dc/d10/d2d/f4a [0,4194304] 0 2023-12-16T03:15:50.842 INFO:tasks.workunit.client.1.smithi184.stdout:0/274: chown dc/d22 67 1 2023-12-16T03:15:50.842 INFO:tasks.workunit.client.1.smithi184.stdout:6/199: dread d0/d5/f1f [0,4194304] 0 2023-12-16T03:15:50.843 INFO:tasks.workunit.client.1.smithi184.stdout:7/136: creat d0/df/f26 x:0 0 0 2023-12-16T03:15:50.843 INFO:tasks.workunit.client.1.smithi184.stdout:7/137: chown d0/d3/c21 15972667 1 2023-12-16T03:15:50.846 INFO:tasks.workunit.client.1.smithi184.stdout:1/256: rename d3/d28/d3c/d24/l30 to d3/d28/d38/l5a 0 2023-12-16T03:15:50.857 INFO:tasks.workunit.client.1.smithi184.stdout:0/275: mkdir dc/d22/d1d/d43/d5a 0 2023-12-16T03:15:50.858 INFO:tasks.workunit.client.1.smithi184.stdout:6/200: creat d0/d5/d26/f38 x:0 0 0 2023-12-16T03:15:50.858 INFO:tasks.workunit.client.1.smithi184.stdout:7/138: truncate d0/d3/f11 4241059 0 2023-12-16T03:15:50.859 INFO:tasks.workunit.client.1.smithi184.stdout:0/276: link dc/d10/d2d/f41 dc/d22/d48/f5b 0 2023-12-16T03:15:50.859 INFO:tasks.workunit.client.1.smithi184.stdout:9/239: dwrite d0/f1c [0,4194304] 0 2023-12-16T03:15:50.862 INFO:tasks.workunit.client.1.smithi184.stdout:7/139: mkdir d0/df/dd/d27 0 2023-12-16T03:15:50.862 INFO:tasks.workunit.client.1.smithi184.stdout:0/277: mknod dc/d22/d53/c5c 0 2023-12-16T03:15:50.862 INFO:tasks.workunit.client.1.smithi184.stdout:9/240: dread d0/d13/d20/f28 [0,4194304] 0 2023-12-16T03:15:50.863 INFO:tasks.workunit.client.1.smithi184.stdout:7/140: symlink d0/l28 0 2023-12-16T03:15:50.863 INFO:tasks.workunit.client.1.smithi184.stdout:7/141: chown d0/df/dd/c14 6450314 1 2023-12-16T03:15:50.863 INFO:tasks.workunit.client.1.smithi184.stdout:7/142: write d0/d3/f1a [1563151,114528] 0 2023-12-16T03:15:50.864 INFO:tasks.workunit.client.1.smithi184.stdout:9/241: rename d0/l1e to d0/d13/d20/d38/l51 0 2023-12-16T03:15:50.866 INFO:tasks.workunit.client.1.smithi184.stdout:1/257: dwrite d3/d13/f29 [0,4194304] 0 2023-12-16T03:15:50.867 INFO:tasks.workunit.client.1.smithi184.stdout:1/258: fdatasync d3/d28/d3c/fe 0 2023-12-16T03:15:50.867 INFO:tasks.workunit.client.1.smithi184.stdout:1/259: write d3/d28/d3c/d41/d46/d4a/f50 [499367,88832] 0 2023-12-16T03:15:50.867 INFO:tasks.workunit.client.1.smithi184.stdout:7/143: mknod d0/df/dd/d27/c29 0 2023-12-16T03:15:50.867 INFO:tasks.workunit.client.1.smithi184.stdout:7/144: chown d0/df/l16 225 1 2023-12-16T03:15:50.867 INFO:tasks.workunit.client.1.smithi184.stdout:9/242: write d0/d30/d31/f48 [94635,85358] 0 2023-12-16T03:15:50.867 INFO:tasks.workunit.client.1.smithi184.stdout:9/243: chown d0/d13/l35 5 1 2023-12-16T03:15:50.869 INFO:tasks.workunit.client.1.smithi184.stdout:7/145: creat d0/df/f2a x:0 0 0 2023-12-16T03:15:50.871 INFO:tasks.workunit.client.1.smithi184.stdout:9/244: unlink d0/c3d 0 2023-12-16T03:15:50.871 INFO:tasks.workunit.client.1.smithi184.stdout:9/245: dread - d0/f3e zero size 2023-12-16T03:15:50.872 INFO:tasks.workunit.client.1.smithi184.stdout:9/246: write d0/f1c [238162,56983] 0 2023-12-16T03:15:50.873 INFO:tasks.workunit.client.1.smithi184.stdout:7/146: creat d0/df/dd/d27/f2b x:0 0 0 2023-12-16T03:15:50.874 INFO:tasks.workunit.client.1.smithi184.stdout:1/260: dread d3/f20 [0,4194304] 0 2023-12-16T03:15:50.874 INFO:tasks.workunit.client.1.smithi184.stdout:1/261: truncate d3/d13/d2c/f4c 473705 0 2023-12-16T03:15:50.874 INFO:tasks.workunit.client.1.smithi184.stdout:1/262: write d3/d28/d3c/d24/f43 [98527,38160] 0 2023-12-16T03:15:50.874 INFO:tasks.workunit.client.1.smithi184.stdout:1/263: write d3/d28/f58 [73585,26225] 0 2023-12-16T03:15:50.875 INFO:tasks.workunit.client.1.smithi184.stdout:7/147: creat d0/d3/d4/f2c x:0 0 0 2023-12-16T03:15:50.876 INFO:tasks.workunit.client.1.smithi184.stdout:7/148: chown d0/df/f2a 215491097 1 2023-12-16T03:15:50.877 INFO:tasks.workunit.client.1.smithi184.stdout:1/264: mknod d3/d28/c5b 0 2023-12-16T03:15:50.877 INFO:tasks.workunit.client.1.smithi184.stdout:1/265: chown d3/d28/d3c/f25 19 1 2023-12-16T03:15:50.878 INFO:tasks.workunit.client.1.smithi184.stdout:1/266: symlink d3/d28/d38/d52/l5c 0 2023-12-16T03:15:50.878 INFO:tasks.workunit.client.1.smithi184.stdout:1/267: write d3/d28/d3c/d41/f4b [659370,77419] 0 2023-12-16T03:15:50.878 INFO:tasks.workunit.client.1.smithi184.stdout:1/268: fdatasync d3/f47 0 2023-12-16T03:15:50.878 INFO:tasks.workunit.client.1.smithi184.stdout:1/269: fsync d3/d28/d3c/d41/d46/d4a/f50 0 2023-12-16T03:15:50.879 INFO:tasks.workunit.client.1.smithi184.stdout:6/201: rmdir d0 39 2023-12-16T03:15:50.879 INFO:tasks.workunit.client.1.smithi184.stdout:6/202: chown d0/d5/d22/fb 11039 1 2023-12-16T03:15:50.879 INFO:tasks.workunit.client.1.smithi184.stdout:9/247: dread d0/d30/f44 [0,4194304] 0 2023-12-16T03:15:50.880 INFO:tasks.workunit.client.1.smithi184.stdout:9/248: read d0/f1d [633617,73067] 0 2023-12-16T03:15:50.880 INFO:tasks.workunit.client.1.smithi184.stdout:9/249: readlink d0/l19 0 2023-12-16T03:15:50.882 INFO:tasks.workunit.client.1.smithi184.stdout:1/270: mkdir d3/d28/d3c/d5d 0 2023-12-16T03:15:50.882 INFO:tasks.workunit.client.1.smithi184.stdout:0/278: fsync dc/d22/d48/f5b 0 2023-12-16T03:15:50.883 INFO:tasks.workunit.client.1.smithi184.stdout:6/203: mknod d0/d5/d22/d37/c39 0 2023-12-16T03:15:50.887 INFO:tasks.workunit.client.1.smithi184.stdout:6/204: dread d0/f18 [0,4194304] 0 2023-12-16T03:15:50.891 INFO:tasks.workunit.client.1.smithi184.stdout:6/205: rename d0/c2 to d0/d5/d22/d34/c3a 0 2023-12-16T03:15:50.893 INFO:tasks.workunit.client.1.smithi184.stdout:6/206: unlink d0/d5/l2d 0 2023-12-16T03:15:50.895 INFO:tasks.workunit.client.1.smithi184.stdout:6/207: creat d0/d36/f3b x:0 0 0 2023-12-16T03:15:50.895 INFO:tasks.workunit.client.1.smithi184.stdout:6/208: dread - d0/f31 zero size 2023-12-16T03:15:50.895 INFO:tasks.workunit.client.1.smithi184.stdout:6/209: fdatasync d0/d5/d12/d1b/f2f 0 2023-12-16T03:15:50.896 INFO:tasks.workunit.client.1.smithi184.stdout:6/210: creat d0/d5/d22/f3c x:0 0 0 2023-12-16T03:15:50.896 INFO:tasks.workunit.client.1.smithi184.stdout:6/211: truncate d0/d5/d12/d1b/f2f 413304 0 2023-12-16T03:15:50.897 INFO:tasks.workunit.client.1.smithi184.stdout:6/212: mkdir d0/d5/d12/d1b/d33/d3d 0 2023-12-16T03:15:50.897 INFO:tasks.workunit.client.1.smithi184.stdout:6/213: truncate d0/d5/d26/f38 328524 0 2023-12-16T03:15:50.897 INFO:tasks.workunit.client.1.smithi184.stdout:6/214: write d0/f18 [1398725,121435] 0 2023-12-16T03:15:50.911 INFO:tasks.workunit.client.1.smithi184.stdout:6/215: fdatasync d0/f18 0 2023-12-16T03:15:50.912 INFO:tasks.workunit.client.1.smithi184.stdout:6/216: truncate d0/d5/f24 56147 0 2023-12-16T03:15:50.913 INFO:tasks.workunit.client.1.smithi184.stdout:6/217: readlink d0/d5/d12/l20 0 2023-12-16T03:15:50.913 INFO:tasks.workunit.client.1.smithi184.stdout:6/218: fsync d0/d5/d12/f32 0 2023-12-16T03:15:50.913 INFO:tasks.workunit.client.1.smithi184.stdout:6/219: truncate d0/d5/d26/f38 1323736 0 2023-12-16T03:15:50.913 INFO:tasks.workunit.client.1.smithi184.stdout:6/220: fsync d0/d5/d22/f29 0 2023-12-16T03:15:50.920 INFO:tasks.workunit.client.1.smithi184.stdout:7/149: dwrite d0/df/dd/d27/f2b [0,4194304] 0 2023-12-16T03:15:50.924 INFO:tasks.workunit.client.1.smithi184.stdout:7/150: unlink d0/df/f26 0 2023-12-16T03:15:50.924 INFO:tasks.workunit.client.1.smithi184.stdout:9/250: dwrite d0/f1d [0,4194304] 0 2023-12-16T03:15:50.926 INFO:tasks.workunit.client.1.smithi184.stdout:7/151: creat d0/df/d1e/f2d x:0 0 0 2023-12-16T03:15:50.926 INFO:tasks.workunit.client.1.smithi184.stdout:7/152: chown d0/d3/c17 45768251 1 2023-12-16T03:15:50.927 INFO:tasks.workunit.client.1.smithi184.stdout:7/153: chown d0/df/dd/le 0 1 2023-12-16T03:15:50.927 INFO:tasks.workunit.client.1.smithi184.stdout:7/154: dread - d0/df/f2a zero size 2023-12-16T03:15:50.927 INFO:tasks.workunit.client.1.smithi184.stdout:0/279: dwrite dc/d22/d1a/f3e [0,4194304] 0 2023-12-16T03:15:50.927 INFO:tasks.workunit.client.1.smithi184.stdout:0/280: stat dc/d22/d45 0 2023-12-16T03:15:50.928 INFO:tasks.workunit.client.1.smithi184.stdout:7/155: mkdir d0/d3/d2e 0 2023-12-16T03:15:50.929 INFO:tasks.workunit.client.1.smithi184.stdout:7/156: link d0/l1 d0/d3/l2f 0 2023-12-16T03:15:50.930 INFO:tasks.workunit.client.1.smithi184.stdout:6/221: dwrite d0/d5/d26/f38 [0,4194304] 0 2023-12-16T03:15:50.933 INFO:tasks.workunit.client.1.smithi184.stdout:6/222: mknod d0/d5/d12/d1b/d33/c3e 0 2023-12-16T03:15:50.933 INFO:tasks.workunit.client.1.smithi184.stdout:6/223: chown d0/d5/d22/fa 13155 1 2023-12-16T03:15:50.934 INFO:tasks.workunit.client.1.smithi184.stdout:6/224: chown d0/d5/d12/d1b/f2f 12983 1 2023-12-16T03:15:50.935 INFO:tasks.workunit.client.1.smithi184.stdout:6/225: mkdir d0/d5/d22/d25/d3f 0 2023-12-16T03:15:50.936 INFO:tasks.workunit.client.1.smithi184.stdout:6/226: mkdir d0/d5/d22/d37/d40 0 2023-12-16T03:15:50.937 INFO:tasks.workunit.client.1.smithi184.stdout:6/227: write d0/d5/f1f [616366,20158] 0 2023-12-16T03:15:50.937 INFO:tasks.workunit.client.1.smithi184.stdout:6/228: creat d0/d5/d22/f41 x:0 0 0 2023-12-16T03:15:50.938 INFO:tasks.workunit.client.1.smithi184.stdout:6/229: mkdir d0/d5/d42 0 2023-12-16T03:15:50.938 INFO:tasks.workunit.client.1.smithi184.stdout:6/230: write d0/d5/d12/f32 [56463,64285] 0 2023-12-16T03:15:50.939 INFO:tasks.workunit.client.1.smithi184.stdout:6/231: mknod d0/d5/d12/d1b/d33/d3d/c43 0 2023-12-16T03:15:50.942 INFO:tasks.workunit.client.1.smithi184.stdout:0/281: dwrite dc/f58 [0,4194304] 0 2023-12-16T03:15:50.946 INFO:tasks.workunit.client.1.smithi184.stdout:0/282: dread dc/d10/d2d/f4a [0,4194304] 0 2023-12-16T03:15:50.950 INFO:tasks.workunit.client.1.smithi184.stdout:7/157: dwrite d0/df/d1e/f20 [0,4194304] 0 2023-12-16T03:15:50.958 INFO:tasks.workunit.client.1.smithi184.stdout:6/232: dwrite d0/d5/d22/d25/f2b [4194304,4194304] 0 2023-12-16T03:15:50.959 INFO:tasks.workunit.client.1.smithi184.stdout:0/283: dread dc/d22/d1a/f3e [0,4194304] 0 2023-12-16T03:15:50.959 INFO:tasks.workunit.client.1.smithi184.stdout:0/284: fsync dc/d22/d1d/d43/f55 0 2023-12-16T03:15:50.959 INFO:tasks.workunit.client.1.smithi184.stdout:6/233: mknod d0/d5/d22/d37/c44 0 2023-12-16T03:15:50.960 INFO:tasks.workunit.client.1.smithi184.stdout:0/285: write dc/d10/d2d/f4a [1258308,54719] 0 2023-12-16T03:15:50.962 INFO:tasks.workunit.client.1.smithi184.stdout:7/158: dread d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:50.972 INFO:tasks.workunit.client.1.smithi184.stdout:7/159: dread d0/df/d1e/f20 [0,4194304] 0 2023-12-16T03:15:50.977 INFO:tasks.workunit.client.1.smithi184.stdout:0/286: dwrite dc/d10/d2d/f4a [0,4194304] 0 2023-12-16T03:15:50.977 INFO:tasks.workunit.client.1.smithi184.stdout:7/160: dread d0/df/d1e/f1b [0,4194304] 0 2023-12-16T03:15:50.978 INFO:tasks.workunit.client.1.smithi184.stdout:7/161: write d0/df/dd/f1d [2518608,59460] 0 2023-12-16T03:15:50.982 INFO:tasks.workunit.client.1.smithi184.stdout:7/162: mknod d0/d3/c30 0 2023-12-16T03:15:50.982 INFO:tasks.workunit.client.1.smithi184.stdout:7/163: truncate d0/df/d1e/f20 4405065 0 2023-12-16T03:15:50.987 INFO:tasks.workunit.client.1.smithi184.stdout:0/287: dread dc/d10/d1c/f21 [0,4194304] 0 2023-12-16T03:15:50.989 INFO:tasks.workunit.client.1.smithi184.stdout:0/288: rename dc/d22/d1d/c47 to dc/d2a/c5d 0 2023-12-16T03:15:50.989 INFO:tasks.workunit.client.1.smithi184.stdout:0/289: stat dc/d10/d1c/c56 0 2023-12-16T03:15:50.991 INFO:tasks.workunit.client.1.smithi184.stdout:0/290: creat dc/d22/d53/f5e x:0 0 0 2023-12-16T03:15:50.992 INFO:tasks.workunit.client.1.smithi184.stdout:0/291: truncate dc/d10/d1c/f2f 3166969 0 2023-12-16T03:15:50.993 INFO:tasks.workunit.client.1.smithi184.stdout:0/292: mkdir dc/d10/d2d/d5f 0 2023-12-16T03:15:51.016 INFO:tasks.workunit.client.1.smithi184.stdout:0/293: dwrite dc/f19 [0,4194304] 0 2023-12-16T03:15:51.016 INFO:tasks.workunit.client.1.smithi184.stdout:0/294: truncate dc/d10/d2d/f50 244584 0 2023-12-16T03:15:51.016 INFO:tasks.workunit.client.1.smithi184.stdout:7/164: dwrite d0/df/dd/d27/f2b [0,4194304] 0 2023-12-16T03:15:51.017 INFO:tasks.workunit.client.1.smithi184.stdout:7/165: link d0/l2 d0/d3/d2e/l31 0 2023-12-16T03:15:51.018 INFO:tasks.workunit.client.1.smithi184.stdout:7/166: readlink d0/l2 0 2023-12-16T03:15:51.018 INFO:tasks.workunit.client.1.smithi184.stdout:7/167: mkdir d0/df/d32 0 2023-12-16T03:15:51.019 INFO:tasks.workunit.client.1.smithi184.stdout:7/168: creat d0/d3/d4/f33 x:0 0 0 2023-12-16T03:15:51.020 INFO:tasks.workunit.client.1.smithi184.stdout:7/169: mkdir d0/df/d34 0 2023-12-16T03:15:51.021 INFO:tasks.workunit.client.1.smithi184.stdout:0/295: dread dc/fe [0,4194304] 0 2023-12-16T03:15:51.021 INFO:tasks.workunit.client.1.smithi184.stdout:0/296: write dc/d10/d2d/f4a [4693455,85657] 0 2023-12-16T03:15:51.021 INFO:tasks.workunit.client.1.smithi184.stdout:0/297: dread - dc/d22/d53/f5e zero size 2023-12-16T03:15:51.021 INFO:tasks.workunit.client.1.smithi184.stdout:7/170: write d0/d3/f1a [540654,50572] 0 2023-12-16T03:15:51.022 INFO:tasks.workunit.client.1.smithi184.stdout:0/298: mkdir dc/d22/d1d/d43/d5a/d60 0 2023-12-16T03:15:51.022 INFO:tasks.workunit.client.1.smithi184.stdout:0/299: chown dc/d10/d1c/c26 6574 1 2023-12-16T03:15:51.022 INFO:tasks.workunit.client.1.smithi184.stdout:0/300: chown dc/d10/d1c/c26 487 1 2023-12-16T03:15:51.022 INFO:tasks.workunit.client.1.smithi184.stdout:0/301: write dc/d22/d1a/f3e [1454820,97917] 0 2023-12-16T03:15:51.022 INFO:tasks.workunit.client.1.smithi184.stdout:0/302: fsync dc/d22/d53/f5e 0 2023-12-16T03:15:51.025 INFO:tasks.workunit.client.1.smithi184.stdout:7/171: truncate d0/df/dd/d27/f2b 674245 0 2023-12-16T03:15:51.026 INFO:tasks.workunit.client.1.smithi184.stdout:7/172: mkdir d0/df/d32/d35 0 2023-12-16T03:15:51.028 INFO:tasks.workunit.client.1.smithi184.stdout:7/173: mkdir d0/df/d36 0 2023-12-16T03:15:51.030 INFO:tasks.workunit.client.1.smithi184.stdout:7/174: rename d0/d3/d2e/l31 to d0/df/l37 0 2023-12-16T03:15:51.030 INFO:tasks.workunit.client.1.smithi184.stdout:7/175: write d0/d3/f24 [4976418,54061] 0 2023-12-16T03:15:51.039 INFO:tasks.workunit.client.0.smithi064.stdout:0/11: creat d2/f3 x:0 0 0 2023-12-16T03:15:51.040 INFO:tasks.workunit.client.0.smithi064.stdout:0/12: fsync f1 0 2023-12-16T03:15:51.041 INFO:tasks.workunit.client.1.smithi184.stdout:0/303: dwrite dc/d22/d1a/f3e [4194304,4194304] 0 2023-12-16T03:15:51.041 INFO:tasks.workunit.client.1.smithi184.stdout:0/304: readlink dc/d10/l34 0 2023-12-16T03:15:51.052 INFO:tasks.workunit.client.1.smithi184.stdout:7/176: dwrite d0/d3/d4/f25 [0,4194304] 0 2023-12-16T03:15:51.052 INFO:tasks.workunit.client.1.smithi184.stdout:7/177: write d0/df/d1e/f1b [226331,77848] 0 2023-12-16T03:15:51.053 INFO:tasks.workunit.client.0.smithi064.stdout:5/14: unlink d0/f2 0 2023-12-16T03:15:51.055 INFO:tasks.workunit.client.1.smithi184.stdout:7/178: rename d0/d3/ca to d0/df/d1e/c38 0 2023-12-16T03:15:51.055 INFO:tasks.workunit.client.1.smithi184.stdout:7/179: fdatasync d0/df/dd/d27/f2b 0 2023-12-16T03:15:51.056 INFO:tasks.workunit.client.1.smithi184.stdout:7/180: unlink d0/df/d1e/f1b 0 2023-12-16T03:15:51.069 INFO:tasks.workunit.client.1.smithi184.stdout:7/181: dwrite d0/d3/f5 [4194304,4194304] 0 2023-12-16T03:15:51.069 INFO:tasks.workunit.client.1.smithi184.stdout:7/182: fsync d0/df/d1e/f2d 0 2023-12-16T03:15:51.069 INFO:tasks.workunit.client.1.smithi184.stdout:7/183: chown d0 1 1 2023-12-16T03:15:51.072 INFO:tasks.workunit.client.1.smithi184.stdout:7/184: dread d0/d3/f1a [0,4194304] 0 2023-12-16T03:15:51.091 INFO:tasks.workunit.client.1.smithi184.stdout:7/185: dwrite d0/df/d1e/f20 [0,4194304] 0 2023-12-16T03:15:51.092 INFO:tasks.workunit.client.1.smithi184.stdout:7/186: mkdir d0/df/d32/d39 0 2023-12-16T03:15:51.096 INFO:tasks.workunit.client.1.smithi184.stdout:7/187: dread d0/df/dd/d27/f2b [0,4194304] 0 2023-12-16T03:15:51.096 INFO:tasks.workunit.client.1.smithi184.stdout:7/188: dread - d0/df/d1e/f2d zero size 2023-12-16T03:15:51.096 INFO:tasks.workunit.client.1.smithi184.stdout:7/189: readlink d0/l28 0 2023-12-16T03:15:51.096 INFO:tasks.workunit.client.1.smithi184.stdout:7/190: readlink d0/l28 0 2023-12-16T03:15:51.096 INFO:tasks.workunit.client.1.smithi184.stdout:7/191: write d0/d3/d4/f33 [342053,16716] 0 2023-12-16T03:15:51.102 INFO:tasks.workunit.client.1.smithi184.stdout:8/153: sync 2023-12-16T03:15:51.104 INFO:tasks.workunit.client.1.smithi184.stdout:8/154: mkdir d2/d12/d21/d30 0 2023-12-16T03:15:51.118 INFO:tasks.workunit.client.1.smithi184.stdout:7/192: dwrite d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:51.119 INFO:tasks.workunit.client.1.smithi184.stdout:7/193: chown d0/d3/d4/f33 118555255 1 2023-12-16T03:15:51.134 INFO:tasks.workunit.client.1.smithi184.stdout:7/194: dwrite d0/d3/d4/f2c [0,4194304] 0 2023-12-16T03:15:51.137 INFO:tasks.workunit.client.1.smithi184.stdout:7/195: creat d0/d3/d2e/f3a x:0 0 0 2023-12-16T03:15:51.138 INFO:tasks.workunit.client.1.smithi184.stdout:7/196: write d0/d3/f24 [539968,118935] 0 2023-12-16T03:15:51.139 INFO:tasks.workunit.client.1.smithi184.stdout:7/197: mkdir d0/d3/d2e/d3b 0 2023-12-16T03:15:51.139 INFO:tasks.workunit.client.1.smithi184.stdout:7/198: write d0/df/dd/d27/f2b [1593626,46651] 0 2023-12-16T03:15:51.156 INFO:tasks.workunit.client.1.smithi184.stdout:7/199: dwrite d0/df/dd/f1d [0,4194304] 0 2023-12-16T03:15:51.158 INFO:tasks.workunit.client.1.smithi184.stdout:7/200: rmdir d0/d3/d4 39 2023-12-16T03:15:51.159 INFO:tasks.workunit.client.1.smithi184.stdout:7/201: rename d0/l28 to d0/df/d1e/l3c 0 2023-12-16T03:15:51.185 INFO:tasks.workunit.client.1.smithi184.stdout:7/202: dwrite d0/df/dd/d27/f2b [0,4194304] 0 2023-12-16T03:15:51.186 INFO:tasks.workunit.client.1.smithi184.stdout:7/203: rename d0/d3/d4/f1c to d0/d3/d4/f3d 0 2023-12-16T03:15:51.187 INFO:tasks.workunit.client.1.smithi184.stdout:7/204: truncate d0/d3/d4/f25 1786391 0 2023-12-16T03:15:51.188 INFO:tasks.workunit.client.1.smithi184.stdout:7/205: creat d0/df/d32/d39/f3e x:0 0 0 2023-12-16T03:15:51.188 INFO:tasks.workunit.client.1.smithi184.stdout:7/206: dread - d0/df/d1e/f2d zero size 2023-12-16T03:15:51.195 INFO:tasks.workunit.client.1.smithi184.stdout:7/207: dread d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:51.214 INFO:tasks.workunit.client.1.smithi184.stdout:7/208: dwrite d0/d3/f7 [4194304,4194304] 0 2023-12-16T03:15:51.215 INFO:tasks.workunit.client.1.smithi184.stdout:7/209: truncate d0/d3/d4/f2c 412885 0 2023-12-16T03:15:51.216 INFO:tasks.workunit.client.1.smithi184.stdout:7/210: mkdir d0/df/d36/d3f 0 2023-12-16T03:15:51.223 INFO:tasks.workunit.client.1.smithi184.stdout:7/211: dread d0/df/d1e/f20 [0,4194304] 0 2023-12-16T03:15:51.224 INFO:tasks.workunit.client.1.smithi184.stdout:7/212: mknod d0/df/d36/c40 0 2023-12-16T03:15:51.224 INFO:tasks.workunit.client.1.smithi184.stdout:7/213: fsync d0/df/d32/d39/f3e 0 2023-12-16T03:15:51.225 INFO:tasks.workunit.client.1.smithi184.stdout:7/214: fsync d0/d3/f1a 0 2023-12-16T03:15:51.225 INFO:tasks.workunit.client.1.smithi184.stdout:7/215: readlink d0/df/l37 0 2023-12-16T03:15:51.225 INFO:tasks.workunit.client.1.smithi184.stdout:7/216: chown d0/d3/d4/c22 747695411 1 2023-12-16T03:15:51.225 INFO:tasks.workunit.client.1.smithi184.stdout:7/217: creat d0/df/d1e/f41 x:0 0 0 2023-12-16T03:15:51.226 INFO:tasks.workunit.client.1.smithi184.stdout:7/218: read d0/d3/d4/f25 [1078948,118759] 0 2023-12-16T03:15:51.226 INFO:tasks.workunit.client.1.smithi184.stdout:7/219: creat d0/df/d1e/f42 x:0 0 0 2023-12-16T03:15:51.362 INFO:tasks.workunit.client.1.smithi184.stdout:2/106: sync 2023-12-16T03:15:51.362 INFO:tasks.workunit.client.1.smithi184.stdout:4/123: sync 2023-12-16T03:15:51.362 INFO:tasks.workunit.client.1.smithi184.stdout:5/40: sync 2023-12-16T03:15:51.362 INFO:tasks.workunit.client.1.smithi184.stdout:5/41: fdatasync d1/f2 0 2023-12-16T03:15:51.363 INFO:tasks.workunit.client.1.smithi184.stdout:2/107: truncate d3/d5/fb 1265843 0 2023-12-16T03:15:51.363 INFO:tasks.workunit.client.1.smithi184.stdout:2/108: dread - d3/d13/f18 zero size 2023-12-16T03:15:51.363 INFO:tasks.workunit.client.1.smithi184.stdout:2/109: stat d3/d9/d19/f1c 0 2023-12-16T03:15:51.364 INFO:tasks.workunit.client.1.smithi184.stdout:5/42: unlink d1/f2 0 2023-12-16T03:15:51.364 INFO:tasks.workunit.client.1.smithi184.stdout:5/43: truncate d1/d3/fc 347327 0 2023-12-16T03:15:51.364 INFO:tasks.workunit.client.1.smithi184.stdout:5/44: chown d1/d3/l4 959900 1 2023-12-16T03:15:51.364 INFO:tasks.workunit.client.1.smithi184.stdout:5/45: truncate d1/d3/fd 64254 0 2023-12-16T03:15:51.365 INFO:tasks.workunit.client.1.smithi184.stdout:5/46: mkdir d1/d3/d9/de 0 2023-12-16T03:15:51.365 INFO:tasks.workunit.client.1.smithi184.stdout:5/47: fsync d1/d3/fa 0 2023-12-16T03:15:51.366 INFO:tasks.workunit.client.1.smithi184.stdout:5/48: rename d1/d3/l4 to d1/d3/lf 0 2023-12-16T03:15:51.373 INFO:tasks.workunit.client.1.smithi184.stdout:5/49: getdents d1 0 2023-12-16T03:15:51.375 INFO:tasks.workunit.client.1.smithi184.stdout:5/50: rename d1/lb to d1/l10 0 2023-12-16T03:15:51.378 INFO:tasks.workunit.client.1.smithi184.stdout:5/51: mkdir d1/d3/d11 0 2023-12-16T03:15:51.379 INFO:tasks.workunit.client.1.smithi184.stdout:5/52: dread d1/d3/fd [0,4194304] 0 2023-12-16T03:15:51.380 INFO:tasks.workunit.client.1.smithi184.stdout:5/53: creat d1/d3/d11/f12 x:0 0 0 2023-12-16T03:15:51.380 INFO:tasks.workunit.client.1.smithi184.stdout:5/54: chown d1/d3/d9 16243272 1 2023-12-16T03:15:51.382 INFO:tasks.workunit.client.1.smithi184.stdout:5/55: creat d1/d3/d11/f13 x:0 0 0 2023-12-16T03:15:51.382 INFO:tasks.workunit.client.1.smithi184.stdout:5/56: read d1/d3/fc [309630,6756] 0 2023-12-16T03:15:51.382 INFO:tasks.workunit.client.1.smithi184.stdout:2/110: dwrite d3/d5/fa [0,4194304] 0 2023-12-16T03:15:51.382 INFO:tasks.workunit.client.1.smithi184.stdout:4/124: dwrite d1/fd [0,4194304] 0 2023-12-16T03:15:51.382 INFO:tasks.workunit.client.1.smithi184.stdout:4/125: chown d1/d12/f17 3 1 2023-12-16T03:15:51.383 INFO:tasks.workunit.client.1.smithi184.stdout:2/111: rename d3/d9/d19/c1d to d3/d13/d1e/d1f/c25 0 2023-12-16T03:15:51.383 INFO:tasks.workunit.client.1.smithi184.stdout:2/112: readlink d3/d13/l23 0 2023-12-16T03:15:51.385 INFO:tasks.workunit.client.1.smithi184.stdout:4/126: rmdir d1 39 2023-12-16T03:15:51.385 INFO:tasks.workunit.client.1.smithi184.stdout:4/127: readlink d1/d11/d1b/d1e/l1f 0 2023-12-16T03:15:51.385 INFO:tasks.workunit.client.1.smithi184.stdout:4/128: chown d1/cc 0 1 2023-12-16T03:15:51.386 INFO:tasks.workunit.client.1.smithi184.stdout:4/129: truncate d1/d11/d1b/d1e/f24 961390 0 2023-12-16T03:15:51.405 INFO:tasks.workunit.client.1.smithi184.stdout:2/113: dwrite d3/f14 [0,4194304] 0 2023-12-16T03:15:51.408 INFO:tasks.workunit.client.1.smithi184.stdout:2/114: link d3/d5/f1a d3/d9/d19/f26 0 2023-12-16T03:15:51.408 INFO:tasks.workunit.client.1.smithi184.stdout:2/115: chown d3/d5/f1a 10142 1 2023-12-16T03:15:51.408 INFO:tasks.workunit.client.1.smithi184.stdout:2/116: creat d3/d9/f27 x:0 0 0 2023-12-16T03:15:51.410 INFO:tasks.workunit.client.1.smithi184.stdout:2/117: mkdir d3/d13/d28 0 2023-12-16T03:15:51.411 INFO:tasks.workunit.client.1.smithi184.stdout:2/118: mkdir d3/d29 0 2023-12-16T03:15:51.412 INFO:tasks.workunit.client.1.smithi184.stdout:2/119: symlink d3/d13/l2a 0 2023-12-16T03:15:51.413 INFO:tasks.workunit.client.1.smithi184.stdout:4/130: dwrite d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:51.413 INFO:tasks.workunit.client.1.smithi184.stdout:2/120: symlink d3/d13/d28/l2b 0 2023-12-16T03:15:51.413 INFO:tasks.workunit.client.1.smithi184.stdout:2/121: readlink d3/d13/l23 0 2023-12-16T03:15:51.415 INFO:tasks.workunit.client.1.smithi184.stdout:4/131: mkdir d1/d29 0 2023-12-16T03:15:51.416 INFO:tasks.workunit.client.1.smithi184.stdout:2/122: creat d3/d13/d28/f2c x:0 0 0 2023-12-16T03:15:51.416 INFO:tasks.workunit.client.1.smithi184.stdout:2/123: truncate d3/d13/f18 31641 0 2023-12-16T03:15:51.417 INFO:tasks.workunit.client.1.smithi184.stdout:2/124: chown d3/d13/f18 0 1 2023-12-16T03:15:51.417 INFO:tasks.workunit.client.1.smithi184.stdout:2/125: chown d3/d9/c16 11 1 2023-12-16T03:15:51.417 INFO:tasks.workunit.client.1.smithi184.stdout:4/132: symlink d1/l2a 0 2023-12-16T03:15:51.417 INFO:tasks.workunit.client.1.smithi184.stdout:4/133: truncate d1/d12/d13/f22 1479151 0 2023-12-16T03:15:51.418 INFO:tasks.workunit.client.1.smithi184.stdout:2/126: creat d3/d29/f2d x:0 0 0 2023-12-16T03:15:51.422 INFO:tasks.workunit.client.1.smithi184.stdout:4/134: mknod d1/d12/d27/c2b 0 2023-12-16T03:15:51.424 INFO:tasks.workunit.client.1.smithi184.stdout:2/127: rename d3/d5 to d3/d13/d1e/d2e 0 2023-12-16T03:15:51.424 INFO:tasks.workunit.client.1.smithi184.stdout:4/135: symlink d1/d11/l2c 0 2023-12-16T03:15:51.425 INFO:tasks.workunit.client.1.smithi184.stdout:2/128: unlink d3/d9/ce 0 2023-12-16T03:15:51.426 INFO:tasks.workunit.client.1.smithi184.stdout:2/129: chown d3/l10 23 1 2023-12-16T03:15:51.436 INFO:tasks.workunit.client.1.smithi184.stdout:4/136: dread d1/f28 [0,4194304] 0 2023-12-16T03:15:51.437 INFO:tasks.workunit.client.1.smithi184.stdout:4/137: unlink d1/d11/d1b/d1e/l1f 0 2023-12-16T03:15:51.438 INFO:tasks.workunit.client.1.smithi184.stdout:2/130: dwrite d3/fd [0,4194304] 0 2023-12-16T03:15:51.458 INFO:tasks.workunit.client.1.smithi184.stdout:4/138: dwrite d1/d11/f23 [0,4194304] 0 2023-12-16T03:15:51.459 INFO:tasks.workunit.client.1.smithi184.stdout:2/131: dwrite d3/d9/d19/f1c [0,4194304] 0 2023-12-16T03:15:51.462 INFO:tasks.workunit.client.1.smithi184.stdout:2/132: rename d3/d13/d1e to d3/d29/d2f 0 2023-12-16T03:15:51.467 INFO:tasks.workunit.client.1.smithi184.stdout:2/133: dread d3/d29/d2f/d2e/f12 [0,4194304] 0 2023-12-16T03:15:51.467 INFO:tasks.workunit.client.1.smithi184.stdout:2/134: fdatasync d3/d29/d2f/d2e/f1a 0 2023-12-16T03:15:51.479 INFO:tasks.workunit.client.1.smithi184.stdout:4/139: dwrite d1/d12/f17 [0,4194304] 0 2023-12-16T03:15:51.483 INFO:tasks.workunit.client.1.smithi184.stdout:4/140: write d1/f28 [3816370,26300] 0 2023-12-16T03:15:51.484 INFO:tasks.workunit.client.1.smithi184.stdout:4/141: symlink d1/d11/d1b/d1e/l2d 0 2023-12-16T03:15:51.495 INFO:tasks.workunit.client.1.smithi184.stdout:2/135: dwrite d3/d9/fc [4194304,4194304] 0 2023-12-16T03:15:51.496 INFO:tasks.workunit.client.1.smithi184.stdout:2/136: chown d3/d9/c16 388148100 1 2023-12-16T03:15:51.496 INFO:tasks.workunit.client.1.smithi184.stdout:4/142: fsync d1/d12/f17 0 2023-12-16T03:15:51.496 INFO:tasks.workunit.client.1.smithi184.stdout:2/137: link d3/d13/d28/f2c d3/d29/f30 0 2023-12-16T03:15:51.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/143: truncate d1/f4 2490961 0 2023-12-16T03:15:51.500 INFO:tasks.workunit.client.1.smithi184.stdout:4/144: creat d1/d29/f2e x:0 0 0 2023-12-16T03:15:51.501 INFO:tasks.workunit.client.1.smithi184.stdout:4/145: getdents d1 0 2023-12-16T03:15:51.502 INFO:tasks.workunit.client.1.smithi184.stdout:4/146: mknod d1/d29/c2f 0 2023-12-16T03:15:51.503 INFO:tasks.workunit.client.1.smithi184.stdout:4/147: fsync d1/d11/f23 0 2023-12-16T03:15:51.504 INFO:tasks.workunit.client.1.smithi184.stdout:4/148: symlink d1/d11/d1b/l30 0 2023-12-16T03:15:51.507 INFO:tasks.workunit.client.1.smithi184.stdout:4/149: truncate d1/f28 533778 0 2023-12-16T03:15:51.510 INFO:tasks.workunit.client.1.smithi184.stdout:2/138: dwrite d3/d9/d19/f1c [4194304,4194304] 0 2023-12-16T03:15:51.536 INFO:tasks.workunit.client.1.smithi184.stdout:4/150: dwrite d1/f8 [0,4194304] 0 2023-12-16T03:15:51.536 INFO:tasks.workunit.client.1.smithi184.stdout:2/139: dwrite d3/f4 [0,4194304] 0 2023-12-16T03:15:51.536 INFO:tasks.workunit.client.1.smithi184.stdout:2/140: write d3/fd [2612609,16458] 0 2023-12-16T03:15:51.537 INFO:tasks.workunit.client.1.smithi184.stdout:4/151: rename d1/d11/d1b/d1e/f20 to d1/d12/d13/f31 0 2023-12-16T03:15:51.537 INFO:tasks.workunit.client.1.smithi184.stdout:4/152: chown d1/l10 5096634 1 2023-12-16T03:15:51.538 INFO:tasks.workunit.client.1.smithi184.stdout:2/141: rename d3/d29/d2f/d1f to d3/d29/d2f/d31 0 2023-12-16T03:15:51.539 INFO:tasks.workunit.client.1.smithi184.stdout:4/153: creat d1/d12/d27/f32 x:0 0 0 2023-12-16T03:15:51.540 INFO:tasks.workunit.client.1.smithi184.stdout:2/142: link d3/d9/fc d3/d29/d2f/d2e/f32 0 2023-12-16T03:15:51.541 INFO:tasks.workunit.client.1.smithi184.stdout:4/154: mkdir d1/d12/d27/d33 0 2023-12-16T03:15:51.542 INFO:tasks.workunit.client.1.smithi184.stdout:2/143: rename d3/d29/d2f/d31/c25 to d3/d29/d2f/c33 0 2023-12-16T03:15:51.542 INFO:tasks.workunit.client.1.smithi184.stdout:2/144: stat d3/d9/d19/f26 0 2023-12-16T03:15:51.542 INFO:tasks.workunit.client.1.smithi184.stdout:4/155: mkdir d1/d29/d34 0 2023-12-16T03:15:51.544 INFO:tasks.workunit.client.1.smithi184.stdout:4/156: write d1/d11/f23 [935659,39521] 0 2023-12-16T03:15:51.544 INFO:tasks.workunit.client.1.smithi184.stdout:4/157: fdatasync d1/d12/d27/f32 0 2023-12-16T03:15:51.547 INFO:tasks.workunit.client.1.smithi184.stdout:2/145: getdents d3/d29/d2f/d2e 0 2023-12-16T03:15:51.577 INFO:tasks.workunit.client.1.smithi184.stdout:4/158: dwrite d1/d11/f23 [0,4194304] 0 2023-12-16T03:15:51.578 INFO:tasks.workunit.client.1.smithi184.stdout:2/146: dwrite d3/d29/d2f/d2e/f1b [0,4194304] 0 2023-12-16T03:15:51.580 INFO:tasks.workunit.client.1.smithi184.stdout:2/147: write d3/fd [6864692,72559] 0 2023-12-16T03:15:51.584 INFO:tasks.workunit.client.1.smithi184.stdout:2/148: read d3/d9/fc [519317,130019] 0 2023-12-16T03:15:51.586 INFO:tasks.workunit.client.1.smithi184.stdout:2/149: rename d3/d9/d19/c24 to d3/d29/c34 0 2023-12-16T03:15:51.586 INFO:tasks.workunit.client.1.smithi184.stdout:2/150: chown d3/d9 1698 1 2023-12-16T03:15:51.586 INFO:tasks.workunit.client.1.smithi184.stdout:2/151: chown d3/d29/d2f/f22 0 1 2023-12-16T03:15:51.586 INFO:tasks.workunit.client.1.smithi184.stdout:2/152: truncate d3/d13/d28/f2c 702196 0 2023-12-16T03:15:51.587 INFO:tasks.workunit.client.1.smithi184.stdout:2/153: creat d3/d29/d2f/d2e/f35 x:0 0 0 2023-12-16T03:15:51.587 INFO:tasks.workunit.client.1.smithi184.stdout:2/154: chown d3 58252768 1 2023-12-16T03:15:51.587 INFO:tasks.workunit.client.1.smithi184.stdout:2/155: symlink d3/d29/d2f/d31/l36 0 2023-12-16T03:15:51.589 INFO:tasks.workunit.client.1.smithi184.stdout:2/156: rmdir d3/d9/d19 39 2023-12-16T03:15:51.590 INFO:tasks.workunit.client.1.smithi184.stdout:2/157: stat d3/d29/d2f/d2e/f7 0 2023-12-16T03:15:51.592 INFO:tasks.workunit.client.1.smithi184.stdout:2/158: link d3/d29/d2f/d2e/f35 d3/d9/d19/f37 0 2023-12-16T03:15:51.592 INFO:tasks.workunit.client.1.smithi184.stdout:2/159: truncate d3/d9/d19/f26 37638 0 2023-12-16T03:15:51.592 INFO:tasks.workunit.client.1.smithi184.stdout:2/160: chown d3/d9/fc 2801 1 2023-12-16T03:15:51.592 INFO:tasks.workunit.client.1.smithi184.stdout:2/161: fsync d3/d9/f27 0 2023-12-16T03:15:51.592 INFO:tasks.workunit.client.1.smithi184.stdout:2/162: write d3/d29/d2f/d2e/f12 [1775520,49040] 0 2023-12-16T03:15:51.593 INFO:tasks.workunit.client.1.smithi184.stdout:4/159: dwrite d1/d12/f17 [0,4194304] 0 2023-12-16T03:15:51.593 INFO:tasks.workunit.client.1.smithi184.stdout:3/285: sync 2023-12-16T03:15:51.593 INFO:tasks.workunit.client.1.smithi184.stdout:1/271: sync 2023-12-16T03:15:51.594 INFO:tasks.workunit.client.1.smithi184.stdout:1/272: truncate d3/d28/d3c/d24/f43 1044777 0 2023-12-16T03:15:51.594 INFO:tasks.workunit.client.1.smithi184.stdout:1/273: readlink d3/d34/l56 0 2023-12-16T03:15:51.594 INFO:tasks.workunit.client.1.smithi184.stdout:2/163: unlink d3/d9/fc 0 2023-12-16T03:15:51.595 INFO:tasks.workunit.client.1.smithi184.stdout:4/160: mknod d1/d29/d34/c35 0 2023-12-16T03:15:51.595 INFO:tasks.workunit.client.1.smithi184.stdout:4/161: readlink d1/d12/l19 0 2023-12-16T03:15:51.595 INFO:tasks.workunit.client.1.smithi184.stdout:3/286: creat d12/d37/f6a x:0 0 0 2023-12-16T03:15:51.597 INFO:tasks.workunit.client.1.smithi184.stdout:1/274: mknod d3/d13/c5e 0 2023-12-16T03:15:51.599 INFO:tasks.workunit.client.1.smithi184.stdout:4/162: rename d1/d12/c18 to d1/d11/d1b/c36 0 2023-12-16T03:15:51.599 INFO:tasks.workunit.client.1.smithi184.stdout:3/287: dread f8 [0,4194304] 0 2023-12-16T03:15:51.600 INFO:tasks.workunit.client.1.smithi184.stdout:1/275: creat d3/d13/f5f x:0 0 0 2023-12-16T03:15:51.600 INFO:tasks.workunit.client.1.smithi184.stdout:1/276: write d3/d28/d3c/d41/d46/d4a/f50 [1231930,79155] 0 2023-12-16T03:15:51.601 INFO:tasks.workunit.client.1.smithi184.stdout:3/288: mknod d12/d18/d1f/d23/d2a/d42/c6b 0 2023-12-16T03:15:51.602 INFO:tasks.workunit.client.1.smithi184.stdout:1/277: symlink d3/d28/d3c/d41/d46/d4a/l60 0 2023-12-16T03:15:51.602 INFO:tasks.workunit.client.1.smithi184.stdout:1/278: fdatasync d3/d28/d3c/f35 0 2023-12-16T03:15:51.603 INFO:tasks.workunit.client.1.smithi184.stdout:3/289: read d12/d37/f3f [3910203,129293] 0 2023-12-16T03:15:51.605 INFO:tasks.workunit.client.1.smithi184.stdout:1/279: mknod d3/d28/d36/c61 0 2023-12-16T03:15:51.606 INFO:tasks.workunit.client.1.smithi184.stdout:1/280: rmdir d3/d13/d2c 39 2023-12-16T03:15:51.607 INFO:tasks.workunit.client.0.smithi064.stdout:7/8: mknod c2 0 2023-12-16T03:15:51.612 INFO:tasks.workunit.client.1.smithi184.stdout:2/164: dwrite d3/d29/d2f/d2e/f35 [0,4194304] 0 2023-12-16T03:15:51.616 INFO:tasks.workunit.client.1.smithi184.stdout:2/165: symlink d3/d29/d2f/l38 0 2023-12-16T03:15:51.619 INFO:tasks.workunit.client.1.smithi184.stdout:2/166: unlink d3/d29/d2f/d2e/f32 0 2023-12-16T03:15:51.619 INFO:tasks.workunit.client.1.smithi184.stdout:2/167: write d3/d9/f27 [203162,37565] 0 2023-12-16T03:15:51.619 INFO:tasks.workunit.client.1.smithi184.stdout:2/168: fdatasync d3/d29/d2f/f22 0 2023-12-16T03:15:51.627 INFO:tasks.workunit.client.1.smithi184.stdout:4/163: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:51.636 INFO:tasks.workunit.client.1.smithi184.stdout:3/290: dwrite d12/f16 [0,4194304] 0 2023-12-16T03:15:51.637 INFO:tasks.workunit.client.1.smithi184.stdout:1/281: dwrite d3/d28/d3c/f4f [0,4194304] 0 2023-12-16T03:15:51.643 INFO:tasks.workunit.client.1.smithi184.stdout:1/282: creat d3/d28/d3c/d41/f62 x:0 0 0 2023-12-16T03:15:51.644 INFO:tasks.workunit.client.1.smithi184.stdout:1/283: mkdir d3/d28/d3c/d41/d63 0 2023-12-16T03:15:51.644 INFO:tasks.workunit.client.1.smithi184.stdout:1/284: fsync d3/d28/d3c/d41/d46/d4a/f50 0 2023-12-16T03:15:51.646 INFO:tasks.workunit.client.1.smithi184.stdout:1/285: getdents d3 0 2023-12-16T03:15:51.647 INFO:tasks.workunit.client.1.smithi184.stdout:4/164: dread d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:51.648 INFO:tasks.workunit.client.1.smithi184.stdout:1/286: creat d3/d28/d3c/d41/d63/f64 x:0 0 0 2023-12-16T03:15:51.648 INFO:tasks.workunit.client.1.smithi184.stdout:1/287: read d3/d28/d3c/d41/d46/d4a/f50 [16951,2926] 0 2023-12-16T03:15:51.651 INFO:tasks.workunit.client.1.smithi184.stdout:4/165: mkdir d1/d29/d37 0 2023-12-16T03:15:51.652 INFO:tasks.workunit.client.1.smithi184.stdout:1/288: truncate d3/f47 726552 0 2023-12-16T03:15:51.653 INFO:tasks.workunit.client.1.smithi184.stdout:4/166: mknod d1/d12/d27/c38 0 2023-12-16T03:15:51.653 INFO:tasks.workunit.client.1.smithi184.stdout:4/167: chown d1/l2 107507 1 2023-12-16T03:15:51.658 INFO:tasks.workunit.client.1.smithi184.stdout:6/234: sync 2023-12-16T03:15:51.658 INFO:tasks.workunit.client.1.smithi184.stdout:9/251: sync 2023-12-16T03:15:51.658 INFO:tasks.workunit.client.1.smithi184.stdout:9/252: fsync d0/f14 0 2023-12-16T03:15:51.659 INFO:tasks.workunit.client.1.smithi184.stdout:9/253: fsync d0/d13/f21 0 2023-12-16T03:15:51.661 INFO:tasks.workunit.client.1.smithi184.stdout:9/254: creat d0/d13/d20/d38/f52 x:0 0 0 2023-12-16T03:15:51.666 INFO:tasks.workunit.client.1.smithi184.stdout:3/291: dwrite d12/f16 [0,4194304] 0 2023-12-16T03:15:51.667 INFO:tasks.workunit.client.0.smithi064.stdout:2/20: creat d1/f4 x:0 0 0 2023-12-16T03:15:51.668 INFO:tasks.workunit.client.1.smithi184.stdout:3/292: creat d12/d18/d1f/f6c x:0 0 0 2023-12-16T03:15:51.671 INFO:tasks.workunit.client.0.smithi064.stdout:3/16: creat f4 x:0 0 0 2023-12-16T03:15:51.671 INFO:tasks.workunit.client.0.smithi064.stdout:8/12: creat d0/f3 x:0 0 0 2023-12-16T03:15:51.672 INFO:tasks.workunit.client.0.smithi064.stdout:9/7: mknod d2/c3 0 2023-12-16T03:15:51.674 INFO:tasks.workunit.client.0.smithi064.stdout:9/8: write f1 [134429,124856] 0 2023-12-16T03:15:51.686 INFO:tasks.workunit.client.1.smithi184.stdout:3/293: dread d12/d18/d1f/f2e [0,4194304] 0 2023-12-16T03:15:51.687 INFO:tasks.workunit.client.1.smithi184.stdout:1/289: dwrite d3/f20 [0,4194304] 0 2023-12-16T03:15:51.687 INFO:tasks.workunit.client.1.smithi184.stdout:3/294: creat d12/d37/f6d x:0 0 0 2023-12-16T03:15:51.689 INFO:tasks.workunit.client.1.smithi184.stdout:1/290: creat d3/d34/f65 x:0 0 0 2023-12-16T03:15:51.690 INFO:tasks.workunit.client.1.smithi184.stdout:3/295: creat d12/d18/d68/f6e x:0 0 0 2023-12-16T03:15:51.691 INFO:tasks.workunit.client.1.smithi184.stdout:1/291: unlink d3/d13/d2c/f49 0 2023-12-16T03:15:51.691 INFO:tasks.workunit.client.1.smithi184.stdout:1/292: dread - d3/d13/f5f zero size 2023-12-16T03:15:51.691 INFO:tasks.workunit.client.1.smithi184.stdout:3/296: creat d12/d18/d1f/d23/d2a/d42/d52/f6f x:0 0 0 2023-12-16T03:15:51.693 INFO:tasks.workunit.client.1.smithi184.stdout:1/293: rmdir d3/d28/d3c/d5d 0 2023-12-16T03:15:51.693 INFO:tasks.workunit.client.1.smithi184.stdout:1/294: write d3/d13/d2c/f37 [4073581,88467] 0 2023-12-16T03:15:51.694 INFO:tasks.workunit.client.1.smithi184.stdout:3/297: creat d12/d18/d1f/d23/d2a/d3e/d48/f70 x:0 0 0 2023-12-16T03:15:51.694 INFO:tasks.workunit.client.1.smithi184.stdout:3/298: chown d12/d18/d1f/d23/d2a/d4a 98569 1 2023-12-16T03:15:51.696 INFO:tasks.workunit.client.1.smithi184.stdout:4/168: dwrite d1/d12/d13/f31 [0,4194304] 0 2023-12-16T03:15:51.696 INFO:tasks.workunit.client.1.smithi184.stdout:4/169: write d1/d12/f17 [4243559,3879] 0 2023-12-16T03:15:51.696 INFO:tasks.workunit.client.1.smithi184.stdout:4/170: chown d1/d12/l19 24148 1 2023-12-16T03:15:51.696 INFO:tasks.workunit.client.1.smithi184.stdout:3/299: truncate d12/d37/f3f 3164559 0 2023-12-16T03:15:51.698 INFO:tasks.workunit.client.1.smithi184.stdout:4/171: mknod d1/d11/d1b/c39 0 2023-12-16T03:15:51.698 INFO:tasks.workunit.client.1.smithi184.stdout:3/300: creat d12/d18/f71 x:0 0 0 2023-12-16T03:15:51.699 INFO:tasks.workunit.client.1.smithi184.stdout:9/255: dwrite d0/d13/f3f [0,4194304] 0 2023-12-16T03:15:51.699 INFO:tasks.workunit.client.1.smithi184.stdout:6/235: dwrite d0/d5/d22/fb [0,4194304] 0 2023-12-16T03:15:51.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/236: dread d0/f18 [0,4194304] 0 2023-12-16T03:15:51.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/237: fsync d0/d5/f2c 0 2023-12-16T03:15:51.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/238: getdents d0/d5/d22/d37/d40 0 2023-12-16T03:15:51.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/239: chown d0/d5/d42 815402 1 2023-12-16T03:15:51.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/240: stat d0/d5/d22/f41 0 2023-12-16T03:15:51.704 INFO:tasks.workunit.client.1.smithi184.stdout:4/172: mknod d1/d29/c3a 0 2023-12-16T03:15:51.704 INFO:tasks.workunit.client.1.smithi184.stdout:3/301: rename d12/d18/d1f/d23/d2a/f34 to d12/d18/d1f/d23/d2a/d4a/d61/f72 0 2023-12-16T03:15:51.704 INFO:tasks.workunit.client.1.smithi184.stdout:3/302: read - d12/d18/d1f/d23/d2a/d3e/d48/f70 zero size 2023-12-16T03:15:51.714 INFO:tasks.workunit.client.1.smithi184.stdout:9/256: mkdir d0/d13/d20/d38/d53 0 2023-12-16T03:15:51.715 INFO:tasks.workunit.client.1.smithi184.stdout:6/241: mkdir d0/d5/d22/d37/d45 0 2023-12-16T03:15:51.717 INFO:tasks.workunit.client.1.smithi184.stdout:1/295: dwrite d3/d13/f29 [0,4194304] 0 2023-12-16T03:15:51.721 INFO:tasks.workunit.client.1.smithi184.stdout:4/173: mkdir d1/d12/d27/d3b 0 2023-12-16T03:15:51.721 INFO:tasks.workunit.client.1.smithi184.stdout:3/303: getdents d12/d1e 0 2023-12-16T03:15:51.721 INFO:tasks.workunit.client.1.smithi184.stdout:6/242: write d0/d5/d12/f1c [5972826,44267] 0 2023-12-16T03:15:51.722 INFO:tasks.workunit.client.1.smithi184.stdout:9/257: creat d0/d30/d31/f54 x:0 0 0 2023-12-16T03:15:51.725 INFO:tasks.workunit.client.1.smithi184.stdout:1/296: creat d3/d34/d39/f66 x:0 0 0 2023-12-16T03:15:51.726 INFO:tasks.workunit.client.1.smithi184.stdout:6/243: read d0/d5/f24 [12289,51475] 0 2023-12-16T03:15:51.729 INFO:tasks.workunit.client.1.smithi184.stdout:1/297: truncate d3/ff 3015093 0 2023-12-16T03:15:51.729 INFO:tasks.workunit.client.1.smithi184.stdout:1/298: write d3/d28/d3c/d41/f4d [776468,52277] 0 2023-12-16T03:15:51.729 INFO:tasks.workunit.client.1.smithi184.stdout:1/299: read - d3/d28/d3c/d41/f62 zero size 2023-12-16T03:15:51.729 INFO:tasks.workunit.client.1.smithi184.stdout:1/300: readlink d3/d28/d3c/d24/l32 0 2023-12-16T03:15:51.729 INFO:tasks.workunit.client.1.smithi184.stdout:6/244: symlink d0/d5/l46 0 2023-12-16T03:15:51.730 INFO:tasks.workunit.client.1.smithi184.stdout:4/174: dread d1/f4 [0,4194304] 0 2023-12-16T03:15:51.731 INFO:tasks.workunit.client.1.smithi184.stdout:6/245: unlink d0/d5/d26/c2a 0 2023-12-16T03:15:51.731 INFO:tasks.workunit.client.1.smithi184.stdout:6/246: chown d0/d5/l46 702750167 1 2023-12-16T03:15:51.739 INFO:tasks.workunit.client.1.smithi184.stdout:4/175: dread d1/d12/f17 [0,4194304] 0 2023-12-16T03:15:51.740 INFO:tasks.workunit.client.1.smithi184.stdout:4/176: rename d1/d11/l2c to d1/d12/d27/l3c 0 2023-12-16T03:15:51.741 INFO:tasks.workunit.client.1.smithi184.stdout:4/177: link d1/d12/d13/f31 d1/d29/d34/f3d 0 2023-12-16T03:15:51.742 INFO:tasks.workunit.client.1.smithi184.stdout:4/178: creat d1/d12/f3e x:0 0 0 2023-12-16T03:15:51.770 INFO:tasks.workunit.client.1.smithi184.stdout:9/258: dread d0/f14 [0,4194304] 0 2023-12-16T03:15:51.770 INFO:tasks.workunit.client.1.smithi184.stdout:6/247: dread d0/d5/d12/f32 [0,4194304] 0 2023-12-16T03:15:51.770 INFO:tasks.workunit.client.1.smithi184.stdout:6/248: write d0/d5/d12/f32 [828665,76143] 0 2023-12-16T03:15:51.770 INFO:tasks.workunit.client.1.smithi184.stdout:6/249: fdatasync d0/d5/f1f 0 2023-12-16T03:15:51.771 INFO:tasks.workunit.client.1.smithi184.stdout:6/250: chown d0/d5/d22/d37/d45 2098768 1 2023-12-16T03:15:51.772 INFO:tasks.workunit.client.1.smithi184.stdout:7/220: sync 2023-12-16T03:15:51.772 INFO:tasks.workunit.client.1.smithi184.stdout:0/305: sync 2023-12-16T03:15:51.772 INFO:tasks.workunit.client.1.smithi184.stdout:0/306: fsync f4 0 2023-12-16T03:15:51.774 INFO:tasks.workunit.client.1.smithi184.stdout:7/221: symlink d0/l43 0 2023-12-16T03:15:51.774 INFO:tasks.workunit.client.1.smithi184.stdout:7/222: chown d0/d3/d4/f33 64200661 1 2023-12-16T03:15:51.774 INFO:tasks.workunit.client.1.smithi184.stdout:7/223: chown d0/df/d36/c40 8633544 1 2023-12-16T03:15:51.774 INFO:tasks.workunit.client.1.smithi184.stdout:6/251: mkdir d0/d5/d22/d25/d47 0 2023-12-16T03:15:51.776 INFO:tasks.workunit.client.1.smithi184.stdout:7/224: truncate d0/df/dd/d27/f2b 3490258 0 2023-12-16T03:15:51.777 INFO:tasks.workunit.client.1.smithi184.stdout:6/252: symlink d0/d5/d12/d1b/d33/d3d/l48 0 2023-12-16T03:15:51.777 INFO:tasks.workunit.client.1.smithi184.stdout:8/155: sync 2023-12-16T03:15:51.778 INFO:tasks.workunit.client.1.smithi184.stdout:5/57: sync 2023-12-16T03:15:51.778 INFO:tasks.workunit.client.1.smithi184.stdout:5/58: chown d1/d3 2 1 2023-12-16T03:15:51.778 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:51 smithi184 ceph-mon[121180]: pgmap v190: 65 pgs: 65 active+clean; 309 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 635 op/s 2023-12-16T03:15:51.785 INFO:tasks.workunit.client.1.smithi184.stdout:0/307: dread dc/d10/d2d/f4a [0,4194304] 0 2023-12-16T03:15:51.788 INFO:tasks.workunit.client.1.smithi184.stdout:8/156: dread d2/d4/d10/d11/f15 [0,4194304] 0 2023-12-16T03:15:51.790 INFO:tasks.workunit.client.1.smithi184.stdout:5/59: rename d1/d3/lf to d1/d3/l14 0 2023-12-16T03:15:51.791 INFO:tasks.workunit.client.1.smithi184.stdout:1/301: rmdir d3/d34/d39 39 2023-12-16T03:15:51.791 INFO:tasks.workunit.client.1.smithi184.stdout:7/225: symlink d0/df/d32/d39/l44 0 2023-12-16T03:15:51.791 INFO:tasks.workunit.client.1.smithi184.stdout:6/253: dread d0/d5/d26/f38 [0,4194304] 0 2023-12-16T03:15:51.793 INFO:tasks.workunit.client.1.smithi184.stdout:0/308: stat dc/l57 0 2023-12-16T03:15:51.793 INFO:tasks.workunit.client.1.smithi184.stdout:5/60: getdents d1/d3/d9 0 2023-12-16T03:15:51.794 INFO:tasks.workunit.client.1.smithi184.stdout:5/61: fdatasync d1/d3/fc 0 2023-12-16T03:15:51.797 INFO:tasks.workunit.client.1.smithi184.stdout:6/254: unlink d0/d5/d22/d37/c39 0 2023-12-16T03:15:51.797 INFO:tasks.workunit.client.1.smithi184.stdout:6/255: dread - d0/d5/d22/f3c zero size 2023-12-16T03:15:51.797 INFO:tasks.workunit.client.1.smithi184.stdout:6/256: write d0/f18 [1909847,3612] 0 2023-12-16T03:15:51.802 INFO:tasks.workunit.client.1.smithi184.stdout:9/259: dwrite d0/f36 [0,4194304] 0 2023-12-16T03:15:51.805 INFO:tasks.workunit.client.1.smithi184.stdout:9/260: creat d0/d13/d20/f55 x:0 0 0 2023-12-16T03:15:51.805 INFO:tasks.workunit.client.1.smithi184.stdout:9/261: fdatasync d0/d13/f2a 0 2023-12-16T03:15:51.811 INFO:tasks.workunit.client.1.smithi184.stdout:9/262: getdents d0 0 2023-12-16T03:15:51.812 INFO:tasks.workunit.client.1.smithi184.stdout:9/263: creat d0/d13/d20/d38/f56 x:0 0 0 2023-12-16T03:15:51.812 INFO:tasks.workunit.client.1.smithi184.stdout:9/264: creat d0/f57 x:0 0 0 2023-12-16T03:15:51.812 INFO:tasks.workunit.client.1.smithi184.stdout:9/265: write d0/d30/d31/f54 [34234,44363] 0 2023-12-16T03:15:51.812 INFO:tasks.workunit.client.1.smithi184.stdout:9/266: chown d0/d13/f3f 2213190 1 2023-12-16T03:15:51.812 INFO:tasks.workunit.client.1.smithi184.stdout:9/267: write d0/d13/d20/f29 [2732445,23305] 0 2023-12-16T03:15:51.815 INFO:tasks.workunit.client.1.smithi184.stdout:8/157: dread d2/d4/d10/d11/f1d [0,4194304] 0 2023-12-16T03:15:51.818 INFO:tasks.workunit.client.1.smithi184.stdout:8/158: mkdir d2/d12/d21/d2d/d31 0 2023-12-16T03:15:51.821 INFO:tasks.workunit.client.1.smithi184.stdout:8/159: rename d2/d4/d10/c24 to d2/d4/d10/d2a/c32 0 2023-12-16T03:15:51.828 INFO:tasks.workunit.client.1.smithi184.stdout:7/226: dwrite d0/df/d1e/f41 [0,4194304] 0 2023-12-16T03:15:51.828 INFO:tasks.workunit.client.1.smithi184.stdout:8/160: truncate d2/d4/d10/d11/f15 2860831 0 2023-12-16T03:15:51.828 INFO:tasks.workunit.client.1.smithi184.stdout:8/161: fdatasync d2/d4/d10/d11/f29 0 2023-12-16T03:15:51.828 INFO:tasks.workunit.client.1.smithi184.stdout:8/162: chown d2/d4/d10/d11/f1d 15588 1 2023-12-16T03:15:51.828 INFO:tasks.workunit.client.1.smithi184.stdout:8/163: fdatasync d2/d4/f2e 0 2023-12-16T03:15:51.828 INFO:tasks.workunit.client.1.smithi184.stdout:8/164: fsync d2/fe 0 2023-12-16T03:15:51.831 INFO:tasks.workunit.client.1.smithi184.stdout:5/62: dwrite d1/d3/d11/f13 [0,4194304] 0 2023-12-16T03:15:51.832 INFO:tasks.workunit.client.1.smithi184.stdout:7/227: truncate d0/d3/f7 2312033 0 2023-12-16T03:15:51.833 INFO:tasks.workunit.client.1.smithi184.stdout:8/165: creat d2/f33 x:0 0 0 2023-12-16T03:15:51.834 INFO:tasks.workunit.client.1.smithi184.stdout:8/166: write d2/d4/f9 [269014,15605] 0 2023-12-16T03:15:51.834 INFO:tasks.workunit.client.1.smithi184.stdout:5/63: dread d1/d3/fc [0,4194304] 0 2023-12-16T03:15:51.836 INFO:tasks.workunit.client.1.smithi184.stdout:0/309: dwrite dc/d22/d1d/d43/f59 [0,4194304] 0 2023-12-16T03:15:51.836 INFO:tasks.workunit.client.1.smithi184.stdout:0/310: stat dc/d2a 0 2023-12-16T03:15:51.837 INFO:tasks.workunit.client.1.smithi184.stdout:0/311: write dc/d22/d53/f5e [235611,39563] 0 2023-12-16T03:15:51.839 INFO:tasks.workunit.client.1.smithi184.stdout:0/312: mknod dc/d10/d2d/c61 0 2023-12-16T03:15:51.842 INFO:tasks.workunit.client.1.smithi184.stdout:7/228: dread d0/d3/d4/f25 [0,4194304] 0 2023-12-16T03:15:51.842 INFO:tasks.workunit.client.1.smithi184.stdout:7/229: chown d0/df/dd/c14 54064 1 2023-12-16T03:15:51.842 INFO:tasks.workunit.client.1.smithi184.stdout:7/230: chown d0/c6 13933 1 2023-12-16T03:15:51.842 INFO:tasks.workunit.client.1.smithi184.stdout:7/231: chown d0/df/dd/le 133134685 1 2023-12-16T03:15:51.842 INFO:tasks.workunit.client.1.smithi184.stdout:7/232: write d0/d3/d4/f3d [1648923,19316] 0 2023-12-16T03:15:51.844 INFO:tasks.workunit.client.1.smithi184.stdout:7/233: mknod d0/c45 0 2023-12-16T03:15:51.844 INFO:tasks.workunit.client.1.smithi184.stdout:7/234: readlink d0/df/d32/d39/l44 0 2023-12-16T03:15:51.847 INFO:tasks.workunit.client.1.smithi184.stdout:6/257: dwrite d0/d5/d12/f1c [0,4194304] 0 2023-12-16T03:15:51.854 INFO:tasks.workunit.client.1.smithi184.stdout:6/258: rename d0/d5/d12/f16 to d0/d5/d22/f49 0 2023-12-16T03:15:51.855 INFO:tasks.workunit.client.1.smithi184.stdout:7/235: dread d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:51.856 INFO:tasks.workunit.client.1.smithi184.stdout:6/259: rmdir d0/d5/d22/d25 39 2023-12-16T03:15:51.859 INFO:tasks.workunit.client.1.smithi184.stdout:9/268: dwrite d0/d13/f2a [0,4194304] 0 2023-12-16T03:15:51.859 INFO:tasks.workunit.client.1.smithi184.stdout:9/269: write d0/f14 [1072482,91950] 0 2023-12-16T03:15:51.863 INFO:tasks.workunit.client.1.smithi184.stdout:8/167: dread d2/d4/f9 [0,4194304] 0 2023-12-16T03:15:51.863 INFO:tasks.workunit.client.1.smithi184.stdout:8/168: fdatasync d2/d4/d10/d11/f15 0 2023-12-16T03:15:51.863 INFO:tasks.workunit.client.1.smithi184.stdout:8/169: readlink d2/d4/l23 0 2023-12-16T03:15:51.863 INFO:tasks.workunit.client.1.smithi184.stdout:8/170: truncate d2/fc 1515958 0 2023-12-16T03:15:51.863 INFO:tasks.workunit.client.1.smithi184.stdout:5/64: dwrite d1/d3/fd [0,4194304] 0 2023-12-16T03:15:51.863 INFO:tasks.workunit.client.1.smithi184.stdout:5/65: write d1/d3/fa [116470,54229] 0 2023-12-16T03:15:51.864 INFO:tasks.workunit.client.1.smithi184.stdout:8/171: mkdir d2/d12/d21/d2d/d31/d34 0 2023-12-16T03:15:51.865 INFO:tasks.workunit.client.1.smithi184.stdout:9/270: write d0/d13/f21 [2723230,89540] 0 2023-12-16T03:15:51.865 INFO:tasks.workunit.client.1.smithi184.stdout:0/313: dwrite dc/f19 [0,4194304] 0 2023-12-16T03:15:51.868 INFO:tasks.workunit.client.1.smithi184.stdout:8/172: creat d2/d12/d21/d30/f35 x:0 0 0 2023-12-16T03:15:51.868 INFO:tasks.workunit.client.1.smithi184.stdout:8/173: chown d2/l1b 1874 1 2023-12-16T03:15:51.869 INFO:tasks.workunit.client.1.smithi184.stdout:6/260: dread d0/d5/d12/f1c [0,4194304] 0 2023-12-16T03:15:51.869 INFO:tasks.workunit.client.1.smithi184.stdout:5/66: write d1/d3/d11/f13 [569053,74348] 0 2023-12-16T03:15:51.869 INFO:tasks.workunit.client.1.smithi184.stdout:9/271: write d0/d13/f3f [685573,100848] 0 2023-12-16T03:15:51.870 INFO:tasks.workunit.client.1.smithi184.stdout:0/314: mknod dc/d22/c62 0 2023-12-16T03:15:51.870 INFO:tasks.workunit.client.1.smithi184.stdout:0/315: chown dc/d22/d1d/d43 6686 1 2023-12-16T03:15:51.871 INFO:tasks.workunit.client.1.smithi184.stdout:9/272: creat d0/d13/d20/d38/d53/f58 x:0 0 0 2023-12-16T03:15:51.872 INFO:tasks.workunit.client.1.smithi184.stdout:9/273: read d0/d30/f44 [3417408,84333] 0 2023-12-16T03:15:51.873 INFO:tasks.workunit.client.1.smithi184.stdout:5/67: unlink d1/l7 0 2023-12-16T03:15:51.874 INFO:tasks.workunit.client.1.smithi184.stdout:7/236: dwrite d0/d3/d4/f2c [0,4194304] 0 2023-12-16T03:15:51.877 INFO:tasks.workunit.client.1.smithi184.stdout:9/274: truncate d0/f1d 621296 0 2023-12-16T03:15:51.877 INFO:tasks.workunit.client.1.smithi184.stdout:9/275: chown d0/f14 191 1 2023-12-16T03:15:51.882 INFO:tasks.workunit.client.1.smithi184.stdout:8/174: write d2/d4/d10/d11/f1d [3238533,21819] 0 2023-12-16T03:15:51.888 INFO:tasks.workunit.client.1.smithi184.stdout:9/276: creat d0/d3a/f59 x:0 0 0 2023-12-16T03:15:51.888 INFO:tasks.workunit.client.1.smithi184.stdout:8/175: mknod d2/d4/d10/d11/c36 0 2023-12-16T03:15:51.888 INFO:tasks.workunit.client.1.smithi184.stdout:8/176: readlink d2/l3 0 2023-12-16T03:15:51.888 INFO:tasks.workunit.client.1.smithi184.stdout:9/277: truncate d0/f1c 4617272 0 2023-12-16T03:15:51.888 INFO:tasks.workunit.client.1.smithi184.stdout:8/177: chown d2/d4/d10/c22 64801483 1 2023-12-16T03:15:51.889 INFO:tasks.workunit.client.1.smithi184.stdout:9/278: symlink d0/d13/d20/d38/d43/l5a 0 2023-12-16T03:15:51.889 INFO:tasks.workunit.client.1.smithi184.stdout:9/279: dread - d0/d13/d20/d38/f52 zero size 2023-12-16T03:15:51.892 INFO:tasks.workunit.client.1.smithi184.stdout:6/261: dwrite d0/d5/d22/f41 [0,4194304] 0 2023-12-16T03:15:51.892 INFO:tasks.workunit.client.1.smithi184.stdout:6/262: chown d0/d5/d22/l11 1426 1 2023-12-16T03:15:51.893 INFO:tasks.workunit.client.1.smithi184.stdout:8/178: mkdir d2/d37 0 2023-12-16T03:15:51.893 INFO:tasks.workunit.client.1.smithi184.stdout:8/179: chown d2/d37 18 1 2023-12-16T03:15:51.894 INFO:tasks.workunit.client.1.smithi184.stdout:6/263: creat d0/d5/f4a x:0 0 0 2023-12-16T03:15:51.895 INFO:tasks.workunit.client.1.smithi184.stdout:8/180: write d2/d4/d10/d11/f15 [882152,79788] 0 2023-12-16T03:15:51.895 INFO:tasks.workunit.client.1.smithi184.stdout:6/264: mknod d0/d5/c4b 0 2023-12-16T03:15:51.896 INFO:tasks.workunit.client.1.smithi184.stdout:8/181: creat d2/d12/f38 x:0 0 0 2023-12-16T03:15:51.897 INFO:tasks.workunit.client.1.smithi184.stdout:7/237: dwrite d0/d3/f5 [4194304,4194304] 0 2023-12-16T03:15:51.897 INFO:tasks.workunit.client.1.smithi184.stdout:6/265: rename d0/d36/f3b to d0/d5/d12/d1b/f4c 0 2023-12-16T03:15:51.898 INFO:tasks.workunit.client.1.smithi184.stdout:6/266: write d0/d5/d12/f1c [217383,11061] 0 2023-12-16T03:15:51.900 INFO:tasks.workunit.client.1.smithi184.stdout:8/182: mknod d2/d4/d10/d2a/c39 0 2023-12-16T03:15:51.901 INFO:tasks.workunit.client.1.smithi184.stdout:7/238: rename d0/df/dd/d27/f2b to d0/df/dd/f46 0 2023-12-16T03:15:51.901 INFO:tasks.workunit.client.1.smithi184.stdout:7/239: stat d0/d3/f5 0 2023-12-16T03:15:51.903 INFO:tasks.workunit.client.1.smithi184.stdout:7/240: dread d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:51.903 INFO:tasks.workunit.client.1.smithi184.stdout:0/316: dwrite dc/d10/d1c/f49 [0,4194304] 0 2023-12-16T03:15:51.906 INFO:tasks.workunit.client.1.smithi184.stdout:8/183: creat d2/d12/d21/d2d/d31/f3a x:0 0 0 2023-12-16T03:15:51.906 INFO:tasks.workunit.client.1.smithi184.stdout:8/184: stat d2/d12/d21/d2d/d31/f3a 0 2023-12-16T03:15:51.906 INFO:tasks.workunit.client.1.smithi184.stdout:8/185: dread - d2/d4/f2e zero size 2023-12-16T03:15:51.906 INFO:tasks.workunit.client.1.smithi184.stdout:8/186: write d2/d4/d10/d11/f29 [122729,67755] 0 2023-12-16T03:15:51.907 INFO:tasks.workunit.client.1.smithi184.stdout:0/317: write dc/d22/d1d/f40 [3997096,37289] 0 2023-12-16T03:15:51.909 INFO:tasks.workunit.client.1.smithi184.stdout:8/187: write d2/f28 [849392,25747] 0 2023-12-16T03:15:51.909 INFO:tasks.workunit.client.1.smithi184.stdout:8/188: chown d2/d4/d10/d11/f29 871669 1 2023-12-16T03:15:51.909 INFO:tasks.workunit.client.1.smithi184.stdout:7/241: mkdir d0/d3/d2e/d47 0 2023-12-16T03:15:51.909 INFO:tasks.workunit.client.1.smithi184.stdout:2/169: sync 2023-12-16T03:15:51.912 INFO:tasks.workunit.client.1.smithi184.stdout:9/280: rename d0/d13/d20/d38 to d0/d13/d20/d5b 0 2023-12-16T03:15:51.912 INFO:tasks.workunit.client.1.smithi184.stdout:0/318: rmdir dc/d22/d48 39 2023-12-16T03:15:51.913 INFO:tasks.workunit.client.1.smithi184.stdout:8/189: creat d2/d4/d10/d11/f3b x:0 0 0 2023-12-16T03:15:51.913 INFO:tasks.workunit.client.1.smithi184.stdout:7/242: creat d0/df/d32/d39/f48 x:0 0 0 2023-12-16T03:15:51.914 INFO:tasks.workunit.client.1.smithi184.stdout:9/281: symlink d0/d13/l5c 0 2023-12-16T03:15:51.917 INFO:tasks.workunit.client.1.smithi184.stdout:0/319: rename dc/d10/d2d/f4a to dc/d22/d46/f63 0 2023-12-16T03:15:51.918 INFO:tasks.workunit.client.1.smithi184.stdout:6/267: dwrite d0/d5/d26/f38 [0,4194304] 0 2023-12-16T03:15:51.918 INFO:tasks.workunit.client.1.smithi184.stdout:6/268: fsync d0/d5/d12/f32 0 2023-12-16T03:15:51.918 INFO:tasks.workunit.client.1.smithi184.stdout:8/190: link d2/d4/d10/d11/l1c d2/d12/l3c 0 2023-12-16T03:15:51.918 INFO:tasks.workunit.client.1.smithi184.stdout:7/243: mkdir d0/df/d36/d3f/d49 0 2023-12-16T03:15:51.918 INFO:tasks.workunit.client.1.smithi184.stdout:7/244: dread - d0/df/d1e/f42 zero size 2023-12-16T03:15:51.920 INFO:tasks.workunit.client.1.smithi184.stdout:9/282: mkdir d0/d13/d40/d5d 0 2023-12-16T03:15:51.922 INFO:tasks.workunit.client.1.smithi184.stdout:6/269: mkdir d0/d5/d22/d37/d4d 0 2023-12-16T03:15:51.922 INFO:tasks.workunit.client.1.smithi184.stdout:8/191: creat d2/d4/d10/d11/f3d x:0 0 0 2023-12-16T03:15:51.927 INFO:tasks.workunit.client.1.smithi184.stdout:9/283: unlink d0/f1d 0 2023-12-16T03:15:51.928 INFO:tasks.workunit.client.1.smithi184.stdout:2/170: dread d3/f4 [0,4194304] 0 2023-12-16T03:15:51.929 INFO:tasks.workunit.client.1.smithi184.stdout:6/270: unlink d0/d5/d26/c30 0 2023-12-16T03:15:51.930 INFO:tasks.workunit.client.1.smithi184.stdout:8/192: getdents d2/d12/d21/d2d/d31 0 2023-12-16T03:15:51.930 INFO:tasks.workunit.client.1.smithi184.stdout:8/193: dread - d2/d4/d10/d11/f3d zero size 2023-12-16T03:15:51.931 INFO:tasks.workunit.client.1.smithi184.stdout:9/284: getdents d0/d30 0 2023-12-16T03:15:51.931 INFO:tasks.workunit.client.1.smithi184.stdout:9/285: fdatasync d0/d13/d20/f28 0 2023-12-16T03:15:51.932 INFO:tasks.workunit.client.1.smithi184.stdout:0/320: dread dc/f42 [0,4194304] 0 2023-12-16T03:15:51.932 INFO:tasks.workunit.client.1.smithi184.stdout:2/171: write d3/d29/d2f/f22 [678322,101705] 0 2023-12-16T03:15:51.933 INFO:tasks.workunit.client.1.smithi184.stdout:9/286: write d0/fe [3779778,2706] 0 2023-12-16T03:15:51.933 INFO:tasks.workunit.client.1.smithi184.stdout:6/271: fdatasync d0/d5/d12/f1c 0 2023-12-16T03:15:51.941 INFO:tasks.workunit.client.1.smithi184.stdout:0/321: dread dc/d10/f14 [0,4194304] 0 2023-12-16T03:15:51.941 INFO:tasks.workunit.client.1.smithi184.stdout:9/287: read d0/d13/f3f [512108,84334] 0 2023-12-16T03:15:51.941 INFO:tasks.workunit.client.1.smithi184.stdout:7/245: dwrite d0/df/d1e/f20 [4194304,4194304] 0 2023-12-16T03:15:51.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:51 smithi064 ceph-mon[111958]: pgmap v190: 65 pgs: 65 active+clean; 309 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 635 op/s 2023-12-16T03:15:51.943 INFO:tasks.workunit.client.1.smithi184.stdout:8/194: mknod d2/d12/d21/d2d/c3e 0 2023-12-16T03:15:51.943 INFO:tasks.workunit.client.1.smithi184.stdout:8/195: stat d2/f13 0 2023-12-16T03:15:51.943 INFO:tasks.workunit.client.1.smithi184.stdout:6/272: creat d0/d5/d12/d1b/d33/f4e x:0 0 0 2023-12-16T03:15:51.944 INFO:tasks.workunit.client.1.smithi184.stdout:6/273: fsync d0/d5/d22/fa 0 2023-12-16T03:15:51.946 INFO:tasks.workunit.client.1.smithi184.stdout:6/274: dread d0/d5/d12/f32 [0,4194304] 0 2023-12-16T03:15:51.946 INFO:tasks.workunit.client.1.smithi184.stdout:6/275: chown d0/d5/c4b 2006979587 1 2023-12-16T03:15:51.946 INFO:tasks.workunit.client.1.smithi184.stdout:6/276: truncate d0/d5/d22/f29 1044345 0 2023-12-16T03:15:51.946 INFO:tasks.workunit.client.1.smithi184.stdout:0/322: unlink dc/d22/d48/l4e 0 2023-12-16T03:15:51.947 INFO:tasks.workunit.client.1.smithi184.stdout:9/288: link d0/c26 d0/d30/d31/c5e 0 2023-12-16T03:15:51.947 INFO:tasks.workunit.client.1.smithi184.stdout:7/246: stat d0/df/d1e/l3c 0 2023-12-16T03:15:51.950 INFO:tasks.workunit.client.1.smithi184.stdout:7/247: dread d0/d3/d4/f25 [0,4194304] 0 2023-12-16T03:15:51.950 INFO:tasks.workunit.client.1.smithi184.stdout:7/248: truncate d0/df/d1e/f2d 349314 0 2023-12-16T03:15:51.950 INFO:tasks.workunit.client.1.smithi184.stdout:7/249: dread - d0/df/d32/d39/f48 zero size 2023-12-16T03:15:51.952 INFO:tasks.workunit.client.1.smithi184.stdout:8/196: creat d2/d4/d10/d11/f3f x:0 0 0 2023-12-16T03:15:51.952 INFO:tasks.workunit.client.1.smithi184.stdout:8/197: fdatasync d2/d4/f2e 0 2023-12-16T03:15:51.953 INFO:tasks.workunit.client.1.smithi184.stdout:8/198: chown d2/f13 7478423 1 2023-12-16T03:15:51.954 INFO:tasks.workunit.client.1.smithi184.stdout:6/277: rename d0/d5/d12/d1b/d33/d3d/l48 to d0/d5/d22/l4f 0 2023-12-16T03:15:51.955 INFO:tasks.workunit.client.1.smithi184.stdout:0/323: symlink dc/d22/d1d/d2c/l64 0 2023-12-16T03:15:51.956 INFO:tasks.workunit.client.1.smithi184.stdout:2/172: dread d3/d13/f18 [0,4194304] 0 2023-12-16T03:15:51.959 INFO:tasks.workunit.client.1.smithi184.stdout:9/289: rename d0/d13/c1b to d0/d13/d20/d5b/d53/c5f 0 2023-12-16T03:15:51.960 INFO:tasks.workunit.client.1.smithi184.stdout:6/278: unlink d0/d5/d22/d34/c3a 0 2023-12-16T03:15:51.960 INFO:tasks.workunit.client.1.smithi184.stdout:6/279: write d0/d5/d12/d1b/f2f [1311917,62489] 0 2023-12-16T03:15:51.963 INFO:tasks.workunit.client.1.smithi184.stdout:0/324: creat dc/d22/d1d/d35/f65 x:0 0 0 2023-12-16T03:15:51.964 INFO:tasks.workunit.client.1.smithi184.stdout:0/325: chown dc/d22/d46 1 1 2023-12-16T03:15:51.964 INFO:tasks.workunit.client.1.smithi184.stdout:0/326: readlink dc/d22/d1d/d2c/l30 0 2023-12-16T03:15:51.964 INFO:tasks.workunit.client.1.smithi184.stdout:0/327: write dc/d22/d48/f5b [4781123,118799] 0 2023-12-16T03:15:51.965 INFO:tasks.workunit.client.1.smithi184.stdout:0/328: rmdir dc/d10/d2d 39 2023-12-16T03:15:51.966 INFO:tasks.workunit.client.1.smithi184.stdout:9/290: dread d0/f14 [0,4194304] 0 2023-12-16T03:15:51.967 INFO:tasks.workunit.client.1.smithi184.stdout:6/280: symlink d0/d5/d12/l50 0 2023-12-16T03:15:51.967 INFO:tasks.workunit.client.1.smithi184.stdout:0/329: mkdir dc/d22/d45/d66 0 2023-12-16T03:15:51.970 INFO:tasks.workunit.client.1.smithi184.stdout:9/291: unlink d0/d13/d20/f32 0 2023-12-16T03:15:51.971 INFO:tasks.workunit.client.1.smithi184.stdout:0/330: creat dc/d22/d46/f67 x:0 0 0 2023-12-16T03:15:51.974 INFO:tasks.workunit.client.1.smithi184.stdout:0/331: creat dc/f68 x:0 0 0 2023-12-16T03:15:51.976 INFO:tasks.workunit.client.1.smithi184.stdout:6/281: dread d0/d5/d22/d25/f2b [0,4194304] 0 2023-12-16T03:15:51.976 INFO:tasks.workunit.client.1.smithi184.stdout:7/250: dwrite d0/df/dd/f1d [4194304,4194304] 0 2023-12-16T03:15:51.976 INFO:tasks.workunit.client.1.smithi184.stdout:7/251: chown d0/d3/d4/f3d 256586705 1 2023-12-16T03:15:51.977 INFO:tasks.workunit.client.1.smithi184.stdout:9/292: dread d0/d13/d20/f29 [0,4194304] 0 2023-12-16T03:15:51.983 INFO:tasks.workunit.client.1.smithi184.stdout:7/252: symlink d0/d3/d2e/d47/l4a 0 2023-12-16T03:15:51.988 INFO:tasks.workunit.client.1.smithi184.stdout:8/199: dwrite d2/fe [0,4194304] 0 2023-12-16T03:15:51.989 INFO:tasks.workunit.client.1.smithi184.stdout:7/253: dread d0/d3/f1a [0,4194304] 0 2023-12-16T03:15:51.989 INFO:tasks.workunit.client.1.smithi184.stdout:8/200: creat d2/d4/f40 x:0 0 0 2023-12-16T03:15:51.993 INFO:tasks.workunit.client.1.smithi184.stdout:7/254: symlink d0/df/d32/l4b 0 2023-12-16T03:15:51.993 INFO:tasks.workunit.client.1.smithi184.stdout:8/201: symlink d2/d12/d21/l41 0 2023-12-16T03:15:51.993 INFO:tasks.workunit.client.1.smithi184.stdout:8/202: write d2/f33 [514949,68929] 0 2023-12-16T03:15:51.993 INFO:tasks.workunit.client.1.smithi184.stdout:8/203: write d2/d4/d10/d11/f3b [64150,98952] 0 2023-12-16T03:15:51.993 INFO:tasks.workunit.client.1.smithi184.stdout:7/255: symlink d0/d3/d4/l4c 0 2023-12-16T03:15:51.994 INFO:tasks.workunit.client.1.smithi184.stdout:7/256: readlink d0/d3/d2e/d47/l4a 0 2023-12-16T03:15:51.994 INFO:tasks.workunit.client.1.smithi184.stdout:7/257: chown d0/df/dd/f1d 0 1 2023-12-16T03:15:51.994 INFO:tasks.workunit.client.1.smithi184.stdout:8/204: creat d2/d12/d21/d30/f42 x:0 0 0 2023-12-16T03:15:51.994 INFO:tasks.workunit.client.1.smithi184.stdout:7/258: creat d0/df/f4d x:0 0 0 2023-12-16T03:15:51.998 INFO:tasks.workunit.client.1.smithi184.stdout:0/332: dwrite dc/f19 [0,4194304] 0 2023-12-16T03:15:51.998 INFO:tasks.workunit.client.1.smithi184.stdout:0/333: truncate dc/d22/d53/f5e 960765 0 2023-12-16T03:15:52.000 INFO:tasks.workunit.client.1.smithi184.stdout:0/334: rename f4 to dc/d22/d1d/d43/d5a/f69 0 2023-12-16T03:15:52.000 INFO:tasks.workunit.client.1.smithi184.stdout:0/335: fdatasync dc/d10/f25 0 2023-12-16T03:15:52.001 INFO:tasks.workunit.client.1.smithi184.stdout:0/336: read - dc/f68 zero size 2023-12-16T03:15:52.004 INFO:tasks.workunit.client.1.smithi184.stdout:0/337: creat dc/d22/d1d/d43/d5a/f6a x:0 0 0 2023-12-16T03:15:52.006 INFO:tasks.workunit.client.1.smithi184.stdout:9/293: dwrite d0/d13/d20/d5b/f56 [0,4194304] 0 2023-12-16T03:15:52.006 INFO:tasks.workunit.client.1.smithi184.stdout:8/205: dread d2/f33 [0,4194304] 0 2023-12-16T03:15:52.015 INFO:tasks.workunit.client.1.smithi184.stdout:7/259: dwrite d0/d3/d4/f2c [0,4194304] 0 2023-12-16T03:15:52.017 INFO:tasks.workunit.client.1.smithi184.stdout:7/260: link d0/d3/d4/f2c d0/df/d36/f4e 0 2023-12-16T03:15:52.017 INFO:tasks.workunit.client.1.smithi184.stdout:7/261: stat d0/d3/f1a 0 2023-12-16T03:15:52.022 INFO:tasks.workunit.client.1.smithi184.stdout:7/262: rename d0/d3/d4/f3d to d0/df/d36/d3f/f4f 0 2023-12-16T03:15:52.026 INFO:tasks.workunit.client.1.smithi184.stdout:7/263: dread d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:52.026 INFO:tasks.workunit.client.1.smithi184.stdout:8/206: dread d2/d4/d10/f14 [0,4194304] 0 2023-12-16T03:15:52.029 INFO:tasks.workunit.client.1.smithi184.stdout:8/207: rename d2/c2c to d2/d12/d21/d2d/d31/d34/c43 0 2023-12-16T03:15:52.032 INFO:tasks.workunit.client.1.smithi184.stdout:0/338: dwrite dc/d22/d1a/f3e [4194304,4194304] 0 2023-12-16T03:15:52.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/294: dwrite d0/f14 [0,4194304] 0 2023-12-16T03:15:52.033 INFO:tasks.workunit.client.1.smithi184.stdout:8/208: write d2/f28 [1180071,89925] 0 2023-12-16T03:15:52.034 INFO:tasks.workunit.client.1.smithi184.stdout:0/339: creat dc/d10/d2d/f6b x:0 0 0 2023-12-16T03:15:52.037 INFO:tasks.workunit.client.1.smithi184.stdout:8/209: link d2/d12/d21/d30/f35 d2/d4/f44 0 2023-12-16T03:15:52.038 INFO:tasks.workunit.client.1.smithi184.stdout:8/210: symlink d2/d4/l45 0 2023-12-16T03:15:52.039 INFO:tasks.workunit.client.1.smithi184.stdout:8/211: getdents d2/d12/d21/d30 0 2023-12-16T03:15:52.039 INFO:tasks.workunit.client.1.smithi184.stdout:0/340: dread dc/f42 [0,4194304] 0 2023-12-16T03:15:52.040 INFO:tasks.workunit.client.1.smithi184.stdout:8/212: symlink d2/d4/d10/d11/l46 0 2023-12-16T03:15:52.040 INFO:tasks.workunit.client.1.smithi184.stdout:8/213: readlink d2/l1a 0 2023-12-16T03:15:52.040 INFO:tasks.workunit.client.1.smithi184.stdout:8/214: dread - d2/d4/d10/d11/f3f zero size 2023-12-16T03:15:52.041 INFO:tasks.workunit.client.1.smithi184.stdout:8/215: truncate d2/d4/d10/f17 123885 0 2023-12-16T03:15:52.042 INFO:tasks.workunit.client.1.smithi184.stdout:0/341: creat dc/d10/f6c x:0 0 0 2023-12-16T03:15:52.044 INFO:tasks.workunit.client.1.smithi184.stdout:9/295: dread d0/d30/f41 [0,4194304] 0 2023-12-16T03:15:52.044 INFO:tasks.workunit.client.1.smithi184.stdout:0/342: creat dc/d22/d48/f6d x:0 0 0 2023-12-16T03:15:52.044 INFO:tasks.workunit.client.1.smithi184.stdout:0/343: chown dc/f68 3273 1 2023-12-16T03:15:52.044 INFO:tasks.workunit.client.1.smithi184.stdout:0/344: write dc/f12 [4588970,45370] 0 2023-12-16T03:15:52.045 INFO:tasks.workunit.client.1.smithi184.stdout:8/216: unlink d2/d12/d21/d2d/c3e 0 2023-12-16T03:15:52.047 INFO:tasks.workunit.client.1.smithi184.stdout:7/264: dwrite d0/df/dd/f1d [4194304,4194304] 0 2023-12-16T03:15:52.047 INFO:tasks.workunit.client.1.smithi184.stdout:8/217: symlink d2/d12/d21/d2d/l47 0 2023-12-16T03:15:52.048 INFO:tasks.workunit.client.1.smithi184.stdout:8/218: read d2/d4/d10/d11/f1d [3146640,67469] 0 2023-12-16T03:15:52.049 INFO:tasks.workunit.client.1.smithi184.stdout:8/219: fsync d2/d4/f40 0 2023-12-16T03:15:52.051 INFO:tasks.workunit.client.1.smithi184.stdout:7/265: unlink d0/df/d1e/f41 0 2023-12-16T03:15:52.053 INFO:tasks.workunit.client.1.smithi184.stdout:8/220: mknod d2/d4/c48 0 2023-12-16T03:15:52.055 INFO:tasks.workunit.client.1.smithi184.stdout:8/221: symlink d2/d12/d21/d30/l49 0 2023-12-16T03:15:52.071 INFO:tasks.workunit.client.1.smithi184.stdout:0/345: dwrite dc/d22/d1d/d43/d5a/f69 [0,4194304] 0 2023-12-16T03:15:52.072 INFO:tasks.workunit.client.1.smithi184.stdout:8/222: dread d2/d4/d10/f17 [0,4194304] 0 2023-12-16T03:15:52.072 INFO:tasks.workunit.client.1.smithi184.stdout:8/223: truncate d2/fe 4222463 0 2023-12-16T03:15:52.072 INFO:tasks.workunit.client.1.smithi184.stdout:8/224: write d2/d4/d10/d11/f3f [903156,19366] 0 2023-12-16T03:15:52.072 INFO:tasks.workunit.client.1.smithi184.stdout:0/346: unlink dc/d22/d46/f63 0 2023-12-16T03:15:52.073 INFO:tasks.workunit.client.1.smithi184.stdout:8/225: mknod d2/d37/c4a 0 2023-12-16T03:15:52.074 INFO:tasks.workunit.client.1.smithi184.stdout:0/347: link dc/d10/d1c/f2f dc/d22/d46/f6e 0 2023-12-16T03:15:52.075 INFO:tasks.workunit.client.1.smithi184.stdout:0/348: creat dc/d22/d1a/f6f x:0 0 0 2023-12-16T03:15:52.076 INFO:tasks.workunit.client.1.smithi184.stdout:0/349: mkdir dc/d22/d1d/d70 0 2023-12-16T03:15:52.077 INFO:tasks.workunit.client.1.smithi184.stdout:0/350: symlink dc/l71 0 2023-12-16T03:15:52.083 INFO:tasks.workunit.client.1.smithi184.stdout:9/296: dwrite d0/d13/f24 [0,4194304] 0 2023-12-16T03:15:52.085 INFO:tasks.workunit.client.1.smithi184.stdout:9/297: unlink d0/c2d 0 2023-12-16T03:15:52.085 INFO:tasks.workunit.client.1.smithi184.stdout:9/298: chown d0/d3a/d47 34 1 2023-12-16T03:15:52.087 INFO:tasks.workunit.client.1.smithi184.stdout:7/266: dwrite d0/df/dd/f46 [0,4194304] 0 2023-12-16T03:15:52.089 INFO:tasks.workunit.client.1.smithi184.stdout:9/299: symlink d0/d13/d20/d5b/d43/l60 0 2023-12-16T03:15:52.089 INFO:tasks.workunit.client.1.smithi184.stdout:9/300: dread - d0/d13/d20/f55 zero size 2023-12-16T03:15:52.090 INFO:tasks.workunit.client.1.smithi184.stdout:7/267: creat d0/f50 x:0 0 0 2023-12-16T03:15:52.090 INFO:tasks.workunit.client.1.smithi184.stdout:7/268: write d0/df/dd/f46 [4475098,129077] 0 2023-12-16T03:15:52.090 INFO:tasks.workunit.client.1.smithi184.stdout:7/269: chown d0/df/dd/c14 978371 1 2023-12-16T03:15:52.092 INFO:tasks.workunit.client.1.smithi184.stdout:9/301: rename d0/d13/d20/d5b/d53/c5f to d0/d3a/c61 0 2023-12-16T03:15:52.092 INFO:tasks.workunit.client.1.smithi184.stdout:9/302: readlink d0/lf 0 2023-12-16T03:15:52.092 INFO:tasks.workunit.client.1.smithi184.stdout:9/303: chown d0/d13/d20/d5b/f56 811356969 1 2023-12-16T03:15:52.092 INFO:tasks.workunit.client.1.smithi184.stdout:9/304: write d0/d13/d20/f55 [297186,91096] 0 2023-12-16T03:15:52.092 INFO:tasks.workunit.client.1.smithi184.stdout:9/305: fdatasync d0/d3a/f59 0 2023-12-16T03:15:52.092 INFO:tasks.workunit.client.1.smithi184.stdout:7/270: mknod d0/d3/d2e/d3b/c51 0 2023-12-16T03:15:52.092 INFO:tasks.workunit.client.1.smithi184.stdout:7/271: dread - d0/f50 zero size 2023-12-16T03:15:52.094 INFO:tasks.workunit.client.1.smithi184.stdout:9/306: rename d0/cc to d0/d13/c62 0 2023-12-16T03:15:52.096 INFO:tasks.workunit.client.1.smithi184.stdout:7/272: link d0/df/dd/le d0/df/d1e/l52 0 2023-12-16T03:15:52.098 INFO:tasks.workunit.client.1.smithi184.stdout:0/351: dwrite dc/f68 [0,4194304] 0 2023-12-16T03:15:52.098 INFO:tasks.workunit.client.1.smithi184.stdout:7/273: dread d0/d3/d4/f25 [0,4194304] 0 2023-12-16T03:15:52.098 INFO:tasks.workunit.client.1.smithi184.stdout:7/274: truncate d0/df/f4d 137365 0 2023-12-16T03:15:52.098 INFO:tasks.workunit.client.1.smithi184.stdout:7/275: dread - d0/df/d32/d39/f3e zero size 2023-12-16T03:15:52.100 INFO:tasks.workunit.client.1.smithi184.stdout:0/352: truncate dc/d22/d1d/d35/f38 2681028 0 2023-12-16T03:15:52.101 INFO:tasks.workunit.client.1.smithi184.stdout:7/276: dread d0/df/d1e/f20 [0,4194304] 0 2023-12-16T03:15:52.101 INFO:tasks.workunit.client.1.smithi184.stdout:9/307: fdatasync d0/d13/d20/f55 0 2023-12-16T03:15:52.101 INFO:tasks.workunit.client.1.smithi184.stdout:9/308: write d0/f57 [662042,123142] 0 2023-12-16T03:15:52.102 INFO:tasks.workunit.client.1.smithi184.stdout:7/277: write d0/d3/f7 [639223,114763] 0 2023-12-16T03:15:52.102 INFO:tasks.workunit.client.1.smithi184.stdout:7/278: chown d0/f50 113616830 1 2023-12-16T03:15:52.102 INFO:tasks.workunit.client.1.smithi184.stdout:7/279: readlink d0/d3/d2e/d47/l4a 0 2023-12-16T03:15:52.103 INFO:tasks.workunit.client.1.smithi184.stdout:0/353: write dc/f68 [486851,22905] 0 2023-12-16T03:15:52.103 INFO:tasks.workunit.client.1.smithi184.stdout:9/309: rmdir d0/d13/d40/d5d 0 2023-12-16T03:15:52.103 INFO:tasks.workunit.client.1.smithi184.stdout:9/310: fsync d0/d13/d20/f55 0 2023-12-16T03:15:52.103 INFO:tasks.workunit.client.1.smithi184.stdout:8/226: dwrite d2/d4/d10/d11/f3d [0,4194304] 0 2023-12-16T03:15:52.106 INFO:tasks.workunit.client.1.smithi184.stdout:7/280: mknod d0/c53 0 2023-12-16T03:15:52.106 INFO:tasks.workunit.client.1.smithi184.stdout:0/354: write dc/d22/d48/f5b [2721878,47882] 0 2023-12-16T03:15:52.106 INFO:tasks.workunit.client.1.smithi184.stdout:0/355: write dc/d22/d1a/f3e [4281643,12166] 0 2023-12-16T03:15:52.106 INFO:tasks.workunit.client.1.smithi184.stdout:0/356: chown dc/d10/f14 4144 1 2023-12-16T03:15:52.106 INFO:tasks.workunit.client.1.smithi184.stdout:0/357: fsync dc/d22/d1d/d43/f55 0 2023-12-16T03:15:52.106 INFO:tasks.workunit.client.1.smithi184.stdout:0/358: chown dc/d2a/c32 6287358 1 2023-12-16T03:15:52.106 INFO:tasks.workunit.client.1.smithi184.stdout:0/359: write dc/d10/d2d/f50 [60589,125042] 0 2023-12-16T03:15:52.106 INFO:tasks.workunit.client.1.smithi184.stdout:9/311: mknod d0/d13/d20/d5b/d53/c63 0 2023-12-16T03:15:52.108 INFO:tasks.workunit.client.1.smithi184.stdout:8/227: symlink d2/l4b 0 2023-12-16T03:15:52.110 INFO:tasks.workunit.client.1.smithi184.stdout:8/228: write d2/d4/d10/d11/f3d [1948706,122627] 0 2023-12-16T03:15:52.112 INFO:tasks.workunit.client.1.smithi184.stdout:0/360: creat dc/d22/d45/d66/f72 x:0 0 0 2023-12-16T03:15:52.112 INFO:tasks.workunit.client.1.smithi184.stdout:0/361: chown dc/d10/d2d/f41 41 1 2023-12-16T03:15:52.112 INFO:tasks.workunit.client.1.smithi184.stdout:0/362: chown dc/f19 2701006 1 2023-12-16T03:15:52.114 INFO:tasks.workunit.client.1.smithi184.stdout:9/312: symlink d0/d3a/d47/l64 0 2023-12-16T03:15:52.118 INFO:tasks.workunit.client.1.smithi184.stdout:8/229: unlink d2/d12/d21/c27 0 2023-12-16T03:15:52.118 INFO:tasks.workunit.client.1.smithi184.stdout:8/230: write d2/d4/d10/d11/f3b [972598,1204] 0 2023-12-16T03:15:52.118 INFO:tasks.workunit.client.1.smithi184.stdout:0/363: mknod dc/d22/d1a/c73 0 2023-12-16T03:15:52.119 INFO:tasks.workunit.client.1.smithi184.stdout:9/313: creat d0/d13/d20/d5b/d53/f65 x:0 0 0 2023-12-16T03:15:52.119 INFO:tasks.workunit.client.1.smithi184.stdout:0/364: creat dc/d22/d1d/d2c/f74 x:0 0 0 2023-12-16T03:15:52.120 INFO:tasks.workunit.client.1.smithi184.stdout:8/231: write d2/fc [1431907,85670] 0 2023-12-16T03:15:52.120 INFO:tasks.workunit.client.1.smithi184.stdout:7/281: dwrite d0/f50 [0,4194304] 0 2023-12-16T03:15:52.125 INFO:tasks.workunit.client.1.smithi184.stdout:9/314: creat d0/d30/f66 x:0 0 0 2023-12-16T03:15:52.125 INFO:tasks.workunit.client.1.smithi184.stdout:0/365: rmdir dc/d22/d1d/d70 0 2023-12-16T03:15:52.125 INFO:tasks.workunit.client.1.smithi184.stdout:8/232: unlink d2/d37/c4a 0 2023-12-16T03:15:52.130 INFO:tasks.workunit.client.1.smithi184.stdout:9/315: rename d0/d13/d40/f42 to d0/d3a/d47/f67 0 2023-12-16T03:15:52.132 INFO:tasks.workunit.client.1.smithi184.stdout:0/366: mkdir dc/d22/d1d/d2c/d75 0 2023-12-16T03:15:52.132 INFO:tasks.workunit.client.1.smithi184.stdout:9/316: unlink d0/f1c 0 2023-12-16T03:15:52.132 INFO:tasks.workunit.client.1.smithi184.stdout:9/317: fdatasync d0/d13/d20/f28 0 2023-12-16T03:15:52.133 INFO:tasks.workunit.client.1.smithi184.stdout:0/367: link dc/d10/f11 dc/d22/d1d/d2c/f76 0 2023-12-16T03:15:52.135 INFO:tasks.workunit.client.1.smithi184.stdout:9/318: creat d0/f68 x:0 0 0 2023-12-16T03:15:52.135 INFO:tasks.workunit.client.1.smithi184.stdout:7/282: dwrite d0/df/d32/d39/f3e [0,4194304] 0 2023-12-16T03:15:52.136 INFO:tasks.workunit.client.1.smithi184.stdout:7/283: write d0/d3/f11 [2778405,127483] 0 2023-12-16T03:15:52.136 INFO:tasks.workunit.client.1.smithi184.stdout:7/284: chown d0/df/d36/d3f/d49 6419363 1 2023-12-16T03:15:52.137 INFO:tasks.workunit.client.1.smithi184.stdout:8/233: dread d2/d4/f9 [0,4194304] 0 2023-12-16T03:15:52.137 INFO:tasks.workunit.client.1.smithi184.stdout:8/234: truncate d2/d12/f38 130148 0 2023-12-16T03:15:52.137 INFO:tasks.workunit.client.1.smithi184.stdout:8/235: truncate d2/d4/d10/d11/f3b 1183112 0 2023-12-16T03:15:52.140 INFO:tasks.workunit.client.1.smithi184.stdout:8/236: write d2/d4/d10/d11/f1d [3635970,51511] 0 2023-12-16T03:15:52.140 INFO:tasks.workunit.client.1.smithi184.stdout:7/285: fdatasync d0/d3/f7 0 2023-12-16T03:15:52.140 INFO:tasks.workunit.client.1.smithi184.stdout:7/286: fdatasync d0/d3/f5 0 2023-12-16T03:15:52.143 INFO:tasks.workunit.client.1.smithi184.stdout:8/237: creat d2/d37/f4c x:0 0 0 2023-12-16T03:15:52.145 INFO:tasks.workunit.client.1.smithi184.stdout:7/287: mknod d0/df/d32/d35/c54 0 2023-12-16T03:15:52.145 INFO:tasks.workunit.client.1.smithi184.stdout:7/288: write d0/df/d1e/f20 [2548085,113235] 0 2023-12-16T03:15:52.150 INFO:tasks.workunit.client.1.smithi184.stdout:8/238: dread d2/d4/d10/d11/f3f [0,4194304] 0 2023-12-16T03:15:52.158 INFO:tasks.workunit.client.1.smithi184.stdout:7/289: symlink d0/df/dd/d27/l55 0 2023-12-16T03:15:52.160 INFO:tasks.workunit.client.1.smithi184.stdout:7/290: mknod d0/df/d32/d39/c56 0 2023-12-16T03:15:52.160 INFO:tasks.workunit.client.1.smithi184.stdout:0/368: dwrite dc/f68 [0,4194304] 0 2023-12-16T03:15:52.161 INFO:tasks.workunit.client.1.smithi184.stdout:7/291: mknod d0/c57 0 2023-12-16T03:15:52.161 INFO:tasks.workunit.client.1.smithi184.stdout:7/292: chown d0/d3/d4/l4c 494626 1 2023-12-16T03:15:52.162 INFO:tasks.workunit.client.1.smithi184.stdout:7/293: write d0/d3/d2e/f3a [695788,27629] 0 2023-12-16T03:15:52.164 INFO:tasks.workunit.client.1.smithi184.stdout:0/369: write dc/f58 [765515,76787] 0 2023-12-16T03:15:52.169 INFO:tasks.workunit.client.1.smithi184.stdout:0/370: write dc/f19 [2269280,109276] 0 2023-12-16T03:15:52.171 INFO:tasks.workunit.client.1.smithi184.stdout:9/319: dwrite d0/f57 [0,4194304] 0 2023-12-16T03:15:52.171 INFO:tasks.workunit.client.1.smithi184.stdout:9/320: readlink d0/lb 0 2023-12-16T03:15:52.172 INFO:tasks.workunit.client.1.smithi184.stdout:0/371: creat dc/d22/d48/f77 x:0 0 0 2023-12-16T03:15:52.172 INFO:tasks.workunit.client.1.smithi184.stdout:8/239: dwrite d2/d4/f9 [0,4194304] 0 2023-12-16T03:15:52.202 INFO:tasks.workunit.client.1.smithi184.stdout:7/294: dwrite d0/df/f2a [0,4194304] 0 2023-12-16T03:15:52.203 INFO:tasks.workunit.client.1.smithi184.stdout:7/295: write d0/d3/f5 [3272295,8841] 0 2023-12-16T03:15:52.203 INFO:tasks.workunit.client.1.smithi184.stdout:7/296: rmdir d0/df/d36/d3f 39 2023-12-16T03:15:52.204 INFO:tasks.workunit.client.1.smithi184.stdout:7/297: getdents d0/df/dd/d27 0 2023-12-16T03:15:52.206 INFO:tasks.workunit.client.1.smithi184.stdout:8/240: dwrite d2/d4/f2e [0,4194304] 0 2023-12-16T03:15:52.207 INFO:tasks.workunit.client.1.smithi184.stdout:9/321: dwrite d0/d13/f21 [0,4194304] 0 2023-12-16T03:15:52.207 INFO:tasks.workunit.client.1.smithi184.stdout:0/372: dwrite dc/d22/d46/f6e [0,4194304] 0 2023-12-16T03:15:52.216 INFO:tasks.workunit.client.1.smithi184.stdout:8/241: dread d2/fe [0,4194304] 0 2023-12-16T03:15:52.216 INFO:tasks.workunit.client.1.smithi184.stdout:8/242: write d2/d37/f4c [450646,84874] 0 2023-12-16T03:15:52.216 INFO:tasks.workunit.client.1.smithi184.stdout:8/243: dread - d2/d12/d21/d2d/d31/f3a zero size 2023-12-16T03:15:52.216 INFO:tasks.workunit.client.1.smithi184.stdout:8/244: write d2/d4/d10/d11/f29 [241966,19961] 0 2023-12-16T03:15:52.219 INFO:tasks.workunit.client.1.smithi184.stdout:9/322: creat d0/d13/f69 x:0 0 0 2023-12-16T03:15:52.220 INFO:tasks.workunit.client.1.smithi184.stdout:7/298: dread d0/d3/f5 [0,4194304] 0 2023-12-16T03:15:52.222 INFO:tasks.workunit.client.1.smithi184.stdout:8/245: dread d2/fc [0,4194304] 0 2023-12-16T03:15:52.223 INFO:tasks.workunit.client.1.smithi184.stdout:8/246: creat d2/d4/d10/d11/f4d x:0 0 0 2023-12-16T03:15:52.224 INFO:tasks.workunit.client.1.smithi184.stdout:7/299: dread d0/df/d1e/f2d [0,4194304] 0 2023-12-16T03:15:52.225 INFO:tasks.workunit.client.1.smithi184.stdout:8/247: symlink d2/d12/d21/d2d/d31/l4e 0 2023-12-16T03:15:52.235 INFO:tasks.workunit.client.1.smithi184.stdout:8/248: dread d2/d37/f4c [0,4194304] 0 2023-12-16T03:15:52.239 INFO:tasks.workunit.client.1.smithi184.stdout:8/249: mknod d2/d4/c4f 0 2023-12-16T03:15:52.244 INFO:tasks.workunit.client.1.smithi184.stdout:9/323: dwrite d0/d30/d31/f48 [0,4194304] 0 2023-12-16T03:15:52.244 INFO:tasks.workunit.client.1.smithi184.stdout:7/300: dwrite d0/d3/f24 [0,4194304] 0 2023-12-16T03:15:52.244 INFO:tasks.workunit.client.1.smithi184.stdout:7/301: fdatasync d0/df/f4d 0 2023-12-16T03:15:52.244 INFO:tasks.workunit.client.1.smithi184.stdout:9/324: symlink d0/d13/d40/l6a 0 2023-12-16T03:15:52.244 INFO:tasks.workunit.client.1.smithi184.stdout:9/325: creat d0/d13/d40/f6b x:0 0 0 2023-12-16T03:15:52.254 INFO:tasks.workunit.client.1.smithi184.stdout:9/326: dread d0/f14 [0,4194304] 0 2023-12-16T03:15:52.256 INFO:tasks.workunit.client.1.smithi184.stdout:9/327: rename d0/d30/d31/c5e to d0/d13/d20/d5b/d53/c6c 0 2023-12-16T03:15:52.258 INFO:tasks.workunit.client.0.smithi064.stdout:0/13: rmdir d2 39 2023-12-16T03:15:52.258 INFO:tasks.workunit.client.0.smithi064.stdout:0/14: readlink - no filename 2023-12-16T03:15:52.262 INFO:tasks.workunit.client.1.smithi184.stdout:9/328: write d0/f57 [2341121,9267] 0 2023-12-16T03:15:52.262 INFO:tasks.workunit.client.1.smithi184.stdout:9/329: read d0/d30/f41 [2062992,41404] 0 2023-12-16T03:15:52.263 INFO:tasks.workunit.client.1.smithi184.stdout:9/330: fsync d0/d13/d20/d5b/d53/f65 0 2023-12-16T03:15:52.264 INFO:tasks.workunit.client.1.smithi184.stdout:9/331: read d0/f2f [1692135,225] 0 2023-12-16T03:15:52.264 INFO:tasks.workunit.client.1.smithi184.stdout:8/250: dwrite d2/d4/d10/d11/f1d [0,4194304] 0 2023-12-16T03:15:52.264 INFO:tasks.workunit.client.1.smithi184.stdout:8/251: write d2/fc [1885757,20618] 0 2023-12-16T03:15:52.264 INFO:tasks.workunit.client.1.smithi184.stdout:7/302: dwrite d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:52.265 INFO:tasks.workunit.client.1.smithi184.stdout:9/332: creat d0/d13/d20/d5b/d53/f6d x:0 0 0 2023-12-16T03:15:52.265 INFO:tasks.workunit.client.1.smithi184.stdout:9/333: readlink d0/d13/l35 0 2023-12-16T03:15:52.265 INFO:tasks.workunit.client.1.smithi184.stdout:9/334: write d0/d13/f69 [174185,120389] 0 2023-12-16T03:15:52.265 INFO:tasks.workunit.client.1.smithi184.stdout:9/335: fdatasync d0/f2f 0 2023-12-16T03:15:52.265 INFO:tasks.workunit.client.1.smithi184.stdout:9/336: write d0/d13/d20/d5b/f52 [217490,125309] 0 2023-12-16T03:15:52.266 INFO:tasks.workunit.client.1.smithi184.stdout:8/252: unlink d2/d4/d10/d11/f3b 0 2023-12-16T03:15:52.266 INFO:tasks.workunit.client.1.smithi184.stdout:7/303: symlink d0/df/d36/d3f/d49/l58 0 2023-12-16T03:15:52.268 INFO:tasks.workunit.client.1.smithi184.stdout:7/304: dread d0/d3/d2e/f3a [0,4194304] 0 2023-12-16T03:15:52.270 INFO:tasks.workunit.client.1.smithi184.stdout:7/305: write d0/f50 [724957,68851] 0 2023-12-16T03:15:52.271 INFO:tasks.workunit.client.1.smithi184.stdout:9/337: dread d0/d13/d20/d5b/f52 [0,4194304] 0 2023-12-16T03:15:52.272 INFO:tasks.workunit.client.1.smithi184.stdout:9/338: unlink d0/l17 0 2023-12-16T03:15:52.275 INFO:tasks.workunit.client.0.smithi064.stdout:5/15: getdents d0 0 2023-12-16T03:15:52.283 INFO:tasks.workunit.client.1.smithi184.stdout:9/339: dread d0/fe [0,4194304] 0 2023-12-16T03:15:52.284 INFO:tasks.workunit.client.1.smithi184.stdout:9/340: mkdir d0/d13/d6e 0 2023-12-16T03:15:52.285 INFO:tasks.workunit.client.1.smithi184.stdout:9/341: mknod d0/c6f 0 2023-12-16T03:15:52.288 INFO:tasks.workunit.client.1.smithi184.stdout:8/253: dwrite d2/d4/f44 [0,4194304] 0 2023-12-16T03:15:52.289 INFO:tasks.workunit.client.1.smithi184.stdout:7/306: dwrite d0/df/d32/d39/f3e [0,4194304] 0 2023-12-16T03:15:52.290 INFO:tasks.workunit.client.1.smithi184.stdout:8/254: link d2/d4/d10/f14 d2/d12/f50 0 2023-12-16T03:15:52.291 INFO:tasks.workunit.client.1.smithi184.stdout:8/255: mknod d2/d12/d21/d2d/c51 0 2023-12-16T03:15:52.295 INFO:tasks.workunit.client.1.smithi184.stdout:8/256: getdents d2/d4 0 2023-12-16T03:15:52.296 INFO:tasks.workunit.client.1.smithi184.stdout:8/257: mkdir d2/d12/d21/d2d/d31/d52 0 2023-12-16T03:15:52.298 INFO:tasks.workunit.client.1.smithi184.stdout:8/258: creat d2/d12/d21/f53 x:0 0 0 2023-12-16T03:15:52.300 INFO:tasks.workunit.client.1.smithi184.stdout:8/259: mknod d2/d4/d10/d11/c54 0 2023-12-16T03:15:52.306 INFO:tasks.workunit.client.1.smithi184.stdout:8/260: getdents d2/d12/d21/d2d 0 2023-12-16T03:15:52.306 INFO:tasks.workunit.client.1.smithi184.stdout:8/261: chown d2/d4/c4f 373776 1 2023-12-16T03:15:52.307 INFO:tasks.workunit.client.1.smithi184.stdout:8/262: rename d2/d12/d21/l41 to d2/d12/l55 0 2023-12-16T03:15:52.311 INFO:tasks.workunit.client.1.smithi184.stdout:9/342: dwrite d0/f3e [0,4194304] 0 2023-12-16T03:15:52.311 INFO:tasks.workunit.client.1.smithi184.stdout:7/307: dread d0/d3/f24 [0,4194304] 0 2023-12-16T03:15:52.311 INFO:tasks.workunit.client.1.smithi184.stdout:9/343: write d0/d3a/f59 [39095,46291] 0 2023-12-16T03:15:52.313 INFO:tasks.workunit.client.1.smithi184.stdout:7/308: symlink d0/d3/d2e/l59 0 2023-12-16T03:15:52.314 INFO:tasks.workunit.client.1.smithi184.stdout:7/309: symlink d0/df/d1e/l5a 0 2023-12-16T03:15:52.317 INFO:tasks.workunit.client.1.smithi184.stdout:8/263: dread d2/d4/f9 [0,4194304] 0 2023-12-16T03:15:52.317 INFO:tasks.workunit.client.1.smithi184.stdout:8/264: fsync d2/d4/d10/f14 0 2023-12-16T03:15:52.319 INFO:tasks.workunit.client.1.smithi184.stdout:7/310: truncate d0/d3/f11 1076749 0 2023-12-16T03:15:52.321 INFO:tasks.workunit.client.1.smithi184.stdout:8/265: dread d2/d12/f50 [0,4194304] 0 2023-12-16T03:15:52.322 INFO:tasks.workunit.client.1.smithi184.stdout:7/311: write d0/d3/d2e/f3a [379231,17359] 0 2023-12-16T03:15:52.323 INFO:tasks.workunit.client.1.smithi184.stdout:9/344: dread d0/f36 [0,4194304] 0 2023-12-16T03:15:52.326 INFO:tasks.workunit.client.1.smithi184.stdout:8/266: rename d2/l1b to d2/d4/d10/l56 0 2023-12-16T03:15:52.328 INFO:tasks.workunit.client.1.smithi184.stdout:8/267: rmdir d2/d12/d21/d30 39 2023-12-16T03:15:52.328 INFO:tasks.workunit.client.1.smithi184.stdout:8/268: fdatasync d2/d37/f4c 0 2023-12-16T03:15:52.331 INFO:tasks.workunit.client.1.smithi184.stdout:9/345: dread d0/f1f [0,4194304] 0 2023-12-16T03:15:52.331 INFO:tasks.workunit.client.1.smithi184.stdout:9/346: truncate d0/d13/d20/d5b/d53/f6d 711315 0 2023-12-16T03:15:52.332 INFO:tasks.workunit.client.1.smithi184.stdout:1/302: sync 2023-12-16T03:15:52.332 INFO:tasks.workunit.client.1.smithi184.stdout:3/304: sync 2023-12-16T03:15:52.332 INFO:tasks.workunit.client.1.smithi184.stdout:4/179: sync 2023-12-16T03:15:52.332 INFO:tasks.workunit.client.1.smithi184.stdout:1/303: chown d3/d28/d3c/d24/f55 57152 1 2023-12-16T03:15:52.333 INFO:tasks.workunit.client.1.smithi184.stdout:5/68: sync 2023-12-16T03:15:52.333 INFO:tasks.workunit.client.1.smithi184.stdout:1/304: write d3/d13/f1f [4485896,31181] 0 2023-12-16T03:15:52.333 INFO:tasks.workunit.client.1.smithi184.stdout:9/347: creat d0/d3a/f70 x:0 0 0 2023-12-16T03:15:52.339 INFO:tasks.workunit.client.1.smithi184.stdout:3/305: unlink d12/d18/d1f/f2e 0 2023-12-16T03:15:52.339 INFO:tasks.workunit.client.1.smithi184.stdout:3/306: fdatasync d12/d1e/f2d 0 2023-12-16T03:15:52.340 INFO:tasks.workunit.client.1.smithi184.stdout:1/305: unlink d3/d28/d3c/f3a 0 2023-12-16T03:15:52.340 INFO:tasks.workunit.client.1.smithi184.stdout:9/348: creat d0/d3a/d47/f71 x:0 0 0 2023-12-16T03:15:52.342 INFO:tasks.workunit.client.1.smithi184.stdout:3/307: rmdir d12/d18/d1f/d23/d2a/d36 39 2023-12-16T03:15:52.342 INFO:tasks.workunit.client.1.smithi184.stdout:3/308: chown d12/d1e/f47 5 1 2023-12-16T03:15:52.344 INFO:tasks.workunit.client.1.smithi184.stdout:1/306: creat d3/d28/d3c/d41/f67 x:0 0 0 2023-12-16T03:15:52.345 INFO:tasks.workunit.client.1.smithi184.stdout:9/349: stat d0/d13/d20/d5b/l51 0 2023-12-16T03:15:52.348 INFO:tasks.workunit.client.1.smithi184.stdout:3/309: link d12/d18/d1f/d23/l2b d12/d18/d1f/d23/d2a/d3e/l73 0 2023-12-16T03:15:52.350 INFO:tasks.workunit.client.1.smithi184.stdout:1/307: mknod d3/d28/d3c/d41/d46/d4a/c68 0 2023-12-16T03:15:52.352 INFO:tasks.workunit.client.1.smithi184.stdout:9/350: rename d0/d30/d31/c39 to d0/d3a/d47/c72 0 2023-12-16T03:15:52.352 INFO:tasks.workunit.client.1.smithi184.stdout:9/351: truncate d0/d3a/d47/f71 73044 0 2023-12-16T03:15:52.353 INFO:tasks.workunit.client.1.smithi184.stdout:3/310: truncate d12/d1e/f47 1804346 0 2023-12-16T03:15:52.354 INFO:tasks.workunit.client.1.smithi184.stdout:3/311: write d12/d18/d1f/f6c [717420,40143] 0 2023-12-16T03:15:52.355 INFO:tasks.workunit.client.1.smithi184.stdout:1/308: getdents d3/d28/d3c/d24 0 2023-12-16T03:15:52.355 INFO:tasks.workunit.client.1.smithi184.stdout:1/309: chown d3/d28/d3c/d41/d46/d4a/c68 781617470 1 2023-12-16T03:15:52.355 INFO:tasks.workunit.client.1.smithi184.stdout:1/310: fdatasync d3/d28/d3c/d24/f55 0 2023-12-16T03:15:52.356 INFO:tasks.workunit.client.1.smithi184.stdout:9/352: truncate d0/f14 3306043 0 2023-12-16T03:15:52.356 INFO:tasks.workunit.client.1.smithi184.stdout:9/353: chown d0/f3e 6436 1 2023-12-16T03:15:52.357 INFO:tasks.workunit.client.1.smithi184.stdout:3/312: creat d12/d18/f74 x:0 0 0 2023-12-16T03:15:52.358 INFO:tasks.workunit.client.1.smithi184.stdout:9/354: truncate d0/f1f 3419534 0 2023-12-16T03:15:52.360 INFO:tasks.workunit.client.1.smithi184.stdout:3/313: rename d12/d18/l1d to d12/d18/d68/l75 0 2023-12-16T03:15:52.360 INFO:tasks.workunit.client.1.smithi184.stdout:3/314: truncate f4 4910265 0 2023-12-16T03:15:52.361 INFO:tasks.workunit.client.1.smithi184.stdout:4/180: dwrite d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:52.361 INFO:tasks.workunit.client.1.smithi184.stdout:8/269: dwrite d2/d4/f44 [4194304,4194304] 0 2023-12-16T03:15:52.361 INFO:tasks.workunit.client.1.smithi184.stdout:5/69: dread d1/d3/d11/f13 [0,4194304] 0 2023-12-16T03:15:52.361 INFO:tasks.workunit.client.1.smithi184.stdout:4/181: fdatasync d1/d12/f17 0 2023-12-16T03:15:52.362 INFO:tasks.workunit.client.1.smithi184.stdout:8/270: write d2/d4/d10/d11/f1d [5241539,119957] 0 2023-12-16T03:15:52.367 INFO:tasks.workunit.client.1.smithi184.stdout:5/70: unlink d1/l10 0 2023-12-16T03:15:52.367 INFO:tasks.workunit.client.1.smithi184.stdout:5/71: readlink d1/d3/l14 0 2023-12-16T03:15:52.367 INFO:tasks.workunit.client.1.smithi184.stdout:5/72: write d1/d3/fa [978320,32902] 0 2023-12-16T03:15:52.367 INFO:tasks.workunit.client.1.smithi184.stdout:5/73: write d1/d3/fa [1588114,85635] 0 2023-12-16T03:15:52.371 INFO:tasks.workunit.client.1.smithi184.stdout:8/271: dread d2/d4/f2e [0,4194304] 0 2023-12-16T03:15:52.371 INFO:tasks.workunit.client.1.smithi184.stdout:8/272: fsync d2/d4/f44 0 2023-12-16T03:15:52.371 INFO:tasks.workunit.client.1.smithi184.stdout:9/355: dread d0/d3a/d47/f71 [0,4194304] 0 2023-12-16T03:15:52.376 INFO:tasks.workunit.client.1.smithi184.stdout:9/356: unlink d0/d30/d31/f48 0 2023-12-16T03:15:52.376 INFO:tasks.workunit.client.1.smithi184.stdout:4/182: dread d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:52.379 INFO:tasks.workunit.client.1.smithi184.stdout:1/311: dwrite d3/d28/d3c/f4f [0,4194304] 0 2023-12-16T03:15:52.379 INFO:tasks.workunit.client.1.smithi184.stdout:1/312: fdatasync d3/d28/d3c/d41/f4b 0 2023-12-16T03:15:52.379 INFO:tasks.workunit.client.1.smithi184.stdout:9/357: mknod d0/c73 0 2023-12-16T03:15:52.379 INFO:tasks.workunit.client.1.smithi184.stdout:9/358: readlink d0/lf 0 2023-12-16T03:15:52.381 INFO:tasks.workunit.client.1.smithi184.stdout:1/313: dread d3/d28/d3c/d41/f4b [0,4194304] 0 2023-12-16T03:15:52.381 INFO:tasks.workunit.client.1.smithi184.stdout:1/314: dread - d3/d13/f5f zero size 2023-12-16T03:15:52.382 INFO:tasks.workunit.client.1.smithi184.stdout:9/359: creat d0/d13/d20/d5b/d53/f74 x:0 0 0 2023-12-16T03:15:52.383 INFO:tasks.workunit.client.1.smithi184.stdout:9/360: creat d0/d30/f75 x:0 0 0 2023-12-16T03:15:52.385 INFO:tasks.workunit.client.1.smithi184.stdout:9/361: truncate d0/d13/d20/f29 291540 0 2023-12-16T03:15:52.387 INFO:tasks.workunit.client.1.smithi184.stdout:9/362: mkdir d0/d76 0 2023-12-16T03:15:52.387 INFO:tasks.workunit.client.1.smithi184.stdout:4/183: truncate d1/d11/d1b/d1e/f24 1415461 0 2023-12-16T03:15:52.390 INFO:tasks.workunit.client.1.smithi184.stdout:4/184: truncate d1/fd 827982 0 2023-12-16T03:15:52.390 INFO:tasks.workunit.client.1.smithi184.stdout:5/74: rmdir d1 39 2023-12-16T03:15:52.392 INFO:tasks.workunit.client.1.smithi184.stdout:4/185: write d1/f8 [4028111,82886] 0 2023-12-16T03:15:52.392 INFO:tasks.workunit.client.1.smithi184.stdout:4/186: getdents d1 0 2023-12-16T03:15:52.392 INFO:tasks.workunit.client.1.smithi184.stdout:8/273: dwrite d2/f28 [4194304,4194304] 0 2023-12-16T03:15:52.392 INFO:tasks.workunit.client.1.smithi184.stdout:8/274: write d2/d4/d10/d11/f29 [425145,52070] 0 2023-12-16T03:15:52.393 INFO:tasks.workunit.client.1.smithi184.stdout:5/75: unlink d1/d3/fc 0 2023-12-16T03:15:52.396 INFO:tasks.workunit.client.1.smithi184.stdout:8/275: symlink d2/d12/d21/d30/l57 0 2023-12-16T03:15:52.396 INFO:tasks.workunit.client.1.smithi184.stdout:8/276: chown d2/d4/d10/d11/f4d 2062680270 1 2023-12-16T03:15:52.396 INFO:tasks.workunit.client.1.smithi184.stdout:8/277: chown d2/d37 8175 1 2023-12-16T03:15:52.397 INFO:tasks.workunit.client.1.smithi184.stdout:5/76: truncate d1/d3/fd 1721513 0 2023-12-16T03:15:52.399 INFO:tasks.workunit.client.1.smithi184.stdout:5/77: mkdir d1/d3/d9/de/d15 0 2023-12-16T03:15:52.399 INFO:tasks.workunit.client.1.smithi184.stdout:5/78: stat d1 0 2023-12-16T03:15:52.401 INFO:tasks.workunit.client.1.smithi184.stdout:9/363: getdents d0/d30 0 2023-12-16T03:15:52.401 INFO:tasks.workunit.client.1.smithi184.stdout:9/364: readlink d0/d13/l35 0 2023-12-16T03:15:52.402 INFO:tasks.workunit.client.1.smithi184.stdout:9/365: chown d0/d13/d20/d5b/d53/f6d 3937614 1 2023-12-16T03:15:52.402 INFO:tasks.workunit.client.1.smithi184.stdout:9/366: write d0/d13/d20/d5b/d53/f6d [840637,33039] 0 2023-12-16T03:15:52.402 INFO:tasks.workunit.client.1.smithi184.stdout:8/278: dread d2/f13 [0,4194304] 0 2023-12-16T03:15:52.402 INFO:tasks.workunit.client.1.smithi184.stdout:8/279: chown d2/d4/d10/f14 2 1 2023-12-16T03:15:52.402 INFO:tasks.workunit.client.1.smithi184.stdout:8/280: write d2/f28 [9153873,98286] 0 2023-12-16T03:15:52.403 INFO:tasks.workunit.client.1.smithi184.stdout:5/79: creat d1/d3/d9/de/f16 x:0 0 0 2023-12-16T03:15:52.405 INFO:tasks.workunit.client.1.smithi184.stdout:9/367: rename d0/d30/d31 to d0/d13/d20/d77 0 2023-12-16T03:15:52.409 INFO:tasks.workunit.client.1.smithi184.stdout:8/281: creat d2/d12/f58 x:0 0 0 2023-12-16T03:15:52.409 INFO:tasks.workunit.client.1.smithi184.stdout:8/282: write d2/d4/d10/f14 [4306739,45937] 0 2023-12-16T03:15:52.410 INFO:tasks.workunit.client.1.smithi184.stdout:4/187: dwrite d1/d12/d13/f31 [0,4194304] 0 2023-12-16T03:15:52.410 INFO:tasks.workunit.client.1.smithi184.stdout:1/315: dwrite d3/d13/d2c/f4c [0,4194304] 0 2023-12-16T03:15:52.414 INFO:tasks.workunit.client.1.smithi184.stdout:4/188: creat d1/d12/d27/d3b/f3f x:0 0 0 2023-12-16T03:15:52.414 INFO:tasks.workunit.client.1.smithi184.stdout:8/283: rename d2/d12/f50 to d2/d4/d10/f59 0 2023-12-16T03:15:52.414 INFO:tasks.workunit.client.1.smithi184.stdout:4/189: fsync d1/f4 0 2023-12-16T03:15:52.417 INFO:tasks.workunit.client.1.smithi184.stdout:4/190: mkdir d1/d12/d13/d40 0 2023-12-16T03:15:52.417 INFO:tasks.workunit.client.1.smithi184.stdout:4/191: readlink d1/l6 0 2023-12-16T03:15:52.417 INFO:tasks.workunit.client.1.smithi184.stdout:8/284: dread d2/fc [0,4194304] 0 2023-12-16T03:15:52.417 INFO:tasks.workunit.client.1.smithi184.stdout:5/80: write d1/d3/fd [2607355,54574] 0 2023-12-16T03:15:52.418 INFO:tasks.workunit.client.1.smithi184.stdout:5/81: stat d1/d3/fa 0 2023-12-16T03:15:52.418 INFO:tasks.workunit.client.1.smithi184.stdout:5/82: chown d1/d3/d9 2940540 1 2023-12-16T03:15:52.422 INFO:tasks.workunit.client.1.smithi184.stdout:9/368: rmdir d0/d13/d20/d77 39 2023-12-16T03:15:52.426 INFO:tasks.workunit.client.1.smithi184.stdout:4/192: truncate d1/d12/d13/f31 3825055 0 2023-12-16T03:15:52.426 INFO:tasks.workunit.client.1.smithi184.stdout:4/193: readlink l0 0 2023-12-16T03:15:52.428 INFO:tasks.workunit.client.1.smithi184.stdout:9/369: creat d0/f78 x:0 0 0 2023-12-16T03:15:52.428 INFO:tasks.workunit.client.1.smithi184.stdout:9/370: write d0/f68 [895967,89053] 0 2023-12-16T03:15:52.428 INFO:tasks.workunit.client.1.smithi184.stdout:9/371: dread - d0/d13/d40/f6b zero size 2023-12-16T03:15:52.428 INFO:tasks.workunit.client.1.smithi184.stdout:4/194: creat d1/d11/d1b/d1e/f41 x:0 0 0 2023-12-16T03:15:52.429 INFO:tasks.workunit.client.1.smithi184.stdout:9/372: mknod d0/d13/d6e/c79 0 2023-12-16T03:15:52.429 INFO:tasks.workunit.client.1.smithi184.stdout:9/373: chown d0/d13/d20/f29 854 1 2023-12-16T03:15:52.429 INFO:tasks.workunit.client.1.smithi184.stdout:5/83: dread d1/d3/fd [0,4194304] 0 2023-12-16T03:15:52.430 INFO:tasks.workunit.client.1.smithi184.stdout:4/195: mkdir d1/d12/d27/d42 0 2023-12-16T03:15:52.431 INFO:tasks.workunit.client.1.smithi184.stdout:9/374: mkdir d0/d3a/d47/d7a 0 2023-12-16T03:15:52.433 INFO:tasks.workunit.client.1.smithi184.stdout:5/84: symlink d1/d3/d9/l17 0 2023-12-16T03:15:52.433 INFO:tasks.workunit.client.1.smithi184.stdout:4/196: mkdir d1/d12/d13/d40/d43 0 2023-12-16T03:15:52.436 INFO:tasks.workunit.client.1.smithi184.stdout:9/375: link d0/d13/d20/d5b/c50 d0/d13/d20/c7b 0 2023-12-16T03:15:52.436 INFO:tasks.workunit.client.1.smithi184.stdout:8/285: truncate d2/d4/d10/d11/f1d 3275249 0 2023-12-16T03:15:52.438 INFO:tasks.workunit.client.1.smithi184.stdout:4/197: mkdir d1/d11/d1b/d44 0 2023-12-16T03:15:52.440 INFO:tasks.workunit.client.1.smithi184.stdout:9/376: rename d0/d30/f66 to d0/d3a/d47/d7a/f7c 0 2023-12-16T03:15:52.440 INFO:tasks.workunit.client.1.smithi184.stdout:9/377: truncate d0/f78 981749 0 2023-12-16T03:15:52.441 INFO:tasks.workunit.client.1.smithi184.stdout:8/286: creat d2/d12/f5a x:0 0 0 2023-12-16T03:15:52.442 INFO:tasks.workunit.client.1.smithi184.stdout:4/198: mkdir d1/d12/d13/d40/d43/d45 0 2023-12-16T03:15:52.442 INFO:tasks.workunit.client.1.smithi184.stdout:4/199: truncate d1/d11/d1b/d1e/f41 335512 0 2023-12-16T03:15:52.442 INFO:tasks.workunit.client.1.smithi184.stdout:9/378: mknod d0/d3a/d47/c7d 0 2023-12-16T03:15:52.443 INFO:tasks.workunit.client.1.smithi184.stdout:8/287: creat d2/d4/d10/d2a/f5b x:0 0 0 2023-12-16T03:15:52.444 INFO:tasks.workunit.client.1.smithi184.stdout:9/379: dread d0/d30/f44 [0,4194304] 0 2023-12-16T03:15:52.444 INFO:tasks.workunit.client.1.smithi184.stdout:9/380: write d0/d3a/f70 [213138,102325] 0 2023-12-16T03:15:52.444 INFO:tasks.workunit.client.1.smithi184.stdout:4/200: symlink d1/d11/l46 0 2023-12-16T03:15:52.445 INFO:tasks.workunit.client.1.smithi184.stdout:8/288: creat d2/d4/d10/d2a/f5c x:0 0 0 2023-12-16T03:15:52.447 INFO:tasks.workunit.client.1.smithi184.stdout:9/381: mknod d0/d13/d20/d77/c7e 0 2023-12-16T03:15:52.447 INFO:tasks.workunit.client.1.smithi184.stdout:9/382: chown d0/d3a/d47/d7a/f7c 1 1 2023-12-16T03:15:52.447 INFO:tasks.workunit.client.1.smithi184.stdout:9/383: chown d0/d13/d20/d5b 103948 1 2023-12-16T03:15:52.447 INFO:tasks.workunit.client.1.smithi184.stdout:9/384: read d0/d13/d20/d5b/d53/f6d [638025,58522] 0 2023-12-16T03:15:52.447 INFO:tasks.workunit.client.1.smithi184.stdout:4/201: unlink d1/d12/d27/c2b 0 2023-12-16T03:15:52.448 INFO:tasks.workunit.client.1.smithi184.stdout:5/85: dwrite d1/d3/d11/f12 [0,4194304] 0 2023-12-16T03:15:52.448 INFO:tasks.workunit.client.1.smithi184.stdout:5/86: write d1/d3/fd [1178651,25514] 0 2023-12-16T03:15:52.448 INFO:tasks.workunit.client.1.smithi184.stdout:5/87: fdatasync d1/d3/d11/f13 0 2023-12-16T03:15:52.449 INFO:tasks.workunit.client.1.smithi184.stdout:9/385: link d0/d13/f21 d0/d13/d20/d5b/f7f 0 2023-12-16T03:15:52.452 INFO:tasks.workunit.client.1.smithi184.stdout:5/88: creat d1/d3/d9/f18 x:0 0 0 2023-12-16T03:15:52.454 INFO:tasks.workunit.client.1.smithi184.stdout:9/386: rename d0/d13/d20/d5b/d53/c63 to d0/d3a/c80 0 2023-12-16T03:15:52.454 INFO:tasks.workunit.client.1.smithi184.stdout:9/387: read - d0/d13/d20/d5b/d53/f65 zero size 2023-12-16T03:15:52.455 INFO:tasks.workunit.client.1.smithi184.stdout:5/89: mkdir d1/d3/d9/de/d15/d19 0 2023-12-16T03:15:52.459 INFO:tasks.workunit.client.1.smithi184.stdout:9/388: dread d0/d3a/f70 [0,4194304] 0 2023-12-16T03:15:52.465 INFO:tasks.workunit.client.1.smithi184.stdout:4/202: truncate d1/d29/d34/f3d 3184545 0 2023-12-16T03:15:52.469 INFO:tasks.workunit.client.1.smithi184.stdout:9/389: dread d0/f1f [0,4194304] 0 2023-12-16T03:15:52.470 INFO:tasks.workunit.client.1.smithi184.stdout:9/390: rmdir d0/d13/d20/d5b/d43 39 2023-12-16T03:15:52.471 INFO:tasks.workunit.client.1.smithi184.stdout:5/90: dread d1/d3/fd [0,4194304] 0 2023-12-16T03:15:52.472 INFO:tasks.workunit.client.1.smithi184.stdout:9/391: creat d0/d13/d20/d5b/d53/f81 x:0 0 0 2023-12-16T03:15:52.473 INFO:tasks.workunit.client.1.smithi184.stdout:5/91: creat d1/f1a x:0 0 0 2023-12-16T03:15:52.473 INFO:tasks.workunit.client.1.smithi184.stdout:5/92: write d1/d3/d9/f18 [625064,102069] 0 2023-12-16T03:15:52.473 INFO:tasks.workunit.client.1.smithi184.stdout:5/93: dread - d1/d3/d9/de/f16 zero size 2023-12-16T03:15:52.475 INFO:tasks.workunit.client.1.smithi184.stdout:9/392: truncate d0/d13/f69 199962 0 2023-12-16T03:15:52.475 INFO:tasks.workunit.client.1.smithi184.stdout:5/94: mkdir d1/d3/d9/de/d15/d1b 0 2023-12-16T03:15:52.475 INFO:tasks.workunit.client.1.smithi184.stdout:8/289: dwrite d2/d4/d10/d11/f1d [0,4194304] 0 2023-12-16T03:15:52.475 INFO:tasks.workunit.client.1.smithi184.stdout:4/203: dread d1/d12/f17 [0,4194304] 0 2023-12-16T03:15:52.475 INFO:tasks.workunit.client.1.smithi184.stdout:8/290: stat d2/d37/f4c 0 2023-12-16T03:15:52.475 INFO:tasks.workunit.client.1.smithi184.stdout:8/291: stat d2/d4/l45 0 2023-12-16T03:15:52.475 INFO:tasks.workunit.client.1.smithi184.stdout:4/204: chown d1/l10 4004274 1 2023-12-16T03:15:52.476 INFO:tasks.workunit.client.1.smithi184.stdout:9/393: mkdir d0/d30/d82 0 2023-12-16T03:15:52.476 INFO:tasks.workunit.client.1.smithi184.stdout:9/394: fdatasync d0/f3e 0 2023-12-16T03:15:52.476 INFO:tasks.workunit.client.1.smithi184.stdout:5/95: write d1/d3/fd [1768808,39587] 0 2023-12-16T03:15:52.476 INFO:tasks.workunit.client.1.smithi184.stdout:4/205: symlink d1/d12/d13/l47 0 2023-12-16T03:15:52.476 INFO:tasks.workunit.client.1.smithi184.stdout:4/206: chown d1/l2a 119887382 1 2023-12-16T03:15:52.477 INFO:tasks.workunit.client.1.smithi184.stdout:5/96: read d1/d3/fa [1035773,43915] 0 2023-12-16T03:15:52.477 INFO:tasks.workunit.client.1.smithi184.stdout:5/97: chown d1/d3 0 1 2023-12-16T03:15:52.477 INFO:tasks.workunit.client.1.smithi184.stdout:8/292: creat d2/d12/d21/d2d/f5d x:0 0 0 2023-12-16T03:15:52.478 INFO:tasks.workunit.client.1.smithi184.stdout:9/395: creat d0/d3a/d47/d7a/f83 x:0 0 0 2023-12-16T03:15:52.479 INFO:tasks.workunit.client.1.smithi184.stdout:5/98: creat d1/d3/d9/de/f1c x:0 0 0 2023-12-16T03:15:52.481 INFO:tasks.workunit.client.1.smithi184.stdout:9/396: rmdir d0/d30/d82 0 2023-12-16T03:15:52.481 INFO:tasks.workunit.client.1.smithi184.stdout:9/397: dread - d0/d30/f75 zero size 2023-12-16T03:15:52.482 INFO:tasks.workunit.client.1.smithi184.stdout:4/207: dread d1/d12/f17 [0,4194304] 0 2023-12-16T03:15:52.482 INFO:tasks.workunit.client.1.smithi184.stdout:4/208: truncate d1/fd 953415 0 2023-12-16T03:15:52.483 INFO:tasks.workunit.client.1.smithi184.stdout:9/398: rename d0/d13/d40 to d0/d13/d6e/d84 0 2023-12-16T03:15:52.483 INFO:tasks.workunit.client.1.smithi184.stdout:9/399: truncate d0/d3a/d47/f67 785019 0 2023-12-16T03:15:52.483 INFO:tasks.workunit.client.1.smithi184.stdout:4/209: creat d1/d29/d34/f48 x:0 0 0 2023-12-16T03:15:52.484 INFO:tasks.workunit.client.1.smithi184.stdout:4/210: truncate d1/f8 1417841 0 2023-12-16T03:15:52.488 INFO:tasks.workunit.client.1.smithi184.stdout:9/400: read d0/f2f [2647834,22017] 0 2023-12-16T03:15:52.488 INFO:tasks.workunit.client.1.smithi184.stdout:5/99: dread d1/d3/d9/f18 [0,4194304] 0 2023-12-16T03:15:52.488 INFO:tasks.workunit.client.1.smithi184.stdout:5/100: stat d1/f1a 0 2023-12-16T03:15:52.490 INFO:tasks.workunit.client.1.smithi184.stdout:9/401: dread d0/d3a/f70 [0,4194304] 0 2023-12-16T03:15:52.490 INFO:tasks.workunit.client.1.smithi184.stdout:9/402: chown d0/d30/c4a 1351 1 2023-12-16T03:15:52.491 INFO:tasks.workunit.client.1.smithi184.stdout:9/403: dread d0/d3a/d47/f67 [0,4194304] 0 2023-12-16T03:15:52.495 INFO:tasks.workunit.client.1.smithi184.stdout:9/404: link d0/l19 d0/d13/l85 0 2023-12-16T03:15:52.495 INFO:tasks.workunit.client.1.smithi184.stdout:8/293: dwrite d2/d4/d10/d11/f3f [0,4194304] 0 2023-12-16T03:15:52.496 INFO:tasks.workunit.client.1.smithi184.stdout:9/405: getdents d0/d13/d20/d77 0 2023-12-16T03:15:52.501 INFO:tasks.workunit.client.1.smithi184.stdout:4/211: dwrite d1/d12/f3e [0,4194304] 0 2023-12-16T03:15:52.501 INFO:tasks.workunit.client.1.smithi184.stdout:4/212: chown l0 11810 1 2023-12-16T03:15:52.501 INFO:tasks.workunit.client.1.smithi184.stdout:9/406: creat d0/d13/d20/f86 x:0 0 0 2023-12-16T03:15:52.504 INFO:tasks.workunit.client.1.smithi184.stdout:4/213: creat d1/d12/d27/f49 x:0 0 0 2023-12-16T03:15:52.504 INFO:tasks.workunit.client.1.smithi184.stdout:4/214: read - d1/d12/d27/f49 zero size 2023-12-16T03:15:52.505 INFO:tasks.workunit.client.1.smithi184.stdout:9/407: creat d0/d13/f87 x:0 0 0 2023-12-16T03:15:52.514 INFO:tasks.workunit.client.1.smithi184.stdout:4/215: mkdir d1/d12/d27/d33/d4a 0 2023-12-16T03:15:52.518 INFO:tasks.workunit.client.1.smithi184.stdout:9/408: link d0/c73 d0/d3a/d47/c88 0 2023-12-16T03:15:52.518 INFO:tasks.workunit.client.1.smithi184.stdout:9/409: symlink d0/d3a/l89 0 2023-12-16T03:15:52.519 INFO:tasks.workunit.client.1.smithi184.stdout:9/410: symlink d0/l8a 0 2023-12-16T03:15:52.521 INFO:tasks.workunit.client.1.smithi184.stdout:9/411: creat d0/f8b x:0 0 0 2023-12-16T03:15:52.531 INFO:tasks.workunit.client.1.smithi184.stdout:4/216: dwrite d1/d12/f17 [0,4194304] 0 2023-12-16T03:15:52.538 INFO:tasks.workunit.client.1.smithi184.stdout:2/173: sync 2023-12-16T03:15:52.539 INFO:tasks.workunit.client.1.smithi184.stdout:6/282: sync 2023-12-16T03:15:52.540 INFO:tasks.workunit.client.1.smithi184.stdout:6/283: creat d0/d5/d12/d1b/f51 x:0 0 0 2023-12-16T03:15:52.540 INFO:tasks.workunit.client.1.smithi184.stdout:6/284: symlink d0/d5/d22/d37/d45/l52 0 2023-12-16T03:15:52.541 INFO:tasks.workunit.client.1.smithi184.stdout:6/285: mkdir d0/d5/d22/d34/d53 0 2023-12-16T03:15:52.542 INFO:tasks.workunit.client.1.smithi184.stdout:6/286: mknod d0/d5/d12/d1b/d33/d3d/c54 0 2023-12-16T03:15:52.543 INFO:tasks.workunit.client.1.smithi184.stdout:6/287: rename d0/d5/d12/d1b/d33/f4e to d0/d36/f55 0 2023-12-16T03:15:52.547 INFO:tasks.workunit.client.1.smithi184.stdout:2/174: dread d3/d29/d2f/d2e/f7 [4194304,4194304] 0 2023-12-16T03:15:52.550 INFO:tasks.workunit.client.1.smithi184.stdout:6/288: dread d0/d5/d22/fa [0,4194304] 0 2023-12-16T03:15:52.550 INFO:tasks.workunit.client.1.smithi184.stdout:2/175: dread d3/d13/d28/f2c [0,4194304] 0 2023-12-16T03:15:52.551 INFO:tasks.workunit.client.1.smithi184.stdout:6/289: mknod d0/d5/d12/d1b/d33/c56 0 2023-12-16T03:15:52.552 INFO:tasks.workunit.client.1.smithi184.stdout:6/290: mknod d0/d5/d42/c57 0 2023-12-16T03:15:52.553 INFO:tasks.workunit.client.1.smithi184.stdout:6/291: write d0/d5/f2c [167475,69659] 0 2023-12-16T03:15:52.553 INFO:tasks.workunit.client.1.smithi184.stdout:2/176: mknod d3/d9/c39 0 2023-12-16T03:15:52.554 INFO:tasks.workunit.client.1.smithi184.stdout:6/292: creat d0/d5/d12/d1b/d33/f58 x:0 0 0 2023-12-16T03:15:52.554 INFO:tasks.workunit.client.1.smithi184.stdout:6/293: creat d0/d5/f59 x:0 0 0 2023-12-16T03:15:52.573 INFO:tasks.workunit.client.1.smithi184.stdout:2/177: dwrite d3/d29/d2f/d2e/fb [0,4194304] 0 2023-12-16T03:15:52.574 INFO:tasks.workunit.client.1.smithi184.stdout:6/294: dwrite d0/d5/d22/f29 [0,4194304] 0 2023-12-16T03:15:52.574 INFO:tasks.workunit.client.1.smithi184.stdout:6/295: getdents d0/d5/d22/d25/d3f 0 2023-12-16T03:15:52.574 INFO:tasks.workunit.client.1.smithi184.stdout:6/296: write d0/d5/f2c [258671,117964] 0 2023-12-16T03:15:52.574 INFO:tasks.workunit.client.1.smithi184.stdout:6/297: dread - d0/f31 zero size 2023-12-16T03:15:52.581 INFO:tasks.workunit.client.1.smithi184.stdout:6/298: getdents d0/d36 0 2023-12-16T03:15:52.583 INFO:tasks.workunit.client.1.smithi184.stdout:6/299: creat d0/d5/d22/d34/d53/f5a x:0 0 0 2023-12-16T03:15:52.583 INFO:tasks.workunit.client.1.smithi184.stdout:6/300: chown d0/d5/d22/d37/d40 8439 1 2023-12-16T03:15:52.583 INFO:tasks.workunit.client.1.smithi184.stdout:6/301: chown d0/d5/d12/d1b 16540 1 2023-12-16T03:15:52.587 INFO:tasks.workunit.client.1.smithi184.stdout:6/302: dread d0/d5/d22/fa [0,4194304] 0 2023-12-16T03:15:52.587 INFO:tasks.workunit.client.1.smithi184.stdout:6/303: creat d0/d5/d12/d1b/f5b x:0 0 0 2023-12-16T03:15:52.588 INFO:tasks.workunit.client.1.smithi184.stdout:6/304: creat d0/d5/d22/d25/d47/f5c x:0 0 0 2023-12-16T03:15:52.588 INFO:tasks.workunit.client.1.smithi184.stdout:6/305: write d0/d5/f59 [909344,4275] 0 2023-12-16T03:15:52.589 INFO:tasks.workunit.client.1.smithi184.stdout:6/306: creat d0/d5/d22/d37/d4d/f5d x:0 0 0 2023-12-16T03:15:52.589 INFO:tasks.workunit.client.1.smithi184.stdout:6/307: chown d0/d5/d22/d25/d3f 730159301 1 2023-12-16T03:15:52.591 INFO:tasks.workunit.client.1.smithi184.stdout:2/178: dwrite d3/f4 [0,4194304] 0 2023-12-16T03:15:52.592 INFO:tasks.workunit.client.1.smithi184.stdout:2/179: creat d3/d29/d2f/d2e/f3a x:0 0 0 2023-12-16T03:15:52.595 INFO:tasks.workunit.client.1.smithi184.stdout:6/308: dread d0/d5/f59 [0,4194304] 0 2023-12-16T03:15:52.598 INFO:tasks.workunit.client.1.smithi184.stdout:6/309: fsync d0/d5/f2c 0 2023-12-16T03:15:52.617 INFO:tasks.workunit.client.1.smithi184.stdout:6/310: dwrite d0/d36/f55 [0,4194304] 0 2023-12-16T03:15:52.618 INFO:tasks.workunit.client.1.smithi184.stdout:2/180: dwrite d3/d13/d28/f2c [0,4194304] 0 2023-12-16T03:15:52.619 INFO:tasks.workunit.client.1.smithi184.stdout:6/311: mknod d0/d5/d22/d37/c5e 0 2023-12-16T03:15:52.619 INFO:tasks.workunit.client.1.smithi184.stdout:6/312: write d0/d5/d22/d25/d47/f5c [961575,85171] 0 2023-12-16T03:15:52.620 INFO:tasks.workunit.client.1.smithi184.stdout:6/313: dread - d0/d5/d22/d37/d4d/f5d zero size 2023-12-16T03:15:52.621 INFO:tasks.workunit.client.1.smithi184.stdout:6/314: creat d0/d5/d22/d25/f5f x:0 0 0 2023-12-16T03:15:52.621 INFO:tasks.workunit.client.1.smithi184.stdout:2/181: dread d3/d9/d19/f26 [0,4194304] 0 2023-12-16T03:15:52.622 INFO:tasks.workunit.client.1.smithi184.stdout:6/315: mknod d0/d5/d22/c60 0 2023-12-16T03:15:52.623 INFO:tasks.workunit.client.1.smithi184.stdout:2/182: getdents d3/d9/d19 0 2023-12-16T03:15:52.624 INFO:tasks.workunit.client.1.smithi184.stdout:6/316: mknod d0/d5/d22/d25/c61 0 2023-12-16T03:15:52.624 INFO:tasks.workunit.client.1.smithi184.stdout:2/183: creat d3/d9/f3b x:0 0 0 2023-12-16T03:15:52.625 INFO:tasks.workunit.client.1.smithi184.stdout:6/317: creat d0/d5/d26/f62 x:0 0 0 2023-12-16T03:15:52.625 INFO:tasks.workunit.client.1.smithi184.stdout:2/184: write d3/d13/d28/f2c [1436280,75457] 0 2023-12-16T03:15:52.626 INFO:tasks.workunit.client.1.smithi184.stdout:2/185: readlink d3/d13/d28/l2b 0 2023-12-16T03:15:52.626 INFO:tasks.workunit.client.1.smithi184.stdout:6/318: symlink d0/d5/d12/d1b/d33/l63 0 2023-12-16T03:15:52.626 INFO:tasks.workunit.client.1.smithi184.stdout:6/319: chown d0/d5/d42 9 1 2023-12-16T03:15:52.627 INFO:tasks.workunit.client.1.smithi184.stdout:2/186: creat d3/f3c x:0 0 0 2023-12-16T03:15:52.627 INFO:tasks.workunit.client.1.smithi184.stdout:6/320: creat d0/d5/d22/d25/d47/f64 x:0 0 0 2023-12-16T03:15:52.627 INFO:tasks.workunit.client.1.smithi184.stdout:2/187: read d3/d29/d2f/d2e/f1b [2921984,1963] 0 2023-12-16T03:15:52.628 INFO:tasks.workunit.client.1.smithi184.stdout:2/188: symlink d3/d29/d2f/d31/l3d 0 2023-12-16T03:15:52.629 INFO:tasks.workunit.client.1.smithi184.stdout:2/189: creat d3/d13/d28/f3e x:0 0 0 2023-12-16T03:15:52.629 INFO:tasks.workunit.client.1.smithi184.stdout:2/190: read d3/d29/d2f/f22 [598405,30413] 0 2023-12-16T03:15:52.630 INFO:tasks.workunit.client.1.smithi184.stdout:2/191: mknod d3/d9/d19/c3f 0 2023-12-16T03:15:52.636 INFO:tasks.workunit.client.1.smithi184.stdout:2/192: fdatasync d3/d13/d28/f2c 0 2023-12-16T03:15:52.636 INFO:tasks.workunit.client.1.smithi184.stdout:2/193: dread - d3/d29/f2d zero size 2023-12-16T03:15:52.638 INFO:tasks.workunit.client.1.smithi184.stdout:2/194: symlink d3/d13/d28/l40 0 2023-12-16T03:15:52.643 INFO:tasks.workunit.client.1.smithi184.stdout:6/321: dwrite d0/d5/d12/d1b/f4c [0,4194304] 0 2023-12-16T03:15:52.647 INFO:tasks.workunit.client.1.smithi184.stdout:6/322: symlink d0/d5/d12/d1b/d33/d3d/l65 0 2023-12-16T03:15:52.647 INFO:tasks.workunit.client.1.smithi184.stdout:6/323: stat d0/d5/d22/d37/d45 0 2023-12-16T03:15:52.647 INFO:tasks.workunit.client.1.smithi184.stdout:6/324: fdatasync d0/d5/f24 0 2023-12-16T03:15:52.647 INFO:tasks.workunit.client.1.smithi184.stdout:6/325: write d0/d5/d22/fa [3954805,7751] 0 2023-12-16T03:15:52.649 INFO:tasks.workunit.client.1.smithi184.stdout:6/326: link d0/d5/d12/d1b/d33/l63 d0/d5/d22/d25/l66 0 2023-12-16T03:15:52.649 INFO:tasks.workunit.client.1.smithi184.stdout:6/327: readlink d0/d5/d12/d1b/l1e 0 2023-12-16T03:15:52.662 INFO:tasks.workunit.client.1.smithi184.stdout:2/195: dwrite d3/d9/f27 [0,4194304] 0 2023-12-16T03:15:52.665 INFO:tasks.workunit.client.1.smithi184.stdout:2/196: write d3/fd [7449186,127933] 0 2023-12-16T03:15:52.665 INFO:tasks.workunit.client.1.smithi184.stdout:6/328: dwrite d0/d5/d12/d1b/d33/f58 [0,4194304] 0 2023-12-16T03:15:52.668 INFO:tasks.workunit.client.1.smithi184.stdout:6/329: read d0/d36/f55 [1244018,125572] 0 2023-12-16T03:15:52.668 INFO:tasks.workunit.client.1.smithi184.stdout:6/330: chown d0/d5/d42 53609 1 2023-12-16T03:15:52.670 INFO:tasks.workunit.client.1.smithi184.stdout:6/331: rename d0/d5/d12/d1b/d33/d3d/c43 to d0/c67 0 2023-12-16T03:15:52.671 INFO:tasks.workunit.client.1.smithi184.stdout:6/332: creat d0/d5/d42/f68 x:0 0 0 2023-12-16T03:15:52.671 INFO:tasks.workunit.client.1.smithi184.stdout:6/333: write d0/d5/f24 [511410,19330] 0 2023-12-16T03:15:52.673 INFO:tasks.workunit.client.1.smithi184.stdout:6/334: rmdir d0/d5/d22/d37/d4d 39 2023-12-16T03:15:52.673 INFO:tasks.workunit.client.1.smithi184.stdout:6/335: write d0/d5/d22/d25/d47/f5c [1908293,102517] 0 2023-12-16T03:15:52.673 INFO:tasks.workunit.client.1.smithi184.stdout:6/336: write d0/d5/d22/f3c [387769,126427] 0 2023-12-16T03:15:52.675 INFO:tasks.workunit.client.1.smithi184.stdout:6/337: mknod d0/d5/d22/d34/c69 0 2023-12-16T03:15:52.677 INFO:tasks.workunit.client.1.smithi184.stdout:6/338: symlink d0/d5/d22/d25/l6a 0 2023-12-16T03:15:52.677 INFO:tasks.workunit.client.1.smithi184.stdout:6/339: mknod d0/d5/d26/c6b 0 2023-12-16T03:15:52.679 INFO:tasks.workunit.client.1.smithi184.stdout:6/340: getdents d0/d5/d22/d25/d47 0 2023-12-16T03:15:52.680 INFO:tasks.workunit.client.1.smithi184.stdout:6/341: creat d0/d5/d12/d1b/d33/f6c x:0 0 0 2023-12-16T03:15:52.683 INFO:tasks.workunit.client.1.smithi184.stdout:6/342: read d0/d5/d22/f41 [3582323,75595] 0 2023-12-16T03:15:52.684 INFO:tasks.workunit.client.1.smithi184.stdout:2/197: dwrite d3/d29/d2f/d2e/fa [4194304,4194304] 0 2023-12-16T03:15:52.688 INFO:tasks.workunit.client.1.smithi184.stdout:2/198: rename d3/d29/d2f/c33 to d3/c41 0 2023-12-16T03:15:52.688 INFO:tasks.workunit.client.1.smithi184.stdout:6/343: fsync d0/d5/d12/d1b/d33/f6c 0 2023-12-16T03:15:52.688 INFO:tasks.workunit.client.1.smithi184.stdout:6/344: fdatasync d0/d5/d12/d1b/d33/f6c 0 2023-12-16T03:15:52.688 INFO:tasks.workunit.client.1.smithi184.stdout:6/345: write d0/d5/f24 [878091,66787] 0 2023-12-16T03:15:52.689 INFO:tasks.workunit.client.1.smithi184.stdout:2/199: symlink d3/d29/d2f/l42 0 2023-12-16T03:15:52.690 INFO:tasks.workunit.client.1.smithi184.stdout:6/346: symlink d0/d5/d22/d37/d40/l6d 0 2023-12-16T03:15:52.690 INFO:tasks.workunit.client.1.smithi184.stdout:6/347: write d0/f18 [2033959,25829] 0 2023-12-16T03:15:52.692 INFO:tasks.workunit.client.1.smithi184.stdout:6/348: creat d0/d5/d22/d25/d47/f6e x:0 0 0 2023-12-16T03:15:52.692 INFO:tasks.workunit.client.1.smithi184.stdout:6/349: dread - d0/d5/d22/d25/f5f zero size 2023-12-16T03:15:52.694 INFO:tasks.workunit.client.1.smithi184.stdout:6/350: truncate d0/d5/d12/d1b/d33/f58 3742202 0 2023-12-16T03:15:52.694 INFO:tasks.workunit.client.1.smithi184.stdout:6/351: write d0/d5/f4a [532991,22626] 0 2023-12-16T03:15:52.694 INFO:tasks.workunit.client.1.smithi184.stdout:2/200: dread d3/d29/d2f/d2e/f7 [4194304,4194304] 0 2023-12-16T03:15:52.695 INFO:tasks.workunit.client.1.smithi184.stdout:6/352: mkdir d0/d5/d22/d25/d3f/d6f 0 2023-12-16T03:15:52.697 INFO:tasks.workunit.client.1.smithi184.stdout:6/353: mknod d0/d5/d22/d25/c70 0 2023-12-16T03:15:52.700 INFO:tasks.workunit.client.1.smithi184.stdout:2/201: unlink d3/l10 0 2023-12-16T03:15:52.719 INFO:tasks.workunit.client.1.smithi184.stdout:0/373: sync 2023-12-16T03:15:52.719 INFO:tasks.workunit.client.1.smithi184.stdout:3/315: sync 2023-12-16T03:15:52.719 INFO:tasks.workunit.client.1.smithi184.stdout:7/312: sync 2023-12-16T03:15:52.719 INFO:tasks.workunit.client.1.smithi184.stdout:7/313: read - d0/df/d1e/f42 zero size 2023-12-16T03:15:52.721 INFO:tasks.workunit.client.1.smithi184.stdout:7/314: creat d0/df/d36/d3f/f5b x:0 0 0 2023-12-16T03:15:52.728 INFO:tasks.workunit.client.1.smithi184.stdout:2/202: dwrite d3/d9/f27 [0,4194304] 0 2023-12-16T03:15:52.731 INFO:tasks.workunit.client.1.smithi184.stdout:7/315: write d0/df/f2a [3065809,109699] 0 2023-12-16T03:15:52.735 INFO:tasks.workunit.client.1.smithi184.stdout:0/374: dread dc/f58 [0,4194304] 0 2023-12-16T03:15:52.768 INFO:tasks.workunit.client.1.smithi184.stdout:2/203: dwrite d3/d29/d2f/d2e/f3a [0,4194304] 0 2023-12-16T03:15:52.768 INFO:tasks.workunit.client.1.smithi184.stdout:7/316: dwrite d0/d3/d2e/f3a [0,4194304] 0 2023-12-16T03:15:52.768 INFO:tasks.workunit.client.1.smithi184.stdout:7/317: fdatasync d0/d3/f7 0 2023-12-16T03:15:52.768 INFO:tasks.workunit.client.1.smithi184.stdout:0/375: dwrite dc/d22/d48/f5b [0,4194304] 0 2023-12-16T03:15:52.768 INFO:tasks.workunit.client.1.smithi184.stdout:3/316: dwrite d12/d18/d1f/d23/d2a/d42/d52/f58 [0,4194304] 0 2023-12-16T03:15:52.768 INFO:tasks.workunit.client.1.smithi184.stdout:3/317: chown d12/d18/d1f/d23/d51 2935513 1 2023-12-16T03:15:52.769 INFO:tasks.workunit.client.1.smithi184.stdout:7/318: write d0/d3/f5 [1886252,64208] 0 2023-12-16T03:15:52.769 INFO:tasks.workunit.client.1.smithi184.stdout:7/319: chown d0/d3/c30 91285824 1 2023-12-16T03:15:52.772 INFO:tasks.workunit.client.1.smithi184.stdout:0/376: creat dc/d22/d1d/d2c/d75/f78 x:0 0 0 2023-12-16T03:15:52.772 INFO:tasks.workunit.client.1.smithi184.stdout:0/377: write dc/d10/d1c/f21 [384121,106088] 0 2023-12-16T03:15:52.772 INFO:tasks.workunit.client.1.smithi184.stdout:3/318: mkdir d12/d18/d1f/d23/d2a/d42/d52/d76 0 2023-12-16T03:15:52.772 INFO:tasks.workunit.client.1.smithi184.stdout:3/319: chown d12/d37/f67 15960 1 2023-12-16T03:15:52.774 INFO:tasks.workunit.client.1.smithi184.stdout:7/320: symlink d0/df/d36/l5c 0 2023-12-16T03:15:52.775 INFO:tasks.workunit.client.1.smithi184.stdout:3/320: symlink d12/d18/d1f/d23/d2a/d3e/l77 0 2023-12-16T03:15:52.775 INFO:tasks.workunit.client.1.smithi184.stdout:3/321: read d12/d18/d1f/d23/d2a/d4a/d61/f72 [95960,85223] 0 2023-12-16T03:15:52.775 INFO:tasks.workunit.client.1.smithi184.stdout:7/321: dread d0/df/d1e/f2d [0,4194304] 0 2023-12-16T03:15:52.782 INFO:tasks.workunit.client.1.smithi184.stdout:0/378: dread dc/d22/d1d/f40 [0,4194304] 0 2023-12-16T03:15:52.802 INFO:tasks.workunit.client.1.smithi184.stdout:7/322: dwrite d0/df/d1e/f2d [0,4194304] 0 2023-12-16T03:15:52.802 INFO:tasks.workunit.client.1.smithi184.stdout:3/322: dwrite d12/d18/d1f/f44 [0,4194304] 0 2023-12-16T03:15:52.803 INFO:tasks.workunit.client.1.smithi184.stdout:3/323: truncate fd 4323510 0 2023-12-16T03:15:52.803 INFO:tasks.workunit.client.1.smithi184.stdout:3/324: write d12/d18/d1f/d23/d2a/d36/f5b [465617,94600] 0 2023-12-16T03:15:52.804 INFO:tasks.workunit.client.1.smithi184.stdout:3/325: mknod d12/d1e/c78 0 2023-12-16T03:15:52.804 INFO:tasks.workunit.client.1.smithi184.stdout:3/326: creat d12/d18/d1f/d23/d51/f79 x:0 0 0 2023-12-16T03:15:52.805 INFO:tasks.workunit.client.1.smithi184.stdout:3/327: mkdir d12/d18/d7a 0 2023-12-16T03:15:52.806 INFO:tasks.workunit.client.1.smithi184.stdout:3/328: mkdir d12/d18/d1f/d23/d2a/d3e/d48/d7b 0 2023-12-16T03:15:52.807 INFO:tasks.workunit.client.1.smithi184.stdout:3/329: creat d12/d18/f7c x:0 0 0 2023-12-16T03:15:52.808 INFO:tasks.workunit.client.1.smithi184.stdout:3/330: mknod d12/d18/d1f/d23/d2a/d4a/c7d 0 2023-12-16T03:15:52.808 INFO:tasks.workunit.client.1.smithi184.stdout:3/331: read - d12/d18/d1f/d23/d2a/d3e/d48/f70 zero size 2023-12-16T03:15:52.824 INFO:tasks.workunit.client.1.smithi184.stdout:3/332: dwrite d12/d18/d1f/d3a/f60 [0,4194304] 0 2023-12-16T03:15:52.826 INFO:tasks.workunit.client.1.smithi184.stdout:3/333: rename c5 to d12/d18/d1f/d23/d2a/d4a/c7e 0 2023-12-16T03:15:52.827 INFO:tasks.workunit.client.1.smithi184.stdout:3/334: mkdir d12/d18/d1f/d23/d2a/d42/d52/d7f 0 2023-12-16T03:15:52.829 INFO:tasks.workunit.client.1.smithi184.stdout:3/335: rename d12/d18/d1f/d3a to d12/d18/d1f/d23/d2a/d42/d52/d76/d80 0 2023-12-16T03:15:52.845 INFO:tasks.workunit.client.1.smithi184.stdout:3/336: dwrite d12/d1e/f20 [0,4194304] 0 2023-12-16T03:15:52.846 INFO:tasks.workunit.client.1.smithi184.stdout:3/337: unlink d12/l26 0 2023-12-16T03:15:52.863 INFO:tasks.workunit.client.1.smithi184.stdout:3/338: dwrite d12/d18/d68/f6e [0,4194304] 0 2023-12-16T03:15:52.864 INFO:tasks.workunit.client.1.smithi184.stdout:3/339: mkdir d12/d37/d81 0 2023-12-16T03:15:52.865 INFO:tasks.workunit.client.1.smithi184.stdout:3/340: symlink d12/d18/d1f/d23/d2a/d3e/d48/l82 0 2023-12-16T03:15:52.867 INFO:tasks.workunit.client.1.smithi184.stdout:3/341: symlink d12/d18/d1f/d23/d2a/d3e/d48/l83 0 2023-12-16T03:15:52.869 INFO:tasks.workunit.client.1.smithi184.stdout:3/342: mkdir d12/d18/d84 0 2023-12-16T03:15:52.871 INFO:tasks.workunit.client.1.smithi184.stdout:3/343: creat d12/d18/d1f/d23/d2a/d3e/d48/d7b/f85 x:0 0 0 2023-12-16T03:15:52.872 INFO:tasks.workunit.client.1.smithi184.stdout:3/344: write d12/d18/d1f/f44 [2320374,127531] 0 2023-12-16T03:15:52.874 INFO:tasks.workunit.client.1.smithi184.stdout:3/345: mkdir d12/d86 0 2023-12-16T03:15:52.889 INFO:tasks.workunit.client.1.smithi184.stdout:3/346: dwrite d12/d37/f67 [0,4194304] 0 2023-12-16T03:15:52.890 INFO:tasks.workunit.client.1.smithi184.stdout:3/347: creat d12/d37/d81/f87 x:0 0 0 2023-12-16T03:15:52.892 INFO:tasks.workunit.client.1.smithi184.stdout:3/348: rename d12/d18/f21 to d12/d18/d1f/d23/d2a/d3e/d48/f88 0 2023-12-16T03:15:52.893 INFO:tasks.workunit.client.1.smithi184.stdout:3/349: mkdir d12/d1e/d89 0 2023-12-16T03:15:52.962 INFO:tasks.workunit.client.1.smithi184.stdout:5/101: sync 2023-12-16T03:15:52.962 INFO:tasks.workunit.client.1.smithi184.stdout:1/316: sync 2023-12-16T03:15:52.963 INFO:tasks.workunit.client.1.smithi184.stdout:1/317: rename d3/f47 to d3/d28/d3c/d41/d46/f69 0 2023-12-16T03:15:52.964 INFO:tasks.workunit.client.1.smithi184.stdout:5/102: creat d1/d3/d9/de/d15/d19/f1d x:0 0 0 2023-12-16T03:15:52.965 INFO:tasks.workunit.client.1.smithi184.stdout:1/318: unlink d3/c3e 0 2023-12-16T03:15:52.965 INFO:tasks.workunit.client.1.smithi184.stdout:1/319: write d3/d34/f65 [616626,78818] 0 2023-12-16T03:15:52.966 INFO:tasks.workunit.client.1.smithi184.stdout:5/103: creat d1/d3/d9/de/d15/f1e x:0 0 0 2023-12-16T03:15:52.967 INFO:tasks.workunit.client.1.smithi184.stdout:5/104: mknod d1/d3/d9/de/d15/d1b/c1f 0 2023-12-16T03:15:52.968 INFO:tasks.workunit.client.1.smithi184.stdout:5/105: truncate d1/d3/fa 1437430 0 2023-12-16T03:15:52.968 INFO:tasks.workunit.client.1.smithi184.stdout:5/106: chown d1/f1a 3099 1 2023-12-16T03:15:52.968 INFO:tasks.workunit.client.1.smithi184.stdout:5/107: fdatasync d1/d3/fa 0 2023-12-16T03:15:52.970 INFO:tasks.workunit.client.1.smithi184.stdout:5/108: symlink d1/d3/d9/de/d15/d19/l20 0 2023-12-16T03:15:52.971 INFO:tasks.workunit.client.1.smithi184.stdout:5/109: symlink d1/d3/d9/de/d15/l21 0 2023-12-16T03:15:52.972 INFO:tasks.workunit.client.1.smithi184.stdout:5/110: stat d1/d3/d9 0 2023-12-16T03:15:52.973 INFO:tasks.workunit.client.1.smithi184.stdout:5/111: link d1/d3/d9/de/d15/d1b/c1f d1/d3/c22 0 2023-12-16T03:15:52.978 INFO:tasks.workunit.client.1.smithi184.stdout:5/112: dread d1/d3/fd [0,4194304] 0 2023-12-16T03:15:52.980 INFO:tasks.workunit.client.1.smithi184.stdout:1/320: dwrite d3/d28/d3c/d41/d63/f64 [0,4194304] 0 2023-12-16T03:15:52.980 INFO:tasks.workunit.client.1.smithi184.stdout:1/321: fdatasync d3/d28/d3c/f35 0 2023-12-16T03:15:52.980 INFO:tasks.workunit.client.1.smithi184.stdout:5/113: link d1/d3/fd d1/d3/d9/de/d15/d19/f23 0 2023-12-16T03:15:52.983 INFO:tasks.workunit.client.1.smithi184.stdout:1/322: mkdir d3/d28/d3c/d41/d46/d4a/d6a 0 2023-12-16T03:15:52.984 INFO:tasks.workunit.client.1.smithi184.stdout:5/114: symlink d1/d3/d11/l24 0 2023-12-16T03:15:52.986 INFO:tasks.workunit.client.1.smithi184.stdout:1/323: mknod d3/d28/d3c/d41/d63/c6b 0 2023-12-16T03:15:52.986 INFO:tasks.workunit.client.1.smithi184.stdout:1/324: fsync d3/d28/d3c/f25 0 2023-12-16T03:15:52.986 INFO:tasks.workunit.client.1.smithi184.stdout:1/325: truncate d3/d13/f5f 542515 0 2023-12-16T03:15:52.989 INFO:tasks.workunit.client.1.smithi184.stdout:1/326: creat d3/d28/d38/d52/f6c x:0 0 0 2023-12-16T03:15:52.994 INFO:tasks.workunit.client.1.smithi184.stdout:5/115: mknod d1/c25 0 2023-12-16T03:15:52.994 INFO:tasks.workunit.client.1.smithi184.stdout:5/116: write d1/d3/d9/f18 [1736037,6070] 0 2023-12-16T03:15:52.994 INFO:tasks.workunit.client.1.smithi184.stdout:5/117: dread - d1/f1a zero size 2023-12-16T03:15:52.994 INFO:tasks.workunit.client.1.smithi184.stdout:5/118: truncate d1/d3/fd 3392285 0 2023-12-16T03:15:52.995 INFO:tasks.workunit.client.1.smithi184.stdout:5/119: mknod d1/d3/d9/de/c26 0 2023-12-16T03:15:53.011 INFO:tasks.workunit.client.1.smithi184.stdout:1/327: dwrite d3/d28/d38/d52/f6c [0,4194304] 0 2023-12-16T03:15:53.011 INFO:tasks.workunit.client.1.smithi184.stdout:5/120: dwrite d1/d3/d9/de/f16 [0,4194304] 0 2023-12-16T03:15:53.011 INFO:tasks.workunit.client.1.smithi184.stdout:5/121: chown d1/d3/d9/de/d15/l21 49654522 1 2023-12-16T03:15:53.013 INFO:tasks.workunit.client.1.smithi184.stdout:1/328: mkdir d3/d28/d3c/d41/d46/d4a/d6a/d6d 0 2023-12-16T03:15:53.013 INFO:tasks.workunit.client.1.smithi184.stdout:1/329: fdatasync d3/ff 0 2023-12-16T03:15:53.014 INFO:tasks.workunit.client.1.smithi184.stdout:5/122: mkdir d1/d3/d9/de/d15/d27 0 2023-12-16T03:15:53.015 INFO:tasks.workunit.client.1.smithi184.stdout:5/123: read d1/d3/d11/f12 [2833155,103412] 0 2023-12-16T03:15:53.021 INFO:tasks.workunit.client.1.smithi184.stdout:5/124: dread d1/d3/fd [0,4194304] 0 2023-12-16T03:15:53.021 INFO:tasks.workunit.client.1.smithi184.stdout:5/125: chown d1/d3/d9/de/f16 5188171 1 2023-12-16T03:15:53.021 INFO:tasks.workunit.client.1.smithi184.stdout:5/126: getdents d1/d3/d11 0 2023-12-16T03:15:53.021 INFO:tasks.workunit.client.1.smithi184.stdout:5/127: write d1/d3/d9/de/f16 [5073276,130934] 0 2023-12-16T03:15:53.023 INFO:tasks.workunit.client.1.smithi184.stdout:5/128: rmdir d1/d3/d9/de 39 2023-12-16T03:15:53.024 INFO:tasks.workunit.client.1.smithi184.stdout:5/129: mkdir d1/d3/d9/de/d15/d1b/d28 0 2023-12-16T03:15:53.026 INFO:tasks.workunit.client.1.smithi184.stdout:5/130: rmdir d1/d3/d9 39 2023-12-16T03:15:53.029 INFO:tasks.workunit.client.1.smithi184.stdout:5/131: dread d1/d3/fa [0,4194304] 0 2023-12-16T03:15:53.029 INFO:tasks.workunit.client.1.smithi184.stdout:5/132: getdents d1/d3/d9/de/d15/d1b/d28 0 2023-12-16T03:15:53.030 INFO:tasks.workunit.client.1.smithi184.stdout:5/133: write d1/d3/d9/de/f1c [142687,46417] 0 2023-12-16T03:15:53.030 INFO:tasks.workunit.client.1.smithi184.stdout:5/134: write d1/d3/d9/de/d15/d19/f23 [3709341,92807] 0 2023-12-16T03:15:53.031 INFO:tasks.workunit.client.1.smithi184.stdout:5/135: rename d1/d3/d11/f12 to d1/f29 0 2023-12-16T03:15:53.035 INFO:tasks.workunit.client.1.smithi184.stdout:5/136: rename d1/d3/d11 to d1/d2a 0 2023-12-16T03:15:53.036 INFO:tasks.workunit.client.1.smithi184.stdout:5/137: symlink d1/d3/d9/de/d15/d1b/l2b 0 2023-12-16T03:15:53.036 INFO:tasks.workunit.client.1.smithi184.stdout:5/138: rmdir d1/d3/d9 39 2023-12-16T03:15:53.037 INFO:tasks.workunit.client.1.smithi184.stdout:5/139: creat d1/d3/d9/de/d15/d19/f2c x:0 0 0 2023-12-16T03:15:53.084 INFO:tasks.workunit.client.0.smithi064.stdout:2/21: creat d1/f5 x:0 0 0 2023-12-16T03:15:53.084 INFO:tasks.workunit.client.0.smithi064.stdout:2/22: read d1/f3 [133395,15465] 0 2023-12-16T03:15:53.084 INFO:tasks.workunit.client.0.smithi064.stdout:8/13: mknod d0/c4 0 2023-12-16T03:15:53.084 INFO:tasks.workunit.client.0.smithi064.stdout:9/9: symlink d2/l4 0 2023-12-16T03:15:53.085 INFO:tasks.workunit.client.0.smithi064.stdout:9/10: truncate f1 1016818 0 2023-12-16T03:15:53.085 INFO:tasks.workunit.client.0.smithi064.stdout:0/15: symlink d2/l4 0 2023-12-16T03:15:53.085 INFO:tasks.workunit.client.0.smithi064.stdout:0/16: dread - d2/f3 zero size 2023-12-16T03:15:53.086 INFO:tasks.workunit.client.0.smithi064.stdout:0/17: write f1 [4299936,35625] 0 2023-12-16T03:15:53.086 INFO:tasks.workunit.client.0.smithi064.stdout:5/16: mknod d0/c4 0 2023-12-16T03:15:53.089 INFO:tasks.workunit.client.0.smithi064.stdout:7/9: unlink f1 0 2023-12-16T03:15:53.091 INFO:tasks.workunit.client.0.smithi064.stdout:5/17: link d0/f3 d0/f5 0 2023-12-16T03:15:53.092 INFO:tasks.workunit.client.0.smithi064.stdout:7/10: symlink l3 0 2023-12-16T03:15:53.092 INFO:tasks.workunit.client.0.smithi064.stdout:7/11: dread - no filename 2023-12-16T03:15:53.092 INFO:tasks.workunit.client.0.smithi064.stdout:7/12: dread - no filename 2023-12-16T03:15:53.092 INFO:tasks.workunit.client.0.smithi064.stdout:5/18: mknod d0/c6 0 2023-12-16T03:15:53.093 INFO:tasks.workunit.client.0.smithi064.stdout:7/13: creat f4 x:0 0 0 2023-12-16T03:15:53.093 INFO:tasks.workunit.client.0.smithi064.stdout:7/14: fdatasync f4 0 2023-12-16T03:15:53.093 INFO:tasks.workunit.client.0.smithi064.stdout:5/19: dread d0/f5 [0,4194304] 0 2023-12-16T03:15:53.094 INFO:tasks.workunit.client.0.smithi064.stdout:7/15: creat f5 x:0 0 0 2023-12-16T03:15:53.094 INFO:tasks.workunit.client.0.smithi064.stdout:7/16: rmdir - no directory 2023-12-16T03:15:53.094 INFO:tasks.workunit.client.0.smithi064.stdout:5/20: mkdir d0/d7 0 2023-12-16T03:15:53.095 INFO:tasks.workunit.client.0.smithi064.stdout:5/21: rmdir d0 39 2023-12-16T03:15:53.095 INFO:tasks.workunit.client.0.smithi064.stdout:5/22: chown d0 1204191 1 2023-12-16T03:15:53.095 INFO:tasks.workunit.client.0.smithi064.stdout:5/23: rename d0 to d0/d8 22 2023-12-16T03:15:53.096 INFO:tasks.workunit.client.0.smithi064.stdout:7/17: link l0 l6 0 2023-12-16T03:15:53.097 INFO:tasks.workunit.client.0.smithi064.stdout:5/24: symlink d0/l9 0 2023-12-16T03:15:53.097 INFO:tasks.workunit.client.0.smithi064.stdout:5/25: truncate d0/f3 327011 0 2023-12-16T03:15:53.097 INFO:tasks.workunit.client.0.smithi064.stdout:7/18: mkdir d7 0 2023-12-16T03:15:53.098 INFO:tasks.workunit.client.0.smithi064.stdout:7/19: write f4 [812719,80875] 0 2023-12-16T03:15:53.100 INFO:tasks.workunit.client.0.smithi064.stdout:5/26: read d0/f5 [79951,49519] 0 2023-12-16T03:15:53.100 INFO:tasks.workunit.client.0.smithi064.stdout:0/18: dread f1 [0,4194304] 0 2023-12-16T03:15:53.100 INFO:tasks.workunit.client.0.smithi064.stdout:5/27: creat d0/d7/fa x:0 0 0 2023-12-16T03:15:53.103 INFO:tasks.workunit.client.0.smithi064.stdout:3/17: dwrite f3 [0,4194304] 0 2023-12-16T03:15:53.103 INFO:tasks.workunit.client.0.smithi064.stdout:3/18: chown f4 1643881173 1 2023-12-16T03:15:53.113 INFO:tasks.workunit.client.0.smithi064.stdout:3/19: dread f3 [0,4194304] 0 2023-12-16T03:15:53.115 INFO:tasks.workunit.client.0.smithi064.stdout:3/20: symlink l5 0 2023-12-16T03:15:53.116 INFO:tasks.workunit.client.0.smithi064.stdout:3/21: rename f3 to f6 0 2023-12-16T03:15:53.117 INFO:tasks.workunit.client.0.smithi064.stdout:3/22: link l5 l7 0 2023-12-16T03:15:53.118 INFO:tasks.workunit.client.0.smithi064.stdout:3/23: chown l2 115991010 1 2023-12-16T03:15:53.118 INFO:tasks.workunit.client.0.smithi064.stdout:3/24: mknod c8 0 2023-12-16T03:15:53.118 INFO:tasks.workunit.client.0.smithi064.stdout:3/25: read f6 [1780636,20212] 0 2023-12-16T03:15:53.119 INFO:tasks.workunit.client.0.smithi064.stdout:3/26: mknod c9 0 2023-12-16T03:15:53.119 INFO:tasks.workunit.client.0.smithi064.stdout:3/27: chown l7 1312113 1 2023-12-16T03:15:53.119 INFO:tasks.workunit.client.0.smithi064.stdout:3/28: fdatasync f6 0 2023-12-16T03:15:53.120 INFO:tasks.workunit.client.0.smithi064.stdout:3/29: rename c9 to ca 0 2023-12-16T03:15:53.123 INFO:tasks.workunit.client.0.smithi064.stdout:3/30: dread f6 [0,4194304] 0 2023-12-16T03:15:53.123 INFO:tasks.workunit.client.0.smithi064.stdout:5/28: dwrite d0/d7/fa [0,4194304] 0 2023-12-16T03:15:53.123 INFO:tasks.workunit.client.0.smithi064.stdout:7/20: dwrite f4 [0,4194304] 0 2023-12-16T03:15:53.123 INFO:tasks.workunit.client.0.smithi064.stdout:7/21: readlink l0 0 2023-12-16T03:15:53.125 INFO:tasks.workunit.client.0.smithi064.stdout:3/31: mkdir db 0 2023-12-16T03:15:53.125 INFO:tasks.workunit.client.0.smithi064.stdout:3/32: stat f0 0 2023-12-16T03:15:53.125 INFO:tasks.workunit.client.0.smithi064.stdout:3/33: chown f0 127 1 2023-12-16T03:15:53.128 INFO:tasks.workunit.client.0.smithi064.stdout:3/34: creat db/fc x:0 0 0 2023-12-16T03:15:53.128 INFO:tasks.workunit.client.0.smithi064.stdout:3/35: truncate f4 905060 0 2023-12-16T03:15:53.141 INFO:tasks.workunit.client.0.smithi064.stdout:7/22: dwrite f4 [0,4194304] 0 2023-12-16T03:15:53.141 INFO:tasks.workunit.client.0.smithi064.stdout:7/23: symlink d7/l8 0 2023-12-16T03:15:53.143 INFO:tasks.workunit.client.0.smithi064.stdout:7/24: creat d7/f9 x:0 0 0 2023-12-16T03:15:53.143 INFO:tasks.workunit.client.0.smithi064.stdout:7/25: stat f5 0 2023-12-16T03:15:53.144 INFO:tasks.workunit.client.1.smithi184.stdout:4/217: sync 2023-12-16T03:15:53.144 INFO:tasks.workunit.client.1.smithi184.stdout:8/294: sync 2023-12-16T03:15:53.144 INFO:tasks.workunit.client.1.smithi184.stdout:9/412: sync 2023-12-16T03:15:53.144 INFO:tasks.workunit.client.1.smithi184.stdout:8/295: write d2/d12/f58 [183890,64717] 0 2023-12-16T03:15:53.144 INFO:tasks.workunit.client.1.smithi184.stdout:8/296: readlink d2/d12/d21/d30/l49 0 2023-12-16T03:15:53.145 INFO:tasks.workunit.client.1.smithi184.stdout:8/297: write d2/fc [1609640,4048] 0 2023-12-16T03:15:53.145 INFO:tasks.workunit.client.1.smithi184.stdout:8/298: dread - d2/d4/f40 zero size 2023-12-16T03:15:53.145 INFO:tasks.workunit.client.1.smithi184.stdout:9/413: mknod d0/d13/d20/d77/c8c 0 2023-12-16T03:15:53.148 INFO:tasks.workunit.client.1.smithi184.stdout:8/299: rename d2/d12/d21/d2d/d31/d52 to d2/d12/d21/d2d/d31/d5e 0 2023-12-16T03:15:53.148 INFO:tasks.workunit.client.1.smithi184.stdout:8/300: read - d2/d12/d21/d2d/d31/f3a zero size 2023-12-16T03:15:53.150 INFO:tasks.workunit.client.1.smithi184.stdout:8/301: symlink d2/d4/l5f 0 2023-12-16T03:15:53.151 INFO:tasks.workunit.client.1.smithi184.stdout:8/302: unlink d2/d4/d10/d2a/f5b 0 2023-12-16T03:15:53.153 INFO:tasks.workunit.client.1.smithi184.stdout:8/303: rename d2/ca to d2/d4/d10/d11/c60 0 2023-12-16T03:15:53.159 INFO:tasks.workunit.client.0.smithi064.stdout:7/26: dwrite f5 [0,4194304] 0 2023-12-16T03:15:53.163 INFO:tasks.workunit.client.0.smithi064.stdout:7/27: read f4 [1669239,96763] 0 2023-12-16T03:15:53.169 INFO:tasks.workunit.client.1.smithi184.stdout:8/304: dwrite d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:15:53.170 INFO:tasks.workunit.client.1.smithi184.stdout:8/305: rmdir d2/d4 39 2023-12-16T03:15:53.171 INFO:tasks.workunit.client.1.smithi184.stdout:8/306: creat d2/d12/d21/d30/f61 x:0 0 0 2023-12-16T03:15:53.184 INFO:tasks.workunit.client.1.smithi184.stdout:8/307: dwrite d2/fe [0,4194304] 0 2023-12-16T03:15:53.185 INFO:tasks.workunit.client.1.smithi184.stdout:8/308: symlink d2/d4/d10/l62 0 2023-12-16T03:15:53.185 INFO:tasks.workunit.client.1.smithi184.stdout:8/309: write d2/fc [296019,108936] 0 2023-12-16T03:15:53.187 INFO:tasks.workunit.client.1.smithi184.stdout:8/310: unlink d2/d12/d21/d2d/c51 0 2023-12-16T03:15:53.188 INFO:tasks.workunit.client.1.smithi184.stdout:8/311: creat d2/d12/d21/d2d/d31/f63 x:0 0 0 2023-12-16T03:15:53.191 INFO:tasks.workunit.client.1.smithi184.stdout:8/312: dread d2/d4/d10/f14 [0,4194304] 0 2023-12-16T03:15:53.192 INFO:tasks.workunit.client.1.smithi184.stdout:8/313: dread d2/d12/f58 [0,4194304] 0 2023-12-16T03:15:53.193 INFO:tasks.workunit.client.1.smithi184.stdout:8/314: getdents d2/d4/d10/d2a 0 2023-12-16T03:15:53.218 INFO:tasks.workunit.client.1.smithi184.stdout:8/315: dwrite d2/d4/d10/d11/f3d [0,4194304] 0 2023-12-16T03:15:53.218 INFO:tasks.workunit.client.1.smithi184.stdout:8/316: chown d2/d4/l5f 125 1 2023-12-16T03:15:53.218 INFO:tasks.workunit.client.1.smithi184.stdout:8/317: write d2/d12/d21/f53 [727788,14765] 0 2023-12-16T03:15:53.219 INFO:tasks.workunit.client.1.smithi184.stdout:8/318: write d2/d37/f4c [1472393,28863] 0 2023-12-16T03:15:53.219 INFO:tasks.workunit.client.1.smithi184.stdout:8/319: symlink d2/d12/l64 0 2023-12-16T03:15:53.219 INFO:tasks.workunit.client.1.smithi184.stdout:8/320: creat d2/d12/d21/d2d/d31/f65 x:0 0 0 2023-12-16T03:15:53.220 INFO:tasks.workunit.client.1.smithi184.stdout:8/321: mkdir d2/d12/d21/d2d/d31/d5e/d66 0 2023-12-16T03:15:53.237 INFO:tasks.workunit.client.1.smithi184.stdout:8/322: dwrite d2/d12/d21/d2d/d31/f65 [0,4194304] 0 2023-12-16T03:15:53.238 INFO:tasks.workunit.client.1.smithi184.stdout:8/323: rename d2/d12/d21/d2d/d31/f65 to d2/d12/d21/d2d/d31/d34/f67 0 2023-12-16T03:15:53.239 INFO:tasks.workunit.client.1.smithi184.stdout:8/324: creat d2/d12/d21/d2d/d31/f68 x:0 0 0 2023-12-16T03:15:53.240 INFO:tasks.workunit.client.1.smithi184.stdout:8/325: symlink d2/d4/d10/l69 0 2023-12-16T03:15:53.240 INFO:tasks.workunit.client.1.smithi184.stdout:8/326: truncate d2/d4/d10/f17 238941 0 2023-12-16T03:15:53.257 INFO:tasks.workunit.client.0.smithi064.stdout:7/28: creat d7/fa x:0 0 0 2023-12-16T03:15:53.258 INFO:tasks.workunit.client.1.smithi184.stdout:8/327: dwrite d2/d4/d10/d11/f15 [0,4194304] 0 2023-12-16T03:15:53.259 INFO:tasks.workunit.client.0.smithi064.stdout:7/29: write f4 [1109959,111967] 0 2023-12-16T03:15:53.260 INFO:tasks.workunit.client.1.smithi184.stdout:8/328: mkdir d2/d6a 0 2023-12-16T03:15:53.260 INFO:tasks.workunit.client.0.smithi064.stdout:7/30: creat d7/fb x:0 0 0 2023-12-16T03:15:53.260 INFO:tasks.workunit.client.0.smithi064.stdout:7/31: dread - d7/fb zero size 2023-12-16T03:15:53.263 INFO:tasks.workunit.client.1.smithi184.stdout:8/329: mknod d2/d4/c6b 0 2023-12-16T03:15:53.266 INFO:tasks.workunit.client.1.smithi184.stdout:8/330: creat d2/d12/d21/d2d/d31/f6c x:0 0 0 2023-12-16T03:15:53.266 INFO:tasks.workunit.client.1.smithi184.stdout:8/331: write d2/d12/d21/d2d/d31/f6c [389290,10821] 0 2023-12-16T03:15:53.266 INFO:tasks.workunit.client.1.smithi184.stdout:8/332: mknod d2/d12/d21/d30/c6d 0 2023-12-16T03:15:53.266 INFO:tasks.workunit.client.1.smithi184.stdout:8/333: dread - d2/d4/d10/d2a/f5c zero size 2023-12-16T03:15:53.268 INFO:tasks.workunit.client.1.smithi184.stdout:8/334: unlink d2/d12/d21/d2d/f5d 0 2023-12-16T03:15:53.268 INFO:tasks.workunit.client.1.smithi184.stdout:8/335: fdatasync d2/d4/d10/d11/f29 0 2023-12-16T03:15:53.270 INFO:tasks.workunit.client.1.smithi184.stdout:8/336: link d2/d12/d21/d2d/d31/f63 d2/d12/d21/f6e 0 2023-12-16T03:15:53.272 INFO:tasks.workunit.client.0.smithi064.stdout:7/32: dwrite d7/fa [0,4194304] 0 2023-12-16T03:15:53.296 INFO:tasks.workunit.client.0.smithi064.stdout:7/33: dwrite d7/f9 [0,4194304] 0 2023-12-16T03:15:53.296 INFO:tasks.workunit.client.1.smithi184.stdout:8/337: dwrite d2/d12/d21/d2d/d31/f6c [0,4194304] 0 2023-12-16T03:15:53.298 INFO:tasks.workunit.client.1.smithi184.stdout:8/338: rmdir d2/d4/d10 39 2023-12-16T03:15:53.298 INFO:tasks.workunit.client.1.smithi184.stdout:8/339: chown d2/d12/l55 11820 1 2023-12-16T03:15:53.298 INFO:tasks.workunit.client.1.smithi184.stdout:8/340: stat d2/d4/d10/d2a/c39 0 2023-12-16T03:15:53.300 INFO:tasks.workunit.client.1.smithi184.stdout:8/341: rmdir d2/d12/d21/d30 39 2023-12-16T03:15:53.300 INFO:tasks.workunit.client.1.smithi184.stdout:8/342: stat d2/d4/d10/d2a/c32 0 2023-12-16T03:15:53.314 INFO:tasks.workunit.client.1.smithi184.stdout:8/343: dwrite d2/d37/f4c [0,4194304] 0 2023-12-16T03:15:53.315 INFO:tasks.workunit.client.1.smithi184.stdout:8/344: creat d2/d4/d10/d11/f6f x:0 0 0 2023-12-16T03:15:53.329 INFO:tasks.workunit.client.1.smithi184.stdout:8/345: dwrite d2/fc [0,4194304] 0 2023-12-16T03:15:53.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/346: dread - d2/d4/f40 zero size 2023-12-16T03:15:53.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/347: fdatasync d2/d12/d21/d2d/d31/f68 0 2023-12-16T03:15:53.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/348: dread - d2/d4/d10/d11/f4d zero size 2023-12-16T03:15:53.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/349: chown d2/d6a 4119259 1 2023-12-16T03:15:53.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/350: truncate d2/d4/d10/d11/f4d 857229 0 2023-12-16T03:15:53.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/351: stat d2/d4/d10/d11/f6f 0 2023-12-16T03:15:53.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/352: rename d2/d12/d21/d2d/d31 to d2/d12/d21/d2d/d31/d34/d70 22 2023-12-16T03:15:53.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/353: symlink d2/d12/d21/d2d/d31/d5e/d66/l71 0 2023-12-16T03:15:53.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/354: fdatasync d2/d12/d21/d30/f35 0 2023-12-16T03:15:53.331 INFO:tasks.workunit.client.1.smithi184.stdout:8/355: write d2/d4/d10/f17 [212921,48864] 0 2023-12-16T03:15:53.331 INFO:tasks.workunit.client.1.smithi184.stdout:8/356: stat d2/d4/d10/d11/f29 0 2023-12-16T03:15:53.331 INFO:tasks.workunit.client.1.smithi184.stdout:8/357: rmdir d2/d4/d10 39 2023-12-16T03:15:53.332 INFO:tasks.workunit.client.1.smithi184.stdout:8/358: mkdir d2/d4/d10/d11/d72 0 2023-12-16T03:15:53.382 INFO:tasks.workunit.client.1.smithi184.stdout:8/359: mkdir d2/d12/d21/d30/d73 0 2023-12-16T03:15:53.382 INFO:tasks.workunit.client.1.smithi184.stdout:2/204: sync 2023-12-16T03:15:53.382 INFO:tasks.workunit.client.1.smithi184.stdout:6/354: sync 2023-12-16T03:15:53.382 INFO:tasks.workunit.client.1.smithi184.stdout:1/330: sync 2023-12-16T03:15:53.382 INFO:tasks.workunit.client.1.smithi184.stdout:7/323: sync 2023-12-16T03:15:53.382 INFO:tasks.workunit.client.1.smithi184.stdout:3/350: sync 2023-12-16T03:15:53.382 INFO:tasks.workunit.client.1.smithi184.stdout:0/379: sync 2023-12-16T03:15:53.383 INFO:tasks.workunit.client.1.smithi184.stdout:8/360: write d2/fe [1455190,54763] 0 2023-12-16T03:15:53.384 INFO:tasks.workunit.client.1.smithi184.stdout:6/355: unlink d0/d5/d22/d25/d47/f5c 0 2023-12-16T03:15:53.385 INFO:tasks.workunit.client.1.smithi184.stdout:7/324: creat d0/df/d1e/f5d x:0 0 0 2023-12-16T03:15:53.385 INFO:tasks.workunit.client.1.smithi184.stdout:3/351: getdents d12/d37/d81 0 2023-12-16T03:15:53.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/331: mknod d3/d13/c6e 0 2023-12-16T03:15:53.389 INFO:tasks.workunit.client.1.smithi184.stdout:3/352: symlink d12/d1e/l8a 0 2023-12-16T03:15:53.390 INFO:tasks.workunit.client.1.smithi184.stdout:6/356: mknod d0/d5/d12/d1b/d33/d3d/c71 0 2023-12-16T03:15:53.390 INFO:tasks.workunit.client.1.smithi184.stdout:6/357: dread - d0/d5/d12/d1b/f51 zero size 2023-12-16T03:15:53.391 INFO:tasks.workunit.client.1.smithi184.stdout:8/361: unlink d2/l3 0 2023-12-16T03:15:53.394 INFO:tasks.workunit.client.1.smithi184.stdout:2/205: dread d3/fd [0,4194304] 0 2023-12-16T03:15:53.395 INFO:tasks.workunit.client.1.smithi184.stdout:6/358: unlink d0/l9 0 2023-12-16T03:15:53.395 INFO:tasks.workunit.client.1.smithi184.stdout:6/359: chown d0/d5/d12/d1b/d33/f6c 65160444 1 2023-12-16T03:15:53.396 INFO:tasks.workunit.client.1.smithi184.stdout:2/206: dread d3/d13/f18 [0,4194304] 0 2023-12-16T03:15:53.396 INFO:tasks.workunit.client.1.smithi184.stdout:2/207: chown d3/d29/d2f/d2e 1 1 2023-12-16T03:15:53.397 INFO:tasks.workunit.client.1.smithi184.stdout:2/208: creat d3/d9/d19/f43 x:0 0 0 2023-12-16T03:15:53.401 INFO:tasks.workunit.client.1.smithi184.stdout:2/209: mknod d3/d13/c44 0 2023-12-16T03:15:53.402 INFO:tasks.workunit.client.1.smithi184.stdout:0/380: dread dc/d22/d1d/d43/d5a/f69 [0,4194304] 0 2023-12-16T03:15:53.403 INFO:tasks.workunit.client.1.smithi184.stdout:2/210: creat d3/d29/d2f/f45 x:0 0 0 2023-12-16T03:15:53.407 INFO:tasks.workunit.client.1.smithi184.stdout:0/381: rename dc/d10/f6c to dc/d22/d1d/d2c/d75/f79 0 2023-12-16T03:15:53.408 INFO:tasks.workunit.client.1.smithi184.stdout:2/211: mkdir d3/d29/d2f/d46 0 2023-12-16T03:15:53.408 INFO:tasks.workunit.client.1.smithi184.stdout:2/212: write d3/d9/d19/f26 [95919,2294] 0 2023-12-16T03:15:53.410 INFO:tasks.workunit.client.1.smithi184.stdout:2/213: mknod d3/d9/d19/c47 0 2023-12-16T03:15:53.410 INFO:tasks.workunit.client.1.smithi184.stdout:2/214: chown d3/d29/c34 462 1 2023-12-16T03:15:53.411 INFO:tasks.workunit.client.1.smithi184.stdout:2/215: creat d3/f48 x:0 0 0 2023-12-16T03:15:53.412 INFO:tasks.workunit.client.1.smithi184.stdout:0/382: write dc/d22/d46/f6e [4121194,54791] 0 2023-12-16T03:15:53.413 INFO:tasks.workunit.client.1.smithi184.stdout:0/383: mkdir dc/d10/d2d/d5f/d7a 0 2023-12-16T03:15:53.414 INFO:tasks.workunit.client.1.smithi184.stdout:0/384: creat dc/f7b x:0 0 0 2023-12-16T03:15:53.417 INFO:tasks.workunit.client.1.smithi184.stdout:2/216: dread d3/d29/d2f/f22 [0,4194304] 0 2023-12-16T03:15:53.417 INFO:tasks.workunit.client.1.smithi184.stdout:2/217: stat d3/d29/d2f/d2e/f35 0 2023-12-16T03:15:53.419 INFO:tasks.workunit.client.1.smithi184.stdout:2/218: creat d3/d9/d19/f49 x:0 0 0 2023-12-16T03:15:53.420 INFO:tasks.workunit.client.1.smithi184.stdout:1/332: dwrite d3/d28/d3c/f33 [4194304,4194304] 0 2023-12-16T03:15:53.421 INFO:tasks.workunit.client.1.smithi184.stdout:8/362: dwrite d2/d12/d21/f6e [0,4194304] 0 2023-12-16T03:15:53.421 INFO:tasks.workunit.client.1.smithi184.stdout:7/325: dwrite d0/d3/f7 [0,4194304] 0 2023-12-16T03:15:53.421 INFO:tasks.workunit.client.1.smithi184.stdout:2/219: mknod d3/d13/d28/c4a 0 2023-12-16T03:15:53.421 INFO:tasks.workunit.client.1.smithi184.stdout:2/220: truncate d3/f3c 408024 0 2023-12-16T03:15:53.421 INFO:tasks.workunit.client.1.smithi184.stdout:2/221: stat d3/d29/d2f/d2e/fb 0 2023-12-16T03:15:53.425 INFO:tasks.workunit.client.1.smithi184.stdout:1/333: creat d3/d28/d3c/d41/d46/d4a/f6f x:0 0 0 2023-12-16T03:15:53.425 INFO:tasks.workunit.client.1.smithi184.stdout:2/222: write d3/d29/d2f/d2e/fb [6063077,58785] 0 2023-12-16T03:15:53.432 INFO:tasks.workunit.client.1.smithi184.stdout:8/363: getdents d2/d12 0 2023-12-16T03:15:53.435 INFO:tasks.workunit.client.1.smithi184.stdout:1/334: dread d3/d28/d3c/f35 [0,4194304] 0 2023-12-16T03:15:53.436 INFO:tasks.workunit.client.1.smithi184.stdout:8/364: creat d2/d6a/f74 x:0 0 0 2023-12-16T03:15:53.437 INFO:tasks.workunit.client.1.smithi184.stdout:1/335: truncate d3/d28/d38/d52/f6c 3626711 0 2023-12-16T03:15:53.437 INFO:tasks.workunit.client.1.smithi184.stdout:1/336: write d3/d28/d3c/d41/f4d [1461045,903] 0 2023-12-16T03:15:53.438 INFO:tasks.workunit.client.1.smithi184.stdout:8/365: truncate d2/d4/d10/f59 1943355 0 2023-12-16T03:15:53.438 INFO:tasks.workunit.client.1.smithi184.stdout:8/366: truncate d2/d12/f5a 1002857 0 2023-12-16T03:15:53.438 INFO:tasks.workunit.client.1.smithi184.stdout:1/337: write d3/d28/d3c/f35 [547102,117794] 0 2023-12-16T03:15:53.438 INFO:tasks.workunit.client.1.smithi184.stdout:8/367: fdatasync d2/d12/d21/d2d/d31/f6c 0 2023-12-16T03:15:53.439 INFO:tasks.workunit.client.1.smithi184.stdout:0/385: dwrite dc/d22/d1d/f40 [0,4194304] 0 2023-12-16T03:15:53.439 INFO:tasks.workunit.client.1.smithi184.stdout:8/368: mkdir d2/d4/d10/d75 0 2023-12-16T03:15:53.440 INFO:tasks.workunit.client.1.smithi184.stdout:8/369: readlink d2/d12/d21/d2d/d31/l4e 0 2023-12-16T03:15:53.440 INFO:tasks.workunit.client.1.smithi184.stdout:8/370: chown d2/d4/d10/d11/f3d 886865417 1 2023-12-16T03:15:53.441 INFO:tasks.workunit.client.1.smithi184.stdout:0/386: mkdir dc/d10/d2d/d5f/d7c 0 2023-12-16T03:15:53.441 INFO:tasks.workunit.client.1.smithi184.stdout:7/326: dwrite d0/df/d1e/f20 [4194304,4194304] 0 2023-12-16T03:15:53.441 INFO:tasks.workunit.client.1.smithi184.stdout:2/223: getdents d3/d13/d28 0 2023-12-16T03:15:53.442 INFO:tasks.workunit.client.1.smithi184.stdout:8/371: dread d2/d4/d10/f17 [0,4194304] 0 2023-12-16T03:15:53.442 INFO:tasks.workunit.client.1.smithi184.stdout:7/327: write d0/df/d32/d39/f3e [2022399,3693] 0 2023-12-16T03:15:53.442 INFO:tasks.workunit.client.1.smithi184.stdout:8/372: read d2/d12/d21/d30/f35 [1181068,55720] 0 2023-12-16T03:15:53.444 INFO:tasks.workunit.client.1.smithi184.stdout:0/387: unlink dc/d22/d1d/d2c/d75/f78 0 2023-12-16T03:15:53.445 INFO:tasks.workunit.client.1.smithi184.stdout:7/328: creat d0/d3/d4/f5e x:0 0 0 2023-12-16T03:15:53.445 INFO:tasks.workunit.client.1.smithi184.stdout:7/329: chown d0/d3/c30 1 1 2023-12-16T03:15:53.445 INFO:tasks.workunit.client.1.smithi184.stdout:7/330: fsync d0/d3/f7 0 2023-12-16T03:15:53.448 INFO:tasks.workunit.client.1.smithi184.stdout:1/338: dread d3/d28/f44 [4194304,4194304] 0 2023-12-16T03:15:53.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/373: creat d2/d4/f76 x:0 0 0 2023-12-16T03:15:53.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/374: fsync d2/d6a/f74 0 2023-12-16T03:15:53.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/375: chown d2/d4/d10/d11/c54 1910646633 1 2023-12-16T03:15:53.451 INFO:tasks.workunit.client.1.smithi184.stdout:1/339: creat d3/d34/f70 x:0 0 0 2023-12-16T03:15:53.452 INFO:tasks.workunit.client.1.smithi184.stdout:8/376: mkdir d2/d4/d10/d11/d77 0 2023-12-16T03:15:53.454 INFO:tasks.workunit.client.1.smithi184.stdout:1/340: symlink d3/d34/l71 0 2023-12-16T03:15:53.455 INFO:tasks.workunit.client.1.smithi184.stdout:1/341: readlink d3/d28/d3c/d24/l32 0 2023-12-16T03:15:53.456 INFO:tasks.workunit.client.1.smithi184.stdout:2/224: dread d3/d9/d19/f37 [0,4194304] 0 2023-12-16T03:15:53.457 INFO:tasks.workunit.client.1.smithi184.stdout:7/331: dread d0/d3/d4/f2c [0,4194304] 0 2023-12-16T03:15:53.457 INFO:tasks.workunit.client.1.smithi184.stdout:7/332: readlink d0/d3/d2e/l59 0 2023-12-16T03:15:53.458 INFO:tasks.workunit.client.1.smithi184.stdout:1/342: unlink d3/d34/f70 0 2023-12-16T03:15:53.460 INFO:tasks.workunit.client.1.smithi184.stdout:2/225: symlink d3/d9/l4b 0 2023-12-16T03:15:53.467 INFO:tasks.workunit.client.1.smithi184.stdout:0/388: dwrite dc/fe [0,4194304] 0 2023-12-16T03:15:53.468 INFO:tasks.workunit.client.1.smithi184.stdout:0/389: mknod dc/d22/d1d/d43/d5a/c7d 0 2023-12-16T03:15:53.468 INFO:tasks.workunit.client.1.smithi184.stdout:0/390: chown dc/d22/d1d 14 1 2023-12-16T03:15:53.471 INFO:tasks.workunit.client.1.smithi184.stdout:0/391: mknod dc/d22/d1d/d43/d5a/d60/c7e 0 2023-12-16T03:15:53.471 INFO:tasks.workunit.client.1.smithi184.stdout:0/392: fdatasync dc/d22/d1d/d2c/f74 0 2023-12-16T03:15:53.479 INFO:tasks.workunit.client.1.smithi184.stdout:5/140: sync 2023-12-16T03:15:53.479 INFO:tasks.workunit.client.1.smithi184.stdout:5/141: write d1/f29 [5005789,128263] 0 2023-12-16T03:15:53.479 INFO:tasks.workunit.client.1.smithi184.stdout:7/333: dwrite d0/df/d1e/f42 [0,4194304] 0 2023-12-16T03:15:53.480 INFO:tasks.workunit.client.1.smithi184.stdout:5/142: write d1/d3/fd [807495,54352] 0 2023-12-16T03:15:53.480 INFO:tasks.workunit.client.1.smithi184.stdout:5/143: fdatasync d1/f1a 0 2023-12-16T03:15:53.481 INFO:tasks.workunit.client.1.smithi184.stdout:5/144: write d1/f29 [1793217,60240] 0 2023-12-16T03:15:53.483 INFO:tasks.workunit.client.1.smithi184.stdout:5/145: dread d1/d3/fa [0,4194304] 0 2023-12-16T03:15:53.484 INFO:tasks.workunit.client.1.smithi184.stdout:5/146: write d1/d3/fd [999856,1369] 0 2023-12-16T03:15:53.484 INFO:tasks.workunit.client.1.smithi184.stdout:5/147: fsync d1/d3/d9/de/d15/d19/f1d 0 2023-12-16T03:15:53.486 INFO:tasks.workunit.client.1.smithi184.stdout:7/334: creat d0/d3/d2e/f5f x:0 0 0 2023-12-16T03:15:53.486 INFO:tasks.workunit.client.1.smithi184.stdout:7/335: fdatasync d0/df/f4d 0 2023-12-16T03:15:53.487 INFO:tasks.workunit.client.1.smithi184.stdout:5/148: creat d1/d3/d9/f2d x:0 0 0 2023-12-16T03:15:53.487 INFO:tasks.workunit.client.1.smithi184.stdout:7/336: write d0/d3/f5 [7589831,80903] 0 2023-12-16T03:15:53.488 INFO:tasks.workunit.client.1.smithi184.stdout:0/393: rmdir dc 39 2023-12-16T03:15:53.492 INFO:tasks.workunit.client.1.smithi184.stdout:7/337: rename d0/d3/d4/f33 to d0/df/dd/d27/f60 0 2023-12-16T03:15:53.492 INFO:tasks.workunit.client.1.smithi184.stdout:0/394: write dc/d10/d1c/f21 [1556972,45708] 0 2023-12-16T03:15:53.492 INFO:tasks.workunit.client.1.smithi184.stdout:0/395: fdatasync dc/d10/f25 0 2023-12-16T03:15:53.493 INFO:tasks.workunit.client.1.smithi184.stdout:0/396: fdatasync dc/d22/d1a/f6f 0 2023-12-16T03:15:53.493 INFO:tasks.workunit.client.1.smithi184.stdout:0/397: fsync dc/d22/d1d/d2c/d75/f79 0 2023-12-16T03:15:53.493 INFO:tasks.workunit.client.1.smithi184.stdout:9/414: sync 2023-12-16T03:15:53.493 INFO:tasks.workunit.client.1.smithi184.stdout:4/218: sync 2023-12-16T03:15:53.494 INFO:tasks.workunit.client.1.smithi184.stdout:0/398: mkdir dc/d22/d46/d7f 0 2023-12-16T03:15:53.496 INFO:tasks.workunit.client.1.smithi184.stdout:9/415: symlink d0/d13/l8d 0 2023-12-16T03:15:53.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/219: creat d1/d11/d1b/d44/f4b x:0 0 0 2023-12-16T03:15:53.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/220: fdatasync d1/d12/f17 0 2023-12-16T03:15:53.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/221: chown d1/d12/d13/l47 4516 1 2023-12-16T03:15:53.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/222: write d1/d11/d1b/d1e/f41 [917134,104257] 0 2023-12-16T03:15:53.499 INFO:tasks.workunit.client.1.smithi184.stdout:4/223: write d1/d12/f3e [4032387,63440] 0 2023-12-16T03:15:53.500 INFO:tasks.workunit.client.1.smithi184.stdout:4/224: truncate d1/d29/f2e 653822 0 2023-12-16T03:15:53.500 INFO:tasks.workunit.client.1.smithi184.stdout:4/225: write d1/d29/d34/f48 [563905,71649] 0 2023-12-16T03:15:53.508 INFO:tasks.workunit.client.1.smithi184.stdout:9/416: dread d0/d13/f24 [0,4194304] 0 2023-12-16T03:15:53.509 INFO:tasks.workunit.client.1.smithi184.stdout:9/417: read d0/d3a/d47/f67 [635399,38280] 0 2023-12-16T03:15:53.518 INFO:tasks.workunit.client.1.smithi184.stdout:4/226: dread d1/d11/f23 [0,4194304] 0 2023-12-16T03:15:53.519 INFO:tasks.workunit.client.1.smithi184.stdout:4/227: write d1/d29/d34/f48 [1299818,26432] 0 2023-12-16T03:15:53.519 INFO:tasks.workunit.client.1.smithi184.stdout:4/228: symlink d1/d11/d1b/d44/l4c 0 2023-12-16T03:15:53.530 INFO:tasks.workunit.client.1.smithi184.stdout:4/229: dread d1/d29/d34/f3d [0,4194304] 0 2023-12-16T03:15:53.532 INFO:tasks.workunit.client.1.smithi184.stdout:4/230: rename d1/f4 to d1/d12/d13/d40/f4d 0 2023-12-16T03:15:53.538 INFO:tasks.workunit.client.1.smithi184.stdout:5/149: dwrite d1/f29 [0,4194304] 0 2023-12-16T03:15:53.538 INFO:tasks.workunit.client.1.smithi184.stdout:5/150: truncate d1/f1a 268858 0 2023-12-16T03:15:53.538 INFO:tasks.workunit.client.1.smithi184.stdout:4/231: write d1/d12/f17 [640161,66329] 0 2023-12-16T03:15:53.538 INFO:tasks.workunit.client.1.smithi184.stdout:0/399: dwrite dc/d10/f11 [0,4194304] 0 2023-12-16T03:15:53.538 INFO:tasks.workunit.client.1.smithi184.stdout:7/338: dwrite d0/d3/f1a [0,4194304] 0 2023-12-16T03:15:53.538 INFO:tasks.workunit.client.1.smithi184.stdout:9/418: dwrite d0/d30/f75 [0,4194304] 0 2023-12-16T03:15:53.539 INFO:tasks.workunit.client.1.smithi184.stdout:5/151: mkdir d1/d3/d9/d2e 0 2023-12-16T03:15:53.539 INFO:tasks.workunit.client.1.smithi184.stdout:5/152: readlink d1/d3/d9/de/d15/d1b/l2b 0 2023-12-16T03:15:53.539 INFO:tasks.workunit.client.1.smithi184.stdout:5/153: dread - d1/d3/d9/de/d15/f1e zero size 2023-12-16T03:15:53.542 INFO:tasks.workunit.client.1.smithi184.stdout:0/400: mkdir dc/d22/d45/d66/d80 0 2023-12-16T03:15:53.547 INFO:tasks.workunit.client.1.smithi184.stdout:9/419: rename d0/d13/d20/d5b/d53/f74 to d0/d13/d20/d5b/f8e 0 2023-12-16T03:15:53.547 INFO:tasks.workunit.client.1.smithi184.stdout:9/420: stat d0/f2f 0 2023-12-16T03:15:53.547 INFO:tasks.workunit.client.1.smithi184.stdout:9/421: write d0/d13/d20/f29 [1128215,35223] 0 2023-12-16T03:15:53.547 INFO:tasks.workunit.client.1.smithi184.stdout:9/422: stat d0/d3a/d47/c7d 0 2023-12-16T03:15:53.548 INFO:tasks.workunit.client.1.smithi184.stdout:5/154: mkdir d1/d3/d2f 0 2023-12-16T03:15:53.549 INFO:tasks.workunit.client.0.smithi064.stdout:4/24: sync 2023-12-16T03:15:53.549 INFO:tasks.workunit.client.0.smithi064.stdout:6/8: sync 2023-12-16T03:15:53.549 INFO:tasks.workunit.client.0.smithi064.stdout:1/1: sync 2023-12-16T03:15:53.549 INFO:tasks.workunit.client.0.smithi064.stdout:4/25: dread - d0/f1 zero size 2023-12-16T03:15:53.549 INFO:tasks.workunit.client.0.smithi064.stdout:1/2: chown . 1094519 1 2023-12-16T03:15:53.549 INFO:tasks.workunit.client.0.smithi064.stdout:1/3: write - no filename 2023-12-16T03:15:53.549 INFO:tasks.workunit.client.0.smithi064.stdout:1/4: fdatasync - no filename 2023-12-16T03:15:53.549 INFO:tasks.workunit.client.0.smithi064.stdout:4/26: write d0/f2 [730995,124761] 0 2023-12-16T03:15:53.550 INFO:tasks.workunit.client.0.smithi064.stdout:4/27: truncate d0/f2 1610772 0 2023-12-16T03:15:53.550 INFO:tasks.workunit.client.0.smithi064.stdout:4/28: chown d0/c7 69 1 2023-12-16T03:15:53.550 INFO:tasks.workunit.client.0.smithi064.stdout:4/29: stat d0/l3 0 2023-12-16T03:15:53.550 INFO:tasks.workunit.client.0.smithi064.stdout:4/30: write d0/f5 [224774,64249] 0 2023-12-16T03:15:53.550 INFO:tasks.workunit.client.0.smithi064.stdout:6/9: unlink f1 0 2023-12-16T03:15:53.553 INFO:tasks.workunit.client.0.smithi064.stdout:1/5: symlink l0 0 2023-12-16T03:15:53.553 INFO:tasks.workunit.client.0.smithi064.stdout:1/6: write - no filename 2023-12-16T03:15:53.553 INFO:tasks.workunit.client.0.smithi064.stdout:8/14: getdents d0 0 2023-12-16T03:15:53.553 INFO:tasks.workunit.client.0.smithi064.stdout:1/7: readlink l0 0 2023-12-16T03:15:53.553 INFO:tasks.workunit.client.0.smithi064.stdout:8/15: truncate d0/f3 32473 0 2023-12-16T03:15:53.553 INFO:tasks.workunit.client.0.smithi064.stdout:8/16: readlink d0/l1 0 2023-12-16T03:15:53.554 INFO:tasks.workunit.client.1.smithi184.stdout:4/232: dread d1/f28 [0,4194304] 0 2023-12-16T03:15:53.554 INFO:tasks.workunit.client.0.smithi064.stdout:4/31: mknod d0/da/cb 0 2023-12-16T03:15:53.554 INFO:tasks.workunit.client.0.smithi064.stdout:4/32: dread - d0/f8 zero size 2023-12-16T03:15:53.554 INFO:tasks.workunit.client.0.smithi064.stdout:4/33: chown d0/f8 0 1 2023-12-16T03:15:53.554 INFO:tasks.workunit.client.1.smithi184.stdout:5/155: mkdir d1/d3/d9/de/d30 0 2023-12-16T03:15:53.555 INFO:tasks.workunit.client.0.smithi064.stdout:9/11: getdents d2 0 2023-12-16T03:15:53.555 INFO:tasks.workunit.client.1.smithi184.stdout:5/156: write d1/f29 [118744,116786] 0 2023-12-16T03:15:53.555 INFO:tasks.workunit.client.0.smithi064.stdout:1/8: mknod c1 0 2023-12-16T03:15:53.557 INFO:tasks.workunit.client.1.smithi184.stdout:0/401: rename dc/d22/c2b to dc/d22/d45/d66/c81 0 2023-12-16T03:15:53.558 INFO:tasks.workunit.client.0.smithi064.stdout:4/34: mknod d0/cc 0 2023-12-16T03:15:53.558 INFO:tasks.workunit.client.0.smithi064.stdout:1/9: creat f2 x:0 0 0 2023-12-16T03:15:53.560 INFO:tasks.workunit.client.0.smithi064.stdout:4/35: rename d0/l3 to d0/da/ld 0 2023-12-16T03:15:53.562 INFO:tasks.workunit.client.0.smithi064.stdout:1/10: mkdir d3 0 2023-12-16T03:15:53.562 INFO:tasks.workunit.client.0.smithi064.stdout:1/11: truncate f2 538647 0 2023-12-16T03:15:53.562 INFO:tasks.workunit.client.0.smithi064.stdout:1/12: getdents d3 0 2023-12-16T03:15:53.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/233: unlink d1/l2a 0 2023-12-16T03:15:53.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/234: write d1/d12/d27/d3b/f3f [417088,1639] 0 2023-12-16T03:15:53.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/235: readlink l0 0 2023-12-16T03:15:53.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/236: stat d1/d12/d27/f32 0 2023-12-16T03:15:53.566 INFO:tasks.workunit.client.0.smithi064.stdout:4/36: symlink d0/le 0 2023-12-16T03:15:53.566 INFO:tasks.workunit.client.0.smithi064.stdout:4/37: read d0/f5 [267069,105186] 0 2023-12-16T03:15:53.566 INFO:tasks.workunit.client.0.smithi064.stdout:1/13: mknod d3/c4 0 2023-12-16T03:15:53.568 INFO:tasks.workunit.client.0.smithi064.stdout:1/14: creat d3/f5 x:0 0 0 2023-12-16T03:15:53.569 INFO:tasks.workunit.client.0.smithi064.stdout:5/29: getdents d0/d7 0 2023-12-16T03:15:53.571 INFO:tasks.workunit.client.0.smithi064.stdout:0/19: truncate f1 3600815 0 2023-12-16T03:15:53.571 INFO:tasks.workunit.client.0.smithi064.stdout:1/15: creat d3/f6 x:0 0 0 2023-12-16T03:15:53.572 INFO:tasks.workunit.client.0.smithi064.stdout:5/30: creat d0/d7/fb x:0 0 0 2023-12-16T03:15:53.573 INFO:tasks.workunit.client.1.smithi184.stdout:5/157: rename d1/d3/d9/de/d15/d1b to d1/d2a/d31 0 2023-12-16T03:15:53.573 INFO:tasks.workunit.client.1.smithi184.stdout:4/237: rename d1 to d1/d12/d13/d4e 22 2023-12-16T03:15:53.573 INFO:tasks.workunit.client.1.smithi184.stdout:4/238: chown d1/d12/d13/d40 634628 1 2023-12-16T03:15:53.573 INFO:tasks.workunit.client.1.smithi184.stdout:0/402: creat dc/d22/d53/f82 x:0 0 0 2023-12-16T03:15:53.573 INFO:tasks.workunit.client.0.smithi064.stdout:1/16: creat d3/f7 x:0 0 0 2023-12-16T03:15:53.575 INFO:tasks.workunit.client.1.smithi184.stdout:5/158: symlink d1/d3/l32 0 2023-12-16T03:15:53.575 INFO:tasks.workunit.client.1.smithi184.stdout:4/239: symlink d1/d12/d13/d40/d43/l4f 0 2023-12-16T03:15:53.576 INFO:tasks.workunit.client.1.smithi184.stdout:0/403: mknod dc/d22/d48/c83 0 2023-12-16T03:15:53.578 INFO:tasks.workunit.client.1.smithi184.stdout:4/240: symlink d1/d12/d27/d33/d4a/l50 0 2023-12-16T03:15:53.578 INFO:tasks.workunit.client.0.smithi064.stdout:3/36: rmdir db 39 2023-12-16T03:15:53.578 INFO:tasks.workunit.client.0.smithi064.stdout:3/37: fdatasync f6 0 2023-12-16T03:15:53.579 INFO:tasks.workunit.client.1.smithi184.stdout:0/404: creat dc/d22/d45/d66/f84 x:0 0 0 2023-12-16T03:15:53.580 INFO:tasks.workunit.client.0.smithi064.stdout:3/38: getdents db 0 2023-12-16T03:15:53.580 INFO:tasks.workunit.client.0.smithi064.stdout:3/39: write f4 [1813496,115182] 0 2023-12-16T03:15:53.581 INFO:tasks.workunit.client.1.smithi184.stdout:5/159: dread d1/d3/d9/f18 [0,4194304] 0 2023-12-16T03:15:53.582 INFO:tasks.workunit.client.1.smithi184.stdout:4/241: dread d1/d12/d13/f31 [0,4194304] 0 2023-12-16T03:15:53.582 INFO:tasks.workunit.client.0.smithi064.stdout:3/40: rename db/fc to db/fd 0 2023-12-16T03:15:53.583 INFO:tasks.workunit.client.1.smithi184.stdout:0/405: getdents dc/d22/d1d/d43/d5a 0 2023-12-16T03:15:53.585 INFO:tasks.workunit.client.0.smithi064.stdout:3/41: creat db/fe x:0 0 0 2023-12-16T03:15:53.586 INFO:tasks.workunit.client.0.smithi064.stdout:3/42: link l5 db/lf 0 2023-12-16T03:15:53.587 INFO:tasks.workunit.client.0.smithi064.stdout:3/43: write db/fd [151114,30364] 0 2023-12-16T03:15:53.587 INFO:tasks.workunit.client.1.smithi184.stdout:4/242: write d1/d12/f3e [921915,13719] 0 2023-12-16T03:15:53.587 INFO:tasks.workunit.client.0.smithi064.stdout:7/34: getdents d7 0 2023-12-16T03:15:53.587 INFO:tasks.workunit.client.0.smithi064.stdout:7/35: readlink l6 0 2023-12-16T03:15:53.589 INFO:tasks.workunit.client.1.smithi184.stdout:4/243: creat d1/f51 x:0 0 0 2023-12-16T03:15:53.590 INFO:tasks.workunit.client.0.smithi064.stdout:7/36: unlink l6 0 2023-12-16T03:15:53.593 INFO:tasks.workunit.client.1.smithi184.stdout:5/160: dread d1/d3/fd [0,4194304] 0 2023-12-16T03:15:53.596 INFO:tasks.workunit.client.1.smithi184.stdout:0/406: dread dc/d10/f14 [0,4194304] 0 2023-12-16T03:15:53.597 INFO:tasks.workunit.client.1.smithi184.stdout:0/407: symlink dc/d22/d1d/d35/l85 0 2023-12-16T03:15:53.598 INFO:tasks.workunit.client.0.smithi064.stdout:9/12: dwrite f1 [0,4194304] 0 2023-12-16T03:15:53.599 INFO:tasks.workunit.client.1.smithi184.stdout:4/244: write d1/fd [239098,121622] 0 2023-12-16T03:15:53.599 INFO:tasks.workunit.client.1.smithi184.stdout:5/161: dread d1/d3/fd [0,4194304] 0 2023-12-16T03:15:53.599 INFO:tasks.workunit.client.1.smithi184.stdout:9/423: dwrite d0/d13/f21 [0,4194304] 0 2023-12-16T03:15:53.599 INFO:tasks.workunit.client.1.smithi184.stdout:9/424: fdatasync d0/f1f 0 2023-12-16T03:15:53.600 INFO:tasks.workunit.client.1.smithi184.stdout:0/408: mknod dc/d10/d1c/c86 0 2023-12-16T03:15:53.600 INFO:tasks.workunit.client.1.smithi184.stdout:4/245: symlink d1/d12/d27/d3b/l52 0 2023-12-16T03:15:53.600 INFO:tasks.workunit.client.0.smithi064.stdout:6/10: dwrite f2 [0,4194304] 0 2023-12-16T03:15:53.600 INFO:tasks.workunit.client.0.smithi064.stdout:8/17: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:15:53.601 INFO:tasks.workunit.client.0.smithi064.stdout:8/18: write d0/f3 [74725,39224] 0 2023-12-16T03:15:53.601 INFO:tasks.workunit.client.1.smithi184.stdout:5/162: mknod d1/d3/d2f/c33 0 2023-12-16T03:15:53.601 INFO:tasks.workunit.client.1.smithi184.stdout:0/409: truncate dc/fe 2708011 0 2023-12-16T03:15:53.605 INFO:tasks.workunit.client.0.smithi064.stdout:1/17: dwrite d3/f7 [0,4194304] 0 2023-12-16T03:15:53.608 INFO:tasks.workunit.client.1.smithi184.stdout:9/425: dread d0/d13/d20/d5b/f56 [0,4194304] 0 2023-12-16T03:15:53.611 INFO:tasks.workunit.client.1.smithi184.stdout:9/426: creat d0/d13/d20/f8f x:0 0 0 2023-12-16T03:15:53.612 INFO:tasks.workunit.client.1.smithi184.stdout:9/427: link d0/c6f d0/d13/d20/d77/c90 0 2023-12-16T03:15:53.615 INFO:tasks.workunit.client.1.smithi184.stdout:9/428: unlink d0/fe 0 2023-12-16T03:15:53.615 INFO:tasks.workunit.client.1.smithi184.stdout:9/429: fdatasync d0/d30/f75 0 2023-12-16T03:15:53.615 INFO:tasks.workunit.client.1.smithi184.stdout:9/430: chown d0/d13/d20/f29 57 1 2023-12-16T03:15:53.616 INFO:tasks.workunit.client.1.smithi184.stdout:9/431: creat d0/d13/f91 x:0 0 0 2023-12-16T03:15:53.618 INFO:tasks.workunit.client.1.smithi184.stdout:9/432: creat d0/d30/f92 x:0 0 0 2023-12-16T03:15:53.620 INFO:tasks.workunit.client.1.smithi184.stdout:9/433: unlink d0/d13/d6e/d84/f6b 0 2023-12-16T03:15:53.620 INFO:tasks.workunit.client.1.smithi184.stdout:9/434: rmdir d0/d13/d20/d5b/d53 39 2023-12-16T03:15:53.622 INFO:tasks.workunit.client.1.smithi184.stdout:9/435: creat d0/d3a/d47/f93 x:0 0 0 2023-12-16T03:15:53.622 INFO:tasks.workunit.client.1.smithi184.stdout:9/436: dread - d0/d13/d20/f86 zero size 2023-12-16T03:15:53.624 INFO:tasks.workunit.client.0.smithi064.stdout:3/44: dwrite f1 [0,4194304] 0 2023-12-16T03:15:53.624 INFO:tasks.workunit.client.0.smithi064.stdout:3/45: write f6 [4879123,33688] 0 2023-12-16T03:15:53.625 INFO:tasks.workunit.client.1.smithi184.stdout:9/437: read d0/f57 [1070010,61783] 0 2023-12-16T03:15:53.625 INFO:tasks.workunit.client.1.smithi184.stdout:9/438: write d0/d3a/d47/f67 [975026,91886] 0 2023-12-16T03:15:53.631 INFO:tasks.workunit.client.1.smithi184.stdout:0/410: dwrite dc/d22/d1d/d43/f59 [0,4194304] 0 2023-12-16T03:15:53.634 INFO:tasks.workunit.client.1.smithi184.stdout:0/411: mkdir dc/d10/d2d/d5f/d7a/d87 0 2023-12-16T03:15:53.634 INFO:tasks.workunit.client.1.smithi184.stdout:0/412: fdatasync dc/d22/d53/f5e 0 2023-12-16T03:15:53.635 INFO:tasks.workunit.client.1.smithi184.stdout:0/413: mknod dc/d22/d1d/d43/c88 0 2023-12-16T03:15:53.637 INFO:tasks.workunit.client.1.smithi184.stdout:0/414: creat dc/d22/d1d/d43/d5a/f89 x:0 0 0 2023-12-16T03:15:53.638 INFO:tasks.workunit.client.1.smithi184.stdout:0/415: creat dc/d22/d45/d66/d80/f8a x:0 0 0 2023-12-16T03:15:53.640 INFO:tasks.workunit.client.1.smithi184.stdout:0/416: link dc/d10/d1c/c26 dc/c8b 0 2023-12-16T03:15:53.642 INFO:tasks.workunit.client.1.smithi184.stdout:0/417: mknod dc/d10/d2d/d5f/c8c 0 2023-12-16T03:15:53.644 INFO:tasks.workunit.client.1.smithi184.stdout:0/418: rename dc/d22/d1d/d43/d5a/f6a to dc/d10/d2d/f8d 0 2023-12-16T03:15:53.646 INFO:tasks.workunit.client.1.smithi184.stdout:0/419: mkdir dc/d22/d1d/d8e 0 2023-12-16T03:15:53.646 INFO:tasks.workunit.client.1.smithi184.stdout:0/420: write dc/d22/d1d/d43/f55 [490811,4520] 0 2023-12-16T03:15:53.646 INFO:tasks.workunit.client.1.smithi184.stdout:0/421: dread - dc/d22/d45/d66/f72 zero size 2023-12-16T03:15:53.646 INFO:tasks.workunit.client.1.smithi184.stdout:0/422: truncate dc/d22/d1d/d2c/f74 939834 0 2023-12-16T03:15:53.706 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:53 smithi184 ceph-mon[121180]: pgmap v191: 65 pgs: 65 active+clean; 378 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 9.4 MiB/s rd, 21 MiB/s wr, 619 op/s 2023-12-16T03:15:53.707 INFO:tasks.workunit.client.1.smithi184.stdout:5/163: dwrite d1/d3/d9/f18 [0,4194304] 0 2023-12-16T03:15:53.710 INFO:tasks.workunit.client.1.smithi184.stdout:5/164: symlink d1/d3/d9/de/d15/l34 0 2023-12-16T03:15:53.710 INFO:tasks.workunit.client.1.smithi184.stdout:5/165: fsync d1/d3/d9/de/f16 0 2023-12-16T03:15:53.710 INFO:tasks.workunit.client.1.smithi184.stdout:5/166: write d1/f29 [6021107,67987] 0 2023-12-16T03:15:53.710 INFO:tasks.workunit.client.1.smithi184.stdout:5/167: chown d1/d3/fa 0 1 2023-12-16T03:15:53.712 INFO:tasks.workunit.client.0.smithi064.stdout:9/13: mkdir d2/d5 0 2023-12-16T03:15:53.712 INFO:tasks.workunit.client.0.smithi064.stdout:9/14: chown d2/c3 25831101 1 2023-12-16T03:15:53.715 INFO:tasks.workunit.client.1.smithi184.stdout:9/439: getdents d0/d30 0 2023-12-16T03:15:53.715 INFO:tasks.workunit.client.0.smithi064.stdout:6/11: mkdir d3 0 2023-12-16T03:15:53.716 INFO:tasks.workunit.client.1.smithi184.stdout:5/168: dread d1/d2a/f13 [0,4194304] 0 2023-12-16T03:15:53.716 INFO:tasks.workunit.client.1.smithi184.stdout:9/440: creat d0/d30/f94 x:0 0 0 2023-12-16T03:15:53.717 INFO:tasks.workunit.client.0.smithi064.stdout:8/19: symlink d0/l5 0 2023-12-16T03:15:53.718 INFO:tasks.workunit.client.1.smithi184.stdout:9/441: mknod d0/d13/d6e/c95 0 2023-12-16T03:15:53.718 INFO:tasks.workunit.client.1.smithi184.stdout:9/442: fdatasync d0/f8b 0 2023-12-16T03:15:53.720 INFO:tasks.workunit.client.1.smithi184.stdout:9/443: symlink d0/d13/d6e/l96 0 2023-12-16T03:15:53.720 INFO:tasks.workunit.client.1.smithi184.stdout:0/423: dwrite dc/d22/d46/f6e [0,4194304] 0 2023-12-16T03:15:53.721 INFO:tasks.workunit.client.0.smithi064.stdout:1/18: mknod d3/c8 0 2023-12-16T03:15:53.721 INFO:tasks.workunit.client.0.smithi064.stdout:1/19: write f2 [1129239,53196] 0 2023-12-16T03:15:53.721 INFO:tasks.workunit.client.0.smithi064.stdout:1/20: chown d3/f7 662559753 1 2023-12-16T03:15:53.721 INFO:tasks.workunit.client.0.smithi064.stdout:1/21: chown d3/c4 0 1 2023-12-16T03:15:53.725 INFO:tasks.workunit.client.1.smithi184.stdout:9/444: mknod d0/d13/d20/d77/c97 0 2023-12-16T03:15:53.725 INFO:tasks.workunit.client.1.smithi184.stdout:0/424: creat dc/d22/d1d/d8e/f8f x:0 0 0 2023-12-16T03:15:53.728 INFO:tasks.workunit.client.1.smithi184.stdout:9/445: mkdir d0/d13/d20/d5b/d53/d98 0 2023-12-16T03:15:53.728 INFO:tasks.workunit.client.1.smithi184.stdout:9/446: chown d0/d13/f21 24880 1 2023-12-16T03:15:53.735 INFO:tasks.workunit.client.1.smithi184.stdout:9/447: dread d0/f14 [0,4194304] 0 2023-12-16T03:15:53.735 INFO:tasks.workunit.client.1.smithi184.stdout:9/448: truncate d0/d3a/f59 633167 0 2023-12-16T03:15:53.736 INFO:tasks.workunit.client.1.smithi184.stdout:5/169: dwrite d1/d3/d9/de/f1c [0,4194304] 0 2023-12-16T03:15:53.736 INFO:tasks.workunit.client.1.smithi184.stdout:9/449: link d0/d13/d20/c45 d0/d13/d20/d5b/d43/c99 0 2023-12-16T03:15:53.736 INFO:tasks.workunit.client.1.smithi184.stdout:9/450: readlink d0/d13/d20/d5b/d43/l60 0 2023-12-16T03:15:53.737 INFO:tasks.workunit.client.1.smithi184.stdout:9/451: write d0/d13/d20/d5b/d53/f81 [519798,73173] 0 2023-12-16T03:15:53.739 INFO:tasks.workunit.client.1.smithi184.stdout:5/170: mknod d1/d3/d9/c35 0 2023-12-16T03:15:53.740 INFO:tasks.workunit.client.1.smithi184.stdout:5/171: truncate d1/d2a/f13 3283468 0 2023-12-16T03:15:53.740 INFO:tasks.workunit.client.1.smithi184.stdout:9/452: write d0/f2f [2522257,12114] 0 2023-12-16T03:15:53.741 INFO:tasks.workunit.client.1.smithi184.stdout:5/172: truncate d1/d3/fd 3586377 0 2023-12-16T03:15:53.743 INFO:tasks.workunit.client.1.smithi184.stdout:5/173: creat d1/d3/f36 x:0 0 0 2023-12-16T03:15:53.744 INFO:tasks.workunit.client.1.smithi184.stdout:0/425: dwrite dc/f7b [0,4194304] 0 2023-12-16T03:15:53.745 INFO:tasks.workunit.client.1.smithi184.stdout:5/174: creat d1/d3/d9/de/f37 x:0 0 0 2023-12-16T03:15:53.749 INFO:tasks.workunit.client.1.smithi184.stdout:5/175: mknod d1/d3/d9/de/d15/c38 0 2023-12-16T03:15:53.749 INFO:tasks.workunit.client.1.smithi184.stdout:5/176: write d1/d3/d9/de/d15/d19/f2c [340068,61137] 0 2023-12-16T03:15:53.751 INFO:tasks.workunit.client.1.smithi184.stdout:5/177: creat d1/d3/d9/f39 x:0 0 0 2023-12-16T03:15:53.751 INFO:tasks.workunit.client.1.smithi184.stdout:5/178: write d1/d3/d9/f39 [138331,113912] 0 2023-12-16T03:15:53.751 INFO:tasks.workunit.client.1.smithi184.stdout:5/179: chown d1/d3/d9 30228 1 2023-12-16T03:15:53.753 INFO:tasks.workunit.client.1.smithi184.stdout:5/180: mkdir d1/d3/d9/de/d15/d19/d3a 0 2023-12-16T03:15:53.755 INFO:tasks.workunit.client.1.smithi184.stdout:5/181: creat d1/d3/d2f/f3b x:0 0 0 2023-12-16T03:15:53.755 INFO:tasks.workunit.client.1.smithi184.stdout:5/182: read d1/f1a [180442,11789] 0 2023-12-16T03:15:53.764 INFO:tasks.workunit.client.1.smithi184.stdout:9/453: dwrite d0/d3a/d47/f71 [0,4194304] 0 2023-12-16T03:15:53.767 INFO:tasks.workunit.client.1.smithi184.stdout:9/454: creat d0/d13/d6e/d84/f9a x:0 0 0 2023-12-16T03:15:53.768 INFO:tasks.workunit.client.1.smithi184.stdout:9/455: creat d0/d3a/f9b x:0 0 0 2023-12-16T03:15:53.769 INFO:tasks.workunit.client.1.smithi184.stdout:9/456: dread d0/f78 [0,4194304] 0 2023-12-16T03:15:53.769 INFO:tasks.workunit.client.1.smithi184.stdout:9/457: truncate d0/d3a/d47/d7a/f83 432963 0 2023-12-16T03:15:53.770 INFO:tasks.workunit.client.1.smithi184.stdout:9/458: symlink d0/d13/d6e/d84/l9c 0 2023-12-16T03:15:53.770 INFO:tasks.workunit.client.1.smithi184.stdout:0/426: dwrite dc/d22/d45/d66/f84 [0,4194304] 0 2023-12-16T03:15:53.771 INFO:tasks.workunit.client.1.smithi184.stdout:9/459: link d0/d13/d20/d5b/d53/c6c d0/d13/d6e/d84/c9d 0 2023-12-16T03:15:53.771 INFO:tasks.workunit.client.1.smithi184.stdout:9/460: dread - d0/d3a/f9b zero size 2023-12-16T03:15:53.772 INFO:tasks.workunit.client.1.smithi184.stdout:5/183: dwrite d1/d3/d2f/f3b [0,4194304] 0 2023-12-16T03:15:53.772 INFO:tasks.workunit.client.1.smithi184.stdout:5/184: stat d1/d3/d9/de/d15/d19/d3a 0 2023-12-16T03:15:53.773 INFO:tasks.workunit.client.1.smithi184.stdout:0/427: truncate dc/d10/f25 885242 0 2023-12-16T03:15:53.773 INFO:tasks.workunit.client.1.smithi184.stdout:0/428: fdatasync dc/d10/d1c/f2f 0 2023-12-16T03:15:53.774 INFO:tasks.workunit.client.1.smithi184.stdout:9/461: creat d0/d13/d6e/f9e x:0 0 0 2023-12-16T03:15:53.774 INFO:tasks.workunit.client.1.smithi184.stdout:9/462: write d0/d13/d20/f29 [1395287,10947] 0 2023-12-16T03:15:53.778 INFO:tasks.workunit.client.1.smithi184.stdout:5/185: link d1/d3/l14 d1/d3/d2f/l3c 0 2023-12-16T03:15:53.780 INFO:tasks.workunit.client.1.smithi184.stdout:9/463: dread d0/d13/d20/d5b/d53/f81 [0,4194304] 0 2023-12-16T03:15:53.780 INFO:tasks.workunit.client.1.smithi184.stdout:5/186: creat d1/d3/d2f/f3d x:0 0 0 2023-12-16T03:15:53.780 INFO:tasks.workunit.client.1.smithi184.stdout:9/464: fsync d0/d3a/d47/d7a/f83 0 2023-12-16T03:15:53.780 INFO:tasks.workunit.client.1.smithi184.stdout:5/187: write d1/d3/fa [1739828,120608] 0 2023-12-16T03:15:53.780 INFO:tasks.workunit.client.1.smithi184.stdout:0/429: dread dc/d22/d1a/f3e [4194304,4194304] 0 2023-12-16T03:15:53.780 INFO:tasks.workunit.client.1.smithi184.stdout:0/430: fsync dc/d10/d1c/f49 0 2023-12-16T03:15:53.782 INFO:tasks.workunit.client.1.smithi184.stdout:9/465: mkdir d0/d13/d6e/d9f 0 2023-12-16T03:15:53.782 INFO:tasks.workunit.client.1.smithi184.stdout:9/466: fsync d0/d13/d20/f8f 0 2023-12-16T03:15:53.783 INFO:tasks.workunit.client.1.smithi184.stdout:9/467: read d0/d3a/d47/f67 [259983,105800] 0 2023-12-16T03:15:53.783 INFO:tasks.workunit.client.1.smithi184.stdout:5/188: mknod d1/d3/d9/de/c3e 0 2023-12-16T03:15:53.785 INFO:tasks.workunit.client.1.smithi184.stdout:0/431: symlink dc/d22/d1d/d43/d5a/d60/l90 0 2023-12-16T03:15:53.785 INFO:tasks.workunit.client.1.smithi184.stdout:0/432: truncate dc/d22/d1a/f6f 673855 0 2023-12-16T03:15:53.785 INFO:tasks.workunit.client.1.smithi184.stdout:0/433: readlink dc/d10/d1c/l39 0 2023-12-16T03:15:53.786 INFO:tasks.workunit.client.1.smithi184.stdout:0/434: fsync dc/d22/d48/f5b 0 2023-12-16T03:15:53.788 INFO:tasks.workunit.client.1.smithi184.stdout:9/468: rename d0/f3e to d0/d3a/d47/d7a/fa0 0 2023-12-16T03:15:53.788 INFO:tasks.workunit.client.1.smithi184.stdout:9/469: truncate d0/d13/d6e/d84/f9a 1682 0 2023-12-16T03:15:53.788 INFO:tasks.workunit.client.1.smithi184.stdout:9/470: truncate d0/d13/d20/f29 2122502 0 2023-12-16T03:15:53.788 INFO:tasks.workunit.client.1.smithi184.stdout:9/471: readlink d0/d3a/l89 0 2023-12-16T03:15:53.789 INFO:tasks.workunit.client.1.smithi184.stdout:5/189: mkdir d1/d3/d9/de/d15/d19/d3a/d3f 0 2023-12-16T03:15:53.790 INFO:tasks.workunit.client.1.smithi184.stdout:9/472: rmdir d0/d13/d20/d5b 39 2023-12-16T03:15:53.792 INFO:tasks.workunit.client.1.smithi184.stdout:5/190: unlink d1/d3/d9/l17 0 2023-12-16T03:15:53.794 INFO:tasks.workunit.client.1.smithi184.stdout:9/473: symlink d0/d13/d20/d5b/d53/la1 0 2023-12-16T03:15:53.794 INFO:tasks.workunit.client.1.smithi184.stdout:0/435: dread dc/d10/f11 [0,4194304] 0 2023-12-16T03:15:53.795 INFO:tasks.workunit.client.1.smithi184.stdout:5/191: creat d1/d3/d9/f40 x:0 0 0 2023-12-16T03:15:53.796 INFO:tasks.workunit.client.1.smithi184.stdout:0/436: rename dc/d22/d53/f5e to dc/d10/d2d/d5f/d7a/d87/f91 0 2023-12-16T03:15:53.798 INFO:tasks.workunit.client.1.smithi184.stdout:0/437: read dc/d22/d46/f6e [1155052,6252] 0 2023-12-16T03:15:53.798 INFO:tasks.workunit.client.1.smithi184.stdout:5/192: creat d1/d3/d9/de/d15/d19/d3a/d3f/f41 x:0 0 0 2023-12-16T03:15:53.798 INFO:tasks.workunit.client.1.smithi184.stdout:9/474: dread d0/d13/d20/f29 [0,4194304] 0 2023-12-16T03:15:53.800 INFO:tasks.workunit.client.0.smithi064.stdout:3/46: creat db/f10 x:0 0 0 2023-12-16T03:15:53.800 INFO:tasks.workunit.client.1.smithi184.stdout:5/193: read d1/d3/d9/de/d15/d19/f2c [331372,42148] 0 2023-12-16T03:15:53.803 INFO:tasks.workunit.client.0.smithi064.stdout:9/15: rmdir d2/d5 0 2023-12-16T03:15:53.803 INFO:tasks.workunit.client.0.smithi064.stdout:9/16: fdatasync f1 0 2023-12-16T03:15:53.803 INFO:tasks.workunit.client.0.smithi064.stdout:9/17: rename d2 to d2/d6 22 2023-12-16T03:15:53.805 INFO:tasks.workunit.client.0.smithi064.stdout:6/12: mknod d3/c4 0 2023-12-16T03:15:53.813 INFO:tasks.workunit.client.0.smithi064.stdout:9/18: dread f1 [0,4194304] 0 2023-12-16T03:15:53.813 INFO:tasks.workunit.client.1.smithi184.stdout:9/475: truncate d0/d30/f41 907078 0 2023-12-16T03:15:53.814 INFO:tasks.workunit.client.1.smithi184.stdout:9/476: write d0/d13/f21 [231932,91520] 0 2023-12-16T03:15:53.814 INFO:tasks.workunit.client.1.smithi184.stdout:9/477: write d0/d13/d20/d5b/d53/f81 [633725,29750] 0 2023-12-16T03:15:53.814 INFO:tasks.workunit.client.1.smithi184.stdout:9/478: dread - d0/d13/f91 zero size 2023-12-16T03:15:53.815 INFO:tasks.workunit.client.1.smithi184.stdout:5/194: symlink d1/l42 0 2023-12-16T03:15:53.815 INFO:tasks.workunit.client.1.smithi184.stdout:5/195: write d1/d3/fa [232620,54240] 0 2023-12-16T03:15:53.815 INFO:tasks.workunit.client.1.smithi184.stdout:5/196: dread - d1/d3/f36 zero size 2023-12-16T03:15:53.815 INFO:tasks.workunit.client.1.smithi184.stdout:5/197: write d1/d3/d9/de/d15/d19/d3a/d3f/f41 [868072,51355] 0 2023-12-16T03:15:53.815 INFO:tasks.workunit.client.1.smithi184.stdout:5/198: chown d1/d2a/f13 3 1 2023-12-16T03:15:53.816 INFO:tasks.workunit.client.1.smithi184.stdout:9/479: mkdir d0/d76/da2 0 2023-12-16T03:15:53.816 INFO:tasks.workunit.client.1.smithi184.stdout:9/480: read d0/f36 [1876124,93013] 0 2023-12-16T03:15:53.817 INFO:tasks.workunit.client.1.smithi184.stdout:5/199: symlink d1/d3/d9/de/d30/l43 0 2023-12-16T03:15:53.818 INFO:tasks.workunit.client.1.smithi184.stdout:9/481: mkdir d0/d13/d20/da3 0 2023-12-16T03:15:53.819 INFO:tasks.workunit.client.1.smithi184.stdout:5/200: mknod d1/d3/c44 0 2023-12-16T03:15:53.819 INFO:tasks.workunit.client.1.smithi184.stdout:5/201: fdatasync d1/f29 0 2023-12-16T03:15:53.821 INFO:tasks.workunit.client.1.smithi184.stdout:5/202: mkdir d1/d3/d9/de/d15/d19/d3a/d3f/d45 0 2023-12-16T03:15:53.821 INFO:tasks.workunit.client.1.smithi184.stdout:0/438: dwrite dc/d22/d46/f67 [0,4194304] 0 2023-12-16T03:15:53.821 INFO:tasks.workunit.client.1.smithi184.stdout:0/439: write dc/d10/d2d/f6b [824326,43770] 0 2023-12-16T03:15:53.821 INFO:tasks.workunit.client.1.smithi184.stdout:0/440: chown dc/l51 22 1 2023-12-16T03:15:53.821 INFO:tasks.workunit.client.1.smithi184.stdout:9/482: symlink d0/d30/la4 0 2023-12-16T03:15:53.822 INFO:tasks.workunit.client.1.smithi184.stdout:9/483: truncate d0/d13/f2a 4228169 0 2023-12-16T03:15:53.822 INFO:tasks.workunit.client.1.smithi184.stdout:5/203: symlink d1/d3/d9/de/d30/l46 0 2023-12-16T03:15:53.822 INFO:tasks.workunit.client.1.smithi184.stdout:5/204: dread - d1/d3/d9/de/f37 zero size 2023-12-16T03:15:53.822 INFO:tasks.workunit.client.1.smithi184.stdout:5/205: fdatasync d1/d3/d9/de/d15/d19/f2c 0 2023-12-16T03:15:53.822 INFO:tasks.workunit.client.1.smithi184.stdout:5/206: dread - d1/d3/f36 zero size 2023-12-16T03:15:53.823 INFO:tasks.workunit.client.1.smithi184.stdout:5/207: chown d1/d3/d9/de/d15/c38 7287008 1 2023-12-16T03:15:53.825 INFO:tasks.workunit.client.1.smithi184.stdout:0/441: rename dc/d10/d1c/c26 to dc/d22/d45/d66/c92 0 2023-12-16T03:15:53.825 INFO:tasks.workunit.client.1.smithi184.stdout:0/442: chown dc/d2a/c3a 4452 1 2023-12-16T03:15:53.825 INFO:tasks.workunit.client.1.smithi184.stdout:0/443: chown dc/d22/d1a/f3e 387 1 2023-12-16T03:15:53.825 INFO:tasks.workunit.client.1.smithi184.stdout:0/444: read dc/d22/d1a/f3e [4257335,31624] 0 2023-12-16T03:15:53.825 INFO:tasks.workunit.client.1.smithi184.stdout:0/445: chown dc/d22/d53/c5c 15 1 2023-12-16T03:15:53.825 INFO:tasks.workunit.client.1.smithi184.stdout:0/446: stat dc/d22/d1d/d2c/l3b 0 2023-12-16T03:15:53.825 INFO:tasks.workunit.client.1.smithi184.stdout:9/484: mknod d0/d3a/d47/ca5 0 2023-12-16T03:15:53.826 INFO:tasks.workunit.client.1.smithi184.stdout:5/208: write d1/d3/d9/de/f1c [3790678,82898] 0 2023-12-16T03:15:53.826 INFO:tasks.workunit.client.1.smithi184.stdout:5/209: write d1/d3/d9/de/d15/f1e [779491,3716] 0 2023-12-16T03:15:53.826 INFO:tasks.workunit.client.1.smithi184.stdout:5/210: chown d1/d3/d9/de/d15/d19/d3a/d3f/f41 193806 1 2023-12-16T03:15:53.829 INFO:tasks.workunit.client.0.smithi064.stdout:6/13: dwrite f2 [0,4194304] 0 2023-12-16T03:15:53.829 INFO:tasks.workunit.client.0.smithi064.stdout:9/19: dwrite f1 [0,4194304] 0 2023-12-16T03:15:53.830 INFO:tasks.workunit.client.1.smithi184.stdout:5/211: link d1/d3/l32 d1/d3/d9/l47 0 2023-12-16T03:15:53.830 INFO:tasks.workunit.client.1.smithi184.stdout:5/212: write d1/d3/d9/de/f37 [539225,108718] 0 2023-12-16T03:15:53.831 INFO:tasks.workunit.client.0.smithi064.stdout:8/20: unlink d0/c4 0 2023-12-16T03:15:53.831 INFO:tasks.workunit.client.1.smithi184.stdout:0/447: symlink dc/d22/l93 0 2023-12-16T03:15:53.833 INFO:tasks.workunit.client.0.smithi064.stdout:1/22: mknod d3/c9 0 2023-12-16T03:15:53.835 INFO:tasks.workunit.client.0.smithi064.stdout:6/14: write f2 [1903426,45068] 0 2023-12-16T03:15:53.835 INFO:tasks.workunit.client.0.smithi064.stdout:1/23: link c1 d3/ca 0 2023-12-16T03:15:53.835 INFO:tasks.workunit.client.0.smithi064.stdout:1/24: dread - d3/f5 zero size 2023-12-16T03:15:53.836 INFO:tasks.workunit.client.1.smithi184.stdout:5/213: mkdir d1/d3/d9/de/d15/d19/d48 0 2023-12-16T03:15:53.836 INFO:tasks.workunit.client.0.smithi064.stdout:3/47: mknod db/c11 0 2023-12-16T03:15:53.837 INFO:tasks.workunit.client.1.smithi184.stdout:0/448: unlink dc/l57 0 2023-12-16T03:15:53.837 INFO:tasks.workunit.client.1.smithi184.stdout:0/449: dread - dc/d22/d1d/d2c/d75/f79 zero size 2023-12-16T03:15:53.838 INFO:tasks.workunit.client.0.smithi064.stdout:1/25: symlink d3/lb 0 2023-12-16T03:15:53.840 INFO:tasks.workunit.client.0.smithi064.stdout:3/48: mkdir db/d12 0 2023-12-16T03:15:53.841 INFO:tasks.workunit.client.1.smithi184.stdout:0/450: mknod dc/c94 0 2023-12-16T03:15:53.841 INFO:tasks.workunit.client.1.smithi184.stdout:0/451: readlink dc/d22/l3d 0 2023-12-16T03:15:53.843 INFO:tasks.workunit.client.0.smithi064.stdout:9/20: dread f1 [0,4194304] 0 2023-12-16T03:15:53.843 INFO:tasks.workunit.client.0.smithi064.stdout:6/15: fsync f2 0 2023-12-16T03:15:53.844 INFO:tasks.workunit.client.1.smithi184.stdout:0/452: creat dc/d22/d53/f95 x:0 0 0 2023-12-16T03:15:53.844 INFO:tasks.workunit.client.1.smithi184.stdout:0/453: write dc/d22/d48/f77 [4217,22170] 0 2023-12-16T03:15:53.844 INFO:tasks.workunit.client.1.smithi184.stdout:0/454: readlink dc/d22/l93 0 2023-12-16T03:15:53.844 INFO:tasks.workunit.client.0.smithi064.stdout:9/21: write f1 [1686494,81955] 0 2023-12-16T03:15:53.844 INFO:tasks.workunit.client.0.smithi064.stdout:9/22: chown l0 31 1 2023-12-16T03:15:53.845 INFO:tasks.workunit.client.0.smithi064.stdout:9/23: chown l0 6955080 1 2023-12-16T03:15:53.845 INFO:tasks.workunit.client.0.smithi064.stdout:3/49: dread f4 [0,4194304] 0 2023-12-16T03:15:53.847 INFO:tasks.workunit.client.1.smithi184.stdout:0/455: unlink dc/d10/d2d/f8d 0 2023-12-16T03:15:53.849 INFO:tasks.workunit.client.0.smithi064.stdout:6/16: rmdir d3 39 2023-12-16T03:15:53.849 INFO:tasks.workunit.client.0.smithi064.stdout:6/17: chown f2 6267745 1 2023-12-16T03:15:53.852 INFO:tasks.workunit.client.0.smithi064.stdout:6/18: creat d3/f5 x:0 0 0 2023-12-16T03:15:53.853 INFO:tasks.workunit.client.0.smithi064.stdout:3/50: mkdir db/d13 0 2023-12-16T03:15:53.855 INFO:tasks.workunit.client.0.smithi064.stdout:3/51: mkdir db/d13/d14 0 2023-12-16T03:15:53.855 INFO:tasks.workunit.client.0.smithi064.stdout:6/19: write f2 [3022786,22601] 0 2023-12-16T03:15:53.855 INFO:tasks.workunit.client.0.smithi064.stdout:6/20: stat d3 0 2023-12-16T03:15:53.855 INFO:tasks.workunit.client.0.smithi064.stdout:6/21: stat d3 0 2023-12-16T03:15:53.855 INFO:tasks.workunit.client.0.smithi064.stdout:8/21: dwrite d0/f3 [0,4194304] 0 2023-12-16T03:15:53.856 INFO:tasks.workunit.client.1.smithi184.stdout:5/214: dwrite d1/d3/d9/de/f1c [0,4194304] 0 2023-12-16T03:15:53.856 INFO:tasks.workunit.client.0.smithi064.stdout:6/22: symlink d3/l6 0 2023-12-16T03:15:53.859 INFO:tasks.workunit.client.1.smithi184.stdout:5/215: dread d1/d3/d9/f39 [0,4194304] 0 2023-12-16T03:15:53.862 INFO:tasks.workunit.client.1.smithi184.stdout:5/216: mkdir d1/d3/d9/d49 0 2023-12-16T03:15:53.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/217: symlink d1/d3/d9/d2e/l4a 0 2023-12-16T03:15:53.867 INFO:tasks.workunit.client.0.smithi064.stdout:5/31: fsync d0/d7/fb 0 2023-12-16T03:15:53.867 INFO:tasks.workunit.client.0.smithi064.stdout:5/32: chown d0/f5 492342 1 2023-12-16T03:15:53.869 INFO:tasks.workunit.client.0.smithi064.stdout:5/33: rename d0/l9 to d0/lc 0 2023-12-16T03:15:53.873 INFO:tasks.workunit.client.1.smithi184.stdout:5/218: write d1/d3/d9/de/f16 [3806592,23659] 0 2023-12-16T03:15:53.874 INFO:tasks.workunit.client.1.smithi184.stdout:5/219: rename d1/d3/d9/de/f1c to d1/d3/d9/de/d15/d19/d3a/f4b 0 2023-12-16T03:15:53.874 INFO:tasks.workunit.client.1.smithi184.stdout:3/353: sync 2023-12-16T03:15:53.875 INFO:tasks.workunit.client.0.smithi064.stdout:4/38: rmdir d0 39 2023-12-16T03:15:53.877 INFO:tasks.workunit.client.1.smithi184.stdout:3/354: mkdir d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b 0 2023-12-16T03:15:53.878 INFO:tasks.workunit.client.0.smithi064.stdout:4/39: getdents d0 0 2023-12-16T03:15:53.880 INFO:tasks.workunit.client.0.smithi064.stdout:4/40: symlink d0/lf 0 2023-12-16T03:15:53.880 INFO:tasks.workunit.client.0.smithi064.stdout:4/41: dread - d0/f1 zero size 2023-12-16T03:15:53.886 INFO:tasks.workunit.client.1.smithi184.stdout:0/456: dwrite dc/d10/d1c/f2f [0,4194304] 0 2023-12-16T03:15:53.887 INFO:tasks.workunit.client.1.smithi184.stdout:0/457: truncate dc/f19 3678442 0 2023-12-16T03:15:53.889 INFO:tasks.workunit.client.1.smithi184.stdout:0/458: link dc/d10/c24 dc/d22/d1d/d43/d5a/d60/c96 0 2023-12-16T03:15:53.889 INFO:tasks.workunit.client.1.smithi184.stdout:0/459: chown dc/d10/d2d/d5f/c8c 5083599 1 2023-12-16T03:15:53.890 INFO:tasks.workunit.client.1.smithi184.stdout:0/460: truncate dc/d10/f14 2836196 0 2023-12-16T03:15:53.892 INFO:tasks.workunit.client.0.smithi064.stdout:3/52: dwrite f0 [0,4194304] 0 2023-12-16T03:15:53.892 INFO:tasks.workunit.client.0.smithi064.stdout:9/24: dwrite f1 [0,4194304] 0 2023-12-16T03:15:53.892 INFO:tasks.workunit.client.0.smithi064.stdout:3/53: chown f4 19442969 1 2023-12-16T03:15:53.892 INFO:tasks.workunit.client.0.smithi064.stdout:6/23: dread f2 [0,4194304] 0 2023-12-16T03:15:53.893 INFO:tasks.workunit.client.0.smithi064.stdout:8/22: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:15:53.893 INFO:tasks.workunit.client.0.smithi064.stdout:0/20: dread f1 [0,4194304] 0 2023-12-16T03:15:53.893 INFO:tasks.workunit.client.0.smithi064.stdout:5/34: dread d0/d7/fa [0,4194304] 0 2023-12-16T03:15:53.897 INFO:tasks.workunit.client.0.smithi064.stdout:9/25: write f1 [1824215,8071] 0 2023-12-16T03:15:53.898 INFO:tasks.workunit.client.1.smithi184.stdout:3/355: dwrite d12/d18/d1f/d23/d2a/d3e/d48/f70 [0,4194304] 0 2023-12-16T03:15:53.898 INFO:tasks.workunit.client.1.smithi184.stdout:3/356: fdatasync d12/d18/d1f/f6c 0 2023-12-16T03:15:53.898 INFO:tasks.workunit.client.1.smithi184.stdout:3/357: write d12/d18/d1f/f3d [684510,10365] 0 2023-12-16T03:15:53.898 INFO:tasks.workunit.client.1.smithi184.stdout:3/358: read - d12/d37/f6a zero size 2023-12-16T03:15:53.900 INFO:tasks.workunit.client.0.smithi064.stdout:5/35: dread d0/d7/fa [0,4194304] 0 2023-12-16T03:15:53.900 INFO:tasks.workunit.client.0.smithi064.stdout:5/36: fdatasync d0/f5 0 2023-12-16T03:15:53.901 INFO:tasks.workunit.client.0.smithi064.stdout:5/37: truncate d0/d7/fb 187837 0 2023-12-16T03:15:53.903 INFO:tasks.workunit.client.1.smithi184.stdout:0/461: dread dc/f58 [0,4194304] 0 2023-12-16T03:15:53.905 INFO:tasks.workunit.client.1.smithi184.stdout:3/359: rmdir d12/d18/d1f/d23/d2a/d4a 39 2023-12-16T03:15:53.906 INFO:tasks.workunit.client.1.smithi184.stdout:3/360: symlink d12/d1e/d89/l8c 0 2023-12-16T03:15:53.909 INFO:tasks.workunit.client.1.smithi184.stdout:3/361: creat d12/d18/d1f/d23/d2a/d36/f8d x:0 0 0 2023-12-16T03:15:53.910 INFO:tasks.workunit.client.1.smithi184.stdout:3/362: mkdir d12/d18/d1f/d23/d2a/d4a/d8e 0 2023-12-16T03:15:53.921 INFO:tasks.workunit.client.1.smithi184.stdout:0/462: dwrite dc/d22/d48/f5b [4194304,4194304] 0 2023-12-16T03:15:53.921 INFO:tasks.workunit.client.1.smithi184.stdout:0/463: read dc/d10/d2d/f50 [238423,52259] 0 2023-12-16T03:15:53.929 INFO:tasks.workunit.client.1.smithi184.stdout:3/363: dwrite d12/d18/f74 [0,4194304] 0 2023-12-16T03:15:53.931 INFO:tasks.workunit.client.1.smithi184.stdout:0/464: dread dc/f7b [0,4194304] 0 2023-12-16T03:15:53.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/364: creat d12/d18/d7a/f8f x:0 0 0 2023-12-16T03:15:53.933 INFO:tasks.workunit.client.1.smithi184.stdout:0/465: unlink l3 0 2023-12-16T03:15:53.933 INFO:tasks.workunit.client.1.smithi184.stdout:0/466: chown dc/d22/d1a 15665 1 2023-12-16T03:15:53.934 INFO:tasks.workunit.client.1.smithi184.stdout:3/365: rmdir d12/d18/d1f/d23/d2a/d4a/d8e 0 2023-12-16T03:15:53.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:53 smithi064 ceph-mon[111958]: pgmap v191: 65 pgs: 65 active+clean; 378 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 9.4 MiB/s rd, 21 MiB/s wr, 619 op/s 2023-12-16T03:15:53.945 INFO:tasks.workunit.client.0.smithi064.stdout:4/42: symlink d0/l10 0 2023-12-16T03:15:53.948 INFO:tasks.workunit.client.0.smithi064.stdout:3/54: link db/fd db/d12/f15 0 2023-12-16T03:15:53.949 INFO:tasks.workunit.client.0.smithi064.stdout:6/24: mknod d3/c7 0 2023-12-16T03:15:53.949 INFO:tasks.workunit.client.0.smithi064.stdout:6/25: read f2 [1994806,72698] 0 2023-12-16T03:15:53.949 INFO:tasks.workunit.client.0.smithi064.stdout:8/23: mknod d0/c6 0 2023-12-16T03:15:53.950 INFO:tasks.workunit.client.0.smithi064.stdout:8/24: write d0/f3 [3118545,106314] 0 2023-12-16T03:15:53.950 INFO:tasks.workunit.client.0.smithi064.stdout:0/21: creat d2/f5 x:0 0 0 2023-12-16T03:15:53.954 INFO:tasks.workunit.client.0.smithi064.stdout:1/26: truncate d3/f7 771279 0 2023-12-16T03:15:53.955 INFO:tasks.workunit.client.0.smithi064.stdout:1/27: write f2 [225639,129545] 0 2023-12-16T03:15:53.955 INFO:tasks.workunit.client.0.smithi064.stdout:5/38: mknod d0/cd 0 2023-12-16T03:15:53.956 INFO:tasks.workunit.client.0.smithi064.stdout:5/39: write d0/d7/fa [2729902,64271] 0 2023-12-16T03:15:53.956 INFO:tasks.workunit.client.0.smithi064.stdout:4/43: stat d0/l6 0 2023-12-16T03:15:53.956 INFO:tasks.workunit.client.0.smithi064.stdout:4/44: chown d0 42340436 1 2023-12-16T03:15:53.957 INFO:tasks.workunit.client.0.smithi064.stdout:3/55: creat db/f16 x:0 0 0 2023-12-16T03:15:53.957 INFO:tasks.workunit.client.0.smithi064.stdout:3/56: dread - db/f16 zero size 2023-12-16T03:15:53.957 INFO:tasks.workunit.client.0.smithi064.stdout:3/57: write f0 [3274103,19797] 0 2023-12-16T03:15:53.958 INFO:tasks.workunit.client.0.smithi064.stdout:6/26: mkdir d3/d8 0 2023-12-16T03:15:53.959 INFO:tasks.workunit.client.0.smithi064.stdout:8/25: creat d0/f7 x:0 0 0 2023-12-16T03:15:53.961 INFO:tasks.workunit.client.0.smithi064.stdout:6/27: dread f2 [0,4194304] 0 2023-12-16T03:15:53.961 INFO:tasks.workunit.client.0.smithi064.stdout:6/28: write f2 [4105575,117921] 0 2023-12-16T03:15:53.961 INFO:tasks.workunit.client.0.smithi064.stdout:1/28: symlink d3/lc 0 2023-12-16T03:15:53.962 INFO:tasks.workunit.client.0.smithi064.stdout:1/29: dread - d3/f5 zero size 2023-12-16T03:15:53.964 INFO:tasks.workunit.client.0.smithi064.stdout:5/40: mkdir d0/de 0 2023-12-16T03:15:53.964 INFO:tasks.workunit.client.0.smithi064.stdout:4/45: stat d0/da/cb 0 2023-12-16T03:15:53.965 INFO:tasks.workunit.client.0.smithi064.stdout:3/58: rmdir db/d12 39 2023-12-16T03:15:53.968 INFO:tasks.workunit.client.0.smithi064.stdout:5/41: link d0/f5 d0/de/ff 0 2023-12-16T03:15:53.968 INFO:tasks.workunit.client.0.smithi064.stdout:5/42: truncate d0/f5 986114 0 2023-12-16T03:15:53.969 INFO:tasks.workunit.client.0.smithi064.stdout:5/43: stat d0/d7 0 2023-12-16T03:15:53.969 INFO:tasks.workunit.client.0.smithi064.stdout:4/46: write d0/f5 [397342,83527] 0 2023-12-16T03:15:53.970 INFO:tasks.workunit.client.0.smithi064.stdout:3/59: rmdir db/d13 39 2023-12-16T03:15:53.970 INFO:tasks.workunit.client.0.smithi064.stdout:3/60: write db/d12/f15 [255636,25232] 0 2023-12-16T03:15:53.972 INFO:tasks.workunit.client.0.smithi064.stdout:5/44: symlink d0/de/l10 0 2023-12-16T03:15:53.974 INFO:tasks.workunit.client.0.smithi064.stdout:5/45: symlink d0/d7/l11 0 2023-12-16T03:15:53.975 INFO:tasks.workunit.client.0.smithi064.stdout:5/46: dread d0/f3 [0,4194304] 0 2023-12-16T03:15:53.977 INFO:tasks.workunit.client.0.smithi064.stdout:6/29: dwrite d3/f5 [0,4194304] 0 2023-12-16T03:15:53.977 INFO:tasks.workunit.client.0.smithi064.stdout:6/30: chown f2 17 1 2023-12-16T03:15:53.978 INFO:tasks.workunit.client.0.smithi064.stdout:5/47: fsync d0/d7/fa 0 2023-12-16T03:15:53.980 INFO:tasks.workunit.client.0.smithi064.stdout:6/31: unlink f2 0 2023-12-16T03:15:53.981 INFO:tasks.workunit.client.0.smithi064.stdout:5/48: symlink d0/l12 0 2023-12-16T03:15:53.989 INFO:tasks.workunit.client.0.smithi064.stdout:0/22: getdents d2 0 2023-12-16T03:15:53.991 INFO:tasks.workunit.client.0.smithi064.stdout:0/23: symlink d2/l6 0 2023-12-16T03:15:53.995 INFO:tasks.workunit.client.0.smithi064.stdout:0/24: mkdir d2/d7 0 2023-12-16T03:15:53.998 INFO:tasks.workunit.client.0.smithi064.stdout:8/26: rmdir d0 39 2023-12-16T03:15:54.000 INFO:tasks.workunit.client.0.smithi064.stdout:8/27: link d0/f3 d0/f8 0 2023-12-16T03:15:54.000 INFO:tasks.workunit.client.0.smithi064.stdout:5/49: write d0/d7/fa [3373065,40991] 0 2023-12-16T03:15:54.001 INFO:tasks.workunit.client.0.smithi064.stdout:8/28: symlink d0/l9 0 2023-12-16T03:15:54.003 INFO:tasks.workunit.client.0.smithi064.stdout:3/61: dwrite db/d12/f15 [0,4194304] 0 2023-12-16T03:15:54.007 INFO:tasks.workunit.client.0.smithi064.stdout:1/30: write d3/f7 [289982,91290] 0 2023-12-16T03:15:54.007 INFO:tasks.workunit.client.0.smithi064.stdout:1/31: write d3/f7 [1180739,11730] 0 2023-12-16T03:15:54.007 INFO:tasks.workunit.client.0.smithi064.stdout:1/32: truncate d3/f5 180991 0 2023-12-16T03:15:54.007 INFO:tasks.workunit.client.0.smithi064.stdout:1/33: write d3/f6 [639087,78923] 0 2023-12-16T03:15:54.008 INFO:tasks.workunit.client.0.smithi064.stdout:3/62: rmdir db/d13 39 2023-12-16T03:15:54.009 INFO:tasks.workunit.client.0.smithi064.stdout:5/50: dread d0/f5 [0,4194304] 0 2023-12-16T03:15:54.009 INFO:tasks.workunit.client.0.smithi064.stdout:4/47: dwrite d0/f5 [0,4194304] 0 2023-12-16T03:15:54.009 INFO:tasks.workunit.client.0.smithi064.stdout:4/48: fsync d0/f5 0 2023-12-16T03:15:54.010 INFO:tasks.workunit.client.0.smithi064.stdout:1/34: mkdir d3/dd 0 2023-12-16T03:15:54.013 INFO:tasks.workunit.client.0.smithi064.stdout:5/51: link d0/d7/l11 d0/l13 0 2023-12-16T03:15:54.013 INFO:tasks.workunit.client.0.smithi064.stdout:5/52: write d0/d7/fb [991573,43404] 0 2023-12-16T03:15:54.014 INFO:tasks.workunit.client.0.smithi064.stdout:5/53: dread d0/f3 [0,4194304] 0 2023-12-16T03:15:54.019 INFO:tasks.workunit.client.0.smithi064.stdout:8/29: fdatasync d0/f3 0 2023-12-16T03:15:54.020 INFO:tasks.workunit.client.0.smithi064.stdout:0/25: dwrite d2/f5 [0,4194304] 0 2023-12-16T03:15:54.021 INFO:tasks.workunit.client.1.smithi184.stdout:6/360: sync 2023-12-16T03:15:54.021 INFO:tasks.workunit.client.1.smithi184.stdout:8/377: sync 2023-12-16T03:15:54.021 INFO:tasks.workunit.client.1.smithi184.stdout:1/343: sync 2023-12-16T03:15:54.021 INFO:tasks.workunit.client.1.smithi184.stdout:6/361: dread - d0/f31 zero size 2023-12-16T03:15:54.021 INFO:tasks.workunit.client.0.smithi064.stdout:8/30: mkdir d0/da 0 2023-12-16T03:15:54.021 INFO:tasks.workunit.client.0.smithi064.stdout:8/31: write d0/f8 [4019466,14060] 0 2023-12-16T03:15:54.022 INFO:tasks.workunit.client.0.smithi064.stdout:6/32: dwrite d3/f5 [0,4194304] 0 2023-12-16T03:15:54.024 INFO:tasks.workunit.client.1.smithi184.stdout:1/344: dread d3/d28/d3c/fe [0,4194304] 0 2023-12-16T03:15:54.026 INFO:tasks.workunit.client.0.smithi064.stdout:0/26: chown d2/l4 5982 1 2023-12-16T03:15:54.026 INFO:tasks.workunit.client.0.smithi064.stdout:0/27: stat d2/l6 0 2023-12-16T03:15:54.027 INFO:tasks.workunit.client.0.smithi064.stdout:1/35: dread d3/f6 [0,4194304] 0 2023-12-16T03:15:54.028 INFO:tasks.workunit.client.0.smithi064.stdout:1/36: getdents d3/dd 0 2023-12-16T03:15:54.029 INFO:tasks.workunit.client.0.smithi064.stdout:0/28: write f1 [1047076,26351] 0 2023-12-16T03:15:54.030 INFO:tasks.workunit.client.0.smithi064.stdout:1/37: dread d3/f6 [0,4194304] 0 2023-12-16T03:15:54.037 INFO:tasks.workunit.client.0.smithi064.stdout:6/33: mkdir d3/d9 0 2023-12-16T03:15:54.037 INFO:tasks.workunit.client.0.smithi064.stdout:6/34: getdents d3/d9 0 2023-12-16T03:15:54.037 INFO:tasks.workunit.client.0.smithi064.stdout:6/35: chown d3/d8 1 1 2023-12-16T03:15:54.038 INFO:tasks.workunit.client.0.smithi064.stdout:3/63: truncate db/d12/f15 3241374 0 2023-12-16T03:15:54.038 INFO:tasks.workunit.client.0.smithi064.stdout:3/64: chown ca 482 1 2023-12-16T03:15:54.038 INFO:tasks.workunit.client.0.smithi064.stdout:3/65: chown f1 4 1 2023-12-16T03:15:54.038 INFO:tasks.workunit.client.0.smithi064.stdout:1/38: creat d3/fe x:0 0 0 2023-12-16T03:15:54.040 INFO:tasks.workunit.client.0.smithi064.stdout:3/66: rename db/d13/d14 to db/d13/d17 0 2023-12-16T03:15:54.042 INFO:tasks.workunit.client.0.smithi064.stdout:3/67: creat db/d12/f18 x:0 0 0 2023-12-16T03:15:54.042 INFO:tasks.workunit.client.0.smithi064.stdout:3/68: creat db/f19 x:0 0 0 2023-12-16T03:15:54.050 INFO:tasks.workunit.client.0.smithi064.stdout:6/36: dread d3/f5 [0,4194304] 0 2023-12-16T03:15:54.050 INFO:tasks.workunit.client.0.smithi064.stdout:6/37: readlink l0 0 2023-12-16T03:15:54.061 INFO:tasks.workunit.client.1.smithi184.stdout:0/467: rename dc/d22/d1d/d2c/d75/f79 to dc/d2a/f97 0 2023-12-16T03:15:54.061 INFO:tasks.workunit.client.1.smithi184.stdout:0/468: write dc/d22/d45/d66/f72 [327950,781] 0 2023-12-16T03:15:54.061 INFO:tasks.workunit.client.1.smithi184.stdout:3/366: creat d12/d18/d1f/d23/d51/f90 x:0 0 0 2023-12-16T03:15:54.062 INFO:tasks.workunit.client.1.smithi184.stdout:3/367: readlink d12/d1e/d89/l8c 0 2023-12-16T03:15:54.062 INFO:tasks.workunit.client.0.smithi064.stdout:5/54: truncate d0/d7/fb 775537 0 2023-12-16T03:15:54.062 INFO:tasks.workunit.client.1.smithi184.stdout:8/378: truncate d2/d12/f5a 831761 0 2023-12-16T03:15:54.063 INFO:tasks.workunit.client.0.smithi064.stdout:5/55: dread d0/de/ff [0,4194304] 0 2023-12-16T03:15:54.064 INFO:tasks.workunit.client.0.smithi064.stdout:5/56: chown d0/f3 204848826 1 2023-12-16T03:15:54.064 INFO:tasks.workunit.client.0.smithi064.stdout:5/57: fsync d0/f5 0 2023-12-16T03:15:54.064 INFO:tasks.workunit.client.1.smithi184.stdout:6/362: symlink d0/d5/d22/d37/d40/l72 0 2023-12-16T03:15:54.064 INFO:tasks.workunit.client.1.smithi184.stdout:6/363: fsync d0/d5/d12/d1b/f4c 0 2023-12-16T03:15:54.064 INFO:tasks.workunit.client.1.smithi184.stdout:6/364: truncate d0/d5/d22/d25/d47/f6e 682428 0 2023-12-16T03:15:54.065 INFO:tasks.workunit.client.1.smithi184.stdout:3/368: creat d12/d18/d1f/d23/d2a/d4a/f91 x:0 0 0 2023-12-16T03:15:54.066 INFO:tasks.workunit.client.0.smithi064.stdout:5/58: mkdir d0/d14 0 2023-12-16T03:15:54.066 INFO:tasks.workunit.client.1.smithi184.stdout:8/379: symlink d2/d12/l78 0 2023-12-16T03:15:54.068 INFO:tasks.workunit.client.1.smithi184.stdout:6/365: link d0/d5/f2c d0/d5/d22/d25/d47/f73 0 2023-12-16T03:15:54.068 INFO:tasks.workunit.client.1.smithi184.stdout:6/366: chown d0/d5/d12/f1c 1772668 1 2023-12-16T03:15:54.069 INFO:tasks.workunit.client.1.smithi184.stdout:3/369: rename d12/d18/d1f/d23/d2a/d4a/d61/c63 to d12/d37/d81/c92 0 2023-12-16T03:15:54.070 INFO:tasks.workunit.client.1.smithi184.stdout:6/367: symlink d0/d5/d22/d37/d45/l74 0 2023-12-16T03:15:54.070 INFO:tasks.workunit.client.1.smithi184.stdout:6/368: write d0/d5/d22/f41 [4607688,92668] 0 2023-12-16T03:15:54.071 INFO:tasks.workunit.client.1.smithi184.stdout:8/380: rename d2/d12/d21/d30/l57 to d2/d37/l79 0 2023-12-16T03:15:54.075 INFO:tasks.workunit.client.1.smithi184.stdout:3/370: truncate d12/d18/d1f/d23/d2a/f38 3677666 0 2023-12-16T03:15:54.075 INFO:tasks.workunit.client.1.smithi184.stdout:3/371: fdatasync d12/d18/d1f/d23/d2a/d3e/d48/f88 0 2023-12-16T03:15:54.075 INFO:tasks.workunit.client.1.smithi184.stdout:3/372: truncate d12/d18/d1f/d23/d51/f79 430661 0 2023-12-16T03:15:54.083 INFO:tasks.workunit.client.1.smithi184.stdout:1/345: dwrite d3/d28/d3c/d41/d46/d4a/f50 [0,4194304] 0 2023-12-16T03:15:54.083 INFO:tasks.workunit.client.0.smithi064.stdout:4/49: dwrite d0/f8 [0,4194304] 0 2023-12-16T03:15:54.084 INFO:tasks.workunit.client.0.smithi064.stdout:8/32: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:15:54.084 INFO:tasks.workunit.client.0.smithi064.stdout:8/33: chown d0/l5 0 1 2023-12-16T03:15:54.084 INFO:tasks.workunit.client.0.smithi064.stdout:6/38: truncate d3/f5 770986 0 2023-12-16T03:15:54.087 INFO:tasks.workunit.client.1.smithi184.stdout:1/346: creat d3/d28/d3c/d41/d46/d4a/d6a/f72 x:0 0 0 2023-12-16T03:15:54.088 INFO:tasks.workunit.client.0.smithi064.stdout:4/50: creat d0/f11 x:0 0 0 2023-12-16T03:15:54.088 INFO:tasks.workunit.client.1.smithi184.stdout:3/373: dread d12/d18/d68/f6e [0,4194304] 0 2023-12-16T03:15:54.089 INFO:tasks.workunit.client.1.smithi184.stdout:3/374: chown d12/d18/f7c 1846434 1 2023-12-16T03:15:54.089 INFO:tasks.workunit.client.0.smithi064.stdout:1/39: rmdir d3 39 2023-12-16T03:15:54.089 INFO:tasks.workunit.client.0.smithi064.stdout:1/40: write d3/f5 [538884,22785] 0 2023-12-16T03:15:54.089 INFO:tasks.workunit.client.0.smithi064.stdout:2/23: sync 2023-12-16T03:15:54.090 INFO:tasks.workunit.client.1.smithi184.stdout:1/347: creat d3/d28/d38/f73 x:0 0 0 2023-12-16T03:15:54.090 INFO:tasks.workunit.client.0.smithi064.stdout:6/39: mkdir d3/d8/da 0 2023-12-16T03:15:54.091 INFO:tasks.workunit.client.1.smithi184.stdout:3/375: mkdir d12/d18/d1f/d93 0 2023-12-16T03:15:54.092 INFO:tasks.workunit.client.1.smithi184.stdout:3/376: write d12/f1b [3358087,49838] 0 2023-12-16T03:15:54.092 INFO:tasks.workunit.client.1.smithi184.stdout:1/348: symlink d3/d28/d3c/d41/d46/d4a/l74 0 2023-12-16T03:15:54.093 INFO:tasks.workunit.client.0.smithi064.stdout:3/69: rmdir db/d13/d17 0 2023-12-16T03:15:54.093 INFO:tasks.workunit.client.0.smithi064.stdout:3/70: write f4 [2057903,128457] 0 2023-12-16T03:15:54.093 INFO:tasks.workunit.client.0.smithi064.stdout:3/71: dread - db/d12/f18 zero size 2023-12-16T03:15:54.093 INFO:tasks.workunit.client.0.smithi064.stdout:3/72: readlink l2 0 2023-12-16T03:15:54.094 INFO:tasks.workunit.client.0.smithi064.stdout:2/24: creat d1/f6 x:0 0 0 2023-12-16T03:15:54.094 INFO:tasks.workunit.client.0.smithi064.stdout:2/25: chown d1/f3 3491 1 2023-12-16T03:15:54.094 INFO:tasks.workunit.client.0.smithi064.stdout:2/26: truncate d1/f6 364991 0 2023-12-16T03:15:54.094 INFO:tasks.workunit.client.1.smithi184.stdout:0/469: dwrite dc/f42 [0,4194304] 0 2023-12-16T03:15:54.095 INFO:tasks.workunit.client.1.smithi184.stdout:1/349: mknod d3/d28/d3c/d41/d63/c75 0 2023-12-16T03:15:54.095 INFO:tasks.workunit.client.0.smithi064.stdout:5/59: rename d0/d7/fb to d0/f15 0 2023-12-16T03:15:54.096 INFO:tasks.workunit.client.0.smithi064.stdout:8/34: dread d0/f3 [0,4194304] 0 2023-12-16T03:15:54.096 INFO:tasks.workunit.client.0.smithi064.stdout:1/41: dread f2 [0,4194304] 0 2023-12-16T03:15:54.098 INFO:tasks.workunit.client.0.smithi064.stdout:8/35: mkdir d0/db 0 2023-12-16T03:15:54.098 INFO:tasks.workunit.client.1.smithi184.stdout:3/377: read d12/d18/d1f/d23/d2a/d42/f46 [1015756,99254] 0 2023-12-16T03:15:54.102 INFO:tasks.workunit.client.1.smithi184.stdout:8/381: dwrite d2/d4/d10/f14 [0,4194304] 0 2023-12-16T03:15:54.102 INFO:tasks.workunit.client.1.smithi184.stdout:6/369: dwrite d0/d5/d12/f1c [0,4194304] 0 2023-12-16T03:15:54.103 INFO:tasks.workunit.client.0.smithi064.stdout:1/42: dread d3/f5 [0,4194304] 0 2023-12-16T03:15:54.106 INFO:tasks.workunit.client.0.smithi064.stdout:1/43: truncate f2 732744 0 2023-12-16T03:15:54.108 INFO:tasks.workunit.client.1.smithi184.stdout:0/470: mknod dc/d10/d2d/d5f/d7c/c98 0 2023-12-16T03:15:54.110 INFO:tasks.workunit.client.1.smithi184.stdout:1/350: mkdir d3/d34/d76 0 2023-12-16T03:15:54.112 INFO:tasks.workunit.client.1.smithi184.stdout:3/378: mknod d12/d18/d1f/d23/d51/c94 0 2023-12-16T03:15:54.112 INFO:tasks.workunit.client.1.smithi184.stdout:3/379: chown d12/l33 704 1 2023-12-16T03:15:54.112 INFO:tasks.workunit.client.1.smithi184.stdout:3/380: dread - d12/d18/d1f/d23/d2a/d36/f8d zero size 2023-12-16T03:15:54.116 INFO:tasks.workunit.client.1.smithi184.stdout:8/382: rename d2/d12/d21/d2d/d31/d5e/d66 to d2/d4/d10/d7a 0 2023-12-16T03:15:54.120 INFO:tasks.workunit.client.1.smithi184.stdout:6/370: creat d0/d5/d26/f75 x:0 0 0 2023-12-16T03:15:54.122 INFO:tasks.workunit.client.1.smithi184.stdout:8/383: write d2/d12/d21/d2d/d31/f6c [248380,14105] 0 2023-12-16T03:15:54.123 INFO:tasks.workunit.client.0.smithi064.stdout:1/44: write f2 [1132733,46212] 0 2023-12-16T03:15:54.123 INFO:tasks.workunit.client.1.smithi184.stdout:1/351: dread d3/d13/f1f [0,4194304] 0 2023-12-16T03:15:54.124 INFO:tasks.workunit.client.1.smithi184.stdout:1/352: write d3/d28/d38/f73 [938475,62635] 0 2023-12-16T03:15:54.124 INFO:tasks.workunit.client.1.smithi184.stdout:1/353: truncate d3/d13/f29 4607612 0 2023-12-16T03:15:54.124 INFO:tasks.workunit.client.1.smithi184.stdout:3/381: creat d12/d37/f95 x:0 0 0 2023-12-16T03:15:54.125 INFO:tasks.workunit.client.0.smithi064.stdout:1/45: creat d3/dd/ff x:0 0 0 2023-12-16T03:15:54.125 INFO:tasks.workunit.client.0.smithi064.stdout:1/46: truncate d3/f7 1669529 0 2023-12-16T03:15:54.125 INFO:tasks.workunit.client.1.smithi184.stdout:6/371: symlink d0/d5/d22/d25/d47/l76 0 2023-12-16T03:15:54.126 INFO:tasks.workunit.client.0.smithi064.stdout:1/47: symlink d3/dd/l10 0 2023-12-16T03:15:54.128 INFO:tasks.workunit.client.1.smithi184.stdout:8/384: rename d2/d12/d21/d2d/l47 to d2/d12/l7b 0 2023-12-16T03:15:54.128 INFO:tasks.workunit.client.0.smithi064.stdout:1/48: mkdir d3/dd/d11 0 2023-12-16T03:15:54.129 INFO:tasks.workunit.client.1.smithi184.stdout:0/471: link dc/d22/d1d/d43/d5a/d60/c96 dc/d22/d1d/d43/d5a/c99 0 2023-12-16T03:15:54.129 INFO:tasks.workunit.client.0.smithi064.stdout:1/49: mknod d3/dd/c12 0 2023-12-16T03:15:54.130 INFO:tasks.workunit.client.1.smithi184.stdout:1/354: mkdir d3/d28/d3c/d41/d77 0 2023-12-16T03:15:54.131 INFO:tasks.workunit.client.1.smithi184.stdout:3/382: creat d12/d1e/d89/f96 x:0 0 0 2023-12-16T03:15:54.131 INFO:tasks.workunit.client.1.smithi184.stdout:3/383: stat d12/d18/d1f/d93 0 2023-12-16T03:15:54.139 INFO:tasks.workunit.client.1.smithi184.stdout:8/385: dread d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:15:54.139 INFO:tasks.workunit.client.1.smithi184.stdout:8/386: fsync d2/d12/d21/d2d/d31/f3a 0 2023-12-16T03:15:54.144 INFO:tasks.workunit.client.1.smithi184.stdout:3/384: dread d12/d18/d1f/d23/d2a/f53 [0,4194304] 0 2023-12-16T03:15:54.144 INFO:tasks.workunit.client.0.smithi064.stdout:3/73: dwrite db/fd [0,4194304] 0 2023-12-16T03:15:54.144 INFO:tasks.workunit.client.0.smithi064.stdout:3/74: chown db/f10 688 1 2023-12-16T03:15:54.144 INFO:tasks.workunit.client.0.smithi064.stdout:8/36: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:15:54.145 INFO:tasks.workunit.client.0.smithi064.stdout:2/27: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:54.145 INFO:tasks.workunit.client.0.smithi064.stdout:2/28: dread - d1/f5 zero size 2023-12-16T03:15:54.145 INFO:tasks.workunit.client.0.smithi064.stdout:6/40: dwrite d3/f5 [0,4194304] 0 2023-12-16T03:15:54.146 INFO:tasks.workunit.client.0.smithi064.stdout:3/75: mkdir db/d12/d1a 0 2023-12-16T03:15:54.147 INFO:tasks.workunit.client.0.smithi064.stdout:3/76: chown db/f16 272 1 2023-12-16T03:15:54.151 INFO:tasks.workunit.client.0.smithi064.stdout:2/29: dread d1/f6 [0,4194304] 0 2023-12-16T03:15:54.151 INFO:tasks.workunit.client.0.smithi064.stdout:2/30: read d1/f3 [285845,6331] 0 2023-12-16T03:15:54.151 INFO:tasks.workunit.client.0.smithi064.stdout:2/31: dread - d1/f5 zero size 2023-12-16T03:15:54.151 INFO:tasks.workunit.client.0.smithi064.stdout:2/32: chown d1/f6 42390067 1 2023-12-16T03:15:54.151 INFO:tasks.workunit.client.0.smithi064.stdout:3/77: mknod db/d13/c1b 0 2023-12-16T03:15:54.152 INFO:tasks.workunit.client.0.smithi064.stdout:2/33: write d1/f3 [187973,128085] 0 2023-12-16T03:15:54.152 INFO:tasks.workunit.client.0.smithi064.stdout:2/34: chown d1 4 1 2023-12-16T03:15:54.152 INFO:tasks.workunit.client.0.smithi064.stdout:2/35: write d1/f5 [398011,47254] 0 2023-12-16T03:15:54.152 INFO:tasks.workunit.client.0.smithi064.stdout:3/78: mknod db/d12/d1a/c1c 0 2023-12-16T03:15:54.152 INFO:tasks.workunit.client.0.smithi064.stdout:5/60: dwrite d0/f5 [0,4194304] 0 2023-12-16T03:15:54.154 INFO:tasks.workunit.client.0.smithi064.stdout:3/79: creat db/d12/d1a/f1d x:0 0 0 2023-12-16T03:15:54.158 INFO:tasks.workunit.client.0.smithi064.stdout:5/61: creat d0/d7/f16 x:0 0 0 2023-12-16T03:15:54.158 INFO:tasks.workunit.client.0.smithi064.stdout:5/62: dread - d0/d7/f16 zero size 2023-12-16T03:15:54.158 INFO:tasks.workunit.client.0.smithi064.stdout:5/63: write d0/f15 [1355662,111571] 0 2023-12-16T03:15:54.160 INFO:tasks.workunit.client.1.smithi184.stdout:8/387: write d2/d12/d21/d2d/d31/f6c [291252,115520] 0 2023-12-16T03:15:54.163 INFO:tasks.workunit.client.1.smithi184.stdout:1/355: dwrite d3/d28/d3c/d41/d46/f69 [0,4194304] 0 2023-12-16T03:15:54.163 INFO:tasks.workunit.client.1.smithi184.stdout:1/356: chown d3/d28/d3c/d24/f55 428661 1 2023-12-16T03:15:54.163 INFO:tasks.workunit.client.1.smithi184.stdout:1/357: chown d3/d28/d3c/d41 402 1 2023-12-16T03:15:54.168 INFO:tasks.workunit.client.1.smithi184.stdout:8/388: write d2/fe [3897896,50779] 0 2023-12-16T03:15:54.169 INFO:tasks.workunit.client.0.smithi064.stdout:6/41: dread d3/f5 [0,4194304] 0 2023-12-16T03:15:54.169 INFO:tasks.workunit.client.0.smithi064.stdout:2/36: dread d1/f5 [0,4194304] 0 2023-12-16T03:15:54.171 INFO:tasks.workunit.client.0.smithi064.stdout:6/42: creat d3/d9/fb x:0 0 0 2023-12-16T03:15:54.172 INFO:tasks.workunit.client.0.smithi064.stdout:2/37: rename d1/f3 to d1/f7 0 2023-12-16T03:15:54.174 INFO:tasks.workunit.client.0.smithi064.stdout:3/80: dread db/d12/f15 [0,4194304] 0 2023-12-16T03:15:54.174 INFO:tasks.workunit.client.0.smithi064.stdout:3/81: chown db/d12/d1a/f1d 97108 1 2023-12-16T03:15:54.174 INFO:tasks.workunit.client.0.smithi064.stdout:3/82: truncate db/f19 50763 0 2023-12-16T03:15:54.174 INFO:tasks.workunit.client.0.smithi064.stdout:3/83: dread - db/d12/d1a/f1d zero size 2023-12-16T03:15:54.174 INFO:tasks.workunit.client.0.smithi064.stdout:8/37: dwrite d0/f7 [0,4194304] 0 2023-12-16T03:15:54.174 INFO:tasks.workunit.client.0.smithi064.stdout:8/38: chown d0/l5 385013846 1 2023-12-16T03:15:54.176 INFO:tasks.workunit.client.0.smithi064.stdout:3/84: unlink f1 0 2023-12-16T03:15:54.176 INFO:tasks.workunit.client.0.smithi064.stdout:1/50: dwrite f2 [0,4194304] 0 2023-12-16T03:15:54.178 INFO:tasks.workunit.client.1.smithi184.stdout:6/372: unlink d0/d5/d22/d37/d45/l52 0 2023-12-16T03:15:54.179 INFO:tasks.workunit.client.0.smithi064.stdout:8/39: unlink d0/f8 0 2023-12-16T03:15:54.179 INFO:tasks.workunit.client.1.smithi184.stdout:0/472: write dc/d10/f25 [1303117,38538] 0 2023-12-16T03:15:54.181 INFO:tasks.workunit.client.1.smithi184.stdout:3/385: rename d12/d37/d81/c92 to d12/d18/d1f/d23/d2a/d3e/d48/c97 0 2023-12-16T03:15:54.184 INFO:tasks.workunit.client.1.smithi184.stdout:1/358: creat d3/d28/d3c/d41/d77/f78 x:0 0 0 2023-12-16T03:15:54.187 INFO:tasks.workunit.client.1.smithi184.stdout:8/389: mkdir d2/d37/d7c 0 2023-12-16T03:15:54.187 INFO:tasks.workunit.client.1.smithi184.stdout:8/390: write d2/d12/d21/d30/f42 [888538,36966] 0 2023-12-16T03:15:54.187 INFO:tasks.workunit.client.1.smithi184.stdout:8/391: chown d2/d4/l5 162 1 2023-12-16T03:15:54.187 INFO:tasks.workunit.client.0.smithi064.stdout:5/64: truncate d0/f3 2849265 0 2023-12-16T03:15:54.189 INFO:tasks.workunit.client.1.smithi184.stdout:0/473: mknod dc/d10/d2d/d5f/d7c/c9a 0 2023-12-16T03:15:54.189 INFO:tasks.workunit.client.1.smithi184.stdout:3/386: creat d12/d37/f98 x:0 0 0 2023-12-16T03:15:54.189 INFO:tasks.workunit.client.0.smithi064.stdout:3/85: mkdir db/d12/d1e 0 2023-12-16T03:15:54.191 INFO:tasks.workunit.client.1.smithi184.stdout:1/359: creat d3/d34/d76/f79 x:0 0 0 2023-12-16T03:15:54.191 INFO:tasks.workunit.client.0.smithi064.stdout:1/51: creat d3/f13 x:0 0 0 2023-12-16T03:15:54.192 INFO:tasks.workunit.client.0.smithi064.stdout:1/52: write d3/f5 [1060248,130428] 0 2023-12-16T03:15:54.192 INFO:tasks.workunit.client.0.smithi064.stdout:6/43: fsync d3/d9/fb 0 2023-12-16T03:15:54.192 INFO:tasks.workunit.client.0.smithi064.stdout:6/44: fsync d3/d9/fb 0 2023-12-16T03:15:54.192 INFO:tasks.workunit.client.0.smithi064.stdout:6/45: truncate d3/f5 4765966 0 2023-12-16T03:15:54.193 INFO:tasks.workunit.client.1.smithi184.stdout:3/387: mkdir d12/d18/d1f/d23/d2a/d42/d52/d7f/d99 0 2023-12-16T03:15:54.194 INFO:tasks.workunit.client.0.smithi064.stdout:2/38: rmdir d1 39 2023-12-16T03:15:54.194 INFO:tasks.workunit.client.1.smithi184.stdout:1/360: unlink d3/d28/c5b 0 2023-12-16T03:15:54.196 INFO:tasks.workunit.client.1.smithi184.stdout:3/388: creat d12/d18/d68/f9a x:0 0 0 2023-12-16T03:15:54.196 INFO:tasks.workunit.client.1.smithi184.stdout:3/389: write d12/d18/d1f/d23/d2a/d36/f5b [1360003,105661] 0 2023-12-16T03:15:54.196 INFO:tasks.workunit.client.0.smithi064.stdout:6/46: link d3/c4 d3/d8/cc 0 2023-12-16T03:15:54.198 INFO:tasks.workunit.client.1.smithi184.stdout:6/373: dwrite d0/d5/d26/f62 [0,4194304] 0 2023-12-16T03:15:54.198 INFO:tasks.workunit.client.1.smithi184.stdout:1/361: symlink d3/d28/d3c/d41/d77/l7a 0 2023-12-16T03:15:54.198 INFO:tasks.workunit.client.1.smithi184.stdout:1/362: fsync d3/d28/f44 0 2023-12-16T03:15:54.198 INFO:tasks.workunit.client.0.smithi064.stdout:8/40: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:15:54.198 INFO:tasks.workunit.client.0.smithi064.stdout:2/39: rename d1/f5 to d1/f8 0 2023-12-16T03:15:54.199 INFO:tasks.workunit.client.0.smithi064.stdout:2/40: fsync d1/f7 0 2023-12-16T03:15:54.199 INFO:tasks.workunit.client.0.smithi064.stdout:2/41: write d1/f8 [889146,56627] 0 2023-12-16T03:15:54.199 INFO:tasks.workunit.client.0.smithi064.stdout:3/86: dread db/f19 [0,4194304] 0 2023-12-16T03:15:54.200 INFO:tasks.workunit.client.1.smithi184.stdout:3/390: rmdir d12/d18/d1f/d23/d2a/d36 39 2023-12-16T03:15:54.200 INFO:tasks.workunit.client.1.smithi184.stdout:3/391: write d12/d18/d1f/d23/d2a/d42/d52/f6f [399563,128400] 0 2023-12-16T03:15:54.200 INFO:tasks.workunit.client.1.smithi184.stdout:3/392: chown d12/d1e/c78 431388 1 2023-12-16T03:15:54.202 INFO:tasks.workunit.client.0.smithi064.stdout:2/42: dread d1/f7 [0,4194304] 0 2023-12-16T03:15:54.202 INFO:tasks.workunit.client.0.smithi064.stdout:2/43: read d1/f6 [167049,113376] 0 2023-12-16T03:15:54.204 INFO:tasks.workunit.client.0.smithi064.stdout:6/47: creat d3/fd x:0 0 0 2023-12-16T03:15:54.204 INFO:tasks.workunit.client.0.smithi064.stdout:6/48: chown d3/f5 2077184 1 2023-12-16T03:15:54.204 INFO:tasks.workunit.client.1.smithi184.stdout:6/374: rename d0/d5/le to d0/d5/d22/d37/d45/l77 0 2023-12-16T03:15:54.204 INFO:tasks.workunit.client.1.smithi184.stdout:6/375: write d0/d5/d26/f75 [48916,45009] 0 2023-12-16T03:15:54.205 INFO:tasks.workunit.client.0.smithi064.stdout:8/41: write d0/f3 [2197803,45175] 0 2023-12-16T03:15:54.205 INFO:tasks.workunit.client.0.smithi064.stdout:8/42: fsync d0/f2 0 2023-12-16T03:15:54.205 INFO:tasks.workunit.client.0.smithi064.stdout:2/44: dread d1/f6 [0,4194304] 0 2023-12-16T03:15:54.208 INFO:tasks.workunit.client.0.smithi064.stdout:3/87: dread db/d12/f15 [0,4194304] 0 2023-12-16T03:15:54.208 INFO:tasks.workunit.client.1.smithi184.stdout:1/363: mknod d3/d28/d3c/d41/d77/c7b 0 2023-12-16T03:15:54.210 INFO:tasks.workunit.client.0.smithi064.stdout:6/49: creat d3/d8/da/fe x:0 0 0 2023-12-16T03:15:54.213 INFO:tasks.workunit.client.1.smithi184.stdout:3/393: dread d12/d18/d1f/d23/d2a/d42/d52/f6f [0,4194304] 0 2023-12-16T03:15:54.215 INFO:tasks.workunit.client.0.smithi064.stdout:8/43: link d0/f7 d0/da/fc 0 2023-12-16T03:15:54.216 INFO:tasks.workunit.client.1.smithi184.stdout:1/364: creat d3/d28/d3c/f7c x:0 0 0 2023-12-16T03:15:54.217 INFO:tasks.workunit.client.1.smithi184.stdout:8/392: dwrite d2/fe [0,4194304] 0 2023-12-16T03:15:54.217 INFO:tasks.workunit.client.0.smithi064.stdout:2/45: rmdir d1 39 2023-12-16T03:15:54.217 INFO:tasks.workunit.client.0.smithi064.stdout:1/53: getdents d3 0 2023-12-16T03:15:54.218 INFO:tasks.workunit.client.0.smithi064.stdout:5/65: read d0/f3 [2812133,99061] 0 2023-12-16T03:15:54.220 INFO:tasks.workunit.client.1.smithi184.stdout:1/365: symlink d3/d28/d3c/d41/l7d 0 2023-12-16T03:15:54.220 INFO:tasks.workunit.client.1.smithi184.stdout:3/394: creat d12/d18/d1f/d23/d2a/d3e/f9b x:0 0 0 2023-12-16T03:15:54.220 INFO:tasks.workunit.client.1.smithi184.stdout:6/376: dread d0/d5/d22/d25/d47/f6e [0,4194304] 0 2023-12-16T03:15:54.221 INFO:tasks.workunit.client.0.smithi064.stdout:8/44: symlink d0/ld 0 2023-12-16T03:15:54.222 INFO:tasks.workunit.client.1.smithi184.stdout:8/393: creat d2/d12/d21/d2d/d31/d5e/f7d x:0 0 0 2023-12-16T03:15:54.223 INFO:tasks.workunit.client.0.smithi064.stdout:7/37: sync 2023-12-16T03:15:54.223 INFO:tasks.workunit.client.0.smithi064.stdout:1/54: mknod d3/dd/c14 0 2023-12-16T03:15:54.224 INFO:tasks.workunit.client.0.smithi064.stdout:5/66: creat d0/f17 x:0 0 0 2023-12-16T03:15:54.224 INFO:tasks.workunit.client.0.smithi064.stdout:5/67: fdatasync d0/de/ff 0 2023-12-16T03:15:54.224 INFO:tasks.workunit.client.1.smithi184.stdout:1/366: truncate d3/d28/d3c/d24/f43 905930 0 2023-12-16T03:15:54.224 INFO:tasks.workunit.client.1.smithi184.stdout:1/367: readlink d3/d28/d3c/d41/l59 0 2023-12-16T03:15:54.224 INFO:tasks.workunit.client.1.smithi184.stdout:1/368: chown d3/l22 595 1 2023-12-16T03:15:54.224 INFO:tasks.workunit.client.1.smithi184.stdout:1/369: readlink d3/d28/d3c/d41/l7d 0 2023-12-16T03:15:54.225 INFO:tasks.workunit.client.1.smithi184.stdout:6/377: write d0/d5/d22/f49 [2920487,79814] 0 2023-12-16T03:15:54.225 INFO:tasks.workunit.client.1.smithi184.stdout:3/395: symlink d12/d37/d81/l9c 0 2023-12-16T03:15:54.226 INFO:tasks.workunit.client.1.smithi184.stdout:3/396: chown d12/d18/d1f/d23/d51/c94 6990569 1 2023-12-16T03:15:54.226 INFO:tasks.workunit.client.1.smithi184.stdout:3/397: fdatasync d12/d18/d1f/d23/d51/f5a 0 2023-12-16T03:15:54.226 INFO:tasks.workunit.client.0.smithi064.stdout:3/88: link db/d13/c1b db/d12/d1a/c1f 0 2023-12-16T03:15:54.227 INFO:tasks.workunit.client.1.smithi184.stdout:8/394: creat d2/d4/d10/d11/f7e x:0 0 0 2023-12-16T03:15:54.229 INFO:tasks.workunit.client.0.smithi064.stdout:8/45: mknod d0/da/ce 0 2023-12-16T03:15:54.229 INFO:tasks.workunit.client.1.smithi184.stdout:1/370: rename d3/d28/d3c/d41/d46/d4a/f6f to d3/d28/d3c/d41/d63/f7e 0 2023-12-16T03:15:54.231 INFO:tasks.workunit.client.1.smithi184.stdout:6/378: link d0/d5/d12/d1b/f2f d0/d5/d22/d25/d3f/f78 0 2023-12-16T03:15:54.231 INFO:tasks.workunit.client.1.smithi184.stdout:6/379: write d0/d5/d22/d25/d47/f64 [43404,52980] 0 2023-12-16T03:15:54.231 INFO:tasks.workunit.client.1.smithi184.stdout:6/380: stat d0/d5/d22/c60 0 2023-12-16T03:15:54.231 INFO:tasks.workunit.client.1.smithi184.stdout:6/381: write d0/d5/f1f [1550338,67462] 0 2023-12-16T03:15:54.231 INFO:tasks.workunit.client.1.smithi184.stdout:6/382: write d0/d5/d12/d1b/f5b [566003,92028] 0 2023-12-16T03:15:54.231 INFO:tasks.workunit.client.1.smithi184.stdout:6/383: dread - d0/d5/d42/f68 zero size 2023-12-16T03:15:54.231 INFO:tasks.workunit.client.0.smithi064.stdout:1/55: symlink d3/dd/d11/l15 0 2023-12-16T03:15:54.231 INFO:tasks.workunit.client.0.smithi064.stdout:1/56: write d3/dd/ff [388669,112513] 0 2023-12-16T03:15:54.232 INFO:tasks.workunit.client.1.smithi184.stdout:8/395: creat d2/d4/d10/d7a/f7f x:0 0 0 2023-12-16T03:15:54.232 INFO:tasks.workunit.client.1.smithi184.stdout:8/396: truncate d2/d12/f38 236668 0 2023-12-16T03:15:54.232 INFO:tasks.workunit.client.0.smithi064.stdout:8/46: mkdir d0/da/df 0 2023-12-16T03:15:54.233 INFO:tasks.workunit.client.0.smithi064.stdout:8/47: write d0/f7 [4492222,119857] 0 2023-12-16T03:15:54.233 INFO:tasks.workunit.client.0.smithi064.stdout:8/48: truncate d0/da/fc 4857047 0 2023-12-16T03:15:54.233 INFO:tasks.workunit.client.0.smithi064.stdout:1/57: symlink d3/dd/l16 0 2023-12-16T03:15:54.235 INFO:tasks.workunit.client.0.smithi064.stdout:5/68: symlink d0/d7/l18 0 2023-12-16T03:15:54.238 INFO:tasks.workunit.client.1.smithi184.stdout:6/384: mkdir d0/d36/d79 0 2023-12-16T03:15:54.238 INFO:tasks.workunit.client.1.smithi184.stdout:1/371: symlink d3/d34/d39/l7f 0 2023-12-16T03:15:54.238 INFO:tasks.workunit.client.0.smithi064.stdout:6/50: dwrite d3/fd [0,4194304] 0 2023-12-16T03:15:54.241 INFO:tasks.workunit.client.0.smithi064.stdout:2/46: dwrite d1/f7 [0,4194304] 0 2023-12-16T03:15:54.242 INFO:tasks.workunit.client.0.smithi064.stdout:2/47: chown d1/f4 8 1 2023-12-16T03:15:54.243 INFO:tasks.workunit.client.0.smithi064.stdout:7/38: dread d7/f9 [0,4194304] 0 2023-12-16T03:15:54.243 INFO:tasks.workunit.client.0.smithi064.stdout:7/39: dread - d7/fb zero size 2023-12-16T03:15:54.246 INFO:tasks.workunit.client.0.smithi064.stdout:5/69: mkdir d0/d19 0 2023-12-16T03:15:54.246 INFO:tasks.workunit.client.1.smithi184.stdout:1/372: truncate d3/d28/d3c/d24/f43 1773708 0 2023-12-16T03:15:54.246 INFO:tasks.workunit.client.1.smithi184.stdout:1/373: rmdir d3/d28/d38/d52 39 2023-12-16T03:15:54.246 INFO:tasks.workunit.client.1.smithi184.stdout:1/374: dread - d3/d28/d3c/d41/d46/d4a/d6a/f72 zero size 2023-12-16T03:15:54.249 INFO:tasks.workunit.client.1.smithi184.stdout:8/397: dread d2/d12/d21/d30/f35 [0,4194304] 0 2023-12-16T03:15:54.251 INFO:tasks.workunit.client.1.smithi184.stdout:8/398: mkdir d2/d37/d7c/d80 0 2023-12-16T03:15:54.254 INFO:tasks.workunit.client.1.smithi184.stdout:8/399: rmdir d2/d37/d7c/d80 0 2023-12-16T03:15:54.264 INFO:tasks.workunit.client.0.smithi064.stdout:8/49: dread d0/f7 [0,4194304] 0 2023-12-16T03:15:54.265 INFO:tasks.workunit.client.0.smithi064.stdout:7/40: mkdir d7/dc 0 2023-12-16T03:15:54.265 INFO:tasks.workunit.client.0.smithi064.stdout:7/41: rename d7 to d7/dd 22 2023-12-16T03:15:54.265 INFO:tasks.workunit.client.0.smithi064.stdout:7/42: stat d7/l8 0 2023-12-16T03:15:54.267 INFO:tasks.workunit.client.1.smithi184.stdout:2/226: sync 2023-12-16T03:15:54.267 INFO:tasks.workunit.client.1.smithi184.stdout:4/246: sync 2023-12-16T03:15:54.267 INFO:tasks.workunit.client.1.smithi184.stdout:4/247: truncate d1/d11/d1b/d1e/f41 1802141 0 2023-12-16T03:15:54.268 INFO:tasks.workunit.client.1.smithi184.stdout:9/485: sync 2023-12-16T03:15:54.268 INFO:tasks.workunit.client.1.smithi184.stdout:7/339: sync 2023-12-16T03:15:54.268 INFO:tasks.workunit.client.1.smithi184.stdout:7/340: dread - d0/df/d32/d39/f48 zero size 2023-12-16T03:15:54.269 INFO:tasks.workunit.client.1.smithi184.stdout:2/227: mkdir d3/d29/d2f/d2e/d4c 0 2023-12-16T03:15:54.269 INFO:tasks.workunit.client.1.smithi184.stdout:2/228: readlink d3/d29/d2f/l38 0 2023-12-16T03:15:54.269 INFO:tasks.workunit.client.1.smithi184.stdout:2/229: dread - d3/d29/f2d zero size 2023-12-16T03:15:54.269 INFO:tasks.workunit.client.1.smithi184.stdout:5/220: sync 2023-12-16T03:15:54.271 INFO:tasks.workunit.client.1.smithi184.stdout:4/248: creat d1/d12/d27/d3b/f53 x:0 0 0 2023-12-16T03:15:54.271 INFO:tasks.workunit.client.0.smithi064.stdout:7/43: truncate d7/f9 1614916 0 2023-12-16T03:15:54.273 INFO:tasks.workunit.client.1.smithi184.stdout:5/221: getdents d1/d3/d9 0 2023-12-16T03:15:54.273 INFO:tasks.workunit.client.1.smithi184.stdout:5/222: readlink d1/d3/d9/de/d30/l43 0 2023-12-16T03:15:54.274 INFO:tasks.workunit.client.1.smithi184.stdout:4/249: creat d1/f54 x:0 0 0 2023-12-16T03:15:54.274 INFO:tasks.workunit.client.1.smithi184.stdout:2/230: truncate d3/f6 1839511 0 2023-12-16T03:15:54.275 INFO:tasks.workunit.client.1.smithi184.stdout:2/231: getdents d3/d13/d28 0 2023-12-16T03:15:54.275 INFO:tasks.workunit.client.0.smithi064.stdout:7/44: mknod d7/ce 0 2023-12-16T03:15:54.275 INFO:tasks.workunit.client.0.smithi064.stdout:7/45: readlink d7/l8 0 2023-12-16T03:15:54.275 INFO:tasks.workunit.client.0.smithi064.stdout:7/46: chown d7/f9 1589 1 2023-12-16T03:15:54.275 INFO:tasks.workunit.client.0.smithi064.stdout:7/47: getdents d7/dc 0 2023-12-16T03:15:54.276 INFO:tasks.workunit.client.1.smithi184.stdout:5/223: creat d1/d3/d9/de/d15/d19/d3a/d3f/f4c x:0 0 0 2023-12-16T03:15:54.276 INFO:tasks.workunit.client.1.smithi184.stdout:5/224: dread - d1/d3/d9/de/d15/d19/f1d zero size 2023-12-16T03:15:54.276 INFO:tasks.workunit.client.1.smithi184.stdout:9/486: dread d0/d3a/d47/f67 [0,4194304] 0 2023-12-16T03:15:54.276 INFO:tasks.workunit.client.1.smithi184.stdout:9/487: read - d0/d30/f94 zero size 2023-12-16T03:15:54.276 INFO:tasks.workunit.client.1.smithi184.stdout:2/232: getdents d3/d29/d2f/d31 0 2023-12-16T03:15:54.277 INFO:tasks.workunit.client.1.smithi184.stdout:9/488: symlink d0/d13/d20/d77/la6 0 2023-12-16T03:15:54.278 INFO:tasks.workunit.client.0.smithi064.stdout:7/48: mknod d7/dc/cf 0 2023-12-16T03:15:54.279 INFO:tasks.workunit.client.1.smithi184.stdout:2/233: rmdir d3/d9 39 2023-12-16T03:15:54.279 INFO:tasks.workunit.client.1.smithi184.stdout:2/234: truncate d3/d9/d19/f49 983966 0 2023-12-16T03:15:54.281 INFO:tasks.workunit.client.0.smithi064.stdout:7/49: rename f5 to d7/dc/f10 0 2023-12-16T03:15:54.287 INFO:tasks.workunit.client.1.smithi184.stdout:9/489: rename d0/d13/d6e/f9e to d0/d13/d20/d5b/d53/fa7 0 2023-12-16T03:15:54.287 INFO:tasks.workunit.client.1.smithi184.stdout:4/250: dread d1/f8 [0,4194304] 0 2023-12-16T03:15:54.287 INFO:tasks.workunit.client.1.smithi184.stdout:9/490: dread - d0/d13/d20/d5b/d53/fa7 zero size 2023-12-16T03:15:54.289 INFO:tasks.workunit.client.1.smithi184.stdout:9/491: symlink d0/d13/d6e/d84/la8 0 2023-12-16T03:15:54.289 INFO:tasks.workunit.client.1.smithi184.stdout:9/492: dread - d0/d13/d20/d5b/d53/f58 zero size 2023-12-16T03:15:54.289 INFO:tasks.workunit.client.1.smithi184.stdout:9/493: fdatasync d0/d3a/d47/d7a/f83 0 2023-12-16T03:15:54.289 INFO:tasks.workunit.client.1.smithi184.stdout:9/494: fdatasync d0/d13/d6e/d84/f9a 0 2023-12-16T03:15:54.289 INFO:tasks.workunit.client.1.smithi184.stdout:9/495: write d0/d13/d20/d77/f54 [823657,103905] 0 2023-12-16T03:15:54.289 INFO:tasks.workunit.client.1.smithi184.stdout:9/496: fsync d0/d13/f2a 0 2023-12-16T03:15:54.291 INFO:tasks.workunit.client.1.smithi184.stdout:9/497: stat d0/d3a/d47/c88 0 2023-12-16T03:15:54.291 INFO:tasks.workunit.client.1.smithi184.stdout:9/498: truncate d0/d30/f41 1926225 0 2023-12-16T03:15:54.292 INFO:tasks.workunit.client.1.smithi184.stdout:3/398: dwrite d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f64 [0,4194304] 0 2023-12-16T03:15:54.292 INFO:tasks.workunit.client.1.smithi184.stdout:3/399: read d12/f19 [747069,73381] 0 2023-12-16T03:15:54.292 INFO:tasks.workunit.client.1.smithi184.stdout:3/400: fsync d12/d18/f74 0 2023-12-16T03:15:54.292 INFO:tasks.workunit.client.1.smithi184.stdout:3/401: readlink d12/d18/d1f/d23/d2a/d3e/d48/l83 0 2023-12-16T03:15:54.293 INFO:tasks.workunit.client.0.smithi064.stdout:3/89: dwrite db/d12/f15 [0,4194304] 0 2023-12-16T03:15:54.295 INFO:tasks.workunit.client.1.smithi184.stdout:3/402: creat d12/d18/d68/f9d x:0 0 0 2023-12-16T03:15:54.298 INFO:tasks.workunit.client.1.smithi184.stdout:1/375: dwrite d3/d28/d3c/f33 [0,4194304] 0 2023-12-16T03:15:54.300 INFO:tasks.workunit.client.0.smithi064.stdout:3/90: unlink db/d12/d1a/c1c 0 2023-12-16T03:15:54.300 INFO:tasks.workunit.client.0.smithi064.stdout:3/91: fdatasync db/d12/f18 0 2023-12-16T03:15:54.304 INFO:tasks.workunit.client.1.smithi184.stdout:2/235: dread d3/f14 [0,4194304] 0 2023-12-16T03:15:54.304 INFO:tasks.workunit.client.1.smithi184.stdout:2/236: chown d3/d9/d19/f1c 3713404 1 2023-12-16T03:15:54.305 INFO:tasks.workunit.client.1.smithi184.stdout:3/403: write fd [2099659,45453] 0 2023-12-16T03:15:54.308 INFO:tasks.workunit.client.1.smithi184.stdout:2/237: write d3/fd [7319112,35309] 0 2023-12-16T03:15:54.308 INFO:tasks.workunit.client.1.smithi184.stdout:6/385: dwrite d0/d5/d12/d1b/d33/f6c [0,4194304] 0 2023-12-16T03:15:54.308 INFO:tasks.workunit.client.1.smithi184.stdout:6/386: chown d0/d5/d12/d1b/c21 1457759533 1 2023-12-16T03:15:54.310 INFO:tasks.workunit.client.1.smithi184.stdout:3/404: creat d12/d18/d68/f9e x:0 0 0 2023-12-16T03:15:54.312 INFO:tasks.workunit.client.1.smithi184.stdout:3/405: mknod d12/d37/d81/c9f 0 2023-12-16T03:15:54.312 INFO:tasks.workunit.client.0.smithi064.stdout:7/50: dread f4 [0,4194304] 0 2023-12-16T03:15:54.313 INFO:tasks.workunit.client.1.smithi184.stdout:1/376: write d3/d28/d3c/d41/d63/f64 [1090488,68946] 0 2023-12-16T03:15:54.313 INFO:tasks.workunit.client.1.smithi184.stdout:1/377: readlink d3/d28/d3c/d41/d46/d4a/l74 0 2023-12-16T03:15:54.313 INFO:tasks.workunit.client.1.smithi184.stdout:1/378: dread - d3/d28/d3c/d41/d77/f78 zero size 2023-12-16T03:15:54.313 INFO:tasks.workunit.client.1.smithi184.stdout:3/406: truncate d12/d1e/f2d 3023171 0 2023-12-16T03:15:54.313 INFO:tasks.workunit.client.1.smithi184.stdout:3/407: dread - d12/d18/d68/f9d zero size 2023-12-16T03:15:54.315 INFO:tasks.workunit.client.0.smithi064.stdout:7/51: mknod d7/dc/c11 0 2023-12-16T03:15:54.316 INFO:tasks.workunit.client.1.smithi184.stdout:3/408: creat d12/d18/fa0 x:0 0 0 2023-12-16T03:15:54.316 INFO:tasks.workunit.client.1.smithi184.stdout:2/238: dread d3/d29/d2f/d2e/f35 [0,4194304] 0 2023-12-16T03:15:54.317 INFO:tasks.workunit.client.0.smithi064.stdout:7/52: rename f4 to d7/dc/f12 0 2023-12-16T03:15:54.317 INFO:tasks.workunit.client.1.smithi184.stdout:3/409: write d12/d18/d1f/f6c [467775,7960] 0 2023-12-16T03:15:54.318 INFO:tasks.workunit.client.0.smithi064.stdout:5/70: dwrite d0/f3 [0,4194304] 0 2023-12-16T03:15:54.319 INFO:tasks.workunit.client.0.smithi064.stdout:5/71: creat d0/d7/f1a x:0 0 0 2023-12-16T03:15:54.319 INFO:tasks.workunit.client.0.smithi064.stdout:5/72: write d0/f3 [4738494,126803] 0 2023-12-16T03:15:54.319 INFO:tasks.workunit.client.0.smithi064.stdout:1/58: dwrite d3/f5 [0,4194304] 0 2023-12-16T03:15:54.319 INFO:tasks.workunit.client.0.smithi064.stdout:1/59: fdatasync d3/f5 0 2023-12-16T03:15:54.319 INFO:tasks.workunit.client.0.smithi064.stdout:2/48: dwrite d1/f6 [0,4194304] 0 2023-12-16T03:15:54.320 INFO:tasks.workunit.client.0.smithi064.stdout:2/49: fdatasync d1/f4 0 2023-12-16T03:15:54.320 INFO:tasks.workunit.client.0.smithi064.stdout:5/73: mknod d0/d19/c1b 0 2023-12-16T03:15:54.321 INFO:tasks.workunit.client.0.smithi064.stdout:1/60: creat d3/dd/d11/f17 x:0 0 0 2023-12-16T03:15:54.326 INFO:tasks.workunit.client.1.smithi184.stdout:2/239: mkdir d3/d29/d4d 0 2023-12-16T03:15:54.326 INFO:tasks.workunit.client.1.smithi184.stdout:2/240: chown d3/d9/d19/f37 498857647 1 2023-12-16T03:15:54.327 INFO:tasks.workunit.client.0.smithi064.stdout:2/50: creat d1/f9 x:0 0 0 2023-12-16T03:15:54.328 INFO:tasks.workunit.client.0.smithi064.stdout:5/74: creat d0/d19/f1c x:0 0 0 2023-12-16T03:15:54.330 INFO:tasks.workunit.client.0.smithi064.stdout:1/61: mknod d3/dd/c18 0 2023-12-16T03:15:54.337 INFO:tasks.workunit.client.1.smithi184.stdout:8/400: dwrite d2/d12/d21/d30/f61 [0,4194304] 0 2023-12-16T03:15:54.337 INFO:tasks.workunit.client.1.smithi184.stdout:8/401: fsync d2/d37/f4c 0 2023-12-16T03:15:54.337 INFO:tasks.workunit.client.1.smithi184.stdout:8/402: getdents d2/d4/d10/d11/d72 0 2023-12-16T03:15:54.337 INFO:tasks.workunit.client.1.smithi184.stdout:3/410: mkdir d12/d18/da1 0 2023-12-16T03:15:54.338 INFO:tasks.workunit.client.1.smithi184.stdout:2/241: rename d3/d29/d2f/d2e/fb to d3/d29/d2f/d31/f4e 0 2023-12-16T03:15:54.339 INFO:tasks.workunit.client.1.smithi184.stdout:7/341: dwrite d0/df/dd/f1d [4194304,4194304] 0 2023-12-16T03:15:54.340 INFO:tasks.workunit.client.1.smithi184.stdout:8/403: mknod d2/d12/d21/d2d/d31/d34/c81 0 2023-12-16T03:15:54.343 INFO:tasks.workunit.client.1.smithi184.stdout:3/411: symlink d12/d18/da1/la2 0 2023-12-16T03:15:54.343 INFO:tasks.workunit.client.1.smithi184.stdout:2/242: creat d3/d9/d19/f4f x:0 0 0 2023-12-16T03:15:54.348 INFO:tasks.workunit.client.1.smithi184.stdout:7/342: symlink d0/d3/d2e/l61 0 2023-12-16T03:15:54.348 INFO:tasks.workunit.client.1.smithi184.stdout:7/343: dread - d0/d3/d4/f5e zero size 2023-12-16T03:15:54.348 INFO:tasks.workunit.client.1.smithi184.stdout:7/344: stat d0/c53 0 2023-12-16T03:15:54.349 INFO:tasks.workunit.client.1.smithi184.stdout:7/345: write d0/df/dd/f1d [8860773,114990] 0 2023-12-16T03:15:54.349 INFO:tasks.workunit.client.0.smithi064.stdout:8/50: dwrite d0/f3 [0,4194304] 0 2023-12-16T03:15:54.349 INFO:tasks.workunit.client.1.smithi184.stdout:2/243: truncate d3/d13/d28/f2c 582906 0 2023-12-16T03:15:54.350 INFO:tasks.workunit.client.0.smithi064.stdout:8/51: symlink d0/db/l10 0 2023-12-16T03:15:54.350 INFO:tasks.workunit.client.0.smithi064.stdout:8/52: fsync d0/da/fc 0 2023-12-16T03:15:54.351 INFO:tasks.workunit.client.0.smithi064.stdout:8/53: chown d0/da/ce 23 1 2023-12-16T03:15:54.351 INFO:tasks.workunit.client.1.smithi184.stdout:7/346: mknod d0/df/d36/d3f/d49/c62 0 2023-12-16T03:15:54.353 INFO:tasks.workunit.client.1.smithi184.stdout:2/244: rmdir d3/d29/d2f/d2e/d4c 0 2023-12-16T03:15:54.353 INFO:tasks.workunit.client.1.smithi184.stdout:2/245: readlink d3/d13/l2a 0 2023-12-16T03:15:54.354 INFO:tasks.workunit.client.1.smithi184.stdout:7/347: getdents d0/df/dd/d27 0 2023-12-16T03:15:54.354 INFO:tasks.workunit.client.1.smithi184.stdout:7/348: chown d0/f50 489004672 1 2023-12-16T03:15:54.357 INFO:tasks.workunit.client.1.smithi184.stdout:7/349: getdents d0/df/d32 0 2023-12-16T03:15:54.359 INFO:tasks.workunit.client.1.smithi184.stdout:7/350: dread d0/d3/d4/f25 [0,4194304] 0 2023-12-16T03:15:54.360 INFO:tasks.workunit.client.1.smithi184.stdout:4/251: dwrite d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:54.361 INFO:tasks.workunit.client.1.smithi184.stdout:2/246: rename d3/d9/d19/f49 to d3/f50 0 2023-12-16T03:15:54.361 INFO:tasks.workunit.client.1.smithi184.stdout:5/225: dwrite d1/d3/fa [0,4194304] 0 2023-12-16T03:15:54.361 INFO:tasks.workunit.client.1.smithi184.stdout:5/226: chown d1/d3/d9/de/d15/d19/d3a/d3f/f4c 0 1 2023-12-16T03:15:54.363 INFO:tasks.workunit.client.1.smithi184.stdout:5/227: write d1/d3/d9/de/d15/f1e [84259,91806] 0 2023-12-16T03:15:54.363 INFO:tasks.workunit.client.1.smithi184.stdout:5/228: dread - d1/d3/d9/de/d15/d19/d3a/d3f/f4c zero size 2023-12-16T03:15:54.363 INFO:tasks.workunit.client.1.smithi184.stdout:5/229: write d1/d3/d9/f40 [816186,20908] 0 2023-12-16T03:15:54.363 INFO:tasks.workunit.client.1.smithi184.stdout:5/230: chown d1/d3/d9/d49 55965572 1 2023-12-16T03:15:54.364 INFO:tasks.workunit.client.0.smithi064.stdout:8/54: dread d0/f7 [0,4194304] 0 2023-12-16T03:15:54.366 INFO:tasks.workunit.client.0.smithi064.stdout:3/92: dwrite db/fe [0,4194304] 0 2023-12-16T03:15:54.366 INFO:tasks.workunit.client.0.smithi064.stdout:3/93: write db/d12/f18 [261615,60243] 0 2023-12-16T03:15:54.366 INFO:tasks.workunit.client.0.smithi064.stdout:3/94: write db/f16 [51563,45764] 0 2023-12-16T03:15:54.366 INFO:tasks.workunit.client.0.smithi064.stdout:8/55: link d0/da/ce d0/da/c11 0 2023-12-16T03:15:54.366 INFO:tasks.workunit.client.1.smithi184.stdout:6/387: dwrite d0/d5/d12/d1b/f5b [0,4194304] 0 2023-12-16T03:15:54.367 INFO:tasks.workunit.client.1.smithi184.stdout:9/499: dwrite d0/f2f [0,4194304] 0 2023-12-16T03:15:54.367 INFO:tasks.workunit.client.1.smithi184.stdout:9/500: fsync d0/d3a/f70 0 2023-12-16T03:15:54.367 INFO:tasks.workunit.client.1.smithi184.stdout:9/501: chown d0/d13 7 1 2023-12-16T03:15:54.367 INFO:tasks.workunit.client.0.smithi064.stdout:5/75: dwrite d0/d7/f16 [0,4194304] 0 2023-12-16T03:15:54.372 INFO:tasks.workunit.client.1.smithi184.stdout:6/388: dread d0/d5/d12/f32 [0,4194304] 0 2023-12-16T03:15:54.372 INFO:tasks.workunit.client.1.smithi184.stdout:5/231: mknod d1/d3/d9/d2e/c4d 0 2023-12-16T03:15:54.373 INFO:tasks.workunit.client.0.smithi064.stdout:7/53: dwrite d7/dc/f10 [4194304,4194304] 0 2023-12-16T03:15:54.373 INFO:tasks.workunit.client.0.smithi064.stdout:7/54: write d7/fa [4417137,64615] 0 2023-12-16T03:15:54.374 INFO:tasks.workunit.client.1.smithi184.stdout:2/247: truncate d3/f6 2230023 0 2023-12-16T03:15:54.374 INFO:tasks.workunit.client.1.smithi184.stdout:8/404: dwrite d2/d4/d10/d11/f4d [0,4194304] 0 2023-12-16T03:15:54.376 INFO:tasks.workunit.client.1.smithi184.stdout:3/412: dwrite d12/d18/d1f/d23/d2a/d36/f5b [0,4194304] 0 2023-12-16T03:15:54.376 INFO:tasks.workunit.client.1.smithi184.stdout:9/502: creat d0/d3a/d47/fa9 x:0 0 0 2023-12-16T03:15:54.376 INFO:tasks.workunit.client.1.smithi184.stdout:9/503: chown d0/d3a/d47/d7a/f7c 3 1 2023-12-16T03:15:54.376 INFO:tasks.workunit.client.1.smithi184.stdout:6/389: mknod d0/d5/d22/d25/d47/c7a 0 2023-12-16T03:15:54.376 INFO:tasks.workunit.client.1.smithi184.stdout:9/504: getdents d0/d13/d6e/d9f 0 2023-12-16T03:15:54.377 INFO:tasks.workunit.client.1.smithi184.stdout:5/232: creat d1/d3/d9/de/d30/f4e x:0 0 0 2023-12-16T03:15:54.377 INFO:tasks.workunit.client.1.smithi184.stdout:5/233: dread - d1/d3/d2f/f3d zero size 2023-12-16T03:15:54.378 INFO:tasks.workunit.client.1.smithi184.stdout:2/248: creat d3/d29/d4d/f51 x:0 0 0 2023-12-16T03:15:54.380 INFO:tasks.workunit.client.0.smithi064.stdout:7/55: rename d7/dc to d7/d13 0 2023-12-16T03:15:54.380 INFO:tasks.workunit.client.0.smithi064.stdout:7/56: chown d7/d13 3600329 1 2023-12-16T03:15:54.380 INFO:tasks.workunit.client.1.smithi184.stdout:8/405: creat d2/d4/d10/d11/d77/f82 x:0 0 0 2023-12-16T03:15:54.380 INFO:tasks.workunit.client.1.smithi184.stdout:6/390: write d0/d5/d22/fb [2231684,30084] 0 2023-12-16T03:15:54.381 INFO:tasks.workunit.client.0.smithi064.stdout:7/57: creat d7/f14 x:0 0 0 2023-12-16T03:15:54.381 INFO:tasks.workunit.client.0.smithi064.stdout:7/58: chown d7/d13/f10 129098 1 2023-12-16T03:15:54.382 INFO:tasks.workunit.client.1.smithi184.stdout:3/413: mkdir d12/d1e/da3 0 2023-12-16T03:15:54.382 INFO:tasks.workunit.client.0.smithi064.stdout:3/95: truncate db/d12/f15 2478656 0 2023-12-16T03:15:54.382 INFO:tasks.workunit.client.0.smithi064.stdout:9/26: sync 2023-12-16T03:15:54.383 INFO:tasks.workunit.client.1.smithi184.stdout:9/505: creat d0/d13/d20/da3/faa x:0 0 0 2023-12-16T03:15:54.383 INFO:tasks.workunit.client.1.smithi184.stdout:9/506: chown d0/d3a/d47/f71 29491338 1 2023-12-16T03:15:54.385 INFO:tasks.workunit.client.0.smithi064.stdout:8/56: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:15:54.385 INFO:tasks.workunit.client.0.smithi064.stdout:1/62: getdents d3/dd 0 2023-12-16T03:15:54.386 INFO:tasks.workunit.client.1.smithi184.stdout:5/234: creat d1/d3/d9/de/d15/d19/d3a/d3f/f4f x:0 0 0 2023-12-16T03:15:54.386 INFO:tasks.workunit.client.1.smithi184.stdout:5/235: write d1/d3/d9/de/d15/d19/f2c [1415490,92012] 0 2023-12-16T03:15:54.386 INFO:tasks.workunit.client.1.smithi184.stdout:5/236: dread - d1/d3/d9/f2d zero size 2023-12-16T03:15:54.388 INFO:tasks.workunit.client.0.smithi064.stdout:2/51: truncate d1/f6 18808 0 2023-12-16T03:15:54.388 INFO:tasks.workunit.client.0.smithi064.stdout:7/59: mknod d7/c15 0 2023-12-16T03:15:54.388 INFO:tasks.workunit.client.0.smithi064.stdout:1/63: getdents d3/dd/d11 0 2023-12-16T03:15:54.391 INFO:tasks.workunit.client.0.smithi064.stdout:2/52: creat d1/fa x:0 0 0 2023-12-16T03:15:54.391 INFO:tasks.workunit.client.0.smithi064.stdout:1/64: truncate f2 503563 0 2023-12-16T03:15:54.391 INFO:tasks.workunit.client.0.smithi064.stdout:1/65: truncate d3/f6 1472898 0 2023-12-16T03:15:54.391 INFO:tasks.workunit.client.1.smithi184.stdout:8/406: mkdir d2/d4/d10/d7a/d83 0 2023-12-16T03:15:54.393 INFO:tasks.workunit.client.1.smithi184.stdout:6/391: getdents d0/d5/d12/d1b/d33/d3d 0 2023-12-16T03:15:54.393 INFO:tasks.workunit.client.1.smithi184.stdout:6/392: read - d0/f31 zero size 2023-12-16T03:15:54.395 INFO:tasks.workunit.client.0.smithi064.stdout:1/66: mknod d3/dd/d11/c19 0 2023-12-16T03:15:54.399 INFO:tasks.workunit.client.1.smithi184.stdout:3/414: getdents d12/d18/d1f 0 2023-12-16T03:15:54.400 INFO:tasks.workunit.client.1.smithi184.stdout:5/237: creat d1/d3/d9/f50 x:0 0 0 2023-12-16T03:15:54.400 INFO:tasks.workunit.client.1.smithi184.stdout:5/238: dread - d1/d3/d9/f2d zero size 2023-12-16T03:15:54.401 INFO:tasks.workunit.client.1.smithi184.stdout:2/249: symlink d3/l52 0 2023-12-16T03:15:54.401 INFO:tasks.workunit.client.1.smithi184.stdout:2/250: write d3/d9/d19/f26 [69965,28124] 0 2023-12-16T03:15:54.403 INFO:tasks.workunit.client.1.smithi184.stdout:5/239: read d1/d3/d9/f18 [1779508,121902] 0 2023-12-16T03:15:54.403 INFO:tasks.workunit.client.1.smithi184.stdout:3/415: symlink d12/d18/d1f/d23/d2a/d36/la4 0 2023-12-16T03:15:54.406 INFO:tasks.workunit.client.1.smithi184.stdout:3/416: unlink d12/d18/f30 0 2023-12-16T03:15:54.406 INFO:tasks.workunit.client.1.smithi184.stdout:3/417: truncate d12/d37/f98 696897 0 2023-12-16T03:15:54.408 INFO:tasks.workunit.client.1.smithi184.stdout:8/407: dread d2/d12/d21/f6e [0,4194304] 0 2023-12-16T03:15:54.411 INFO:tasks.workunit.client.1.smithi184.stdout:3/418: write f8 [4677217,80950] 0 2023-12-16T03:15:54.411 INFO:tasks.workunit.client.1.smithi184.stdout:3/419: fdatasync d12/d37/f95 0 2023-12-16T03:15:54.411 INFO:tasks.workunit.client.1.smithi184.stdout:7/351: rename d0/df/d36/d3f/d49 to d0/df/d32/d35/d63 0 2023-12-16T03:15:54.414 INFO:tasks.workunit.client.1.smithi184.stdout:3/420: mkdir d12/d18/d1f/d23/d2a/d42/d52/d76/da5 0 2023-12-16T03:15:54.415 INFO:tasks.workunit.client.0.smithi064.stdout:9/27: dwrite f1 [0,4194304] 0 2023-12-16T03:15:54.415 INFO:tasks.workunit.client.0.smithi064.stdout:8/57: dwrite d0/da/fc [4194304,4194304] 0 2023-12-16T03:15:54.417 INFO:tasks.workunit.client.0.smithi064.stdout:9/28: creat d2/f7 x:0 0 0 2023-12-16T03:15:54.417 INFO:tasks.workunit.client.1.smithi184.stdout:4/252: rename d1/l6 to d1/d12/l55 0 2023-12-16T03:15:54.421 INFO:tasks.workunit.client.0.smithi064.stdout:8/58: write d0/f3 [867614,34680] 0 2023-12-16T03:15:54.421 INFO:tasks.workunit.client.1.smithi184.stdout:7/352: creat d0/d3/f64 x:0 0 0 2023-12-16T03:15:54.421 INFO:tasks.workunit.client.1.smithi184.stdout:4/253: mknod d1/d11/d1b/d44/c56 0 2023-12-16T03:15:54.423 INFO:tasks.workunit.client.0.smithi064.stdout:9/29: creat d2/f8 x:0 0 0 2023-12-16T03:15:54.425 INFO:tasks.workunit.client.0.smithi064.stdout:9/30: read f1 [991307,5753] 0 2023-12-16T03:15:54.425 INFO:tasks.workunit.client.0.smithi064.stdout:9/31: dread - d2/f7 zero size 2023-12-16T03:15:54.425 INFO:tasks.workunit.client.0.smithi064.stdout:9/32: readlink d2/l4 0 2023-12-16T03:15:54.425 INFO:tasks.workunit.client.1.smithi184.stdout:4/254: creat d1/d11/d1b/d1e/f57 x:0 0 0 2023-12-16T03:15:54.426 INFO:tasks.workunit.client.1.smithi184.stdout:7/353: unlink d0/df/d1e/f42 0 2023-12-16T03:15:54.429 INFO:tasks.workunit.client.1.smithi184.stdout:4/255: mkdir d1/d11/d58 0 2023-12-16T03:15:54.431 INFO:tasks.workunit.client.1.smithi184.stdout:4/256: symlink d1/d12/d13/d40/l59 0 2023-12-16T03:15:54.431 INFO:tasks.workunit.client.1.smithi184.stdout:4/257: stat d1/lb 0 2023-12-16T03:15:54.432 INFO:tasks.workunit.client.0.smithi064.stdout:8/59: dread d0/f2 [0,4194304] 0 2023-12-16T03:15:54.432 INFO:tasks.workunit.client.0.smithi064.stdout:3/96: dwrite db/f16 [0,4194304] 0 2023-12-16T03:15:54.433 INFO:tasks.workunit.client.0.smithi064.stdout:0/29: sync 2023-12-16T03:15:54.433 INFO:tasks.workunit.client.0.smithi064.stdout:2/53: write d1/f6 [636303,37454] 0 2023-12-16T03:15:54.433 INFO:tasks.workunit.client.0.smithi064.stdout:4/51: sync 2023-12-16T03:15:54.433 INFO:tasks.workunit.client.0.smithi064.stdout:4/52: dread - d0/f11 zero size 2023-12-16T03:15:54.433 INFO:tasks.workunit.client.0.smithi064.stdout:0/30: getdents d2/d7 0 2023-12-16T03:15:54.434 INFO:tasks.workunit.client.1.smithi184.stdout:4/258: truncate d1/d29/d34/f3d 881867 0 2023-12-16T03:15:54.434 INFO:tasks.workunit.client.1.smithi184.stdout:2/251: dread d3/d29/d2f/d2e/f3a [0,4194304] 0 2023-12-16T03:15:54.436 INFO:tasks.workunit.client.1.smithi184.stdout:4/259: unlink d1/d11/d1b/d1e/l2d 0 2023-12-16T03:15:54.438 INFO:tasks.workunit.client.1.smithi184.stdout:9/507: rename d0/d13/d20/da3 to d0/d13/d20/d5b/d43/dab 0 2023-12-16T03:15:54.438 INFO:tasks.workunit.client.1.smithi184.stdout:2/252: rmdir d3/d13 39 2023-12-16T03:15:54.438 INFO:tasks.workunit.client.0.smithi064.stdout:4/53: read d0/f8 [378842,118911] 0 2023-12-16T03:15:54.440 INFO:tasks.workunit.client.1.smithi184.stdout:9/508: truncate d0/d13/f21 2389809 0 2023-12-16T03:15:54.440 INFO:tasks.workunit.client.1.smithi184.stdout:9/509: stat d0/d13/f87 0 2023-12-16T03:15:54.441 INFO:tasks.workunit.client.0.smithi064.stdout:8/60: mkdir d0/db/d12 0 2023-12-16T03:15:54.442 INFO:tasks.workunit.client.0.smithi064.stdout:2/54: symlink d1/lb 0 2023-12-16T03:15:54.442 INFO:tasks.workunit.client.1.smithi184.stdout:2/253: link d3/d9/d19/f26 d3/d29/d2f/d2e/f53 0 2023-12-16T03:15:54.443 INFO:tasks.workunit.client.1.smithi184.stdout:9/510: mknod d0/d13/d6e/d9f/cac 0 2023-12-16T03:15:54.445 INFO:tasks.workunit.client.1.smithi184.stdout:2/254: creat d3/d29/d2f/f54 x:0 0 0 2023-12-16T03:15:54.447 INFO:tasks.workunit.client.1.smithi184.stdout:9/511: symlink d0/d13/d20/d5b/d43/lad 0 2023-12-16T03:15:54.447 INFO:tasks.workunit.client.1.smithi184.stdout:2/255: symlink d3/d29/d2f/l55 0 2023-12-16T03:15:54.447 INFO:tasks.workunit.client.1.smithi184.stdout:2/256: read d3/d13/f18 [18621,115452] 0 2023-12-16T03:15:54.447 INFO:tasks.workunit.client.1.smithi184.stdout:2/257: dread - d3/d29/d2f/f54 zero size 2023-12-16T03:15:54.447 INFO:tasks.workunit.client.1.smithi184.stdout:7/354: dread d0/d3/f5 [4194304,4194304] 0 2023-12-16T03:15:54.447 INFO:tasks.workunit.client.1.smithi184.stdout:7/355: readlink d0/df/d1e/l52 0 2023-12-16T03:15:54.447 INFO:tasks.workunit.client.0.smithi064.stdout:3/97: mknod db/c20 0 2023-12-16T03:15:54.447 INFO:tasks.workunit.client.0.smithi064.stdout:8/61: link d0/ld d0/l13 0 2023-12-16T03:15:54.447 INFO:tasks.workunit.client.0.smithi064.stdout:4/54: chown d0/c4 3548 1 2023-12-16T03:15:54.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/408: dwrite d2/d4/d10/d11/f15 [0,4194304] 0 2023-12-16T03:15:54.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/409: dread - d2/d4/d10/d11/f6f zero size 2023-12-16T03:15:54.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/410: read - d2/d4/d10/d2a/f5c zero size 2023-12-16T03:15:54.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/411: truncate d2/d4/d10/f17 1087723 0 2023-12-16T03:15:54.448 INFO:tasks.workunit.client.1.smithi184.stdout:2/258: rmdir d3/d9 39 2023-12-16T03:15:54.449 INFO:tasks.workunit.client.1.smithi184.stdout:9/512: dread d0/d3a/f59 [0,4194304] 0 2023-12-16T03:15:54.449 INFO:tasks.workunit.client.1.smithi184.stdout:9/513: fdatasync d0/d3a/d47/f71 0 2023-12-16T03:15:54.449 INFO:tasks.workunit.client.1.smithi184.stdout:9/514: write d0/d30/f94 [1009133,98866] 0 2023-12-16T03:15:54.449 INFO:tasks.workunit.client.0.smithi064.stdout:0/31: mkdir d2/d8 0 2023-12-16T03:15:54.449 INFO:tasks.workunit.client.0.smithi064.stdout:2/55: mknod d1/cc 0 2023-12-16T03:15:54.450 INFO:tasks.workunit.client.0.smithi064.stdout:2/56: write d1/f9 [727585,94916] 0 2023-12-16T03:15:54.450 INFO:tasks.workunit.client.1.smithi184.stdout:8/412: unlink d2/d4/d10/d11/f4d 0 2023-12-16T03:15:54.450 INFO:tasks.workunit.client.1.smithi184.stdout:9/515: symlink d0/d13/d20/d5b/d53/lae 0 2023-12-16T03:15:54.450 INFO:tasks.workunit.client.0.smithi064.stdout:3/98: rename db/d12/d1e to db/d12/d21 0 2023-12-16T03:15:54.453 INFO:tasks.workunit.client.1.smithi184.stdout:8/413: rename d2/f28 to d2/d6a/f84 0 2023-12-16T03:15:54.453 INFO:tasks.workunit.client.1.smithi184.stdout:8/414: chown d2/d4/f44 59973457 1 2023-12-16T03:15:54.454 INFO:tasks.workunit.client.1.smithi184.stdout:7/356: write d0/df/d36/d3f/f4f [622304,14181] 0 2023-12-16T03:15:54.454 INFO:tasks.workunit.client.1.smithi184.stdout:9/516: write d0/f1f [905596,55096] 0 2023-12-16T03:15:54.454 INFO:tasks.workunit.client.1.smithi184.stdout:8/415: creat d2/d4/d10/d11/d72/f85 x:0 0 0 2023-12-16T03:15:54.454 INFO:tasks.workunit.client.0.smithi064.stdout:8/62: link d0/f3 d0/f14 0 2023-12-16T03:15:54.454 INFO:tasks.workunit.client.0.smithi064.stdout:0/32: chown d2/f3 1426456 1 2023-12-16T03:15:54.454 INFO:tasks.workunit.client.0.smithi064.stdout:3/99: symlink db/d12/d21/l22 0 2023-12-16T03:15:54.455 INFO:tasks.workunit.client.0.smithi064.stdout:0/33: symlink d2/d7/l9 0 2023-12-16T03:15:54.455 INFO:tasks.workunit.client.0.smithi064.stdout:0/34: write d2/f3 [1038217,96125] 0 2023-12-16T03:15:54.456 INFO:tasks.workunit.client.1.smithi184.stdout:5/240: dwrite d1/d3/d9/de/d15/d19/d3a/d3f/f4f [0,4194304] 0 2023-12-16T03:15:54.456 INFO:tasks.workunit.client.1.smithi184.stdout:5/241: stat d1/d3/d2f 0 2023-12-16T03:15:54.456 INFO:tasks.workunit.client.1.smithi184.stdout:5/242: fdatasync d1/d3/d9/de/f37 0 2023-12-16T03:15:54.456 INFO:tasks.workunit.client.1.smithi184.stdout:5/243: dread - d1/d3/d2f/f3d zero size 2023-12-16T03:15:54.456 INFO:tasks.workunit.client.1.smithi184.stdout:5/244: write d1/d3/d9/de/d15/d19/d3a/d3f/f41 [970680,19899] 0 2023-12-16T03:15:54.456 INFO:tasks.workunit.client.1.smithi184.stdout:7/357: symlink d0/df/d32/d35/d63/l65 0 2023-12-16T03:15:54.457 INFO:tasks.workunit.client.0.smithi064.stdout:0/35: mkdir d2/d8/da 0 2023-12-16T03:15:54.459 INFO:tasks.workunit.client.1.smithi184.stdout:9/517: creat d0/d13/d20/d5b/faf x:0 0 0 2023-12-16T03:15:54.460 INFO:tasks.workunit.client.1.smithi184.stdout:2/259: dread d3/f4 [0,4194304] 0 2023-12-16T03:15:54.460 INFO:tasks.workunit.client.1.smithi184.stdout:6/393: truncate d0/d5/d12/d1b/f5b 2241931 0 2023-12-16T03:15:54.460 INFO:tasks.workunit.client.1.smithi184.stdout:6/394: chown d0/d5/d12/d1b/d33/f58 220 1 2023-12-16T03:15:54.461 INFO:tasks.workunit.client.0.smithi064.stdout:9/33: dwrite f1 [0,4194304] 0 2023-12-16T03:15:54.461 INFO:tasks.workunit.client.0.smithi064.stdout:9/34: dread - d2/f7 zero size 2023-12-16T03:15:54.461 INFO:tasks.workunit.client.0.smithi064.stdout:9/35: truncate d2/f7 406708 0 2023-12-16T03:15:54.461 INFO:tasks.workunit.client.0.smithi064.stdout:8/63: write d0/f14 [607568,31738] 0 2023-12-16T03:15:54.461 INFO:tasks.workunit.client.0.smithi064.stdout:8/64: chown d0/f14 790 1 2023-12-16T03:15:54.466 INFO:tasks.workunit.client.1.smithi184.stdout:8/416: creat d2/d12/d21/d2d/d31/d5e/f86 x:0 0 0 2023-12-16T03:15:54.468 INFO:tasks.workunit.client.0.smithi064.stdout:1/67: write f2 [117216,125761] 0 2023-12-16T03:15:54.470 INFO:tasks.workunit.client.1.smithi184.stdout:7/358: creat d0/df/d36/f66 x:0 0 0 2023-12-16T03:15:54.470 INFO:tasks.workunit.client.1.smithi184.stdout:7/359: chown d0/df/d36/d3f/f4f 67 1 2023-12-16T03:15:54.471 INFO:tasks.workunit.client.1.smithi184.stdout:4/260: dwrite d1/d29/f2e [0,4194304] 0 2023-12-16T03:15:54.471 INFO:tasks.workunit.client.1.smithi184.stdout:4/261: dread - d1/d12/d27/d3b/f53 zero size 2023-12-16T03:15:54.471 INFO:tasks.workunit.client.1.smithi184.stdout:4/262: truncate d1/f51 604480 0 2023-12-16T03:15:54.472 INFO:tasks.workunit.client.1.smithi184.stdout:2/260: creat d3/f56 x:0 0 0 2023-12-16T03:15:54.475 INFO:tasks.workunit.client.0.smithi064.stdout:4/55: dread d0/f8 [0,4194304] 0 2023-12-16T03:15:54.475 INFO:tasks.workunit.client.0.smithi064.stdout:4/56: stat d0 0 2023-12-16T03:15:54.476 INFO:tasks.workunit.client.0.smithi064.stdout:4/57: write d0/f1 [738384,120573] 0 2023-12-16T03:15:54.476 INFO:tasks.workunit.client.0.smithi064.stdout:4/58: write d0/f11 [48138,10591] 0 2023-12-16T03:15:54.476 INFO:tasks.workunit.client.1.smithi184.stdout:6/395: rename d0/d5/l46 to d0/d5/d22/d25/d3f/l7b 0 2023-12-16T03:15:54.476 INFO:tasks.workunit.client.0.smithi064.stdout:4/59: read d0/f8 [2870306,2573] 0 2023-12-16T03:15:54.477 INFO:tasks.workunit.client.0.smithi064.stdout:4/60: chown d0/da 1002 1 2023-12-16T03:15:54.477 INFO:tasks.workunit.client.0.smithi064.stdout:4/61: stat d0/da/cb 0 2023-12-16T03:15:54.477 INFO:tasks.workunit.client.0.smithi064.stdout:1/68: creat d3/dd/f1a x:0 0 0 2023-12-16T03:15:54.480 INFO:tasks.workunit.client.1.smithi184.stdout:7/360: write d0/d3/f7 [919541,57329] 0 2023-12-16T03:15:54.480 INFO:tasks.workunit.client.1.smithi184.stdout:8/417: creat d2/d4/d10/d2a/f87 x:0 0 0 2023-12-16T03:15:54.484 INFO:tasks.workunit.client.0.smithi064.stdout:1/69: unlink d3/lb 0 2023-12-16T03:15:54.484 INFO:tasks.workunit.client.0.smithi064.stdout:4/62: mkdir d0/d12 0 2023-12-16T03:15:54.485 INFO:tasks.workunit.client.1.smithi184.stdout:6/396: write d0/d5/f1f [1481888,15972] 0 2023-12-16T03:15:54.487 INFO:tasks.workunit.client.0.smithi064.stdout:0/36: dread d2/f5 [0,4194304] 0 2023-12-16T03:15:54.488 INFO:tasks.workunit.client.0.smithi064.stdout:2/57: write d1/f6 [225424,49109] 0 2023-12-16T03:15:54.488 INFO:tasks.workunit.client.0.smithi064.stdout:1/70: unlink d3/f7 0 2023-12-16T03:15:54.488 INFO:tasks.workunit.client.0.smithi064.stdout:1/71: stat d3/dd/d11/f17 0 2023-12-16T03:15:54.488 INFO:tasks.workunit.client.0.smithi064.stdout:1/72: dread - d3/fe zero size 2023-12-16T03:15:54.493 INFO:tasks.workunit.client.1.smithi184.stdout:7/361: dread d0/df/d36/f4e [0,4194304] 0 2023-12-16T03:15:54.494 INFO:tasks.workunit.client.1.smithi184.stdout:2/261: mknod d3/d9/d19/c57 0 2023-12-16T03:15:54.495 INFO:tasks.workunit.client.0.smithi064.stdout:4/63: dread d0/f8 [0,4194304] 0 2023-12-16T03:15:54.497 INFO:tasks.workunit.client.0.smithi064.stdout:3/100: rmdir db 39 2023-12-16T03:15:54.498 INFO:tasks.workunit.client.1.smithi184.stdout:8/418: getdents d2/d37 0 2023-12-16T03:15:54.498 INFO:tasks.workunit.client.1.smithi184.stdout:7/362: mknod d0/df/d32/d35/c67 0 2023-12-16T03:15:54.498 INFO:tasks.workunit.client.0.smithi064.stdout:0/37: getdents d2/d7 0 2023-12-16T03:15:54.498 INFO:tasks.workunit.client.0.smithi064.stdout:0/38: stat d2/d8 0 2023-12-16T03:15:54.499 INFO:tasks.workunit.client.1.smithi184.stdout:6/397: dread d0/d5/d22/f41 [0,4194304] 0 2023-12-16T03:15:54.499 INFO:tasks.workunit.client.0.smithi064.stdout:4/64: truncate d0/f2 1624858 0 2023-12-16T03:15:54.500 INFO:tasks.workunit.client.1.smithi184.stdout:7/363: read d0/d3/d2e/f3a [407809,9749] 0 2023-12-16T03:15:54.501 INFO:tasks.workunit.client.1.smithi184.stdout:5/245: dwrite d1/f1a [0,4194304] 0 2023-12-16T03:15:54.501 INFO:tasks.workunit.client.1.smithi184.stdout:5/246: fdatasync d1/d3/d9/de/f37 0 2023-12-16T03:15:54.501 INFO:tasks.workunit.client.1.smithi184.stdout:6/398: creat d0/d36/d79/f7c x:0 0 0 2023-12-16T03:15:54.501 INFO:tasks.workunit.client.1.smithi184.stdout:6/399: dread - d0/f31 zero size 2023-12-16T03:15:54.501 INFO:tasks.workunit.client.1.smithi184.stdout:6/400: write d0/d5/d22/d25/f5f [255141,38233] 0 2023-12-16T03:15:54.501 INFO:tasks.workunit.client.1.smithi184.stdout:6/401: truncate d0/d5/d12/f1c 9384615 0 2023-12-16T03:15:54.503 INFO:tasks.workunit.client.0.smithi064.stdout:9/36: dwrite d2/f8 [0,4194304] 0 2023-12-16T03:15:54.506 INFO:tasks.workunit.client.1.smithi184.stdout:5/247: symlink d1/d3/d9/de/d15/d19/l51 0 2023-12-16T03:15:54.508 INFO:tasks.workunit.client.1.smithi184.stdout:9/518: dwrite d0/d13/d20/d5b/faf [0,4194304] 0 2023-12-16T03:15:54.510 INFO:tasks.workunit.client.1.smithi184.stdout:6/402: unlink d0/d5/d12/d1b/f2f 0 2023-12-16T03:15:54.511 INFO:tasks.workunit.client.0.smithi064.stdout:4/65: symlink d0/da/l13 0 2023-12-16T03:15:54.511 INFO:tasks.workunit.client.0.smithi064.stdout:3/101: creat db/d12/f23 x:0 0 0 2023-12-16T03:15:54.511 INFO:tasks.workunit.client.0.smithi064.stdout:4/66: stat d0/f11 0 2023-12-16T03:15:54.512 INFO:tasks.workunit.client.1.smithi184.stdout:5/248: creat d1/d3/d9/de/d15/f52 x:0 0 0 2023-12-16T03:15:54.512 INFO:tasks.workunit.client.1.smithi184.stdout:5/249: readlink d1/d3/d9/de/d15/l34 0 2023-12-16T03:15:54.513 INFO:tasks.workunit.client.0.smithi064.stdout:0/39: mknod d2/cb 0 2023-12-16T03:15:54.513 INFO:tasks.workunit.client.1.smithi184.stdout:5/250: read d1/d3/d9/f40 [143402,116537] 0 2023-12-16T03:15:54.517 INFO:tasks.workunit.client.1.smithi184.stdout:9/519: rename d0/d3a/d47/d7a to d0/d13/d20/db0 0 2023-12-16T03:15:54.517 INFO:tasks.workunit.client.1.smithi184.stdout:9/520: write d0/d3a/f9b [775104,44409] 0 2023-12-16T03:15:54.517 INFO:tasks.workunit.client.1.smithi184.stdout:9/521: dread - d0/d13/d20/d5b/d53/f58 zero size 2023-12-16T03:15:54.517 INFO:tasks.workunit.client.1.smithi184.stdout:6/403: write d0/d5/d12/d1b/f5b [3249038,48490] 0 2023-12-16T03:15:54.517 INFO:tasks.workunit.client.1.smithi184.stdout:6/404: truncate d0/d5/d22/d25/f5f 1319378 0 2023-12-16T03:15:54.518 INFO:tasks.workunit.client.0.smithi064.stdout:0/40: mknod d2/d8/da/cc 0 2023-12-16T03:15:54.518 INFO:tasks.workunit.client.0.smithi064.stdout:6/51: sync 2023-12-16T03:15:54.518 INFO:tasks.workunit.client.0.smithi064.stdout:0/41: fdatasync d2/f5 0 2023-12-16T03:15:54.518 INFO:tasks.workunit.client.0.smithi064.stdout:6/52: write d3/d9/fb [873961,58920] 0 2023-12-16T03:15:54.518 INFO:tasks.workunit.client.1.smithi184.stdout:5/251: read d1/d3/d9/de/d15/d19/d3a/f4b [687459,85218] 0 2023-12-16T03:15:54.521 INFO:tasks.workunit.client.1.smithi184.stdout:9/522: symlink d0/d13/d20/d5b/d43/lb1 0 2023-12-16T03:15:54.522 INFO:tasks.workunit.client.0.smithi064.stdout:0/42: read d2/f3 [563736,77241] 0 2023-12-16T03:15:54.523 INFO:tasks.workunit.client.1.smithi184.stdout:9/523: mkdir d0/d76/db2 0 2023-12-16T03:15:54.524 INFO:tasks.workunit.client.0.smithi064.stdout:4/67: mkdir d0/d14 0 2023-12-16T03:15:54.524 INFO:tasks.workunit.client.0.smithi064.stdout:8/65: dwrite d0/da/fc [0,4194304] 0 2023-12-16T03:15:54.524 INFO:tasks.workunit.client.1.smithi184.stdout:9/524: write d0/f14 [3074696,91786] 0 2023-12-16T03:15:54.524 INFO:tasks.workunit.client.1.smithi184.stdout:4/263: dwrite d1/fd [0,4194304] 0 2023-12-16T03:15:54.527 INFO:tasks.workunit.client.0.smithi064.stdout:6/53: symlink d3/lf 0 2023-12-16T03:15:54.527 INFO:tasks.workunit.client.0.smithi064.stdout:6/54: chown d3/lf 115 1 2023-12-16T03:15:54.527 INFO:tasks.workunit.client.1.smithi184.stdout:6/405: write d0/d5/d12/d1b/d33/f58 [3146470,53165] 0 2023-12-16T03:15:54.529 INFO:tasks.workunit.client.1.smithi184.stdout:7/364: dwrite d0/df/d36/d3f/f4f [0,4194304] 0 2023-12-16T03:15:54.529 INFO:tasks.workunit.client.1.smithi184.stdout:9/525: symlink d0/d13/d20/d5b/d43/dab/lb3 0 2023-12-16T03:15:54.529 INFO:tasks.workunit.client.0.smithi064.stdout:4/68: symlink d0/d12/l15 0 2023-12-16T03:15:54.530 INFO:tasks.workunit.client.0.smithi064.stdout:0/43: truncate d2/f3 222457 0 2023-12-16T03:15:54.530 INFO:tasks.workunit.client.0.smithi064.stdout:4/69: write d0/f2 [2637701,59429] 0 2023-12-16T03:15:54.530 INFO:tasks.workunit.client.0.smithi064.stdout:8/66: creat d0/db/d12/f15 x:0 0 0 2023-12-16T03:15:54.530 INFO:tasks.workunit.client.0.smithi064.stdout:8/67: chown d0/l5 8111 1 2023-12-16T03:15:54.531 INFO:tasks.workunit.client.0.smithi064.stdout:6/55: unlink l0 0 2023-12-16T03:15:54.531 INFO:tasks.workunit.client.1.smithi184.stdout:6/406: write d0/d5/d22/d25/d3f/f78 [1899517,86884] 0 2023-12-16T03:15:54.532 INFO:tasks.workunit.client.0.smithi064.stdout:3/102: dread db/fd [0,4194304] 0 2023-12-16T03:15:54.532 INFO:tasks.workunit.client.1.smithi184.stdout:4/264: dread d1/d11/d1b/d1e/f41 [0,4194304] 0 2023-12-16T03:15:54.533 INFO:tasks.workunit.client.0.smithi064.stdout:4/70: creat d0/da/f16 x:0 0 0 2023-12-16T03:15:54.534 INFO:tasks.workunit.client.1.smithi184.stdout:7/365: read d0/df/d32/d39/f3e [2096693,79160] 0 2023-12-16T03:15:54.534 INFO:tasks.workunit.client.1.smithi184.stdout:4/265: truncate d1/d11/f23 1051868 0 2023-12-16T03:15:54.534 INFO:tasks.workunit.client.1.smithi184.stdout:4/266: chown d1/d29/d34/f3d 311536 1 2023-12-16T03:15:54.534 INFO:tasks.workunit.client.1.smithi184.stdout:4/267: readlink d1/d12/d13/l1c 0 2023-12-16T03:15:54.535 INFO:tasks.workunit.client.0.smithi064.stdout:3/103: creat db/d13/f24 x:0 0 0 2023-12-16T03:15:54.536 INFO:tasks.workunit.client.1.smithi184.stdout:8/419: dwrite d2/d4/d10/f17 [0,4194304] 0 2023-12-16T03:15:54.536 INFO:tasks.workunit.client.1.smithi184.stdout:8/420: chown d2/f33 22704 1 2023-12-16T03:15:54.536 INFO:tasks.workunit.client.1.smithi184.stdout:7/366: rename d0/d3/d2e/d47 to d0/d3/d68 0 2023-12-16T03:15:54.536 INFO:tasks.workunit.client.1.smithi184.stdout:7/367: chown d0/d3/c30 0 1 2023-12-16T03:15:54.536 INFO:tasks.workunit.client.0.smithi064.stdout:4/71: unlink d0/da/cb 0 2023-12-16T03:15:54.536 INFO:tasks.workunit.client.0.smithi064.stdout:3/104: fdatasync f4 0 2023-12-16T03:15:54.538 INFO:tasks.workunit.client.0.smithi064.stdout:8/68: write d0/f7 [2453293,76901] 0 2023-12-16T03:15:54.542 INFO:tasks.workunit.client.0.smithi064.stdout:3/105: dread db/d12/f18 [0,4194304] 0 2023-12-16T03:15:54.543 INFO:tasks.workunit.client.1.smithi184.stdout:2/262: dwrite d3/f56 [0,4194304] 0 2023-12-16T03:15:54.544 INFO:tasks.workunit.client.0.smithi064.stdout:8/69: mkdir d0/da/d16 0 2023-12-16T03:15:54.544 INFO:tasks.workunit.client.0.smithi064.stdout:8/70: write d0/db/d12/f15 [1045051,27393] 0 2023-12-16T03:15:54.544 INFO:tasks.workunit.client.1.smithi184.stdout:5/252: dwrite d1/d3/d9/de/d15/d19/f23 [0,4194304] 0 2023-12-16T03:15:54.544 INFO:tasks.workunit.client.1.smithi184.stdout:5/253: chown d1/d3/d9/l47 40972327 1 2023-12-16T03:15:54.545 INFO:tasks.workunit.client.0.smithi064.stdout:3/106: creat db/d13/f25 x:0 0 0 2023-12-16T03:15:54.549 INFO:tasks.workunit.client.0.smithi064.stdout:9/37: dwrite d2/f7 [0,4194304] 0 2023-12-16T03:15:54.550 INFO:tasks.workunit.client.0.smithi064.stdout:9/38: fsync d2/f8 0 2023-12-16T03:15:54.550 INFO:tasks.workunit.client.0.smithi064.stdout:9/39: chown d2/f8 2893080 1 2023-12-16T03:15:54.550 INFO:tasks.workunit.client.0.smithi064.stdout:8/71: read d0/f3 [726212,125436] 0 2023-12-16T03:15:54.550 INFO:tasks.workunit.client.0.smithi064.stdout:8/72: readlink d0/l9 0 2023-12-16T03:15:54.555 INFO:tasks.workunit.client.0.smithi064.stdout:8/73: link d0/ld d0/da/df/l17 0 2023-12-16T03:15:54.562 INFO:tasks.workunit.client.1.smithi184.stdout:6/407: dwrite d0/d5/d12/d1b/d33/f6c [0,4194304] 0 2023-12-16T03:15:54.566 INFO:tasks.workunit.client.1.smithi184.stdout:9/526: dwrite d0/d13/d20/f8f [0,4194304] 0 2023-12-16T03:15:54.571 INFO:tasks.workunit.client.0.smithi064.stdout:3/107: getdents db/d13 0 2023-12-16T03:15:54.571 INFO:tasks.workunit.client.0.smithi064.stdout:3/108: stat c8 0 2023-12-16T03:15:54.573 INFO:tasks.workunit.client.0.smithi064.stdout:3/109: creat db/d12/d1a/f26 x:0 0 0 2023-12-16T03:15:54.573 INFO:tasks.workunit.client.0.smithi064.stdout:3/110: creat db/d12/f27 x:0 0 0 2023-12-16T03:15:54.574 INFO:tasks.workunit.client.0.smithi064.stdout:3/111: truncate db/d12/d1a/f26 106205 0 2023-12-16T03:15:54.574 INFO:tasks.workunit.client.0.smithi064.stdout:3/112: creat db/d12/d1a/f28 x:0 0 0 2023-12-16T03:15:54.574 INFO:tasks.workunit.client.0.smithi064.stdout:3/113: read - db/f10 zero size 2023-12-16T03:15:54.576 INFO:tasks.workunit.client.0.smithi064.stdout:3/114: unlink db/fe 0 2023-12-16T03:15:54.579 INFO:tasks.workunit.client.1.smithi184.stdout:9/527: dread d0/d13/d20/f8f [0,4194304] 0 2023-12-16T03:15:54.580 INFO:tasks.workunit.client.0.smithi064.stdout:0/44: dwrite f1 [4194304,4194304] 0 2023-12-16T03:15:54.581 INFO:tasks.workunit.client.1.smithi184.stdout:4/268: dwrite d1/d11/d1b/d44/f4b [0,4194304] 0 2023-12-16T03:15:54.581 INFO:tasks.workunit.client.1.smithi184.stdout:4/269: dread - d1/d12/d27/f49 zero size 2023-12-16T03:15:54.581 INFO:tasks.workunit.client.1.smithi184.stdout:4/270: read - d1/d12/d27/f32 zero size 2023-12-16T03:15:54.581 INFO:tasks.workunit.client.1.smithi184.stdout:9/528: write d0/d13/f21 [681194,64120] 0 2023-12-16T03:15:54.582 INFO:tasks.workunit.client.0.smithi064.stdout:0/45: mknod d2/d7/cd 0 2023-12-16T03:15:54.582 INFO:tasks.workunit.client.0.smithi064.stdout:8/74: fsync d0/f7 0 2023-12-16T03:15:54.582 INFO:tasks.workunit.client.0.smithi064.stdout:8/75: write d0/db/d12/f15 [1193741,14648] 0 2023-12-16T03:15:54.583 INFO:tasks.workunit.client.0.smithi064.stdout:9/40: write d2/f7 [4545855,36584] 0 2023-12-16T03:15:54.584 INFO:tasks.workunit.client.0.smithi064.stdout:4/72: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:15:54.585 INFO:tasks.workunit.client.1.smithi184.stdout:2/263: symlink d3/d29/d2f/l58 0 2023-12-16T03:15:54.590 INFO:tasks.workunit.client.0.smithi064.stdout:4/73: mkdir d0/d12/d17 0 2023-12-16T03:15:54.592 INFO:tasks.workunit.client.0.smithi064.stdout:4/74: link d0/l6 d0/da/l18 0 2023-12-16T03:15:54.593 INFO:tasks.workunit.client.0.smithi064.stdout:4/75: symlink d0/d14/l19 0 2023-12-16T03:15:54.597 INFO:tasks.workunit.client.0.smithi064.stdout:4/76: dread d0/f1 [0,4194304] 0 2023-12-16T03:15:54.597 INFO:tasks.workunit.client.0.smithi064.stdout:4/77: chown d0/da/l18 76 1 2023-12-16T03:15:54.598 INFO:tasks.workunit.client.0.smithi064.stdout:4/78: chown d0/c7 1500909 1 2023-12-16T03:15:54.598 INFO:tasks.workunit.client.0.smithi064.stdout:0/46: dread f1 [4194304,4194304] 0 2023-12-16T03:15:54.599 INFO:tasks.workunit.client.0.smithi064.stdout:5/76: sync 2023-12-16T03:15:54.599 INFO:tasks.workunit.client.0.smithi064.stdout:7/60: sync 2023-12-16T03:15:54.599 INFO:tasks.workunit.client.0.smithi064.stdout:0/47: write f1 [173497,118362] 0 2023-12-16T03:15:54.602 INFO:tasks.workunit.client.0.smithi064.stdout:8/76: dwrite d0/f14 [0,4194304] 0 2023-12-16T03:15:54.602 INFO:tasks.workunit.client.0.smithi064.stdout:8/77: read d0/db/d12/f15 [788510,127389] 0 2023-12-16T03:15:54.602 INFO:tasks.workunit.client.0.smithi064.stdout:7/61: rmdir d7/d13 39 2023-12-16T03:15:54.602 INFO:tasks.workunit.client.0.smithi064.stdout:7/62: read - d7/f14 zero size 2023-12-16T03:15:54.605 INFO:tasks.workunit.client.1.smithi184.stdout:4/271: dwrite d1/d11/d1b/d1e/f57 [0,4194304] 0 2023-12-16T03:15:54.605 INFO:tasks.workunit.client.0.smithi064.stdout:5/77: link d0/de/ff d0/d7/f1d 0 2023-12-16T03:15:54.606 INFO:tasks.workunit.client.0.smithi064.stdout:8/78: mkdir d0/da/d16/d18 0 2023-12-16T03:15:54.608 INFO:tasks.workunit.client.0.smithi064.stdout:8/79: getdents d0 0 2023-12-16T03:15:54.608 INFO:tasks.workunit.client.0.smithi064.stdout:8/80: chown d0/f7 11007733 1 2023-12-16T03:15:54.609 INFO:tasks.workunit.client.0.smithi064.stdout:8/81: symlink d0/db/d12/l19 0 2023-12-16T03:15:54.611 INFO:tasks.workunit.client.0.smithi064.stdout:8/82: write d0/f7 [5679154,65259] 0 2023-12-16T03:15:54.613 INFO:tasks.workunit.client.1.smithi184.stdout:5/254: mkdir d1/d3/d9/de/d15/d19/d53 0 2023-12-16T03:15:54.614 INFO:tasks.workunit.client.1.smithi184.stdout:5/255: getdents d1/d3/d9/de/d15/d27 0 2023-12-16T03:15:54.614 INFO:tasks.workunit.client.1.smithi184.stdout:5/256: fdatasync d1/d3/d9/de/f37 0 2023-12-16T03:15:54.614 INFO:tasks.workunit.client.1.smithi184.stdout:5/257: write d1/d3/d9/de/d15/d19/d3a/d3f/f41 [1231399,43782] 0 2023-12-16T03:15:54.614 INFO:tasks.workunit.client.0.smithi064.stdout:8/83: link d0/l9 d0/da/df/l1a 0 2023-12-16T03:15:54.624 INFO:tasks.workunit.client.0.smithi064.stdout:5/78: dread d0/f5 [0,4194304] 0 2023-12-16T03:15:54.625 INFO:tasks.workunit.client.1.smithi184.stdout:9/529: mkdir d0/d76/da2/db4 0 2023-12-16T03:15:54.625 INFO:tasks.workunit.client.0.smithi064.stdout:9/41: dwrite d2/f7 [0,4194304] 0 2023-12-16T03:15:54.625 INFO:tasks.workunit.client.0.smithi064.stdout:0/48: dwrite d2/f3 [0,4194304] 0 2023-12-16T03:15:54.626 INFO:tasks.workunit.client.0.smithi064.stdout:5/79: getdents d0/de 0 2023-12-16T03:15:54.627 INFO:tasks.workunit.client.0.smithi064.stdout:8/84: dread d0/f14 [0,4194304] 0 2023-12-16T03:15:54.627 INFO:tasks.workunit.client.1.smithi184.stdout:2/264: rename d3/d13/d28/l40 to d3/d13/l59 0 2023-12-16T03:15:54.628 INFO:tasks.workunit.client.1.smithi184.stdout:2/265: fdatasync d3/d29/d2f/d2e/f35 0 2023-12-16T03:15:54.629 INFO:tasks.workunit.client.1.smithi184.stdout:9/530: read d0/d13/d20/db0/fa0 [2355087,130584] 0 2023-12-16T03:15:54.631 INFO:tasks.workunit.client.0.smithi064.stdout:9/42: truncate d2/f8 3916794 0 2023-12-16T03:15:54.633 INFO:tasks.workunit.client.0.smithi064.stdout:5/80: truncate d0/f3 2965875 0 2023-12-16T03:15:54.633 INFO:tasks.workunit.client.1.smithi184.stdout:4/272: mkdir d1/d11/d5a 0 2023-12-16T03:15:54.634 INFO:tasks.workunit.client.0.smithi064.stdout:8/85: creat d0/da/d16/f1b x:0 0 0 2023-12-16T03:15:54.635 INFO:tasks.workunit.client.1.smithi184.stdout:6/408: mknod d0/d5/d22/d25/d3f/c7d 0 2023-12-16T03:15:54.635 INFO:tasks.workunit.client.0.smithi064.stdout:9/43: getdents d2 0 2023-12-16T03:15:54.635 INFO:tasks.workunit.client.0.smithi064.stdout:9/44: readlink l0 0 2023-12-16T03:15:54.636 INFO:tasks.workunit.client.0.smithi064.stdout:9/45: fdatasync d2/f8 0 2023-12-16T03:15:54.637 INFO:tasks.workunit.client.0.smithi064.stdout:5/81: creat d0/d7/f1e x:0 0 0 2023-12-16T03:15:54.637 INFO:tasks.workunit.client.0.smithi064.stdout:8/86: mkdir d0/db/d12/d1c 0 2023-12-16T03:15:54.638 INFO:tasks.workunit.client.0.smithi064.stdout:5/82: symlink d0/de/l1f 0 2023-12-16T03:15:54.638 INFO:tasks.workunit.client.0.smithi064.stdout:5/83: getdents d0/d14 0 2023-12-16T03:15:54.639 INFO:tasks.workunit.client.1.smithi184.stdout:2/266: mknod d3/d29/d2f/c5a 0 2023-12-16T03:15:54.640 INFO:tasks.workunit.client.0.smithi064.stdout:8/87: mkdir d0/d1d 0 2023-12-16T03:15:54.641 INFO:tasks.workunit.client.0.smithi064.stdout:8/88: rmdir d0 39 2023-12-16T03:15:54.644 INFO:tasks.workunit.client.0.smithi064.stdout:8/89: unlink d0/db/l10 0 2023-12-16T03:15:54.644 INFO:tasks.workunit.client.1.smithi184.stdout:4/273: rename d1/d12/d13/d40/d43/l4f to d1/d12/d27/d3b/l5b 0 2023-12-16T03:15:54.645 INFO:tasks.workunit.client.1.smithi184.stdout:4/274: mkdir d1/d29/d34/d5c 0 2023-12-16T03:15:54.646 INFO:tasks.workunit.client.1.smithi184.stdout:5/258: dwrite d1/d3/d9/de/d15/d19/d3a/d3f/f4f [0,4194304] 0 2023-12-16T03:15:54.646 INFO:tasks.workunit.client.1.smithi184.stdout:6/409: write d0/d36/f55 [2271131,97256] 0 2023-12-16T03:15:54.646 INFO:tasks.workunit.client.1.smithi184.stdout:4/275: creat d1/d11/d1b/d1e/f5d x:0 0 0 2023-12-16T03:15:54.648 INFO:tasks.workunit.client.0.smithi064.stdout:8/90: mknod d0/db/d12/d1c/c1e 0 2023-12-16T03:15:54.649 INFO:tasks.workunit.client.1.smithi184.stdout:5/259: creat d1/d2a/d31/f54 x:0 0 0 2023-12-16T03:15:54.652 INFO:tasks.workunit.client.1.smithi184.stdout:4/276: mkdir d1/d12/d13/d40/d43/d5e 0 2023-12-16T03:15:54.652 INFO:tasks.workunit.client.1.smithi184.stdout:6/410: creat d0/d5/d12/d1b/d33/f7e x:0 0 0 2023-12-16T03:15:54.656 INFO:tasks.workunit.client.1.smithi184.stdout:5/260: link d1/d3/fd d1/d3/d9/d49/f55 0 2023-12-16T03:15:54.661 INFO:tasks.workunit.client.1.smithi184.stdout:4/277: link d1/d11/d1b/c36 d1/d11/d1b/d1e/c5f 0 2023-12-16T03:15:54.666 INFO:tasks.workunit.client.1.smithi184.stdout:9/531: dwrite d0/f1f [4194304,4194304] 0 2023-12-16T03:15:54.667 INFO:tasks.workunit.client.1.smithi184.stdout:4/278: dread d1/d11/f23 [0,4194304] 0 2023-12-16T03:15:54.667 INFO:tasks.workunit.client.1.smithi184.stdout:4/279: chown d1/d12/l19 115 1 2023-12-16T03:15:54.671 INFO:tasks.workunit.client.0.smithi064.stdout:0/49: dwrite d2/f3 [0,4194304] 0 2023-12-16T03:15:54.671 INFO:tasks.workunit.client.0.smithi064.stdout:0/50: chown d2/d7/cd 191111996 1 2023-12-16T03:15:54.672 INFO:tasks.workunit.client.0.smithi064.stdout:0/51: chown d2/d8 784158342 1 2023-12-16T03:15:54.672 INFO:tasks.workunit.client.0.smithi064.stdout:0/52: chown d2/d8 489516 1 2023-12-16T03:15:54.673 INFO:tasks.workunit.client.1.smithi184.stdout:4/280: creat d1/d11/d5a/f60 x:0 0 0 2023-12-16T03:15:54.678 INFO:tasks.workunit.client.1.smithi184.stdout:4/281: read d1/d12/f3e [2744765,121301] 0 2023-12-16T03:15:54.680 INFO:tasks.workunit.client.1.smithi184.stdout:4/282: link d1/d12/d13/l47 d1/d11/l61 0 2023-12-16T03:15:54.681 INFO:tasks.workunit.client.1.smithi184.stdout:4/283: truncate d1/f54 254636 0 2023-12-16T03:15:54.681 INFO:tasks.workunit.client.0.smithi064.stdout:9/46: dread d2/f7 [0,4194304] 0 2023-12-16T03:15:54.683 INFO:tasks.workunit.client.1.smithi184.stdout:4/284: write d1/f8 [672098,67448] 0 2023-12-16T03:15:54.684 INFO:tasks.workunit.client.1.smithi184.stdout:4/285: write d1/d29/d34/f3d [1190911,33990] 0 2023-12-16T03:15:54.685 INFO:tasks.workunit.client.0.smithi064.stdout:9/47: creat d2/f9 x:0 0 0 2023-12-16T03:15:54.686 INFO:tasks.workunit.client.1.smithi184.stdout:4/286: mknod d1/d11/d1b/d1e/c62 0 2023-12-16T03:15:54.687 INFO:tasks.workunit.client.1.smithi184.stdout:4/287: stat d1/l14 0 2023-12-16T03:15:54.689 INFO:tasks.workunit.client.1.smithi184.stdout:4/288: mkdir d1/d11/d5a/d63 0 2023-12-16T03:15:54.689 INFO:tasks.workunit.client.1.smithi184.stdout:4/289: chown d1/d12/l55 58636319 1 2023-12-16T03:15:54.698 INFO:tasks.workunit.client.0.smithi064.stdout:8/91: dwrite d0/db/d12/f15 [0,4194304] 0 2023-12-16T03:15:54.701 INFO:tasks.workunit.client.0.smithi064.stdout:8/92: creat d0/db/d12/d1c/f1f x:0 0 0 2023-12-16T03:15:54.701 INFO:tasks.workunit.client.0.smithi064.stdout:9/48: dread d2/f7 [0,4194304] 0 2023-12-16T03:15:54.701 INFO:tasks.workunit.client.0.smithi064.stdout:9/49: write d2/f9 [1000988,66013] 0 2023-12-16T03:15:54.701 INFO:tasks.workunit.client.0.smithi064.stdout:8/93: creat d0/d1d/f20 x:0 0 0 2023-12-16T03:15:54.702 INFO:tasks.workunit.client.0.smithi064.stdout:9/50: creat d2/fa x:0 0 0 2023-12-16T03:15:54.703 INFO:tasks.workunit.client.0.smithi064.stdout:8/94: creat d0/db/d12/f21 x:0 0 0 2023-12-16T03:15:54.703 INFO:tasks.workunit.client.0.smithi064.stdout:9/51: truncate d2/f7 1165075 0 2023-12-16T03:15:54.704 INFO:tasks.workunit.client.0.smithi064.stdout:8/95: creat d0/db/f22 x:0 0 0 2023-12-16T03:15:54.705 INFO:tasks.workunit.client.0.smithi064.stdout:9/52: creat d2/fb x:0 0 0 2023-12-16T03:15:54.705 INFO:tasks.workunit.client.0.smithi064.stdout:9/53: chown d2/fb 182 1 2023-12-16T03:15:54.706 INFO:tasks.workunit.client.0.smithi064.stdout:8/96: truncate d0/f3 2171206 0 2023-12-16T03:15:54.706 INFO:tasks.workunit.client.0.smithi064.stdout:8/97: chown d0/f2 729 1 2023-12-16T03:15:54.707 INFO:tasks.workunit.client.0.smithi064.stdout:9/54: mkdir d2/dc 0 2023-12-16T03:15:54.707 INFO:tasks.workunit.client.0.smithi064.stdout:9/55: dread - d2/fb zero size 2023-12-16T03:15:54.707 INFO:tasks.workunit.client.0.smithi064.stdout:9/56: truncate d2/fa 942213 0 2023-12-16T03:15:54.707 INFO:tasks.workunit.client.1.smithi184.stdout:5/261: dwrite d1/d3/d9/de/d15/d19/f2c [0,4194304] 0 2023-12-16T03:15:54.708 INFO:tasks.workunit.client.0.smithi064.stdout:8/98: link d0/db/d12/f15 d0/da/f23 0 2023-12-16T03:15:54.709 INFO:tasks.workunit.client.0.smithi064.stdout:9/57: symlink d2/ld 0 2023-12-16T03:15:54.710 INFO:tasks.workunit.client.0.smithi064.stdout:5/84: dwrite d0/de/ff [0,4194304] 0 2023-12-16T03:15:54.710 INFO:tasks.workunit.client.1.smithi184.stdout:6/411: dwrite d0/d5/d26/f62 [0,4194304] 0 2023-12-16T03:15:54.710 INFO:tasks.workunit.client.1.smithi184.stdout:9/532: dwrite d0/d13/d20/d5b/d53/f81 [0,4194304] 0 2023-12-16T03:15:54.710 INFO:tasks.workunit.client.1.smithi184.stdout:6/412: chown d0/d5/d12 72169 1 2023-12-16T03:15:54.710 INFO:tasks.workunit.client.1.smithi184.stdout:9/533: chown d0/d13/d6e/d84/l4e 23 1 2023-12-16T03:15:54.711 INFO:tasks.workunit.client.1.smithi184.stdout:5/262: symlink d1/d3/d9/de/d15/d19/d3a/l56 0 2023-12-16T03:15:54.711 INFO:tasks.workunit.client.1.smithi184.stdout:5/263: fsync d1/d3/d9/de/d15/f1e 0 2023-12-16T03:15:54.712 INFO:tasks.workunit.client.0.smithi064.stdout:0/53: dwrite f1 [0,4194304] 0 2023-12-16T03:15:54.713 INFO:tasks.workunit.client.0.smithi064.stdout:0/54: write d2/f5 [3904844,45925] 0 2023-12-16T03:15:54.713 INFO:tasks.workunit.client.0.smithi064.stdout:8/99: rename d0/da/df to d0/d1d/d24 0 2023-12-16T03:15:54.713 INFO:tasks.workunit.client.1.smithi184.stdout:5/264: link d1/d3/d9/de/d15/d19/d3a/d3f/f4f d1/d3/d9/de/d15/f57 0 2023-12-16T03:15:54.713 INFO:tasks.workunit.client.1.smithi184.stdout:5/265: chown d1/d3/d9/de/d15/d19 258275 1 2023-12-16T03:15:54.714 INFO:tasks.workunit.client.0.smithi064.stdout:0/55: read f1 [8067537,60488] 0 2023-12-16T03:15:54.714 INFO:tasks.workunit.client.1.smithi184.stdout:5/266: mkdir d1/d2a/d31/d58 0 2023-12-16T03:15:54.715 INFO:tasks.workunit.client.0.smithi064.stdout:9/58: mknod d2/ce 0 2023-12-16T03:15:54.721 INFO:tasks.workunit.client.0.smithi064.stdout:5/85: getdents d0/de 0 2023-12-16T03:15:54.721 INFO:tasks.workunit.client.0.smithi064.stdout:8/100: mknod d0/da/c25 0 2023-12-16T03:15:54.724 INFO:tasks.workunit.client.0.smithi064.stdout:2/58: sync 2023-12-16T03:15:54.725 INFO:tasks.workunit.client.1.smithi184.stdout:4/290: rmdir d1/d11/d1b/d1e 39 2023-12-16T03:15:54.725 INFO:tasks.workunit.client.1.smithi184.stdout:5/267: symlink d1/d2a/d31/l59 0 2023-12-16T03:15:54.725 INFO:tasks.workunit.client.1.smithi184.stdout:4/291: truncate d1/f8 2140062 0 2023-12-16T03:15:54.725 INFO:tasks.workunit.client.1.smithi184.stdout:5/268: getdents d1/d2a/d31/d28 0 2023-12-16T03:15:54.725 INFO:tasks.workunit.client.1.smithi184.stdout:5/269: readlink d1/d3/d9/l47 0 2023-12-16T03:15:54.726 INFO:tasks.workunit.client.1.smithi184.stdout:5/270: symlink d1/d3/l5a 0 2023-12-16T03:15:54.726 INFO:tasks.workunit.client.1.smithi184.stdout:5/271: write d1/d3/d9/f40 [1793716,87136] 0 2023-12-16T03:15:54.726 INFO:tasks.workunit.client.1.smithi184.stdout:5/272: chown d1/d3/d9/de/f37 275837 1 2023-12-16T03:15:54.726 INFO:tasks.workunit.client.0.smithi064.stdout:9/59: rename d2/f9 to d2/dc/ff 0 2023-12-16T03:15:54.728 INFO:tasks.workunit.client.0.smithi064.stdout:9/60: symlink d2/dc/l10 0 2023-12-16T03:15:54.728 INFO:tasks.workunit.client.0.smithi064.stdout:9/61: readlink l0 0 2023-12-16T03:15:54.730 INFO:tasks.workunit.client.0.smithi064.stdout:2/59: write d1/f9 [653268,66337] 0 2023-12-16T03:15:54.730 INFO:tasks.workunit.client.0.smithi064.stdout:2/60: dread - d1/fa zero size 2023-12-16T03:15:54.734 INFO:tasks.workunit.client.0.smithi064.stdout:2/61: dread d1/f6 [0,4194304] 0 2023-12-16T03:15:54.734 INFO:tasks.workunit.client.0.smithi064.stdout:2/62: chown d1/f9 1030 1 2023-12-16T03:15:54.734 INFO:tasks.workunit.client.1.smithi184.stdout:0/474: sync 2023-12-16T03:15:54.734 INFO:tasks.workunit.client.1.smithi184.stdout:1/379: sync 2023-12-16T03:15:54.734 INFO:tasks.workunit.client.1.smithi184.stdout:3/421: sync 2023-12-16T03:15:54.734 INFO:tasks.workunit.client.1.smithi184.stdout:0/475: write dc/d10/f14 [3679302,111234] 0 2023-12-16T03:15:54.736 INFO:tasks.workunit.client.0.smithi064.stdout:8/101: dread d0/f7 [4194304,4194304] 0 2023-12-16T03:15:54.737 INFO:tasks.workunit.client.1.smithi184.stdout:1/380: symlink d3/d28/d3c/l80 0 2023-12-16T03:15:54.737 INFO:tasks.workunit.client.1.smithi184.stdout:1/381: getdents d3/d28/d3c/d24 0 2023-12-16T03:15:54.737 INFO:tasks.workunit.client.0.smithi064.stdout:0/56: truncate f1 2521607 0 2023-12-16T03:15:54.738 INFO:tasks.workunit.client.1.smithi184.stdout:3/422: mknod d12/d18/d1f/d23/d2a/ca6 0 2023-12-16T03:15:54.738 INFO:tasks.workunit.client.0.smithi064.stdout:8/102: symlink d0/da/l26 0 2023-12-16T03:15:54.739 INFO:tasks.workunit.client.1.smithi184.stdout:0/476: fdatasync dc/f19 0 2023-12-16T03:15:54.739 INFO:tasks.workunit.client.1.smithi184.stdout:1/382: creat d3/d13/d2c/f81 x:0 0 0 2023-12-16T03:15:54.741 INFO:tasks.workunit.client.1.smithi184.stdout:0/477: mknod dc/d22/d1d/d43/d5a/d60/c9b 0 2023-12-16T03:15:54.741 INFO:tasks.workunit.client.0.smithi064.stdout:8/103: link d0/f3 d0/f27 0 2023-12-16T03:15:54.742 INFO:tasks.workunit.client.1.smithi184.stdout:6/413: dwrite d0/d5/d12/d1b/d33/f58 [0,4194304] 0 2023-12-16T03:15:54.742 INFO:tasks.workunit.client.1.smithi184.stdout:5/273: dread d1/d3/d9/de/d15/d19/f23 [0,4194304] 0 2023-12-16T03:15:54.742 INFO:tasks.workunit.client.1.smithi184.stdout:6/414: read d0/d5/d22/d25/d47/f6e [118190,29303] 0 2023-12-16T03:15:54.743 INFO:tasks.workunit.client.1.smithi184.stdout:1/383: symlink d3/d28/d3c/d41/d46/l82 0 2023-12-16T03:15:54.743 INFO:tasks.workunit.client.1.smithi184.stdout:1/384: fsync d3/d28/d3c/f33 0 2023-12-16T03:15:54.744 INFO:tasks.workunit.client.1.smithi184.stdout:1/385: chown d3/d28/l54 1 1 2023-12-16T03:15:54.744 INFO:tasks.workunit.client.0.smithi064.stdout:0/57: truncate d2/f5 3696822 0 2023-12-16T03:15:54.747 INFO:tasks.workunit.client.1.smithi184.stdout:4/292: dread d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:54.751 INFO:tasks.workunit.client.1.smithi184.stdout:1/386: mknod d3/c83 0 2023-12-16T03:15:54.751 INFO:tasks.workunit.client.1.smithi184.stdout:0/478: write dc/d22/d48/f5b [2533533,47045] 0 2023-12-16T03:15:54.757 INFO:tasks.workunit.client.1.smithi184.stdout:1/387: symlink d3/l84 0 2023-12-16T03:15:54.757 INFO:tasks.workunit.client.1.smithi184.stdout:0/479: mknod dc/d22/d1d/d43/d5a/c9c 0 2023-12-16T03:15:54.757 INFO:tasks.workunit.client.1.smithi184.stdout:1/388: readlink d3/d28/d3c/d41/d46/d4a/l74 0 2023-12-16T03:15:54.757 INFO:tasks.workunit.client.1.smithi184.stdout:0/480: truncate dc/d22/d53/f95 1005995 0 2023-12-16T03:15:54.758 INFO:tasks.workunit.client.1.smithi184.stdout:0/481: readlink dc/d10/l34 0 2023-12-16T03:15:54.758 INFO:tasks.workunit.client.1.smithi184.stdout:0/482: stat dc/d22/d1d/d43/d5a/f89 0 2023-12-16T03:15:54.758 INFO:tasks.workunit.client.0.smithi064.stdout:5/86: dwrite d0/f3 [0,4194304] 0 2023-12-16T03:15:54.759 INFO:tasks.workunit.client.0.smithi064.stdout:5/87: read - d0/d7/f1e zero size 2023-12-16T03:15:54.761 INFO:tasks.workunit.client.0.smithi064.stdout:5/88: mkdir d0/d14/d20 0 2023-12-16T03:15:54.764 INFO:tasks.workunit.client.1.smithi184.stdout:0/483: readlink dc/d22/l1f 0 2023-12-16T03:15:54.764 INFO:tasks.workunit.client.1.smithi184.stdout:1/389: rmdir d3/d28/d38 39 2023-12-16T03:15:54.764 INFO:tasks.workunit.client.1.smithi184.stdout:1/390: stat d3/d28/d3c/f25 0 2023-12-16T03:15:54.765 INFO:tasks.workunit.client.0.smithi064.stdout:8/104: dread d0/da/f23 [0,4194304] 0 2023-12-16T03:15:54.765 INFO:tasks.workunit.client.1.smithi184.stdout:4/293: dread d1/f28 [0,4194304] 0 2023-12-16T03:15:54.765 INFO:tasks.workunit.client.1.smithi184.stdout:4/294: read - d1/d11/d1b/d1e/f5d zero size 2023-12-16T03:15:54.766 INFO:tasks.workunit.client.0.smithi064.stdout:5/89: link d0/cd d0/de/c21 0 2023-12-16T03:15:54.766 INFO:tasks.workunit.client.0.smithi064.stdout:5/90: fdatasync d0/d19/f1c 0 2023-12-16T03:15:54.766 INFO:tasks.workunit.client.0.smithi064.stdout:5/91: read - d0/d19/f1c zero size 2023-12-16T03:15:54.767 INFO:tasks.workunit.client.1.smithi184.stdout:0/484: creat dc/d10/d2d/d5f/d7a/f9d x:0 0 0 2023-12-16T03:15:54.767 INFO:tasks.workunit.client.1.smithi184.stdout:1/391: creat d3/d34/d76/f85 x:0 0 0 2023-12-16T03:15:54.768 INFO:tasks.workunit.client.0.smithi064.stdout:8/105: mknod d0/da/d16/c28 0 2023-12-16T03:15:54.768 INFO:tasks.workunit.client.0.smithi064.stdout:8/106: stat d0/db/d12/d1c 0 2023-12-16T03:15:54.768 INFO:tasks.workunit.client.1.smithi184.stdout:4/295: dread d1/d12/d13/f22 [0,4194304] 0 2023-12-16T03:15:54.768 INFO:tasks.workunit.client.1.smithi184.stdout:4/296: truncate d1/f54 533204 0 2023-12-16T03:15:54.769 INFO:tasks.workunit.client.0.smithi064.stdout:8/107: rmdir d0/d1d 39 2023-12-16T03:15:54.769 INFO:tasks.workunit.client.1.smithi184.stdout:0/485: rename dc/d22/d1d/f40 to dc/d22/d46/f9e 0 2023-12-16T03:15:54.769 INFO:tasks.workunit.client.1.smithi184.stdout:1/392: dread d3/d28/d3c/d41/f4b [0,4194304] 0 2023-12-16T03:15:54.769 INFO:tasks.workunit.client.1.smithi184.stdout:1/393: dread - d3/d34/d76/f85 zero size 2023-12-16T03:15:54.769 INFO:tasks.workunit.client.1.smithi184.stdout:4/297: symlink d1/d12/d27/d42/l64 0 2023-12-16T03:15:54.770 INFO:tasks.workunit.client.0.smithi064.stdout:8/108: symlink d0/db/d12/d1c/l29 0 2023-12-16T03:15:54.770 INFO:tasks.workunit.client.0.smithi064.stdout:2/63: dread d1/f4 [0,4194304] 0 2023-12-16T03:15:54.770 INFO:tasks.workunit.client.0.smithi064.stdout:2/64: dread - d1/fa zero size 2023-12-16T03:15:54.770 INFO:tasks.workunit.client.1.smithi184.stdout:1/394: creat d3/d28/d38/f86 x:0 0 0 2023-12-16T03:15:54.771 INFO:tasks.workunit.client.1.smithi184.stdout:0/486: read dc/d22/d1d/d43/f55 [380858,74487] 0 2023-12-16T03:15:54.771 INFO:tasks.workunit.client.1.smithi184.stdout:4/298: creat d1/d12/d27/d33/f65 x:0 0 0 2023-12-16T03:15:54.771 INFO:tasks.workunit.client.1.smithi184.stdout:4/299: chown d1/fd 175987 1 2023-12-16T03:15:54.772 INFO:tasks.workunit.client.1.smithi184.stdout:4/300: readlink d1/d11/d1b/l30 0 2023-12-16T03:15:54.773 INFO:tasks.workunit.client.1.smithi184.stdout:1/395: unlink d3/d28/d3c/f35 0 2023-12-16T03:15:54.773 INFO:tasks.workunit.client.1.smithi184.stdout:1/396: chown d3/d34/d39/l7f 57 1 2023-12-16T03:15:54.777 INFO:tasks.workunit.client.1.smithi184.stdout:0/487: getdents dc/d10/d2d 0 2023-12-16T03:15:54.777 INFO:tasks.workunit.client.1.smithi184.stdout:4/301: rmdir d1/d11/d58 0 2023-12-16T03:15:54.777 INFO:tasks.workunit.client.1.smithi184.stdout:5/274: dwrite d1/d3/d9/f2d [0,4194304] 0 2023-12-16T03:15:54.777 INFO:tasks.workunit.client.1.smithi184.stdout:4/302: mknod d1/d12/d13/d40/d43/d45/c66 0 2023-12-16T03:15:54.778 INFO:tasks.workunit.client.0.smithi064.stdout:9/62: dwrite f1 [0,4194304] 0 2023-12-16T03:15:54.778 INFO:tasks.workunit.client.0.smithi064.stdout:9/63: write d2/f8 [3930304,87801] 0 2023-12-16T03:15:54.778 INFO:tasks.workunit.client.0.smithi064.stdout:9/64: dread - d2/fb zero size 2023-12-16T03:15:54.778 INFO:tasks.workunit.client.0.smithi064.stdout:9/65: write d2/fa [408648,105140] 0 2023-12-16T03:15:54.778 INFO:tasks.workunit.client.0.smithi064.stdout:9/66: write f1 [4489632,17539] 0 2023-12-16T03:15:54.778 INFO:tasks.workunit.client.0.smithi064.stdout:2/65: dread d1/f4 [0,4194304] 0 2023-12-16T03:15:54.778 INFO:tasks.workunit.client.0.smithi064.stdout:2/66: truncate d1/fa 171301 0 2023-12-16T03:15:54.779 INFO:tasks.workunit.client.1.smithi184.stdout:4/303: dread d1/d11/d1b/d1e/f41 [0,4194304] 0 2023-12-16T03:15:54.781 INFO:tasks.workunit.client.1.smithi184.stdout:6/415: dwrite d0/f18 [0,4194304] 0 2023-12-16T03:15:54.781 INFO:tasks.workunit.client.1.smithi184.stdout:5/275: link d1/d3/c44 d1/d3/d2f/c5b 0 2023-12-16T03:15:54.781 INFO:tasks.workunit.client.1.smithi184.stdout:6/416: chown d0/d5/d22/cd 0 1 2023-12-16T03:15:54.781 INFO:tasks.workunit.client.1.smithi184.stdout:5/276: write d1/d3/d9/de/d15/f52 [308179,35784] 0 2023-12-16T03:15:54.781 INFO:tasks.workunit.client.1.smithi184.stdout:0/488: dread dc/d10/d2d/f50 [0,4194304] 0 2023-12-16T03:15:54.781 INFO:tasks.workunit.client.1.smithi184.stdout:0/489: dread - dc/d22/d1d/d35/f65 zero size 2023-12-16T03:15:54.781 INFO:tasks.workunit.client.1.smithi184.stdout:0/490: fdatasync dc/d10/f11 0 2023-12-16T03:15:54.782 INFO:tasks.workunit.client.1.smithi184.stdout:4/304: getdents d1/d12/d27/d33/d4a 0 2023-12-16T03:15:54.783 INFO:tasks.workunit.client.1.smithi184.stdout:6/417: symlink d0/d5/d12/d1b/d33/l7f 0 2023-12-16T03:15:54.783 INFO:tasks.workunit.client.1.smithi184.stdout:0/491: creat dc/d10/d2d/d5f/d7a/f9f x:0 0 0 2023-12-16T03:15:54.784 INFO:tasks.workunit.client.1.smithi184.stdout:0/492: write dc/d10/f14 [1163457,123111] 0 2023-12-16T03:15:54.784 INFO:tasks.workunit.client.1.smithi184.stdout:4/305: mknod d1/d12/d13/d40/c67 0 2023-12-16T03:15:54.785 INFO:tasks.workunit.client.1.smithi184.stdout:6/418: creat d0/d5/d42/f80 x:0 0 0 2023-12-16T03:15:54.786 INFO:tasks.workunit.client.0.smithi064.stdout:9/67: write d2/f7 [985608,14700] 0 2023-12-16T03:15:54.786 INFO:tasks.workunit.client.0.smithi064.stdout:1/73: sync 2023-12-16T03:15:54.786 INFO:tasks.workunit.client.1.smithi184.stdout:3/423: dwrite d12/d18/d68/f69 [0,4194304] 0 2023-12-16T03:15:54.786 INFO:tasks.workunit.client.1.smithi184.stdout:3/424: chown d12/d18/d1f/d23/d2a/d42/d52/d76/d80/c40 2 1 2023-12-16T03:15:54.787 INFO:tasks.workunit.client.1.smithi184.stdout:0/493: rmdir dc/d22/d1d/d8e 39 2023-12-16T03:15:54.787 INFO:tasks.workunit.client.0.smithi064.stdout:9/68: creat d2/dc/f11 x:0 0 0 2023-12-16T03:15:54.789 INFO:tasks.workunit.client.1.smithi184.stdout:4/306: truncate d1/d29/f2e 36567 0 2023-12-16T03:15:54.791 INFO:tasks.workunit.client.0.smithi064.stdout:1/74: rename d3/dd/ff to d3/f1b 0 2023-12-16T03:15:54.791 INFO:tasks.workunit.client.0.smithi064.stdout:1/75: truncate f2 813294 0 2023-12-16T03:15:54.792 INFO:tasks.workunit.client.1.smithi184.stdout:1/397: dwrite d3/d28/d3c/d41/d77/f78 [0,4194304] 0 2023-12-16T03:15:54.792 INFO:tasks.workunit.client.1.smithi184.stdout:1/398: read - d3/d28/d3c/d41/d46/d4a/d6a/f72 zero size 2023-12-16T03:15:54.792 INFO:tasks.workunit.client.1.smithi184.stdout:6/419: creat d0/d5/d22/d25/d3f/f81 x:0 0 0 2023-12-16T03:15:54.793 INFO:tasks.workunit.client.0.smithi064.stdout:8/109: getdents d0/db/d12/d1c 0 2023-12-16T03:15:54.793 INFO:tasks.workunit.client.0.smithi064.stdout:8/110: write d0/f14 [3094429,13244] 0 2023-12-16T03:15:54.793 INFO:tasks.workunit.client.0.smithi064.stdout:8/111: write d0/db/f22 [1020825,83434] 0 2023-12-16T03:15:54.796 INFO:tasks.workunit.client.1.smithi184.stdout:3/425: creat d12/d1e/da3/fa7 x:0 0 0 2023-12-16T03:15:54.796 INFO:tasks.workunit.client.0.smithi064.stdout:9/69: unlink d2/f7 0 2023-12-16T03:15:54.796 INFO:tasks.workunit.client.0.smithi064.stdout:5/92: dread d0/d7/f1d [0,4194304] 0 2023-12-16T03:15:54.797 INFO:tasks.workunit.client.1.smithi184.stdout:4/307: symlink d1/d12/d13/l68 0 2023-12-16T03:15:54.797 INFO:tasks.workunit.client.1.smithi184.stdout:4/308: dread - d1/d12/d27/f32 zero size 2023-12-16T03:15:54.797 INFO:tasks.workunit.client.1.smithi184.stdout:4/309: truncate d1/d11/d1b/d1e/f41 2655553 0 2023-12-16T03:15:54.797 INFO:tasks.workunit.client.1.smithi184.stdout:4/310: getdents d1/d29/d34/d5c 0 2023-12-16T03:15:54.797 INFO:tasks.workunit.client.0.smithi064.stdout:1/76: mknod d3/dd/d11/c1c 0 2023-12-16T03:15:54.799 INFO:tasks.workunit.client.1.smithi184.stdout:5/277: dread d1/d3/d9/de/d15/f57 [0,4194304] 0 2023-12-16T03:15:54.799 INFO:tasks.workunit.client.0.smithi064.stdout:8/112: rename d0/da/d16/c28 to d0/da/d16/c2a 0 2023-12-16T03:15:54.799 INFO:tasks.workunit.client.0.smithi064.stdout:8/113: chown d0/da/d16/d18 6936 1 2023-12-16T03:15:54.801 INFO:tasks.workunit.client.1.smithi184.stdout:1/399: creat d3/d28/f87 x:0 0 0 2023-12-16T03:15:54.801 INFO:tasks.workunit.client.1.smithi184.stdout:1/400: fdatasync d3/d28/d3c/d41/d63/f7e 0 2023-12-16T03:15:54.802 INFO:tasks.workunit.client.0.smithi064.stdout:1/77: dread d3/f6 [0,4194304] 0 2023-12-16T03:15:54.802 INFO:tasks.workunit.client.0.smithi064.stdout:1/78: write d3/fe [142998,62206] 0 2023-12-16T03:15:54.802 INFO:tasks.workunit.client.0.smithi064.stdout:1/79: stat d3/dd/d11/l15 0 2023-12-16T03:15:54.802 INFO:tasks.workunit.client.0.smithi064.stdout:5/93: link d0/d7/l18 d0/d14/d20/l22 0 2023-12-16T03:15:54.802 INFO:tasks.workunit.client.1.smithi184.stdout:6/420: creat d0/d5/d26/f82 x:0 0 0 2023-12-16T03:15:54.803 INFO:tasks.workunit.client.1.smithi184.stdout:6/421: readlink d0/d5/d22/d25/l6a 0 2023-12-16T03:15:54.803 INFO:tasks.workunit.client.1.smithi184.stdout:6/422: chown d0/d36/d79/f7c 820629733 1 2023-12-16T03:15:54.805 INFO:tasks.workunit.client.1.smithi184.stdout:3/426: symlink d12/d18/d68/la8 0 2023-12-16T03:15:54.806 INFO:tasks.workunit.client.0.smithi064.stdout:8/114: symlink d0/db/l2b 0 2023-12-16T03:15:54.807 INFO:tasks.workunit.client.0.smithi064.stdout:5/94: mkdir d0/de/d23 0 2023-12-16T03:15:54.809 INFO:tasks.workunit.client.0.smithi064.stdout:5/95: mknod d0/d14/c24 0 2023-12-16T03:15:54.809 INFO:tasks.workunit.client.1.smithi184.stdout:5/278: creat d1/d3/d9/d2e/f5c x:0 0 0 2023-12-16T03:15:54.810 INFO:tasks.workunit.client.1.smithi184.stdout:1/401: symlink d3/d28/d3c/d41/d46/l88 0 2023-12-16T03:15:54.811 INFO:tasks.workunit.client.0.smithi064.stdout:5/96: mkdir d0/d14/d25 0 2023-12-16T03:15:54.812 INFO:tasks.workunit.client.1.smithi184.stdout:6/423: symlink d0/d5/d12/d1b/d33/l83 0 2023-12-16T03:15:54.812 INFO:tasks.workunit.client.1.smithi184.stdout:6/424: readlink d0/d5/d12/d1b/d33/l7f 0 2023-12-16T03:15:54.812 INFO:tasks.workunit.client.1.smithi184.stdout:6/425: chown d0/d36/f55 73061 1 2023-12-16T03:15:54.813 INFO:tasks.workunit.client.1.smithi184.stdout:6/426: chown d0/d5/d22/d37/d4d 15226056 1 2023-12-16T03:15:54.814 INFO:tasks.workunit.client.1.smithi184.stdout:5/279: creat d1/d3/f5d x:0 0 0 2023-12-16T03:15:54.816 INFO:tasks.workunit.client.1.smithi184.stdout:1/402: mknod d3/d34/c89 0 2023-12-16T03:15:54.816 INFO:tasks.workunit.client.1.smithi184.stdout:1/403: read d3/d28/d36/f48 [697451,39948] 0 2023-12-16T03:15:54.816 INFO:tasks.workunit.client.1.smithi184.stdout:1/404: stat d3/d28/f44 0 2023-12-16T03:15:54.818 INFO:tasks.workunit.client.1.smithi184.stdout:6/427: symlink d0/d5/d22/d25/l84 0 2023-12-16T03:15:54.819 INFO:tasks.workunit.client.1.smithi184.stdout:5/280: symlink d1/d3/d9/l5e 0 2023-12-16T03:15:54.819 INFO:tasks.workunit.client.1.smithi184.stdout:5/281: read - d1/d3/d2f/f3d zero size 2023-12-16T03:15:54.821 INFO:tasks.workunit.client.1.smithi184.stdout:1/405: rmdir d3/d34/d76 39 2023-12-16T03:15:54.821 INFO:tasks.workunit.client.1.smithi184.stdout:1/406: stat d3/d28/d3c/l15 0 2023-12-16T03:15:54.822 INFO:tasks.workunit.client.1.smithi184.stdout:1/407: stat d3/d28/d3c/d41/d77/f78 0 2023-12-16T03:15:54.823 INFO:tasks.workunit.client.1.smithi184.stdout:6/428: mknod d0/d5/d22/d37/d40/c85 0 2023-12-16T03:15:54.826 INFO:tasks.workunit.client.1.smithi184.stdout:5/282: rename d1/d3/d9/de/d15/d19/d3a/d3f to d1/d3/d9/de/d15/d19/d5f 0 2023-12-16T03:15:54.826 INFO:tasks.workunit.client.1.smithi184.stdout:6/429: rename d0 to d0/d5/d26/d86 22 2023-12-16T03:15:54.826 INFO:tasks.workunit.client.1.smithi184.stdout:5/283: write d1/d2a/d31/f54 [331604,96560] 0 2023-12-16T03:15:54.827 INFO:tasks.workunit.client.1.smithi184.stdout:5/284: chown d1/d3/d9/de/d15/d19/d5f 34246285 1 2023-12-16T03:15:54.827 INFO:tasks.workunit.client.1.smithi184.stdout:5/285: chown d1/d3/l14 261512 1 2023-12-16T03:15:54.828 INFO:tasks.workunit.client.1.smithi184.stdout:1/408: write d3/d28/d3c/d41/d63/f64 [1751648,63992] 0 2023-12-16T03:15:54.828 INFO:tasks.workunit.client.1.smithi184.stdout:1/409: fsync d3/d28/d3c/f25 0 2023-12-16T03:15:54.828 INFO:tasks.workunit.client.1.smithi184.stdout:1/410: write d3/d34/d76/f85 [398423,48566] 0 2023-12-16T03:15:54.828 INFO:tasks.workunit.client.1.smithi184.stdout:5/286: write d1/d3/d9/de/d15/d19/d5f/f4f [3081218,124584] 0 2023-12-16T03:15:54.828 INFO:tasks.workunit.client.1.smithi184.stdout:6/430: mkdir d0/d5/d22/d37/d4d/d87 0 2023-12-16T03:15:54.828 INFO:tasks.workunit.client.0.smithi064.stdout:5/97: dread d0/de/ff [0,4194304] 0 2023-12-16T03:15:54.829 INFO:tasks.workunit.client.0.smithi064.stdout:5/98: creat d0/de/d23/f26 x:0 0 0 2023-12-16T03:15:54.830 INFO:tasks.workunit.client.0.smithi064.stdout:5/99: creat d0/d19/f27 x:0 0 0 2023-12-16T03:15:54.831 INFO:tasks.workunit.client.0.smithi064.stdout:5/100: symlink d0/d19/l28 0 2023-12-16T03:15:54.832 INFO:tasks.workunit.client.0.smithi064.stdout:5/101: write d0/d7/fa [212703,29385] 0 2023-12-16T03:15:54.832 INFO:tasks.workunit.client.0.smithi064.stdout:2/67: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:54.833 INFO:tasks.workunit.client.0.smithi064.stdout:2/68: write d1/f9 [421082,81485] 0 2023-12-16T03:15:54.834 INFO:tasks.workunit.client.1.smithi184.stdout:1/411: rename d3/d28/d3c/fe to d3/d28/d3c/d41/f8a 0 2023-12-16T03:15:54.834 INFO:tasks.workunit.client.1.smithi184.stdout:1/412: write d3/d28/d36/f48 [999338,85967] 0 2023-12-16T03:15:54.835 INFO:tasks.workunit.client.1.smithi184.stdout:1/413: write d3/d28/d3c/d24/f43 [1109024,94738] 0 2023-12-16T03:15:54.835 INFO:tasks.workunit.client.1.smithi184.stdout:1/414: readlink d3/d28/d38/d52/l5c 0 2023-12-16T03:15:54.835 INFO:tasks.workunit.client.0.smithi064.stdout:2/69: creat d1/fd x:0 0 0 2023-12-16T03:15:54.835 INFO:tasks.workunit.client.0.smithi064.stdout:2/70: dread - d1/fd zero size 2023-12-16T03:15:54.837 INFO:tasks.workunit.client.0.smithi064.stdout:2/71: link d1/lb d1/le 0 2023-12-16T03:15:54.837 INFO:tasks.workunit.client.0.smithi064.stdout:2/72: chown d1/f4 247615 1 2023-12-16T03:15:54.837 INFO:tasks.workunit.client.1.smithi184.stdout:5/287: unlink d1/d3/d9/de/c3e 0 2023-12-16T03:15:54.839 INFO:tasks.workunit.client.0.smithi064.stdout:2/73: mknod d1/cf 0 2023-12-16T03:15:54.839 INFO:tasks.workunit.client.0.smithi064.stdout:2/74: truncate d1/f6 994060 0 2023-12-16T03:15:54.845 INFO:tasks.workunit.client.1.smithi184.stdout:0/494: dwrite dc/d22/d46/f67 [0,4194304] 0 2023-12-16T03:15:54.848 INFO:tasks.workunit.client.1.smithi184.stdout:3/427: dwrite d12/d18/d7a/f8f [0,4194304] 0 2023-12-16T03:15:54.849 INFO:tasks.workunit.client.1.smithi184.stdout:3/428: stat d12/d18/d1f/d23/d2a/d4a/d61/f72 0 2023-12-16T03:15:54.849 INFO:tasks.workunit.client.0.smithi064.stdout:9/70: dwrite d2/fa [0,4194304] 0 2023-12-16T03:15:54.849 INFO:tasks.workunit.client.1.smithi184.stdout:0/495: mkdir dc/d10/d2d/d5f/d7a/da0 0 2023-12-16T03:15:54.851 INFO:tasks.workunit.client.0.smithi064.stdout:9/71: creat d2/dc/f12 x:0 0 0 2023-12-16T03:15:54.853 INFO:tasks.workunit.client.0.smithi064.stdout:9/72: link d2/dc/l10 d2/dc/l13 0 2023-12-16T03:15:54.853 INFO:tasks.workunit.client.1.smithi184.stdout:4/311: dwrite d1/d12/d27/d3b/f3f [0,4194304] 0 2023-12-16T03:15:54.854 INFO:tasks.workunit.client.0.smithi064.stdout:9/73: getdents d2 0 2023-12-16T03:15:54.861 INFO:tasks.workunit.client.0.smithi064.stdout:9/74: dread d2/dc/ff [0,4194304] 0 2023-12-16T03:15:54.861 INFO:tasks.workunit.client.0.smithi064.stdout:9/75: mknod d2/dc/c14 0 2023-12-16T03:15:54.861 INFO:tasks.workunit.client.0.smithi064.stdout:9/76: truncate d2/dc/f12 34363 0 2023-12-16T03:15:54.863 INFO:tasks.workunit.client.0.smithi064.stdout:1/80: dwrite d3/f13 [0,4194304] 0 2023-12-16T03:15:54.863 INFO:tasks.workunit.client.0.smithi064.stdout:1/81: truncate d3/dd/f1a 258553 0 2023-12-16T03:15:54.865 INFO:tasks.workunit.client.0.smithi064.stdout:8/115: dwrite d0/f3 [0,4194304] 0 2023-12-16T03:15:54.865 INFO:tasks.workunit.client.0.smithi064.stdout:8/116: chown d0/da/d16 59191 1 2023-12-16T03:15:54.866 INFO:tasks.workunit.client.0.smithi064.stdout:8/117: read d0/db/f22 [965858,123002] 0 2023-12-16T03:15:54.866 INFO:tasks.workunit.client.0.smithi064.stdout:9/77: dread d2/dc/f12 [0,4194304] 0 2023-12-16T03:15:54.867 INFO:tasks.workunit.client.0.smithi064.stdout:9/78: chown d2/dc/c14 1784609 1 2023-12-16T03:15:54.867 INFO:tasks.workunit.client.1.smithi184.stdout:0/496: write dc/f58 [4758143,101440] 0 2023-12-16T03:15:54.867 INFO:tasks.workunit.client.1.smithi184.stdout:3/429: dread d12/d37/f67 [0,4194304] 0 2023-12-16T03:15:54.867 INFO:tasks.workunit.client.1.smithi184.stdout:3/430: chown d12/d1e/l8a 0 1 2023-12-16T03:15:54.867 INFO:tasks.workunit.client.1.smithi184.stdout:3/431: chown d12/d18/d1f/c28 12924115 1 2023-12-16T03:15:54.867 INFO:tasks.workunit.client.1.smithi184.stdout:3/432: write d12/d18/d1f/d23/d2a/f2f [224524,41142] 0 2023-12-16T03:15:54.867 INFO:tasks.workunit.client.1.smithi184.stdout:3/433: fdatasync f8 0 2023-12-16T03:15:54.868 INFO:tasks.workunit.client.0.smithi064.stdout:2/75: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:54.869 INFO:tasks.workunit.client.1.smithi184.stdout:1/415: dwrite d3/d28/d3c/d41/d63/f7e [0,4194304] 0 2023-12-16T03:15:54.869 INFO:tasks.workunit.client.1.smithi184.stdout:1/416: chown d3/d28/d3c/d41/f4d 84816 1 2023-12-16T03:15:54.869 INFO:tasks.workunit.client.1.smithi184.stdout:1/417: stat d3/d28/d3c/d41/d46 0 2023-12-16T03:15:54.869 INFO:tasks.workunit.client.1.smithi184.stdout:5/288: dwrite d1/d3/d9/de/f37 [0,4194304] 0 2023-12-16T03:15:54.870 INFO:tasks.workunit.client.1.smithi184.stdout:3/434: write d12/d18/d1f/d23/d2a/d36/f5b [126927,44381] 0 2023-12-16T03:15:54.870 INFO:tasks.workunit.client.1.smithi184.stdout:3/435: chown d12/d1e/da3/fa7 713794811 1 2023-12-16T03:15:54.870 INFO:tasks.workunit.client.1.smithi184.stdout:3/436: chown d12/d18/d1f/d23/d2a/d42/d52/f58 9841 1 2023-12-16T03:15:54.874 INFO:tasks.workunit.client.1.smithi184.stdout:0/497: symlink dc/d22/d1d/d2c/d75/la1 0 2023-12-16T03:15:54.875 INFO:tasks.workunit.client.0.smithi064.stdout:5/102: rmdir d0/d19 39 2023-12-16T03:15:54.877 INFO:tasks.workunit.client.0.smithi064.stdout:5/103: mkdir d0/d14/d20/d29 0 2023-12-16T03:15:54.879 INFO:tasks.workunit.client.0.smithi064.stdout:5/104: rmdir d0/d14/d20 39 2023-12-16T03:15:54.880 INFO:tasks.workunit.client.0.smithi064.stdout:5/105: mkdir d0/d14/d20/d29/d2a 0 2023-12-16T03:15:54.880 INFO:tasks.workunit.client.0.smithi064.stdout:5/106: dread - d0/d19/f27 zero size 2023-12-16T03:15:54.881 INFO:tasks.workunit.client.0.smithi064.stdout:2/76: write d1/f4 [2688798,123960] 0 2023-12-16T03:15:54.881 INFO:tasks.workunit.client.0.smithi064.stdout:2/77: write d1/f6 [1207955,99691] 0 2023-12-16T03:15:54.881 INFO:tasks.workunit.client.0.smithi064.stdout:2/78: readlink d1/lb 0 2023-12-16T03:15:54.882 INFO:tasks.workunit.client.0.smithi064.stdout:5/107: getdents d0 0 2023-12-16T03:15:54.882 INFO:tasks.workunit.client.0.smithi064.stdout:5/108: dread - d0/f17 zero size 2023-12-16T03:15:54.882 INFO:tasks.workunit.client.0.smithi064.stdout:8/118: dread d0/da/fc [0,4194304] 0 2023-12-16T03:15:54.883 INFO:tasks.workunit.client.1.smithi184.stdout:5/289: symlink d1/d3/l60 0 2023-12-16T03:15:54.883 INFO:tasks.workunit.client.1.smithi184.stdout:5/290: fsync d1/d3/d9/f39 0 2023-12-16T03:15:54.885 INFO:tasks.workunit.client.1.smithi184.stdout:3/437: mkdir d12/d18/d1f/d23/d2a/d4a/d61/da9 0 2023-12-16T03:15:54.885 INFO:tasks.workunit.client.1.smithi184.stdout:4/312: dread d1/f51 [0,4194304] 0 2023-12-16T03:15:54.886 INFO:tasks.workunit.client.0.smithi064.stdout:2/79: link d1/fa d1/f10 0 2023-12-16T03:15:54.886 INFO:tasks.workunit.client.0.smithi064.stdout:5/109: symlink d0/l2b 0 2023-12-16T03:15:54.887 INFO:tasks.workunit.client.1.smithi184.stdout:0/498: rename dc/d22/d1d/d2c/l30 to dc/d10/d2d/d5f/la2 0 2023-12-16T03:15:54.888 INFO:tasks.workunit.client.1.smithi184.stdout:1/418: truncate d3/d13/d2c/f4c 4030585 0 2023-12-16T03:15:54.888 INFO:tasks.workunit.client.1.smithi184.stdout:1/419: dread - d3/d28/d3c/d41/f67 zero size 2023-12-16T03:15:54.888 INFO:tasks.workunit.client.0.smithi064.stdout:2/80: symlink d1/l11 0 2023-12-16T03:15:54.889 INFO:tasks.workunit.client.1.smithi184.stdout:4/313: creat d1/d12/d27/f69 x:0 0 0 2023-12-16T03:15:54.889 INFO:tasks.workunit.client.0.smithi064.stdout:8/119: dread d0/da/f23 [0,4194304] 0 2023-12-16T03:15:54.889 INFO:tasks.workunit.client.0.smithi064.stdout:1/82: dwrite d3/f6 [0,4194304] 0 2023-12-16T03:15:54.890 INFO:tasks.workunit.client.1.smithi184.stdout:3/438: rename d12/d18/d1f/d23/d2a/d3e/d48/c59 to d12/d18/d84/caa 0 2023-12-16T03:15:54.891 INFO:tasks.workunit.client.0.smithi064.stdout:2/81: mknod d1/c12 0 2023-12-16T03:15:54.895 INFO:tasks.workunit.client.1.smithi184.stdout:1/420: unlink d3/d28/d3c/d41/d46/d4a/d6a/f72 0 2023-12-16T03:15:54.895 INFO:tasks.workunit.client.0.smithi064.stdout:1/83: unlink d3/c4 0 2023-12-16T03:15:54.897 INFO:tasks.workunit.client.1.smithi184.stdout:4/314: mkdir d1/d12/d13/d40/d43/d5e/d6a 0 2023-12-16T03:15:54.897 INFO:tasks.workunit.client.1.smithi184.stdout:4/315: stat d1/d12/d27/d33/d4a/l50 0 2023-12-16T03:15:54.897 INFO:tasks.workunit.client.1.smithi184.stdout:4/316: fsync d1/fd 0 2023-12-16T03:15:54.897 INFO:tasks.workunit.client.0.smithi064.stdout:8/120: link d0/db/d12/l19 d0/da/l2c 0 2023-12-16T03:15:54.898 INFO:tasks.workunit.client.1.smithi184.stdout:0/499: rename dc/d10/d2d/d5f/d7a/d87 to dc/d22/d45/d66/d80/da3 0 2023-12-16T03:15:54.901 INFO:tasks.workunit.client.1.smithi184.stdout:0/500: creat dc/d22/d1d/d8e/fa4 x:0 0 0 2023-12-16T03:15:54.902 INFO:tasks.workunit.client.0.smithi064.stdout:2/82: rename d1/cc to d1/c13 0 2023-12-16T03:15:54.902 INFO:tasks.workunit.client.0.smithi064.stdout:7/63: sync 2023-12-16T03:15:54.903 INFO:tasks.workunit.client.0.smithi064.stdout:4/79: sync 2023-12-16T03:15:54.903 INFO:tasks.workunit.client.0.smithi064.stdout:7/64: write d7/fb [212458,2422] 0 2023-12-16T03:15:54.903 INFO:tasks.workunit.client.0.smithi064.stdout:7/65: chown c2 4 1 2023-12-16T03:15:54.904 INFO:tasks.workunit.client.0.smithi064.stdout:1/84: rename d3/f6 to d3/dd/f1d 0 2023-12-16T03:15:54.905 INFO:tasks.workunit.client.0.smithi064.stdout:2/83: creat d1/f14 x:0 0 0 2023-12-16T03:15:54.905 INFO:tasks.workunit.client.0.smithi064.stdout:3/115: sync 2023-12-16T03:15:54.905 INFO:tasks.workunit.client.0.smithi064.stdout:6/56: sync 2023-12-16T03:15:54.906 INFO:tasks.workunit.client.0.smithi064.stdout:6/57: write d3/d8/da/fe [373208,45001] 0 2023-12-16T03:15:54.906 INFO:tasks.workunit.client.0.smithi064.stdout:4/80: creat d0/d12/d17/f1a x:0 0 0 2023-12-16T03:15:54.906 INFO:tasks.workunit.client.0.smithi064.stdout:4/81: chown d0/da/f16 15806162 1 2023-12-16T03:15:54.906 INFO:tasks.workunit.client.0.smithi064.stdout:4/82: dread - d0/d12/d17/f1a zero size 2023-12-16T03:15:54.907 INFO:tasks.workunit.client.0.smithi064.stdout:7/66: mknod d7/c16 0 2023-12-16T03:15:54.907 INFO:tasks.workunit.client.0.smithi064.stdout:7/67: fdatasync d7/fa 0 2023-12-16T03:15:54.908 INFO:tasks.workunit.client.0.smithi064.stdout:5/110: rename d0/d19/c1b to d0/d14/d20/d29/d2a/c2c 0 2023-12-16T03:15:54.909 INFO:tasks.workunit.client.0.smithi064.stdout:1/85: mknod d3/dd/d11/c1e 0 2023-12-16T03:15:54.909 INFO:tasks.workunit.client.0.smithi064.stdout:1/86: fdatasync d3/fe 0 2023-12-16T03:15:54.909 INFO:tasks.workunit.client.0.smithi064.stdout:1/87: chown d3 131245849 1 2023-12-16T03:15:54.911 INFO:tasks.workunit.client.0.smithi064.stdout:8/121: truncate d0/f3 2533587 0 2023-12-16T03:15:54.911 INFO:tasks.workunit.client.0.smithi064.stdout:2/84: mkdir d1/d15 0 2023-12-16T03:15:54.911 INFO:tasks.workunit.client.0.smithi064.stdout:2/85: write d1/f14 [294192,17665] 0 2023-12-16T03:15:54.911 INFO:tasks.workunit.client.1.smithi184.stdout:3/439: dwrite d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f64 [0,4194304] 0 2023-12-16T03:15:54.912 INFO:tasks.workunit.client.1.smithi184.stdout:4/317: dwrite d1/f51 [0,4194304] 0 2023-12-16T03:15:54.913 INFO:tasks.workunit.client.0.smithi064.stdout:6/58: mknod d3/d8/da/c10 0 2023-12-16T03:15:54.914 INFO:tasks.workunit.client.1.smithi184.stdout:3/440: symlink d12/d1e/lab 0 2023-12-16T03:15:54.915 INFO:tasks.workunit.client.0.smithi064.stdout:4/83: symlink d0/d12/d17/l1b 0 2023-12-16T03:15:54.916 INFO:tasks.workunit.client.0.smithi064.stdout:3/116: rename db/f10 to db/d12/f29 0 2023-12-16T03:15:54.917 INFO:tasks.workunit.client.1.smithi184.stdout:4/318: creat d1/d11/d1b/d44/f6b x:0 0 0 2023-12-16T03:15:54.917 INFO:tasks.workunit.client.1.smithi184.stdout:4/319: fdatasync d1/d12/d13/f31 0 2023-12-16T03:15:54.917 INFO:tasks.workunit.client.1.smithi184.stdout:4/320: write d1/d12/d27/d3b/f53 [123940,53817] 0 2023-12-16T03:15:54.918 INFO:tasks.workunit.client.0.smithi064.stdout:5/111: fdatasync d0/f15 0 2023-12-16T03:15:54.918 INFO:tasks.workunit.client.1.smithi184.stdout:3/441: creat d12/d18/d1f/d23/d2a/d4a/d61/fac x:0 0 0 2023-12-16T03:15:54.919 INFO:tasks.workunit.client.1.smithi184.stdout:4/321: getdents d1/d12/d27/d3b 0 2023-12-16T03:15:54.919 INFO:tasks.workunit.client.0.smithi064.stdout:2/86: link c0 d1/c16 0 2023-12-16T03:15:54.920 INFO:tasks.workunit.client.0.smithi064.stdout:2/87: readlink d1/lb 0 2023-12-16T03:15:54.922 INFO:tasks.workunit.client.0.smithi064.stdout:7/68: rename l0 to d7/l17 0 2023-12-16T03:15:54.926 INFO:tasks.workunit.client.1.smithi184.stdout:3/442: write d12/d18/d1f/d23/d2a/d3e/d48/f70 [2834301,124277] 0 2023-12-16T03:15:54.926 INFO:tasks.workunit.client.1.smithi184.stdout:3/443: fsync d12/d18/d1f/d23/d2a/d42/d52/f6f 0 2023-12-16T03:15:54.926 INFO:tasks.workunit.client.1.smithi184.stdout:3/444: write d12/d1e/da3/fa7 [276427,7575] 0 2023-12-16T03:15:54.927 INFO:tasks.workunit.client.0.smithi064.stdout:3/117: symlink db/d12/d1a/l2a 0 2023-12-16T03:15:54.927 INFO:tasks.workunit.client.0.smithi064.stdout:5/112: dread - d0/d7/f1a zero size 2023-12-16T03:15:54.928 INFO:tasks.workunit.client.0.smithi064.stdout:7/69: rmdir d7/d13 39 2023-12-16T03:15:54.928 INFO:tasks.workunit.client.1.smithi184.stdout:3/445: rename d12/d18/d1f/d23/d51/c94 to d12/d37/cad 0 2023-12-16T03:15:54.930 INFO:tasks.workunit.client.0.smithi064.stdout:3/118: mkdir db/d12/d21/d2b 0 2023-12-16T03:15:54.930 INFO:tasks.workunit.client.0.smithi064.stdout:3/119: chown db/d12/d1a/l2a 0 1 2023-12-16T03:15:54.932 INFO:tasks.workunit.client.0.smithi064.stdout:5/113: getdents d0/d14/d20/d29 0 2023-12-16T03:15:54.934 INFO:tasks.workunit.client.1.smithi184.stdout:3/446: rename d12/d18/d1f/d23/d51/l5f to d12/lae 0 2023-12-16T03:15:54.935 INFO:tasks.workunit.client.0.smithi064.stdout:7/70: mknod d7/d13/c18 0 2023-12-16T03:15:54.940 INFO:tasks.workunit.client.0.smithi064.stdout:3/120: mkdir db/d12/d1a/d2c 0 2023-12-16T03:15:54.941 INFO:tasks.workunit.client.0.smithi064.stdout:5/114: link d0/d14/c24 d0/d19/c2d 0 2023-12-16T03:15:54.942 INFO:tasks.workunit.client.0.smithi064.stdout:5/115: rmdir d0/d14 39 2023-12-16T03:15:54.942 INFO:tasks.workunit.client.0.smithi064.stdout:3/121: dread db/f19 [0,4194304] 0 2023-12-16T03:15:54.942 INFO:tasks.workunit.client.0.smithi064.stdout:3/122: chown db/d12/d1a/d2c 24584 1 2023-12-16T03:15:54.942 INFO:tasks.workunit.client.1.smithi184.stdout:4/322: rmdir d1/d11/d1b/d44 39 2023-12-16T03:15:54.942 INFO:tasks.workunit.client.0.smithi064.stdout:5/116: fsync d0/f3 0 2023-12-16T03:15:54.944 INFO:tasks.workunit.client.1.smithi184.stdout:4/323: mknod d1/d12/d27/d42/c6c 0 2023-12-16T03:15:54.944 INFO:tasks.workunit.client.1.smithi184.stdout:4/324: chown d1/l2 0 1 2023-12-16T03:15:54.945 INFO:tasks.workunit.client.0.smithi064.stdout:7/71: dread d7/d13/f10 [0,4194304] 0 2023-12-16T03:15:54.945 INFO:tasks.workunit.client.0.smithi064.stdout:3/123: symlink db/d12/d1a/d2c/l2d 0 2023-12-16T03:15:54.945 INFO:tasks.workunit.client.0.smithi064.stdout:5/117: creat d0/d7/f2e x:0 0 0 2023-12-16T03:15:54.945 INFO:tasks.workunit.client.0.smithi064.stdout:3/124: write db/fd [22249,35845] 0 2023-12-16T03:15:54.946 INFO:tasks.workunit.client.1.smithi184.stdout:4/325: mknod d1/c6d 0 2023-12-16T03:15:54.946 INFO:tasks.workunit.client.1.smithi184.stdout:4/326: truncate d1/f51 2124416 0 2023-12-16T03:15:54.946 INFO:tasks.workunit.client.0.smithi064.stdout:5/118: creat d0/d14/d20/f2f x:0 0 0 2023-12-16T03:15:54.946 INFO:tasks.workunit.client.0.smithi064.stdout:5/119: chown d0/d7/f1e 114684 1 2023-12-16T03:15:54.947 INFO:tasks.workunit.client.0.smithi064.stdout:3/125: mknod db/d12/d21/c2e 0 2023-12-16T03:15:54.947 INFO:tasks.workunit.client.1.smithi184.stdout:4/327: symlink d1/d12/d13/d40/d43/d45/l6e 0 2023-12-16T03:15:54.948 INFO:tasks.workunit.client.0.smithi064.stdout:5/120: creat d0/d14/d20/d29/f30 x:0 0 0 2023-12-16T03:15:54.948 INFO:tasks.workunit.client.1.smithi184.stdout:4/328: write d1/d12/d13/f22 [394993,84019] 0 2023-12-16T03:15:54.948 INFO:tasks.workunit.client.0.smithi064.stdout:5/121: write d0/de/d23/f26 [92282,110153] 0 2023-12-16T03:15:54.958 INFO:tasks.workunit.client.1.smithi184.stdout:4/329: fsync d1/d12/d27/d3b/f53 0 2023-12-16T03:15:54.958 INFO:tasks.workunit.client.1.smithi184.stdout:4/330: write d1/d12/d13/f22 [512526,1361] 0 2023-12-16T03:15:54.965 INFO:tasks.workunit.client.0.smithi064.stdout:5/122: dwrite d0/d19/f27 [0,4194304] 0 2023-12-16T03:15:54.965 INFO:tasks.workunit.client.0.smithi064.stdout:5/123: write d0/d14/d20/d29/f30 [336397,43789] 0 2023-12-16T03:15:54.965 INFO:tasks.workunit.client.0.smithi064.stdout:5/124: read - d0/d7/f1a zero size 2023-12-16T03:15:54.965 INFO:tasks.workunit.client.0.smithi064.stdout:5/125: dread - d0/d7/f2e zero size 2023-12-16T03:15:54.965 INFO:tasks.workunit.client.0.smithi064.stdout:5/126: chown d0/d19 1 1 2023-12-16T03:15:54.968 INFO:tasks.workunit.client.1.smithi184.stdout:4/331: dread d1/d11/d1b/d1e/f57 [0,4194304] 0 2023-12-16T03:15:54.969 INFO:tasks.workunit.client.0.smithi064.stdout:5/127: rename d0/c6 to d0/d14/c31 0 2023-12-16T03:15:54.969 INFO:tasks.workunit.client.0.smithi064.stdout:5/128: fdatasync d0/d19/f1c 0 2023-12-16T03:15:54.969 INFO:tasks.workunit.client.0.smithi064.stdout:5/129: chown d0/de/ff 338103231 1 2023-12-16T03:15:54.970 INFO:tasks.workunit.client.1.smithi184.stdout:4/332: getdents d1/d11/d1b/d44 0 2023-12-16T03:15:54.971 INFO:tasks.workunit.client.1.smithi184.stdout:4/333: unlink d1/d11/d1b/d44/f6b 0 2023-12-16T03:15:54.971 INFO:tasks.workunit.client.1.smithi184.stdout:4/334: stat d1/d11/d1b/d1e/f41 0 2023-12-16T03:15:54.971 INFO:tasks.workunit.client.1.smithi184.stdout:4/335: truncate d1/d29/d34/f3d 2156951 0 2023-12-16T03:15:55.037 INFO:tasks.workunit.client.0.smithi064.stdout:8/122: dwrite d0/db/d12/f15 [0,4194304] 0 2023-12-16T03:15:55.038 INFO:tasks.workunit.client.1.smithi184.stdout:8/421: sync 2023-12-16T03:15:55.038 INFO:tasks.workunit.client.1.smithi184.stdout:7/368: sync 2023-12-16T03:15:55.039 INFO:tasks.workunit.client.0.smithi064.stdout:6/59: dwrite d3/f5 [4194304,4194304] 0 2023-12-16T03:15:55.039 INFO:tasks.workunit.client.0.smithi064.stdout:6/60: write d3/d8/da/fe [881209,99097] 0 2023-12-16T03:15:55.039 INFO:tasks.workunit.client.0.smithi064.stdout:1/88: dwrite d3/f13 [0,4194304] 0 2023-12-16T03:15:55.039 INFO:tasks.workunit.client.0.smithi064.stdout:1/89: fsync d3/f5 0 2023-12-16T03:15:55.039 INFO:tasks.workunit.client.0.smithi064.stdout:1/90: stat d3/dd/d11/f17 0 2023-12-16T03:15:55.039 INFO:tasks.workunit.client.0.smithi064.stdout:2/88: dwrite d1/fd [0,4194304] 0 2023-12-16T03:15:55.039 INFO:tasks.workunit.client.0.smithi064.stdout:1/91: write d3/f5 [948260,42130] 0 2023-12-16T03:15:55.039 INFO:tasks.workunit.client.0.smithi064.stdout:8/123: mknod d0/db/d12/d1c/c2d 0 2023-12-16T03:15:55.040 INFO:tasks.workunit.client.1.smithi184.stdout:7/369: getdents d0/d3/d2e 0 2023-12-16T03:15:55.041 INFO:tasks.workunit.client.0.smithi064.stdout:6/61: rmdir d3/d9 39 2023-12-16T03:15:55.042 INFO:tasks.workunit.client.1.smithi184.stdout:4/336: dread d1/d29/d34/f3d [0,4194304] 0 2023-12-16T03:15:55.044 INFO:tasks.workunit.client.1.smithi184.stdout:3/447: dwrite d12/d18/f71 [0,4194304] 0 2023-12-16T03:15:55.044 INFO:tasks.workunit.client.1.smithi184.stdout:3/448: chown d12/d18/d1f/d23/d2a/d3e/l77 9587 1 2023-12-16T03:15:55.046 INFO:tasks.workunit.client.1.smithi184.stdout:7/370: unlink d0/d3/f24 0 2023-12-16T03:15:55.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/449: mknod d12/caf 0 2023-12-16T03:15:55.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/450: read - d12/d18/d1f/f5d zero size 2023-12-16T03:15:55.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/451: write d12/d18/d1f/d23/d2a/d36/f8d [845184,25464] 0 2023-12-16T03:15:55.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/452: chown d12/d18/da1 13895 1 2023-12-16T03:15:55.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/453: stat d12/d18/d1f/d23/d2a/d42/c6b 0 2023-12-16T03:15:55.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/454: readlink d12/l33 0 2023-12-16T03:15:55.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/455: read - d12/d37/f95 zero size 2023-12-16T03:15:55.051 INFO:tasks.workunit.client.0.smithi064.stdout:3/126: link db/d12/f29 db/d12/d21/d2b/f2f 0 2023-12-16T03:15:55.051 INFO:tasks.workunit.client.0.smithi064.stdout:3/127: chown db/f19 6693831 1 2023-12-16T03:15:55.051 INFO:tasks.workunit.client.0.smithi064.stdout:3/128: write db/d12/f23 [857155,103025] 0 2023-12-16T03:15:55.051 INFO:tasks.workunit.client.0.smithi064.stdout:3/129: write db/d13/f24 [761395,9324] 0 2023-12-16T03:15:55.052 INFO:tasks.workunit.client.1.smithi184.stdout:3/456: symlink d12/d18/d1f/d23/d2a/d42/d52/lb0 0 2023-12-16T03:15:55.052 INFO:tasks.workunit.client.1.smithi184.stdout:3/457: truncate d12/f19 1667987 0 2023-12-16T03:15:55.055 INFO:tasks.workunit.client.1.smithi184.stdout:3/458: getdents d12/d18/d1f/d23/d2a/d3e 0 2023-12-16T03:15:55.056 INFO:tasks.workunit.client.0.smithi064.stdout:5/130: dwrite d0/d7/f16 [4194304,4194304] 0 2023-12-16T03:15:55.057 INFO:tasks.workunit.client.0.smithi064.stdout:7/72: unlink d7/l17 0 2023-12-16T03:15:55.057 INFO:tasks.workunit.client.0.smithi064.stdout:7/73: chown d7/d13/c18 30157902 1 2023-12-16T03:15:55.057 INFO:tasks.workunit.client.0.smithi064.stdout:7/74: chown c2 509206 1 2023-12-16T03:15:55.058 INFO:tasks.workunit.client.1.smithi184.stdout:3/459: symlink d12/d1e/d89/lb1 0 2023-12-16T03:15:55.058 INFO:tasks.workunit.client.1.smithi184.stdout:3/460: chown d12/d18/d1f/d23/d2a/d4a 789446 1 2023-12-16T03:15:55.058 INFO:tasks.workunit.client.1.smithi184.stdout:3/461: readlink d12/d18/d1f/l29 0 2023-12-16T03:15:55.061 INFO:tasks.workunit.client.0.smithi064.stdout:2/89: unlink d1/f14 0 2023-12-16T03:15:55.061 INFO:tasks.workunit.client.0.smithi064.stdout:2/90: truncate d1/f8 1438676 0 2023-12-16T03:15:55.062 INFO:tasks.workunit.client.1.smithi184.stdout:3/462: rename d12/d18/d1f/d23/d2a/d42/c6b to d12/cb2 0 2023-12-16T03:15:55.062 INFO:tasks.workunit.client.1.smithi184.stdout:3/463: fsync d12/d18/d1f/d23/d2a/d3e/d48/f88 0 2023-12-16T03:15:55.062 INFO:tasks.workunit.client.1.smithi184.stdout:3/464: chown c11 6025500 1 2023-12-16T03:15:55.063 INFO:tasks.workunit.client.1.smithi184.stdout:3/465: dread - d12/d18/d1f/d23/d51/f90 zero size 2023-12-16T03:15:55.064 INFO:tasks.workunit.client.0.smithi064.stdout:1/92: creat d3/dd/d11/f1f x:0 0 0 2023-12-16T03:15:55.064 INFO:tasks.workunit.client.0.smithi064.stdout:1/93: write f2 [1722581,7435] 0 2023-12-16T03:15:55.065 INFO:tasks.workunit.client.0.smithi064.stdout:3/130: unlink db/d12/f29 0 2023-12-16T03:15:55.069 INFO:tasks.workunit.client.0.smithi064.stdout:7/75: mkdir d7/d19 0 2023-12-16T03:15:55.070 INFO:tasks.workunit.client.0.smithi064.stdout:1/94: symlink d3/dd/l20 0 2023-12-16T03:15:55.070 INFO:tasks.workunit.client.0.smithi064.stdout:1/95: stat d3/c9 0 2023-12-16T03:15:55.074 INFO:tasks.workunit.client.1.smithi184.stdout:8/422: dwrite d2/d12/f5a [0,4194304] 0 2023-12-16T03:15:55.074 INFO:tasks.workunit.client.0.smithi064.stdout:5/131: rename d0/d19/f1c to d0/f32 0 2023-12-16T03:15:55.074 INFO:tasks.workunit.client.0.smithi064.stdout:2/91: dread d1/f7 [0,4194304] 0 2023-12-16T03:15:55.075 INFO:tasks.workunit.client.0.smithi064.stdout:2/92: fdatasync d1/f4 0 2023-12-16T03:15:55.075 INFO:tasks.workunit.client.0.smithi064.stdout:7/76: symlink d7/d13/l1a 0 2023-12-16T03:15:55.075 INFO:tasks.workunit.client.0.smithi064.stdout:7/77: chown d7/d13/c11 330740778 1 2023-12-16T03:15:55.075 INFO:tasks.workunit.client.0.smithi064.stdout:7/78: chown d7/c16 1551121 1 2023-12-16T03:15:55.075 INFO:tasks.workunit.client.0.smithi064.stdout:7/79: truncate d7/fb 554141 0 2023-12-16T03:15:55.075 INFO:tasks.workunit.client.0.smithi064.stdout:7/80: stat d7/d13/cf 0 2023-12-16T03:15:55.078 INFO:tasks.workunit.client.0.smithi064.stdout:2/93: link c0 d1/c17 0 2023-12-16T03:15:55.078 INFO:tasks.workunit.client.0.smithi064.stdout:2/94: fdatasync d1/f9 0 2023-12-16T03:15:55.079 INFO:tasks.workunit.client.0.smithi064.stdout:7/81: truncate d7/f9 1554852 0 2023-12-16T03:15:55.081 INFO:tasks.workunit.client.0.smithi064.stdout:5/132: unlink d0/l13 0 2023-12-16T03:15:55.084 INFO:tasks.workunit.client.1.smithi184.stdout:4/337: dwrite d1/fd [0,4194304] 0 2023-12-16T03:15:55.084 INFO:tasks.workunit.client.0.smithi064.stdout:5/133: creat d0/d14/d20/d29/f33 x:0 0 0 2023-12-16T03:15:55.084 INFO:tasks.workunit.client.1.smithi184.stdout:3/466: fsync d12/d1e/da3/fa7 0 2023-12-16T03:15:55.085 INFO:tasks.workunit.client.0.smithi064.stdout:8/124: dwrite d0/db/d12/f15 [0,4194304] 0 2023-12-16T03:15:55.085 INFO:tasks.workunit.client.1.smithi184.stdout:4/338: creat d1/d11/d5a/f6f x:0 0 0 2023-12-16T03:15:55.091 INFO:tasks.workunit.client.1.smithi184.stdout:3/467: write d12/f25 [66980,50182] 0 2023-12-16T03:15:55.091 INFO:tasks.workunit.client.1.smithi184.stdout:3/468: write d12/d18/d1f/d23/d2a/d36/f8d [1062565,32869] 0 2023-12-16T03:15:55.091 INFO:tasks.workunit.client.0.smithi064.stdout:3/131: dwrite f4 [0,4194304] 0 2023-12-16T03:15:55.092 INFO:tasks.workunit.client.1.smithi184.stdout:7/371: dwrite d0/df/dd/f46 [0,4194304] 0 2023-12-16T03:15:55.092 INFO:tasks.workunit.client.1.smithi184.stdout:7/372: dread - d0/d3/f64 zero size 2023-12-16T03:15:55.092 INFO:tasks.workunit.client.1.smithi184.stdout:7/373: chown d0/l1 386973 1 2023-12-16T03:15:55.093 INFO:tasks.workunit.client.0.smithi064.stdout:0/58: sync 2023-12-16T03:15:55.096 INFO:tasks.workunit.client.1.smithi184.stdout:3/469: symlink d12/d1e/da3/lb3 0 2023-12-16T03:15:55.097 INFO:tasks.workunit.client.1.smithi184.stdout:3/470: fsync d12/d18/d68/f69 0 2023-12-16T03:15:55.097 INFO:tasks.workunit.client.1.smithi184.stdout:3/471: write d12/d18/fa0 [921752,85143] 0 2023-12-16T03:15:55.097 INFO:tasks.workunit.client.1.smithi184.stdout:3/472: chown d12/d18/d1f/d23/d2a/d3e/d48/l4f 226496 1 2023-12-16T03:15:55.097 INFO:tasks.workunit.client.1.smithi184.stdout:3/473: chown d12/d18/f7c 1484 1 2023-12-16T03:15:55.097 INFO:tasks.workunit.client.1.smithi184.stdout:3/474: stat d12/d18/d1f/d23/d2a/d36/l5c 0 2023-12-16T03:15:55.099 INFO:tasks.workunit.client.1.smithi184.stdout:3/475: getdents d12/d37/d81 0 2023-12-16T03:15:55.099 INFO:tasks.workunit.client.0.smithi064.stdout:3/132: truncate db/fd 721125 0 2023-12-16T03:15:55.100 INFO:tasks.workunit.client.0.smithi064.stdout:0/59: truncate f1 97381 0 2023-12-16T03:15:55.101 INFO:tasks.workunit.client.1.smithi184.stdout:3/476: mkdir d12/d18/d7a/db4 0 2023-12-16T03:15:55.101 INFO:tasks.workunit.client.1.smithi184.stdout:3/477: chown d12/d18/d1f/d23/d2a/f38 14 1 2023-12-16T03:15:55.103 INFO:tasks.workunit.client.1.smithi184.stdout:3/478: creat d12/d18/d1f/d23/fb5 x:0 0 0 2023-12-16T03:15:55.106 INFO:tasks.workunit.client.0.smithi064.stdout:3/133: link db/f19 db/d12/d21/f30 0 2023-12-16T03:15:55.106 INFO:tasks.workunit.client.0.smithi064.stdout:3/134: write db/d13/f24 [1712682,111117] 0 2023-12-16T03:15:55.106 INFO:tasks.workunit.client.1.smithi184.stdout:3/479: link d12/d18/d1f/d23/d2a/d36/f5b d12/d1e/fb6 0 2023-12-16T03:15:55.106 INFO:tasks.workunit.client.1.smithi184.stdout:3/480: readlink d12/d18/d1f/d23/d2a/d36/l5c 0 2023-12-16T03:15:55.108 INFO:tasks.workunit.client.0.smithi064.stdout:0/60: symlink d2/d8/da/le 0 2023-12-16T03:15:55.110 INFO:tasks.workunit.client.1.smithi184.stdout:8/423: dwrite d2/f33 [0,4194304] 0 2023-12-16T03:15:55.112 INFO:tasks.workunit.client.0.smithi064.stdout:3/135: mkdir db/d12/d1a/d31 0 2023-12-16T03:15:55.115 INFO:tasks.workunit.client.1.smithi184.stdout:8/424: dread d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:15:55.115 INFO:tasks.workunit.client.1.smithi184.stdout:8/425: fdatasync d2/d4/d10/f17 0 2023-12-16T03:15:55.115 INFO:tasks.workunit.client.1.smithi184.stdout:8/426: write d2/d12/d21/d2d/d31/d34/f67 [4547040,90684] 0 2023-12-16T03:15:55.116 INFO:tasks.workunit.client.1.smithi184.stdout:8/427: truncate d2/d12/d21/d2d/d31/f3a 177112 0 2023-12-16T03:15:55.117 INFO:tasks.workunit.client.1.smithi184.stdout:8/428: creat d2/d12/d21/d2d/d31/d5e/f88 x:0 0 0 2023-12-16T03:15:55.118 INFO:tasks.workunit.client.1.smithi184.stdout:8/429: link d2/d4/d10/d11/d77/f82 d2/f89 0 2023-12-16T03:15:55.119 INFO:tasks.workunit.client.1.smithi184.stdout:8/430: mkdir d2/d12/d21/d8a 0 2023-12-16T03:15:55.125 INFO:tasks.workunit.client.1.smithi184.stdout:4/339: dwrite d1/f28 [4194304,4194304] 0 2023-12-16T03:15:55.127 INFO:tasks.workunit.client.0.smithi064.stdout:2/95: truncate d1/f8 879460 0 2023-12-16T03:15:55.128 INFO:tasks.workunit.client.1.smithi184.stdout:4/340: write d1/f28 [3718187,27633] 0 2023-12-16T03:15:55.128 INFO:tasks.workunit.client.0.smithi064.stdout:2/96: creat d1/d15/f18 x:0 0 0 2023-12-16T03:15:55.129 INFO:tasks.workunit.client.0.smithi064.stdout:2/97: readlink d1/lb 0 2023-12-16T03:15:55.129 INFO:tasks.workunit.client.0.smithi064.stdout:2/98: chown d1/d15/f18 1693621326 1 2023-12-16T03:15:55.129 INFO:tasks.workunit.client.1.smithi184.stdout:4/341: creat d1/d12/d27/f70 x:0 0 0 2023-12-16T03:15:55.129 INFO:tasks.workunit.client.1.smithi184.stdout:4/342: read - d1/d12/d27/f69 zero size 2023-12-16T03:15:55.131 INFO:tasks.workunit.client.1.smithi184.stdout:4/343: dread d1/d12/d13/f31 [0,4194304] 0 2023-12-16T03:15:55.131 INFO:tasks.workunit.client.1.smithi184.stdout:4/344: truncate d1/d12/d27/f70 155782 0 2023-12-16T03:15:55.131 INFO:tasks.workunit.client.1.smithi184.stdout:4/345: write d1/d12/d27/f49 [254529,103247] 0 2023-12-16T03:15:55.133 INFO:tasks.workunit.client.1.smithi184.stdout:4/346: truncate d1/d12/f3e 3472585 0 2023-12-16T03:15:55.133 INFO:tasks.workunit.client.1.smithi184.stdout:4/347: chown d1/d29 484 1 2023-12-16T03:15:55.144 INFO:tasks.workunit.client.0.smithi064.stdout:8/125: dwrite d0/da/f23 [0,4194304] 0 2023-12-16T03:15:55.145 INFO:tasks.workunit.client.0.smithi064.stdout:5/134: dwrite d0/f15 [0,4194304] 0 2023-12-16T03:15:55.146 INFO:tasks.workunit.client.0.smithi064.stdout:8/126: getdents d0/d1d/d24 0 2023-12-16T03:15:55.148 INFO:tasks.workunit.client.0.smithi064.stdout:5/135: mkdir d0/d7/d34 0 2023-12-16T03:15:55.148 INFO:tasks.workunit.client.0.smithi064.stdout:5/136: write d0/d7/f2e [504671,22526] 0 2023-12-16T03:15:55.148 INFO:tasks.workunit.client.0.smithi064.stdout:5/137: mkdir d0/d14/d20/d29/d2a/d35 0 2023-12-16T03:15:55.152 INFO:tasks.workunit.client.0.smithi064.stdout:8/127: dread d0/f7 [4194304,4194304] 0 2023-12-16T03:15:55.153 INFO:tasks.workunit.client.0.smithi064.stdout:0/61: dwrite d2/f3 [0,4194304] 0 2023-12-16T03:15:55.154 INFO:tasks.workunit.client.0.smithi064.stdout:0/62: fdatasync d2/f3 0 2023-12-16T03:15:55.154 INFO:tasks.workunit.client.1.smithi184.stdout:3/481: dwrite d12/d18/d1f/d23/d2a/f53 [0,4194304] 0 2023-12-16T03:15:55.154 INFO:tasks.workunit.client.1.smithi184.stdout:3/482: write d12/d18/d1f/d23/d2a/d4a/d61/f72 [682392,2946] 0 2023-12-16T03:15:55.154 INFO:tasks.workunit.client.1.smithi184.stdout:3/483: dread - d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f50 zero size 2023-12-16T03:15:55.154 INFO:tasks.workunit.client.0.smithi064.stdout:8/128: mknod d0/d1d/c2e 0 2023-12-16T03:15:55.154 INFO:tasks.workunit.client.0.smithi064.stdout:8/129: stat d0/f7 0 2023-12-16T03:15:55.155 INFO:tasks.workunit.client.0.smithi064.stdout:5/138: dread d0/de/ff [0,4194304] 0 2023-12-16T03:15:55.156 INFO:tasks.workunit.client.1.smithi184.stdout:8/431: dwrite d2/d4/d10/f14 [0,4194304] 0 2023-12-16T03:15:55.156 INFO:tasks.workunit.client.0.smithi064.stdout:5/139: write d0/f3 [444593,42249] 0 2023-12-16T03:15:55.156 INFO:tasks.workunit.client.0.smithi064.stdout:5/140: truncate d0/d14/d20/f2f 341532 0 2023-12-16T03:15:55.158 INFO:tasks.workunit.client.0.smithi064.stdout:8/130: getdents d0/da/d16 0 2023-12-16T03:15:55.158 INFO:tasks.workunit.client.0.smithi064.stdout:8/131: dread - d0/da/d16/f1b zero size 2023-12-16T03:15:55.159 INFO:tasks.workunit.client.0.smithi064.stdout:8/132: read d0/f27 [862748,59240] 0 2023-12-16T03:15:55.161 INFO:tasks.workunit.client.0.smithi064.stdout:8/133: mkdir d0/d1d/d24/d2f 0 2023-12-16T03:15:55.162 INFO:tasks.workunit.client.0.smithi064.stdout:8/134: chown d0/da/f23 662126 1 2023-12-16T03:15:55.164 INFO:tasks.workunit.client.0.smithi064.stdout:0/63: dread d2/f3 [0,4194304] 0 2023-12-16T03:15:55.164 INFO:tasks.workunit.client.0.smithi064.stdout:2/99: dwrite d1/fd [0,4194304] 0 2023-12-16T03:15:55.164 INFO:tasks.workunit.client.0.smithi064.stdout:2/100: truncate d1/d15/f18 156499 0 2023-12-16T03:15:55.170 INFO:tasks.workunit.client.1.smithi184.stdout:3/484: dread d12/d1e/f20 [0,4194304] 0 2023-12-16T03:15:55.171 INFO:tasks.workunit.client.1.smithi184.stdout:8/432: mkdir d2/d4/d10/d7a/d83/d8b 0 2023-12-16T03:15:55.172 INFO:tasks.workunit.client.0.smithi064.stdout:5/141: dwrite d0/d19/f27 [0,4194304] 0 2023-12-16T03:15:55.173 INFO:tasks.workunit.client.1.smithi184.stdout:8/433: unlink d2/d12/d21/d30/f35 0 2023-12-16T03:15:55.176 INFO:tasks.workunit.client.1.smithi184.stdout:8/434: rename d2/d4/d10/d11/d72/f85 to d2/d12/d21/f8c 0 2023-12-16T03:15:55.176 INFO:tasks.workunit.client.0.smithi064.stdout:0/64: write d2/f5 [208854,4085] 0 2023-12-16T03:15:55.187 INFO:tasks.workunit.client.0.smithi064.stdout:8/135: dwrite d0/f7 [0,4194304] 0 2023-12-16T03:15:55.187 INFO:tasks.workunit.client.0.smithi064.stdout:8/136: readlink d0/l13 0 2023-12-16T03:15:55.187 INFO:tasks.workunit.client.0.smithi064.stdout:8/137: stat d0/f3 0 2023-12-16T03:15:55.187 INFO:tasks.workunit.client.0.smithi064.stdout:8/138: truncate d0/da/d16/f1b 740229 0 2023-12-16T03:15:55.194 INFO:tasks.workunit.client.1.smithi184.stdout:8/435: dwrite d2/d4/f44 [0,4194304] 0 2023-12-16T03:15:55.199 INFO:tasks.workunit.client.0.smithi064.stdout:8/139: dread d0/db/d12/f15 [0,4194304] 0 2023-12-16T03:15:55.205 INFO:tasks.workunit.client.1.smithi184.stdout:8/436: dread d2/fc [0,4194304] 0 2023-12-16T03:15:55.210 INFO:tasks.workunit.client.1.smithi184.stdout:8/437: write d2/d4/d10/d11/f3d [1900109,124531] 0 2023-12-16T03:15:55.210 INFO:tasks.workunit.client.1.smithi184.stdout:8/438: fsync d2/d12/f5a 0 2023-12-16T03:15:55.210 INFO:tasks.workunit.client.1.smithi184.stdout:8/439: chown d2/d12/d21/d2d/d31/f3a 157243 1 2023-12-16T03:15:55.215 INFO:tasks.workunit.client.0.smithi064.stdout:8/140: dwrite d0/da/d16/f1b [0,4194304] 0 2023-12-16T03:15:55.249 INFO:tasks.workunit.client.1.smithi184.stdout:2/267: sync 2023-12-16T03:15:55.249 INFO:tasks.workunit.client.1.smithi184.stdout:9/534: sync 2023-12-16T03:15:55.249 INFO:tasks.workunit.client.1.smithi184.stdout:2/268: write d3/d29/d2f/f45 [628459,14108] 0 2023-12-16T03:15:55.250 INFO:tasks.workunit.client.1.smithi184.stdout:9/535: mknod d0/d76/db2/cb5 0 2023-12-16T03:15:55.251 INFO:tasks.workunit.client.0.smithi064.stdout:2/101: creat d1/f19 x:0 0 0 2023-12-16T03:15:55.251 INFO:tasks.workunit.client.1.smithi184.stdout:2/269: mkdir d3/d29/d4d/d5b 0 2023-12-16T03:15:55.251 INFO:tasks.workunit.client.1.smithi184.stdout:2/270: truncate d3/d9/d19/f26 804121 0 2023-12-16T03:15:55.251 INFO:tasks.workunit.client.1.smithi184.stdout:2/271: symlink d3/d29/d4d/d5b/l5c 0 2023-12-16T03:15:55.253 INFO:tasks.workunit.client.0.smithi064.stdout:5/142: creat d0/de/f36 x:0 0 0 2023-12-16T03:15:55.255 INFO:tasks.workunit.client.0.smithi064.stdout:0/65: mkdir d2/d8/da/df 0 2023-12-16T03:15:55.258 INFO:tasks.workunit.client.0.smithi064.stdout:0/66: read f1 [37744,23699] 0 2023-12-16T03:15:55.260 INFO:tasks.workunit.client.0.smithi064.stdout:5/143: dread d0/d7/f16 [4194304,4194304] 0 2023-12-16T03:15:55.261 INFO:tasks.workunit.client.0.smithi064.stdout:5/144: readlink d0/l2b 0 2023-12-16T03:15:55.263 INFO:tasks.workunit.client.0.smithi064.stdout:0/67: write d2/f5 [3600109,12692] 0 2023-12-16T03:15:55.263 INFO:tasks.workunit.client.0.smithi064.stdout:0/68: chown d2/cb 14965 1 2023-12-16T03:15:55.263 INFO:tasks.workunit.client.1.smithi184.stdout:9/536: dwrite d0/f8b [0,4194304] 0 2023-12-16T03:15:55.263 INFO:tasks.workunit.client.1.smithi184.stdout:9/537: chown d0 197 1 2023-12-16T03:15:55.264 INFO:tasks.workunit.client.0.smithi064.stdout:8/141: creat d0/da/f30 x:0 0 0 2023-12-16T03:15:55.265 INFO:tasks.workunit.client.1.smithi184.stdout:9/538: mknod d0/d76/db2/cb6 0 2023-12-16T03:15:55.265 INFO:tasks.workunit.client.1.smithi184.stdout:9/539: write d0/d13/d20/f29 [3169166,91591] 0 2023-12-16T03:15:55.266 INFO:tasks.workunit.client.1.smithi184.stdout:9/540: mkdir d0/d76/db7 0 2023-12-16T03:15:55.266 INFO:tasks.workunit.client.0.smithi064.stdout:2/102: unlink d1/cf 0 2023-12-16T03:15:55.266 INFO:tasks.workunit.client.0.smithi064.stdout:2/103: write d1/f9 [734487,28970] 0 2023-12-16T03:15:55.267 INFO:tasks.workunit.client.0.smithi064.stdout:2/104: fdatasync d1/d15/f18 0 2023-12-16T03:15:55.267 INFO:tasks.workunit.client.1.smithi184.stdout:9/541: mknod d0/d13/d6e/d9f/cb8 0 2023-12-16T03:15:55.267 INFO:tasks.workunit.client.1.smithi184.stdout:9/542: chown d0/d13/c23 74765 1 2023-12-16T03:15:55.267 INFO:tasks.workunit.client.1.smithi184.stdout:9/543: chown d0/d13/l5c 8269271 1 2023-12-16T03:15:55.268 INFO:tasks.workunit.client.0.smithi064.stdout:7/82: truncate d7/f9 903049 0 2023-12-16T03:15:55.273 INFO:tasks.workunit.client.0.smithi064.stdout:5/145: mkdir d0/d14/d20/d37 0 2023-12-16T03:15:55.273 INFO:tasks.workunit.client.1.smithi184.stdout:9/544: symlink d0/d13/d20/lb9 0 2023-12-16T03:15:55.273 INFO:tasks.workunit.client.1.smithi184.stdout:9/545: creat d0/d13/d6e/d9f/fba x:0 0 0 2023-12-16T03:15:55.273 INFO:tasks.workunit.client.1.smithi184.stdout:9/546: chown d0/d76/db2 2068218 1 2023-12-16T03:15:55.274 INFO:tasks.workunit.client.1.smithi184.stdout:9/547: rename d0/d13/d20/d5b/d53/la1 to d0/d13/d6e/lbb 0 2023-12-16T03:15:55.275 INFO:tasks.workunit.client.1.smithi184.stdout:9/548: write d0/f57 [381534,46125] 0 2023-12-16T03:15:55.276 INFO:tasks.workunit.client.1.smithi184.stdout:9/549: creat d0/d3a/d47/fbc x:0 0 0 2023-12-16T03:15:55.278 INFO:tasks.workunit.client.1.smithi184.stdout:9/550: mknod d0/d76/db2/cbd 0 2023-12-16T03:15:55.278 INFO:tasks.workunit.client.1.smithi184.stdout:9/551: fdatasync d0/d3a/d47/f71 0 2023-12-16T03:15:55.278 INFO:tasks.workunit.client.1.smithi184.stdout:9/552: write d0/d13/d20/d5b/faf [4573076,62576] 0 2023-12-16T03:15:55.279 INFO:tasks.workunit.client.1.smithi184.stdout:9/553: symlink d0/d76/lbe 0 2023-12-16T03:15:55.280 INFO:tasks.workunit.client.0.smithi064.stdout:6/62: sync 2023-12-16T03:15:55.281 INFO:tasks.workunit.client.0.smithi064.stdout:4/84: sync 2023-12-16T03:15:55.281 INFO:tasks.workunit.client.0.smithi064.stdout:9/79: sync 2023-12-16T03:15:55.281 INFO:tasks.workunit.client.0.smithi064.stdout:3/136: sync 2023-12-16T03:15:55.281 INFO:tasks.workunit.client.0.smithi064.stdout:1/96: sync 2023-12-16T03:15:55.281 INFO:tasks.workunit.client.0.smithi064.stdout:3/137: dread - db/d12/d1a/f28 zero size 2023-12-16T03:15:55.281 INFO:tasks.workunit.client.0.smithi064.stdout:7/83: rmdir d7 39 2023-12-16T03:15:55.283 INFO:tasks.workunit.client.0.smithi064.stdout:0/69: dwrite f1 [0,4194304] 0 2023-12-16T03:15:55.284 INFO:tasks.workunit.client.0.smithi064.stdout:7/84: rmdir d7/d13 39 2023-12-16T03:15:55.285 INFO:tasks.workunit.client.0.smithi064.stdout:6/63: dread d3/d8/da/fe [0,4194304] 0 2023-12-16T03:15:55.289 INFO:tasks.workunit.client.0.smithi064.stdout:0/70: mkdir d2/d7/d10 0 2023-12-16T03:15:55.289 INFO:tasks.workunit.client.0.smithi064.stdout:6/64: rmdir d3/d8 39 2023-12-16T03:15:55.289 INFO:tasks.workunit.client.0.smithi064.stdout:7/85: creat d7/d19/f1b x:0 0 0 2023-12-16T03:15:55.293 INFO:tasks.workunit.client.1.smithi184.stdout:9/554: mkdir d0/d76/dbf 0 2023-12-16T03:15:55.294 INFO:tasks.workunit.client.0.smithi064.stdout:6/65: symlink d3/d9/l11 0 2023-12-16T03:15:55.294 INFO:tasks.workunit.client.0.smithi064.stdout:6/66: fdatasync d3/fd 0 2023-12-16T03:15:55.294 INFO:tasks.workunit.client.0.smithi064.stdout:6/67: readlink d3/l6 0 2023-12-16T03:15:55.294 INFO:tasks.workunit.client.0.smithi064.stdout:7/86: getdents d7/d13 0 2023-12-16T03:15:55.295 INFO:tasks.workunit.client.0.smithi064.stdout:7/87: fdatasync d7/fb 0 2023-12-16T03:15:55.296 INFO:tasks.workunit.client.1.smithi184.stdout:9/555: read d0/f1f [4909127,91647] 0 2023-12-16T03:15:55.296 INFO:tasks.workunit.client.1.smithi184.stdout:9/556: fdatasync d0/f14 0 2023-12-16T03:15:55.298 INFO:tasks.workunit.client.1.smithi184.stdout:9/557: creat d0/d3a/fc0 x:0 0 0 2023-12-16T03:15:55.298 INFO:tasks.workunit.client.1.smithi184.stdout:9/558: fdatasync d0/d13/f3f 0 2023-12-16T03:15:55.302 INFO:tasks.workunit.client.1.smithi184.stdout:9/559: dread d0/d13/d20/f8f [0,4194304] 0 2023-12-16T03:15:55.314 INFO:tasks.workunit.client.0.smithi064.stdout:6/68: dread d3/fd [0,4194304] 0 2023-12-16T03:15:55.314 INFO:tasks.workunit.client.0.smithi064.stdout:2/105: dwrite d1/f10 [0,4194304] 0 2023-12-16T03:15:55.314 INFO:tasks.workunit.client.0.smithi064.stdout:2/106: chown d1/c17 0 1 2023-12-16T03:15:55.316 INFO:tasks.workunit.client.0.smithi064.stdout:2/107: creat d1/d15/f1a x:0 0 0 2023-12-16T03:15:55.317 INFO:tasks.workunit.client.0.smithi064.stdout:8/142: dwrite d0/da/fc [0,4194304] 0 2023-12-16T03:15:55.319 INFO:tasks.workunit.client.0.smithi064.stdout:6/69: dread d3/f5 [0,4194304] 0 2023-12-16T03:15:55.320 INFO:tasks.workunit.client.0.smithi064.stdout:6/70: mknod d3/d8/da/c12 0 2023-12-16T03:15:55.320 INFO:tasks.workunit.client.0.smithi064.stdout:6/71: write d3/fd [5064676,127412] 0 2023-12-16T03:15:55.321 INFO:tasks.workunit.client.0.smithi064.stdout:6/72: write d3/f5 [2857199,6288] 0 2023-12-16T03:15:55.321 INFO:tasks.workunit.client.0.smithi064.stdout:6/73: chown d3/lf 39218 1 2023-12-16T03:15:55.322 INFO:tasks.workunit.client.0.smithi064.stdout:6/74: mkdir d3/d8/d13 0 2023-12-16T03:15:55.324 INFO:tasks.workunit.client.0.smithi064.stdout:0/71: write d2/f5 [3668957,62938] 0 2023-12-16T03:15:55.325 INFO:tasks.workunit.client.0.smithi064.stdout:4/85: dwrite d0/f1 [0,4194304] 0 2023-12-16T03:15:55.326 INFO:tasks.workunit.client.0.smithi064.stdout:8/143: dread d0/da/fc [4194304,4194304] 0 2023-12-16T03:15:55.326 INFO:tasks.workunit.client.0.smithi064.stdout:9/80: dwrite d2/dc/ff [0,4194304] 0 2023-12-16T03:15:55.327 INFO:tasks.workunit.client.0.smithi064.stdout:0/72: unlink d2/d7/l9 0 2023-12-16T03:15:55.329 INFO:tasks.workunit.client.0.smithi064.stdout:3/138: dwrite db/d13/f24 [0,4194304] 0 2023-12-16T03:15:55.329 INFO:tasks.workunit.client.0.smithi064.stdout:3/139: stat db/d12/d21/l22 0 2023-12-16T03:15:55.329 INFO:tasks.workunit.client.0.smithi064.stdout:3/140: chown db/d13 40 1 2023-12-16T03:15:55.329 INFO:tasks.workunit.client.0.smithi064.stdout:1/97: dwrite d3/f13 [4194304,4194304] 0 2023-12-16T03:15:55.329 INFO:tasks.workunit.client.0.smithi064.stdout:1/98: fsync d3/dd/d11/f1f 0 2023-12-16T03:15:55.330 INFO:tasks.workunit.client.1.smithi184.stdout:9/560: dwrite d0/d30/f75 [4194304,4194304] 0 2023-12-16T03:15:55.331 INFO:tasks.workunit.client.0.smithi064.stdout:7/88: rename d7/d19 to d7/d1c 0 2023-12-16T03:15:55.331 INFO:tasks.workunit.client.0.smithi064.stdout:7/89: fdatasync d7/fb 0 2023-12-16T03:15:55.332 INFO:tasks.workunit.client.1.smithi184.stdout:9/561: symlink d0/d3a/d47/lc1 0 2023-12-16T03:15:55.333 INFO:tasks.workunit.client.0.smithi064.stdout:7/90: write d7/fb [523112,20100] 0 2023-12-16T03:15:55.333 INFO:tasks.workunit.client.0.smithi064.stdout:7/91: chown d7/ce 409 1 2023-12-16T03:15:55.334 INFO:tasks.workunit.client.1.smithi184.stdout:9/562: dread d0/d13/d20/d5b/f52 [0,4194304] 0 2023-12-16T03:15:55.335 INFO:tasks.workunit.client.0.smithi064.stdout:8/144: rmdir d0/da 39 2023-12-16T03:15:55.336 INFO:tasks.workunit.client.1.smithi184.stdout:9/563: truncate d0/d3a/f70 54255 0 2023-12-16T03:15:55.337 INFO:tasks.workunit.client.0.smithi064.stdout:9/81: rename d2/f8 to d2/dc/f15 0 2023-12-16T03:15:55.337 INFO:tasks.workunit.client.0.smithi064.stdout:9/82: fdatasync d2/fa 0 2023-12-16T03:15:55.338 INFO:tasks.workunit.client.0.smithi064.stdout:0/73: mkdir d2/d8/da/d11 0 2023-12-16T03:15:55.338 INFO:tasks.workunit.client.0.smithi064.stdout:2/108: getdents d1/d15 0 2023-12-16T03:15:55.342 INFO:tasks.workunit.client.0.smithi064.stdout:6/75: truncate d3/f5 1168740 0 2023-12-16T03:15:55.343 INFO:tasks.workunit.client.0.smithi064.stdout:3/141: write f0 [1081398,50460] 0 2023-12-16T03:15:55.348 INFO:tasks.workunit.client.0.smithi064.stdout:1/99: mknod d3/dd/c21 0 2023-12-16T03:15:55.348 INFO:tasks.workunit.client.0.smithi064.stdout:1/100: fsync d3/f5 0 2023-12-16T03:15:55.348 INFO:tasks.workunit.client.0.smithi064.stdout:7/92: creat d7/d13/f1d x:0 0 0 2023-12-16T03:15:55.349 INFO:tasks.workunit.client.0.smithi064.stdout:4/86: dwrite d0/f11 [0,4194304] 0 2023-12-16T03:15:55.349 INFO:tasks.workunit.client.0.smithi064.stdout:4/87: write d0/f2 [4951589,77370] 0 2023-12-16T03:15:55.349 INFO:tasks.workunit.client.0.smithi064.stdout:4/88: write d0/da/f16 [643472,4509] 0 2023-12-16T03:15:55.350 INFO:tasks.workunit.client.0.smithi064.stdout:8/145: symlink d0/db/l31 0 2023-12-16T03:15:55.350 INFO:tasks.workunit.client.1.smithi184.stdout:9/564: dread d0/f8b [0,4194304] 0 2023-12-16T03:15:55.351 INFO:tasks.workunit.client.1.smithi184.stdout:9/565: fdatasync d0/f57 0 2023-12-16T03:15:55.351 INFO:tasks.workunit.client.1.smithi184.stdout:9/566: write d0/d13/d6e/d84/f9a [888937,84762] 0 2023-12-16T03:15:55.351 INFO:tasks.workunit.client.1.smithi184.stdout:9/567: write d0/d13/f24 [1475897,77176] 0 2023-12-16T03:15:55.353 INFO:tasks.workunit.client.0.smithi064.stdout:6/76: symlink d3/d8/da/l14 0 2023-12-16T03:15:55.357 INFO:tasks.workunit.client.0.smithi064.stdout:3/142: getdents db/d12/d1a/d2c 0 2023-12-16T03:15:55.359 INFO:tasks.workunit.client.0.smithi064.stdout:1/101: mkdir d3/d22 0 2023-12-16T03:15:55.360 INFO:tasks.workunit.client.0.smithi064.stdout:4/89: write d0/f5 [3881638,106239] 0 2023-12-16T03:15:55.361 INFO:tasks.workunit.client.0.smithi064.stdout:7/93: rename d7/l8 to d7/d13/l1e 0 2023-12-16T03:15:55.368 INFO:tasks.workunit.client.0.smithi064.stdout:1/102: dread f2 [0,4194304] 0 2023-12-16T03:15:55.370 INFO:tasks.workunit.client.0.smithi064.stdout:3/143: mknod db/c32 0 2023-12-16T03:15:55.372 INFO:tasks.workunit.client.0.smithi064.stdout:4/90: mknod d0/c1c 0 2023-12-16T03:15:55.373 INFO:tasks.workunit.client.0.smithi064.stdout:3/144: unlink db/d12/f23 0 2023-12-16T03:15:55.373 INFO:tasks.workunit.client.0.smithi064.stdout:3/145: truncate db/d12/f18 354444 0 2023-12-16T03:15:55.373 INFO:tasks.workunit.client.0.smithi064.stdout:3/146: stat db/d12/d21/c2e 0 2023-12-16T03:15:55.380 INFO:tasks.workunit.client.0.smithi064.stdout:9/83: dwrite d2/fa [0,4194304] 0 2023-12-16T03:15:55.381 INFO:tasks.workunit.client.0.smithi064.stdout:9/84: chown d2/dc/ff 348322456 1 2023-12-16T03:15:55.385 INFO:tasks.workunit.client.0.smithi064.stdout:1/103: dread d3/f13 [4194304,4194304] 0 2023-12-16T03:15:55.387 INFO:tasks.workunit.client.0.smithi064.stdout:2/109: dwrite d1/fa [0,4194304] 0 2023-12-16T03:15:55.387 INFO:tasks.workunit.client.0.smithi064.stdout:2/110: chown d1/fd 67635 1 2023-12-16T03:15:55.387 INFO:tasks.workunit.client.0.smithi064.stdout:2/111: write d1/f9 [828301,93079] 0 2023-12-16T03:15:55.388 INFO:tasks.workunit.client.0.smithi064.stdout:1/104: dread f2 [0,4194304] 0 2023-12-16T03:15:55.388 INFO:tasks.workunit.client.0.smithi064.stdout:1/105: chown d3/dd 14307 1 2023-12-16T03:15:55.389 INFO:tasks.workunit.client.0.smithi064.stdout:2/112: mkdir d1/d15/d1b 0 2023-12-16T03:15:55.389 INFO:tasks.workunit.client.0.smithi064.stdout:2/113: chown d1/f19 51523 1 2023-12-16T03:15:55.389 INFO:tasks.workunit.client.0.smithi064.stdout:2/114: read d1/d15/f18 [60708,19893] 0 2023-12-16T03:15:55.390 INFO:tasks.workunit.client.0.smithi064.stdout:1/106: mkdir d3/dd/d23 0 2023-12-16T03:15:55.392 INFO:tasks.workunit.client.0.smithi064.stdout:8/146: dwrite d0/db/d12/d1c/f1f [0,4194304] 0 2023-12-16T03:15:55.392 INFO:tasks.workunit.client.0.smithi064.stdout:8/147: chown d0/db/f22 6672962 1 2023-12-16T03:15:55.392 INFO:tasks.workunit.client.0.smithi064.stdout:6/77: dwrite d3/f5 [0,4194304] 0 2023-12-16T03:15:55.393 INFO:tasks.workunit.client.1.smithi184.stdout:9/568: dwrite d0/d13/d6e/d84/f9a [0,4194304] 0 2023-12-16T03:15:55.393 INFO:tasks.workunit.client.1.smithi184.stdout:6/431: sync 2023-12-16T03:15:55.395 INFO:tasks.workunit.client.1.smithi184.stdout:9/569: mknod d0/d13/d20/cc2 0 2023-12-16T03:15:55.396 INFO:tasks.workunit.client.1.smithi184.stdout:6/432: truncate d0/f18 3321098 0 2023-12-16T03:15:55.397 INFO:tasks.workunit.client.0.smithi064.stdout:1/107: write d3/f5 [4024246,6397] 0 2023-12-16T03:15:55.397 INFO:tasks.workunit.client.0.smithi064.stdout:8/148: rename d0/da/l2c to d0/da/d16/l32 0 2023-12-16T03:15:55.398 INFO:tasks.workunit.client.0.smithi064.stdout:8/149: stat d0/da 0 2023-12-16T03:15:55.398 INFO:tasks.workunit.client.1.smithi184.stdout:9/570: symlink d0/d13/d6e/d84/lc3 0 2023-12-16T03:15:55.398 INFO:tasks.workunit.client.1.smithi184.stdout:6/433: symlink d0/d5/d42/l88 0 2023-12-16T03:15:55.399 INFO:tasks.workunit.client.1.smithi184.stdout:6/434: creat d0/d5/d12/d1b/d33/d3d/f89 x:0 0 0 2023-12-16T03:15:55.402 INFO:tasks.workunit.client.0.smithi064.stdout:7/94: getdents d7 0 2023-12-16T03:15:55.402 INFO:tasks.workunit.client.0.smithi064.stdout:6/78: dread d3/fd [0,4194304] 0 2023-12-16T03:15:55.402 INFO:tasks.workunit.client.0.smithi064.stdout:6/79: truncate d3/d8/da/fe 1451800 0 2023-12-16T03:15:55.403 INFO:tasks.workunit.client.1.smithi184.stdout:6/435: rename d0/d5/d22/d37/d40 to d0/d36/d8a 0 2023-12-16T03:15:55.404 INFO:tasks.workunit.client.0.smithi064.stdout:2/115: dwrite d1/f19 [0,4194304] 0 2023-12-16T03:15:55.405 INFO:tasks.workunit.client.0.smithi064.stdout:6/80: write d3/fd [1382878,78996] 0 2023-12-16T03:15:55.411 INFO:tasks.workunit.client.0.smithi064.stdout:1/108: rename d3/dd/d11/c19 to d3/d22/c24 0 2023-12-16T03:15:55.411 INFO:tasks.workunit.client.0.smithi064.stdout:8/150: symlink d0/da/d16/l33 0 2023-12-16T03:15:55.411 INFO:tasks.workunit.client.0.smithi064.stdout:0/74: truncate d2/f5 2967322 0 2023-12-16T03:15:55.413 INFO:tasks.workunit.client.0.smithi064.stdout:7/95: unlink d7/fa 0 2023-12-16T03:15:55.419 INFO:tasks.workunit.client.0.smithi064.stdout:0/75: dread d2/f3 [0,4194304] 0 2023-12-16T03:15:55.419 INFO:tasks.workunit.client.0.smithi064.stdout:0/76: chown d2/d7 34978 1 2023-12-16T03:15:55.419 INFO:tasks.workunit.client.0.smithi064.stdout:1/109: unlink c1 0 2023-12-16T03:15:55.419 INFO:tasks.workunit.client.0.smithi064.stdout:1/110: fdatasync d3/dd/f1d 0 2023-12-16T03:15:55.420 INFO:tasks.workunit.client.0.smithi064.stdout:1/111: chown d3/dd/f1d 64 1 2023-12-16T03:15:55.420 INFO:tasks.workunit.client.0.smithi064.stdout:4/91: truncate d0/da/f16 465381 0 2023-12-16T03:15:55.420 INFO:tasks.workunit.client.0.smithi064.stdout:8/151: creat d0/db/f34 x:0 0 0 2023-12-16T03:15:55.420 INFO:tasks.workunit.client.0.smithi064.stdout:4/92: fsync d0/f1 0 2023-12-16T03:15:55.421 INFO:tasks.workunit.client.0.smithi064.stdout:7/96: link d7/d13/l1e d7/d13/l1f 0 2023-12-16T03:15:55.421 INFO:tasks.workunit.client.0.smithi064.stdout:7/97: truncate d7/d13/f1d 957146 0 2023-12-16T03:15:55.421 INFO:tasks.workunit.client.0.smithi064.stdout:7/98: dread - d7/f14 zero size 2023-12-16T03:15:55.422 INFO:tasks.workunit.client.0.smithi064.stdout:1/112: creat d3/f25 x:0 0 0 2023-12-16T03:15:55.424 INFO:tasks.workunit.client.0.smithi064.stdout:8/152: rename d0/db/f22 to d0/db/d12/d1c/f35 0 2023-12-16T03:15:55.426 INFO:tasks.workunit.client.0.smithi064.stdout:7/99: mkdir d7/d13/d20 0 2023-12-16T03:15:55.427 INFO:tasks.workunit.client.0.smithi064.stdout:1/113: creat d3/f26 x:0 0 0 2023-12-16T03:15:55.427 INFO:tasks.workunit.client.0.smithi064.stdout:1/114: dread - d3/dd/d11/f17 zero size 2023-12-16T03:15:55.427 INFO:tasks.workunit.client.0.smithi064.stdout:1/115: chown d3/dd/d11/c1e 0 1 2023-12-16T03:15:55.427 INFO:tasks.workunit.client.0.smithi064.stdout:8/153: truncate d0/da/fc 2299243 0 2023-12-16T03:15:55.429 INFO:tasks.workunit.client.0.smithi064.stdout:7/100: rename d7/d13/f12 to d7/d13/d20/f21 0 2023-12-16T03:15:55.430 INFO:tasks.workunit.client.0.smithi064.stdout:1/116: mknod d3/dd/c27 0 2023-12-16T03:15:55.432 INFO:tasks.workunit.client.0.smithi064.stdout:8/154: truncate d0/da/f23 3202234 0 2023-12-16T03:15:55.432 INFO:tasks.workunit.client.0.smithi064.stdout:8/155: chown d0/db/l31 223 1 2023-12-16T03:15:55.434 INFO:tasks.workunit.client.0.smithi064.stdout:7/101: dread d7/f9 [0,4194304] 0 2023-12-16T03:15:55.434 INFO:tasks.workunit.client.0.smithi064.stdout:7/102: truncate d7/d1c/f1b 476768 0 2023-12-16T03:15:55.434 INFO:tasks.workunit.client.0.smithi064.stdout:7/103: fsync d7/fb 0 2023-12-16T03:15:55.434 INFO:tasks.workunit.client.0.smithi064.stdout:8/156: creat d0/d1d/d24/f36 x:0 0 0 2023-12-16T03:15:55.434 INFO:tasks.workunit.client.0.smithi064.stdout:8/157: write d0/f3 [2577099,40188] 0 2023-12-16T03:15:55.435 INFO:tasks.workunit.client.0.smithi064.stdout:7/104: rename d7/d13/c18 to d7/d13/d20/c22 0 2023-12-16T03:15:55.436 INFO:tasks.workunit.client.0.smithi064.stdout:7/105: fsync d7/f9 0 2023-12-16T03:15:55.436 INFO:tasks.workunit.client.0.smithi064.stdout:7/106: readlink d7/d13/l1a 0 2023-12-16T03:15:55.437 INFO:tasks.workunit.client.0.smithi064.stdout:8/158: mkdir d0/db/d37 0 2023-12-16T03:15:55.439 INFO:tasks.workunit.client.0.smithi064.stdout:7/107: symlink d7/d13/l23 0 2023-12-16T03:15:55.439 INFO:tasks.workunit.client.0.smithi064.stdout:2/116: dwrite d1/f19 [0,4194304] 0 2023-12-16T03:15:55.439 INFO:tasks.workunit.client.0.smithi064.stdout:2/117: chown d1/l11 0 1 2023-12-16T03:15:55.439 INFO:tasks.workunit.client.1.smithi184.stdout:9/571: dwrite d0/d13/d20/d5b/d53/f81 [0,4194304] 0 2023-12-16T03:15:55.440 INFO:tasks.workunit.client.0.smithi064.stdout:8/159: mkdir d0/da/d16/d38 0 2023-12-16T03:15:55.440 INFO:tasks.workunit.client.0.smithi064.stdout:8/160: read - d0/d1d/d24/f36 zero size 2023-12-16T03:15:55.440 INFO:tasks.workunit.client.0.smithi064.stdout:6/81: dwrite d3/f5 [0,4194304] 0 2023-12-16T03:15:55.441 INFO:tasks.workunit.client.0.smithi064.stdout:7/108: symlink d7/d13/l24 0 2023-12-16T03:15:55.442 INFO:tasks.workunit.client.1.smithi184.stdout:6/436: dwrite d0/d5/d26/f82 [0,4194304] 0 2023-12-16T03:15:55.442 INFO:tasks.workunit.client.0.smithi064.stdout:2/118: symlink d1/d15/l1c 0 2023-12-16T03:15:55.446 INFO:tasks.workunit.client.0.smithi064.stdout:2/119: link d1/f8 d1/f1d 0 2023-12-16T03:15:55.446 INFO:tasks.workunit.client.0.smithi064.stdout:2/120: chown d1/d15 361 1 2023-12-16T03:15:55.446 INFO:tasks.workunit.client.0.smithi064.stdout:2/121: fsync d1/fd 0 2023-12-16T03:15:55.447 INFO:tasks.workunit.client.0.smithi064.stdout:6/82: write d3/f5 [77085,7575] 0 2023-12-16T03:15:55.447 INFO:tasks.workunit.client.0.smithi064.stdout:6/83: readlink d3/d8/da/l14 0 2023-12-16T03:15:55.447 INFO:tasks.workunit.client.0.smithi064.stdout:7/109: write d7/d13/d20/f21 [1811082,28515] 0 2023-12-16T03:15:55.448 INFO:tasks.workunit.client.0.smithi064.stdout:2/122: mkdir d1/d15/d1e 0 2023-12-16T03:15:55.448 INFO:tasks.workunit.client.0.smithi064.stdout:2/123: readlink d1/lb 0 2023-12-16T03:15:55.450 INFO:tasks.workunit.client.0.smithi064.stdout:7/110: creat d7/d1c/f25 x:0 0 0 2023-12-16T03:15:55.454 INFO:tasks.workunit.client.0.smithi064.stdout:7/111: mkdir d7/d26 0 2023-12-16T03:15:55.454 INFO:tasks.workunit.client.0.smithi064.stdout:5/146: sync 2023-12-16T03:15:55.454 INFO:tasks.workunit.client.0.smithi064.stdout:1/117: dwrite d3/f26 [0,4194304] 0 2023-12-16T03:15:55.454 INFO:tasks.workunit.client.0.smithi064.stdout:1/118: truncate d3/dd/d11/f17 680841 0 2023-12-16T03:15:55.455 INFO:tasks.workunit.client.0.smithi064.stdout:1/119: fsync f2 0 2023-12-16T03:15:55.455 INFO:tasks.workunit.client.0.smithi064.stdout:4/93: rmdir d0/da 39 2023-12-16T03:15:55.458 INFO:tasks.workunit.client.0.smithi064.stdout:6/84: dread d3/d9/fb [0,4194304] 0 2023-12-16T03:15:55.460 INFO:tasks.workunit.client.0.smithi064.stdout:5/147: creat d0/d14/d20/f38 x:0 0 0 2023-12-16T03:15:55.460 INFO:tasks.workunit.client.0.smithi064.stdout:5/148: fsync d0/d14/d20/f2f 0 2023-12-16T03:15:55.460 INFO:tasks.workunit.client.0.smithi064.stdout:5/149: fdatasync d0/d7/f1d 0 2023-12-16T03:15:55.461 INFO:tasks.workunit.client.0.smithi064.stdout:1/120: creat d3/d22/f28 x:0 0 0 2023-12-16T03:15:55.470 INFO:tasks.workunit.client.0.smithi064.stdout:4/94: read d0/da/f16 [242701,104284] 0 2023-12-16T03:15:55.472 INFO:tasks.workunit.client.0.smithi064.stdout:4/95: read d0/f5 [1399049,14181] 0 2023-12-16T03:15:55.473 INFO:tasks.workunit.client.0.smithi064.stdout:4/96: chown d0/d12 1082989 1 2023-12-16T03:15:55.473 INFO:tasks.workunit.client.0.smithi064.stdout:4/97: fsync d0/d12/d17/f1a 0 2023-12-16T03:15:55.473 INFO:tasks.workunit.client.0.smithi064.stdout:1/121: mknod d3/dd/d23/c29 0 2023-12-16T03:15:55.476 INFO:tasks.workunit.client.0.smithi064.stdout:4/98: creat d0/d12/d17/f1d x:0 0 0 2023-12-16T03:15:55.486 INFO:tasks.workunit.client.1.smithi184.stdout:6/437: dwrite d0/d5/d22/f29 [0,4194304] 0 2023-12-16T03:15:55.492 INFO:tasks.workunit.client.0.smithi064.stdout:4/99: dread d0/f5 [0,4194304] 0 2023-12-16T03:15:55.493 INFO:tasks.workunit.client.0.smithi064.stdout:4/100: truncate d0/f5 3608615 0 2023-12-16T03:15:55.493 INFO:tasks.workunit.client.0.smithi064.stdout:4/101: chown d0/l6 6 1 2023-12-16T03:15:55.502 INFO:tasks.workunit.client.1.smithi184.stdout:6/438: dread d0/d5/d22/f49 [0,4194304] 0 2023-12-16T03:15:55.502 INFO:tasks.workunit.client.1.smithi184.stdout:6/439: write d0/d5/d22/d34/d53/f5a [636978,102831] 0 2023-12-16T03:15:55.504 INFO:tasks.workunit.client.1.smithi184.stdout:9/572: dwrite d0/d13/d20/f86 [0,4194304] 0 2023-12-16T03:15:55.504 INFO:tasks.workunit.client.1.smithi184.stdout:9/573: write d0/d13/d20/d5b/f8e [68934,125872] 0 2023-12-16T03:15:55.505 INFO:tasks.workunit.client.0.smithi064.stdout:7/112: dwrite d7/d1c/f25 [0,4194304] 0 2023-12-16T03:15:55.505 INFO:tasks.workunit.client.0.smithi064.stdout:0/77: dwrite d2/f5 [0,4194304] 0 2023-12-16T03:15:55.505 INFO:tasks.workunit.client.0.smithi064.stdout:0/78: write d2/f3 [1823359,684] 0 2023-12-16T03:15:55.511 INFO:tasks.workunit.client.1.smithi184.stdout:9/574: unlink d0/d13/c62 0 2023-12-16T03:15:55.512 INFO:tasks.workunit.client.0.smithi064.stdout:5/150: dwrite d0/de/ff [0,4194304] 0 2023-12-16T03:15:55.513 INFO:tasks.workunit.client.1.smithi184.stdout:9/575: mkdir d0/d76/da2/dc4 0 2023-12-16T03:15:55.513 INFO:tasks.workunit.client.1.smithi184.stdout:9/576: chown d0/d13/d20/d77/c7e 198 1 2023-12-16T03:15:55.513 INFO:tasks.workunit.client.0.smithi064.stdout:0/79: symlink d2/d7/d10/l12 0 2023-12-16T03:15:55.513 INFO:tasks.workunit.client.1.smithi184.stdout:9/577: rmdir d0/d13/d20/d5b/d43 39 2023-12-16T03:15:55.514 INFO:tasks.workunit.client.1.smithi184.stdout:9/578: mknod d0/cc5 0 2023-12-16T03:15:55.514 INFO:tasks.workunit.client.1.smithi184.stdout:9/579: readlink d0/d13/d6e/l96 0 2023-12-16T03:15:55.514 INFO:tasks.workunit.client.1.smithi184.stdout:9/580: write d0/d3a/f70 [822046,65893] 0 2023-12-16T03:15:55.515 INFO:tasks.workunit.client.0.smithi064.stdout:0/80: symlink d2/d8/da/l13 0 2023-12-16T03:15:55.515 INFO:tasks.workunit.client.1.smithi184.stdout:9/581: symlink d0/d13/d6e/d84/lc6 0 2023-12-16T03:15:55.517 INFO:tasks.workunit.client.1.smithi184.stdout:9/582: mkdir d0/d13/d20/d5b/d43/dc7 0 2023-12-16T03:15:55.517 INFO:tasks.workunit.client.1.smithi184.stdout:9/583: write d0/d30/f41 [2283565,101214] 0 2023-12-16T03:15:55.517 INFO:tasks.workunit.client.1.smithi184.stdout:9/584: truncate d0/d13/d20/d5b/f8e 420147 0 2023-12-16T03:15:55.517 INFO:tasks.workunit.client.1.smithi184.stdout:9/585: fdatasync d0/f2f 0 2023-12-16T03:15:55.517 INFO:tasks.workunit.client.0.smithi064.stdout:5/151: write d0/f15 [682171,98812] 0 2023-12-16T03:15:55.517 INFO:tasks.workunit.client.0.smithi064.stdout:5/152: write d0/de/f36 [869395,26545] 0 2023-12-16T03:15:55.519 INFO:tasks.workunit.client.1.smithi184.stdout:9/586: creat d0/d3a/fc8 x:0 0 0 2023-12-16T03:15:55.520 INFO:tasks.workunit.client.0.smithi064.stdout:7/113: getdents d7 0 2023-12-16T03:15:55.525 INFO:tasks.workunit.client.0.smithi064.stdout:7/114: link d7/d13/f10 d7/d26/f27 0 2023-12-16T03:15:55.525 INFO:tasks.workunit.client.0.smithi064.stdout:2/124: dwrite d1/f9 [0,4194304] 0 2023-12-16T03:15:55.525 INFO:tasks.workunit.client.0.smithi064.stdout:2/125: fdatasync d1/f9 0 2023-12-16T03:15:55.527 INFO:tasks.workunit.client.0.smithi064.stdout:1/122: unlink d3/c9 0 2023-12-16T03:15:55.531 INFO:tasks.workunit.client.0.smithi064.stdout:7/115: creat d7/d13/d20/f28 x:0 0 0 2023-12-16T03:15:55.533 INFO:tasks.workunit.client.0.smithi064.stdout:2/126: truncate d1/f1d 662904 0 2023-12-16T03:15:55.536 INFO:tasks.workunit.client.0.smithi064.stdout:7/116: rename d7/d13/f10 to d7/d13/f29 0 2023-12-16T03:15:55.538 INFO:tasks.workunit.client.0.smithi064.stdout:2/127: creat d1/d15/f1f x:0 0 0 2023-12-16T03:15:55.540 INFO:tasks.workunit.client.0.smithi064.stdout:8/161: dwrite d0/f7 [0,4194304] 0 2023-12-16T03:15:55.540 INFO:tasks.workunit.client.0.smithi064.stdout:5/153: dread d0/d7/f1d [0,4194304] 0 2023-12-16T03:15:55.541 INFO:tasks.workunit.client.0.smithi064.stdout:5/154: chown d0/de/l10 110 1 2023-12-16T03:15:55.546 INFO:tasks.workunit.client.0.smithi064.stdout:8/162: write d0/da/d16/f1b [880614,71779] 0 2023-12-16T03:15:55.550 INFO:tasks.workunit.client.1.smithi184.stdout:6/440: dwrite d0/d5/d12/f32 [0,4194304] 0 2023-12-16T03:15:55.550 INFO:tasks.workunit.client.1.smithi184.stdout:6/441: fsync d0/d5/d22/d37/d4d/f5d 0 2023-12-16T03:15:55.551 INFO:tasks.workunit.client.0.smithi064.stdout:8/163: creat d0/d1d/d24/d2f/f39 x:0 0 0 2023-12-16T03:15:55.551 INFO:tasks.workunit.client.0.smithi064.stdout:8/164: getdents d0/da/d16/d18 0 2023-12-16T03:15:55.552 INFO:tasks.workunit.client.1.smithi184.stdout:9/587: dwrite d0/d3a/d47/fa9 [0,4194304] 0 2023-12-16T03:15:55.552 INFO:tasks.workunit.client.1.smithi184.stdout:9/588: fsync d0/d13/d20/d5b/f8e 0 2023-12-16T03:15:55.555 INFO:tasks.workunit.client.1.smithi184.stdout:6/442: dread d0/d5/d22/d25/d47/f73 [0,4194304] 0 2023-12-16T03:15:55.556 INFO:tasks.workunit.client.0.smithi064.stdout:4/102: dwrite d0/d12/d17/f1d [0,4194304] 0 2023-12-16T03:15:55.556 INFO:tasks.workunit.client.0.smithi064.stdout:6/85: dwrite d3/f5 [0,4194304] 0 2023-12-16T03:15:55.556 INFO:tasks.workunit.client.0.smithi064.stdout:4/103: readlink d0/d14/l19 0 2023-12-16T03:15:55.556 INFO:tasks.workunit.client.0.smithi064.stdout:5/155: dread d0/d7/fa [0,4194304] 0 2023-12-16T03:15:55.556 INFO:tasks.workunit.client.0.smithi064.stdout:1/123: truncate d3/f25 388127 0 2023-12-16T03:15:55.556 INFO:tasks.workunit.client.0.smithi064.stdout:1/124: chown d3/dd/f1d 4 1 2023-12-16T03:15:55.556 INFO:tasks.workunit.client.1.smithi184.stdout:9/589: link d0/d13/d20/c45 d0/d76/db2/cc9 0 2023-12-16T03:15:55.557 INFO:tasks.workunit.client.1.smithi184.stdout:6/443: rename d0/d5/d22/f41 to d0/d5/d22/d37/d4d/d87/f8b 0 2023-12-16T03:15:55.558 INFO:tasks.workunit.client.1.smithi184.stdout:9/590: truncate d0/d13/d20/d5b/f7f 1391855 0 2023-12-16T03:15:55.561 INFO:tasks.workunit.client.0.smithi064.stdout:1/125: mkdir d3/dd/d2a 0 2023-12-16T03:15:55.561 INFO:tasks.workunit.client.1.smithi184.stdout:6/444: unlink d0/d5/d12/f32 0 2023-12-16T03:15:55.562 INFO:tasks.workunit.client.1.smithi184.stdout:9/591: truncate d0/f1f 8386626 0 2023-12-16T03:15:55.563 INFO:tasks.workunit.client.0.smithi064.stdout:7/117: dread d7/d1c/f25 [0,4194304] 0 2023-12-16T03:15:55.563 INFO:tasks.workunit.client.0.smithi064.stdout:5/156: truncate d0/de/ff 2441950 0 2023-12-16T03:15:55.563 INFO:tasks.workunit.client.0.smithi064.stdout:2/128: dwrite d1/f4 [0,4194304] 0 2023-12-16T03:15:55.567 INFO:tasks.workunit.client.1.smithi184.stdout:9/592: link d0/d3a/d47/l64 d0/d13/d6e/d9f/lca 0 2023-12-16T03:15:55.567 INFO:tasks.workunit.client.0.smithi064.stdout:7/118: rename d7/d13/c11 to d7/d13/d20/c2a 0 2023-12-16T03:15:55.567 INFO:tasks.workunit.client.0.smithi064.stdout:0/81: dwrite d2/f5 [0,4194304] 0 2023-12-16T03:15:55.567 INFO:tasks.workunit.client.0.smithi064.stdout:8/165: dread d0/da/fc [0,4194304] 0 2023-12-16T03:15:55.567 INFO:tasks.workunit.client.0.smithi064.stdout:4/104: write d0/f1 [1960195,122504] 0 2023-12-16T03:15:55.567 INFO:tasks.workunit.client.0.smithi064.stdout:4/105: chown d0/da 16326 1 2023-12-16T03:15:55.568 INFO:tasks.workunit.client.0.smithi064.stdout:4/106: chown d0/d12/d17/f1d 40 1 2023-12-16T03:15:55.568 INFO:tasks.workunit.client.0.smithi064.stdout:9/85: sync 2023-12-16T03:15:55.568 INFO:tasks.workunit.client.0.smithi064.stdout:3/147: sync 2023-12-16T03:15:55.570 INFO:tasks.workunit.client.1.smithi184.stdout:6/445: write d0/f18 [2486084,99008] 0 2023-12-16T03:15:55.570 INFO:tasks.workunit.client.1.smithi184.stdout:9/593: truncate d0/d3a/f9b 558679 0 2023-12-16T03:15:55.575 INFO:tasks.workunit.client.1.smithi184.stdout:6/446: dread d0/d5/d26/f75 [0,4194304] 0 2023-12-16T03:15:55.575 INFO:tasks.workunit.client.1.smithi184.stdout:6/447: fdatasync d0/d5/d26/f82 0 2023-12-16T03:15:55.576 INFO:tasks.workunit.client.1.smithi184.stdout:6/448: chown d0/d5/d22/d34 193023 1 2023-12-16T03:15:55.577 INFO:tasks.workunit.client.0.smithi064.stdout:8/166: mkdir d0/db/d37/d3a 0 2023-12-16T03:15:55.577 INFO:tasks.workunit.client.0.smithi064.stdout:7/119: mknod d7/d26/c2b 0 2023-12-16T03:15:55.577 INFO:tasks.workunit.client.0.smithi064.stdout:7/120: stat d7/fb 0 2023-12-16T03:15:55.577 INFO:tasks.workunit.client.0.smithi064.stdout:7/121: chown d7 12 1 2023-12-16T03:15:55.577 INFO:tasks.workunit.client.0.smithi064.stdout:9/86: dread d2/dc/f12 [0,4194304] 0 2023-12-16T03:15:55.578 INFO:tasks.workunit.client.1.smithi184.stdout:6/449: rename d0/d5/d22/d37/d45/l77 to d0/d5/l8c 0 2023-12-16T03:15:55.578 INFO:tasks.workunit.client.0.smithi064.stdout:4/107: rmdir d0/d12 39 2023-12-16T03:15:55.579 INFO:tasks.workunit.client.1.smithi184.stdout:6/450: symlink d0/d5/d22/d37/d4d/d87/l8d 0 2023-12-16T03:15:55.579 INFO:tasks.workunit.client.0.smithi064.stdout:8/167: rename d0/da/c25 to d0/d1d/c3b 0 2023-12-16T03:15:55.579 INFO:tasks.workunit.client.0.smithi064.stdout:9/87: mkdir d2/d16 0 2023-12-16T03:15:55.579 INFO:tasks.workunit.client.0.smithi064.stdout:9/88: chown d2/c3 1882922 1 2023-12-16T03:15:55.580 INFO:tasks.workunit.client.0.smithi064.stdout:4/108: unlink d0/c1c 0 2023-12-16T03:15:55.581 INFO:tasks.workunit.client.0.smithi064.stdout:8/168: mkdir d0/d1d/d3c 0 2023-12-16T03:15:55.581 INFO:tasks.workunit.client.0.smithi064.stdout:8/169: write d0/db/d12/f15 [3904278,35273] 0 2023-12-16T03:15:55.583 INFO:tasks.workunit.client.0.smithi064.stdout:8/170: write d0/f7 [3987139,113911] 0 2023-12-16T03:15:55.583 INFO:tasks.workunit.client.0.smithi064.stdout:3/148: write f6 [1443856,94679] 0 2023-12-16T03:15:55.583 INFO:tasks.workunit.client.0.smithi064.stdout:9/89: rename d2/l4 to d2/dc/l17 0 2023-12-16T03:15:55.585 INFO:tasks.workunit.client.0.smithi064.stdout:8/171: mknod d0/c3d 0 2023-12-16T03:15:55.586 INFO:tasks.workunit.client.0.smithi064.stdout:3/149: creat db/d12/d21/f33 x:0 0 0 2023-12-16T03:15:55.586 INFO:tasks.workunit.client.0.smithi064.stdout:9/90: symlink d2/d16/l18 0 2023-12-16T03:15:55.588 INFO:tasks.workunit.client.0.smithi064.stdout:3/150: mkdir db/d12/d1a/d2c/d34 0 2023-12-16T03:15:55.591 INFO:tasks.workunit.client.0.smithi064.stdout:1/126: dwrite d3/dd/f1a [0,4194304] 0 2023-12-16T03:15:55.591 INFO:tasks.workunit.client.0.smithi064.stdout:1/127: chown f2 10231 1 2023-12-16T03:15:55.592 INFO:tasks.workunit.client.1.smithi184.stdout:1/421: sync 2023-12-16T03:15:55.592 INFO:tasks.workunit.client.1.smithi184.stdout:5/291: sync 2023-12-16T03:15:55.592 INFO:tasks.workunit.client.1.smithi184.stdout:1/422: chown d3/d28/d3c/d41/d46/f69 528675612 1 2023-12-16T03:15:55.592 INFO:tasks.workunit.client.1.smithi184.stdout:1/423: truncate d3/d34/f4e 754851 0 2023-12-16T03:15:55.594 INFO:tasks.workunit.client.1.smithi184.stdout:5/292: read d1/d3/d9/de/d15/f1e [567320,88861] 0 2023-12-16T03:15:55.595 INFO:tasks.workunit.client.0.smithi064.stdout:6/86: dwrite d3/f5 [0,4194304] 0 2023-12-16T03:15:55.596 INFO:tasks.workunit.client.1.smithi184.stdout:1/424: truncate d3/d28/d36/f48 605486 0 2023-12-16T03:15:55.596 INFO:tasks.workunit.client.1.smithi184.stdout:1/425: write d3/d28/d38/f86 [422670,26763] 0 2023-12-16T03:15:55.596 INFO:tasks.workunit.client.1.smithi184.stdout:5/293: creat d1/d3/d9/de/d15/f61 x:0 0 0 2023-12-16T03:15:55.596 INFO:tasks.workunit.client.0.smithi064.stdout:4/109: dread d0/f8 [0,4194304] 0 2023-12-16T03:15:55.597 INFO:tasks.workunit.client.0.smithi064.stdout:3/151: rename db/lf to db/d12/d21/d2b/l35 0 2023-12-16T03:15:55.599 INFO:tasks.workunit.client.1.smithi184.stdout:5/294: creat d1/d3/f62 x:0 0 0 2023-12-16T03:15:55.599 INFO:tasks.workunit.client.1.smithi184.stdout:5/295: chown d1/d3/d9/de/d15/d19/d5f/d45 214971 1 2023-12-16T03:15:55.600 INFO:tasks.workunit.client.1.smithi184.stdout:5/296: creat d1/d2a/d31/f63 x:0 0 0 2023-12-16T03:15:55.605 INFO:tasks.workunit.client.1.smithi184.stdout:9/594: dread d0/d3a/f9b [0,4194304] 0 2023-12-16T03:15:55.605 INFO:tasks.workunit.client.0.smithi064.stdout:6/87: creat d3/d9/f15 x:0 0 0 2023-12-16T03:15:55.607 INFO:tasks.workunit.client.0.smithi064.stdout:3/152: mknod db/d12/d1a/c36 0 2023-12-16T03:15:55.609 INFO:tasks.workunit.client.0.smithi064.stdout:1/128: link d3/lc d3/dd/d2a/l2b 0 2023-12-16T03:15:55.609 INFO:tasks.workunit.client.0.smithi064.stdout:1/129: fsync d3/dd/d11/f1f 0 2023-12-16T03:15:55.610 INFO:tasks.workunit.client.0.smithi064.stdout:6/88: rmdir d3/d8/da 39 2023-12-16T03:15:55.611 INFO:tasks.workunit.client.0.smithi064.stdout:6/89: truncate d3/d9/f15 335036 0 2023-12-16T03:15:55.612 INFO:tasks.workunit.client.0.smithi064.stdout:4/110: mkdir d0/d1e 0 2023-12-16T03:15:55.613 INFO:tasks.workunit.client.0.smithi064.stdout:3/153: dread - db/d12/d21/d2b/f2f zero size 2023-12-16T03:15:55.615 INFO:tasks.workunit.client.0.smithi064.stdout:1/130: fdatasync d3/f5 0 2023-12-16T03:15:55.615 INFO:tasks.workunit.client.0.smithi064.stdout:1/131: fdatasync d3/dd/d11/f17 0 2023-12-16T03:15:55.617 INFO:tasks.workunit.client.0.smithi064.stdout:4/111: symlink d0/d1e/l1f 0 2023-12-16T03:15:55.619 INFO:tasks.workunit.client.0.smithi064.stdout:3/154: symlink db/d12/d1a/d31/l37 0 2023-12-16T03:15:55.619 INFO:tasks.workunit.client.0.smithi064.stdout:3/155: chown c8 29 1 2023-12-16T03:15:55.621 INFO:tasks.workunit.client.0.smithi064.stdout:1/132: creat d3/dd/d23/f2c x:0 0 0 2023-12-16T03:15:55.624 INFO:tasks.workunit.client.0.smithi064.stdout:4/112: symlink d0/d12/l20 0 2023-12-16T03:15:55.625 INFO:tasks.workunit.client.0.smithi064.stdout:1/133: write d3/d22/f28 [790406,130974] 0 2023-12-16T03:15:55.627 INFO:tasks.workunit.client.0.smithi064.stdout:1/134: creat d3/dd/f2d x:0 0 0 2023-12-16T03:15:55.628 INFO:tasks.workunit.client.0.smithi064.stdout:1/135: creat d3/d22/f2e x:0 0 0 2023-12-16T03:15:55.628 INFO:tasks.workunit.client.0.smithi064.stdout:1/136: readlink l0 0 2023-12-16T03:15:55.628 INFO:tasks.workunit.client.0.smithi064.stdout:1/137: chown d3/dd/c14 357666 1 2023-12-16T03:15:55.628 INFO:tasks.workunit.client.0.smithi064.stdout:4/113: write d0/d12/d17/f1d [1924302,107635] 0 2023-12-16T03:15:55.629 INFO:tasks.workunit.client.0.smithi064.stdout:1/138: mkdir d3/dd/d11/d2f 0 2023-12-16T03:15:55.631 INFO:tasks.workunit.client.0.smithi064.stdout:4/114: creat d0/d12/d17/f21 x:0 0 0 2023-12-16T03:15:55.634 INFO:tasks.workunit.client.0.smithi064.stdout:4/115: symlink d0/d14/l22 0 2023-12-16T03:15:55.634 INFO:tasks.workunit.client.0.smithi064.stdout:1/139: symlink d3/l30 0 2023-12-16T03:15:55.634 INFO:tasks.workunit.client.0.smithi064.stdout:1/140: write d3/d22/f28 [1826103,26843] 0 2023-12-16T03:15:55.636 INFO:tasks.workunit.client.0.smithi064.stdout:9/91: dwrite f1 [0,4194304] 0 2023-12-16T03:15:55.637 INFO:tasks.workunit.client.0.smithi064.stdout:1/141: rename l0 to d3/dd/d2a/l31 0 2023-12-16T03:15:55.637 INFO:tasks.workunit.client.0.smithi064.stdout:1/142: readlink d3/dd/l20 0 2023-12-16T03:15:55.638 INFO:tasks.workunit.client.1.smithi184.stdout:6/451: dwrite d0/d5/f1f [0,4194304] 0 2023-12-16T03:15:55.638 INFO:tasks.workunit.client.1.smithi184.stdout:6/452: truncate d0/d5/d22/d25/d47/f64 848488 0 2023-12-16T03:15:55.640 INFO:tasks.workunit.client.0.smithi064.stdout:1/143: unlink d3/dd/f1d 0 2023-12-16T03:15:55.641 INFO:tasks.workunit.client.0.smithi064.stdout:1/144: creat d3/d22/f32 x:0 0 0 2023-12-16T03:15:55.644 INFO:tasks.workunit.client.0.smithi064.stdout:5/157: truncate d0/f3 904433 0 2023-12-16T03:15:55.647 INFO:tasks.workunit.client.0.smithi064.stdout:5/158: mkdir d0/d14/d20/d29/d39 0 2023-12-16T03:15:55.647 INFO:tasks.workunit.client.0.smithi064.stdout:5/159: fdatasync d0/f32 0 2023-12-16T03:15:55.648 INFO:tasks.workunit.client.0.smithi064.stdout:1/145: dread d3/fe [0,4194304] 0 2023-12-16T03:15:55.648 INFO:tasks.workunit.client.0.smithi064.stdout:1/146: truncate d3/dd/d23/f2c 134029 0 2023-12-16T03:15:55.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/595: dwrite d0/d13/d20/f28 [0,4194304] 0 2023-12-16T03:15:55.649 INFO:tasks.workunit.client.1.smithi184.stdout:5/297: dwrite d1/d3/d9/de/d15/d19/f23 [0,4194304] 0 2023-12-16T03:15:55.650 INFO:tasks.workunit.client.0.smithi064.stdout:8/172: dwrite d0/db/f34 [0,4194304] 0 2023-12-16T03:15:55.650 INFO:tasks.workunit.client.0.smithi064.stdout:5/160: creat d0/d14/d20/d29/d39/f3a x:0 0 0 2023-12-16T03:15:55.651 INFO:tasks.workunit.client.1.smithi184.stdout:9/596: truncate d0/d13/f24 2053400 0 2023-12-16T03:15:55.651 INFO:tasks.workunit.client.1.smithi184.stdout:5/298: mkdir d1/d2a/d64 0 2023-12-16T03:15:55.651 INFO:tasks.workunit.client.1.smithi184.stdout:9/597: mkdir d0/d13/d20/db0/dcb 0 2023-12-16T03:15:55.652 INFO:tasks.workunit.client.0.smithi064.stdout:1/147: unlink d3/dd/l16 0 2023-12-16T03:15:55.653 INFO:tasks.workunit.client.1.smithi184.stdout:9/598: creat d0/d76/db7/fcc x:0 0 0 2023-12-16T03:15:55.653 INFO:tasks.workunit.client.0.smithi064.stdout:7/122: dwrite d7/d13/d20/f21 [0,4194304] 0 2023-12-16T03:15:55.653 INFO:tasks.workunit.client.0.smithi064.stdout:7/123: dread - d7/f14 zero size 2023-12-16T03:15:55.653 INFO:tasks.workunit.client.0.smithi064.stdout:7/124: stat d7/d26/f27 0 2023-12-16T03:15:55.654 INFO:tasks.workunit.client.0.smithi064.stdout:7/125: chown d7/d13/d20 1938985980 1 2023-12-16T03:15:55.657 INFO:tasks.workunit.client.0.smithi064.stdout:8/173: mkdir d0/da/d3e 0 2023-12-16T03:15:55.657 INFO:tasks.workunit.client.0.smithi064.stdout:5/161: rename d0/d19/l28 to d0/d14/d20/d29/d39/l3b 0 2023-12-16T03:15:55.657 INFO:tasks.workunit.client.0.smithi064.stdout:5/162: read - d0/d7/f1a zero size 2023-12-16T03:15:55.657 INFO:tasks.workunit.client.0.smithi064.stdout:8/174: write d0/f14 [2911030,12392] 0 2023-12-16T03:15:55.657 INFO:tasks.workunit.client.0.smithi064.stdout:8/175: stat d0/d1d/d24/d2f/f39 0 2023-12-16T03:15:55.659 INFO:tasks.workunit.client.1.smithi184.stdout:9/599: rename d0/d3a/c80 to d0/d76/ccd 0 2023-12-16T03:15:55.659 INFO:tasks.workunit.client.0.smithi064.stdout:8/176: mknod d0/db/d12/c3f 0 2023-12-16T03:15:55.659 INFO:tasks.workunit.client.0.smithi064.stdout:8/177: chown d0/db/d12/d1c/c2d 14368099 1 2023-12-16T03:15:55.660 INFO:tasks.workunit.client.0.smithi064.stdout:8/178: mkdir d0/d1d/d3c/d40 0 2023-12-16T03:15:55.660 INFO:tasks.workunit.client.0.smithi064.stdout:8/179: dread - d0/db/d12/f21 zero size 2023-12-16T03:15:55.660 INFO:tasks.workunit.client.0.smithi064.stdout:8/180: dread - d0/db/d12/f21 zero size 2023-12-16T03:15:55.661 INFO:tasks.workunit.client.0.smithi064.stdout:8/181: creat d0/d1d/d24/d2f/f41 x:0 0 0 2023-12-16T03:15:55.662 INFO:tasks.workunit.client.1.smithi184.stdout:9/600: dread d0/d30/f94 [0,4194304] 0 2023-12-16T03:15:55.664 INFO:tasks.workunit.client.0.smithi064.stdout:3/156: dwrite db/d13/f24 [0,4194304] 0 2023-12-16T03:15:55.664 INFO:tasks.workunit.client.1.smithi184.stdout:6/453: dwrite d0/d5/d22/d25/d3f/f81 [0,4194304] 0 2023-12-16T03:15:55.665 INFO:tasks.workunit.client.0.smithi064.stdout:8/182: rmdir d0/da/d16/d18 0 2023-12-16T03:15:55.667 INFO:tasks.workunit.client.0.smithi064.stdout:3/157: write f6 [114106,12664] 0 2023-12-16T03:15:55.669 INFO:tasks.workunit.client.0.smithi064.stdout:3/158: creat db/d12/d1a/f38 x:0 0 0 2023-12-16T03:15:55.670 INFO:tasks.workunit.client.0.smithi064.stdout:3/159: mkdir db/d13/d39 0 2023-12-16T03:15:55.673 INFO:tasks.workunit.client.0.smithi064.stdout:9/92: dwrite d2/fa [0,4194304] 0 2023-12-16T03:15:55.673 INFO:tasks.workunit.client.0.smithi064.stdout:3/160: rename db/c11 to db/d12/d21/c3a 0 2023-12-16T03:15:55.675 INFO:tasks.workunit.client.0.smithi064.stdout:9/93: rename d2/dc/c14 to d2/dc/c19 0 2023-12-16T03:15:55.675 INFO:tasks.workunit.client.0.smithi064.stdout:9/94: readlink d2/dc/l17 0 2023-12-16T03:15:55.686 INFO:tasks.workunit.client.1.smithi184.stdout:5/299: dwrite d1/d2a/d31/f54 [0,4194304] 0 2023-12-16T03:15:55.686 INFO:tasks.workunit.client.1.smithi184.stdout:5/300: chown d1/d3/d9/l47 48749 1 2023-12-16T03:15:55.687 INFO:tasks.workunit.client.1.smithi184.stdout:5/301: chown d1/d3/d9/de/d15/f1e 41029402 1 2023-12-16T03:15:55.689 INFO:tasks.workunit.client.1.smithi184.stdout:5/302: creat d1/d2a/d31/d28/f65 x:0 0 0 2023-12-16T03:15:55.689 INFO:tasks.workunit.client.1.smithi184.stdout:5/303: creat d1/f66 x:0 0 0 2023-12-16T03:15:55.689 INFO:tasks.workunit.client.1.smithi184.stdout:5/304: chown d1/d3/d9/de/d15/d19/d5f/f4f 845 1 2023-12-16T03:15:55.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:55 smithi064 ceph-mon[111958]: pgmap v192: 65 pgs: 65 active+clean; 807 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 48 MiB/s rd, 93 MiB/s wr, 697 op/s 2023-12-16T03:15:55.709 INFO:tasks.workunit.client.1.smithi184.stdout:5/305: dwrite d1/d3/fa [0,4194304] 0 2023-12-16T03:15:55.709 INFO:tasks.workunit.client.1.smithi184.stdout:5/306: chown d1/d2a/d31/c1f 290668 1 2023-12-16T03:15:55.710 INFO:tasks.workunit.client.1.smithi184.stdout:5/307: creat d1/d3/d9/d2e/f67 x:0 0 0 2023-12-16T03:15:55.710 INFO:tasks.workunit.client.1.smithi184.stdout:5/308: fdatasync d1/d3/d9/de/f37 0 2023-12-16T03:15:55.711 INFO:tasks.workunit.client.1.smithi184.stdout:5/309: readlink d1/d3/d9/d2e/l4a 0 2023-12-16T03:15:55.712 INFO:tasks.workunit.client.1.smithi184.stdout:5/310: mkdir d1/d3/d9/de/d30/d68 0 2023-12-16T03:15:55.712 INFO:tasks.workunit.client.1.smithi184.stdout:5/311: unlink d1/d3/d9/d2e/f5c 0 2023-12-16T03:15:55.713 INFO:tasks.workunit.client.1.smithi184.stdout:5/312: mknod d1/d3/d9/de/d30/d68/c69 0 2023-12-16T03:15:55.736 INFO:tasks.workunit.client.1.smithi184.stdout:9/601: dwrite d0/d30/f41 [0,4194304] 0 2023-12-16T03:15:55.737 INFO:tasks.workunit.client.1.smithi184.stdout:9/602: dread - d0/d13/d20/db0/f7c zero size 2023-12-16T03:15:55.737 INFO:tasks.workunit.client.1.smithi184.stdout:9/603: truncate d0/d3a/d47/fa9 40522 0 2023-12-16T03:15:55.737 INFO:tasks.workunit.client.1.smithi184.stdout:9/604: stat d0/d13/d20/d5b/f7f 0 2023-12-16T03:15:55.738 INFO:tasks.workunit.client.1.smithi184.stdout:9/605: unlink d0/d13/d20/d77/f54 0 2023-12-16T03:15:55.739 INFO:tasks.workunit.client.1.smithi184.stdout:9/606: symlink d0/d13/d6e/d9f/lce 0 2023-12-16T03:15:55.739 INFO:tasks.workunit.client.1.smithi184.stdout:9/607: chown d0/d13/d20/d5b/c50 7604 1 2023-12-16T03:15:55.740 INFO:tasks.workunit.client.0.smithi064.stdout:3/161: dwrite db/d12/d21/f30 [0,4194304] 0 2023-12-16T03:15:55.741 INFO:tasks.workunit.client.1.smithi184.stdout:9/608: symlink d0/lcf 0 2023-12-16T03:15:55.741 INFO:tasks.workunit.client.1.smithi184.stdout:6/454: dwrite d0/d5/d22/d25/d47/f73 [0,4194304] 0 2023-12-16T03:15:55.741 INFO:tasks.workunit.client.1.smithi184.stdout:6/455: read d0/d5/f59 [356632,27915] 0 2023-12-16T03:15:55.747 INFO:tasks.workunit.client.0.smithi064.stdout:5/163: dwrite d0/d7/f1d [0,4194304] 0 2023-12-16T03:15:55.747 INFO:tasks.workunit.client.0.smithi064.stdout:5/164: readlink d0/d7/l18 0 2023-12-16T03:15:55.747 INFO:tasks.workunit.client.0.smithi064.stdout:8/183: getdents d0/d1d/d3c 0 2023-12-16T03:15:55.749 INFO:tasks.workunit.client.1.smithi184.stdout:0/501: sync 2023-12-16T03:15:55.751 INFO:tasks.workunit.client.1.smithi184.stdout:5/313: dwrite d1/d3/d9/de/d15/f57 [4194304,4194304] 0 2023-12-16T03:15:55.755 INFO:tasks.workunit.client.1.smithi184.stdout:5/314: rename d1/d3/d2f/c5b to d1/d2a/d31/d58/c6a 0 2023-12-16T03:15:55.755 INFO:tasks.workunit.client.0.smithi064.stdout:9/95: getdents d2/dc 0 2023-12-16T03:15:55.755 INFO:tasks.workunit.client.0.smithi064.stdout:3/162: rmdir db/d12/d21 39 2023-12-16T03:15:55.755 INFO:tasks.workunit.client.0.smithi064.stdout:9/96: chown d2/fb 374 1 2023-12-16T03:15:55.757 INFO:tasks.workunit.client.1.smithi184.stdout:5/315: creat d1/d2a/d64/f6b x:0 0 0 2023-12-16T03:15:55.757 INFO:tasks.workunit.client.0.smithi064.stdout:5/165: mkdir d0/d14/d20/d37/d3c 0 2023-12-16T03:15:55.757 INFO:tasks.workunit.client.0.smithi064.stdout:8/184: mkdir d0/d1d/d3c/d42 0 2023-12-16T03:15:55.758 INFO:tasks.workunit.client.0.smithi064.stdout:3/163: link f0 db/d12/f3b 0 2023-12-16T03:15:55.759 INFO:tasks.workunit.client.0.smithi064.stdout:9/97: symlink d2/dc/l1a 0 2023-12-16T03:15:55.760 INFO:tasks.workunit.client.0.smithi064.stdout:5/166: creat d0/d14/d20/f3d x:0 0 0 2023-12-16T03:15:55.760 INFO:tasks.workunit.client.0.smithi064.stdout:5/167: dread - d0/d14/d20/d29/d39/f3a zero size 2023-12-16T03:15:55.760 INFO:tasks.workunit.client.0.smithi064.stdout:8/185: creat d0/db/d37/f43 x:0 0 0 2023-12-16T03:15:55.761 INFO:tasks.workunit.client.0.smithi064.stdout:8/186: write d0/da/f23 [681892,63310] 0 2023-12-16T03:15:55.761 INFO:tasks.workunit.client.0.smithi064.stdout:8/187: chown d0/d1d/d24/l17 727976 1 2023-12-16T03:15:55.761 INFO:tasks.workunit.client.0.smithi064.stdout:3/164: link db/d12/d21/l22 db/d12/d1a/d2c/l3c 0 2023-12-16T03:15:55.762 INFO:tasks.workunit.client.0.smithi064.stdout:3/165: chown db/fd 141362693 1 2023-12-16T03:15:55.762 INFO:tasks.workunit.client.1.smithi184.stdout:5/316: write d1/f1a [648441,29194] 0 2023-12-16T03:15:55.762 INFO:tasks.workunit.client.0.smithi064.stdout:9/98: truncate d2/dc/f15 1559985 0 2023-12-16T03:15:55.763 INFO:tasks.workunit.client.0.smithi064.stdout:5/168: rmdir d0/d14 39 2023-12-16T03:15:55.764 INFO:tasks.workunit.client.0.smithi064.stdout:8/188: mkdir d0/db/d12/d44 0 2023-12-16T03:15:55.764 INFO:tasks.workunit.client.0.smithi064.stdout:8/189: chown d0/db/d12 39 1 2023-12-16T03:15:55.766 INFO:tasks.workunit.client.1.smithi184.stdout:9/609: dwrite d0/d13/f24 [0,4194304] 0 2023-12-16T03:15:55.766 INFO:tasks.workunit.client.1.smithi184.stdout:6/456: dwrite d0/d5/d42/f80 [0,4194304] 0 2023-12-16T03:15:55.767 INFO:tasks.workunit.client.0.smithi064.stdout:3/166: unlink f0 0 2023-12-16T03:15:55.767 INFO:tasks.workunit.client.1.smithi184.stdout:9/610: write d0/d13/f21 [966549,55822] 0 2023-12-16T03:15:55.769 INFO:tasks.workunit.client.0.smithi064.stdout:5/169: rename d0/d14/d20/d29/d2a to d0/d14/d25/d3e 0 2023-12-16T03:15:55.771 INFO:tasks.workunit.client.0.smithi064.stdout:8/190: symlink d0/da/d16/l45 0 2023-12-16T03:15:55.773 INFO:tasks.workunit.client.1.smithi184.stdout:6/457: mknod d0/d5/d22/d25/c8e 0 2023-12-16T03:15:55.773 INFO:tasks.workunit.client.1.smithi184.stdout:6/458: chown d0/d5/d12/d1b/d33/d3d/l65 277495813 1 2023-12-16T03:15:55.775 INFO:tasks.workunit.client.0.smithi064.stdout:3/167: rename db/d12/d21/d2b/f2f to db/d12/d1a/d2c/d34/f3d 0 2023-12-16T03:15:55.775 INFO:tasks.workunit.client.0.smithi064.stdout:5/170: creat d0/de/d23/f3f x:0 0 0 2023-12-16T03:15:55.775 INFO:tasks.workunit.client.0.smithi064.stdout:3/168: write db/d12/f27 [417708,121619] 0 2023-12-16T03:15:55.775 INFO:tasks.workunit.client.0.smithi064.stdout:3/169: chown db/d13/f24 27263243 1 2023-12-16T03:15:55.776 INFO:tasks.workunit.client.1.smithi184.stdout:9/611: unlink d0/d13/d6e/d84/l6a 0 2023-12-16T03:15:55.777 INFO:tasks.workunit.client.1.smithi184.stdout:6/459: rename d0/d5/d26/f62 to d0/d5/d22/d25/d47/f8f 0 2023-12-16T03:15:55.779 INFO:tasks.workunit.client.1.smithi184.stdout:9/612: mkdir d0/d76/da2/dc4/dd0 0 2023-12-16T03:15:55.780 INFO:tasks.workunit.client.0.smithi064.stdout:8/191: write d0/db/f34 [478935,45830] 0 2023-12-16T03:15:55.780 INFO:tasks.workunit.client.0.smithi064.stdout:8/192: chown d0/da/fc 8 1 2023-12-16T03:15:55.780 INFO:tasks.workunit.client.0.smithi064.stdout:8/193: stat d0/d1d 0 2023-12-16T03:15:55.780 INFO:tasks.workunit.client.0.smithi064.stdout:8/194: readlink d0/da/d16/l32 0 2023-12-16T03:15:55.783 INFO:tasks.workunit.client.1.smithi184.stdout:9/613: unlink d0/d76/db2/cb5 0 2023-12-16T03:15:55.783 INFO:tasks.workunit.client.0.smithi064.stdout:8/195: mkdir d0/da/d3e/d46 0 2023-12-16T03:15:55.784 INFO:tasks.workunit.client.0.smithi064.stdout:8/196: write d0/da/fc [4319456,93496] 0 2023-12-16T03:15:55.784 INFO:tasks.workunit.client.0.smithi064.stdout:8/197: write d0/d1d/f20 [447024,93732] 0 2023-12-16T03:15:55.785 INFO:tasks.workunit.client.0.smithi064.stdout:8/198: symlink d0/d1d/d24/d2f/l47 0 2023-12-16T03:15:55.785 INFO:tasks.workunit.client.0.smithi064.stdout:3/170: dread db/d12/d21/f30 [0,4194304] 0 2023-12-16T03:15:55.786 INFO:tasks.workunit.client.0.smithi064.stdout:2/129: sync 2023-12-16T03:15:55.786 INFO:tasks.workunit.client.0.smithi064.stdout:2/130: fdatasync d1/f10 0 2023-12-16T03:15:55.786 INFO:tasks.workunit.client.0.smithi064.stdout:8/199: mkdir d0/d1d/d48 0 2023-12-16T03:15:55.788 INFO:tasks.workunit.client.0.smithi064.stdout:2/131: symlink d1/d15/d1b/l20 0 2023-12-16T03:15:55.789 INFO:tasks.workunit.client.1.smithi184.stdout:6/460: dread d0/d5/f2c [0,4194304] 0 2023-12-16T03:15:55.790 INFO:tasks.workunit.client.0.smithi064.stdout:2/132: unlink d1/f19 0 2023-12-16T03:15:55.791 INFO:tasks.workunit.client.1.smithi184.stdout:6/461: mkdir d0/d5/d22/d37/d45/d90 0 2023-12-16T03:15:55.791 INFO:tasks.workunit.client.1.smithi184.stdout:6/462: fsync d0/d5/f2c 0 2023-12-16T03:15:55.796 INFO:tasks.workunit.client.1.smithi184.stdout:5/317: dwrite d1/d3/fd [4194304,4194304] 0 2023-12-16T03:15:55.796 INFO:tasks.workunit.client.1.smithi184.stdout:5/318: chown d1/d3/d9/de/d15/d19/f2c 14062 1 2023-12-16T03:15:55.798 INFO:tasks.workunit.client.1.smithi184.stdout:5/319: write d1/d3/d9/de/d15/d19/f23 [6713239,114138] 0 2023-12-16T03:15:55.800 INFO:tasks.workunit.client.0.smithi064.stdout:9/99: dwrite d2/fa [0,4194304] 0 2023-12-16T03:15:55.800 INFO:tasks.workunit.client.0.smithi064.stdout:9/100: readlink d2/dc/l1a 0 2023-12-16T03:15:55.800 INFO:tasks.workunit.client.0.smithi064.stdout:9/101: fdatasync d2/dc/f15 0 2023-12-16T03:15:55.800 INFO:tasks.workunit.client.0.smithi064.stdout:9/102: stat d2/dc/l1a 0 2023-12-16T03:15:55.800 INFO:tasks.workunit.client.0.smithi064.stdout:9/103: truncate d2/fa 4886021 0 2023-12-16T03:15:55.800 INFO:tasks.workunit.client.0.smithi064.stdout:5/171: dwrite d0/d7/f1a [0,4194304] 0 2023-12-16T03:15:55.800 INFO:tasks.workunit.client.0.smithi064.stdout:5/172: chown d0/d14/d20/d29 136 1 2023-12-16T03:15:55.800 INFO:tasks.workunit.client.0.smithi064.stdout:5/173: chown d0/d7/fa 2 1 2023-12-16T03:15:55.801 INFO:tasks.workunit.client.1.smithi184.stdout:5/320: getdents d1/d3/d9/de/d15 0 2023-12-16T03:15:55.807 INFO:tasks.workunit.client.0.smithi064.stdout:5/174: rename d0/d14 to d0/d14/d20/d29/d39/d40 22 2023-12-16T03:15:55.807 INFO:tasks.workunit.client.0.smithi064.stdout:9/104: rename d2/dc/l17 to d2/l1b 0 2023-12-16T03:15:55.807 INFO:tasks.workunit.client.0.smithi064.stdout:8/200: dread d0/da/f23 [0,4194304] 0 2023-12-16T03:15:55.809 INFO:tasks.workunit.client.1.smithi184.stdout:5/321: dread d1/d3/d9/f40 [0,4194304] 0 2023-12-16T03:15:55.809 INFO:tasks.workunit.client.1.smithi184.stdout:5/322: rename d1/d3/d9/de/d15/d19 to d1/d3/d9/de/d15/d19/d48/d6c 22 2023-12-16T03:15:55.810 INFO:tasks.workunit.client.1.smithi184.stdout:5/323: stat d1/f29 0 2023-12-16T03:15:55.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:55 smithi184 ceph-mon[121180]: pgmap v192: 65 pgs: 65 active+clean; 807 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 48 MiB/s rd, 93 MiB/s wr, 697 op/s 2023-12-16T03:15:55.810 INFO:tasks.workunit.client.0.smithi064.stdout:9/105: creat d2/d16/f1c x:0 0 0 2023-12-16T03:15:55.810 INFO:tasks.workunit.client.0.smithi064.stdout:9/106: chown d2 1262690 1 2023-12-16T03:15:55.811 INFO:tasks.workunit.client.0.smithi064.stdout:9/107: readlink d2/dc/l13 0 2023-12-16T03:15:55.811 INFO:tasks.workunit.client.1.smithi184.stdout:5/324: creat d1/d3/d2f/f6d x:0 0 0 2023-12-16T03:15:55.811 INFO:tasks.workunit.client.1.smithi184.stdout:5/325: chown d1/f66 0 1 2023-12-16T03:15:55.812 INFO:tasks.workunit.client.0.smithi064.stdout:8/201: rename d0/da/d16/c2a to d0/db/c49 0 2023-12-16T03:15:55.812 INFO:tasks.workunit.client.0.smithi064.stdout:8/202: write d0/f27 [3884577,100566] 0 2023-12-16T03:15:55.812 INFO:tasks.workunit.client.0.smithi064.stdout:8/203: write d0/da/f30 [103444,39565] 0 2023-12-16T03:15:55.813 INFO:tasks.workunit.client.0.smithi064.stdout:9/108: rename d2/fa to d2/f1d 0 2023-12-16T03:15:55.815 INFO:tasks.workunit.client.0.smithi064.stdout:9/109: mknod d2/c1e 0 2023-12-16T03:15:55.816 INFO:tasks.workunit.client.0.smithi064.stdout:9/110: chown d2/dc/c19 1747529 1 2023-12-16T03:15:55.817 INFO:tasks.workunit.client.0.smithi064.stdout:9/111: creat d2/dc/f1f x:0 0 0 2023-12-16T03:15:55.818 INFO:tasks.workunit.client.0.smithi064.stdout:9/112: creat d2/d16/f20 x:0 0 0 2023-12-16T03:15:55.819 INFO:tasks.workunit.client.0.smithi064.stdout:9/113: symlink d2/d16/l21 0 2023-12-16T03:15:55.825 INFO:tasks.workunit.client.1.smithi184.stdout:5/326: dread d1/d3/d9/f18 [0,4194304] 0 2023-12-16T03:15:55.826 INFO:tasks.workunit.client.1.smithi184.stdout:5/327: chown d1/d3/d2f/f3d 43 1 2023-12-16T03:15:55.827 INFO:tasks.workunit.client.1.smithi184.stdout:5/328: symlink d1/d3/d9/de/d15/d19/d5f/l6e 0 2023-12-16T03:15:55.829 INFO:tasks.workunit.client.1.smithi184.stdout:5/329: unlink d1/d3/d9/de/d15/d19/d5f/f4f 0 2023-12-16T03:15:55.831 INFO:tasks.workunit.client.1.smithi184.stdout:5/330: rename d1/d3/d9/f18 to d1/d3/d9/d2e/f6f 0 2023-12-16T03:15:55.833 INFO:tasks.workunit.client.0.smithi064.stdout:8/204: dread d0/da/d16/f1b [0,4194304] 0 2023-12-16T03:15:55.833 INFO:tasks.workunit.client.1.smithi184.stdout:5/331: rename d1/d2a/d31/d58/c6a to d1/d3/d9/d2e/c70 0 2023-12-16T03:15:55.834 INFO:tasks.workunit.client.1.smithi184.stdout:5/332: chown d1/d3/d9/c35 1423 1 2023-12-16T03:15:55.834 INFO:tasks.workunit.client.1.smithi184.stdout:5/333: write d1/d3/d2f/f6d [1016924,99679] 0 2023-12-16T03:15:55.834 INFO:tasks.workunit.client.1.smithi184.stdout:6/463: dwrite d0/d36/f55 [4194304,4194304] 0 2023-12-16T03:15:55.834 INFO:tasks.workunit.client.1.smithi184.stdout:6/464: stat d0/d5/d22/f49 0 2023-12-16T03:15:55.835 INFO:tasks.workunit.client.1.smithi184.stdout:5/334: link d1/d3/l14 d1/d3/d9/de/d30/l71 0 2023-12-16T03:15:55.838 INFO:tasks.workunit.client.1.smithi184.stdout:6/465: unlink d0/d5/d12/d1b/d33/d3d/c71 0 2023-12-16T03:15:55.842 INFO:tasks.workunit.client.1.smithi184.stdout:6/466: rename d0/d5/d22/fa to d0/d5/d12/d1b/d33/f91 0 2023-12-16T03:15:55.848 INFO:tasks.workunit.client.0.smithi064.stdout:3/171: dwrite db/d12/d1a/f26 [0,4194304] 0 2023-12-16T03:15:55.849 INFO:tasks.workunit.client.0.smithi064.stdout:5/175: dwrite d0/d14/d20/f2f [0,4194304] 0 2023-12-16T03:15:55.850 INFO:tasks.workunit.client.1.smithi184.stdout:9/614: dwrite d0/d13/d20/d5b/f8e [0,4194304] 0 2023-12-16T03:15:55.852 INFO:tasks.workunit.client.0.smithi064.stdout:9/114: dwrite d2/fb [0,4194304] 0 2023-12-16T03:15:55.852 INFO:tasks.workunit.client.0.smithi064.stdout:2/133: dwrite d1/f6 [0,4194304] 0 2023-12-16T03:15:55.853 INFO:tasks.workunit.client.0.smithi064.stdout:2/134: read - d1/d15/f1a zero size 2023-12-16T03:15:55.853 INFO:tasks.workunit.client.0.smithi064.stdout:2/135: chown d1/f4 0 1 2023-12-16T03:15:55.854 INFO:tasks.workunit.client.1.smithi184.stdout:9/615: dread d0/d13/d20/d5b/f52 [0,4194304] 0 2023-12-16T03:15:55.855 INFO:tasks.workunit.client.1.smithi184.stdout:9/616: creat d0/d3a/d47/fd1 x:0 0 0 2023-12-16T03:15:55.857 INFO:tasks.workunit.client.1.smithi184.stdout:9/617: rmdir d0/d13/d20/db0/dcb 0 2023-12-16T03:15:55.857 INFO:tasks.workunit.client.1.smithi184.stdout:9/618: write d0/d3a/d47/f67 [1846636,71993] 0 2023-12-16T03:15:55.864 INFO:tasks.workunit.client.0.smithi064.stdout:9/115: creat d2/dc/f22 x:0 0 0 2023-12-16T03:15:55.864 INFO:tasks.workunit.client.0.smithi064.stdout:3/172: creat db/d12/d21/d2b/f3e x:0 0 0 2023-12-16T03:15:55.866 INFO:tasks.workunit.client.0.smithi064.stdout:2/136: rename d1/d15/l1c to d1/d15/d1b/l21 0 2023-12-16T03:15:55.867 INFO:tasks.workunit.client.0.smithi064.stdout:9/116: symlink d2/d16/l23 0 2023-12-16T03:15:55.869 INFO:tasks.workunit.client.0.smithi064.stdout:3/173: creat db/d12/d21/f3f x:0 0 0 2023-12-16T03:15:55.869 INFO:tasks.workunit.client.0.smithi064.stdout:2/137: rename d1/c16 to d1/d15/d1e/c22 0 2023-12-16T03:15:55.872 INFO:tasks.workunit.client.1.smithi184.stdout:5/335: dwrite d1/d3/d2f/f3d [0,4194304] 0 2023-12-16T03:15:55.875 INFO:tasks.workunit.client.1.smithi184.stdout:5/336: mkdir d1/d2a/d31/d28/d72 0 2023-12-16T03:15:55.876 INFO:tasks.workunit.client.1.smithi184.stdout:5/337: creat d1/d2a/d31/f73 x:0 0 0 2023-12-16T03:15:55.878 INFO:tasks.workunit.client.0.smithi064.stdout:3/174: creat db/d12/d1a/f40 x:0 0 0 2023-12-16T03:15:55.880 INFO:tasks.workunit.client.0.smithi064.stdout:3/175: mknod db/d12/d1a/c41 0 2023-12-16T03:15:55.885 INFO:tasks.workunit.client.0.smithi064.stdout:8/205: dwrite d0/f7 [4194304,4194304] 0 2023-12-16T03:15:55.886 INFO:tasks.workunit.client.0.smithi064.stdout:3/176: write db/d12/f27 [108335,18897] 0 2023-12-16T03:15:55.890 INFO:tasks.workunit.client.0.smithi064.stdout:3/177: creat db/d12/d1a/f42 x:0 0 0 2023-12-16T03:15:55.890 INFO:tasks.workunit.client.0.smithi064.stdout:3/178: fdatasync db/d12/d21/f33 0 2023-12-16T03:15:55.891 INFO:tasks.workunit.client.0.smithi064.stdout:3/179: chown db/d12/f18 679909898 1 2023-12-16T03:15:55.892 INFO:tasks.workunit.client.1.smithi184.stdout:6/467: dwrite d0/d5/d22/d25/d47/f8f [0,4194304] 0 2023-12-16T03:15:55.892 INFO:tasks.workunit.client.1.smithi184.stdout:9/619: dwrite d0/d13/d20/d5b/f7f [0,4194304] 0 2023-12-16T03:15:55.892 INFO:tasks.workunit.client.1.smithi184.stdout:9/620: fsync d0/d13/d20/f28 0 2023-12-16T03:15:55.892 INFO:tasks.workunit.client.1.smithi184.stdout:9/621: readlink d0/d13/d20/d5b/d43/l5a 0 2023-12-16T03:15:55.892 INFO:tasks.workunit.client.1.smithi184.stdout:9/622: truncate d0/d30/f41 4359276 0 2023-12-16T03:15:55.893 INFO:tasks.workunit.client.1.smithi184.stdout:6/468: creat d0/d5/d22/d25/f92 x:0 0 0 2023-12-16T03:15:55.893 INFO:tasks.workunit.client.0.smithi064.stdout:9/117: dwrite d2/dc/ff [0,4194304] 0 2023-12-16T03:15:55.893 INFO:tasks.workunit.client.0.smithi064.stdout:3/180: creat db/d13/d39/f43 x:0 0 0 2023-12-16T03:15:55.894 INFO:tasks.workunit.client.0.smithi064.stdout:3/181: creat db/d12/d1a/d2c/f44 x:0 0 0 2023-12-16T03:15:55.894 INFO:tasks.workunit.client.1.smithi184.stdout:9/623: mkdir d0/d3a/d47/dd2 0 2023-12-16T03:15:55.898 INFO:tasks.workunit.client.1.smithi184.stdout:9/624: unlink d0/d13/d6e/d84/f9a 0 2023-12-16T03:15:55.900 INFO:tasks.workunit.client.0.smithi064.stdout:2/138: rmdir d1 39 2023-12-16T03:15:55.901 INFO:tasks.workunit.client.0.smithi064.stdout:0/82: sync 2023-12-16T03:15:55.901 INFO:tasks.workunit.client.0.smithi064.stdout:6/90: sync 2023-12-16T03:15:55.901 INFO:tasks.workunit.client.0.smithi064.stdout:6/91: truncate d3/d9/fb 1148293 0 2023-12-16T03:15:55.901 INFO:tasks.workunit.client.0.smithi064.stdout:6/92: chown d3/d9 305935058 1 2023-12-16T03:15:55.901 INFO:tasks.workunit.client.0.smithi064.stdout:4/116: sync 2023-12-16T03:15:55.901 INFO:tasks.workunit.client.0.smithi064.stdout:7/126: sync 2023-12-16T03:15:55.901 INFO:tasks.workunit.client.0.smithi064.stdout:1/148: sync 2023-12-16T03:15:55.902 INFO:tasks.workunit.client.1.smithi184.stdout:9/625: rename d0/d30/f92 to d0/d13/d20/d5b/d43/dab/fd3 0 2023-12-16T03:15:55.902 INFO:tasks.workunit.client.0.smithi064.stdout:2/139: mkdir d1/d15/d23 0 2023-12-16T03:15:55.902 INFO:tasks.workunit.client.0.smithi064.stdout:2/140: truncate d1/d15/f1a 195610 0 2023-12-16T03:15:55.903 INFO:tasks.workunit.client.0.smithi064.stdout:0/83: link d2/f5 d2/d7/d10/f14 0 2023-12-16T03:15:55.903 INFO:tasks.workunit.client.0.smithi064.stdout:0/84: getdents d2/d8/da/d11 0 2023-12-16T03:15:55.903 INFO:tasks.workunit.client.1.smithi184.stdout:9/626: rename d0/d13/d6e/d9f/cac to d0/d13/d6e/d9f/cd4 0 2023-12-16T03:15:55.903 INFO:tasks.workunit.client.0.smithi064.stdout:8/206: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:15:55.904 INFO:tasks.workunit.client.0.smithi064.stdout:6/93: mknod d3/d8/d13/c16 0 2023-12-16T03:15:55.904 INFO:tasks.workunit.client.0.smithi064.stdout:8/207: write d0/f14 [3564390,122764] 0 2023-12-16T03:15:55.905 INFO:tasks.workunit.client.0.smithi064.stdout:4/117: mknod d0/d12/c23 0 2023-12-16T03:15:55.906 INFO:tasks.workunit.client.1.smithi184.stdout:9/627: mknod d0/d13/d6e/d84/cd5 0 2023-12-16T03:15:55.907 INFO:tasks.workunit.client.0.smithi064.stdout:7/127: rename d7/d13/l1a to d7/d13/l2c 0 2023-12-16T03:15:55.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/182: fsync db/d13/d39/f43 0 2023-12-16T03:15:55.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/183: write db/d12/d1a/d2c/f44 [715718,14211] 0 2023-12-16T03:15:55.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/184: stat db/d13/f25 0 2023-12-16T03:15:55.907 INFO:tasks.workunit.client.0.smithi064.stdout:2/141: mknod d1/d15/d1b/c24 0 2023-12-16T03:15:55.908 INFO:tasks.workunit.client.0.smithi064.stdout:2/142: chown d1/d15/d1b 1 1 2023-12-16T03:15:55.908 INFO:tasks.workunit.client.0.smithi064.stdout:8/208: read d0/f3 [2487673,37884] 0 2023-12-16T03:15:55.908 INFO:tasks.workunit.client.0.smithi064.stdout:0/85: mknod d2/d8/da/c15 0 2023-12-16T03:15:55.910 INFO:tasks.workunit.client.0.smithi064.stdout:4/118: write d0/f2 [3970554,29704] 0 2023-12-16T03:15:55.910 INFO:tasks.workunit.client.1.smithi184.stdout:6/469: dwrite d0/d5/d22/d34/d53/f5a [0,4194304] 0 2023-12-16T03:15:55.910 INFO:tasks.workunit.client.0.smithi064.stdout:6/94: link d3/d9/fb d3/d9/f17 0 2023-12-16T03:15:55.913 INFO:tasks.workunit.client.0.smithi064.stdout:6/95: write d3/d9/f15 [1320993,58082] 0 2023-12-16T03:15:55.913 INFO:tasks.workunit.client.0.smithi064.stdout:1/149: mknod d3/c33 0 2023-12-16T03:15:55.913 INFO:tasks.workunit.client.0.smithi064.stdout:1/150: chown d3/d22/c24 1978694 1 2023-12-16T03:15:55.913 INFO:tasks.workunit.client.0.smithi064.stdout:3/185: write db/f16 [2235615,51924] 0 2023-12-16T03:15:55.914 INFO:tasks.workunit.client.0.smithi064.stdout:2/143: symlink d1/d15/d1b/l25 0 2023-12-16T03:15:55.916 INFO:tasks.workunit.client.0.smithi064.stdout:0/86: truncate f1 12241 0 2023-12-16T03:15:55.916 INFO:tasks.workunit.client.0.smithi064.stdout:0/87: chown d2/d8 177436 1 2023-12-16T03:15:55.916 INFO:tasks.workunit.client.0.smithi064.stdout:1/151: creat d3/dd/d11/f34 x:0 0 0 2023-12-16T03:15:55.917 INFO:tasks.workunit.client.0.smithi064.stdout:3/186: mknod db/d12/d1a/d2c/c45 0 2023-12-16T03:15:55.919 INFO:tasks.workunit.client.0.smithi064.stdout:3/187: creat db/d12/f46 x:0 0 0 2023-12-16T03:15:55.920 INFO:tasks.workunit.client.0.smithi064.stdout:3/188: truncate db/d12/f18 1069833 0 2023-12-16T03:15:55.920 INFO:tasks.workunit.client.0.smithi064.stdout:1/152: mknod d3/c35 0 2023-12-16T03:15:55.921 INFO:tasks.workunit.client.1.smithi184.stdout:6/470: creat d0/d5/d22/d25/d3f/d6f/f93 x:0 0 0 2023-12-16T03:15:55.921 INFO:tasks.workunit.client.0.smithi064.stdout:1/153: chown d3/dd/d11/c1c 35 1 2023-12-16T03:15:55.924 INFO:tasks.workunit.client.1.smithi184.stdout:6/471: symlink d0/d5/d22/d34/l94 0 2023-12-16T03:15:55.927 INFO:tasks.workunit.client.1.smithi184.stdout:6/472: write d0/d5/d22/d25/f2b [8324562,110433] 0 2023-12-16T03:15:55.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/485: sync 2023-12-16T03:15:55.934 INFO:tasks.workunit.client.1.smithi184.stdout:3/486: mkdir d12/d18/db7 0 2023-12-16T03:15:55.940 INFO:tasks.workunit.client.0.smithi064.stdout:2/144: write d1/f6 [3819928,129306] 0 2023-12-16T03:15:55.940 INFO:tasks.workunit.client.0.smithi064.stdout:0/88: dread d2/d7/d10/f14 [0,4194304] 0 2023-12-16T03:15:55.943 INFO:tasks.workunit.client.0.smithi064.stdout:2/145: creat d1/f26 x:0 0 0 2023-12-16T03:15:55.944 INFO:tasks.workunit.client.1.smithi184.stdout:8/440: sync 2023-12-16T03:15:55.945 INFO:tasks.workunit.client.1.smithi184.stdout:2/272: sync 2023-12-16T03:15:55.945 INFO:tasks.workunit.client.1.smithi184.stdout:2/273: fdatasync d3/d9/f27 0 2023-12-16T03:15:55.945 INFO:tasks.workunit.client.1.smithi184.stdout:7/374: sync 2023-12-16T03:15:55.945 INFO:tasks.workunit.client.1.smithi184.stdout:4/348: sync 2023-12-16T03:15:55.945 INFO:tasks.workunit.client.0.smithi064.stdout:8/209: dwrite d0/d1d/d24/d2f/f41 [0,4194304] 0 2023-12-16T03:15:55.946 INFO:tasks.workunit.client.1.smithi184.stdout:8/441: creat d2/d4/d10/d11/d72/f8d x:0 0 0 2023-12-16T03:15:55.946 INFO:tasks.workunit.client.1.smithi184.stdout:2/274: creat d3/d29/d2f/d2e/f5d x:0 0 0 2023-12-16T03:15:55.947 INFO:tasks.workunit.client.1.smithi184.stdout:9/628: dwrite d0/d13/d20/d5b/d53/f81 [0,4194304] 0 2023-12-16T03:15:55.947 INFO:tasks.workunit.client.1.smithi184.stdout:9/629: rename d0/d3a/d47/dd2 to d0/d3a/d47/dd2/dd6 22 2023-12-16T03:15:55.948 INFO:tasks.workunit.client.1.smithi184.stdout:7/375: mkdir d0/df/d32/d35/d63/d69 0 2023-12-16T03:15:55.948 INFO:tasks.workunit.client.1.smithi184.stdout:7/376: write d0/df/f4d [358562,84935] 0 2023-12-16T03:15:55.948 INFO:tasks.workunit.client.1.smithi184.stdout:7/377: write d0/df/d1e/f5d [648682,51808] 0 2023-12-16T03:15:55.949 INFO:tasks.workunit.client.0.smithi064.stdout:8/210: unlink d0/da/ce 0 2023-12-16T03:15:55.949 INFO:tasks.workunit.client.0.smithi064.stdout:8/211: fdatasync d0/da/d16/f1b 0 2023-12-16T03:15:55.950 INFO:tasks.workunit.client.1.smithi184.stdout:4/349: mknod d1/d11/d5a/d63/c71 0 2023-12-16T03:15:55.950 INFO:tasks.workunit.client.1.smithi184.stdout:4/350: chown d1/d12/d13/l47 2 1 2023-12-16T03:15:55.950 INFO:tasks.workunit.client.1.smithi184.stdout:4/351: write d1/d11/d5a/f60 [339256,4570] 0 2023-12-16T03:15:55.950 INFO:tasks.workunit.client.1.smithi184.stdout:2/275: rmdir d3/d9 39 2023-12-16T03:15:55.951 INFO:tasks.workunit.client.0.smithi064.stdout:8/212: link d0/f7 d0/db/d12/d44/f4a 0 2023-12-16T03:15:55.951 INFO:tasks.workunit.client.1.smithi184.stdout:9/630: creat d0/d3a/d47/fd7 x:0 0 0 2023-12-16T03:15:55.952 INFO:tasks.workunit.client.1.smithi184.stdout:4/352: mkdir d1/d11/d5a/d63/d72 0 2023-12-16T03:15:55.952 INFO:tasks.workunit.client.1.smithi184.stdout:2/276: mknod d3/d29/d2f/d2e/c5e 0 2023-12-16T03:15:55.952 INFO:tasks.workunit.client.1.smithi184.stdout:2/277: truncate d3/d29/f2d 992747 0 2023-12-16T03:15:55.952 INFO:tasks.workunit.client.1.smithi184.stdout:4/353: symlink d1/d12/d27/l73 0 2023-12-16T03:15:55.952 INFO:tasks.workunit.client.1.smithi184.stdout:4/354: rename d1/d29 to d1/d29/d37/d74 22 2023-12-16T03:15:55.953 INFO:tasks.workunit.client.1.smithi184.stdout:2/278: mknod d3/d29/d2f/d46/c5f 0 2023-12-16T03:15:55.953 INFO:tasks.workunit.client.1.smithi184.stdout:2/279: chown d3/d29/f2d 1397 1 2023-12-16T03:15:55.953 INFO:tasks.workunit.client.1.smithi184.stdout:2/280: dread - d3/d9/d19/f43 zero size 2023-12-16T03:15:55.953 INFO:tasks.workunit.client.1.smithi184.stdout:2/281: truncate d3/d9/d19/f43 242100 0 2023-12-16T03:15:55.954 INFO:tasks.workunit.client.0.smithi064.stdout:8/213: rename d0/da/f23 to d0/d1d/d24/d2f/f4b 0 2023-12-16T03:15:55.954 INFO:tasks.workunit.client.1.smithi184.stdout:4/355: rmdir d1/d29/d34 39 2023-12-16T03:15:55.956 INFO:tasks.workunit.client.1.smithi184.stdout:2/282: symlink d3/d9/l60 0 2023-12-16T03:15:55.956 INFO:tasks.workunit.client.1.smithi184.stdout:2/283: dread - d3/d29/d2f/d2e/f5d zero size 2023-12-16T03:15:55.957 INFO:tasks.workunit.client.1.smithi184.stdout:4/356: symlink d1/d11/d5a/d63/l75 0 2023-12-16T03:15:55.958 INFO:tasks.workunit.client.1.smithi184.stdout:7/378: read d0/df/d1e/f20 [5119958,96849] 0 2023-12-16T03:15:55.962 INFO:tasks.workunit.client.1.smithi184.stdout:2/284: mkdir d3/d29/d61 0 2023-12-16T03:15:55.962 INFO:tasks.workunit.client.1.smithi184.stdout:8/442: dread d2/f13 [0,4194304] 0 2023-12-16T03:15:55.962 INFO:tasks.workunit.client.1.smithi184.stdout:8/443: dread - d2/d4/d10/d11/f6f zero size 2023-12-16T03:15:55.962 INFO:tasks.workunit.client.0.smithi064.stdout:6/96: dwrite d3/d9/f17 [0,4194304] 0 2023-12-16T03:15:55.963 INFO:tasks.workunit.client.1.smithi184.stdout:2/285: write d3/d29/d2f/d2e/f7 [5322887,63000] 0 2023-12-16T03:15:55.963 INFO:tasks.workunit.client.1.smithi184.stdout:8/444: rmdir d2/d12/d21/d2d/d31/d5e 39 2023-12-16T03:15:55.964 INFO:tasks.workunit.client.1.smithi184.stdout:2/286: mknod d3/d13/c62 0 2023-12-16T03:15:55.965 INFO:tasks.workunit.client.0.smithi064.stdout:6/97: creat d3/d9/f18 x:0 0 0 2023-12-16T03:15:55.967 INFO:tasks.workunit.client.0.smithi064.stdout:6/98: getdents d3/d8/d13 0 2023-12-16T03:15:55.970 INFO:tasks.workunit.client.0.smithi064.stdout:6/99: write d3/fd [2888012,5413] 0 2023-12-16T03:15:55.974 INFO:tasks.workunit.client.1.smithi184.stdout:8/445: dread d2/d4/d10/f59 [0,4194304] 0 2023-12-16T03:15:55.975 INFO:tasks.workunit.client.1.smithi184.stdout:8/446: creat d2/d12/d21/d2d/d31/d5e/f8e x:0 0 0 2023-12-16T03:15:55.976 INFO:tasks.workunit.client.1.smithi184.stdout:8/447: creat d2/d12/d21/d2d/d31/f8f x:0 0 0 2023-12-16T03:15:55.977 INFO:tasks.workunit.client.1.smithi184.stdout:6/473: dwrite d0/d5/d22/fb [0,4194304] 0 2023-12-16T03:15:55.977 INFO:tasks.workunit.client.1.smithi184.stdout:6/474: truncate d0/d5/f59 1069071 0 2023-12-16T03:15:55.977 INFO:tasks.workunit.client.0.smithi064.stdout:0/89: dwrite d2/d7/d10/f14 [0,4194304] 0 2023-12-16T03:15:55.978 INFO:tasks.workunit.client.0.smithi064.stdout:8/214: dwrite d0/d1d/f20 [0,4194304] 0 2023-12-16T03:15:55.978 INFO:tasks.workunit.client.0.smithi064.stdout:1/154: dwrite d3/dd/d11/f17 [0,4194304] 0 2023-12-16T03:15:55.978 INFO:tasks.workunit.client.0.smithi064.stdout:3/189: dwrite db/d13/f25 [0,4194304] 0 2023-12-16T03:15:55.981 INFO:tasks.workunit.client.0.smithi064.stdout:4/119: dwrite d0/f5 [0,4194304] 0 2023-12-16T03:15:55.981 INFO:tasks.workunit.client.0.smithi064.stdout:8/215: unlink d0/db/d12/d1c/c2d 0 2023-12-16T03:15:55.982 INFO:tasks.workunit.client.0.smithi064.stdout:8/216: readlink d0/da/l26 0 2023-12-16T03:15:55.982 INFO:tasks.workunit.client.1.smithi184.stdout:9/631: dread d0/f1f [0,4194304] 0 2023-12-16T03:15:55.985 INFO:tasks.workunit.client.1.smithi184.stdout:2/287: write d3/f56 [491976,111096] 0 2023-12-16T03:15:55.992 INFO:tasks.workunit.client.0.smithi064.stdout:3/190: creat db/d12/d1a/d31/f47 x:0 0 0 2023-12-16T03:15:55.992 INFO:tasks.workunit.client.0.smithi064.stdout:3/191: read - db/d12/d1a/f28 zero size 2023-12-16T03:15:55.998 INFO:tasks.workunit.client.1.smithi184.stdout:4/357: rename d1/d12/d27 to d1/d29/d34/d5c/d76 0 2023-12-16T03:15:55.999 INFO:tasks.workunit.client.0.smithi064.stdout:0/90: truncate d2/d7/d10/f14 2226267 0 2023-12-16T03:15:55.999 INFO:tasks.workunit.client.0.smithi064.stdout:4/120: truncate d0/f8 2381026 0 2023-12-16T03:15:55.999 INFO:tasks.workunit.client.0.smithi064.stdout:4/121: write d0/d12/d17/f21 [166690,2708] 0 2023-12-16T03:15:55.999 INFO:tasks.workunit.client.0.smithi064.stdout:8/217: truncate d0/db/d12/f15 1151651 0 2023-12-16T03:15:55.999 INFO:tasks.workunit.client.1.smithi184.stdout:4/358: symlink d1/d29/d34/d5c/d76/d33/l77 0 2023-12-16T03:15:56.000 INFO:tasks.workunit.client.1.smithi184.stdout:9/632: write d0/d13/d20/f86 [3599189,75373] 0 2023-12-16T03:15:56.001 INFO:tasks.workunit.client.1.smithi184.stdout:8/448: dread d2/d4/d10/d11/f3d [0,4194304] 0 2023-12-16T03:15:56.001 INFO:tasks.workunit.client.1.smithi184.stdout:6/475: dread d0/d5/d22/d25/d3f/f78 [0,4194304] 0 2023-12-16T03:15:56.001 INFO:tasks.workunit.client.1.smithi184.stdout:6/476: write d0/f31 [698855,62635] 0 2023-12-16T03:15:56.002 INFO:tasks.workunit.client.1.smithi184.stdout:9/633: mkdir d0/d13/d6e/d9f/dd8 0 2023-12-16T03:15:56.003 INFO:tasks.workunit.client.1.smithi184.stdout:8/449: readlink d2/d4/l5f 0 2023-12-16T03:15:56.003 INFO:tasks.workunit.client.0.smithi064.stdout:3/192: creat db/d12/f48 x:0 0 0 2023-12-16T03:15:56.003 INFO:tasks.workunit.client.0.smithi064.stdout:3/193: stat db/d13/f25 0 2023-12-16T03:15:56.003 INFO:tasks.workunit.client.0.smithi064.stdout:1/155: mkdir d3/d36 0 2023-12-16T03:15:56.003 INFO:tasks.workunit.client.0.smithi064.stdout:8/218: stat d0/ld 0 2023-12-16T03:15:56.004 INFO:tasks.workunit.client.0.smithi064.stdout:3/194: unlink db/d12/d21/d2b/f3e 0 2023-12-16T03:15:56.005 INFO:tasks.workunit.client.1.smithi184.stdout:6/477: rename d0/d5/d22/d25/l6a to d0/d5/d42/l95 0 2023-12-16T03:15:56.005 INFO:tasks.workunit.client.1.smithi184.stdout:6/478: chown d0/d5/d12/l20 20870844 1 2023-12-16T03:15:56.005 INFO:tasks.workunit.client.1.smithi184.stdout:9/634: mknod d0/d13/d6e/d9f/cd9 0 2023-12-16T03:15:56.007 INFO:tasks.workunit.client.0.smithi064.stdout:1/156: mkdir d3/d37 0 2023-12-16T03:15:56.008 INFO:tasks.workunit.client.1.smithi184.stdout:6/479: mkdir d0/d5/d12/d1b/d33/d3d/d96 0 2023-12-16T03:15:56.008 INFO:tasks.workunit.client.1.smithi184.stdout:6/480: chown d0/d5/d22 1584853134 1 2023-12-16T03:15:56.009 INFO:tasks.workunit.client.0.smithi064.stdout:8/219: mkdir d0/db/d4c 0 2023-12-16T03:15:56.011 INFO:tasks.workunit.client.1.smithi184.stdout:6/481: rename d0/d5/d12/d1b/d33/f6c to d0/d5/d26/f97 0 2023-12-16T03:15:56.014 INFO:tasks.workunit.client.1.smithi184.stdout:6/482: rename d0/d5/d22/d34/l94 to d0/d5/d12/d1b/d33/d3d/l98 0 2023-12-16T03:15:56.015 INFO:tasks.workunit.client.0.smithi064.stdout:1/157: mkdir d3/dd/d11/d38 0 2023-12-16T03:15:56.015 INFO:tasks.workunit.client.0.smithi064.stdout:1/158: fdatasync d3/dd/d23/f2c 0 2023-12-16T03:15:56.015 INFO:tasks.workunit.client.0.smithi064.stdout:8/220: symlink d0/da/d16/l4d 0 2023-12-16T03:15:56.016 INFO:tasks.workunit.client.1.smithi184.stdout:6/483: creat d0/d5/d22/d25/d47/f99 x:0 0 0 2023-12-16T03:15:56.016 INFO:tasks.workunit.client.1.smithi184.stdout:7/379: dwrite d0/f50 [0,4194304] 0 2023-12-16T03:15:56.017 INFO:tasks.workunit.client.0.smithi064.stdout:8/221: mknod d0/d1d/d24/d2f/c4e 0 2023-12-16T03:15:56.022 INFO:tasks.workunit.client.0.smithi064.stdout:8/222: write d0/db/f34 [4052692,87185] 0 2023-12-16T03:15:56.022 INFO:tasks.workunit.client.1.smithi184.stdout:6/484: symlink d0/d36/l9a 0 2023-12-16T03:15:56.022 INFO:tasks.workunit.client.1.smithi184.stdout:6/485: creat d0/d5/d12/d1b/f9b x:0 0 0 2023-12-16T03:15:56.023 INFO:tasks.workunit.client.0.smithi064.stdout:8/223: rename d0/db/f34 to d0/db/f4f 0 2023-12-16T03:15:56.024 INFO:tasks.workunit.client.0.smithi064.stdout:8/224: mkdir d0/d1d/d24/d2f/d50 0 2023-12-16T03:15:56.025 INFO:tasks.workunit.client.0.smithi064.stdout:8/225: link d0/d1d/d24/l17 d0/d1d/d48/l51 0 2023-12-16T03:15:56.025 INFO:tasks.workunit.client.0.smithi064.stdout:8/226: fsync d0/da/f30 0 2023-12-16T03:15:56.027 INFO:tasks.workunit.client.0.smithi064.stdout:8/227: symlink d0/db/d12/l52 0 2023-12-16T03:15:56.029 INFO:tasks.workunit.client.1.smithi184.stdout:7/380: dread d0/df/d36/d3f/f4f [0,4194304] 0 2023-12-16T03:15:56.030 INFO:tasks.workunit.client.1.smithi184.stdout:7/381: symlink d0/df/d32/d35/d63/l6a 0 2023-12-16T03:15:56.030 INFO:tasks.workunit.client.1.smithi184.stdout:7/382: chown d0/d3/d2e/l61 94 1 2023-12-16T03:15:56.031 INFO:tasks.workunit.client.0.smithi064.stdout:6/100: dwrite d3/fd [0,4194304] 0 2023-12-16T03:15:56.041 INFO:tasks.workunit.client.1.smithi184.stdout:8/450: dwrite d2/f33 [4194304,4194304] 0 2023-12-16T03:15:56.041 INFO:tasks.workunit.client.1.smithi184.stdout:8/451: fdatasync d2/d12/f58 0 2023-12-16T03:15:56.042 INFO:tasks.workunit.client.0.smithi064.stdout:4/122: dwrite d0/d12/d17/f1a [0,4194304] 0 2023-12-16T03:15:56.042 INFO:tasks.workunit.client.1.smithi184.stdout:2/288: dwrite d3/d13/d28/f3e [0,4194304] 0 2023-12-16T03:15:56.042 INFO:tasks.workunit.client.0.smithi064.stdout:3/195: dwrite db/d12/d1a/d31/f47 [0,4194304] 0 2023-12-16T03:15:56.046 INFO:tasks.workunit.client.0.smithi064.stdout:8/228: dwrite d0/f27 [0,4194304] 0 2023-12-16T03:15:56.049 INFO:tasks.workunit.client.0.smithi064.stdout:4/123: creat d0/f24 x:0 0 0 2023-12-16T03:15:56.049 INFO:tasks.workunit.client.0.smithi064.stdout:4/124: chown d0/d12/d17/f21 125061364 1 2023-12-16T03:15:56.049 INFO:tasks.workunit.client.1.smithi184.stdout:2/289: mknod d3/d13/c63 0 2023-12-16T03:15:56.050 INFO:tasks.workunit.client.1.smithi184.stdout:2/290: symlink d3/d9/d19/l64 0 2023-12-16T03:15:56.051 INFO:tasks.workunit.client.1.smithi184.stdout:2/291: creat d3/f65 x:0 0 0 2023-12-16T03:15:56.051 INFO:tasks.workunit.client.1.smithi184.stdout:2/292: chown d3/d29/d4d/f51 170285 1 2023-12-16T03:15:56.052 INFO:tasks.workunit.client.0.smithi064.stdout:4/125: mkdir d0/d1e/d25 0 2023-12-16T03:15:56.053 INFO:tasks.workunit.client.0.smithi064.stdout:0/91: write d2/f5 [698073,82959] 0 2023-12-16T03:15:56.053 INFO:tasks.workunit.client.1.smithi184.stdout:4/359: dwrite d1/d12/f3e [0,4194304] 0 2023-12-16T03:15:56.053 INFO:tasks.workunit.client.1.smithi184.stdout:4/360: chown d1/d12/d13 1212 1 2023-12-16T03:15:56.054 INFO:tasks.workunit.client.0.smithi064.stdout:3/196: link db/d12/f3b db/d12/d21/f49 0 2023-12-16T03:15:56.056 INFO:tasks.workunit.client.0.smithi064.stdout:8/229: creat d0/da/d3e/f53 x:0 0 0 2023-12-16T03:15:56.057 INFO:tasks.workunit.client.0.smithi064.stdout:0/92: read d2/d7/d10/f14 [1829115,59394] 0 2023-12-16T03:15:56.058 INFO:tasks.workunit.client.1.smithi184.stdout:4/361: rename d1/d29/d34/d5c/d76/d3b/l5b to d1/d12/d13/d40/d43/d5e/d6a/l78 0 2023-12-16T03:15:56.059 INFO:tasks.workunit.client.0.smithi064.stdout:3/197: symlink db/d12/d1a/l4a 0 2023-12-16T03:15:56.060 INFO:tasks.workunit.client.1.smithi184.stdout:4/362: creat d1/d11/d1b/f79 x:0 0 0 2023-12-16T03:15:56.061 INFO:tasks.workunit.client.1.smithi184.stdout:4/363: stat d1/d29/d34/f48 0 2023-12-16T03:15:56.061 INFO:tasks.workunit.client.1.smithi184.stdout:4/364: readlink d1/d12/d13/l47 0 2023-12-16T03:15:56.062 INFO:tasks.workunit.client.0.smithi064.stdout:3/198: write db/d13/f24 [639906,39879] 0 2023-12-16T03:15:56.065 INFO:tasks.workunit.client.1.smithi184.stdout:8/452: dwrite d2/d12/d21/d2d/d31/f68 [0,4194304] 0 2023-12-16T03:15:56.065 INFO:tasks.workunit.client.1.smithi184.stdout:8/453: readlink d2/d4/d10/l56 0 2023-12-16T03:15:56.066 INFO:tasks.workunit.client.0.smithi064.stdout:3/199: dread db/f19 [0,4194304] 0 2023-12-16T03:15:56.069 INFO:tasks.workunit.client.1.smithi184.stdout:8/454: creat d2/d4/d10/d7a/d83/f90 x:0 0 0 2023-12-16T03:15:56.071 INFO:tasks.workunit.client.0.smithi064.stdout:3/200: link db/d12/f48 db/d12/d1a/d31/f4b 0 2023-12-16T03:15:56.071 INFO:tasks.workunit.client.0.smithi064.stdout:3/201: dread - db/d12/d21/f33 zero size 2023-12-16T03:15:56.071 INFO:tasks.workunit.client.1.smithi184.stdout:8/455: rmdir d2/d12/d21/d2d/d31/d34 39 2023-12-16T03:15:56.072 INFO:tasks.workunit.client.0.smithi064.stdout:4/126: dread d0/d12/d17/f1d [0,4194304] 0 2023-12-16T03:15:56.072 INFO:tasks.workunit.client.0.smithi064.stdout:4/127: readlink d0/da/l13 0 2023-12-16T03:15:56.072 INFO:tasks.workunit.client.0.smithi064.stdout:4/128: chown d0/d1e/l1f 1932850 1 2023-12-16T03:15:56.073 INFO:tasks.workunit.client.1.smithi184.stdout:7/383: dwrite d0/f50 [0,4194304] 0 2023-12-16T03:15:56.073 INFO:tasks.workunit.client.1.smithi184.stdout:8/456: stat d2/d4/l45 0 2023-12-16T03:15:56.073 INFO:tasks.workunit.client.1.smithi184.stdout:8/457: readlink d2/d12/d21/d30/l49 0 2023-12-16T03:15:56.074 INFO:tasks.workunit.client.0.smithi064.stdout:3/202: truncate db/f16 4173408 0 2023-12-16T03:15:56.077 INFO:tasks.workunit.client.1.smithi184.stdout:8/458: mknod d2/d12/d21/d30/d73/c91 0 2023-12-16T03:15:56.078 INFO:tasks.workunit.client.0.smithi064.stdout:3/203: write db/d13/f24 [2302847,15838] 0 2023-12-16T03:15:56.079 INFO:tasks.workunit.client.1.smithi184.stdout:7/384: rename d0/df/d32/d35/d63 to d0/d6b 0 2023-12-16T03:15:56.079 INFO:tasks.workunit.client.0.smithi064.stdout:4/129: dread d0/f8 [0,4194304] 0 2023-12-16T03:15:56.079 INFO:tasks.workunit.client.0.smithi064.stdout:3/204: readlink l7 0 2023-12-16T03:15:56.081 INFO:tasks.workunit.client.0.smithi064.stdout:4/130: creat d0/d14/f26 x:0 0 0 2023-12-16T03:15:56.081 INFO:tasks.workunit.client.0.smithi064.stdout:4/131: chown d0/d12/d17/l1b 0 1 2023-12-16T03:15:56.081 INFO:tasks.workunit.client.0.smithi064.stdout:4/132: write d0/da/f16 [525978,48478] 0 2023-12-16T03:15:56.082 INFO:tasks.workunit.client.1.smithi184.stdout:8/459: getdents d2/d12/d21/d2d/d31 0 2023-12-16T03:15:56.084 INFO:tasks.workunit.client.1.smithi184.stdout:8/460: rename d2/d12/l64 to d2/d12/d21/d30/l92 0 2023-12-16T03:15:56.085 INFO:tasks.workunit.client.0.smithi064.stdout:4/133: rename d0/f24 to d0/d1e/f27 0 2023-12-16T03:15:56.089 INFO:tasks.workunit.client.0.smithi064.stdout:4/134: dread d0/f8 [0,4194304] 0 2023-12-16T03:15:56.089 INFO:tasks.workunit.client.0.smithi064.stdout:4/135: fdatasync d0/d12/d17/f1a 0 2023-12-16T03:15:56.090 INFO:tasks.workunit.client.1.smithi184.stdout:7/385: dread d0/d3/d4/f2c [0,4194304] 0 2023-12-16T03:15:56.090 INFO:tasks.workunit.client.1.smithi184.stdout:7/386: rmdir d0/d3/d2e/d3b 39 2023-12-16T03:15:56.090 INFO:tasks.workunit.client.1.smithi184.stdout:1/426: sync 2023-12-16T03:15:56.090 INFO:tasks.workunit.client.1.smithi184.stdout:7/387: chown d0/df/d36 2329 1 2023-12-16T03:15:56.090 INFO:tasks.workunit.client.1.smithi184.stdout:7/388: chown d0/df/dd/f46 0 1 2023-12-16T03:15:56.090 INFO:tasks.workunit.client.1.smithi184.stdout:1/427: chown d3/d13/d2c 0 1 2023-12-16T03:15:56.090 INFO:tasks.workunit.client.1.smithi184.stdout:1/428: chown d3/c10 930093 1 2023-12-16T03:15:56.091 INFO:tasks.workunit.client.0.smithi064.stdout:4/136: truncate d0/f1 2997686 0 2023-12-16T03:15:56.091 INFO:tasks.workunit.client.0.smithi064.stdout:4/137: write d0/d14/f26 [670642,21451] 0 2023-12-16T03:15:56.091 INFO:tasks.workunit.client.1.smithi184.stdout:1/429: rmdir d3/d28/d36 39 2023-12-16T03:15:56.093 INFO:tasks.workunit.client.1.smithi184.stdout:2/293: dwrite d3/d13/f18 [0,4194304] 0 2023-12-16T03:15:56.095 INFO:tasks.workunit.client.0.smithi064.stdout:8/230: dwrite d0/db/d12/d44/f4a [0,4194304] 0 2023-12-16T03:15:56.096 INFO:tasks.workunit.client.1.smithi184.stdout:1/430: rename d3/l1d to d3/d28/d3c/d41/l8b 0 2023-12-16T03:15:56.096 INFO:tasks.workunit.client.1.smithi184.stdout:7/389: write d0/d3/d4/f25 [980284,14582] 0 2023-12-16T03:15:56.096 INFO:tasks.workunit.client.1.smithi184.stdout:4/365: dwrite d1/f51 [0,4194304] 0 2023-12-16T03:15:56.099 INFO:tasks.workunit.client.1.smithi184.stdout:2/294: link d3/d29/f2d d3/d13/f66 0 2023-12-16T03:15:56.099 INFO:tasks.workunit.client.1.smithi184.stdout:2/295: stat d3/d29/d4d/f51 0 2023-12-16T03:15:56.099 INFO:tasks.workunit.client.1.smithi184.stdout:2/296: fdatasync d3/d29/d2f/d2e/f7 0 2023-12-16T03:15:56.101 INFO:tasks.workunit.client.1.smithi184.stdout:1/431: link d3/d28/d3c/d41/d46/f69 d3/d28/d3c/d41/d46/f8c 0 2023-12-16T03:15:56.104 INFO:tasks.workunit.client.1.smithi184.stdout:7/390: truncate d0/df/d1e/f5d 691532 0 2023-12-16T03:15:56.105 INFO:tasks.workunit.client.1.smithi184.stdout:0/502: sync 2023-12-16T03:15:56.107 INFO:tasks.workunit.client.0.smithi064.stdout:8/231: dread d0/db/d12/d44/f4a [4194304,4194304] 0 2023-12-16T03:15:56.108 INFO:tasks.workunit.client.1.smithi184.stdout:0/503: mkdir dc/d22/d1d/da5 0 2023-12-16T03:15:56.110 INFO:tasks.workunit.client.0.smithi064.stdout:8/232: mkdir d0/da/d3e/d46/d54 0 2023-12-16T03:15:56.110 INFO:tasks.workunit.client.1.smithi184.stdout:0/504: symlink dc/d22/d46/la6 0 2023-12-16T03:15:56.111 INFO:tasks.workunit.client.0.smithi064.stdout:8/233: creat d0/d1d/d3c/f55 x:0 0 0 2023-12-16T03:15:56.111 INFO:tasks.workunit.client.0.smithi064.stdout:8/234: fsync d0/db/d12/f21 0 2023-12-16T03:15:56.113 INFO:tasks.workunit.client.0.smithi064.stdout:8/235: mknod d0/db/c56 0 2023-12-16T03:15:56.122 INFO:tasks.workunit.client.1.smithi184.stdout:8/461: dwrite d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:15:56.123 INFO:tasks.workunit.client.0.smithi064.stdout:4/138: dwrite d0/f2 [4194304,4194304] 0 2023-12-16T03:15:56.124 INFO:tasks.workunit.client.0.smithi064.stdout:3/205: dwrite db/d12/f27 [0,4194304] 0 2023-12-16T03:15:56.125 INFO:tasks.workunit.client.1.smithi184.stdout:8/462: unlink d2/d12/d21/d30/l49 0 2023-12-16T03:15:56.127 INFO:tasks.workunit.client.0.smithi064.stdout:3/206: mkdir db/d12/d1a/d2c/d34/d4c 0 2023-12-16T03:15:56.129 INFO:tasks.workunit.client.0.smithi064.stdout:4/139: rename d0/l9 to d0/d1e/l28 0 2023-12-16T03:15:56.130 INFO:tasks.workunit.client.1.smithi184.stdout:8/463: link d2/d4/f40 d2/d12/d21/d2d/d31/d5e/f93 0 2023-12-16T03:15:56.133 INFO:tasks.workunit.client.0.smithi064.stdout:4/140: rename d0/f1 to d0/d1e/f29 0 2023-12-16T03:15:56.133 INFO:tasks.workunit.client.0.smithi064.stdout:4/141: chown d0/d14/f26 204933 1 2023-12-16T03:15:56.133 INFO:tasks.workunit.client.0.smithi064.stdout:4/142: chown d0/da/l13 2 1 2023-12-16T03:15:56.133 INFO:tasks.workunit.client.0.smithi064.stdout:4/143: chown d0/d1e 38017 1 2023-12-16T03:15:56.133 INFO:tasks.workunit.client.1.smithi184.stdout:8/464: write d2/d4/f2e [3569056,76228] 0 2023-12-16T03:15:56.135 INFO:tasks.workunit.client.0.smithi064.stdout:4/144: unlink d0/d12/d17/l1b 0 2023-12-16T03:15:56.136 INFO:tasks.workunit.client.0.smithi064.stdout:4/145: creat d0/d12/f2a x:0 0 0 2023-12-16T03:15:56.136 INFO:tasks.workunit.client.0.smithi064.stdout:4/146: symlink d0/d12/d17/l2b 0 2023-12-16T03:15:56.138 INFO:tasks.workunit.client.0.smithi064.stdout:4/147: creat d0/d1e/f2c x:0 0 0 2023-12-16T03:15:56.138 INFO:tasks.workunit.client.0.smithi064.stdout:4/148: chown d0/f2 7355554 1 2023-12-16T03:15:56.138 INFO:tasks.workunit.client.1.smithi184.stdout:8/465: symlink d2/d4/d10/d7a/l94 0 2023-12-16T03:15:56.138 INFO:tasks.workunit.client.1.smithi184.stdout:8/466: dread - d2/d6a/f74 zero size 2023-12-16T03:15:56.138 INFO:tasks.workunit.client.1.smithi184.stdout:8/467: dread - d2/d6a/f74 zero size 2023-12-16T03:15:56.139 INFO:tasks.workunit.client.0.smithi064.stdout:4/149: mknod d0/d12/d17/c2d 0 2023-12-16T03:15:56.139 INFO:tasks.workunit.client.0.smithi064.stdout:4/150: chown d0/d12/c23 56 1 2023-12-16T03:15:56.140 INFO:tasks.workunit.client.0.smithi064.stdout:4/151: rmdir d0/d14 39 2023-12-16T03:15:56.141 INFO:tasks.workunit.client.1.smithi184.stdout:8/468: rename d2/d4/d10/d7a/l94 to d2/d4/d10/d7a/d83/d8b/l95 0 2023-12-16T03:15:56.141 INFO:tasks.workunit.client.0.smithi064.stdout:4/152: creat d0/f2e x:0 0 0 2023-12-16T03:15:56.141 INFO:tasks.workunit.client.0.smithi064.stdout:4/153: readlink d0/d12/d17/l2b 0 2023-12-16T03:15:56.142 INFO:tasks.workunit.client.1.smithi184.stdout:8/469: getdents d2/d12 0 2023-12-16T03:15:56.144 INFO:tasks.workunit.client.1.smithi184.stdout:8/470: mkdir d2/d12/d21/d2d/d31/d34/d96 0 2023-12-16T03:15:56.144 INFO:tasks.workunit.client.1.smithi184.stdout:8/471: chown d2/d12/d21/d2d/d31/d34/f67 4416 1 2023-12-16T03:15:56.144 INFO:tasks.workunit.client.1.smithi184.stdout:8/472: fdatasync d2/d12/d21/d2d/d31/d5e/f93 0 2023-12-16T03:15:56.145 INFO:tasks.workunit.client.1.smithi184.stdout:8/473: mknod d2/d4/d10/d7a/d83/d8b/c97 0 2023-12-16T03:15:56.146 INFO:tasks.workunit.client.0.smithi064.stdout:4/154: dread d0/d12/d17/f1d [0,4194304] 0 2023-12-16T03:15:56.146 INFO:tasks.workunit.client.1.smithi184.stdout:8/474: creat d2/d12/d21/d30/f98 x:0 0 0 2023-12-16T03:15:56.148 INFO:tasks.workunit.client.0.smithi064.stdout:4/155: symlink d0/l2f 0 2023-12-16T03:15:56.149 INFO:tasks.workunit.client.1.smithi184.stdout:8/475: read d2/d12/d21/d2d/d31/f68 [2078056,92467] 0 2023-12-16T03:15:56.150 INFO:tasks.workunit.client.1.smithi184.stdout:8/476: getdents d2/d4/d10/d11 0 2023-12-16T03:15:56.151 INFO:tasks.workunit.client.1.smithi184.stdout:8/477: mkdir d2/d4/d10/d99 0 2023-12-16T03:15:56.153 INFO:tasks.workunit.client.1.smithi184.stdout:8/478: rename d2/l1a to d2/d12/d21/d2d/d31/d5e/l9a 0 2023-12-16T03:15:56.153 INFO:tasks.workunit.client.1.smithi184.stdout:8/479: mknod d2/d12/d21/d8a/c9b 0 2023-12-16T03:15:56.154 INFO:tasks.workunit.client.1.smithi184.stdout:8/480: rmdir d2/d4 39 2023-12-16T03:15:56.155 INFO:tasks.workunit.client.1.smithi184.stdout:8/481: symlink d2/d4/d10/l9c 0 2023-12-16T03:15:56.155 INFO:tasks.workunit.client.1.smithi184.stdout:8/482: dread - d2/d4/f76 zero size 2023-12-16T03:15:56.159 INFO:tasks.workunit.client.0.smithi064.stdout:4/156: read d0/d1e/f29 [2555990,28117] 0 2023-12-16T03:15:56.161 INFO:tasks.workunit.client.1.smithi184.stdout:4/366: dwrite d1/d11/d1b/d1e/f41 [0,4194304] 0 2023-12-16T03:15:56.170 INFO:tasks.workunit.client.1.smithi184.stdout:2/297: dwrite d3/d9/d19/f26 [0,4194304] 0 2023-12-16T03:15:56.171 INFO:tasks.workunit.client.1.smithi184.stdout:2/298: write d3/d29/d2f/d2e/f12 [463882,81221] 0 2023-12-16T03:15:56.177 INFO:tasks.workunit.client.1.smithi184.stdout:4/367: dread d1/fd [0,4194304] 0 2023-12-16T03:15:56.178 INFO:tasks.workunit.client.0.smithi064.stdout:8/236: dwrite d0/f27 [0,4194304] 0 2023-12-16T03:15:56.178 INFO:tasks.workunit.client.0.smithi064.stdout:8/237: readlink d0/l13 0 2023-12-16T03:15:56.178 INFO:tasks.workunit.client.0.smithi064.stdout:0/93: dwrite d2/f5 [0,4194304] 0 2023-12-16T03:15:56.178 INFO:tasks.workunit.client.1.smithi184.stdout:1/432: dwrite d3/d28/d3c/d41/f4d [0,4194304] 0 2023-12-16T03:15:56.179 INFO:tasks.workunit.client.0.smithi064.stdout:8/238: unlink d0/db/d12/f21 0 2023-12-16T03:15:56.182 INFO:tasks.workunit.client.0.smithi064.stdout:8/239: creat d0/db/d37/d3a/f57 x:0 0 0 2023-12-16T03:15:56.182 INFO:tasks.workunit.client.0.smithi064.stdout:8/240: fdatasync d0/d1d/f20 0 2023-12-16T03:15:56.182 INFO:tasks.workunit.client.0.smithi064.stdout:8/241: stat d0/da/d16/l4d 0 2023-12-16T03:15:56.186 INFO:tasks.workunit.client.0.smithi064.stdout:0/94: rename d2/f3 to d2/f16 0 2023-12-16T03:15:56.186 INFO:tasks.workunit.client.1.smithi184.stdout:0/505: dwrite dc/d10/f14 [0,4194304] 0 2023-12-16T03:15:56.186 INFO:tasks.workunit.client.1.smithi184.stdout:0/506: dread - dc/d22/d45/d66/d80/f8a zero size 2023-12-16T03:15:56.187 INFO:tasks.workunit.client.1.smithi184.stdout:0/507: mkdir dc/d10/da7 0 2023-12-16T03:15:56.187 INFO:tasks.workunit.client.0.smithi064.stdout:8/242: symlink d0/db/d12/d44/l58 0 2023-12-16T03:15:56.188 INFO:tasks.workunit.client.0.smithi064.stdout:8/243: write d0/d1d/d24/d2f/f39 [665745,43193] 0 2023-12-16T03:15:56.188 INFO:tasks.workunit.client.1.smithi184.stdout:0/508: getdents dc/d22/d45/d66/d80/da3 0 2023-12-16T03:15:56.189 INFO:tasks.workunit.client.1.smithi184.stdout:8/483: dwrite d2/d12/d21/d2d/d31/d5e/f8e [0,4194304] 0 2023-12-16T03:15:56.189 INFO:tasks.workunit.client.1.smithi184.stdout:8/484: truncate d2/d4/d10/d2a/f5c 70212 0 2023-12-16T03:15:56.191 INFO:tasks.workunit.client.0.smithi064.stdout:3/207: dwrite db/d12/f3b [0,4194304] 0 2023-12-16T03:15:56.191 INFO:tasks.workunit.client.0.smithi064.stdout:4/157: dwrite d0/d1e/f27 [0,4194304] 0 2023-12-16T03:15:56.192 INFO:tasks.workunit.client.0.smithi064.stdout:8/244: truncate d0/da/fc 8608725 0 2023-12-16T03:15:56.193 INFO:tasks.workunit.client.1.smithi184.stdout:0/509: dread dc/d22/d1d/d43/f55 [0,4194304] 0 2023-12-16T03:15:56.193 INFO:tasks.workunit.client.1.smithi184.stdout:8/485: dread d2/fc [0,4194304] 0 2023-12-16T03:15:56.194 INFO:tasks.workunit.client.0.smithi064.stdout:4/158: dread d0/d12/d17/f21 [0,4194304] 0 2023-12-16T03:15:56.194 INFO:tasks.workunit.client.1.smithi184.stdout:0/510: mknod dc/d22/d1d/d35/ca8 0 2023-12-16T03:15:56.194 INFO:tasks.workunit.client.1.smithi184.stdout:0/511: truncate dc/d22/d1d/d43/f55 1201388 0 2023-12-16T03:15:56.195 INFO:tasks.workunit.client.0.smithi064.stdout:3/208: truncate f4 3030118 0 2023-12-16T03:15:56.195 INFO:tasks.workunit.client.1.smithi184.stdout:8/486: mknod d2/d4/d10/d11/d72/c9d 0 2023-12-16T03:15:56.198 INFO:tasks.workunit.client.0.smithi064.stdout:8/245: mkdir d0/db/d12/d1c/d59 0 2023-12-16T03:15:56.200 INFO:tasks.workunit.client.1.smithi184.stdout:0/512: rename dc/d22/d1d/d43/c88 to dc/d22/d1d/d43/d5a/d60/ca9 0 2023-12-16T03:15:56.200 INFO:tasks.workunit.client.1.smithi184.stdout:8/487: mknod d2/d4/d10/d75/c9e 0 2023-12-16T03:15:56.200 INFO:tasks.workunit.client.1.smithi184.stdout:8/488: chown d2/d12/l26 2 1 2023-12-16T03:15:56.201 INFO:tasks.workunit.client.0.smithi064.stdout:4/159: unlink d0/c4 0 2023-12-16T03:15:56.201 INFO:tasks.workunit.client.0.smithi064.stdout:4/160: read d0/da/f16 [511389,10977] 0 2023-12-16T03:15:56.201 INFO:tasks.workunit.client.0.smithi064.stdout:4/161: truncate d0/d12/f2a 875297 0 2023-12-16T03:15:56.201 INFO:tasks.workunit.client.0.smithi064.stdout:4/162: chown d0/d12/d17/c2d 20 1 2023-12-16T03:15:56.201 INFO:tasks.workunit.client.0.smithi064.stdout:4/163: write d0/f5 [4446383,32509] 0 2023-12-16T03:15:56.202 INFO:tasks.workunit.client.1.smithi184.stdout:0/513: symlink dc/d22/d1d/d2c/laa 0 2023-12-16T03:15:56.202 INFO:tasks.workunit.client.0.smithi064.stdout:3/209: symlink db/d12/d1a/l4d 0 2023-12-16T03:15:56.202 INFO:tasks.workunit.client.0.smithi064.stdout:8/246: mkdir d0/db/d5a 0 2023-12-16T03:15:56.204 INFO:tasks.workunit.client.1.smithi184.stdout:8/489: symlink d2/d4/d10/d11/l9f 0 2023-12-16T03:15:56.204 INFO:tasks.workunit.client.0.smithi064.stdout:4/164: unlink d0/d14/l22 0 2023-12-16T03:15:56.204 INFO:tasks.workunit.client.1.smithi184.stdout:1/433: dwrite d3/d28/d3c/d41/d77/f78 [0,4194304] 0 2023-12-16T03:15:56.205 INFO:tasks.workunit.client.1.smithi184.stdout:4/368: dwrite d1/d11/d1b/d1e/f5d [0,4194304] 0 2023-12-16T03:15:56.207 INFO:tasks.workunit.client.0.smithi064.stdout:8/247: rmdir d0/da/d3e 39 2023-12-16T03:15:56.207 INFO:tasks.workunit.client.0.smithi064.stdout:8/248: write d0/da/d16/f1b [4547814,4679] 0 2023-12-16T03:15:56.207 INFO:tasks.workunit.client.0.smithi064.stdout:8/249: truncate d0/d1d/d3c/f55 934064 0 2023-12-16T03:15:56.211 INFO:tasks.workunit.client.0.smithi064.stdout:3/210: rename db/d12/d21/d2b to db/d12/d4e 0 2023-12-16T03:15:56.213 INFO:tasks.workunit.client.0.smithi064.stdout:0/95: dwrite d2/f16 [0,4194304] 0 2023-12-16T03:15:56.213 INFO:tasks.workunit.client.1.smithi184.stdout:8/490: creat d2/d4/d10/d11/d77/fa0 x:0 0 0 2023-12-16T03:15:56.213 INFO:tasks.workunit.client.1.smithi184.stdout:8/491: write d2/d12/d21/d2d/d31/d5e/f93 [624492,124146] 0 2023-12-16T03:15:56.213 INFO:tasks.workunit.client.1.smithi184.stdout:8/492: stat d2/d12/d21/f8c 0 2023-12-16T03:15:56.215 INFO:tasks.workunit.client.0.smithi064.stdout:3/211: mkdir db/d4f 0 2023-12-16T03:15:56.217 INFO:tasks.workunit.client.0.smithi064.stdout:3/212: write db/d12/d1a/d31/f47 [2108588,79976] 0 2023-12-16T03:15:56.218 INFO:tasks.workunit.client.0.smithi064.stdout:5/176: sync 2023-12-16T03:15:56.218 INFO:tasks.workunit.client.0.smithi064.stdout:5/177: stat d0/de/l10 0 2023-12-16T03:15:56.218 INFO:tasks.workunit.client.1.smithi184.stdout:4/369: chown d1/d11/d1b/d44/l4c 2074934519 1 2023-12-16T03:15:56.218 INFO:tasks.workunit.client.1.smithi184.stdout:4/370: readlink d1/lb 0 2023-12-16T03:15:56.220 INFO:tasks.workunit.client.0.smithi064.stdout:3/213: symlink db/d12/d21/l50 0 2023-12-16T03:15:56.221 INFO:tasks.workunit.client.1.smithi184.stdout:0/514: mkdir dc/dab 0 2023-12-16T03:15:56.221 INFO:tasks.workunit.client.1.smithi184.stdout:8/493: truncate d2/d4/d10/d11/f3f 3588894 0 2023-12-16T03:15:56.221 INFO:tasks.workunit.client.1.smithi184.stdout:8/494: dread - d2/d4/d10/d11/f7e zero size 2023-12-16T03:15:56.222 INFO:tasks.workunit.client.0.smithi064.stdout:5/178: unlink d0/de/d23/f26 0 2023-12-16T03:15:56.222 INFO:tasks.workunit.client.0.smithi064.stdout:5/179: stat d0/d19/f27 0 2023-12-16T03:15:56.223 INFO:tasks.workunit.client.1.smithi184.stdout:4/371: creat d1/d11/f7a x:0 0 0 2023-12-16T03:15:56.223 INFO:tasks.workunit.client.1.smithi184.stdout:4/372: dread - d1/d11/d1b/f79 zero size 2023-12-16T03:15:56.225 INFO:tasks.workunit.client.1.smithi184.stdout:0/515: link dc/d22/d1d/d2c/d75/la1 dc/d22/d1d/d43/d5a/d60/lac 0 2023-12-16T03:15:56.227 INFO:tasks.workunit.client.1.smithi184.stdout:8/495: creat d2/d12/d21/d30/fa1 x:0 0 0 2023-12-16T03:15:56.229 INFO:tasks.workunit.client.0.smithi064.stdout:3/214: mkdir db/d4f/d51 0 2023-12-16T03:15:56.230 INFO:tasks.workunit.client.0.smithi064.stdout:5/180: mkdir d0/d19/d41 0 2023-12-16T03:15:56.230 INFO:tasks.workunit.client.0.smithi064.stdout:3/215: stat db/d4f/d51 0 2023-12-16T03:15:56.230 INFO:tasks.workunit.client.0.smithi064.stdout:5/181: chown d0/d14/d20/d37/d3c 3 1 2023-12-16T03:15:56.230 INFO:tasks.workunit.client.1.smithi184.stdout:4/373: link d1/d29/d34/f3d d1/d12/d13/d40/d43/d45/f7b 0 2023-12-16T03:15:56.231 INFO:tasks.workunit.client.1.smithi184.stdout:1/434: dwrite d3/d34/d39/f66 [0,4194304] 0 2023-12-16T03:15:56.233 INFO:tasks.workunit.client.0.smithi064.stdout:3/216: symlink db/d12/d1a/d2c/d34/d4c/l52 0 2023-12-16T03:15:56.233 INFO:tasks.workunit.client.1.smithi184.stdout:8/496: rename d2/d4/d10/d11/f7e to d2/d12/d21/d2d/fa2 0 2023-12-16T03:15:56.233 INFO:tasks.workunit.client.1.smithi184.stdout:8/497: write d2/d12/d21/f8c [910373,61059] 0 2023-12-16T03:15:56.234 INFO:tasks.workunit.client.0.smithi064.stdout:5/182: symlink d0/d14/d20/d37/l42 0 2023-12-16T03:15:56.235 INFO:tasks.workunit.client.1.smithi184.stdout:1/435: mknod d3/d28/d3c/d41/d77/c8d 0 2023-12-16T03:15:56.235 INFO:tasks.workunit.client.0.smithi064.stdout:5/183: link d0/de/l10 d0/d14/d20/d29/d39/l43 0 2023-12-16T03:15:56.238 INFO:tasks.workunit.client.1.smithi184.stdout:0/516: link lb dc/d22/lad 0 2023-12-16T03:15:56.240 INFO:tasks.workunit.client.1.smithi184.stdout:1/436: mkdir d3/d28/d3c/d24/d8e 0 2023-12-16T03:15:56.240 INFO:tasks.workunit.client.1.smithi184.stdout:1/437: chown d3/d34/d39/f66 1821824 1 2023-12-16T03:15:56.242 INFO:tasks.workunit.client.0.smithi064.stdout:3/217: write f6 [4124113,130546] 0 2023-12-16T03:15:56.242 INFO:tasks.workunit.client.0.smithi064.stdout:3/218: fdatasync db/d12/d1a/f28 0 2023-12-16T03:15:56.242 INFO:tasks.workunit.client.0.smithi064.stdout:4/165: dwrite d0/da/f16 [0,4194304] 0 2023-12-16T03:15:56.243 INFO:tasks.workunit.client.1.smithi184.stdout:0/517: rmdir dc/d10/d2d/d5f/d7a/da0 0 2023-12-16T03:15:56.244 INFO:tasks.workunit.client.1.smithi184.stdout:1/438: symlink d3/d28/l8f 0 2023-12-16T03:15:56.245 INFO:tasks.workunit.client.0.smithi064.stdout:4/166: creat d0/d14/f30 x:0 0 0 2023-12-16T03:15:56.247 INFO:tasks.workunit.client.1.smithi184.stdout:0/518: rename dc/d10/d2d/f6b to dc/d22/d45/d66/fae 0 2023-12-16T03:15:56.249 INFO:tasks.workunit.client.1.smithi184.stdout:1/439: link d3/d28/d3c/d41/d77/f78 d3/d13/f90 0 2023-12-16T03:15:56.252 INFO:tasks.workunit.client.0.smithi064.stdout:8/250: dwrite d0/db/d12/f15 [0,4194304] 0 2023-12-16T03:15:56.253 INFO:tasks.workunit.client.1.smithi184.stdout:1/440: getdents d3/d28/d3c/d41/d63 0 2023-12-16T03:15:56.253 INFO:tasks.workunit.client.1.smithi184.stdout:1/441: fsync d3/d28/d3c/d41/f62 0 2023-12-16T03:15:56.253 INFO:tasks.workunit.client.0.smithi064.stdout:8/251: getdents d0/da/d3e/d46 0 2023-12-16T03:15:56.253 INFO:tasks.workunit.client.1.smithi184.stdout:1/442: write d3/d13/d2c/f81 [836075,125001] 0 2023-12-16T03:15:56.254 INFO:tasks.workunit.client.1.smithi184.stdout:1/443: chown d3/d13/f90 104 1 2023-12-16T03:15:56.255 INFO:tasks.workunit.client.0.smithi064.stdout:0/96: dwrite d2/f5 [4194304,4194304] 0 2023-12-16T03:15:56.255 INFO:tasks.workunit.client.0.smithi064.stdout:8/252: link d0/db/d12/d1c/l29 d0/d1d/d24/d2f/l5b 0 2023-12-16T03:15:56.256 INFO:tasks.workunit.client.1.smithi184.stdout:1/444: mkdir d3/d34/d76/d91 0 2023-12-16T03:15:56.263 INFO:tasks.workunit.client.0.smithi064.stdout:8/253: write d0/db/d12/d1c/f1f [1109364,88546] 0 2023-12-16T03:15:56.264 INFO:tasks.workunit.client.0.smithi064.stdout:0/97: mknod d2/c17 0 2023-12-16T03:15:56.264 INFO:tasks.workunit.client.0.smithi064.stdout:8/254: stat d0/d1d/d24/l1a 0 2023-12-16T03:15:56.264 INFO:tasks.workunit.client.0.smithi064.stdout:8/255: chown d0/d1d/d3c/d40 23536 1 2023-12-16T03:15:56.264 INFO:tasks.workunit.client.0.smithi064.stdout:8/256: fsync d0/da/fc 0 2023-12-16T03:15:56.268 INFO:tasks.workunit.client.0.smithi064.stdout:8/257: write d0/da/fc [1808944,75172] 0 2023-12-16T03:15:56.277 INFO:tasks.workunit.client.0.smithi064.stdout:3/219: dwrite db/d12/d1a/f38 [0,4194304] 0 2023-12-16T03:15:56.277 INFO:tasks.workunit.client.0.smithi064.stdout:3/220: write db/d12/d21/f33 [886150,104786] 0 2023-12-16T03:15:56.277 INFO:tasks.workunit.client.0.smithi064.stdout:3/221: dread - db/d12/d1a/d2c/d34/f3d zero size 2023-12-16T03:15:56.277 INFO:tasks.workunit.client.0.smithi064.stdout:3/222: fsync db/d12/d1a/f1d 0 2023-12-16T03:15:56.278 INFO:tasks.workunit.client.0.smithi064.stdout:4/167: dwrite d0/d12/d17/f21 [0,4194304] 0 2023-12-16T03:15:56.280 INFO:tasks.workunit.client.1.smithi184.stdout:4/374: dwrite d1/d11/f23 [0,4194304] 0 2023-12-16T03:15:56.280 INFO:tasks.workunit.client.1.smithi184.stdout:1/445: dread d3/d28/d3c/d41/d46/f69 [0,4194304] 0 2023-12-16T03:15:56.281 INFO:tasks.workunit.client.1.smithi184.stdout:5/338: sync 2023-12-16T03:15:56.281 INFO:tasks.workunit.client.1.smithi184.stdout:0/519: dwrite dc/f7b [0,4194304] 0 2023-12-16T03:15:56.281 INFO:tasks.workunit.client.1.smithi184.stdout:0/520: write dc/d22/d1d/d43/d5a/f89 [885605,98792] 0 2023-12-16T03:15:56.282 INFO:tasks.workunit.client.1.smithi184.stdout:1/446: creat d3/d13/f92 x:0 0 0 2023-12-16T03:15:56.283 INFO:tasks.workunit.client.1.smithi184.stdout:0/521: mkdir dc/d22/d45/daf 0 2023-12-16T03:15:56.283 INFO:tasks.workunit.client.1.smithi184.stdout:8/498: dwrite d2/fe [0,4194304] 0 2023-12-16T03:15:56.283 INFO:tasks.workunit.client.1.smithi184.stdout:1/447: mknod d3/d13/c93 0 2023-12-16T03:15:56.284 INFO:tasks.workunit.client.1.smithi184.stdout:1/448: getdents d3/d28/d3c/d41/d63 0 2023-12-16T03:15:56.284 INFO:tasks.workunit.client.1.smithi184.stdout:5/339: unlink d1/d2a/d64/f6b 0 2023-12-16T03:15:56.284 INFO:tasks.workunit.client.1.smithi184.stdout:8/499: mknod d2/d4/d10/d75/ca3 0 2023-12-16T03:15:56.285 INFO:tasks.workunit.client.0.smithi064.stdout:3/223: mknod db/d13/d39/c53 0 2023-12-16T03:15:56.287 INFO:tasks.workunit.client.1.smithi184.stdout:5/340: stat d1/d3/d9/de/d15/f61 0 2023-12-16T03:15:56.288 INFO:tasks.workunit.client.1.smithi184.stdout:0/522: dread dc/d22/d45/d66/d80/da3/f91 [0,4194304] 0 2023-12-16T03:15:56.289 INFO:tasks.workunit.client.1.smithi184.stdout:1/449: rename d3/d13/d2c/f4c to d3/d28/d3c/d24/f94 0 2023-12-16T03:15:56.289 INFO:tasks.workunit.client.1.smithi184.stdout:1/450: chown d3/d28/d3c/d41/d46/d4a/f50 0 1 2023-12-16T03:15:56.289 INFO:tasks.workunit.client.0.smithi064.stdout:4/168: truncate d0/d14/f26 521145 0 2023-12-16T03:15:56.289 INFO:tasks.workunit.client.1.smithi184.stdout:5/341: mkdir d1/d3/d9/d49/d74 0 2023-12-16T03:15:56.290 INFO:tasks.workunit.client.0.smithi064.stdout:3/224: creat db/d12/d1a/f54 x:0 0 0 2023-12-16T03:15:56.291 INFO:tasks.workunit.client.1.smithi184.stdout:1/451: truncate d3/d28/f44 99370 0 2023-12-16T03:15:56.292 INFO:tasks.workunit.client.1.smithi184.stdout:4/375: dread d1/d11/f23 [0,4194304] 0 2023-12-16T03:15:56.293 INFO:tasks.workunit.client.0.smithi064.stdout:4/169: readlink d0/le 0 2023-12-16T03:15:56.293 INFO:tasks.workunit.client.0.smithi064.stdout:4/170: creat d0/d12/d17/f31 x:0 0 0 2023-12-16T03:15:56.294 INFO:tasks.workunit.client.1.smithi184.stdout:4/376: write d1/f51 [4082621,113754] 0 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:9/118: sync 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:7/128: sync 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:1/159: sync 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:6/101: sync 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:7/129: fsync d7/f14 0 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:7/130: read - d7/f14 zero size 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:7/131: write d7/f14 [532905,55720] 0 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:2/146: sync 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:7/132: readlink d7/d13/l2c 0 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:7/133: chown d7/f9 3 1 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:1/160: write d3/d22/f28 [2605215,103023] 0 2023-12-16T03:15:56.295 INFO:tasks.workunit.client.0.smithi064.stdout:1/161: rename d3/dd/d11/d38 to d3/dd/d11/d38/d39 22 2023-12-16T03:15:56.296 INFO:tasks.workunit.client.0.smithi064.stdout:9/119: rmdir d2 39 2023-12-16T03:15:56.296 INFO:tasks.workunit.client.0.smithi064.stdout:9/120: stat d2/f1d 0 2023-12-16T03:15:56.296 INFO:tasks.workunit.client.0.smithi064.stdout:6/102: symlink d3/d9/l19 0 2023-12-16T03:15:56.296 INFO:tasks.workunit.client.0.smithi064.stdout:6/103: fdatasync d3/f5 0 2023-12-16T03:15:56.296 INFO:tasks.workunit.client.0.smithi064.stdout:6/104: stat d3/d9/fb 0 2023-12-16T03:15:56.298 INFO:tasks.workunit.client.0.smithi064.stdout:2/147: mkdir d1/d27 0 2023-12-16T03:15:56.298 INFO:tasks.workunit.client.0.smithi064.stdout:7/134: creat d7/d1c/f2d x:0 0 0 2023-12-16T03:15:56.298 INFO:tasks.workunit.client.0.smithi064.stdout:7/135: chown d7/d26/c2b 308 1 2023-12-16T03:15:56.298 INFO:tasks.workunit.client.0.smithi064.stdout:7/136: readlink d7/d13/l2c 0 2023-12-16T03:15:56.298 INFO:tasks.workunit.client.0.smithi064.stdout:7/137: fsync d7/d13/d20/f21 0 2023-12-16T03:15:56.298 INFO:tasks.workunit.client.0.smithi064.stdout:7/138: write d7/d13/f1d [1489999,20698] 0 2023-12-16T03:15:56.299 INFO:tasks.workunit.client.0.smithi064.stdout:9/121: truncate d2/f1d 4100576 0 2023-12-16T03:15:56.299 INFO:tasks.workunit.client.0.smithi064.stdout:9/122: dread - d2/dc/f22 zero size 2023-12-16T03:15:56.300 INFO:tasks.workunit.client.0.smithi064.stdout:6/105: mkdir d3/d9/d1a 0 2023-12-16T03:15:56.300 INFO:tasks.workunit.client.0.smithi064.stdout:2/148: unlink d1/d15/f18 0 2023-12-16T03:15:56.301 INFO:tasks.workunit.client.0.smithi064.stdout:2/149: fdatasync d1/f9 0 2023-12-16T03:15:56.302 INFO:tasks.workunit.client.0.smithi064.stdout:7/139: truncate d7/d26/f27 1260315 0 2023-12-16T03:15:56.303 INFO:tasks.workunit.client.1.smithi184.stdout:5/342: unlink d1/d3/d9/d2e/f6f 0 2023-12-16T03:15:56.303 INFO:tasks.workunit.client.1.smithi184.stdout:1/452: link d3/d28/d3c/l15 d3/l95 0 2023-12-16T03:15:56.304 INFO:tasks.workunit.client.1.smithi184.stdout:8/500: rename d2/d12/d21/d2d/d31/d5e to d2/d6a/da4 0 2023-12-16T03:15:56.304 INFO:tasks.workunit.client.1.smithi184.stdout:8/501: read - d2/d12/d21/d2d/d31/f8f zero size 2023-12-16T03:15:56.304 INFO:tasks.workunit.client.0.smithi064.stdout:2/150: rename d1/f26 to d1/d15/f28 0 2023-12-16T03:15:56.304 INFO:tasks.workunit.client.1.smithi184.stdout:4/377: unlink d1/lb 0 2023-12-16T03:15:56.307 INFO:tasks.workunit.client.0.smithi064.stdout:7/140: mknod d7/d26/c2e 0 2023-12-16T03:15:56.307 INFO:tasks.workunit.client.0.smithi064.stdout:7/141: write d7/fb [1553416,23450] 0 2023-12-16T03:15:56.307 INFO:tasks.workunit.client.0.smithi064.stdout:7/142: stat d7/d26/f27 0 2023-12-16T03:15:56.307 INFO:tasks.workunit.client.0.smithi064.stdout:2/151: link d1/d15/f1f d1/d27/f29 0 2023-12-16T03:15:56.307 INFO:tasks.workunit.client.0.smithi064.stdout:2/152: fdatasync d1/d15/f28 0 2023-12-16T03:15:56.308 INFO:tasks.workunit.client.1.smithi184.stdout:5/343: creat d1/d3/d9/d49/d74/f75 x:0 0 0 2023-12-16T03:15:56.308 INFO:tasks.workunit.client.1.smithi184.stdout:4/378: dread d1/d29/f2e [0,4194304] 0 2023-12-16T03:15:56.309 INFO:tasks.workunit.client.0.smithi064.stdout:3/225: dread db/d12/d1a/f26 [0,4194304] 0 2023-12-16T03:15:56.310 INFO:tasks.workunit.client.0.smithi064.stdout:3/226: dread - db/d12/d21/f3f zero size 2023-12-16T03:15:56.310 INFO:tasks.workunit.client.1.smithi184.stdout:5/344: link d1/d3/d9/f40 d1/d3/d9/de/d30/d68/f76 0 2023-12-16T03:15:56.310 INFO:tasks.workunit.client.1.smithi184.stdout:0/523: dread dc/f42 [0,4194304] 0 2023-12-16T03:15:56.311 INFO:tasks.workunit.client.0.smithi064.stdout:0/98: dwrite d2/d7/d10/f14 [4194304,4194304] 0 2023-12-16T03:15:56.312 INFO:tasks.workunit.client.1.smithi184.stdout:0/524: mknod dc/dab/cb0 0 2023-12-16T03:15:56.314 INFO:tasks.workunit.client.1.smithi184.stdout:0/525: creat dc/d22/d1d/d43/fb1 x:0 0 0 2023-12-16T03:15:56.315 INFO:tasks.workunit.client.0.smithi064.stdout:0/99: dread f1 [0,4194304] 0 2023-12-16T03:15:56.316 INFO:tasks.workunit.client.1.smithi184.stdout:0/526: mknod dc/d22/d1d/cb2 0 2023-12-16T03:15:56.316 INFO:tasks.workunit.client.0.smithi064.stdout:6/106: dread d3/f5 [0,4194304] 0 2023-12-16T03:15:56.316 INFO:tasks.workunit.client.0.smithi064.stdout:6/107: stat d3/d9 0 2023-12-16T03:15:56.316 INFO:tasks.workunit.client.0.smithi064.stdout:6/108: chown d3/d9/fb 1715277 1 2023-12-16T03:15:56.317 INFO:tasks.workunit.client.0.smithi064.stdout:6/109: stat d3/d8/d13/c16 0 2023-12-16T03:15:56.317 INFO:tasks.workunit.client.0.smithi064.stdout:6/110: stat d3/c7 0 2023-12-16T03:15:56.317 INFO:tasks.workunit.client.0.smithi064.stdout:2/153: dread d1/fd [0,4194304] 0 2023-12-16T03:15:56.317 INFO:tasks.workunit.client.0.smithi064.stdout:2/154: truncate d1/d15/f28 669413 0 2023-12-16T03:15:56.318 INFO:tasks.workunit.client.1.smithi184.stdout:0/527: creat dc/d22/d1a/fb3 x:0 0 0 2023-12-16T03:15:56.318 INFO:tasks.workunit.client.1.smithi184.stdout:0/528: chown dc/d10/d1c/l39 487 1 2023-12-16T03:15:56.318 INFO:tasks.workunit.client.1.smithi184.stdout:5/345: write d1/d3/d9/f2d [302838,28092] 0 2023-12-16T03:15:56.319 INFO:tasks.workunit.client.0.smithi064.stdout:8/258: dwrite d0/d1d/d24/f36 [0,4194304] 0 2023-12-16T03:15:56.321 INFO:tasks.workunit.client.1.smithi184.stdout:0/529: mknod dc/d10/d1c/cb4 0 2023-12-16T03:15:56.325 INFO:tasks.workunit.client.0.smithi064.stdout:3/227: getdents db/d12 0 2023-12-16T03:15:56.325 INFO:tasks.workunit.client.0.smithi064.stdout:7/143: dread d7/d13/f1d [0,4194304] 0 2023-12-16T03:15:56.328 INFO:tasks.workunit.client.1.smithi184.stdout:8/502: dread d2/d12/d21/f8c [0,4194304] 0 2023-12-16T03:15:56.329 INFO:tasks.workunit.client.0.smithi064.stdout:0/100: symlink d2/d8/da/df/l18 0 2023-12-16T03:15:56.329 INFO:tasks.workunit.client.0.smithi064.stdout:0/101: fsync d2/f5 0 2023-12-16T03:15:56.329 INFO:tasks.workunit.client.0.smithi064.stdout:4/171: dwrite d0/d14/f30 [0,4194304] 0 2023-12-16T03:15:56.331 INFO:tasks.workunit.client.1.smithi184.stdout:0/530: rename dc/d22/d1d/d2c/laa to dc/d22/d45/lb5 0 2023-12-16T03:15:56.332 INFO:tasks.workunit.client.0.smithi064.stdout:6/111: getdents d3/d8/da 0 2023-12-16T03:15:56.334 INFO:tasks.workunit.client.0.smithi064.stdout:9/123: dwrite d2/dc/f1f [0,4194304] 0 2023-12-16T03:15:56.335 INFO:tasks.workunit.client.0.smithi064.stdout:7/144: fsync d7/fb 0 2023-12-16T03:15:56.335 INFO:tasks.workunit.client.0.smithi064.stdout:4/172: rmdir d0/d1e/d25 0 2023-12-16T03:15:56.335 INFO:tasks.workunit.client.0.smithi064.stdout:4/173: write d0/d12/f2a [981888,118683] 0 2023-12-16T03:15:56.336 INFO:tasks.workunit.client.1.smithi184.stdout:0/531: creat dc/d22/d45/d66/d80/fb6 x:0 0 0 2023-12-16T03:15:56.336 INFO:tasks.workunit.client.1.smithi184.stdout:8/503: creat d2/d4/d10/d75/fa5 x:0 0 0 2023-12-16T03:15:56.337 INFO:tasks.workunit.client.1.smithi184.stdout:4/379: dwrite d1/d11/d5a/f6f [0,4194304] 0 2023-12-16T03:15:56.337 INFO:tasks.workunit.client.1.smithi184.stdout:4/380: write d1/f54 [225575,11282] 0 2023-12-16T03:15:56.337 INFO:tasks.workunit.client.1.smithi184.stdout:4/381: truncate d1/d29/d34/d5c/d76/d33/f65 767194 0 2023-12-16T03:15:56.337 INFO:tasks.workunit.client.0.smithi064.stdout:9/124: mkdir d2/dc/d24 0 2023-12-16T03:15:56.338 INFO:tasks.workunit.client.0.smithi064.stdout:9/125: dread - d2/dc/f11 zero size 2023-12-16T03:15:56.338 INFO:tasks.workunit.client.0.smithi064.stdout:9/126: dread - d2/d16/f20 zero size 2023-12-16T03:15:56.338 INFO:tasks.workunit.client.0.smithi064.stdout:6/112: write d3/f5 [1978635,111511] 0 2023-12-16T03:15:56.339 INFO:tasks.workunit.client.0.smithi064.stdout:7/145: mknod d7/d26/c2f 0 2023-12-16T03:15:56.340 INFO:tasks.workunit.client.1.smithi184.stdout:0/532: rename dc/d22/d1d/d2c/d75/la1 to dc/d10/d2d/d5f/lb7 0 2023-12-16T03:15:56.340 INFO:tasks.workunit.client.1.smithi184.stdout:0/533: chown dc/d10/f14 19088706 1 2023-12-16T03:15:56.340 INFO:tasks.workunit.client.0.smithi064.stdout:9/127: rename d2/c3 to d2/dc/c25 0 2023-12-16T03:15:56.341 INFO:tasks.workunit.client.0.smithi064.stdout:9/128: write d2/dc/f11 [132027,1526] 0 2023-12-16T03:15:56.341 INFO:tasks.workunit.client.1.smithi184.stdout:8/504: readlink d2/d4/l5 0 2023-12-16T03:15:56.341 INFO:tasks.workunit.client.1.smithi184.stdout:8/505: truncate d2/d12/d21/d2d/d31/f3a 449001 0 2023-12-16T03:15:56.341 INFO:tasks.workunit.client.1.smithi184.stdout:8/506: write d2/d12/f38 [218542,95883] 0 2023-12-16T03:15:56.341 INFO:tasks.workunit.client.1.smithi184.stdout:8/507: fsync d2/d12/d21/d2d/d31/f63 0 2023-12-16T03:15:56.342 INFO:tasks.workunit.client.0.smithi064.stdout:6/113: rmdir d3/d9/d1a 0 2023-12-16T03:15:56.342 INFO:tasks.workunit.client.0.smithi064.stdout:6/114: truncate d3/d9/f18 522007 0 2023-12-16T03:15:56.344 INFO:tasks.workunit.client.1.smithi184.stdout:4/382: getdents d1/d29/d34/d5c/d76/d33 0 2023-12-16T03:15:56.344 INFO:tasks.workunit.client.0.smithi064.stdout:7/146: mkdir d7/d26/d30 0 2023-12-16T03:15:56.344 INFO:tasks.workunit.client.0.smithi064.stdout:7/147: read d7/d13/f1d [738770,18059] 0 2023-12-16T03:15:56.345 INFO:tasks.workunit.client.1.smithi184.stdout:0/534: link dc/d10/d1c/c86 dc/d22/d1d/cb8 0 2023-12-16T03:15:56.348 INFO:tasks.workunit.client.0.smithi064.stdout:6/115: creat d3/d8/d13/f1b x:0 0 0 2023-12-16T03:15:56.349 INFO:tasks.workunit.client.1.smithi184.stdout:0/535: creat dc/d22/d1d/d2c/fb9 x:0 0 0 2023-12-16T03:15:56.350 INFO:tasks.workunit.client.0.smithi064.stdout:2/155: dwrite d1/f10 [0,4194304] 0 2023-12-16T03:15:56.351 INFO:tasks.workunit.client.0.smithi064.stdout:7/148: creat d7/d13/f31 x:0 0 0 2023-12-16T03:15:56.351 INFO:tasks.workunit.client.0.smithi064.stdout:7/149: write d7/d13/d20/f28 [318325,59382] 0 2023-12-16T03:15:56.352 INFO:tasks.workunit.client.1.smithi184.stdout:0/536: creat dc/dab/fba x:0 0 0 2023-12-16T03:15:56.353 INFO:tasks.workunit.client.0.smithi064.stdout:8/259: dwrite d0/db/d37/f43 [0,4194304] 0 2023-12-16T03:15:56.360 INFO:tasks.workunit.client.1.smithi184.stdout:1/453: dread d3/d28/f44 [0,4194304] 0 2023-12-16T03:15:56.360 INFO:tasks.workunit.client.1.smithi184.stdout:0/537: dread dc/f42 [0,4194304] 0 2023-12-16T03:15:56.360 INFO:tasks.workunit.client.1.smithi184.stdout:1/454: write d3/d13/f5f [780591,49200] 0 2023-12-16T03:15:56.361 INFO:tasks.workunit.client.1.smithi184.stdout:0/538: symlink dc/d10/lbb 0 2023-12-16T03:15:56.361 INFO:tasks.workunit.client.1.smithi184.stdout:0/539: stat dc 0 2023-12-16T03:15:56.364 INFO:tasks.workunit.client.0.smithi064.stdout:7/150: unlink d7/d26/c2f 0 2023-12-16T03:15:56.365 INFO:tasks.workunit.client.1.smithi184.stdout:1/455: rename d3/c21 to d3/d28/d3c/d41/d46/d4a/d6a/d6d/c96 0 2023-12-16T03:15:56.365 INFO:tasks.workunit.client.1.smithi184.stdout:0/540: creat dc/d10/d2d/fbc x:0 0 0 2023-12-16T03:15:56.366 INFO:tasks.workunit.client.1.smithi184.stdout:0/541: chown dc/d22/d46/f6e 367 1 2023-12-16T03:15:56.366 INFO:tasks.workunit.client.1.smithi184.stdout:1/456: write d3/d28/f87 [932441,39149] 0 2023-12-16T03:15:56.366 INFO:tasks.workunit.client.1.smithi184.stdout:0/542: write dc/d22/d53/f95 [1249942,111872] 0 2023-12-16T03:15:56.366 INFO:tasks.workunit.client.1.smithi184.stdout:0/543: fdatasync dc/d22/d46/f67 0 2023-12-16T03:15:56.366 INFO:tasks.workunit.client.0.smithi064.stdout:6/116: dwrite d3/d8/da/fe [0,4194304] 0 2023-12-16T03:15:56.368 INFO:tasks.workunit.client.0.smithi064.stdout:3/228: dwrite f4 [0,4194304] 0 2023-12-16T03:15:56.368 INFO:tasks.workunit.client.0.smithi064.stdout:3/229: write db/d12/f18 [1501556,30380] 0 2023-12-16T03:15:56.368 INFO:tasks.workunit.client.1.smithi184.stdout:1/457: creat d3/d28/d3c/d24/d8e/f97 x:0 0 0 2023-12-16T03:15:56.369 INFO:tasks.workunit.client.1.smithi184.stdout:0/544: mkdir dc/d22/d46/d7f/dbd 0 2023-12-16T03:15:56.370 INFO:tasks.workunit.client.0.smithi064.stdout:7/151: symlink d7/l32 0 2023-12-16T03:15:56.371 INFO:tasks.workunit.client.1.smithi184.stdout:1/458: symlink d3/d34/d76/l98 0 2023-12-16T03:15:56.371 INFO:tasks.workunit.client.1.smithi184.stdout:0/545: fsync dc/f68 0 2023-12-16T03:15:56.372 INFO:tasks.workunit.client.1.smithi184.stdout:0/546: stat dc/d22/d1d/d43/d5a/d60/l90 0 2023-12-16T03:15:56.372 INFO:tasks.workunit.client.1.smithi184.stdout:0/547: mknod dc/d22/d46/d7f/cbe 0 2023-12-16T03:15:56.373 INFO:tasks.workunit.client.1.smithi184.stdout:0/548: chown dc/d22/d1d 31363 1 2023-12-16T03:15:56.373 INFO:tasks.workunit.client.0.smithi064.stdout:2/156: truncate d1/d15/f28 532130 0 2023-12-16T03:15:56.373 INFO:tasks.workunit.client.0.smithi064.stdout:2/157: truncate d1/d27/f29 833134 0 2023-12-16T03:15:56.374 INFO:tasks.workunit.client.1.smithi184.stdout:1/459: dread d3/d34/f4e [0,4194304] 0 2023-12-16T03:15:56.375 INFO:tasks.workunit.client.1.smithi184.stdout:1/460: write d3/d28/d3c/d41/f67 [851953,30483] 0 2023-12-16T03:15:56.375 INFO:tasks.workunit.client.0.smithi064.stdout:7/152: creat d7/d26/d30/f33 x:0 0 0 2023-12-16T03:15:56.376 INFO:tasks.workunit.client.0.smithi064.stdout:2/158: mknod d1/d15/d1b/c2a 0 2023-12-16T03:15:56.377 INFO:tasks.workunit.client.0.smithi064.stdout:7/153: unlink d7/d1c/f2d 0 2023-12-16T03:15:56.378 INFO:tasks.workunit.client.1.smithi184.stdout:0/549: dread dc/d22/d45/d66/f72 [0,4194304] 0 2023-12-16T03:15:56.379 INFO:tasks.workunit.client.0.smithi064.stdout:2/159: mknod d1/c2b 0 2023-12-16T03:15:56.379 INFO:tasks.workunit.client.0.smithi064.stdout:7/154: dread d7/d13/f29 [0,4194304] 0 2023-12-16T03:15:56.380 INFO:tasks.workunit.client.1.smithi184.stdout:0/550: creat dc/d22/d1d/d2c/d75/fbf x:0 0 0 2023-12-16T03:15:56.381 INFO:tasks.workunit.client.1.smithi184.stdout:0/551: rmdir dc/d22/d46/d7f/dbd 0 2023-12-16T03:15:56.381 INFO:tasks.workunit.client.0.smithi064.stdout:7/155: rename d7/d13/f1d to d7/d26/f34 0 2023-12-16T03:15:56.382 INFO:tasks.workunit.client.1.smithi184.stdout:0/552: mkdir dc/d10/da7/dc0 0 2023-12-16T03:15:56.382 INFO:tasks.workunit.client.1.smithi184.stdout:0/553: chown dc/d22/d1d/d43/f55 4101145 1 2023-12-16T03:15:56.382 INFO:tasks.workunit.client.1.smithi184.stdout:0/554: chown dc/d22/d48/f6d 1546717870 1 2023-12-16T03:15:56.383 INFO:tasks.workunit.client.0.smithi064.stdout:7/156: unlink d7/d1c/f1b 0 2023-12-16T03:15:56.387 INFO:tasks.workunit.client.1.smithi184.stdout:8/508: dwrite d2/d4/d10/d11/f3f [0,4194304] 0 2023-12-16T03:15:56.387 INFO:tasks.workunit.client.1.smithi184.stdout:8/509: stat d2/d4/d10/c1e 0 2023-12-16T03:15:56.392 INFO:tasks.workunit.client.0.smithi064.stdout:4/174: dwrite d0/d12/d17/f1d [0,4194304] 0 2023-12-16T03:15:56.392 INFO:tasks.workunit.client.1.smithi184.stdout:4/383: dwrite d1/f28 [4194304,4194304] 0 2023-12-16T03:15:56.393 INFO:tasks.workunit.client.0.smithi064.stdout:3/230: dwrite db/d12/d21/f3f [0,4194304] 0 2023-12-16T03:15:56.393 INFO:tasks.workunit.client.0.smithi064.stdout:0/102: dwrite f1 [0,4194304] 0 2023-12-16T03:15:56.393 INFO:tasks.workunit.client.0.smithi064.stdout:3/231: write db/f19 [3830475,44412] 0 2023-12-16T03:15:56.394 INFO:tasks.workunit.client.1.smithi184.stdout:8/510: dread d2/d4/f2e [0,4194304] 0 2023-12-16T03:15:56.395 INFO:tasks.workunit.client.0.smithi064.stdout:0/103: truncate d2/f5 596082 0 2023-12-16T03:15:56.399 INFO:tasks.workunit.client.0.smithi064.stdout:3/232: symlink db/d12/l55 0 2023-12-16T03:15:56.401 INFO:tasks.workunit.client.0.smithi064.stdout:9/129: getdents d2/dc 0 2023-12-16T03:15:56.401 INFO:tasks.workunit.client.0.smithi064.stdout:9/130: chown d2/d16/f1c 2105 1 2023-12-16T03:15:56.404 INFO:tasks.workunit.client.0.smithi064.stdout:6/117: getdents d3/d9 0 2023-12-16T03:15:56.412 INFO:tasks.workunit.client.0.smithi064.stdout:6/118: truncate d3/d8/da/fe 1664799 0 2023-12-16T03:15:56.413 INFO:tasks.workunit.client.0.smithi064.stdout:6/119: creat d3/d9/f1c x:0 0 0 2023-12-16T03:15:56.415 INFO:tasks.workunit.client.0.smithi064.stdout:6/120: unlink d3/d8/da/c12 0 2023-12-16T03:15:56.416 INFO:tasks.workunit.client.0.smithi064.stdout:6/121: write d3/fd [4669737,82865] 0 2023-12-16T03:15:56.416 INFO:tasks.workunit.client.0.smithi064.stdout:6/122: chown d3/d9/f1c 99284806 1 2023-12-16T03:15:56.417 INFO:tasks.workunit.client.1.smithi184.stdout:1/461: getdents d3/d28/d3c/d41/d46/d4a/d6a/d6d 0 2023-12-16T03:15:56.417 INFO:tasks.workunit.client.0.smithi064.stdout:7/157: rmdir d7/d26 39 2023-12-16T03:15:56.418 INFO:tasks.workunit.client.0.smithi064.stdout:6/123: mknod d3/d8/da/c1d 0 2023-12-16T03:15:56.418 INFO:tasks.workunit.client.0.smithi064.stdout:2/160: truncate d1/d27/f29 758004 0 2023-12-16T03:15:56.419 INFO:tasks.workunit.client.1.smithi184.stdout:1/462: mkdir d3/d28/d3c/d41/d46/d4a/d6a/d6d/d99 0 2023-12-16T03:15:56.419 INFO:tasks.workunit.client.1.smithi184.stdout:1/463: write d3/d28/d38/f73 [1204638,116866] 0 2023-12-16T03:15:56.419 INFO:tasks.workunit.client.1.smithi184.stdout:1/464: truncate d3/d28/f58 1043534 0 2023-12-16T03:15:56.420 INFO:tasks.workunit.client.0.smithi064.stdout:6/124: mknod d3/d8/da/c1e 0 2023-12-16T03:15:56.420 INFO:tasks.workunit.client.0.smithi064.stdout:6/125: dread - d3/d9/f1c zero size 2023-12-16T03:15:56.421 INFO:tasks.workunit.client.1.smithi184.stdout:0/555: rmdir dc/d10/d2d 39 2023-12-16T03:15:56.421 INFO:tasks.workunit.client.0.smithi064.stdout:6/126: mkdir d3/d8/d1f 0 2023-12-16T03:15:56.422 INFO:tasks.workunit.client.1.smithi184.stdout:0/556: write dc/f12 [5150797,64013] 0 2023-12-16T03:15:56.424 INFO:tasks.workunit.client.1.smithi184.stdout:1/465: write d3/d28/d3c/d41/d77/f78 [2928144,89350] 0 2023-12-16T03:15:56.424 INFO:tasks.workunit.client.1.smithi184.stdout:0/557: symlink dc/d22/d45/d66/d80/da3/lc1 0 2023-12-16T03:15:56.424 INFO:tasks.workunit.client.1.smithi184.stdout:0/558: write dc/d22/d53/f82 [465903,128061] 0 2023-12-16T03:15:56.425 INFO:tasks.workunit.client.1.smithi184.stdout:0/559: write dc/d22/d53/f82 [104452,121745] 0 2023-12-16T03:15:56.426 INFO:tasks.workunit.client.0.smithi064.stdout:3/233: dwrite db/fd [0,4194304] 0 2023-12-16T03:15:56.427 INFO:tasks.workunit.client.1.smithi184.stdout:1/466: creat d3/d28/d3c/d41/d63/f9a x:0 0 0 2023-12-16T03:15:56.427 INFO:tasks.workunit.client.1.smithi184.stdout:1/467: read - d3/d28/d3c/d41/f62 zero size 2023-12-16T03:15:56.428 INFO:tasks.workunit.client.0.smithi064.stdout:4/175: dwrite d0/f2 [8388608,4194304] 0 2023-12-16T03:15:56.429 INFO:tasks.workunit.client.1.smithi184.stdout:1/468: creat d3/d28/d36/f9b x:0 0 0 2023-12-16T03:15:56.433 INFO:tasks.workunit.client.1.smithi184.stdout:4/384: dwrite d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:56.433 INFO:tasks.workunit.client.0.smithi064.stdout:3/234: mkdir db/d12/d4e/d56 0 2023-12-16T03:15:56.435 INFO:tasks.workunit.client.0.smithi064.stdout:4/176: symlink d0/l32 0 2023-12-16T03:15:56.435 INFO:tasks.workunit.client.1.smithi184.stdout:4/385: symlink d1/d12/d13/d40/d43/l7c 0 2023-12-16T03:15:56.436 INFO:tasks.workunit.client.1.smithi184.stdout:4/386: read d1/d12/d13/d40/d43/d45/f7b [1836031,20506] 0 2023-12-16T03:15:56.439 INFO:tasks.workunit.client.1.smithi184.stdout:4/387: rename d1/d12/d13/l21 to d1/d29/d34/d5c/d76/d42/l7d 0 2023-12-16T03:15:56.441 INFO:tasks.workunit.client.0.smithi064.stdout:9/131: dwrite d2/d16/f1c [0,4194304] 0 2023-12-16T03:15:56.443 INFO:tasks.workunit.client.1.smithi184.stdout:4/388: mknod d1/d12/d13/d40/d43/d5e/c7e 0 2023-12-16T03:15:56.446 INFO:tasks.workunit.client.1.smithi184.stdout:4/389: creat d1/f7f x:0 0 0 2023-12-16T03:15:56.446 INFO:tasks.workunit.client.0.smithi064.stdout:9/132: creat d2/dc/f26 x:0 0 0 2023-12-16T03:15:56.446 INFO:tasks.workunit.client.0.smithi064.stdout:9/133: dread - d2/dc/f26 zero size 2023-12-16T03:15:56.447 INFO:tasks.workunit.client.0.smithi064.stdout:9/134: creat d2/d16/f27 x:0 0 0 2023-12-16T03:15:56.447 INFO:tasks.workunit.client.0.smithi064.stdout:4/177: dread d0/d1e/f29 [0,4194304] 0 2023-12-16T03:15:56.447 INFO:tasks.workunit.client.1.smithi184.stdout:3/487: sync 2023-12-16T03:15:56.447 INFO:tasks.workunit.client.1.smithi184.stdout:9/635: sync 2023-12-16T03:15:56.447 INFO:tasks.workunit.client.1.smithi184.stdout:6/486: sync 2023-12-16T03:15:56.448 INFO:tasks.workunit.client.0.smithi064.stdout:9/135: symlink d2/l28 0 2023-12-16T03:15:56.448 INFO:tasks.workunit.client.1.smithi184.stdout:9/636: mkdir d0/d13/d20/d5b/d43/dc7/dda 0 2023-12-16T03:15:56.449 INFO:tasks.workunit.client.0.smithi064.stdout:4/178: unlink d0/d12/d17/f1a 0 2023-12-16T03:15:56.450 INFO:tasks.workunit.client.1.smithi184.stdout:4/390: write d1/f28 [7941294,8434] 0 2023-12-16T03:15:56.450 INFO:tasks.workunit.client.1.smithi184.stdout:9/637: mkdir d0/d76/da2/dc4/ddb 0 2023-12-16T03:15:56.452 INFO:tasks.workunit.client.0.smithi064.stdout:9/136: rename d2/dc/f22 to d2/dc/f29 0 2023-12-16T03:15:56.452 INFO:tasks.workunit.client.1.smithi184.stdout:3/488: write f2 [1882881,60790] 0 2023-12-16T03:15:56.452 INFO:tasks.workunit.client.1.smithi184.stdout:3/489: chown d12/d18/d7a/f8f 861726 1 2023-12-16T03:15:56.453 INFO:tasks.workunit.client.1.smithi184.stdout:4/391: rmdir d1/d29/d34/d5c/d76/d33 39 2023-12-16T03:15:56.453 INFO:tasks.workunit.client.0.smithi064.stdout:4/179: mkdir d0/d14/d33 0 2023-12-16T03:15:56.454 INFO:tasks.workunit.client.0.smithi064.stdout:4/180: readlink d0/d1e/l1f 0 2023-12-16T03:15:56.454 INFO:tasks.workunit.client.1.smithi184.stdout:9/638: truncate d0/d13/d20/d5b/f52 290382 0 2023-12-16T03:15:56.454 INFO:tasks.workunit.client.1.smithi184.stdout:9/639: dread - d0/d13/d20/d5b/d43/dab/faa zero size 2023-12-16T03:15:56.455 INFO:tasks.workunit.client.0.smithi064.stdout:7/158: dwrite d7/d13/d20/f28 [0,4194304] 0 2023-12-16T03:15:56.456 INFO:tasks.workunit.client.0.smithi064.stdout:4/181: mknod d0/c34 0 2023-12-16T03:15:56.461 INFO:tasks.workunit.client.1.smithi184.stdout:9/640: rename d0/d13/d6e/d9f to d0/d13/d20/d5b/d43/dc7/ddc 0 2023-12-16T03:15:56.461 INFO:tasks.workunit.client.0.smithi064.stdout:2/161: write d1/d15/f1f [786631,30785] 0 2023-12-16T03:15:56.462 INFO:tasks.workunit.client.1.smithi184.stdout:9/641: mknod d0/d13/d20/d5b/cdd 0 2023-12-16T03:15:56.462 INFO:tasks.workunit.client.1.smithi184.stdout:9/642: readlink d0/lf 0 2023-12-16T03:15:56.463 INFO:tasks.workunit.client.0.smithi064.stdout:4/182: creat d0/d12/f35 x:0 0 0 2023-12-16T03:15:56.465 INFO:tasks.workunit.client.0.smithi064.stdout:2/162: rename d1/c2 to d1/d15/d1e/c2c 0 2023-12-16T03:15:56.465 INFO:tasks.workunit.client.0.smithi064.stdout:6/127: dwrite d3/d9/f18 [0,4194304] 0 2023-12-16T03:15:56.466 INFO:tasks.workunit.client.1.smithi184.stdout:0/560: dwrite dc/d22/d45/d66/d80/f8a [0,4194304] 0 2023-12-16T03:15:56.469 INFO:tasks.workunit.client.0.smithi064.stdout:2/163: read d1/f4 [3547889,22402] 0 2023-12-16T03:15:56.469 INFO:tasks.workunit.client.0.smithi064.stdout:6/128: creat d3/d9/f20 x:0 0 0 2023-12-16T03:15:56.470 INFO:tasks.workunit.client.0.smithi064.stdout:0/104: dread d2/f5 [0,4194304] 0 2023-12-16T03:15:56.472 INFO:tasks.workunit.client.0.smithi064.stdout:2/164: mkdir d1/d15/d23/d2d 0 2023-12-16T03:15:56.475 INFO:tasks.workunit.client.1.smithi184.stdout:0/561: creat dc/d10/d2d/d5f/fc2 x:0 0 0 2023-12-16T03:15:56.479 INFO:tasks.workunit.client.0.smithi064.stdout:0/105: mknod d2/d8/da/c19 0 2023-12-16T03:15:56.479 INFO:tasks.workunit.client.0.smithi064.stdout:2/165: unlink d1/fa 0 2023-12-16T03:15:56.479 INFO:tasks.workunit.client.0.smithi064.stdout:2/166: write d1/f7 [193150,30045] 0 2023-12-16T03:15:56.481 INFO:tasks.workunit.client.0.smithi064.stdout:0/106: creat d2/d7/d10/f1a x:0 0 0 2023-12-16T03:15:56.482 INFO:tasks.workunit.client.0.smithi064.stdout:0/107: creat d2/d8/f1b x:0 0 0 2023-12-16T03:15:56.483 INFO:tasks.workunit.client.0.smithi064.stdout:4/183: dread d0/d12/d17/f1d [0,4194304] 0 2023-12-16T03:15:56.484 INFO:tasks.workunit.client.0.smithi064.stdout:0/108: creat d2/d8/f1c x:0 0 0 2023-12-16T03:15:56.484 INFO:tasks.workunit.client.0.smithi064.stdout:0/109: readlink d2/d8/da/le 0 2023-12-16T03:15:56.484 INFO:tasks.workunit.client.0.smithi064.stdout:0/110: stat f1 0 2023-12-16T03:15:56.489 INFO:tasks.workunit.client.0.smithi064.stdout:1/162: sync 2023-12-16T03:15:56.489 INFO:tasks.workunit.client.0.smithi064.stdout:8/260: sync 2023-12-16T03:15:56.489 INFO:tasks.workunit.client.0.smithi064.stdout:8/261: chown d0/d1d/d24/l1a 13 1 2023-12-16T03:15:56.489 INFO:tasks.workunit.client.0.smithi064.stdout:5/184: sync 2023-12-16T03:15:56.489 INFO:tasks.workunit.client.0.smithi064.stdout:5/185: stat d0/d14/d25 0 2023-12-16T03:15:56.491 INFO:tasks.workunit.client.0.smithi064.stdout:5/186: unlink d0/f32 0 2023-12-16T03:15:56.493 INFO:tasks.workunit.client.0.smithi064.stdout:5/187: mkdir d0/d14/d25/d44 0 2023-12-16T03:15:56.493 INFO:tasks.workunit.client.0.smithi064.stdout:1/163: dread d3/f25 [0,4194304] 0 2023-12-16T03:15:56.494 INFO:tasks.workunit.client.0.smithi064.stdout:5/188: mknod d0/d14/d20/d29/c45 0 2023-12-16T03:15:56.497 INFO:tasks.workunit.client.1.smithi184.stdout:3/490: dwrite d12/d18/d7a/f8f [0,4194304] 0 2023-12-16T03:15:56.498 INFO:tasks.workunit.client.1.smithi184.stdout:6/487: dwrite d0/d5/d12/d1b/f5b [0,4194304] 0 2023-12-16T03:15:56.498 INFO:tasks.workunit.client.0.smithi064.stdout:3/235: dwrite db/d12/d1a/d31/f47 [0,4194304] 0 2023-12-16T03:15:56.498 INFO:tasks.workunit.client.0.smithi064.stdout:3/236: fsync db/d13/f25 0 2023-12-16T03:15:56.500 INFO:tasks.workunit.client.0.smithi064.stdout:1/164: creat d3/d37/f3a x:0 0 0 2023-12-16T03:15:56.500 INFO:tasks.workunit.client.0.smithi064.stdout:3/237: getdents db/d13/d39 0 2023-12-16T03:15:56.503 INFO:tasks.workunit.client.0.smithi064.stdout:5/189: rename d0/d14/d20/d29/c45 to d0/c46 0 2023-12-16T03:15:56.503 INFO:tasks.workunit.client.0.smithi064.stdout:5/190: fdatasync d0/d7/f2e 0 2023-12-16T03:15:56.503 INFO:tasks.workunit.client.0.smithi064.stdout:9/137: dwrite d2/dc/f12 [0,4194304] 0 2023-12-16T03:15:56.503 INFO:tasks.workunit.client.0.smithi064.stdout:9/138: chown d2/d16 7 1 2023-12-16T03:15:56.503 INFO:tasks.workunit.client.0.smithi064.stdout:3/238: write db/d13/f25 [527429,34180] 0 2023-12-16T03:15:56.504 INFO:tasks.workunit.client.1.smithi184.stdout:9/643: dwrite d0/d13/d20/d5b/faf [0,4194304] 0 2023-12-16T03:15:56.505 INFO:tasks.workunit.client.0.smithi064.stdout:6/129: dwrite d3/d9/f20 [0,4194304] 0 2023-12-16T03:15:56.506 INFO:tasks.workunit.client.0.smithi064.stdout:9/139: write d2/dc/f15 [988463,18815] 0 2023-12-16T03:15:56.506 INFO:tasks.workunit.client.0.smithi064.stdout:9/140: truncate d2/dc/f26 104703 0 2023-12-16T03:15:56.506 INFO:tasks.workunit.client.0.smithi064.stdout:1/165: truncate d3/f13 1213678 0 2023-12-16T03:15:56.506 INFO:tasks.workunit.client.0.smithi064.stdout:1/166: fsync d3/dd/f2d 0 2023-12-16T03:15:56.506 INFO:tasks.workunit.client.0.smithi064.stdout:1/167: getdents d3/dd/d11/d38 0 2023-12-16T03:15:56.506 INFO:tasks.workunit.client.0.smithi064.stdout:1/168: chown d3/dd/d2a/l2b 494 1 2023-12-16T03:15:56.507 INFO:tasks.workunit.client.0.smithi064.stdout:5/191: mknod d0/d14/d20/d29/d39/c47 0 2023-12-16T03:15:56.508 INFO:tasks.workunit.client.0.smithi064.stdout:9/141: read d2/dc/f1f [2511611,82865] 0 2023-12-16T03:15:56.510 INFO:tasks.workunit.client.1.smithi184.stdout:6/488: write d0/d5/d22/fb [1126275,5924] 0 2023-12-16T03:15:56.511 INFO:tasks.workunit.client.0.smithi064.stdout:5/192: dread d0/d7/f2e [0,4194304] 0 2023-12-16T03:15:56.511 INFO:tasks.workunit.client.0.smithi064.stdout:3/239: stat db/d12/d1a/d2c/l3c 0 2023-12-16T03:15:56.514 INFO:tasks.workunit.client.0.smithi064.stdout:1/169: dread d3/d22/f28 [0,4194304] 0 2023-12-16T03:15:56.516 INFO:tasks.workunit.client.0.smithi064.stdout:2/167: dwrite d1/fd [0,4194304] 0 2023-12-16T03:15:56.517 INFO:tasks.workunit.client.0.smithi064.stdout:4/184: getdents d0/d12/d17 0 2023-12-16T03:15:56.520 INFO:tasks.workunit.client.0.smithi064.stdout:9/142: write d2/dc/f15 [1480066,5096] 0 2023-12-16T03:15:56.523 INFO:tasks.workunit.client.0.smithi064.stdout:3/240: dread f6 [0,4194304] 0 2023-12-16T03:15:56.525 INFO:tasks.workunit.client.0.smithi064.stdout:8/262: dwrite d0/f14 [0,4194304] 0 2023-12-16T03:15:56.526 INFO:tasks.workunit.client.0.smithi064.stdout:4/185: mkdir d0/d1e/d36 0 2023-12-16T03:15:56.526 INFO:tasks.workunit.client.0.smithi064.stdout:2/168: mkdir d1/d27/d2e 0 2023-12-16T03:15:56.528 INFO:tasks.workunit.client.0.smithi064.stdout:9/143: rename d2/fb to d2/f2a 0 2023-12-16T03:15:56.532 INFO:tasks.workunit.client.0.smithi064.stdout:8/263: mkdir d0/db/d12/d1c/d59/d5c 0 2023-12-16T03:15:56.535 INFO:tasks.workunit.client.0.smithi064.stdout:8/264: read d0/f7 [4010016,22834] 0 2023-12-16T03:15:56.539 INFO:tasks.workunit.client.0.smithi064.stdout:4/186: creat d0/d1e/f37 x:0 0 0 2023-12-16T03:15:56.539 INFO:tasks.workunit.client.0.smithi064.stdout:4/187: truncate d0/d12/d17/f31 154636 0 2023-12-16T03:15:56.540 INFO:tasks.workunit.client.0.smithi064.stdout:0/111: getdents d2/d8/da 0 2023-12-16T03:15:56.541 INFO:tasks.workunit.client.0.smithi064.stdout:6/130: dwrite d3/d9/f1c [0,4194304] 0 2023-12-16T03:15:56.542 INFO:tasks.workunit.client.0.smithi064.stdout:6/131: fsync d3/d9/f15 0 2023-12-16T03:15:56.545 INFO:tasks.workunit.client.0.smithi064.stdout:9/144: rmdir d2/dc 39 2023-12-16T03:15:56.545 INFO:tasks.workunit.client.0.smithi064.stdout:6/132: write d3/d9/f18 [117289,117489] 0 2023-12-16T03:15:56.546 INFO:tasks.workunit.client.1.smithi184.stdout:9/644: truncate d0/d13/d20/f86 2736193 0 2023-12-16T03:15:56.546 INFO:tasks.workunit.client.1.smithi184.stdout:9/645: dread - d0/d3a/d47/fd7 zero size 2023-12-16T03:15:56.546 INFO:tasks.workunit.client.1.smithi184.stdout:9/646: dread - d0/d13/d20/d5b/d43/dc7/ddc/fba zero size 2023-12-16T03:15:56.547 INFO:tasks.workunit.client.0.smithi064.stdout:3/241: symlink db/l57 0 2023-12-16T03:15:56.549 INFO:tasks.workunit.client.0.smithi064.stdout:7/159: dwrite d7/d13/d20/f28 [4194304,4194304] 0 2023-12-16T03:15:56.549 INFO:tasks.workunit.client.0.smithi064.stdout:2/169: write d1/f10 [2885632,111249] 0 2023-12-16T03:15:56.552 INFO:tasks.workunit.client.1.smithi184.stdout:6/489: mkdir d0/d5/d22/d37/d4d/d9c 0 2023-12-16T03:15:56.552 INFO:tasks.workunit.client.1.smithi184.stdout:6/490: chown d0/d5/d12/l20 31 1 2023-12-16T03:15:56.554 INFO:tasks.workunit.client.0.smithi064.stdout:4/188: getdents d0/d12 0 2023-12-16T03:15:56.554 INFO:tasks.workunit.client.0.smithi064.stdout:0/112: getdents d2/d7/d10 0 2023-12-16T03:15:56.560 INFO:tasks.workunit.client.0.smithi064.stdout:1/170: dwrite d3/dd/f1a [0,4194304] 0 2023-12-16T03:15:56.560 INFO:tasks.workunit.client.0.smithi064.stdout:5/193: dwrite d0/d14/d20/d29/f33 [0,4194304] 0 2023-12-16T03:15:56.560 INFO:tasks.workunit.client.0.smithi064.stdout:5/194: write d0/de/d23/f3f [585651,44062] 0 2023-12-16T03:15:56.561 INFO:tasks.workunit.client.0.smithi064.stdout:9/145: rmdir d2/d16 39 2023-12-16T03:15:56.563 INFO:tasks.workunit.client.0.smithi064.stdout:6/133: mknod d3/c21 0 2023-12-16T03:15:56.563 INFO:tasks.workunit.client.0.smithi064.stdout:6/134: stat d3/d8/da/c1d 0 2023-12-16T03:15:56.565 INFO:tasks.workunit.client.0.smithi064.stdout:3/242: truncate db/f16 1420274 0 2023-12-16T03:15:56.574 INFO:tasks.workunit.client.1.smithi184.stdout:6/491: dread d0/f18 [0,4194304] 0 2023-12-16T03:15:56.576 INFO:tasks.workunit.client.0.smithi064.stdout:4/189: creat d0/d14/d33/f38 x:0 0 0 2023-12-16T03:15:56.577 INFO:tasks.workunit.client.0.smithi064.stdout:2/170: dread d1/d15/f1f [0,4194304] 0 2023-12-16T03:15:56.578 INFO:tasks.workunit.client.1.smithi184.stdout:9/647: dwrite d0/d3a/d47/fd1 [0,4194304] 0 2023-12-16T03:15:56.578 INFO:tasks.workunit.client.1.smithi184.stdout:9/648: fdatasync d0/d3a/d47/fd1 0 2023-12-16T03:15:56.579 INFO:tasks.workunit.client.0.smithi064.stdout:0/113: dwrite d2/d8/f1c [0,4194304] 0 2023-12-16T03:15:56.581 INFO:tasks.workunit.client.0.smithi064.stdout:7/160: dwrite d7/d26/d30/f33 [0,4194304] 0 2023-12-16T03:15:56.583 INFO:tasks.workunit.client.0.smithi064.stdout:1/171: write d3/f1b [537831,53584] 0 2023-12-16T03:15:56.584 INFO:tasks.workunit.client.0.smithi064.stdout:5/195: rename d0/d19/d41 to d0/d19/d48 0 2023-12-16T03:15:56.586 INFO:tasks.workunit.client.0.smithi064.stdout:9/146: creat d2/dc/f2b x:0 0 0 2023-12-16T03:15:56.586 INFO:tasks.workunit.client.0.smithi064.stdout:9/147: chown d2/f1d 0 1 2023-12-16T03:15:56.587 INFO:tasks.workunit.client.0.smithi064.stdout:9/148: dread - d2/d16/f27 zero size 2023-12-16T03:15:56.587 INFO:tasks.workunit.client.0.smithi064.stdout:9/149: truncate f1 4676265 0 2023-12-16T03:15:56.587 INFO:tasks.workunit.client.0.smithi064.stdout:5/196: dread d0/d14/d20/d29/f30 [0,4194304] 0 2023-12-16T03:15:56.589 INFO:tasks.workunit.client.0.smithi064.stdout:6/135: creat d3/d8/d1f/f22 x:0 0 0 2023-12-16T03:15:56.589 INFO:tasks.workunit.client.0.smithi064.stdout:6/136: write d3/d9/f20 [4858168,28878] 0 2023-12-16T03:15:56.591 INFO:tasks.workunit.client.0.smithi064.stdout:3/243: rename db/d12/f15 to db/d12/f58 0 2023-12-16T03:15:56.597 INFO:tasks.workunit.client.0.smithi064.stdout:7/161: dread d7/d26/d30/f33 [0,4194304] 0 2023-12-16T03:15:56.597 INFO:tasks.workunit.client.0.smithi064.stdout:4/190: mknod d0/da/c39 0 2023-12-16T03:15:56.598 INFO:tasks.workunit.client.0.smithi064.stdout:2/171: chown d1/fd 0 1 2023-12-16T03:15:56.601 INFO:tasks.workunit.client.0.smithi064.stdout:0/114: mkdir d2/d8/da/d11/d1d 0 2023-12-16T03:15:56.605 INFO:tasks.workunit.client.0.smithi064.stdout:9/150: dwrite f1 [0,4194304] 0 2023-12-16T03:15:56.605 INFO:tasks.workunit.client.0.smithi064.stdout:9/151: chown d2/d16/f27 87 1 2023-12-16T03:15:56.605 INFO:tasks.workunit.client.0.smithi064.stdout:3/244: symlink db/d13/l59 0 2023-12-16T03:15:56.606 INFO:tasks.workunit.client.0.smithi064.stdout:7/162: mknod d7/d13/c35 0 2023-12-16T03:15:56.607 INFO:tasks.workunit.client.0.smithi064.stdout:4/191: dread d0/f8 [0,4194304] 0 2023-12-16T03:15:56.609 INFO:tasks.workunit.client.0.smithi064.stdout:0/115: mknod d2/d8/da/df/c1e 0 2023-12-16T03:15:56.612 INFO:tasks.workunit.client.0.smithi064.stdout:5/197: rename d0/d7/l18 to d0/l49 0 2023-12-16T03:15:56.614 INFO:tasks.workunit.client.0.smithi064.stdout:9/152: mkdir d2/d2c 0 2023-12-16T03:15:56.616 INFO:tasks.workunit.client.0.smithi064.stdout:3/245: unlink db/d13/c1b 0 2023-12-16T03:15:56.616 INFO:tasks.workunit.client.0.smithi064.stdout:3/246: stat db/d13/d39 0 2023-12-16T03:15:56.619 INFO:tasks.workunit.client.0.smithi064.stdout:7/163: mknod d7/d13/c36 0 2023-12-16T03:15:56.621 INFO:tasks.workunit.client.0.smithi064.stdout:2/172: mkdir d1/d27/d2f 0 2023-12-16T03:15:56.625 INFO:tasks.workunit.client.0.smithi064.stdout:0/116: creat d2/d7/d10/f1f x:0 0 0 2023-12-16T03:15:56.627 INFO:tasks.workunit.client.0.smithi064.stdout:6/137: rename d3/d9/f15 to d3/d8/da/f23 0 2023-12-16T03:15:56.630 INFO:tasks.workunit.client.0.smithi064.stdout:6/138: write d3/d9/f20 [3820811,53763] 0 2023-12-16T03:15:56.630 INFO:tasks.workunit.client.0.smithi064.stdout:6/139: readlink d3/d8/da/l14 0 2023-12-16T03:15:56.630 INFO:tasks.workunit.client.0.smithi064.stdout:6/140: fdatasync d3/f5 0 2023-12-16T03:15:56.631 INFO:tasks.workunit.client.0.smithi064.stdout:9/153: mkdir d2/d2d 0 2023-12-16T03:15:56.631 INFO:tasks.workunit.client.0.smithi064.stdout:7/164: dread d7/d13/d20/f28 [4194304,4194304] 0 2023-12-16T03:15:56.631 INFO:tasks.workunit.client.0.smithi064.stdout:7/165: chown d7/d26 3 1 2023-12-16T03:15:56.631 INFO:tasks.workunit.client.0.smithi064.stdout:3/247: getdents db/d4f 0 2023-12-16T03:15:56.641 INFO:tasks.workunit.client.0.smithi064.stdout:0/117: mkdir d2/d7/d20 0 2023-12-16T03:15:56.641 INFO:tasks.workunit.client.0.smithi064.stdout:6/141: creat d3/d8/d13/f24 x:0 0 0 2023-12-16T03:15:56.642 INFO:tasks.workunit.client.0.smithi064.stdout:2/173: write d1/f8 [943729,62098] 0 2023-12-16T03:15:56.642 INFO:tasks.workunit.client.0.smithi064.stdout:7/166: stat d7/d13/d20/c2a 0 2023-12-16T03:15:56.643 INFO:tasks.workunit.client.0.smithi064.stdout:4/192: dwrite d0/d1e/f29 [0,4194304] 0 2023-12-16T03:15:56.643 INFO:tasks.workunit.client.0.smithi064.stdout:4/193: truncate d0/d14/d33/f38 133054 0 2023-12-16T03:15:56.644 INFO:tasks.workunit.client.0.smithi064.stdout:0/118: getdents d2 0 2023-12-16T03:15:56.651 INFO:tasks.workunit.client.0.smithi064.stdout:7/167: mkdir d7/d13/d20/d37 0 2023-12-16T03:15:56.651 INFO:tasks.workunit.client.0.smithi064.stdout:7/168: write d7/d13/f29 [2058938,60155] 0 2023-12-16T03:15:56.651 INFO:tasks.workunit.client.0.smithi064.stdout:4/194: rename d0/d12/d17/l2b to d0/da/l3a 0 2023-12-16T03:15:56.651 INFO:tasks.workunit.client.0.smithi064.stdout:4/195: write d0/f2e [847287,24461] 0 2023-12-16T03:15:56.651 INFO:tasks.workunit.client.1.smithi184.stdout:3/491: unlink d12/d18/d1f/d23/fb5 0 2023-12-16T03:15:56.652 INFO:tasks.workunit.client.1.smithi184.stdout:3/492: creat d12/d18/d1f/d23/d2a/fb8 x:0 0 0 2023-12-16T03:15:56.652 INFO:tasks.workunit.client.1.smithi184.stdout:3/493: truncate d12/d18/d1f/d23/d2a/f55 4824119 0 2023-12-16T03:15:56.652 INFO:tasks.workunit.client.1.smithi184.stdout:3/494: chown d12/d18/f71 2442959 1 2023-12-16T03:15:56.654 INFO:tasks.workunit.client.1.smithi184.stdout:9/649: dwrite d0/d3a/d47/fd1 [4194304,4194304] 0 2023-12-16T03:15:56.655 INFO:tasks.workunit.client.1.smithi184.stdout:3/495: symlink d12/d1e/da3/lb9 0 2023-12-16T03:15:56.655 INFO:tasks.workunit.client.0.smithi064.stdout:2/174: rename d1/fd to d1/f30 0 2023-12-16T03:15:56.656 INFO:tasks.workunit.client.0.smithi064.stdout:3/248: dread db/d13/f24 [0,4194304] 0 2023-12-16T03:15:56.659 INFO:tasks.workunit.client.0.smithi064.stdout:7/169: rename d7/d13/cf to d7/d13/d20/d37/c38 0 2023-12-16T03:15:56.660 INFO:tasks.workunit.client.0.smithi064.stdout:2/175: chown d1/f4 1589123 1 2023-12-16T03:15:56.661 INFO:tasks.workunit.client.1.smithi184.stdout:3/496: read fd [3284870,113964] 0 2023-12-16T03:15:56.663 INFO:tasks.workunit.client.1.smithi184.stdout:9/650: creat d0/d76/fde x:0 0 0 2023-12-16T03:15:56.663 INFO:tasks.workunit.client.1.smithi184.stdout:9/651: chown d0/d13/d6e/d84/l4e 2 1 2023-12-16T03:15:56.663 INFO:tasks.workunit.client.1.smithi184.stdout:9/652: fsync d0/d13/f87 0 2023-12-16T03:15:56.663 INFO:tasks.workunit.client.0.smithi064.stdout:4/196: dread d0/d14/d33/f38 [0,4194304] 0 2023-12-16T03:15:56.664 INFO:tasks.workunit.client.1.smithi184.stdout:3/497: mkdir d12/d18/d7a/dba 0 2023-12-16T03:15:56.666 INFO:tasks.workunit.client.0.smithi064.stdout:4/197: write d0/d12/d17/f1d [399976,30865] 0 2023-12-16T03:15:56.666 INFO:tasks.workunit.client.0.smithi064.stdout:7/170: creat d7/d26/d30/f39 x:0 0 0 2023-12-16T03:15:56.666 INFO:tasks.workunit.client.0.smithi064.stdout:9/154: write d2/f1d [2031645,32349] 0 2023-12-16T03:15:56.666 INFO:tasks.workunit.client.0.smithi064.stdout:9/155: chown d2/l28 330639893 1 2023-12-16T03:15:56.666 INFO:tasks.workunit.client.0.smithi064.stdout:1/172: dwrite d3/f25 [0,4194304] 0 2023-12-16T03:15:56.666 INFO:tasks.workunit.client.0.smithi064.stdout:1/173: chown d3/c33 132 1 2023-12-16T03:15:56.667 INFO:tasks.workunit.client.0.smithi064.stdout:1/174: write d3/d22/f2e [806686,90051] 0 2023-12-16T03:15:56.667 INFO:tasks.workunit.client.1.smithi184.stdout:0/562: rename dc/d22/d46 to dc/d22/d1d/d35/dc3 0 2023-12-16T03:15:56.667 INFO:tasks.workunit.client.1.smithi184.stdout:0/563: truncate dc/d22/d1d/d2c/d75/fbf 538866 0 2023-12-16T03:15:56.667 INFO:tasks.workunit.client.0.smithi064.stdout:2/176: write d1/f1d [1461597,58316] 0 2023-12-16T03:15:56.667 INFO:tasks.workunit.client.0.smithi064.stdout:9/156: write d2/dc/f11 [127188,67631] 0 2023-12-16T03:15:56.668 INFO:tasks.workunit.client.1.smithi184.stdout:3/498: creat d12/d18/d1f/d23/d2a/fbb x:0 0 0 2023-12-16T03:15:56.669 INFO:tasks.workunit.client.0.smithi064.stdout:9/157: read d2/dc/ff [2834752,127267] 0 2023-12-16T03:15:56.669 INFO:tasks.workunit.client.0.smithi064.stdout:9/158: readlink d2/l1b 0 2023-12-16T03:15:56.672 INFO:tasks.workunit.client.1.smithi184.stdout:6/492: rename d0/d36/l9a to d0/d5/d22/d37/l9d 0 2023-12-16T03:15:56.672 INFO:tasks.workunit.client.1.smithi184.stdout:0/564: write dc/d22/d1d/d43/d5a/f89 [94371,98141] 0 2023-12-16T03:15:56.672 INFO:tasks.workunit.client.1.smithi184.stdout:0/565: write dc/d22/d45/d66/d80/da3/f91 [1528219,16752] 0 2023-12-16T03:15:56.673 INFO:tasks.workunit.client.0.smithi064.stdout:0/119: fsync d2/d7/d10/f1f 0 2023-12-16T03:15:56.673 INFO:tasks.workunit.client.0.smithi064.stdout:0/120: fsync d2/d7/d10/f1a 0 2023-12-16T03:15:56.676 INFO:tasks.workunit.client.1.smithi184.stdout:3/499: mknod d12/d18/d1f/d23/d2a/d3e/cbc 0 2023-12-16T03:15:56.678 INFO:tasks.workunit.client.0.smithi064.stdout:2/177: dread d1/f30 [0,4194304] 0 2023-12-16T03:15:56.686 INFO:tasks.workunit.client.0.smithi064.stdout:4/198: symlink d0/d14/l3b 0 2023-12-16T03:15:56.686 INFO:tasks.workunit.client.0.smithi064.stdout:4/199: chown d0/d14/d33/f38 114774647 1 2023-12-16T03:15:56.688 INFO:tasks.workunit.client.0.smithi064.stdout:5/198: dwrite d0/f17 [0,4194304] 0 2023-12-16T03:15:56.691 INFO:tasks.workunit.client.0.smithi064.stdout:1/175: mkdir d3/dd/d11/d3b 0 2023-12-16T03:15:56.694 INFO:tasks.workunit.client.0.smithi064.stdout:1/176: dread d3/d22/f28 [0,4194304] 0 2023-12-16T03:15:56.695 INFO:tasks.workunit.client.0.smithi064.stdout:0/121: rename d2/d7/d20 to d2/d7/d10/d21 0 2023-12-16T03:15:56.696 INFO:tasks.workunit.client.0.smithi064.stdout:2/178: mknod d1/d27/d2f/c31 0 2023-12-16T03:15:56.700 INFO:tasks.workunit.client.0.smithi064.stdout:6/142: dwrite d3/d9/f20 [4194304,4194304] 0 2023-12-16T03:15:56.703 INFO:tasks.workunit.client.0.smithi064.stdout:0/122: rmdir d2/d8/da 39 2023-12-16T03:15:56.705 INFO:tasks.workunit.client.0.smithi064.stdout:2/179: mknod d1/d15/d1e/c32 0 2023-12-16T03:15:56.706 INFO:tasks.workunit.client.1.smithi184.stdout:6/493: getdents d0/d5/d22/d37 0 2023-12-16T03:15:56.706 INFO:tasks.workunit.client.1.smithi184.stdout:9/653: dwrite d0/d13/d20/d5b/d43/dab/faa [0,4194304] 0 2023-12-16T03:15:56.706 INFO:tasks.workunit.client.0.smithi064.stdout:6/143: creat d3/f25 x:0 0 0 2023-12-16T03:15:56.707 INFO:tasks.workunit.client.0.smithi064.stdout:6/144: write d3/d9/f1c [4457565,117394] 0 2023-12-16T03:15:56.708 INFO:tasks.workunit.client.0.smithi064.stdout:0/123: symlink d2/d8/l22 0 2023-12-16T03:15:56.709 INFO:tasks.workunit.client.1.smithi184.stdout:2/299: sync 2023-12-16T03:15:56.709 INFO:tasks.workunit.client.1.smithi184.stdout:5/346: sync 2023-12-16T03:15:56.712 INFO:tasks.workunit.client.1.smithi184.stdout:6/494: rmdir d0/d5/d22/d34 39 2023-12-16T03:15:56.712 INFO:tasks.workunit.client.1.smithi184.stdout:6/495: readlink d0/d5/d12/d1b/d33/l7f 0 2023-12-16T03:15:56.712 INFO:tasks.workunit.client.1.smithi184.stdout:6/496: readlink d0/d5/d22/l4f 0 2023-12-16T03:15:56.713 INFO:tasks.workunit.client.0.smithi064.stdout:2/180: dread d1/f8 [0,4194304] 0 2023-12-16T03:15:56.714 INFO:tasks.workunit.client.1.smithi184.stdout:2/300: unlink d3/d29/d4d/f51 0 2023-12-16T03:15:56.715 INFO:tasks.workunit.client.1.smithi184.stdout:7/391: sync 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:0/566: dwrite dc/d10/d1c/f21 [0,4194304] 0 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:0/567: truncate dc/d22/d1d/d2c/fb9 201647 0 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:1/469: sync 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:4/392: sync 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:8/511: sync 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:8/512: read - d2/d4/d10/d11/f6f zero size 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:8/513: truncate d2/d12/d21/d2d/fa2 454864 0 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:8/514: truncate d2/d4/f76 67614 0 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:8/515: truncate d2/d12/d21/d30/f42 1020722 0 2023-12-16T03:15:56.716 INFO:tasks.workunit.client.1.smithi184.stdout:8/516: write d2/d4/d10/d75/fa5 [213063,23901] 0 2023-12-16T03:15:56.717 INFO:tasks.workunit.client.1.smithi184.stdout:5/347: unlink d1/d3/d9/l47 0 2023-12-16T03:15:56.718 INFO:tasks.workunit.client.1.smithi184.stdout:6/497: mkdir d0/d5/d22/d25/d3f/d6f/d9e 0 2023-12-16T03:15:56.718 INFO:tasks.workunit.client.1.smithi184.stdout:9/654: mkdir d0/d30/ddf 0 2023-12-16T03:15:56.718 INFO:tasks.workunit.client.1.smithi184.stdout:9/655: fsync d0/d13/f69 0 2023-12-16T03:15:56.718 INFO:tasks.workunit.client.1.smithi184.stdout:9/656: write d0/f68 [1099023,72611] 0 2023-12-16T03:15:56.722 INFO:tasks.workunit.client.0.smithi064.stdout:0/124: dread d2/d8/f1c [0,4194304] 0 2023-12-16T03:15:56.722 INFO:tasks.workunit.client.0.smithi064.stdout:5/199: write d0/f5 [1402124,103555] 0 2023-12-16T03:15:56.723 INFO:tasks.workunit.client.1.smithi184.stdout:2/301: creat d3/d29/d2f/d31/f67 x:0 0 0 2023-12-16T03:15:56.723 INFO:tasks.workunit.client.1.smithi184.stdout:2/302: fdatasync d3/d9/d19/f4f 0 2023-12-16T03:15:56.723 INFO:tasks.workunit.client.1.smithi184.stdout:6/498: read d0/d5/d22/d25/f2b [825500,89379] 0 2023-12-16T03:15:56.724 INFO:tasks.workunit.client.1.smithi184.stdout:4/393: getdents d1/d29/d34/d5c 0 2023-12-16T03:15:56.725 INFO:tasks.workunit.client.1.smithi184.stdout:7/392: symlink d0/df/d36/d3f/l6c 0 2023-12-16T03:15:56.727 INFO:tasks.workunit.client.1.smithi184.stdout:2/303: read d3/d29/f30 [386221,773] 0 2023-12-16T03:15:56.727 INFO:tasks.workunit.client.1.smithi184.stdout:2/304: fdatasync d3/d13/d28/f3e 0 2023-12-16T03:15:56.728 INFO:tasks.workunit.client.1.smithi184.stdout:2/305: chown d3/d9/d19/f43 152 1 2023-12-16T03:15:56.728 INFO:tasks.workunit.client.1.smithi184.stdout:2/306: write d3/f48 [720997,116117] 0 2023-12-16T03:15:56.728 INFO:tasks.workunit.client.1.smithi184.stdout:0/568: creat dc/d22/d1d/d43/fc4 x:0 0 0 2023-12-16T03:15:56.728 INFO:tasks.workunit.client.1.smithi184.stdout:1/470: write d3/d28/d3c/f33 [5456892,88855] 0 2023-12-16T03:15:56.729 INFO:tasks.workunit.client.0.smithi064.stdout:0/125: creat d2/d7/f23 x:0 0 0 2023-12-16T03:15:56.734 INFO:tasks.workunit.client.1.smithi184.stdout:5/348: symlink d1/d2a/d31/d28/d72/l77 0 2023-12-16T03:15:56.734 INFO:tasks.workunit.client.1.smithi184.stdout:6/499: mknod d0/d5/d22/d37/d45/c9f 0 2023-12-16T03:15:56.734 INFO:tasks.workunit.client.1.smithi184.stdout:6/500: truncate d0/d5/d26/f75 289524 0 2023-12-16T03:15:56.734 INFO:tasks.workunit.client.1.smithi184.stdout:9/657: write d0/d13/d20/db0/fa0 [793474,37967] 0 2023-12-16T03:15:56.735 INFO:tasks.workunit.client.1.smithi184.stdout:7/393: creat d0/df/d36/d3f/f6d x:0 0 0 2023-12-16T03:15:56.735 INFO:tasks.workunit.client.1.smithi184.stdout:7/394: readlink d0/l43 0 2023-12-16T03:15:56.738 INFO:tasks.workunit.client.1.smithi184.stdout:5/349: dread d1/d3/d9/f39 [0,4194304] 0 2023-12-16T03:15:56.738 INFO:tasks.workunit.client.1.smithi184.stdout:5/350: write d1/d3/d9/de/d30/d68/f76 [2012725,109702] 0 2023-12-16T03:15:56.738 INFO:tasks.workunit.client.1.smithi184.stdout:1/471: mknod d3/d34/d39/c9c 0 2023-12-16T03:15:56.738 INFO:tasks.workunit.client.1.smithi184.stdout:8/517: mkdir d2/d4/da6 0 2023-12-16T03:15:56.738 INFO:tasks.workunit.client.1.smithi184.stdout:3/500: dwrite d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f64 [0,4194304] 0 2023-12-16T03:15:56.738 INFO:tasks.workunit.client.1.smithi184.stdout:3/501: fdatasync d12/d18/d1f/d23/d2a/d36/f5b 0 2023-12-16T03:15:56.740 INFO:tasks.workunit.client.1.smithi184.stdout:7/395: creat d0/d6b/d69/f6e x:0 0 0 2023-12-16T03:15:56.744 INFO:tasks.workunit.client.1.smithi184.stdout:4/394: dread d1/f28 [0,4194304] 0 2023-12-16T03:15:56.744 INFO:tasks.workunit.client.1.smithi184.stdout:9/658: dread d0/d3a/d47/fa9 [0,4194304] 0 2023-12-16T03:15:56.744 INFO:tasks.workunit.client.1.smithi184.stdout:8/518: creat d2/d6a/da4/fa7 x:0 0 0 2023-12-16T03:15:56.744 INFO:tasks.workunit.client.1.smithi184.stdout:1/472: symlink d3/d28/d3c/d24/l9d 0 2023-12-16T03:15:56.744 INFO:tasks.workunit.client.1.smithi184.stdout:1/473: fdatasync d3/d28/d3c/f25 0 2023-12-16T03:15:56.745 INFO:tasks.workunit.client.1.smithi184.stdout:1/474: fsync d3/d28/d3c/d41/d63/f9a 0 2023-12-16T03:15:56.745 INFO:tasks.workunit.client.0.smithi064.stdout:5/200: dread d0/d19/f27 [0,4194304] 0 2023-12-16T03:15:56.746 INFO:tasks.workunit.client.1.smithi184.stdout:3/502: mkdir d12/d18/da1/dbd 0 2023-12-16T03:15:56.746 INFO:tasks.workunit.client.1.smithi184.stdout:2/307: dread d3/f4 [0,4194304] 0 2023-12-16T03:15:56.746 INFO:tasks.workunit.client.1.smithi184.stdout:4/395: rmdir d1/d11/d1b 39 2023-12-16T03:15:56.746 INFO:tasks.workunit.client.1.smithi184.stdout:8/519: read d2/d12/d21/d30/f61 [1293149,39529] 0 2023-12-16T03:15:56.747 INFO:tasks.workunit.client.0.smithi064.stdout:4/200: dwrite d0/d14/f26 [0,4194304] 0 2023-12-16T03:15:56.751 INFO:tasks.workunit.client.1.smithi184.stdout:2/308: creat d3/d29/d61/f68 x:0 0 0 2023-12-16T03:15:56.751 INFO:tasks.workunit.client.1.smithi184.stdout:6/501: dread d0/d5/d12/f1c [0,4194304] 0 2023-12-16T03:15:56.751 INFO:tasks.workunit.client.1.smithi184.stdout:6/502: readlink d0/d5/d22/d37/d45/l74 0 2023-12-16T03:15:56.751 INFO:tasks.workunit.client.1.smithi184.stdout:1/475: creat d3/d28/d3c/d41/f9e x:0 0 0 2023-12-16T03:15:56.752 INFO:tasks.workunit.client.1.smithi184.stdout:4/396: symlink d1/d11/d5a/d63/d72/l80 0 2023-12-16T03:15:56.752 INFO:tasks.workunit.client.1.smithi184.stdout:4/397: chown d1/d11/d1b/d1e/c5f 3727072 1 2023-12-16T03:15:56.753 INFO:tasks.workunit.client.1.smithi184.stdout:8/520: link d2/d12/d21/d30/l92 d2/d12/d21/d2d/la8 0 2023-12-16T03:15:56.754 INFO:tasks.workunit.client.0.smithi064.stdout:4/201: truncate d0/f5 3503318 0 2023-12-16T03:15:56.754 INFO:tasks.workunit.client.0.smithi064.stdout:4/202: truncate d0/d1e/f37 452293 0 2023-12-16T03:15:56.754 INFO:tasks.workunit.client.1.smithi184.stdout:3/503: dread d12/d37/f98 [0,4194304] 0 2023-12-16T03:15:56.755 INFO:tasks.workunit.client.0.smithi064.stdout:1/177: dwrite d3/dd/d11/f1f [0,4194304] 0 2023-12-16T03:15:56.756 INFO:tasks.workunit.client.1.smithi184.stdout:2/309: creat d3/d13/d28/f69 x:0 0 0 2023-12-16T03:15:56.757 INFO:tasks.workunit.client.0.smithi064.stdout:3/249: dwrite db/d12/d1a/f28 [0,4194304] 0 2023-12-16T03:15:56.757 INFO:tasks.workunit.client.0.smithi064.stdout:3/250: truncate db/d12/f46 453471 0 2023-12-16T03:15:56.757 INFO:tasks.workunit.client.1.smithi184.stdout:6/503: creat d0/d5/d12/fa0 x:0 0 0 2023-12-16T03:15:56.759 INFO:tasks.workunit.client.1.smithi184.stdout:4/398: link d1/f54 d1/d29/d34/d5c/d76/d33/f81 0 2023-12-16T03:15:56.759 INFO:tasks.workunit.client.1.smithi184.stdout:8/521: symlink d2/d4/d10/d11/la9 0 2023-12-16T03:15:56.761 INFO:tasks.workunit.client.1.smithi184.stdout:3/504: rename f2 to d12/d18/d7a/fbe 0 2023-12-16T03:15:56.763 INFO:tasks.workunit.client.1.smithi184.stdout:2/310: unlink d3/d13/l23 0 2023-12-16T03:15:56.766 INFO:tasks.workunit.client.1.smithi184.stdout:6/504: mknod d0/d5/d12/d1b/d33/d3d/d96/ca1 0 2023-12-16T03:15:56.766 INFO:tasks.workunit.client.1.smithi184.stdout:4/399: mknod d1/d12/d13/d40/d43/c82 0 2023-12-16T03:15:56.767 INFO:tasks.workunit.client.1.smithi184.stdout:3/505: link d12/d18/d1f/d23/d2a/d42/d52/d76/d80/c40 d12/d18/d1f/d23/d2a/d42/d52/d76/cbf 0 2023-12-16T03:15:56.767 INFO:tasks.workunit.client.0.smithi064.stdout:3/251: creat db/d12/d1a/d2c/d34/f5a x:0 0 0 2023-12-16T03:15:56.768 INFO:tasks.workunit.client.1.smithi184.stdout:4/400: dread d1/d29/d34/d5c/d76/d33/f81 [0,4194304] 0 2023-12-16T03:15:56.769 INFO:tasks.workunit.client.1.smithi184.stdout:6/505: mkdir d0/d5/d12/d1b/d33/d3d/da2 0 2023-12-16T03:15:56.771 INFO:tasks.workunit.client.0.smithi064.stdout:2/181: dwrite d1/f7 [0,4194304] 0 2023-12-16T03:15:56.771 INFO:tasks.workunit.client.1.smithi184.stdout:3/506: symlink d12/d18/d1f/d23/d2a/d42/d52/d76/da5/lc0 0 2023-12-16T03:15:56.771 INFO:tasks.workunit.client.1.smithi184.stdout:3/507: write d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f50 [935725,86383] 0 2023-12-16T03:15:56.771 INFO:tasks.workunit.client.1.smithi184.stdout:3/508: chown d12/d18/d84 1744 1 2023-12-16T03:15:56.771 INFO:tasks.workunit.client.0.smithi064.stdout:3/252: truncate db/d12/d1a/f38 4998457 0 2023-12-16T03:15:56.771 INFO:tasks.workunit.client.1.smithi184.stdout:4/401: dread d1/d29/d34/d5c/d76/f70 [0,4194304] 0 2023-12-16T03:15:56.772 INFO:tasks.workunit.client.0.smithi064.stdout:3/253: truncate f6 2762108 0 2023-12-16T03:15:56.773 INFO:tasks.workunit.client.1.smithi184.stdout:6/506: mknod d0/d5/d12/d1b/d33/d3d/d96/ca3 0 2023-12-16T03:15:56.773 INFO:tasks.workunit.client.1.smithi184.stdout:3/509: truncate d12/d1e/f20 6540526 0 2023-12-16T03:15:56.773 INFO:tasks.workunit.client.1.smithi184.stdout:3/510: chown d12/d18/d68/f9e 559 1 2023-12-16T03:15:56.775 INFO:tasks.workunit.client.0.smithi064.stdout:2/182: write d1/f7 [3015707,73797] 0 2023-12-16T03:15:56.775 INFO:tasks.workunit.client.0.smithi064.stdout:3/254: link db/d12/d1a/f26 db/d12/d1a/d2c/f5b 0 2023-12-16T03:15:56.776 INFO:tasks.workunit.client.1.smithi184.stdout:6/507: link d0/d5/d12/d1b/d33/l63 d0/d5/d22/d37/d4d/la4 0 2023-12-16T03:15:56.777 INFO:tasks.workunit.client.1.smithi184.stdout:3/511: mknod d12/d18/d1f/d23/d2a/d42/d52/d7f/cc1 0 2023-12-16T03:15:56.779 INFO:tasks.workunit.client.0.smithi064.stdout:0/126: dwrite d2/d8/f1b [0,4194304] 0 2023-12-16T03:15:56.780 INFO:tasks.workunit.client.1.smithi184.stdout:6/508: rename d0/d5/d22/d37/d45/l74 to d0/d36/la5 0 2023-12-16T03:15:56.782 INFO:tasks.workunit.client.0.smithi064.stdout:3/255: dread - db/d12/d1a/d31/f4b zero size 2023-12-16T03:15:56.782 INFO:tasks.workunit.client.0.smithi064.stdout:2/183: write d1/f6 [3884043,47637] 0 2023-12-16T03:15:56.782 INFO:tasks.workunit.client.0.smithi064.stdout:2/184: write d1/d15/f1a [317104,48691] 0 2023-12-16T03:15:56.787 INFO:tasks.workunit.client.1.smithi184.stdout:5/351: dwrite d1/d2a/f13 [0,4194304] 0 2023-12-16T03:15:56.788 INFO:tasks.workunit.client.0.smithi064.stdout:6/145: dwrite d3/d9/f20 [4194304,4194304] 0 2023-12-16T03:15:56.788 INFO:tasks.workunit.client.1.smithi184.stdout:3/512: mkdir d12/d1e/d89/dc2 0 2023-12-16T03:15:56.788 INFO:tasks.workunit.client.0.smithi064.stdout:5/201: dread d0/d14/d20/f2f [0,4194304] 0 2023-12-16T03:15:56.789 INFO:tasks.workunit.client.0.smithi064.stdout:5/202: fsync d0/d14/d20/d29/d39/f3a 0 2023-12-16T03:15:56.789 INFO:tasks.workunit.client.1.smithi184.stdout:7/396: dwrite d0/f50 [4194304,4194304] 0 2023-12-16T03:15:56.791 INFO:tasks.workunit.client.1.smithi184.stdout:4/402: read d1/d12/f3e [1801987,80382] 0 2023-12-16T03:15:56.791 INFO:tasks.workunit.client.1.smithi184.stdout:4/403: fdatasync d1/d29/d34/d5c/d76/d33/f65 0 2023-12-16T03:15:56.791 INFO:tasks.workunit.client.1.smithi184.stdout:4/404: getdents d1/d29/d37 0 2023-12-16T03:15:56.796 INFO:tasks.workunit.client.1.smithi184.stdout:4/405: dread d1/f54 [0,4194304] 0 2023-12-16T03:15:56.796 INFO:tasks.workunit.client.0.smithi064.stdout:5/203: creat d0/d19/f4a x:0 0 0 2023-12-16T03:15:56.797 INFO:tasks.workunit.client.0.smithi064.stdout:0/127: dread d2/d8/f1b [0,4194304] 0 2023-12-16T03:15:56.797 INFO:tasks.workunit.client.0.smithi064.stdout:0/128: write d2/d7/d10/f1a [342437,35778] 0 2023-12-16T03:15:56.802 INFO:tasks.workunit.client.0.smithi064.stdout:0/129: dread d2/d8/f1c [0,4194304] 0 2023-12-16T03:15:56.803 INFO:tasks.workunit.client.0.smithi064.stdout:5/204: symlink d0/de/d23/l4b 0 2023-12-16T03:15:56.803 INFO:tasks.workunit.client.0.smithi064.stdout:0/130: creat d2/d7/d10/d21/f24 x:0 0 0 2023-12-16T03:15:56.809 INFO:tasks.workunit.client.1.smithi184.stdout:9/659: getdents d0/d30 0 2023-12-16T03:15:56.809 INFO:tasks.workunit.client.1.smithi184.stdout:9/660: readlink d0/l8a 0 2023-12-16T03:15:56.810 INFO:tasks.workunit.client.0.smithi064.stdout:4/203: dread d0/d12/d17/f1d [0,4194304] 0 2023-12-16T03:15:56.812 INFO:tasks.workunit.client.1.smithi184.stdout:2/311: dwrite d3/d9/d19/f26 [0,4194304] 0 2023-12-16T03:15:56.815 INFO:tasks.workunit.client.1.smithi184.stdout:1/476: dwrite d3/d28/d3c/d41/f4d [4194304,4194304] 0 2023-12-16T03:15:56.815 INFO:tasks.workunit.client.1.smithi184.stdout:1/477: fsync d3/d28/d3c/f7c 0 2023-12-16T03:15:56.819 INFO:tasks.workunit.client.1.smithi184.stdout:0/569: truncate dc/d22/d45/d66/d80/da3/f91 1214631 0 2023-12-16T03:15:56.820 INFO:tasks.workunit.client.1.smithi184.stdout:0/570: dread - dc/d22/d1a/fb3 zero size 2023-12-16T03:15:56.820 INFO:tasks.workunit.client.1.smithi184.stdout:0/571: chown dc/d10/d2d/c31 249696 1 2023-12-16T03:15:56.821 INFO:tasks.workunit.client.0.smithi064.stdout:1/178: write d3/f26 [1569129,51523] 0 2023-12-16T03:15:56.826 INFO:tasks.workunit.client.1.smithi184.stdout:5/352: dread d1/d3/d9/de/d15/d19/f2c [0,4194304] 0 2023-12-16T03:15:56.828 INFO:tasks.workunit.client.1.smithi184.stdout:0/572: read dc/d22/d1d/d2c/d75/fbf [112526,81954] 0 2023-12-16T03:15:56.828 INFO:tasks.workunit.client.1.smithi184.stdout:0/573: symlink dc/d10/d2d/d5f/d7a/lc5 0 2023-12-16T03:15:56.828 INFO:tasks.workunit.client.1.smithi184.stdout:0/574: chown dc/d10/f11 27581 1 2023-12-16T03:15:56.831 INFO:tasks.workunit.client.1.smithi184.stdout:0/575: creat dc/d22/d48/fc6 x:0 0 0 2023-12-16T03:15:56.834 INFO:tasks.workunit.client.1.smithi184.stdout:0/576: creat dc/d22/d1d/d43/fc7 x:0 0 0 2023-12-16T03:15:56.841 INFO:tasks.workunit.client.1.smithi184.stdout:2/312: dread d3/f56 [0,4194304] 0 2023-12-16T03:15:56.844 INFO:tasks.workunit.client.1.smithi184.stdout:2/313: unlink d3/f56 0 2023-12-16T03:15:56.845 INFO:tasks.workunit.client.1.smithi184.stdout:6/509: dwrite d0/d5/d22/d34/d53/f5a [0,4194304] 0 2023-12-16T03:15:56.845 INFO:tasks.workunit.client.1.smithi184.stdout:2/314: getdents d3/d29/d2f/d46 0 2023-12-16T03:15:56.849 INFO:tasks.workunit.client.1.smithi184.stdout:2/315: unlink d3/d13/l2a 0 2023-12-16T03:15:56.850 INFO:tasks.workunit.client.1.smithi184.stdout:6/510: write d0/d5/d12/d1b/d33/f58 [2134235,122740] 0 2023-12-16T03:15:56.850 INFO:tasks.workunit.client.1.smithi184.stdout:2/316: getdents d3/d29/d2f 0 2023-12-16T03:15:56.852 INFO:tasks.workunit.client.0.smithi064.stdout:1/179: dread d3/f25 [0,4194304] 0 2023-12-16T03:15:56.852 INFO:tasks.workunit.client.1.smithi184.stdout:6/511: read d0/d5/f4a [442581,33657] 0 2023-12-16T03:15:56.854 INFO:tasks.workunit.client.0.smithi064.stdout:1/180: truncate f2 1683527 0 2023-12-16T03:15:56.855 INFO:tasks.workunit.client.0.smithi064.stdout:6/146: dwrite d3/d8/d1f/f22 [0,4194304] 0 2023-12-16T03:15:56.855 INFO:tasks.workunit.client.0.smithi064.stdout:6/147: stat d3/d8 0 2023-12-16T03:15:56.855 INFO:tasks.workunit.client.1.smithi184.stdout:2/317: mkdir d3/d29/d6a 0 2023-12-16T03:15:56.856 INFO:tasks.workunit.client.1.smithi184.stdout:5/353: dread d1/d3/d9/de/d15/d19/d3a/f4b [0,4194304] 0 2023-12-16T03:15:56.856 INFO:tasks.workunit.client.1.smithi184.stdout:7/397: dwrite d0/d3/f5 [4194304,4194304] 0 2023-12-16T03:15:56.856 INFO:tasks.workunit.client.1.smithi184.stdout:5/354: fdatasync d1/d3/d9/de/d15/d19/d3a/f4b 0 2023-12-16T03:15:56.856 INFO:tasks.workunit.client.1.smithi184.stdout:7/398: fsync d0/d3/d2e/f5f 0 2023-12-16T03:15:56.856 INFO:tasks.workunit.client.1.smithi184.stdout:7/399: readlink d0/d3/d2e/l59 0 2023-12-16T03:15:56.856 INFO:tasks.workunit.client.1.smithi184.stdout:7/400: fdatasync d0/d3/f64 0 2023-12-16T03:15:56.856 INFO:tasks.workunit.client.1.smithi184.stdout:6/512: mkdir d0/d5/d42/da6 0 2023-12-16T03:15:56.857 INFO:tasks.workunit.client.1.smithi184.stdout:2/318: rmdir d3/d29/d6a 0 2023-12-16T03:15:56.857 INFO:tasks.workunit.client.0.smithi064.stdout:1/181: creat d3/dd/f3c x:0 0 0 2023-12-16T03:15:56.857 INFO:tasks.workunit.client.0.smithi064.stdout:1/182: dread - d3/dd/f3c zero size 2023-12-16T03:15:56.858 INFO:tasks.workunit.client.0.smithi064.stdout:6/148: mkdir d3/d8/d1f/d26 0 2023-12-16T03:15:56.858 INFO:tasks.workunit.client.0.smithi064.stdout:6/149: chown d3/d8/d13/f1b 495678787 1 2023-12-16T03:15:56.860 INFO:tasks.workunit.client.0.smithi064.stdout:1/183: rename d3/f1b to d3/dd/d2a/f3d 0 2023-12-16T03:15:56.860 INFO:tasks.workunit.client.0.smithi064.stdout:1/184: readlink d3/l30 0 2023-12-16T03:15:56.861 INFO:tasks.workunit.client.0.smithi064.stdout:6/150: getdents d3/d9 0 2023-12-16T03:15:56.862 INFO:tasks.workunit.client.1.smithi184.stdout:6/513: getdents d0/d5 0 2023-12-16T03:15:56.862 INFO:tasks.workunit.client.1.smithi184.stdout:6/514: chown d0/d5/d22/l19 679427090 1 2023-12-16T03:15:56.863 INFO:tasks.workunit.client.0.smithi064.stdout:1/185: rename d3/f25 to d3/dd/d11/d3b/f3e 0 2023-12-16T03:15:56.864 INFO:tasks.workunit.client.1.smithi184.stdout:7/401: rmdir d0/d3/d68 39 2023-12-16T03:15:56.864 INFO:tasks.workunit.client.1.smithi184.stdout:7/402: fdatasync d0/d3/f1a 0 2023-12-16T03:15:56.864 INFO:tasks.workunit.client.1.smithi184.stdout:7/403: truncate d0/d3/f64 468376 0 2023-12-16T03:15:56.866 INFO:tasks.workunit.client.1.smithi184.stdout:7/404: link d0/d3/d2e/l61 d0/df/d32/l6f 0 2023-12-16T03:15:56.868 INFO:tasks.workunit.client.1.smithi184.stdout:4/406: dwrite d1/d11/d1b/d1e/f57 [0,4194304] 0 2023-12-16T03:15:56.869 INFO:tasks.workunit.client.0.smithi064.stdout:6/151: rename d3/d8/da/c10 to d3/c27 0 2023-12-16T03:15:56.869 INFO:tasks.workunit.client.0.smithi064.stdout:6/152: read - d3/f25 zero size 2023-12-16T03:15:56.871 INFO:tasks.workunit.client.0.smithi064.stdout:4/204: dwrite d0/d1e/f29 [4194304,4194304] 0 2023-12-16T03:15:56.872 INFO:tasks.workunit.client.1.smithi184.stdout:3/513: dwrite d12/d18/d1f/d23/d2a/f53 [0,4194304] 0 2023-12-16T03:15:56.872 INFO:tasks.workunit.client.1.smithi184.stdout:3/514: readlink d12/d1e/d89/lb1 0 2023-12-16T03:15:56.872 INFO:tasks.workunit.client.1.smithi184.stdout:5/355: dread d1/d3/d9/de/d15/f57 [0,4194304] 0 2023-12-16T03:15:56.873 INFO:tasks.workunit.client.1.smithi184.stdout:2/319: write d3/d29/d2f/d31/f4e [3085933,55343] 0 2023-12-16T03:15:56.873 INFO:tasks.workunit.client.1.smithi184.stdout:4/407: creat d1/d12/d13/d40/d43/d5e/f83 x:0 0 0 2023-12-16T03:15:56.873 INFO:tasks.workunit.client.1.smithi184.stdout:4/408: dread - d1/d11/d1b/f79 zero size 2023-12-16T03:15:56.873 INFO:tasks.workunit.client.1.smithi184.stdout:2/320: truncate d3/d9/d19/f43 335197 0 2023-12-16T03:15:56.874 INFO:tasks.workunit.client.0.smithi064.stdout:6/153: link d3/c21 d3/d8/d1f/c28 0 2023-12-16T03:15:56.875 INFO:tasks.workunit.client.0.smithi064.stdout:4/205: getdents d0/d12/d17 0 2023-12-16T03:15:56.876 INFO:tasks.workunit.client.0.smithi064.stdout:6/154: unlink d3/d8/cc 0 2023-12-16T03:15:56.876 INFO:tasks.workunit.client.1.smithi184.stdout:3/515: creat d12/d18/d1f/d23/d2a/d42/d52/d76/da5/fc3 x:0 0 0 2023-12-16T03:15:56.876 INFO:tasks.workunit.client.1.smithi184.stdout:3/516: write d12/d37/f6a [781512,68882] 0 2023-12-16T03:15:56.877 INFO:tasks.workunit.client.0.smithi064.stdout:4/206: rename d0/da/l18 to d0/d14/d33/l3c 0 2023-12-16T03:15:56.878 INFO:tasks.workunit.client.1.smithi184.stdout:2/321: dread d3/d29/d2f/f45 [0,4194304] 0 2023-12-16T03:15:56.878 INFO:tasks.workunit.client.1.smithi184.stdout:2/322: write d3/d13/f66 [1557356,104331] 0 2023-12-16T03:15:56.879 INFO:tasks.workunit.client.1.smithi184.stdout:4/409: rename d1/d11/d1b/d1e/c5f to d1/d29/d34/d5c/d76/d42/c84 0 2023-12-16T03:15:56.880 INFO:tasks.workunit.client.1.smithi184.stdout:4/410: truncate d1/d12/d13/d40/d43/d5e/f83 1046008 0 2023-12-16T03:15:56.880 INFO:tasks.workunit.client.0.smithi064.stdout:4/207: symlink d0/da/l3d 0 2023-12-16T03:15:56.881 INFO:tasks.workunit.client.1.smithi184.stdout:3/517: symlink d12/d1e/d89/dc2/lc4 0 2023-12-16T03:15:56.881 INFO:tasks.workunit.client.1.smithi184.stdout:3/518: write d12/d18/d1f/d23/d2a/d4a/f91 [910867,97458] 0 2023-12-16T03:15:56.881 INFO:tasks.workunit.client.1.smithi184.stdout:3/519: write d12/d18/d1f/d23/d2a/d4a/d61/fac [956882,90727] 0 2023-12-16T03:15:56.884 INFO:tasks.workunit.client.0.smithi064.stdout:4/208: symlink d0/d12/l3e 0 2023-12-16T03:15:56.884 INFO:tasks.workunit.client.0.smithi064.stdout:4/209: stat d0/f8 0 2023-12-16T03:15:56.884 INFO:tasks.workunit.client.0.smithi064.stdout:4/210: chown d0/c34 4 1 2023-12-16T03:15:56.884 INFO:tasks.workunit.client.1.smithi184.stdout:2/323: creat d3/d29/d2f/d46/f6b x:0 0 0 2023-12-16T03:15:56.885 INFO:tasks.workunit.client.1.smithi184.stdout:0/577: dwrite dc/d22/d1d/d43/d5a/f89 [0,4194304] 0 2023-12-16T03:15:56.885 INFO:tasks.workunit.client.1.smithi184.stdout:0/578: chown dc/d22/d1d/da5 1192283 1 2023-12-16T03:15:56.887 INFO:tasks.workunit.client.1.smithi184.stdout:9/661: dwrite d0/d3a/d47/fd7 [0,4194304] 0 2023-12-16T03:15:56.887 INFO:tasks.workunit.client.1.smithi184.stdout:9/662: read - d0/d13/d20/d5b/d43/dab/fd3 zero size 2023-12-16T03:15:56.891 INFO:tasks.workunit.client.1.smithi184.stdout:2/324: write d3/d9/d19/f1c [5239239,82977] 0 2023-12-16T03:15:56.894 INFO:tasks.workunit.client.1.smithi184.stdout:4/411: symlink d1/d12/d13/d40/d43/d5e/l85 0 2023-12-16T03:15:56.894 INFO:tasks.workunit.client.1.smithi184.stdout:4/412: chown d1/d11/d1b/f79 71 1 2023-12-16T03:15:56.895 INFO:tasks.workunit.client.1.smithi184.stdout:1/478: dwrite d3/d13/d2c/f37 [0,4194304] 0 2023-12-16T03:15:56.902 INFO:tasks.workunit.client.1.smithi184.stdout:1/479: mkdir d3/d28/d36/d9f 0 2023-12-16T03:15:56.904 INFO:tasks.workunit.client.0.smithi064.stdout:1/186: rmdir d3/dd/d11 39 2023-12-16T03:15:56.904 INFO:tasks.workunit.client.1.smithi184.stdout:1/480: write d3/d28/d3c/d41/f8a [1296338,43224] 0 2023-12-16T03:15:56.904 INFO:tasks.workunit.client.1.smithi184.stdout:1/481: chown d3/d28/d3c/d41/d77/c8d 12 1 2023-12-16T03:15:56.904 INFO:tasks.workunit.client.1.smithi184.stdout:1/482: chown d3/d28/d3c/d41/f9e 196585 1 2023-12-16T03:15:56.905 INFO:tasks.workunit.client.0.smithi064.stdout:4/211: dread d0/d12/d17/f1d [0,4194304] 0 2023-12-16T03:15:56.905 INFO:tasks.workunit.client.0.smithi064.stdout:1/187: creat d3/d37/f3f x:0 0 0 2023-12-16T03:15:56.906 INFO:tasks.workunit.client.1.smithi184.stdout:1/483: unlink d3/f20 0 2023-12-16T03:15:56.906 INFO:tasks.workunit.client.1.smithi184.stdout:1/484: truncate d3/d28/d36/f48 1593242 0 2023-12-16T03:15:56.908 INFO:tasks.workunit.client.0.smithi064.stdout:1/188: stat d3/lc 0 2023-12-16T03:15:56.908 INFO:tasks.workunit.client.0.smithi064.stdout:1/189: fdatasync d3/f13 0 2023-12-16T03:15:56.910 INFO:tasks.workunit.client.1.smithi184.stdout:1/485: write d3/d28/d3c/d24/f43 [1427034,104077] 0 2023-12-16T03:15:56.911 INFO:tasks.workunit.client.0.smithi064.stdout:1/190: rename d3/lc to d3/dd/d23/l40 0 2023-12-16T03:15:56.930 INFO:tasks.workunit.client.1.smithi184.stdout:9/663: read d0/d13/f21 [2230735,30626] 0 2023-12-16T03:15:56.931 INFO:tasks.workunit.client.1.smithi184.stdout:3/520: dread d12/f16 [0,4194304] 0 2023-12-16T03:15:56.931 INFO:tasks.workunit.client.1.smithi184.stdout:6/515: dwrite d0/d5/d26/f82 [0,4194304] 0 2023-12-16T03:15:56.931 INFO:tasks.workunit.client.0.smithi064.stdout:4/212: dread d0/d12/d17/f1d [0,4194304] 0 2023-12-16T03:15:56.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/521: dread d12/d18/d1f/f3d [0,4194304] 0 2023-12-16T03:15:56.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/522: chown d12/d37 12112 1 2023-12-16T03:15:56.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/523: write d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f50 [1280236,29524] 0 2023-12-16T03:15:56.932 INFO:tasks.workunit.client.1.smithi184.stdout:4/413: write d1/d12/f17 [1856104,81211] 0 2023-12-16T03:15:56.932 INFO:tasks.workunit.client.1.smithi184.stdout:2/325: dwrite d3/d29/f30 [0,4194304] 0 2023-12-16T03:15:56.932 INFO:tasks.workunit.client.1.smithi184.stdout:5/356: dwrite d1/d3/d2f/f3d [0,4194304] 0 2023-12-16T03:15:56.932 INFO:tasks.workunit.client.1.smithi184.stdout:5/357: readlink d1/d3/d9/de/d30/l46 0 2023-12-16T03:15:56.933 INFO:tasks.workunit.client.0.smithi064.stdout:2/185: dwrite d1/f6 [0,4194304] 0 2023-12-16T03:15:56.933 INFO:tasks.workunit.client.0.smithi064.stdout:1/191: dread d3/dd/f1a [0,4194304] 0 2023-12-16T03:15:56.933 INFO:tasks.workunit.client.0.smithi064.stdout:1/192: truncate d3/dd/f1a 4866298 0 2023-12-16T03:15:56.933 INFO:tasks.workunit.client.0.smithi064.stdout:4/213: stat d0/da/l3a 0 2023-12-16T03:15:56.935 INFO:tasks.workunit.client.0.smithi064.stdout:6/155: dwrite d3/d8/d13/f24 [0,4194304] 0 2023-12-16T03:15:56.935 INFO:tasks.workunit.client.1.smithi184.stdout:0/579: dwrite dc/d22/d1d/d43/f55 [0,4194304] 0 2023-12-16T03:15:56.936 INFO:tasks.workunit.client.1.smithi184.stdout:9/664: mkdir d0/d13/d20/d5b/d43/dc7/ddc/dd8/de0 0 2023-12-16T03:15:56.936 INFO:tasks.workunit.client.1.smithi184.stdout:9/665: readlink d0/l19 0 2023-12-16T03:15:56.937 INFO:tasks.workunit.client.0.smithi064.stdout:6/156: symlink d3/d8/d1f/d26/l29 0 2023-12-16T03:15:56.939 INFO:tasks.workunit.client.1.smithi184.stdout:3/524: link d12/d18/f7c d12/d86/fc5 0 2023-12-16T03:15:56.939 INFO:tasks.workunit.client.1.smithi184.stdout:3/525: readlink d12/d18/d1f/d23/d2a/d42/d52/lb0 0 2023-12-16T03:15:56.939 INFO:tasks.workunit.client.1.smithi184.stdout:3/526: readlink d12/d18/d1f/d23/l27 0 2023-12-16T03:15:56.942 INFO:tasks.workunit.client.0.smithi064.stdout:6/157: dread d3/d8/da/f23 [0,4194304] 0 2023-12-16T03:15:56.943 INFO:tasks.workunit.client.0.smithi064.stdout:6/158: mknod d3/d8/c2a 0 2023-12-16T03:15:56.956 INFO:tasks.workunit.client.0.smithi064.stdout:1/193: dread d3/dd/f1a [0,4194304] 0 2023-12-16T03:15:56.958 INFO:tasks.workunit.client.0.smithi064.stdout:1/194: mkdir d3/dd/d23/d41 0 2023-12-16T03:15:56.959 INFO:tasks.workunit.client.0.smithi064.stdout:8/265: sync 2023-12-16T03:15:56.959 INFO:tasks.workunit.client.0.smithi064.stdout:1/195: write d3/dd/d11/f17 [2387762,11504] 0 2023-12-16T03:15:56.961 INFO:tasks.workunit.client.0.smithi064.stdout:6/159: getdents d3/d8 0 2023-12-16T03:15:56.962 INFO:tasks.workunit.client.0.smithi064.stdout:1/196: creat d3/dd/f42 x:0 0 0 2023-12-16T03:15:56.967 INFO:tasks.workunit.client.0.smithi064.stdout:4/214: dread d0/d14/f26 [0,4194304] 0 2023-12-16T03:15:56.967 INFO:tasks.workunit.client.0.smithi064.stdout:2/186: dwrite d1/d27/f29 [0,4194304] 0 2023-12-16T03:15:56.972 INFO:tasks.workunit.client.0.smithi064.stdout:6/160: write d3/f5 [2920405,90672] 0 2023-12-16T03:15:56.974 INFO:tasks.workunit.client.1.smithi184.stdout:0/580: link dc/d22/d1d/d2c/l64 dc/d22/d1d/d43/d5a/d60/lc8 0 2023-12-16T03:15:56.974 INFO:tasks.workunit.client.1.smithi184.stdout:2/326: symlink d3/d13/d28/l6c 0 2023-12-16T03:15:56.974 INFO:tasks.workunit.client.1.smithi184.stdout:4/414: symlink d1/d11/d5a/d63/l86 0 2023-12-16T03:15:56.974 INFO:tasks.workunit.client.1.smithi184.stdout:4/415: chown d1/d12/d13/d40/l59 11 1 2023-12-16T03:15:56.974 INFO:tasks.workunit.client.1.smithi184.stdout:5/358: rmdir d1/d3/d9/d49/d74 39 2023-12-16T03:15:56.975 INFO:tasks.workunit.client.1.smithi184.stdout:5/359: stat d1/d3/d9/de/d15 0 2023-12-16T03:15:56.975 INFO:tasks.workunit.client.1.smithi184.stdout:5/360: write d1/d3/d9/de/d30/f4e [537117,15004] 0 2023-12-16T03:15:56.975 INFO:tasks.workunit.client.1.smithi184.stdout:5/361: truncate d1/d3/d9/d2e/f67 439004 0 2023-12-16T03:15:56.975 INFO:tasks.workunit.client.0.smithi064.stdout:1/197: dread d3/dd/d11/f17 [0,4194304] 0 2023-12-16T03:15:56.975 INFO:tasks.workunit.client.0.smithi064.stdout:4/215: symlink d0/d14/d33/l3f 0 2023-12-16T03:15:56.978 INFO:tasks.workunit.client.0.smithi064.stdout:6/161: creat d3/d8/d13/f2b x:0 0 0 2023-12-16T03:15:56.979 INFO:tasks.workunit.client.0.smithi064.stdout:4/216: symlink d0/da/l40 0 2023-12-16T03:15:56.985 INFO:tasks.workunit.client.1.smithi184.stdout:9/666: rename d0/l19 to d0/d13/d20/d5b/d43/le1 0 2023-12-16T03:15:56.985 INFO:tasks.workunit.client.1.smithi184.stdout:3/527: symlink d12/d1e/da3/lc6 0 2023-12-16T03:15:56.986 INFO:tasks.workunit.client.1.smithi184.stdout:6/516: truncate d0/d5/d26/f82 3064355 0 2023-12-16T03:15:56.986 INFO:tasks.workunit.client.1.smithi184.stdout:1/486: truncate d3/d13/d2c/f37 3735012 0 2023-12-16T03:15:56.987 INFO:tasks.workunit.client.0.smithi064.stdout:1/198: dread d3/dd/d2a/f3d [0,4194304] 0 2023-12-16T03:15:56.987 INFO:tasks.workunit.client.0.smithi064.stdout:1/199: rename d3/dd to d3/dd/d11/d2f/d43 22 2023-12-16T03:15:56.987 INFO:tasks.workunit.client.1.smithi184.stdout:2/327: mkdir d3/d29/d61/d6d 0 2023-12-16T03:15:56.989 INFO:tasks.workunit.client.1.smithi184.stdout:4/416: creat d1/d11/d1b/f87 x:0 0 0 2023-12-16T03:15:56.989 INFO:tasks.workunit.client.0.smithi064.stdout:1/200: mkdir d3/d36/d44 0 2023-12-16T03:15:56.990 INFO:tasks.workunit.client.1.smithi184.stdout:5/362: symlink d1/d3/d2f/l78 0 2023-12-16T03:15:56.990 INFO:tasks.workunit.client.1.smithi184.stdout:5/363: fsync d1/d3/d9/de/d15/d19/d3a/f4b 0 2023-12-16T03:15:56.991 INFO:tasks.workunit.client.1.smithi184.stdout:9/667: mknod d0/d13/d20/d5b/d43/dc7/ddc/ce2 0 2023-12-16T03:15:56.991 INFO:tasks.workunit.client.1.smithi184.stdout:9/668: readlink d0/d13/d6e/d84/l4e 0 2023-12-16T03:15:56.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/528: creat d12/d18/d1f/d23/d2a/d3e/d48/fc7 x:0 0 0 2023-12-16T03:15:56.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/529: write d12/d37/f6a [1632378,55217] 0 2023-12-16T03:15:56.993 INFO:tasks.workunit.client.1.smithi184.stdout:3/530: stat d12/d18/d1f/f3d 0 2023-12-16T03:15:56.994 INFO:tasks.workunit.client.1.smithi184.stdout:6/517: mknod d0/d5/d22/d37/d45/d90/ca7 0 2023-12-16T03:15:56.994 INFO:tasks.workunit.client.1.smithi184.stdout:6/518: chown d0/d5/d12/d1b/d33/d3d 86925460 1 2023-12-16T03:15:56.995 INFO:tasks.workunit.client.0.smithi064.stdout:1/201: creat d3/d36/f45 x:0 0 0 2023-12-16T03:15:56.995 INFO:tasks.workunit.client.0.smithi064.stdout:1/202: write d3/d37/f3a [590630,114999] 0 2023-12-16T03:15:56.995 INFO:tasks.workunit.client.0.smithi064.stdout:1/203: read - d3/dd/f2d zero size 2023-12-16T03:15:56.995 INFO:tasks.workunit.client.0.smithi064.stdout:4/217: dread d0/d12/d17/f21 [0,4194304] 0 2023-12-16T03:15:56.995 INFO:tasks.workunit.client.0.smithi064.stdout:4/218: stat d0/f5 0 2023-12-16T03:15:56.995 INFO:tasks.workunit.client.0.smithi064.stdout:4/219: fdatasync d0/d14/f26 0 2023-12-16T03:15:56.996 INFO:tasks.workunit.client.1.smithi184.stdout:2/328: mkdir d3/d13/d6e 0 2023-12-16T03:15:56.997 INFO:tasks.workunit.client.0.smithi064.stdout:1/204: truncate d3/f5 3901756 0 2023-12-16T03:15:56.998 INFO:tasks.workunit.client.0.smithi064.stdout:4/220: symlink d0/d14/l41 0 2023-12-16T03:15:57.001 INFO:tasks.workunit.client.0.smithi064.stdout:8/266: dwrite d0/db/d12/f15 [0,4194304] 0 2023-12-16T03:15:57.001 INFO:tasks.workunit.client.0.smithi064.stdout:1/205: symlink d3/d22/l46 0 2023-12-16T03:15:57.001 INFO:tasks.workunit.client.0.smithi064.stdout:8/267: fdatasync d0/db/d12/f15 0 2023-12-16T03:15:57.001 INFO:tasks.workunit.client.0.smithi064.stdout:1/206: stat d3/f13 0 2023-12-16T03:15:57.001 INFO:tasks.workunit.client.0.smithi064.stdout:4/221: truncate d0/f8 709741 0 2023-12-16T03:15:57.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/417: rename d1/d12/l19 to d1/d29/d34/d5c/l88 0 2023-12-16T03:15:57.002 INFO:tasks.workunit.client.1.smithi184.stdout:5/364: symlink d1/d3/d9/de/d15/d19/l79 0 2023-12-16T03:15:57.003 INFO:tasks.workunit.client.1.smithi184.stdout:9/669: mknod d0/d13/d20/d5b/d43/dc7/ddc/dd8/ce3 0 2023-12-16T03:15:57.003 INFO:tasks.workunit.client.0.smithi064.stdout:8/268: creat d0/d1d/d3c/d42/f5d x:0 0 0 2023-12-16T03:15:57.005 INFO:tasks.workunit.client.0.smithi064.stdout:4/222: dread d0/f2e [0,4194304] 0 2023-12-16T03:15:57.005 INFO:tasks.workunit.client.0.smithi064.stdout:4/223: fsync d0/d12/f35 0 2023-12-16T03:15:57.005 INFO:tasks.workunit.client.1.smithi184.stdout:6/519: mkdir d0/d5/d22/d25/d3f/d6f/da8 0 2023-12-16T03:15:57.006 INFO:tasks.workunit.client.0.smithi064.stdout:8/269: getdents d0/db/d12/d44 0 2023-12-16T03:15:57.006 INFO:tasks.workunit.client.0.smithi064.stdout:6/162: dwrite d3/d8/d13/f1b [0,4194304] 0 2023-12-16T03:15:57.006 INFO:tasks.workunit.client.0.smithi064.stdout:6/163: getdents d3/d9 0 2023-12-16T03:15:57.011 INFO:tasks.workunit.client.0.smithi064.stdout:4/224: mkdir d0/d42 0 2023-12-16T03:15:57.012 INFO:tasks.workunit.client.1.smithi184.stdout:5/365: dread d1/d3/d9/de/d15/d19/f23 [4194304,4194304] 0 2023-12-16T03:15:57.012 INFO:tasks.workunit.client.1.smithi184.stdout:9/670: mknod d0/d30/ce4 0 2023-12-16T03:15:57.012 INFO:tasks.workunit.client.1.smithi184.stdout:6/520: creat d0/d5/d22/d37/d4d/d9c/fa9 x:0 0 0 2023-12-16T03:15:57.021 INFO:tasks.workunit.client.1.smithi184.stdout:5/366: symlink d1/d2a/l7a 0 2023-12-16T03:15:57.021 INFO:tasks.workunit.client.1.smithi184.stdout:9/671: getdents d0/d76/da2 0 2023-12-16T03:15:57.021 INFO:tasks.workunit.client.1.smithi184.stdout:5/367: fsync d1/d2a/f13 0 2023-12-16T03:15:57.021 INFO:tasks.workunit.client.1.smithi184.stdout:6/521: mkdir d0/d5/d42/da6/daa 0 2023-12-16T03:15:57.026 INFO:tasks.workunit.client.0.smithi064.stdout:8/270: dread d0/db/d37/f43 [0,4194304] 0 2023-12-16T03:15:57.029 INFO:tasks.workunit.client.1.smithi184.stdout:9/672: symlink d0/d13/d20/d5b/d43/dab/le5 0 2023-12-16T03:15:57.030 INFO:tasks.workunit.client.1.smithi184.stdout:6/522: creat d0/d5/d26/fab x:0 0 0 2023-12-16T03:15:57.031 INFO:tasks.workunit.client.1.smithi184.stdout:0/581: dwrite dc/d22/d45/d66/d80/fb6 [0,4194304] 0 2023-12-16T03:15:57.032 INFO:tasks.workunit.client.1.smithi184.stdout:9/673: symlink d0/d13/d20/d5b/d43/dc7/dda/le6 0 2023-12-16T03:15:57.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/674: write d0/d3a/d47/f93 [361360,8308] 0 2023-12-16T03:15:57.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/675: write d0/d13/d20/d5b/d43/dc7/ddc/fba [18313,30547] 0 2023-12-16T03:15:57.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/676: write d0/f68 [1142620,48210] 0 2023-12-16T03:15:57.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/677: chown d0/d13/d20/d5b/faf 51647 1 2023-12-16T03:15:57.034 INFO:tasks.workunit.client.0.smithi064.stdout:8/271: creat d0/da/d3e/d46/f5e x:0 0 0 2023-12-16T03:15:57.034 INFO:tasks.workunit.client.0.smithi064.stdout:8/272: chown d0/db/d12/d1c/d59 2041 1 2023-12-16T03:15:57.034 INFO:tasks.workunit.client.0.smithi064.stdout:8/273: rename d0/d1d/d3c/d42 to d0/d1d/d3c/d42/d5f 22 2023-12-16T03:15:57.035 INFO:tasks.workunit.client.1.smithi184.stdout:9/678: symlink d0/d13/d6e/d84/le7 0 2023-12-16T03:15:57.036 INFO:tasks.workunit.client.1.smithi184.stdout:0/582: dread dc/d22/d1a/f6f [0,4194304] 0 2023-12-16T03:15:57.036 INFO:tasks.workunit.client.1.smithi184.stdout:9/679: truncate d0/d30/f94 1099301 0 2023-12-16T03:15:57.037 INFO:tasks.workunit.client.1.smithi184.stdout:9/680: creat d0/d13/d6e/fe8 x:0 0 0 2023-12-16T03:15:57.038 INFO:tasks.workunit.client.1.smithi184.stdout:0/583: mkdir dc/dc9 0 2023-12-16T03:15:57.039 INFO:tasks.workunit.client.1.smithi184.stdout:0/584: write dc/d22/d45/d66/fae [1519606,37132] 0 2023-12-16T03:15:57.039 INFO:tasks.workunit.client.0.smithi064.stdout:1/207: dread d3/d37/f3a [0,4194304] 0 2023-12-16T03:15:57.041 INFO:tasks.workunit.client.1.smithi184.stdout:9/681: creat d0/d76/dbf/fe9 x:0 0 0 2023-12-16T03:15:57.041 INFO:tasks.workunit.client.1.smithi184.stdout:0/585: symlink dc/d22/d1d/d43/lca 0 2023-12-16T03:15:57.042 INFO:tasks.workunit.client.0.smithi064.stdout:1/208: symlink d3/dd/l47 0 2023-12-16T03:15:57.042 INFO:tasks.workunit.client.0.smithi064.stdout:1/209: fsync d3/dd/f2d 0 2023-12-16T03:15:57.042 INFO:tasks.workunit.client.0.smithi064.stdout:1/210: dread - d3/dd/f3c zero size 2023-12-16T03:15:57.043 INFO:tasks.workunit.client.0.smithi064.stdout:1/211: creat d3/d36/d44/f48 x:0 0 0 2023-12-16T03:15:57.045 INFO:tasks.workunit.client.0.smithi064.stdout:1/212: creat d3/d22/f49 x:0 0 0 2023-12-16T03:15:57.046 INFO:tasks.workunit.client.1.smithi184.stdout:0/586: truncate dc/fe 3535808 0 2023-12-16T03:15:57.047 INFO:tasks.workunit.client.1.smithi184.stdout:6/523: dread d0/d5/f1f [0,4194304] 0 2023-12-16T03:15:57.050 INFO:tasks.workunit.client.1.smithi184.stdout:6/524: rename d0/d5/d12/fa0 to d0/d5/d22/d25/d47/fac 0 2023-12-16T03:15:57.053 INFO:tasks.workunit.client.1.smithi184.stdout:1/487: dwrite d3/d34/f65 [0,4194304] 0 2023-12-16T03:15:57.055 INFO:tasks.workunit.client.1.smithi184.stdout:3/531: dwrite d12/f1b [0,4194304] 0 2023-12-16T03:15:57.060 INFO:tasks.workunit.client.1.smithi184.stdout:3/532: mkdir d12/d18/da1/dbd/dc8 0 2023-12-16T03:15:57.060 INFO:tasks.workunit.client.1.smithi184.stdout:3/533: chown d12/d18/d1f/d23/d2a/d4a/c7e 457 1 2023-12-16T03:15:57.060 INFO:tasks.workunit.client.1.smithi184.stdout:2/329: dwrite d3/d29/d2f/d31/f4e [4194304,4194304] 0 2023-12-16T03:15:57.060 INFO:tasks.workunit.client.1.smithi184.stdout:2/330: fsync d3/d29/d2f/d2e/f7 0 2023-12-16T03:15:57.060 INFO:tasks.workunit.client.1.smithi184.stdout:1/488: symlink d3/d28/la0 0 2023-12-16T03:15:57.061 INFO:tasks.workunit.client.1.smithi184.stdout:6/525: write d0/d5/d22/d34/d53/f5a [1068605,90770] 0 2023-12-16T03:15:57.061 INFO:tasks.workunit.client.1.smithi184.stdout:3/534: creat d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/fc9 x:0 0 0 2023-12-16T03:15:57.061 INFO:tasks.workunit.client.1.smithi184.stdout:1/489: mknod d3/d34/d76/d91/ca1 0 2023-12-16T03:15:57.063 INFO:tasks.workunit.client.1.smithi184.stdout:1/490: creat d3/fa2 x:0 0 0 2023-12-16T03:15:57.063 INFO:tasks.workunit.client.1.smithi184.stdout:5/368: dwrite d1/f1a [0,4194304] 0 2023-12-16T03:15:57.066 INFO:tasks.workunit.client.0.smithi064.stdout:6/164: dwrite d3/d8/d1f/f22 [0,4194304] 0 2023-12-16T03:15:57.068 INFO:tasks.workunit.client.1.smithi184.stdout:1/491: rename d3/d28/d38/f86 to d3/d28/d3c/d41/d77/fa3 0 2023-12-16T03:15:57.070 INFO:tasks.workunit.client.1.smithi184.stdout:5/369: mknod d1/d3/d9/de/d15/d19/c7b 0 2023-12-16T03:15:57.070 INFO:tasks.workunit.client.1.smithi184.stdout:5/370: write d1/f66 [843758,18298] 0 2023-12-16T03:15:57.070 INFO:tasks.workunit.client.1.smithi184.stdout:5/371: chown d1/d3/l5a 29 1 2023-12-16T03:15:57.072 INFO:tasks.workunit.client.1.smithi184.stdout:1/492: rename d3/d34/d39/l7f to d3/d28/d3c/d41/d46/d4a/d6a/d6d/d99/la4 0 2023-12-16T03:15:57.074 INFO:tasks.workunit.client.1.smithi184.stdout:5/372: creat d1/d3/d9/de/d15/d19/d48/f7c x:0 0 0 2023-12-16T03:15:57.074 INFO:tasks.workunit.client.1.smithi184.stdout:5/373: write d1/d2a/d31/f73 [1046603,70022] 0 2023-12-16T03:15:57.075 INFO:tasks.workunit.client.0.smithi064.stdout:1/213: dread d3/dd/d11/f1f [0,4194304] 0 2023-12-16T03:15:57.075 INFO:tasks.workunit.client.0.smithi064.stdout:2/187: dwrite d1/d15/f1f [0,4194304] 0 2023-12-16T03:15:57.075 INFO:tasks.workunit.client.0.smithi064.stdout:8/274: dwrite d0/d1d/d24/d2f/f41 [4194304,4194304] 0 2023-12-16T03:15:57.076 INFO:tasks.workunit.client.0.smithi064.stdout:1/214: write d3/dd/f42 [786418,108740] 0 2023-12-16T03:15:57.076 INFO:tasks.workunit.client.1.smithi184.stdout:1/493: mkdir d3/d28/d3c/d41/d46/d4a/d6a/da5 0 2023-12-16T03:15:57.078 INFO:tasks.workunit.client.0.smithi064.stdout:8/275: write d0/da/d16/f1b [3298223,114487] 0 2023-12-16T03:15:57.079 INFO:tasks.workunit.client.0.smithi064.stdout:2/188: stat d1/d15/d1e/c2c 0 2023-12-16T03:15:57.080 INFO:tasks.workunit.client.1.smithi184.stdout:1/494: getdents d3/d28/d36 0 2023-12-16T03:15:57.080 INFO:tasks.workunit.client.1.smithi184.stdout:1/495: fsync d3/d28/d3c/f4f 0 2023-12-16T03:15:57.080 INFO:tasks.workunit.client.1.smithi184.stdout:1/496: fdatasync d3/d13/f92 0 2023-12-16T03:15:57.080 INFO:tasks.workunit.client.1.smithi184.stdout:2/331: dread d3/d13/d28/f3e [0,4194304] 0 2023-12-16T03:15:57.080 INFO:tasks.workunit.client.0.smithi064.stdout:1/215: mkdir d3/d22/d4a 0 2023-12-16T03:15:57.081 INFO:tasks.workunit.client.1.smithi184.stdout:2/332: symlink d3/d29/d4d/d5b/l6f 0 2023-12-16T03:15:57.081 INFO:tasks.workunit.client.0.smithi064.stdout:8/276: rmdir d0/da/d16 39 2023-12-16T03:15:57.083 INFO:tasks.workunit.client.1.smithi184.stdout:2/333: link d3/d29/c34 d3/d29/c70 0 2023-12-16T03:15:57.083 INFO:tasks.workunit.client.1.smithi184.stdout:2/334: readlink d3/d29/d2f/d31/l3d 0 2023-12-16T03:15:57.083 INFO:tasks.workunit.client.0.smithi064.stdout:1/216: creat d3/dd/d23/d41/f4b x:0 0 0 2023-12-16T03:15:57.084 INFO:tasks.workunit.client.0.smithi064.stdout:1/217: chown d3/dd/d11/f17 1 1 2023-12-16T03:15:57.085 INFO:tasks.workunit.client.1.smithi184.stdout:2/335: getdents d3/d13/d28 0 2023-12-16T03:15:57.086 INFO:tasks.workunit.client.0.smithi064.stdout:2/189: unlink d1/c2b 0 2023-12-16T03:15:57.087 INFO:tasks.workunit.client.0.smithi064.stdout:2/190: write d1/f8 [1662531,10131] 0 2023-12-16T03:15:57.087 INFO:tasks.workunit.client.1.smithi184.stdout:2/336: creat d3/d29/d2f/d46/f71 x:0 0 0 2023-12-16T03:15:57.087 INFO:tasks.workunit.client.1.smithi184.stdout:3/535: dwrite d12/d18/d68/f9a [0,4194304] 0 2023-12-16T03:15:57.091 INFO:tasks.workunit.client.1.smithi184.stdout:3/536: mknod d12/d18/d1f/d23/d2a/d3e/cca 0 2023-12-16T03:15:57.091 INFO:tasks.workunit.client.1.smithi184.stdout:3/537: fsync d12/d18/d1f/d23/d2a/d42/d52/d76/da5/fc3 0 2023-12-16T03:15:57.091 INFO:tasks.workunit.client.1.smithi184.stdout:3/538: chown d12/d18/d1f/d23/d2a/d36/f5b 90 1 2023-12-16T03:15:57.092 INFO:tasks.workunit.client.0.smithi064.stdout:2/191: link d1/f7 d1/d15/d1b/f33 0 2023-12-16T03:15:57.092 INFO:tasks.workunit.client.1.smithi184.stdout:1/497: dread d3/d28/d3c/f33 [0,4194304] 0 2023-12-16T03:15:57.096 INFO:tasks.workunit.client.1.smithi184.stdout:2/337: dread d3/d29/d2f/d2e/f1b [0,4194304] 0 2023-12-16T03:15:57.098 INFO:tasks.workunit.client.1.smithi184.stdout:2/338: mknod d3/d29/d61/d6d/c72 0 2023-12-16T03:15:57.110 INFO:tasks.workunit.client.1.smithi184.stdout:9/682: dwrite d0/d13/f91 [0,4194304] 0 2023-12-16T03:15:57.110 INFO:tasks.workunit.client.1.smithi184.stdout:4/418: dwrite d1/d11/f23 [0,4194304] 0 2023-12-16T03:15:57.114 INFO:tasks.workunit.client.1.smithi184.stdout:3/539: dwrite d12/d18/d1f/d23/d2a/d3e/d48/f70 [4194304,4194304] 0 2023-12-16T03:15:57.114 INFO:tasks.workunit.client.1.smithi184.stdout:3/540: write d12/d18/d1f/f44 [5024296,8755] 0 2023-12-16T03:15:57.114 INFO:tasks.workunit.client.1.smithi184.stdout:3/541: stat d12/d18/f32 0 2023-12-16T03:15:57.115 INFO:tasks.workunit.client.1.smithi184.stdout:3/542: write d12/d86/fc5 [322589,116005] 0 2023-12-16T03:15:57.115 INFO:tasks.workunit.client.1.smithi184.stdout:3/543: dread - d12/d18/d1f/d23/d2a/d3e/d48/d7b/f85 zero size 2023-12-16T03:15:57.118 INFO:tasks.workunit.client.1.smithi184.stdout:9/683: symlink d0/d76/lea 0 2023-12-16T03:15:57.119 INFO:tasks.workunit.client.1.smithi184.stdout:6/526: dwrite d0/f31 [0,4194304] 0 2023-12-16T03:15:57.121 INFO:tasks.workunit.client.1.smithi184.stdout:3/544: link d12/d1e/l41 d12/lcb 0 2023-12-16T03:15:57.126 INFO:tasks.workunit.client.1.smithi184.stdout:9/684: creat d0/d76/db7/feb x:0 0 0 2023-12-16T03:15:57.131 INFO:tasks.workunit.client.1.smithi184.stdout:3/545: symlink d12/d18/d1f/d23/d2a/d4a/lcc 0 2023-12-16T03:15:57.131 INFO:tasks.workunit.client.1.smithi184.stdout:6/527: creat d0/d5/d42/fad x:0 0 0 2023-12-16T03:15:57.137 INFO:tasks.workunit.client.1.smithi184.stdout:4/419: dread d1/fd [0,4194304] 0 2023-12-16T03:15:57.137 INFO:tasks.workunit.client.1.smithi184.stdout:4/420: chown d1/d11/d1b/d1e/c62 1 1 2023-12-16T03:15:57.137 INFO:tasks.workunit.client.1.smithi184.stdout:4/421: readlink d1/l10 0 2023-12-16T03:15:57.138 INFO:tasks.workunit.client.1.smithi184.stdout:2/339: dwrite d3/f6 [0,4194304] 0 2023-12-16T03:15:57.138 INFO:tasks.workunit.client.1.smithi184.stdout:6/528: write d0/d36/f55 [672455,82585] 0 2023-12-16T03:15:57.138 INFO:tasks.workunit.client.1.smithi184.stdout:6/529: dread - d0/d5/d22/d37/d4d/d9c/fa9 zero size 2023-12-16T03:15:57.138 INFO:tasks.workunit.client.1.smithi184.stdout:6/530: write d0/d5/d12/d1b/d33/f7e [41836,7319] 0 2023-12-16T03:15:57.139 INFO:tasks.workunit.client.1.smithi184.stdout:2/340: rename d3/d13/l15 to d3/d9/l73 0 2023-12-16T03:15:57.141 INFO:tasks.workunit.client.1.smithi184.stdout:6/531: link d0/d5/d22/d25/f2b d0/d5/d12/d1b/fae 0 2023-12-16T03:15:57.142 INFO:tasks.workunit.client.1.smithi184.stdout:2/341: rename d3/d9/d19/f43 to d3/d13/d28/f74 0 2023-12-16T03:15:57.142 INFO:tasks.workunit.client.1.smithi184.stdout:2/342: write d3/d29/d2f/d2e/f5d [259805,29540] 0 2023-12-16T03:15:57.143 INFO:tasks.workunit.client.1.smithi184.stdout:4/422: write d1/d29/d34/d5c/d76/d3b/f3f [2719142,106069] 0 2023-12-16T03:15:57.143 INFO:tasks.workunit.client.1.smithi184.stdout:6/532: truncate d0/d5/d12/d1b/d33/f91 2981082 0 2023-12-16T03:15:57.145 INFO:tasks.workunit.client.1.smithi184.stdout:2/343: creat d3/f75 x:0 0 0 2023-12-16T03:15:57.145 INFO:tasks.workunit.client.1.smithi184.stdout:2/344: write d3/f3c [480499,54016] 0 2023-12-16T03:15:57.147 INFO:tasks.workunit.client.0.smithi064.stdout:8/277: dwrite d0/d1d/f20 [4194304,4194304] 0 2023-12-16T03:15:57.147 INFO:tasks.workunit.client.0.smithi064.stdout:8/278: chown d0/d1d/c3b 364943003 1 2023-12-16T03:15:57.147 INFO:tasks.workunit.client.0.smithi064.stdout:8/279: stat d0/d1d/d3c/d40 0 2023-12-16T03:15:57.147 INFO:tasks.workunit.client.1.smithi184.stdout:6/533: symlink d0/d5/d22/d25/laf 0 2023-12-16T03:15:57.147 INFO:tasks.workunit.client.1.smithi184.stdout:4/423: symlink d1/d11/d5a/l89 0 2023-12-16T03:15:57.148 INFO:tasks.workunit.client.1.smithi184.stdout:6/534: write d0/d5/d22/d25/d47/f6e [1008001,79343] 0 2023-12-16T03:15:57.150 INFO:tasks.workunit.client.1.smithi184.stdout:4/424: rename d1/d11/d1b/c36 to d1/d12/d13/d40/d43/d45/c8a 0 2023-12-16T03:15:57.150 INFO:tasks.workunit.client.1.smithi184.stdout:4/425: readlink d1/l2 0 2023-12-16T03:15:57.151 INFO:tasks.workunit.client.0.smithi064.stdout:8/280: link d0/db/f4f d0/f60 0 2023-12-16T03:15:57.151 INFO:tasks.workunit.client.0.smithi064.stdout:8/281: truncate d0/db/d37/d3a/f57 994968 0 2023-12-16T03:15:57.151 INFO:tasks.workunit.client.0.smithi064.stdout:8/282: write d0/f3 [5164469,107419] 0 2023-12-16T03:15:57.151 INFO:tasks.workunit.client.0.smithi064.stdout:8/283: write d0/db/d12/d1c/f1f [1267824,936] 0 2023-12-16T03:15:57.153 INFO:tasks.workunit.client.0.smithi064.stdout:7/171: sync 2023-12-16T03:15:57.153 INFO:tasks.workunit.client.0.smithi064.stdout:9/159: sync 2023-12-16T03:15:57.153 INFO:tasks.workunit.client.0.smithi064.stdout:2/192: dwrite d1/d15/f1f [4194304,4194304] 0 2023-12-16T03:15:57.153 INFO:tasks.workunit.client.0.smithi064.stdout:2/193: write d1/f1d [2271241,35722] 0 2023-12-16T03:15:57.153 INFO:tasks.workunit.client.0.smithi064.stdout:2/194: write d1/d15/f28 [203556,47780] 0 2023-12-16T03:15:57.154 INFO:tasks.workunit.client.0.smithi064.stdout:7/172: rmdir d7 39 2023-12-16T03:15:57.154 INFO:tasks.workunit.client.1.smithi184.stdout:6/535: truncate d0/d5/d22/d25/f2b 4964602 0 2023-12-16T03:15:57.155 INFO:tasks.workunit.client.0.smithi064.stdout:9/160: read d2/dc/f1f [2544205,65071] 0 2023-12-16T03:15:57.156 INFO:tasks.workunit.client.1.smithi184.stdout:6/536: rmdir d0/d5/d22/d37/d45/d90 39 2023-12-16T03:15:57.156 INFO:tasks.workunit.client.1.smithi184.stdout:4/426: dread d1/d12/d13/f22 [0,4194304] 0 2023-12-16T03:15:57.157 INFO:tasks.workunit.client.1.smithi184.stdout:3/546: dread d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f60 [0,4194304] 0 2023-12-16T03:15:57.157 INFO:tasks.workunit.client.1.smithi184.stdout:3/547: chown d12/l4c 7 1 2023-12-16T03:15:57.157 INFO:tasks.workunit.client.1.smithi184.stdout:4/427: mknod d1/d11/d1b/d44/c8b 0 2023-12-16T03:15:57.159 INFO:tasks.workunit.client.1.smithi184.stdout:3/548: creat d12/d18/da1/dbd/dc8/fcd x:0 0 0 2023-12-16T03:15:57.159 INFO:tasks.workunit.client.1.smithi184.stdout:3/549: dread - d12/d18/d68/f9e zero size 2023-12-16T03:15:57.161 INFO:tasks.workunit.client.1.smithi184.stdout:4/428: unlink d1/cc 0 2023-12-16T03:15:57.161 INFO:tasks.workunit.client.0.smithi064.stdout:7/173: rename d7/d26/f34 to d7/d13/d20/f3a 0 2023-12-16T03:15:57.162 INFO:tasks.workunit.client.1.smithi184.stdout:5/374: dwrite d1/d3/d2f/f3d [0,4194304] 0 2023-12-16T03:15:57.162 INFO:tasks.workunit.client.1.smithi184.stdout:6/537: write d0/d5/f2c [2700494,109413] 0 2023-12-16T03:15:57.164 INFO:tasks.workunit.client.0.smithi064.stdout:9/161: dread d2/dc/f15 [0,4194304] 0 2023-12-16T03:15:57.164 INFO:tasks.workunit.client.0.smithi064.stdout:7/174: unlink d7/d13/f31 0 2023-12-16T03:15:57.166 INFO:tasks.workunit.client.1.smithi184.stdout:2/345: dwrite d3/d29/d2f/d46/f71 [0,4194304] 0 2023-12-16T03:15:57.166 INFO:tasks.workunit.client.1.smithi184.stdout:4/429: link d1/d29/d34/d5c/d76/d33/d4a/l50 d1/d29/d34/d5c/d76/d33/d4a/l8c 0 2023-12-16T03:15:57.166 INFO:tasks.workunit.client.1.smithi184.stdout:9/685: dwrite d0/d13/f87 [0,4194304] 0 2023-12-16T03:15:57.166 INFO:tasks.workunit.client.1.smithi184.stdout:3/550: creat d12/d18/d1f/d23/d2a/d42/d52/fce x:0 0 0 2023-12-16T03:15:57.167 INFO:tasks.workunit.client.1.smithi184.stdout:1/498: dwrite d3/d13/f90 [4194304,4194304] 0 2023-12-16T03:15:57.170 INFO:tasks.workunit.client.1.smithi184.stdout:6/538: creat d0/d5/d22/d34/fb0 x:0 0 0 2023-12-16T03:15:57.170 INFO:tasks.workunit.client.0.smithi064.stdout:9/162: creat d2/f2e x:0 0 0 2023-12-16T03:15:57.173 INFO:tasks.workunit.client.0.smithi064.stdout:7/175: creat d7/f3b x:0 0 0 2023-12-16T03:15:57.174 INFO:tasks.workunit.client.1.smithi184.stdout:4/430: mknod d1/d11/d5a/d63/d72/c8d 0 2023-12-16T03:15:57.178 INFO:tasks.workunit.client.0.smithi064.stdout:7/176: link c2 d7/d13/d20/d37/c3c 0 2023-12-16T03:15:57.178 INFO:tasks.workunit.client.1.smithi184.stdout:7/405: sync 2023-12-16T03:15:57.178 INFO:tasks.workunit.client.1.smithi184.stdout:8/522: sync 2023-12-16T03:15:57.179 INFO:tasks.workunit.client.1.smithi184.stdout:9/686: creat d0/d76/da2/db4/fec x:0 0 0 2023-12-16T03:15:57.179 INFO:tasks.workunit.client.1.smithi184.stdout:3/551: creat d12/d18/d1f/d23/d2a/d3e/d48/fcf x:0 0 0 2023-12-16T03:15:57.181 INFO:tasks.workunit.client.0.smithi064.stdout:7/177: mkdir d7/d26/d3d 0 2023-12-16T03:15:57.181 INFO:tasks.workunit.client.0.smithi064.stdout:8/284: truncate d0/f3 4226328 0 2023-12-16T03:15:57.181 INFO:tasks.workunit.client.1.smithi184.stdout:1/499: getdents d3/d28/d3c/d41 0 2023-12-16T03:15:57.182 INFO:tasks.workunit.client.1.smithi184.stdout:1/500: truncate d3/d28/f87 1167401 0 2023-12-16T03:15:57.187 INFO:tasks.workunit.client.0.smithi064.stdout:7/178: mkdir d7/d3e 0 2023-12-16T03:15:57.187 INFO:tasks.workunit.client.0.smithi064.stdout:8/285: write d0/d1d/f20 [4692569,11524] 0 2023-12-16T03:15:57.190 INFO:tasks.workunit.client.1.smithi184.stdout:4/431: getdents d1/d12/d13/d40 0 2023-12-16T03:15:57.191 INFO:tasks.workunit.client.1.smithi184.stdout:1/501: mkdir d3/d28/d3c/d41/d46/d4a/d6a/da6 0 2023-12-16T03:15:57.191 INFO:tasks.workunit.client.0.smithi064.stdout:8/286: creat d0/db/d37/f61 x:0 0 0 2023-12-16T03:15:57.191 INFO:tasks.workunit.client.0.smithi064.stdout:8/287: dread - d0/da/d3e/f53 zero size 2023-12-16T03:15:57.191 INFO:tasks.workunit.client.1.smithi184.stdout:3/552: symlink d12/d18/d1f/d23/ld0 0 2023-12-16T03:15:57.192 INFO:tasks.workunit.client.1.smithi184.stdout:3/553: chown d12/d18/d1f/d23/d2a/d36 0 1 2023-12-16T03:15:57.192 INFO:tasks.workunit.client.1.smithi184.stdout:3/554: fsync d12/d18/d1f/d23/d51/f90 0 2023-12-16T03:15:57.192 INFO:tasks.workunit.client.1.smithi184.stdout:3/555: stat f4 0 2023-12-16T03:15:57.192 INFO:tasks.workunit.client.0.smithi064.stdout:8/288: creat d0/db/f62 x:0 0 0 2023-12-16T03:15:57.192 INFO:tasks.workunit.client.1.smithi184.stdout:9/687: write d0/d30/f75 [5735081,32484] 0 2023-12-16T03:15:57.193 INFO:tasks.workunit.client.1.smithi184.stdout:4/432: mknod d1/d12/d13/d40/d43/d5e/c8e 0 2023-12-16T03:15:57.194 INFO:tasks.workunit.client.0.smithi064.stdout:8/289: rename d0/l5 to d0/d1d/d3c/d40/l63 0 2023-12-16T03:15:57.194 INFO:tasks.workunit.client.0.smithi064.stdout:8/290: chown d0/f14 152303056 1 2023-12-16T03:15:57.194 INFO:tasks.workunit.client.0.smithi064.stdout:8/291: readlink d0/d1d/d24/d2f/l5b 0 2023-12-16T03:15:57.194 INFO:tasks.workunit.client.0.smithi064.stdout:8/292: fdatasync d0/db/d37/f43 0 2023-12-16T03:15:57.194 INFO:tasks.workunit.client.0.smithi064.stdout:8/293: fsync d0/d1d/d3c/f55 0 2023-12-16T03:15:57.195 INFO:tasks.workunit.client.0.smithi064.stdout:8/294: write d0/db/f62 [1024197,104982] 0 2023-12-16T03:15:57.195 INFO:tasks.workunit.client.0.smithi064.stdout:7/179: read d7/d26/d30/f33 [1967047,23634] 0 2023-12-16T03:15:57.195 INFO:tasks.workunit.client.1.smithi184.stdout:1/502: mknod d3/d28/d3c/d41/d77/ca7 0 2023-12-16T03:15:57.196 INFO:tasks.workunit.client.1.smithi184.stdout:1/503: chown d3/d13/f92 28299 1 2023-12-16T03:15:57.196 INFO:tasks.workunit.client.1.smithi184.stdout:1/504: write d3/d28/f87 [1732116,35965] 0 2023-12-16T03:15:57.200 INFO:tasks.workunit.client.0.smithi064.stdout:7/180: rmdir d7/d26/d3d 0 2023-12-16T03:15:57.206 INFO:tasks.workunit.client.1.smithi184.stdout:3/556: rename d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f64 to d12/d37/fd1 0 2023-12-16T03:15:57.206 INFO:tasks.workunit.client.1.smithi184.stdout:3/557: read d12/d1e/f20 [2736883,21464] 0 2023-12-16T03:15:57.207 INFO:tasks.workunit.client.1.smithi184.stdout:3/558: read - d12/d18/d1f/d23/d2a/f4e zero size 2023-12-16T03:15:57.207 INFO:tasks.workunit.client.1.smithi184.stdout:3/559: dread - d12/d37/f6d zero size 2023-12-16T03:15:57.207 INFO:tasks.workunit.client.1.smithi184.stdout:1/505: dread d3/d28/d3c/d41/d77/fa3 [0,4194304] 0 2023-12-16T03:15:57.207 INFO:tasks.workunit.client.0.smithi064.stdout:7/181: mknod d7/d13/d20/d37/c3f 0 2023-12-16T03:15:57.207 INFO:tasks.workunit.client.1.smithi184.stdout:1/506: mknod d3/d28/d3c/d41/d46/d4a/d6a/d6d/d99/ca8 0 2023-12-16T03:15:57.209 INFO:tasks.workunit.client.1.smithi184.stdout:1/507: link d3/d13/d2c/f81 d3/d28/d3c/d41/d63/fa9 0 2023-12-16T03:15:57.212 INFO:tasks.workunit.client.1.smithi184.stdout:1/508: mknod d3/d13/d2c/caa 0 2023-12-16T03:15:57.216 INFO:tasks.workunit.client.1.smithi184.stdout:2/346: dwrite d3/d29/d2f/f22 [0,4194304] 0 2023-12-16T03:15:57.218 INFO:tasks.workunit.client.1.smithi184.stdout:1/509: rename d3/c10 to d3/d13/d2c/cab 0 2023-12-16T03:15:57.221 INFO:tasks.workunit.client.0.smithi064.stdout:7/182: read d7/f9 [336365,35933] 0 2023-12-16T03:15:57.221 INFO:tasks.workunit.client.0.smithi064.stdout:7/183: chown d7/d26/d30/f33 32725267 1 2023-12-16T03:15:57.223 INFO:tasks.workunit.client.0.smithi064.stdout:7/184: read d7/f9 [62440,42251] 0 2023-12-16T03:15:57.224 INFO:tasks.workunit.client.0.smithi064.stdout:7/185: getdents d7/d3e 0 2023-12-16T03:15:57.224 INFO:tasks.workunit.client.0.smithi064.stdout:7/186: fdatasync d7/d26/d30/f33 0 2023-12-16T03:15:57.224 INFO:tasks.workunit.client.0.smithi064.stdout:7/187: fsync d7/d26/d30/f39 0 2023-12-16T03:15:57.224 INFO:tasks.workunit.client.0.smithi064.stdout:7/188: write d7/d26/d30/f39 [775217,120312] 0 2023-12-16T03:15:57.224 INFO:tasks.workunit.client.0.smithi064.stdout:7/189: write d7/f9 [971447,96207] 0 2023-12-16T03:15:57.224 INFO:tasks.workunit.client.1.smithi184.stdout:2/347: rmdir d3/d29/d2f/d2e 39 2023-12-16T03:15:57.224 INFO:tasks.workunit.client.1.smithi184.stdout:1/510: creat d3/d28/d38/fac x:0 0 0 2023-12-16T03:15:57.228 INFO:tasks.workunit.client.1.smithi184.stdout:5/375: dwrite d1/d3/fa [0,4194304] 0 2023-12-16T03:15:57.228 INFO:tasks.workunit.client.1.smithi184.stdout:5/376: chown d1/c25 12044899 1 2023-12-16T03:15:57.228 INFO:tasks.workunit.client.1.smithi184.stdout:5/377: chown d1/d2a/d31/l59 509549 1 2023-12-16T03:15:57.228 INFO:tasks.workunit.client.1.smithi184.stdout:6/539: dwrite d0/f18 [0,4194304] 0 2023-12-16T03:15:57.229 INFO:tasks.workunit.client.0.smithi064.stdout:7/190: unlink d7/d1c/f25 0 2023-12-16T03:15:57.229 INFO:tasks.workunit.client.0.smithi064.stdout:7/191: fsync d7/f14 0 2023-12-16T03:15:57.229 INFO:tasks.workunit.client.0.smithi064.stdout:7/192: fdatasync d7/d13/d20/f3a 0 2023-12-16T03:15:57.230 INFO:tasks.workunit.client.1.smithi184.stdout:2/348: write d3/d29/d2f/d2e/f53 [1919048,125917] 0 2023-12-16T03:15:57.231 INFO:tasks.workunit.client.0.smithi064.stdout:7/193: symlink d7/d26/l40 0 2023-12-16T03:15:57.234 INFO:tasks.workunit.client.1.smithi184.stdout:6/540: creat d0/d5/d22/fb1 x:0 0 0 2023-12-16T03:15:57.237 INFO:tasks.workunit.client.0.smithi064.stdout:2/195: dwrite d1/d27/f29 [4194304,4194304] 0 2023-12-16T03:15:57.238 INFO:tasks.workunit.client.0.smithi064.stdout:2/196: chown d1/d15/d1b/c24 10 1 2023-12-16T03:15:57.238 INFO:tasks.workunit.client.0.smithi064.stdout:2/197: chown d1/d15/d1e 1 1 2023-12-16T03:15:57.238 INFO:tasks.workunit.client.1.smithi184.stdout:2/349: creat d3/f76 x:0 0 0 2023-12-16T03:15:57.239 INFO:tasks.workunit.client.0.smithi064.stdout:2/198: creat d1/d27/d2e/f34 x:0 0 0 2023-12-16T03:15:57.244 INFO:tasks.workunit.client.0.smithi064.stdout:2/199: mkdir d1/d27/d35 0 2023-12-16T03:15:57.244 INFO:tasks.workunit.client.0.smithi064.stdout:2/200: getdents d1/d27/d35 0 2023-12-16T03:15:57.250 INFO:tasks.workunit.client.0.smithi064.stdout:2/201: write d1/d15/f1f [8294539,1680] 0 2023-12-16T03:15:57.252 INFO:tasks.workunit.client.0.smithi064.stdout:2/202: rmdir d1/d27 39 2023-12-16T03:15:57.256 INFO:tasks.workunit.client.1.smithi184.stdout:9/688: dwrite d0/d13/d20/d5b/d53/f81 [0,4194304] 0 2023-12-16T03:15:57.256 INFO:tasks.workunit.client.1.smithi184.stdout:7/406: dwrite d0/df/d1e/f5d [0,4194304] 0 2023-12-16T03:15:57.256 INFO:tasks.workunit.client.1.smithi184.stdout:7/407: chown d0/d3 450337 1 2023-12-16T03:15:57.256 INFO:tasks.workunit.client.1.smithi184.stdout:8/523: dwrite d2/d4/f44 [0,4194304] 0 2023-12-16T03:15:57.256 INFO:tasks.workunit.client.1.smithi184.stdout:8/524: chown d2/d4/d10/d7a 36721179 1 2023-12-16T03:15:57.258 INFO:tasks.workunit.client.1.smithi184.stdout:3/560: dwrite d12/d18/d1f/f3d [0,4194304] 0 2023-12-16T03:15:57.258 INFO:tasks.workunit.client.1.smithi184.stdout:6/541: dread d0/d5/d22/fb [0,4194304] 0 2023-12-16T03:15:57.261 INFO:tasks.workunit.client.1.smithi184.stdout:4/433: dwrite d1/d11/f7a [0,4194304] 0 2023-12-16T03:15:57.261 INFO:tasks.workunit.client.1.smithi184.stdout:4/434: fdatasync d1/d29/d34/d5c/d76/d3b/f53 0 2023-12-16T03:15:57.261 INFO:tasks.workunit.client.0.smithi064.stdout:9/163: dwrite d2/d16/f20 [0,4194304] 0 2023-12-16T03:15:57.261 INFO:tasks.workunit.client.0.smithi064.stdout:9/164: stat d2/d16/l21 0 2023-12-16T03:15:57.262 INFO:tasks.workunit.client.1.smithi184.stdout:6/542: mknod d0/d5/d22/cb2 0 2023-12-16T03:15:57.263 INFO:tasks.workunit.client.1.smithi184.stdout:6/543: fsync d0/d5/f59 0 2023-12-16T03:15:57.263 INFO:tasks.workunit.client.1.smithi184.stdout:1/511: dwrite d3/d28/d3c/d24/f43 [0,4194304] 0 2023-12-16T03:15:57.263 INFO:tasks.workunit.client.1.smithi184.stdout:3/561: creat d12/d18/d1f/d23/d2a/d4a/fd2 x:0 0 0 2023-12-16T03:15:57.263 INFO:tasks.workunit.client.1.smithi184.stdout:7/408: truncate d0/d3/d2e/f3a 570752 0 2023-12-16T03:15:57.265 INFO:tasks.workunit.client.0.smithi064.stdout:3/256: sync 2023-12-16T03:15:57.265 INFO:tasks.workunit.client.0.smithi064.stdout:3/257: write db/d12/f58 [4860670,119089] 0 2023-12-16T03:15:57.266 INFO:tasks.workunit.client.1.smithi184.stdout:6/544: write d0/d5/d22/d25/d3f/f78 [997467,107900] 0 2023-12-16T03:15:57.266 INFO:tasks.workunit.client.1.smithi184.stdout:1/512: write d3/d28/d3c/d41/d63/fa9 [347890,40088] 0 2023-12-16T03:15:57.266 INFO:tasks.workunit.client.1.smithi184.stdout:1/513: stat d3/d28/d3c/d41/d46/d4a/d6a/d6d 0 2023-12-16T03:15:57.266 INFO:tasks.workunit.client.1.smithi184.stdout:1/514: chown d3/d28/d3c/d41/d63 6 1 2023-12-16T03:15:57.266 INFO:tasks.workunit.client.1.smithi184.stdout:4/435: creat d1/d29/d34/d5c/d76/f8f x:0 0 0 2023-12-16T03:15:57.266 INFO:tasks.workunit.client.1.smithi184.stdout:4/436: chown d1/d11/d1b/d1e/c62 12402288 1 2023-12-16T03:15:57.268 INFO:tasks.workunit.client.1.smithi184.stdout:6/545: read d0/d5/d22/d25/f2b [3744737,33062] 0 2023-12-16T03:15:57.268 INFO:tasks.workunit.client.1.smithi184.stdout:6/546: fsync d0/d5/d22/fb 0 2023-12-16T03:15:57.269 INFO:tasks.workunit.client.1.smithi184.stdout:3/562: symlink d12/d18/d1f/d23/d2a/d3e/ld3 0 2023-12-16T03:15:57.270 INFO:tasks.workunit.client.0.smithi064.stdout:9/165: rename d2/d16/l21 to d2/l2f 0 2023-12-16T03:15:57.271 INFO:tasks.workunit.client.1.smithi184.stdout:7/409: truncate d0/df/d1e/f2d 3059019 0 2023-12-16T03:15:57.271 INFO:tasks.workunit.client.1.smithi184.stdout:4/437: mkdir d1/d29/d34/d5c/d76/d42/d90 0 2023-12-16T03:15:57.271 INFO:tasks.workunit.client.0.smithi064.stdout:3/258: creat db/d12/d21/f5c x:0 0 0 2023-12-16T03:15:57.271 INFO:tasks.workunit.client.0.smithi064.stdout:3/259: chown db/c32 2759740 1 2023-12-16T03:15:57.271 INFO:tasks.workunit.client.0.smithi064.stdout:8/295: truncate d0/d1d/f20 1917286 0 2023-12-16T03:15:57.272 INFO:tasks.workunit.client.0.smithi064.stdout:9/166: write d2/dc/f1f [3048376,33757] 0 2023-12-16T03:15:57.272 INFO:tasks.workunit.client.0.smithi064.stdout:9/167: truncate d2/dc/f2b 1042316 0 2023-12-16T03:15:57.273 INFO:tasks.workunit.client.1.smithi184.stdout:6/547: symlink d0/d5/d22/d25/d3f/d6f/lb3 0 2023-12-16T03:15:57.273 INFO:tasks.workunit.client.1.smithi184.stdout:7/410: creat d0/df/d32/d39/f70 x:0 0 0 2023-12-16T03:15:57.274 INFO:tasks.workunit.client.0.smithi064.stdout:7/194: getdents d7/d26 0 2023-12-16T03:15:57.274 INFO:tasks.workunit.client.0.smithi064.stdout:3/260: link db/d12/d1a/d2c/f44 db/d4f/f5d 0 2023-12-16T03:15:57.276 INFO:tasks.workunit.client.1.smithi184.stdout:2/350: dwrite d3/d29/d61/f68 [0,4194304] 0 2023-12-16T03:15:57.277 INFO:tasks.workunit.client.1.smithi184.stdout:9/689: dread d0/d3a/d47/f71 [0,4194304] 0 2023-12-16T03:15:57.277 INFO:tasks.workunit.client.1.smithi184.stdout:9/690: stat d0/d13/d20/d5b/faf 0 2023-12-16T03:15:57.277 INFO:tasks.workunit.client.1.smithi184.stdout:2/351: write d3/d29/f2d [2590669,129771] 0 2023-12-16T03:15:57.277 INFO:tasks.workunit.client.1.smithi184.stdout:2/352: fsync d3/d29/d2f/d2e/fa 0 2023-12-16T03:15:57.277 INFO:tasks.workunit.client.1.smithi184.stdout:7/411: mknod d0/c71 0 2023-12-16T03:15:57.278 INFO:tasks.workunit.client.1.smithi184.stdout:6/548: creat d0/d5/d12/d1b/d33/fb4 x:0 0 0 2023-12-16T03:15:57.278 INFO:tasks.workunit.client.1.smithi184.stdout:6/549: fdatasync d0/d5/d22/fb 0 2023-12-16T03:15:57.278 INFO:tasks.workunit.client.1.smithi184.stdout:4/438: dread d1/f54 [0,4194304] 0 2023-12-16T03:15:57.278 INFO:tasks.workunit.client.1.smithi184.stdout:3/563: write d12/f1b [1291845,72101] 0 2023-12-16T03:15:57.280 INFO:tasks.workunit.client.0.smithi064.stdout:9/168: dread f1 [0,4194304] 0 2023-12-16T03:15:57.282 INFO:tasks.workunit.client.1.smithi184.stdout:5/378: dwrite d1/d3/d9/f39 [0,4194304] 0 2023-12-16T03:15:57.283 INFO:tasks.workunit.client.1.smithi184.stdout:8/525: dread d2/d12/d21/d2d/d31/d34/f67 [0,4194304] 0 2023-12-16T03:15:57.283 INFO:tasks.workunit.client.1.smithi184.stdout:2/353: truncate d3/d29/f30 1986202 0 2023-12-16T03:15:57.283 INFO:tasks.workunit.client.1.smithi184.stdout:2/354: fsync d3/d29/d2f/d46/f6b 0 2023-12-16T03:15:57.287 INFO:tasks.workunit.client.1.smithi184.stdout:7/412: mknod d0/d3/d2e/c72 0 2023-12-16T03:15:57.287 INFO:tasks.workunit.client.1.smithi184.stdout:3/564: creat d12/d18/d1f/d23/d2a/d42/d52/d76/fd4 x:0 0 0 2023-12-16T03:15:57.287 INFO:tasks.workunit.client.1.smithi184.stdout:3/565: write d12/d18/d1f/d23/d2a/d36/f8d [1305698,63790] 0 2023-12-16T03:15:57.290 INFO:tasks.workunit.client.0.smithi064.stdout:8/296: write d0/d1d/f20 [635516,129944] 0 2023-12-16T03:15:57.291 INFO:tasks.workunit.client.0.smithi064.stdout:3/261: mknod db/d13/d39/c5e 0 2023-12-16T03:15:57.293 INFO:tasks.workunit.client.0.smithi064.stdout:9/169: link d2/d16/l23 d2/d2d/l30 0 2023-12-16T03:15:57.296 INFO:tasks.workunit.client.0.smithi064.stdout:8/297: creat d0/d1d/d24/d2f/f64 x:0 0 0 2023-12-16T03:15:57.297 INFO:tasks.workunit.client.0.smithi064.stdout:3/262: mknod db/c5f 0 2023-12-16T03:15:57.298 INFO:tasks.workunit.client.1.smithi184.stdout:6/550: write d0/d5/f2c [3722519,28437] 0 2023-12-16T03:15:57.298 INFO:tasks.workunit.client.1.smithi184.stdout:6/551: write d0/d5/d26/f75 [426637,95647] 0 2023-12-16T03:15:57.300 INFO:tasks.workunit.client.0.smithi064.stdout:3/263: symlink db/d13/l60 0 2023-12-16T03:15:57.304 INFO:tasks.workunit.client.0.smithi064.stdout:3/264: rename db/d12/d1a/d31/f4b to db/d12/d21/f61 0 2023-12-16T03:15:57.306 INFO:tasks.workunit.client.1.smithi184.stdout:8/526: link d2/d4/d10/l62 d2/d4/da6/laa 0 2023-12-16T03:15:57.308 INFO:tasks.workunit.client.0.smithi064.stdout:2/203: dread d1/d15/f1f [4194304,4194304] 0 2023-12-16T03:15:57.313 INFO:tasks.workunit.client.1.smithi184.stdout:6/552: rename d0/d5/d42/f68 to d0/d5/d22/d37/d45/fb5 0 2023-12-16T03:15:57.313 INFO:tasks.workunit.client.1.smithi184.stdout:6/553: truncate d0/d5/d22/d25/d47/f6e 1194652 0 2023-12-16T03:15:57.313 INFO:tasks.workunit.client.1.smithi184.stdout:6/554: write d0/d5/d12/d1b/f9b [545485,129882] 0 2023-12-16T03:15:57.322 INFO:tasks.workunit.client.1.smithi184.stdout:8/527: creat d2/d4/d10/d7a/d83/d8b/fab x:0 0 0 2023-12-16T03:15:57.322 INFO:tasks.workunit.client.1.smithi184.stdout:8/528: stat d2/d4/d10/d7a/d83 0 2023-12-16T03:15:57.323 INFO:tasks.workunit.client.1.smithi184.stdout:6/555: rename d0/d5/d26/fab to d0/d5/d22/d34/fb6 0 2023-12-16T03:15:57.329 INFO:tasks.workunit.client.1.smithi184.stdout:8/529: chown d2/d4/c7 68 1 2023-12-16T03:15:57.331 INFO:tasks.workunit.client.0.smithi064.stdout:2/204: write d1/f4 [2689278,28159] 0 2023-12-16T03:15:57.333 INFO:tasks.workunit.client.1.smithi184.stdout:1/515: dwrite d3/d13/d2c/f81 [0,4194304] 0 2023-12-16T03:15:57.333 INFO:tasks.workunit.client.1.smithi184.stdout:6/556: rename d0/d5/d22/d34/c35 to d0/d5/d22/d34/cb7 0 2023-12-16T03:15:57.333 INFO:tasks.workunit.client.1.smithi184.stdout:1/516: write d3/d34/d76/f79 [250746,116854] 0 2023-12-16T03:15:57.335 INFO:tasks.workunit.client.1.smithi184.stdout:1/517: write d3/d28/d3c/d41/d46/f8c [1271697,19983] 0 2023-12-16T03:15:57.335 INFO:tasks.workunit.client.1.smithi184.stdout:1/518: write d3/d34/f4e [431396,71343] 0 2023-12-16T03:15:57.336 INFO:tasks.workunit.client.1.smithi184.stdout:8/530: creat d2/d4/d10/d11/fac x:0 0 0 2023-12-16T03:15:57.337 INFO:tasks.workunit.client.1.smithi184.stdout:1/519: creat d3/d28/d3c/d41/d46/d4a/fad x:0 0 0 2023-12-16T03:15:57.341 INFO:tasks.workunit.client.1.smithi184.stdout:3/566: dwrite d12/d18/d68/f9e [0,4194304] 0 2023-12-16T03:15:57.342 INFO:tasks.workunit.client.1.smithi184.stdout:6/557: dread d0/d5/f59 [0,4194304] 0 2023-12-16T03:15:57.345 INFO:tasks.workunit.client.1.smithi184.stdout:3/567: rmdir d12/d86 39 2023-12-16T03:15:57.355 INFO:tasks.workunit.client.1.smithi184.stdout:2/355: dwrite d3/d13/d28/f74 [0,4194304] 0 2023-12-16T03:15:57.356 INFO:tasks.workunit.client.0.smithi064.stdout:7/195: dwrite d7/f3b [0,4194304] 0 2023-12-16T03:15:57.356 INFO:tasks.workunit.client.0.smithi064.stdout:2/205: dread d1/f6 [0,4194304] 0 2023-12-16T03:15:57.359 INFO:tasks.workunit.client.0.smithi064.stdout:7/196: rmdir d7/d13 39 2023-12-16T03:15:57.359 INFO:tasks.workunit.client.0.smithi064.stdout:7/197: write d7/f14 [644998,66498] 0 2023-12-16T03:15:57.364 INFO:tasks.workunit.client.0.smithi064.stdout:8/298: dwrite d0/f7 [0,4194304] 0 2023-12-16T03:15:57.364 INFO:tasks.workunit.client.0.smithi064.stdout:8/299: chown d0/db/d4c 80623283 1 2023-12-16T03:15:57.364 INFO:tasks.workunit.client.1.smithi184.stdout:0/587: sync 2023-12-16T03:15:57.364 INFO:tasks.workunit.client.1.smithi184.stdout:2/356: mkdir d3/d29/d2f/d46/d77 0 2023-12-16T03:15:57.365 INFO:tasks.workunit.client.1.smithi184.stdout:2/357: fdatasync d3/d13/d28/f2c 0 2023-12-16T03:15:57.365 INFO:tasks.workunit.client.0.smithi064.stdout:9/170: dwrite d2/d16/f1c [0,4194304] 0 2023-12-16T03:15:57.365 INFO:tasks.workunit.client.0.smithi064.stdout:9/171: fdatasync d2/dc/f2b 0 2023-12-16T03:15:57.365 INFO:tasks.workunit.client.0.smithi064.stdout:7/198: truncate d7/d26/d30/f39 537305 0 2023-12-16T03:15:57.366 INFO:tasks.workunit.client.1.smithi184.stdout:2/358: rename d3/d29/d2f/d46/f71 to d3/d29/f78 0 2023-12-16T03:15:57.366 INFO:tasks.workunit.client.1.smithi184.stdout:2/359: readlink d3/d29/d2f/d31/l36 0 2023-12-16T03:15:57.366 INFO:tasks.workunit.client.1.smithi184.stdout:4/439: dwrite d1/d11/f23 [0,4194304] 0 2023-12-16T03:15:57.367 INFO:tasks.workunit.client.1.smithi184.stdout:4/440: stat d1/d29/d34/d5c/d76/f32 0 2023-12-16T03:15:57.367 INFO:tasks.workunit.client.1.smithi184.stdout:4/441: readlink d1/l1a 0 2023-12-16T03:15:57.367 INFO:tasks.workunit.client.1.smithi184.stdout:4/442: fdatasync d1/d29/d34/f48 0 2023-12-16T03:15:57.367 INFO:tasks.workunit.client.1.smithi184.stdout:7/413: dwrite d0/df/d1e/f2d [0,4194304] 0 2023-12-16T03:15:57.367 INFO:tasks.workunit.client.1.smithi184.stdout:9/691: dwrite d0/d30/f94 [0,4194304] 0 2023-12-16T03:15:57.367 INFO:tasks.workunit.client.1.smithi184.stdout:9/692: chown d0/d13/d20/d5b/cdd 14808 1 2023-12-16T03:15:57.368 INFO:tasks.workunit.client.0.smithi064.stdout:8/300: creat d0/da/f65 x:0 0 0 2023-12-16T03:15:57.368 INFO:tasks.workunit.client.1.smithi184.stdout:4/443: link d1/l14 d1/d29/d34/l91 0 2023-12-16T03:15:57.369 INFO:tasks.workunit.client.1.smithi184.stdout:8/531: dwrite d2/f13 [0,4194304] 0 2023-12-16T03:15:57.372 INFO:tasks.workunit.client.0.smithi064.stdout:3/265: truncate db/d12/f58 3194270 0 2023-12-16T03:15:57.373 INFO:tasks.workunit.client.1.smithi184.stdout:3/568: truncate d12/f25 3435225 0 2023-12-16T03:15:57.374 INFO:tasks.workunit.client.0.smithi064.stdout:7/199: symlink d7/d26/d30/l41 0 2023-12-16T03:15:57.374 INFO:tasks.workunit.client.1.smithi184.stdout:9/693: getdents d0/d13/d20/d5b/d43/dab 0 2023-12-16T03:15:57.374 INFO:tasks.workunit.client.1.smithi184.stdout:9/694: fdatasync d0/f36 0 2023-12-16T03:15:57.374 INFO:tasks.workunit.client.0.smithi064.stdout:8/301: creat d0/db/f66 x:0 0 0 2023-12-16T03:15:57.374 INFO:tasks.workunit.client.0.smithi064.stdout:2/206: fsync d1/f4 0 2023-12-16T03:15:57.376 INFO:tasks.workunit.client.1.smithi184.stdout:6/558: dwrite d0/d5/d22/d37/d4d/d9c/fa9 [0,4194304] 0 2023-12-16T03:15:57.376 INFO:tasks.workunit.client.0.smithi064.stdout:9/172: rename d2/d16 to d2/d2d/d31 0 2023-12-16T03:15:57.377 INFO:tasks.workunit.client.0.smithi064.stdout:3/266: symlink db/d12/d1a/d2c/d34/d4c/l62 0 2023-12-16T03:15:57.380 INFO:tasks.workunit.client.0.smithi064.stdout:2/207: symlink d1/d15/d1b/l36 0 2023-12-16T03:15:57.380 INFO:tasks.workunit.client.0.smithi064.stdout:2/208: chown d1/d15/f1f 1 1 2023-12-16T03:15:57.381 INFO:tasks.workunit.client.0.smithi064.stdout:8/302: dread d0/db/d37/f43 [0,4194304] 0 2023-12-16T03:15:57.381 INFO:tasks.workunit.client.0.smithi064.stdout:8/303: write d0/db/d37/d3a/f57 [968404,84952] 0 2023-12-16T03:15:57.382 INFO:tasks.workunit.client.0.smithi064.stdout:2/209: readlink d1/lb 0 2023-12-16T03:15:57.382 INFO:tasks.workunit.client.0.smithi064.stdout:7/200: mkdir d7/d3e/d42 0 2023-12-16T03:15:57.382 INFO:tasks.workunit.client.0.smithi064.stdout:7/201: chown d7/d1c 622156889 1 2023-12-16T03:15:57.383 INFO:tasks.workunit.client.1.smithi184.stdout:4/444: unlink d1/d12/d13/d40/d43/d45/f7b 0 2023-12-16T03:15:57.386 INFO:tasks.workunit.client.0.smithi064.stdout:0/131: sync 2023-12-16T03:15:57.386 INFO:tasks.workunit.client.0.smithi064.stdout:4/225: sync 2023-12-16T03:15:57.387 INFO:tasks.workunit.client.1.smithi184.stdout:7/414: dread d0/df/f2a [0,4194304] 0 2023-12-16T03:15:57.389 INFO:tasks.workunit.client.0.smithi064.stdout:8/304: truncate d0/db/d12/f15 356463 0 2023-12-16T03:15:57.389 INFO:tasks.workunit.client.0.smithi064.stdout:7/202: mkdir d7/d3e/d42/d43 0 2023-12-16T03:15:57.389 INFO:tasks.workunit.client.0.smithi064.stdout:4/226: dread d0/f8 [0,4194304] 0 2023-12-16T03:15:57.390 INFO:tasks.workunit.client.1.smithi184.stdout:8/532: mknod d2/d4/d10/d11/d72/cad 0 2023-12-16T03:15:57.390 INFO:tasks.workunit.client.1.smithi184.stdout:3/569: link d12/d1e/f20 d12/d1e/d89/fd5 0 2023-12-16T03:15:57.391 INFO:tasks.workunit.client.0.smithi064.stdout:5/205: sync 2023-12-16T03:15:57.391 INFO:tasks.workunit.client.0.smithi064.stdout:6/165: sync 2023-12-16T03:15:57.391 INFO:tasks.workunit.client.0.smithi064.stdout:1/218: sync 2023-12-16T03:15:57.391 INFO:tasks.workunit.client.0.smithi064.stdout:5/206: write d0/d7/f1e [816938,114704] 0 2023-12-16T03:15:57.391 INFO:tasks.workunit.client.0.smithi064.stdout:5/207: rename d0/de/d23 to d0/de/d23/d4c 22 2023-12-16T03:15:57.392 INFO:tasks.workunit.client.1.smithi184.stdout:9/695: rename d0/d3a/f9b to d0/d13/d20/d5b/fed 0 2023-12-16T03:15:57.392 INFO:tasks.workunit.client.0.smithi064.stdout:7/203: read d7/fb [25211,54181] 0 2023-12-16T03:15:57.393 INFO:tasks.workunit.client.1.smithi184.stdout:5/379: dwrite d1/d2a/f13 [4194304,4194304] 0 2023-12-16T03:15:57.395 INFO:tasks.workunit.client.1.smithi184.stdout:3/570: read d12/d18/fa0 [508767,86447] 0 2023-12-16T03:15:57.396 INFO:tasks.workunit.client.0.smithi064.stdout:0/132: symlink d2/d7/d10/d21/l25 0 2023-12-16T03:15:57.396 INFO:tasks.workunit.client.1.smithi184.stdout:6/559: truncate d0/d5/d22/fb 4398535 0 2023-12-16T03:15:57.396 INFO:tasks.workunit.client.0.smithi064.stdout:2/210: mknod d1/d27/c37 0 2023-12-16T03:15:57.403 INFO:tasks.workunit.client.1.smithi184.stdout:8/533: symlink d2/d4/d10/d11/d77/lae 0 2023-12-16T03:15:57.403 INFO:tasks.workunit.client.0.smithi064.stdout:7/204: creat d7/d3e/d42/f44 x:0 0 0 2023-12-16T03:15:57.403 INFO:tasks.workunit.client.0.smithi064.stdout:7/205: fdatasync d7/d26/d30/f39 0 2023-12-16T03:15:57.404 INFO:tasks.workunit.client.0.smithi064.stdout:8/305: mknod d0/d1d/d48/c67 0 2023-12-16T03:15:57.404 INFO:tasks.workunit.client.0.smithi064.stdout:0/133: mknod d2/d8/da/d11/c26 0 2023-12-16T03:15:57.404 INFO:tasks.workunit.client.0.smithi064.stdout:0/134: write d2/d7/d10/f1a [966426,129966] 0 2023-12-16T03:15:57.404 INFO:tasks.workunit.client.0.smithi064.stdout:6/166: truncate d3/d9/f1c 2770205 0 2023-12-16T03:15:57.404 INFO:tasks.workunit.client.0.smithi064.stdout:6/167: chown d3/l6 42596 1 2023-12-16T03:15:57.404 INFO:tasks.workunit.client.0.smithi064.stdout:6/168: chown d3/c27 525310 1 2023-12-16T03:15:57.405 INFO:tasks.workunit.client.1.smithi184.stdout:9/696: truncate d0/d30/f44 2056519 0 2023-12-16T03:15:57.410 INFO:tasks.workunit.client.0.smithi064.stdout:5/208: link d0/lc d0/d14/d20/l4d 0 2023-12-16T03:15:57.410 INFO:tasks.workunit.client.0.smithi064.stdout:0/135: rmdir d2/d8/da/d11/d1d 0 2023-12-16T03:15:57.411 INFO:tasks.workunit.client.1.smithi184.stdout:5/380: mknod d1/d3/d9/de/d15/d19/d5f/d45/c7d 0 2023-12-16T03:15:57.412 INFO:tasks.workunit.client.0.smithi064.stdout:6/169: unlink d3/f25 0 2023-12-16T03:15:57.413 INFO:tasks.workunit.client.1.smithi184.stdout:3/571: write fd [4189299,6450] 0 2023-12-16T03:15:57.413 INFO:tasks.workunit.client.1.smithi184.stdout:8/534: creat d2/d6a/faf x:0 0 0 2023-12-16T03:15:57.414 INFO:tasks.workunit.client.1.smithi184.stdout:9/697: creat d0/d13/d20/db0/fee x:0 0 0 2023-12-16T03:15:57.415 INFO:tasks.workunit.client.1.smithi184.stdout:5/381: truncate d1/d2a/d31/f73 230987 0 2023-12-16T03:15:57.416 INFO:tasks.workunit.client.0.smithi064.stdout:0/136: link d2/d7/d10/f1a d2/f27 0 2023-12-16T03:15:57.417 INFO:tasks.workunit.client.1.smithi184.stdout:6/560: rename d0/d5/d22/d37/d4d/d87/f8b to d0/d5/d12/fb8 0 2023-12-16T03:15:57.418 INFO:tasks.workunit.client.1.smithi184.stdout:3/572: truncate d12/d18/d68/f6e 2349943 0 2023-12-16T03:15:57.420 INFO:tasks.workunit.client.1.smithi184.stdout:6/561: rmdir d0/d5/d22/d37/d45/d90 39 2023-12-16T03:15:57.421 INFO:tasks.workunit.client.1.smithi184.stdout:8/535: rename d2/d4/l45 to d2/d6a/lb0 0 2023-12-16T03:15:57.421 INFO:tasks.workunit.client.1.smithi184.stdout:8/536: readlink d2/d4/d10/d11/d77/lae 0 2023-12-16T03:15:57.422 INFO:tasks.workunit.client.1.smithi184.stdout:2/360: dwrite d3/d29/d2f/d2e/f12 [0,4194304] 0 2023-12-16T03:15:57.422 INFO:tasks.workunit.client.1.smithi184.stdout:2/361: readlink d3/d29/d2f/l38 0 2023-12-16T03:15:57.423 INFO:tasks.workunit.client.1.smithi184.stdout:3/573: creat d12/d37/d81/fd6 x:0 0 0 2023-12-16T03:15:57.431 INFO:tasks.workunit.client.0.smithi064.stdout:9/173: dwrite d2/dc/f11 [0,4194304] 0 2023-12-16T03:15:57.431 INFO:tasks.workunit.client.0.smithi064.stdout:5/209: dread d0/d7/fa [0,4194304] 0 2023-12-16T03:15:57.431 INFO:tasks.workunit.client.0.smithi064.stdout:5/210: chown d0/d19 19 1 2023-12-16T03:15:57.434 INFO:tasks.workunit.client.1.smithi184.stdout:4/445: dread d1/d11/d1b/d44/f4b [0,4194304] 0 2023-12-16T03:15:57.434 INFO:tasks.workunit.client.1.smithi184.stdout:2/362: mknod d3/c79 0 2023-12-16T03:15:57.435 INFO:tasks.workunit.client.1.smithi184.stdout:2/363: fsync d3/d29/d2f/f45 0 2023-12-16T03:15:57.435 INFO:tasks.workunit.client.1.smithi184.stdout:2/364: stat d3/d29/d2f/l55 0 2023-12-16T03:15:57.435 INFO:tasks.workunit.client.1.smithi184.stdout:3/574: mkdir d12/d18/d1f/d23/d51/dd7 0 2023-12-16T03:15:57.437 INFO:tasks.workunit.client.0.smithi064.stdout:5/211: mkdir d0/d14/d4e 0 2023-12-16T03:15:57.438 INFO:tasks.workunit.client.1.smithi184.stdout:2/365: symlink d3/d13/d28/l7a 0 2023-12-16T03:15:57.438 INFO:tasks.workunit.client.1.smithi184.stdout:8/537: dread d2/d4/d10/d2a/f5c [0,4194304] 0 2023-12-16T03:15:57.438 INFO:tasks.workunit.client.1.smithi184.stdout:8/538: dread - d2/d12/d21/d30/fa1 zero size 2023-12-16T03:15:57.441 INFO:tasks.workunit.client.1.smithi184.stdout:2/366: mknod d3/d29/d2f/c7b 0 2023-12-16T03:15:57.441 INFO:tasks.workunit.client.1.smithi184.stdout:2/367: stat d3/d9/f3b 0 2023-12-16T03:15:57.441 INFO:tasks.workunit.client.0.smithi064.stdout:1/219: dwrite d3/dd/d23/d41/f4b [0,4194304] 0 2023-12-16T03:15:57.442 INFO:tasks.workunit.client.1.smithi184.stdout:8/539: creat d2/d12/d21/d30/fb1 x:0 0 0 2023-12-16T03:15:57.442 INFO:tasks.workunit.client.1.smithi184.stdout:8/540: read - d2/d6a/faf zero size 2023-12-16T03:15:57.444 INFO:tasks.workunit.client.0.smithi064.stdout:2/211: dwrite d1/d15/d1b/f33 [0,4194304] 0 2023-12-16T03:15:57.445 INFO:tasks.workunit.client.1.smithi184.stdout:8/541: truncate d2/d12/d21/d2d/d31/f68 1478859 0 2023-12-16T03:15:57.445 INFO:tasks.workunit.client.1.smithi184.stdout:8/542: dread - d2/d12/d21/d2d/d31/f8f zero size 2023-12-16T03:15:57.445 INFO:tasks.workunit.client.1.smithi184.stdout:2/368: dread d3/f50 [0,4194304] 0 2023-12-16T03:15:57.445 INFO:tasks.workunit.client.1.smithi184.stdout:7/415: dwrite d0/df/d32/d39/f48 [0,4194304] 0 2023-12-16T03:15:57.447 INFO:tasks.workunit.client.0.smithi064.stdout:7/206: dwrite d7/d13/d20/f28 [4194304,4194304] 0 2023-12-16T03:15:57.447 INFO:tasks.workunit.client.0.smithi064.stdout:3/267: dwrite db/d12/d21/f33 [0,4194304] 0 2023-12-16T03:15:57.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/543: creat d2/d12/d21/d8a/fb2 x:0 0 0 2023-12-16T03:15:57.448 INFO:tasks.workunit.client.1.smithi184.stdout:2/369: link d3/d29/d2f/d46/c5f d3/d29/d2f/d2e/c7c 0 2023-12-16T03:15:57.455 INFO:tasks.workunit.client.0.smithi064.stdout:9/174: dread d2/dc/f1f [0,4194304] 0 2023-12-16T03:15:57.456 INFO:tasks.workunit.client.0.smithi064.stdout:0/137: write d2/f27 [415656,8774] 0 2023-12-16T03:15:57.458 INFO:tasks.workunit.client.0.smithi064.stdout:1/220: dread d3/dd/f1a [0,4194304] 0 2023-12-16T03:15:57.458 INFO:tasks.workunit.client.0.smithi064.stdout:7/207: mkdir d7/d13/d20/d37/d45 0 2023-12-16T03:15:57.459 INFO:tasks.workunit.client.0.smithi064.stdout:2/212: mknod d1/d15/d1e/c38 0 2023-12-16T03:15:57.461 INFO:tasks.workunit.client.1.smithi184.stdout:7/416: creat d0/df/d32/d39/f73 x:0 0 0 2023-12-16T03:15:57.461 INFO:tasks.workunit.client.1.smithi184.stdout:7/417: write d0/df/d32/d39/f73 [186102,32926] 0 2023-12-16T03:15:57.468 INFO:tasks.workunit.client.0.smithi064.stdout:7/208: rmdir d7/d13 39 2023-12-16T03:15:57.468 INFO:tasks.workunit.client.0.smithi064.stdout:7/209: dread - d7/d3e/d42/f44 zero size 2023-12-16T03:15:57.468 INFO:tasks.workunit.client.0.smithi064.stdout:7/210: readlink d7/d13/l2c 0 2023-12-16T03:15:57.474 INFO:tasks.workunit.client.0.smithi064.stdout:7/211: mkdir d7/d3e/d42/d43/d46 0 2023-12-16T03:15:57.474 INFO:tasks.workunit.client.0.smithi064.stdout:7/212: write d7/f9 [1699527,29010] 0 2023-12-16T03:15:57.476 INFO:tasks.workunit.client.1.smithi184.stdout:7/418: write d0/d3/f7 [2318008,4803] 0 2023-12-16T03:15:57.480 INFO:tasks.workunit.client.0.smithi064.stdout:5/212: dread d0/d14/d20/f2f [0,4194304] 0 2023-12-16T03:15:57.487 INFO:tasks.workunit.client.0.smithi064.stdout:4/227: dwrite d0/da/f16 [0,4194304] 0 2023-12-16T03:15:57.487 INFO:tasks.workunit.client.0.smithi064.stdout:4/228: chown d0/d12/c23 19 1 2023-12-16T03:15:57.488 INFO:tasks.workunit.client.0.smithi064.stdout:4/229: chown d0/d1e/l28 42866314 1 2023-12-16T03:15:57.489 INFO:tasks.workunit.client.1.smithi184.stdout:6/562: dwrite d0/d36/f55 [4194304,4194304] 0 2023-12-16T03:15:57.490 INFO:tasks.workunit.client.1.smithi184.stdout:6/563: truncate d0/d5/d22/d25/f2b 5269707 0 2023-12-16T03:15:57.490 INFO:tasks.workunit.client.1.smithi184.stdout:6/564: readlink d0/d5/l10 0 2023-12-16T03:15:57.490 INFO:tasks.workunit.client.1.smithi184.stdout:7/419: write d0/df/d36/f4e [2323431,32229] 0 2023-12-16T03:15:57.491 INFO:tasks.workunit.client.1.smithi184.stdout:6/565: creat d0/d5/d12/fb9 x:0 0 0 2023-12-16T03:15:57.492 INFO:tasks.workunit.client.1.smithi184.stdout:6/566: symlink d0/d5/d12/d1b/lba 0 2023-12-16T03:15:57.492 INFO:tasks.workunit.client.1.smithi184.stdout:6/567: write d0/d5/d22/d37/d45/fb5 [680991,117383] 0 2023-12-16T03:15:57.492 INFO:tasks.workunit.client.1.smithi184.stdout:6/568: readlink d0/d5/d22/d25/d47/l76 0 2023-12-16T03:15:57.495 INFO:tasks.workunit.client.1.smithi184.stdout:6/569: rename d0/d5/d12/d1b/d33/c3e to d0/d5/d12/d1b/cbb 0 2023-12-16T03:15:57.496 INFO:tasks.workunit.client.0.smithi064.stdout:4/230: symlink d0/d1e/d36/l43 0 2023-12-16T03:15:57.498 INFO:tasks.workunit.client.0.smithi064.stdout:4/231: getdents d0/da 0 2023-12-16T03:15:57.498 INFO:tasks.workunit.client.0.smithi064.stdout:7/213: dread d7/f3b [0,4194304] 0 2023-12-16T03:15:57.498 INFO:tasks.workunit.client.0.smithi064.stdout:7/214: chown d7/d13/l2c 401323855 1 2023-12-16T03:15:57.498 INFO:tasks.workunit.client.0.smithi064.stdout:4/232: write d0/d12/f2a [1673958,109157] 0 2023-12-16T03:15:57.499 INFO:tasks.workunit.client.0.smithi064.stdout:7/215: rmdir d7/d13/d20 39 2023-12-16T03:15:57.503 INFO:tasks.workunit.client.1.smithi184.stdout:7/420: dread d0/df/d32/d39/f48 [0,4194304] 0 2023-12-16T03:15:57.506 INFO:tasks.workunit.client.0.smithi064.stdout:4/233: dread d0/d14/f26 [0,4194304] 0 2023-12-16T03:15:57.506 INFO:tasks.workunit.client.0.smithi064.stdout:4/234: fsync d0/d14/f26 0 2023-12-16T03:15:57.508 INFO:tasks.workunit.client.0.smithi064.stdout:3/268: dwrite db/d12/f3b [0,4194304] 0 2023-12-16T03:15:57.508 INFO:tasks.workunit.client.1.smithi184.stdout:4/446: dwrite d1/d29/d34/d5c/d76/f32 [0,4194304] 0 2023-12-16T03:15:57.508 INFO:tasks.workunit.client.1.smithi184.stdout:4/447: chown d1/d12/d13/d40/d43/d5e/l85 184508165 1 2023-12-16T03:15:57.511 INFO:tasks.workunit.client.0.smithi064.stdout:3/269: rename db/d12/f48 to db/d12/d1a/d2c/d34/d4c/f63 0 2023-12-16T03:15:57.511 INFO:tasks.workunit.client.1.smithi184.stdout:8/544: dwrite d2/d4/f40 [0,4194304] 0 2023-12-16T03:15:57.512 INFO:tasks.workunit.client.1.smithi184.stdout:7/421: dread d0/df/f2a [0,4194304] 0 2023-12-16T03:15:57.512 INFO:tasks.workunit.client.1.smithi184.stdout:4/448: creat d1/d29/d34/d5c/d76/d42/f92 x:0 0 0 2023-12-16T03:15:57.512 INFO:tasks.workunit.client.1.smithi184.stdout:9/698: dwrite d0/d13/d20/f86 [0,4194304] 0 2023-12-16T03:15:57.513 INFO:tasks.workunit.client.0.smithi064.stdout:9/175: dwrite f1 [0,4194304] 0 2023-12-16T03:15:57.514 INFO:tasks.workunit.client.0.smithi064.stdout:5/213: dread d0/f17 [0,4194304] 0 2023-12-16T03:15:57.517 INFO:tasks.workunit.client.0.smithi064.stdout:1/221: dwrite d3/dd/f3c [0,4194304] 0 2023-12-16T03:15:57.517 INFO:tasks.workunit.client.0.smithi064.stdout:1/222: write d3/dd/f42 [1729274,89486] 0 2023-12-16T03:15:57.521 INFO:tasks.workunit.client.0.smithi064.stdout:1/223: read d3/dd/f3c [3725077,67859] 0 2023-12-16T03:15:57.523 INFO:tasks.workunit.client.0.smithi064.stdout:0/138: truncate d2/f27 152177 0 2023-12-16T03:15:57.523 INFO:tasks.workunit.client.0.smithi064.stdout:0/139: dread - d2/d7/f23 zero size 2023-12-16T03:15:57.523 INFO:tasks.workunit.client.0.smithi064.stdout:0/140: stat d2/d7/d10/d21/f24 0 2023-12-16T03:15:57.523 INFO:tasks.workunit.client.1.smithi184.stdout:6/570: dwrite d0/d5/d42/f80 [4194304,4194304] 0 2023-12-16T03:15:57.524 INFO:tasks.workunit.client.1.smithi184.stdout:9/699: creat d0/d13/d20/d5b/d53/fef x:0 0 0 2023-12-16T03:15:57.524 INFO:tasks.workunit.client.1.smithi184.stdout:3/575: dwrite d12/d18/d1f/d23/d2a/d3e/d48/fc7 [0,4194304] 0 2023-12-16T03:15:57.524 INFO:tasks.workunit.client.1.smithi184.stdout:5/382: dwrite d1/d3/d2f/f3b [0,4194304] 0 2023-12-16T03:15:57.525 INFO:tasks.workunit.client.1.smithi184.stdout:8/545: creat d2/d12/d21/d30/d73/fb3 x:0 0 0 2023-12-16T03:15:57.525 INFO:tasks.workunit.client.1.smithi184.stdout:4/449: creat d1/f93 x:0 0 0 2023-12-16T03:15:57.525 INFO:tasks.workunit.client.0.smithi064.stdout:9/176: creat d2/dc/f32 x:0 0 0 2023-12-16T03:15:57.525 INFO:tasks.workunit.client.0.smithi064.stdout:9/177: chown d2/ce 3980 1 2023-12-16T03:15:57.531 INFO:tasks.workunit.client.0.smithi064.stdout:9/178: write d2/dc/ff [3081216,107159] 0 2023-12-16T03:15:57.531 INFO:tasks.workunit.client.0.smithi064.stdout:9/179: write d2/f2e [286893,119924] 0 2023-12-16T03:15:57.531 INFO:tasks.workunit.client.0.smithi064.stdout:9/180: fdatasync d2/dc/f32 0 2023-12-16T03:15:57.531 INFO:tasks.workunit.client.0.smithi064.stdout:5/214: rename d0/d14/d20/d29/d39/c47 to d0/d19/d48/c4f 0 2023-12-16T03:15:57.533 INFO:tasks.workunit.client.0.smithi064.stdout:7/216: dwrite d7/d26/d30/f39 [0,4194304] 0 2023-12-16T03:15:57.534 INFO:tasks.workunit.client.1.smithi184.stdout:5/383: write d1/d2a/d31/f54 [2527598,86363] 0 2023-12-16T03:15:57.534 INFO:tasks.workunit.client.0.smithi064.stdout:4/235: dread d0/f5 [0,4194304] 0 2023-12-16T03:15:57.535 INFO:tasks.workunit.client.1.smithi184.stdout:7/422: dwrite d0/d3/d2e/f3a [0,4194304] 0 2023-12-16T03:15:57.535 INFO:tasks.workunit.client.1.smithi184.stdout:7/423: fdatasync d0/df/d32/d39/f70 0 2023-12-16T03:15:57.536 INFO:tasks.workunit.client.1.smithi184.stdout:6/571: getdents d0/d5/d12/d1b 0 2023-12-16T03:15:57.536 INFO:tasks.workunit.client.1.smithi184.stdout:6/572: fdatasync d0/d5/f4a 0 2023-12-16T03:15:57.536 INFO:tasks.workunit.client.1.smithi184.stdout:9/700: creat d0/d76/da2/dc4/ddb/ff0 x:0 0 0 2023-12-16T03:15:57.536 INFO:tasks.workunit.client.1.smithi184.stdout:9/701: stat d0/c73 0 2023-12-16T03:15:57.536 INFO:tasks.workunit.client.1.smithi184.stdout:9/702: write d0/d3a/d47/fa9 [1078299,16788] 0 2023-12-16T03:15:57.539 INFO:tasks.workunit.client.0.smithi064.stdout:7/217: write d7/d13/d20/f28 [675421,34173] 0 2023-12-16T03:15:57.539 INFO:tasks.workunit.client.0.smithi064.stdout:7/218: chown d7/f3b 1704 1 2023-12-16T03:15:57.545 INFO:tasks.workunit.client.0.smithi064.stdout:4/236: rename d0/d14/l3b to d0/d12/d17/l44 0 2023-12-16T03:15:57.546 INFO:tasks.workunit.client.1.smithi184.stdout:8/546: rmdir d2/d12/d21/d2d 39 2023-12-16T03:15:57.547 INFO:tasks.workunit.client.1.smithi184.stdout:4/450: truncate d1/d11/d5a/f60 120451 0 2023-12-16T03:15:57.547 INFO:tasks.workunit.client.1.smithi184.stdout:5/384: creat d1/f7e x:0 0 0 2023-12-16T03:15:57.547 INFO:tasks.workunit.client.1.smithi184.stdout:4/451: write d1/d29/d34/d5c/d76/f32 [4979741,95083] 0 2023-12-16T03:15:57.547 INFO:tasks.workunit.client.1.smithi184.stdout:7/424: symlink d0/d3/d2e/l74 0 2023-12-16T03:15:57.547 INFO:tasks.workunit.client.0.smithi064.stdout:4/237: rename d0/d12/l20 to d0/d12/l45 0 2023-12-16T03:15:57.547 INFO:tasks.workunit.client.1.smithi184.stdout:4/452: write d1/d11/d1b/d44/f4b [3172380,21710] 0 2023-12-16T03:15:57.548 INFO:tasks.workunit.client.1.smithi184.stdout:9/703: unlink d0/d13/d6e/d84/lc6 0 2023-12-16T03:15:57.550 INFO:tasks.workunit.client.1.smithi184.stdout:8/547: getdents d2 0 2023-12-16T03:15:57.550 INFO:tasks.workunit.client.1.smithi184.stdout:8/548: truncate d2/d6a/da4/f8e 5230988 0 2023-12-16T03:15:57.551 INFO:tasks.workunit.client.1.smithi184.stdout:8/549: chown d2/d6a/f84 44 1 2023-12-16T03:15:57.551 INFO:tasks.workunit.client.0.smithi064.stdout:4/238: read d0/f2 [4187609,61701] 0 2023-12-16T03:15:57.551 INFO:tasks.workunit.client.0.smithi064.stdout:4/239: write d0/d14/d33/f38 [300808,106233] 0 2023-12-16T03:15:57.552 INFO:tasks.workunit.client.1.smithi184.stdout:5/385: rename d1/d3/d9/f2d to d1/d2a/d31/d58/f7f 0 2023-12-16T03:15:57.552 INFO:tasks.workunit.client.1.smithi184.stdout:5/386: write d1/d3/d9/de/d15/d19/d3a/f4b [1506003,69418] 0 2023-12-16T03:15:57.553 INFO:tasks.workunit.client.1.smithi184.stdout:5/387: write d1/d3/d9/de/d30/d68/f76 [2737344,21398] 0 2023-12-16T03:15:57.554 INFO:tasks.workunit.client.1.smithi184.stdout:5/388: readlink d1/d2a/d31/l59 0 2023-12-16T03:15:57.554 INFO:tasks.workunit.client.1.smithi184.stdout:5/389: fdatasync d1/d3/d9/de/d15/d19/d5f/f41 0 2023-12-16T03:15:57.554 INFO:tasks.workunit.client.1.smithi184.stdout:7/425: mkdir d0/df/dd/d75 0 2023-12-16T03:15:57.555 INFO:tasks.workunit.client.1.smithi184.stdout:4/453: rename d1/f7f to d1/d12/d13/f94 0 2023-12-16T03:15:57.557 INFO:tasks.workunit.client.1.smithi184.stdout:8/550: write d2/d4/f44 [2554716,129379] 0 2023-12-16T03:15:57.557 INFO:tasks.workunit.client.1.smithi184.stdout:8/551: fsync d2/fe 0 2023-12-16T03:15:57.557 INFO:tasks.workunit.client.1.smithi184.stdout:8/552: write d2/d4/d10/d11/f3d [4815480,110815] 0 2023-12-16T03:15:57.557 INFO:tasks.workunit.client.1.smithi184.stdout:7/426: creat d0/df/dd/d27/f76 x:0 0 0 2023-12-16T03:15:57.558 INFO:tasks.workunit.client.1.smithi184.stdout:6/573: dread d0/d5/d26/f97 [0,4194304] 0 2023-12-16T03:15:57.559 INFO:tasks.workunit.client.1.smithi184.stdout:6/574: fdatasync d0/d5/d22/d37/d4d/d9c/fa9 0 2023-12-16T03:15:57.559 INFO:tasks.workunit.client.1.smithi184.stdout:6/575: chown d0/d5/f1f 1186400603 1 2023-12-16T03:15:57.561 INFO:tasks.workunit.client.1.smithi184.stdout:7/427: creat d0/f77 x:0 0 0 2023-12-16T03:15:57.563 INFO:tasks.workunit.client.1.smithi184.stdout:6/576: rename d0/d5/d42/da6 to d0/d5/d12/d1b/d33/d3d/da2/dbc 0 2023-12-16T03:15:57.566 INFO:tasks.workunit.client.1.smithi184.stdout:7/428: unlink d0/l1 0 2023-12-16T03:15:57.570 INFO:tasks.workunit.client.1.smithi184.stdout:6/577: getdents d0/d5/d22/d25/d47 0 2023-12-16T03:15:57.571 INFO:tasks.workunit.client.1.smithi184.stdout:6/578: getdents d0/d36/d8a 0 2023-12-16T03:15:57.575 INFO:tasks.workunit.client.0.smithi064.stdout:1/224: dwrite d3/d36/f45 [0,4194304] 0 2023-12-16T03:15:57.577 INFO:tasks.workunit.client.0.smithi064.stdout:5/215: rmdir d0 39 2023-12-16T03:15:57.581 INFO:tasks.workunit.client.0.smithi064.stdout:3/270: dwrite db/f16 [0,4194304] 0 2023-12-16T03:15:57.581 INFO:tasks.workunit.client.0.smithi064.stdout:3/271: write db/d12/f58 [3483517,81075] 0 2023-12-16T03:15:57.582 INFO:tasks.workunit.client.0.smithi064.stdout:5/216: rename d0/d14/d20/d29 to d0/d50 0 2023-12-16T03:15:57.582 INFO:tasks.workunit.client.0.smithi064.stdout:5/217: truncate d0/d14/d20/f2f 4350980 0 2023-12-16T03:15:57.582 INFO:tasks.workunit.client.0.smithi064.stdout:5/218: chown d0/d14/c24 3565325 1 2023-12-16T03:15:57.582 INFO:tasks.workunit.client.0.smithi064.stdout:5/219: readlink d0/l2b 0 2023-12-16T03:15:57.582 INFO:tasks.workunit.client.0.smithi064.stdout:0/141: dwrite d2/d7/f23 [0,4194304] 0 2023-12-16T03:15:57.583 INFO:tasks.workunit.client.1.smithi184.stdout:6/579: dread d0/f18 [0,4194304] 0 2023-12-16T03:15:57.584 INFO:tasks.workunit.client.1.smithi184.stdout:6/580: fdatasync d0/d5/d22/d25/d47/f64 0 2023-12-16T03:15:57.584 INFO:tasks.workunit.client.0.smithi064.stdout:5/220: read d0/d7/f1e [65414,28546] 0 2023-12-16T03:15:57.584 INFO:tasks.workunit.client.0.smithi064.stdout:0/142: mknod d2/d7/c28 0 2023-12-16T03:15:57.585 INFO:tasks.workunit.client.1.smithi184.stdout:3/576: dwrite d12/d1e/f47 [0,4194304] 0 2023-12-16T03:15:57.586 INFO:tasks.workunit.client.1.smithi184.stdout:6/581: truncate d0/d5/d42/f80 2476530 0 2023-12-16T03:15:57.588 INFO:tasks.workunit.client.0.smithi064.stdout:3/272: write db/d12/d21/f49 [548917,124364] 0 2023-12-16T03:15:57.588 INFO:tasks.workunit.client.0.smithi064.stdout:3/273: chown db/d12/d1a/f38 244739 1 2023-12-16T03:15:57.588 INFO:tasks.workunit.client.0.smithi064.stdout:5/221: unlink d0/d50/d39/l3b 0 2023-12-16T03:15:57.588 INFO:tasks.workunit.client.0.smithi064.stdout:3/274: chown db/d12/d1a/c41 692831995 1 2023-12-16T03:15:57.588 INFO:tasks.workunit.client.0.smithi064.stdout:0/143: truncate f1 1297095 0 2023-12-16T03:15:57.589 INFO:tasks.workunit.client.0.smithi064.stdout:3/275: write db/d12/d21/f5c [622602,83331] 0 2023-12-16T03:15:57.589 INFO:tasks.workunit.client.0.smithi064.stdout:3/276: fsync db/d12/d1a/f28 0 2023-12-16T03:15:57.589 INFO:tasks.workunit.client.0.smithi064.stdout:3/277: chown db/d12/d21/l50 328 1 2023-12-16T03:15:57.589 INFO:tasks.workunit.client.0.smithi064.stdout:0/144: write d2/d7/d10/f1f [184640,122733] 0 2023-12-16T03:15:57.589 INFO:tasks.workunit.client.0.smithi064.stdout:0/145: write d2/d7/d10/f1a [1143007,13112] 0 2023-12-16T03:15:57.590 INFO:tasks.workunit.client.0.smithi064.stdout:4/240: dwrite d0/d12/d17/f21 [0,4194304] 0 2023-12-16T03:15:57.590 INFO:tasks.workunit.client.0.smithi064.stdout:5/222: creat d0/d14/d20/d37/f51 x:0 0 0 2023-12-16T03:15:57.590 INFO:tasks.workunit.client.0.smithi064.stdout:3/278: creat db/d12/d1a/d31/f64 x:0 0 0 2023-12-16T03:15:57.590 INFO:tasks.workunit.client.0.smithi064.stdout:3/279: truncate db/d13/f24 4318086 0 2023-12-16T03:15:57.590 INFO:tasks.workunit.client.0.smithi064.stdout:3/280: chown db/d12/d21/c3a 68 1 2023-12-16T03:15:57.591 INFO:tasks.workunit.client.1.smithi184.stdout:6/582: write d0/d5/f2c [1766391,60649] 0 2023-12-16T03:15:57.591 INFO:tasks.workunit.client.1.smithi184.stdout:6/583: write d0/d5/d22/f3c [1268367,48469] 0 2023-12-16T03:15:57.591 INFO:tasks.workunit.client.0.smithi064.stdout:0/146: mkdir d2/d29 0 2023-12-16T03:15:57.591 INFO:tasks.workunit.client.0.smithi064.stdout:5/223: dread d0/de/f36 [0,4194304] 0 2023-12-16T03:15:57.592 INFO:tasks.workunit.client.0.smithi064.stdout:5/224: truncate d0/d7/f2e 1461105 0 2023-12-16T03:15:57.592 INFO:tasks.workunit.client.0.smithi064.stdout:4/241: creat d0/d1e/d36/f46 x:0 0 0 2023-12-16T03:15:57.593 INFO:tasks.workunit.client.0.smithi064.stdout:3/281: creat db/d12/d21/f65 x:0 0 0 2023-12-16T03:15:57.595 INFO:tasks.workunit.client.1.smithi184.stdout:5/390: dwrite d1/d3/d9/d49/f55 [0,4194304] 0 2023-12-16T03:15:57.596 INFO:tasks.workunit.client.1.smithi184.stdout:5/391: mkdir d1/d3/d9/de/d30/d80 0 2023-12-16T03:15:57.596 INFO:tasks.workunit.client.1.smithi184.stdout:5/392: write d1/d3/d9/de/d30/d68/f76 [3065443,7177] 0 2023-12-16T03:15:57.597 INFO:tasks.workunit.client.0.smithi064.stdout:0/147: creat d2/d8/da/d11/f2a x:0 0 0 2023-12-16T03:15:57.597 INFO:tasks.workunit.client.0.smithi064.stdout:5/225: creat d0/d14/d20/d37/d3c/f52 x:0 0 0 2023-12-16T03:15:57.598 INFO:tasks.workunit.client.1.smithi184.stdout:5/393: unlink d1/d3/d9/de/f16 0 2023-12-16T03:15:57.598 INFO:tasks.workunit.client.1.smithi184.stdout:5/394: read - d1/d3/d9/de/d15/d19/d48/f7c zero size 2023-12-16T03:15:57.598 INFO:tasks.workunit.client.0.smithi064.stdout:4/242: symlink d0/d14/l47 0 2023-12-16T03:15:57.599 INFO:tasks.workunit.client.0.smithi064.stdout:4/243: write d0/f5 [2419906,13525] 0 2023-12-16T03:15:57.600 INFO:tasks.workunit.client.0.smithi064.stdout:4/244: fsync d0/d12/d17/f31 0 2023-12-16T03:15:57.600 INFO:tasks.workunit.client.0.smithi064.stdout:4/245: chown d0/d12/l3e 61239 1 2023-12-16T03:15:57.600 INFO:tasks.workunit.client.0.smithi064.stdout:4/246: fdatasync d0/f8 0 2023-12-16T03:15:57.600 INFO:tasks.workunit.client.1.smithi184.stdout:5/395: creat d1/d3/d9/de/d15/d27/f81 x:0 0 0 2023-12-16T03:15:57.601 INFO:tasks.workunit.client.1.smithi184.stdout:5/396: unlink d1/d3/d9/de/d15/d19/d48/f7c 0 2023-12-16T03:15:57.603 INFO:tasks.workunit.client.0.smithi064.stdout:7/219: dread d7/d13/d20/f28 [4194304,4194304] 0 2023-12-16T03:15:57.605 INFO:tasks.workunit.client.0.smithi064.stdout:7/220: creat d7/d3e/f47 x:0 0 0 2023-12-16T03:15:57.613 INFO:tasks.workunit.client.0.smithi064.stdout:5/226: dread d0/f15 [0,4194304] 0 2023-12-16T03:15:57.615 INFO:tasks.workunit.client.1.smithi184.stdout:9/704: dwrite d0/d13/f87 [0,4194304] 0 2023-12-16T03:15:57.615 INFO:tasks.workunit.client.0.smithi064.stdout:5/227: creat d0/d14/d4e/f53 x:0 0 0 2023-12-16T03:15:57.617 INFO:tasks.workunit.client.0.smithi064.stdout:4/247: dread d0/d12/d17/f1d [0,4194304] 0 2023-12-16T03:15:57.617 INFO:tasks.workunit.client.1.smithi184.stdout:9/705: creat d0/d76/da2/dc4/dd0/ff1 x:0 0 0 2023-12-16T03:15:57.619 INFO:tasks.workunit.client.1.smithi184.stdout:9/706: creat d0/d13/d20/d5b/d43/dc7/ddc/ff2 x:0 0 0 2023-12-16T03:15:57.619 INFO:tasks.workunit.client.0.smithi064.stdout:7/221: dread d7/f9 [0,4194304] 0 2023-12-16T03:15:57.620 INFO:tasks.workunit.client.1.smithi184.stdout:9/707: stat d0/d13/d20/c27 0 2023-12-16T03:15:57.620 INFO:tasks.workunit.client.1.smithi184.stdout:9/708: fdatasync d0/d3a/d47/fbc 0 2023-12-16T03:15:57.620 INFO:tasks.workunit.client.1.smithi184.stdout:9/709: fdatasync d0/d13/f21 0 2023-12-16T03:15:57.621 INFO:tasks.workunit.client.1.smithi184.stdout:9/710: creat d0/d13/d20/d5b/d43/dc7/ddc/ff3 x:0 0 0 2023-12-16T03:15:57.622 INFO:tasks.workunit.client.0.smithi064.stdout:7/222: rmdir d7/d13/d20/d37/d45 0 2023-12-16T03:15:57.623 INFO:tasks.workunit.client.1.smithi184.stdout:9/711: mkdir d0/d76/da2/df4 0 2023-12-16T03:15:57.623 INFO:tasks.workunit.client.1.smithi184.stdout:9/712: write d0/d3a/fc8 [309403,46149] 0 2023-12-16T03:15:57.623 INFO:tasks.workunit.client.1.smithi184.stdout:8/553: dwrite d2/d4/d10/d11/d72/f8d [0,4194304] 0 2023-12-16T03:15:57.624 INFO:tasks.workunit.client.0.smithi064.stdout:7/223: getdents d7/d1c 0 2023-12-16T03:15:57.624 INFO:tasks.workunit.client.0.smithi064.stdout:5/228: write d0/de/d23/f3f [558119,17495] 0 2023-12-16T03:15:57.626 INFO:tasks.workunit.client.1.smithi184.stdout:9/713: rename d0/d13/d20/d5b/d53/f6d to d0/d13/d20/d5b/d43/dc7/ddc/dd8/ff5 0 2023-12-16T03:15:57.628 INFO:tasks.workunit.client.0.smithi064.stdout:5/229: creat d0/d14/d25/d3e/d35/f54 x:0 0 0 2023-12-16T03:15:57.630 INFO:tasks.workunit.client.1.smithi184.stdout:8/554: mkdir d2/d12/db4 0 2023-12-16T03:15:57.632 INFO:tasks.workunit.client.1.smithi184.stdout:6/584: dwrite d0/d5/d26/f75 [0,4194304] 0 2023-12-16T03:15:57.633 INFO:tasks.workunit.client.1.smithi184.stdout:5/397: dwrite d1/f1a [0,4194304] 0 2023-12-16T03:15:57.633 INFO:tasks.workunit.client.0.smithi064.stdout:1/225: dwrite d3/d22/f2e [0,4194304] 0 2023-12-16T03:15:57.633 INFO:tasks.workunit.client.0.smithi064.stdout:1/226: write d3/d37/f3f [768265,7415] 0 2023-12-16T03:15:57.633 INFO:tasks.workunit.client.0.smithi064.stdout:1/227: readlink d3/dd/d11/l15 0 2023-12-16T03:15:57.634 INFO:tasks.workunit.client.1.smithi184.stdout:9/714: creat d0/ff6 x:0 0 0 2023-12-16T03:15:57.634 INFO:tasks.workunit.client.0.smithi064.stdout:9/181: dwrite d2/dc/ff [0,4194304] 0 2023-12-16T03:15:57.636 INFO:tasks.workunit.client.1.smithi184.stdout:5/398: write d1/d2a/d31/f54 [3137734,90415] 0 2023-12-16T03:15:57.637 INFO:tasks.workunit.client.0.smithi064.stdout:1/228: creat d3/dd/d11/d2f/f4c x:0 0 0 2023-12-16T03:15:57.644 INFO:tasks.workunit.client.0.smithi064.stdout:1/229: write d3/dd/d11/f1f [827109,115446] 0 2023-12-16T03:15:57.647 INFO:tasks.workunit.client.0.smithi064.stdout:9/182: truncate d2/f1d 79531 0 2023-12-16T03:15:57.647 INFO:tasks.workunit.client.0.smithi064.stdout:4/248: dwrite d0/f2e [0,4194304] 0 2023-12-16T03:15:57.648 INFO:tasks.workunit.client.1.smithi184.stdout:6/585: mknod d0/d5/d22/d37/d45/d90/cbd 0 2023-12-16T03:15:57.648 INFO:tasks.workunit.client.1.smithi184.stdout:7/429: truncate d0/d3/d2e/f3a 524280 0 2023-12-16T03:15:57.652 INFO:tasks.workunit.client.1.smithi184.stdout:9/715: mkdir d0/d30/ddf/df7 0 2023-12-16T03:15:57.652 INFO:tasks.workunit.client.1.smithi184.stdout:6/586: mkdir d0/d5/d12/d1b/d33/d3d/da2/dbc/daa/dbe 0 2023-12-16T03:15:57.653 INFO:tasks.workunit.client.1.smithi184.stdout:9/716: dread d0/d13/d20/d5b/fed [0,4194304] 0 2023-12-16T03:15:57.654 INFO:tasks.workunit.client.1.smithi184.stdout:7/430: creat d0/d6b/f78 x:0 0 0 2023-12-16T03:15:57.654 INFO:tasks.workunit.client.1.smithi184.stdout:9/717: dread d0/d3a/f59 [0,4194304] 0 2023-12-16T03:15:57.657 INFO:tasks.workunit.client.1.smithi184.stdout:9/718: write d0/d13/d20/d5b/d43/dc7/ddc/dd8/ff5 [120620,60595] 0 2023-12-16T03:15:57.657 INFO:tasks.workunit.client.0.smithi064.stdout:1/230: rename d3/d37 to d3/d36/d44/d4d 0 2023-12-16T03:15:57.657 INFO:tasks.workunit.client.0.smithi064.stdout:1/231: readlink d3/dd/d11/l15 0 2023-12-16T03:15:57.657 INFO:tasks.workunit.client.0.smithi064.stdout:9/183: rmdir d2/dc 39 2023-12-16T03:15:57.660 INFO:tasks.workunit.client.0.smithi064.stdout:4/249: mkdir d0/d12/d48 0 2023-12-16T03:15:57.660 INFO:tasks.workunit.client.0.smithi064.stdout:4/250: write d0/d1e/f37 [250519,128559] 0 2023-12-16T03:15:57.660 INFO:tasks.workunit.client.0.smithi064.stdout:4/251: chown d0/d1e/f27 644508719 1 2023-12-16T03:15:57.661 INFO:tasks.workunit.client.0.smithi064.stdout:1/232: creat d3/d36/d44/d4d/f4e x:0 0 0 2023-12-16T03:15:57.661 INFO:tasks.workunit.client.0.smithi064.stdout:1/233: truncate d3/d36/d44/d4d/f4e 978511 0 2023-12-16T03:15:57.661 INFO:tasks.workunit.client.0.smithi064.stdout:1/234: chown d3/dd/d23/c29 15 1 2023-12-16T03:15:57.661 INFO:tasks.workunit.client.0.smithi064.stdout:1/235: write d3/dd/d11/f34 [494732,41487] 0 2023-12-16T03:15:57.661 INFO:tasks.workunit.client.0.smithi064.stdout:1/236: chown d3/f26 1148345 1 2023-12-16T03:15:57.661 INFO:tasks.workunit.client.0.smithi064.stdout:1/237: mkdir d3/dd/d23/d4f 0 2023-12-16T03:15:57.662 INFO:tasks.workunit.client.1.smithi184.stdout:9/719: rename d0/d13/d20/db0/fee to d0/d13/d20/d5b/d53/d98/ff8 0 2023-12-16T03:15:57.667 INFO:tasks.workunit.client.0.smithi064.stdout:3/282: dwrite db/d12/f58 [0,4194304] 0 2023-12-16T03:15:57.667 INFO:tasks.workunit.client.1.smithi184.stdout:7/431: rename d0/df to d0/d3/d2e/d79 0 2023-12-16T03:15:57.668 INFO:tasks.workunit.client.0.smithi064.stdout:3/283: creat db/d13/d39/f66 x:0 0 0 2023-12-16T03:15:57.669 INFO:tasks.workunit.client.1.smithi184.stdout:9/720: truncate d0/d3a/d47/fd7 3433859 0 2023-12-16T03:15:57.671 INFO:tasks.workunit.client.1.smithi184.stdout:7/432: link d0/d3/d2e/l74 d0/l7a 0 2023-12-16T03:15:57.671 INFO:tasks.workunit.client.0.smithi064.stdout:7/224: dwrite d7/f14 [0,4194304] 0 2023-12-16T03:15:57.671 INFO:tasks.workunit.client.0.smithi064.stdout:5/230: dwrite d0/d7/f2e [0,4194304] 0 2023-12-16T03:15:57.672 INFO:tasks.workunit.client.1.smithi184.stdout:9/721: symlink d0/d13/d20/db0/lf9 0 2023-12-16T03:15:57.672 INFO:tasks.workunit.client.1.smithi184.stdout:6/587: dread d0/d5/d22/f3c [0,4194304] 0 2023-12-16T03:15:57.672 INFO:tasks.workunit.client.1.smithi184.stdout:8/555: dwrite d2/f13 [0,4194304] 0 2023-12-16T03:15:57.673 INFO:tasks.workunit.client.0.smithi064.stdout:3/284: rename db/d12/f46 to db/f67 0 2023-12-16T03:15:57.673 INFO:tasks.workunit.client.0.smithi064.stdout:3/285: fsync db/d12/d1a/d2c/f44 0 2023-12-16T03:15:57.673 INFO:tasks.workunit.client.0.smithi064.stdout:9/184: dread d2/d2d/d31/f20 [0,4194304] 0 2023-12-16T03:15:57.673 INFO:tasks.workunit.client.0.smithi064.stdout:0/148: dwrite d2/d7/d10/f1a [0,4194304] 0 2023-12-16T03:15:57.673 INFO:tasks.workunit.client.0.smithi064.stdout:0/149: stat d2/d8/da/df 0 2023-12-16T03:15:57.677 INFO:tasks.workunit.client.0.smithi064.stdout:7/225: rmdir d7/d13 39 2023-12-16T03:15:57.680 INFO:tasks.workunit.client.1.smithi184.stdout:9/722: rmdir d0/d76 39 2023-12-16T03:15:57.680 INFO:tasks.workunit.client.1.smithi184.stdout:9/723: write d0/d76/da2/dc4/ddb/ff0 [150746,98942] 0 2023-12-16T03:15:57.682 INFO:tasks.workunit.client.0.smithi064.stdout:3/286: chown db/d12/d1a/f54 31 1 2023-12-16T03:15:57.683 INFO:tasks.workunit.client.1.smithi184.stdout:6/588: unlink d0/d5/d12/d1b/fae 0 2023-12-16T03:15:57.684 INFO:tasks.workunit.client.0.smithi064.stdout:9/185: truncate d2/dc/f15 1535712 0 2023-12-16T03:15:57.686 INFO:tasks.workunit.client.0.smithi064.stdout:4/252: dwrite d0/d14/f30 [0,4194304] 0 2023-12-16T03:15:57.686 INFO:tasks.workunit.client.1.smithi184.stdout:8/556: rmdir d2/d12/d21/d30/d73 39 2023-12-16T03:15:57.687 INFO:tasks.workunit.client.1.smithi184.stdout:8/557: chown d2/d4/d10/l56 9055817 1 2023-12-16T03:15:57.687 INFO:tasks.workunit.client.0.smithi064.stdout:7/226: mkdir d7/d3e/d42/d48 0 2023-12-16T03:15:57.687 INFO:tasks.workunit.client.0.smithi064.stdout:7/227: dread - d7/d3e/f47 zero size 2023-12-16T03:15:57.687 INFO:tasks.workunit.client.0.smithi064.stdout:7/228: dread - d7/d3e/d42/f44 zero size 2023-12-16T03:15:57.688 INFO:tasks.workunit.client.0.smithi064.stdout:3/287: chown ca 50 1 2023-12-16T03:15:57.688 INFO:tasks.workunit.client.0.smithi064.stdout:3/288: readlink l7 0 2023-12-16T03:15:57.688 INFO:tasks.workunit.client.1.smithi184.stdout:9/724: creat d0/d13/d20/d5b/ffa x:0 0 0 2023-12-16T03:15:57.690 INFO:tasks.workunit.client.0.smithi064.stdout:0/150: rename d2/d8/da/d11/f2a to d2/d7/f2b 0 2023-12-16T03:15:57.690 INFO:tasks.workunit.client.1.smithi184.stdout:8/558: mkdir d2/d4/d10/d99/db5 0 2023-12-16T03:15:57.691 INFO:tasks.workunit.client.1.smithi184.stdout:7/433: dwrite d0/d3/f11 [0,4194304] 0 2023-12-16T03:15:57.692 INFO:tasks.workunit.client.0.smithi064.stdout:3/289: dread db/d12/d1a/d2c/f44 [0,4194304] 0 2023-12-16T03:15:57.692 INFO:tasks.workunit.client.0.smithi064.stdout:3/290: chown db/c20 724 1 2023-12-16T03:15:57.692 INFO:tasks.workunit.client.1.smithi184.stdout:9/725: link d0/d13/d6e/fe8 d0/d76/dbf/ffb 0 2023-12-16T03:15:57.693 INFO:tasks.workunit.client.0.smithi064.stdout:4/253: symlink d0/d14/l49 0 2023-12-16T03:15:57.694 INFO:tasks.workunit.client.1.smithi184.stdout:8/559: readlink d2/d4/l1f 0 2023-12-16T03:15:57.694 INFO:tasks.workunit.client.1.smithi184.stdout:8/560: chown d2/d4/d10/d11/d72/f8d 0 1 2023-12-16T03:15:57.695 INFO:tasks.workunit.client.0.smithi064.stdout:7/229: creat d7/d3e/d42/d48/f49 x:0 0 0 2023-12-16T03:15:57.695 INFO:tasks.workunit.client.0.smithi064.stdout:1/238: getdents d3/dd/d11/d2f 0 2023-12-16T03:15:57.696 INFO:tasks.workunit.client.1.smithi184.stdout:8/561: write d2/d12/d21/f8c [585036,24916] 0 2023-12-16T03:15:57.697 INFO:tasks.workunit.client.1.smithi184.stdout:8/562: write d2/d4/d10/d11/fac [1034756,70093] 0 2023-12-16T03:15:57.697 INFO:tasks.workunit.client.1.smithi184.stdout:8/563: dread - d2/d4/d10/d11/f6f zero size 2023-12-16T03:15:57.697 INFO:tasks.workunit.client.1.smithi184.stdout:7/434: symlink d0/d3/d2e/d79/d34/l7b 0 2023-12-16T03:15:57.698 INFO:tasks.workunit.client.1.smithi184.stdout:9/726: mknod d0/d76/da2/dc4/cfc 0 2023-12-16T03:15:57.698 INFO:tasks.workunit.client.0.smithi064.stdout:0/151: creat d2/d29/f2c x:0 0 0 2023-12-16T03:15:57.698 INFO:tasks.workunit.client.0.smithi064.stdout:0/152: dread - d2/d7/d10/d21/f24 zero size 2023-12-16T03:15:57.698 INFO:tasks.workunit.client.0.smithi064.stdout:0/153: chown d2/d8/l22 1916166 1 2023-12-16T03:15:57.701 INFO:tasks.workunit.client.1.smithi184.stdout:2/370: sync 2023-12-16T03:15:57.701 INFO:tasks.workunit.client.1.smithi184.stdout:2/371: fsync d3/d29/d2f/d2e/f5d 0 2023-12-16T03:15:57.701 INFO:tasks.workunit.client.1.smithi184.stdout:1/520: sync 2023-12-16T03:15:57.702 INFO:tasks.workunit.client.1.smithi184.stdout:0/588: sync 2023-12-16T03:15:57.702 INFO:tasks.workunit.client.1.smithi184.stdout:0/589: readlink dc/d22/d1d/d43/d5a/d60/lc8 0 2023-12-16T03:15:57.702 INFO:tasks.workunit.client.1.smithi184.stdout:8/564: symlink d2/d4/d10/d11/d77/lb6 0 2023-12-16T03:15:57.704 INFO:tasks.workunit.client.1.smithi184.stdout:9/727: creat d0/d30/ddf/df7/ffd x:0 0 0 2023-12-16T03:15:57.704 INFO:tasks.workunit.client.1.smithi184.stdout:2/372: creat d3/d9/d19/f7d x:0 0 0 2023-12-16T03:15:57.704 INFO:tasks.workunit.client.1.smithi184.stdout:1/521: write d3/d28/d3c/d41/f4d [5116348,77973] 0 2023-12-16T03:15:57.704 INFO:tasks.workunit.client.1.smithi184.stdout:7/435: mknod d0/d3/d2e/d79/d1e/c7c 0 2023-12-16T03:15:57.705 INFO:tasks.workunit.client.0.smithi064.stdout:7/230: mkdir d7/d13/d20/d4a 0 2023-12-16T03:15:57.705 INFO:tasks.workunit.client.1.smithi184.stdout:6/589: rename d0/d5/d12/d1b/d33/d3d/da2/dbc/daa to d0/d5/d22/d25/dbf 0 2023-12-16T03:15:57.705 INFO:tasks.workunit.client.1.smithi184.stdout:6/590: write d0/d5/d12/d1b/d33/f7e [105951,48401] 0 2023-12-16T03:15:57.705 INFO:tasks.workunit.client.1.smithi184.stdout:6/591: write d0/d5/d42/fad [747304,18258] 0 2023-12-16T03:15:57.707 INFO:tasks.workunit.client.1.smithi184.stdout:8/565: dread d2/d12/f38 [0,4194304] 0 2023-12-16T03:15:57.707 INFO:tasks.workunit.client.1.smithi184.stdout:9/728: mknod d0/d76/da2/dc4/cfe 0 2023-12-16T03:15:57.709 INFO:tasks.workunit.client.0.smithi064.stdout:4/254: truncate d0/f2e 824155 0 2023-12-16T03:15:57.710 INFO:tasks.workunit.client.1.smithi184.stdout:2/373: creat d3/d29/d2f/d46/f7e x:0 0 0 2023-12-16T03:15:57.711 INFO:tasks.workunit.client.0.smithi064.stdout:4/255: unlink d0/d1e/f27 0 2023-12-16T03:15:57.713 INFO:tasks.workunit.client.0.smithi064.stdout:7/231: dread d7/d26/d30/f39 [0,4194304] 0 2023-12-16T03:15:57.713 INFO:tasks.workunit.client.0.smithi064.stdout:0/154: dread d2/d7/d10/f14 [0,4194304] 0 2023-12-16T03:15:57.713 INFO:tasks.workunit.client.0.smithi064.stdout:7/232: chown d7/d26/d30/f33 702857 1 2023-12-16T03:15:57.713 INFO:tasks.workunit.client.0.smithi064.stdout:7/233: getdents d7/d26 0 2023-12-16T03:15:57.714 INFO:tasks.workunit.client.1.smithi184.stdout:1/522: truncate d3/d28/d3c/d41/d46/d4a/f50 1400914 0 2023-12-16T03:15:57.714 INFO:tasks.workunit.client.1.smithi184.stdout:1/523: chown d3/d28/d3c/d41/f62 284274 1 2023-12-16T03:15:57.715 INFO:tasks.workunit.client.0.smithi064.stdout:0/155: creat d2/d8/f2d x:0 0 0 2023-12-16T03:15:57.716 INFO:tasks.workunit.client.1.smithi184.stdout:9/729: write d0/d13/d20/d5b/f56 [2669831,114136] 0 2023-12-16T03:15:57.716 INFO:tasks.workunit.client.1.smithi184.stdout:9/730: truncate d0/d76/da2/dc4/dd0/ff1 845383 0 2023-12-16T03:15:57.716 INFO:tasks.workunit.client.0.smithi064.stdout:9/186: dread d2/f1d [0,4194304] 0 2023-12-16T03:15:57.716 INFO:tasks.workunit.client.0.smithi064.stdout:9/187: stat d2/f2e 0 2023-12-16T03:15:57.717 INFO:tasks.workunit.client.1.smithi184.stdout:6/592: mknod d0/d5/d22/d25/dbf/cc0 0 2023-12-16T03:15:57.719 INFO:tasks.workunit.client.1.smithi184.stdout:6/593: fdatasync d0/d5/d26/f38 0 2023-12-16T03:15:57.719 INFO:tasks.workunit.client.0.smithi064.stdout:7/234: mknod d7/d3e/d42/d43/d46/c4b 0 2023-12-16T03:15:57.720 INFO:tasks.workunit.client.1.smithi184.stdout:2/374: creat d3/d29/d2f/d46/d77/f7f x:0 0 0 2023-12-16T03:15:57.721 INFO:tasks.workunit.client.1.smithi184.stdout:7/436: truncate d0/d3/f5 6622562 0 2023-12-16T03:15:57.721 INFO:tasks.workunit.client.1.smithi184.stdout:1/524: rmdir d3/d28/d38/d52 39 2023-12-16T03:15:57.724 INFO:tasks.workunit.client.0.smithi064.stdout:0/156: mknod d2/d8/c2e 0 2023-12-16T03:15:57.724 INFO:tasks.workunit.client.0.smithi064.stdout:3/291: dwrite db/d12/d1a/d31/f47 [0,4194304] 0 2023-12-16T03:15:57.725 INFO:tasks.workunit.client.1.smithi184.stdout:9/731: rename d0/d13/d20/f29 to d0/d76/da2/dc4/dd0/fff 0 2023-12-16T03:15:57.726 INFO:tasks.workunit.client.0.smithi064.stdout:3/292: write db/d12/f18 [1219894,63866] 0 2023-12-16T03:15:57.727 INFO:tasks.workunit.client.0.smithi064.stdout:4/256: dread d0/d14/d33/f38 [0,4194304] 0 2023-12-16T03:15:57.728 INFO:tasks.workunit.client.1.smithi184.stdout:9/732: mkdir d0/d76/db7/d100 0 2023-12-16T03:15:57.729 INFO:tasks.workunit.client.0.smithi064.stdout:7/235: mknod d7/d3e/d42/c4c 0 2023-12-16T03:15:57.729 INFO:tasks.workunit.client.0.smithi064.stdout:7/236: chown d7/c15 195329 1 2023-12-16T03:15:57.730 INFO:tasks.workunit.client.1.smithi184.stdout:7/437: rename d0/d3/d2e/d79/d36/c40 to d0/d3/d2e/d79/dd/c7d 0 2023-12-16T03:15:57.730 INFO:tasks.workunit.client.1.smithi184.stdout:1/525: mknod d3/d13/d2c/cae 0 2023-12-16T03:15:57.730 INFO:tasks.workunit.client.0.smithi064.stdout:0/157: creat d2/d29/f2f x:0 0 0 2023-12-16T03:15:57.731 INFO:tasks.workunit.client.1.smithi184.stdout:9/733: symlink d0/d30/ddf/df7/l101 0 2023-12-16T03:15:57.733 INFO:tasks.workunit.client.0.smithi064.stdout:4/257: mknod d0/d12/d48/c4a 0 2023-12-16T03:15:57.733 INFO:tasks.workunit.client.0.smithi064.stdout:2/213: sync 2023-12-16T03:15:57.733 INFO:tasks.workunit.client.0.smithi064.stdout:6/170: sync 2023-12-16T03:15:57.733 INFO:tasks.workunit.client.0.smithi064.stdout:8/306: sync 2023-12-16T03:15:57.733 INFO:tasks.workunit.client.1.smithi184.stdout:9/734: rmdir d0/d76 39 2023-12-16T03:15:57.736 INFO:tasks.workunit.client.1.smithi184.stdout:9/735: symlink d0/d30/ddf/l102 0 2023-12-16T03:15:57.736 INFO:tasks.workunit.client.1.smithi184.stdout:7/438: mkdir d0/d3/d7e 0 2023-12-16T03:15:57.736 INFO:tasks.workunit.client.1.smithi184.stdout:7/439: fsync d0/d3/d2e/f3a 0 2023-12-16T03:15:57.740 INFO:tasks.workunit.client.0.smithi064.stdout:4/258: symlink d0/d42/l4b 0 2023-12-16T03:15:57.740 INFO:tasks.workunit.client.0.smithi064.stdout:6/171: rename d3/d9/f17 to d3/d8/d13/f2c 0 2023-12-16T03:15:57.741 INFO:tasks.workunit.client.0.smithi064.stdout:2/214: dread d1/d15/d1b/f33 [0,4194304] 0 2023-12-16T03:15:57.741 INFO:tasks.workunit.client.0.smithi064.stdout:2/215: fdatasync d1/d15/f1a 0 2023-12-16T03:15:57.742 INFO:tasks.workunit.client.0.smithi064.stdout:8/307: mkdir d0/db/d12/d44/d68 0 2023-12-16T03:15:57.742 INFO:tasks.workunit.client.1.smithi184.stdout:9/736: write d0/d13/f2a [826243,30325] 0 2023-12-16T03:15:57.744 INFO:tasks.workunit.client.0.smithi064.stdout:4/259: mkdir d0/d42/d4c 0 2023-12-16T03:15:57.744 INFO:tasks.workunit.client.0.smithi064.stdout:4/260: write d0/d12/f2a [2602868,86591] 0 2023-12-16T03:15:57.750 INFO:tasks.workunit.client.0.smithi064.stdout:8/308: creat d0/da/d3e/f69 x:0 0 0 2023-12-16T03:15:57.751 INFO:tasks.workunit.client.0.smithi064.stdout:8/309: mkdir d0/db/d12/d1c/d6a 0 2023-12-16T03:15:57.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/239: dwrite d3/d36/d44/d4d/f4e [0,4194304] 0 2023-12-16T03:15:57.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/240: truncate d3/d22/f32 422466 0 2023-12-16T03:15:57.753 INFO:tasks.workunit.client.0.smithi064.stdout:2/216: link d1/c13 d1/c39 0 2023-12-16T03:15:57.754 INFO:tasks.workunit.client.0.smithi064.stdout:8/310: mknod d0/d1d/d3c/c6b 0 2023-12-16T03:15:57.754 INFO:tasks.workunit.client.0.smithi064.stdout:8/311: write d0/db/f62 [1320275,60901] 0 2023-12-16T03:15:57.756 INFO:tasks.workunit.client.0.smithi064.stdout:1/241: mknod d3/d36/c50 0 2023-12-16T03:15:57.757 INFO:tasks.workunit.client.0.smithi064.stdout:2/217: creat d1/f3a x:0 0 0 2023-12-16T03:15:57.759 INFO:tasks.workunit.client.1.smithi184.stdout:9/737: dread d0/d13/f24 [0,4194304] 0 2023-12-16T03:15:57.760 INFO:tasks.workunit.client.0.smithi064.stdout:2/218: mkdir d1/d27/d3b 0 2023-12-16T03:15:57.760 INFO:tasks.workunit.client.0.smithi064.stdout:8/312: rename d0/d1d/d24/d2f/c4e to d0/da/d3e/d46/c6c 0 2023-12-16T03:15:57.760 INFO:tasks.workunit.client.0.smithi064.stdout:8/313: chown d0/db/c56 5563725 1 2023-12-16T03:15:57.760 INFO:tasks.workunit.client.1.smithi184.stdout:8/566: dwrite d2/d4/d10/d2a/f5c [0,4194304] 0 2023-12-16T03:15:57.763 INFO:tasks.workunit.client.1.smithi184.stdout:9/738: rename d0/d13/d20/d5b/d43/c99 to d0/d13/d20/d5b/c103 0 2023-12-16T03:15:57.764 INFO:tasks.workunit.client.1.smithi184.stdout:0/590: dwrite dc/d22/d45/d66/fae [0,4194304] 0 2023-12-16T03:15:57.766 INFO:tasks.workunit.client.0.smithi064.stdout:6/172: dread d3/d8/d13/f2c [0,4194304] 0 2023-12-16T03:15:57.767 INFO:tasks.workunit.client.1.smithi184.stdout:9/739: getdents d0/d76/da2 0 2023-12-16T03:15:57.773 INFO:tasks.workunit.client.0.smithi064.stdout:4/261: dread d0/d1e/f29 [0,4194304] 0 2023-12-16T03:15:57.773 INFO:tasks.workunit.client.0.smithi064.stdout:2/219: creat d1/d15/d23/d2d/f3c x:0 0 0 2023-12-16T03:15:57.773 INFO:tasks.workunit.client.0.smithi064.stdout:8/314: mkdir d0/db/d12/d44/d68/d6d 0 2023-12-16T03:15:57.774 INFO:tasks.workunit.client.0.smithi064.stdout:6/173: mkdir d3/d9/d2d 0 2023-12-16T03:15:57.775 INFO:tasks.workunit.client.1.smithi184.stdout:0/591: mkdir dc/d22/d45/d66/d80/da3/dcb 0 2023-12-16T03:15:57.776 INFO:tasks.workunit.client.0.smithi064.stdout:6/174: mknod d3/d8/c2e 0 2023-12-16T03:15:57.781 INFO:tasks.workunit.client.0.smithi064.stdout:6/175: truncate d3/f5 3988427 0 2023-12-16T03:15:57.782 INFO:tasks.workunit.client.0.smithi064.stdout:6/176: symlink d3/d8/d1f/d26/l2f 0 2023-12-16T03:15:57.784 INFO:tasks.workunit.client.0.smithi064.stdout:6/177: truncate d3/d8/d13/f24 3774166 0 2023-12-16T03:15:57.787 INFO:tasks.workunit.client.0.smithi064.stdout:6/178: rename d3/d8/d1f/c28 to d3/d8/d13/c30 0 2023-12-16T03:15:57.791 INFO:tasks.workunit.client.1.smithi184.stdout:1/526: dwrite d3/d13/d2c/f81 [0,4194304] 0 2023-12-16T03:15:57.793 INFO:tasks.workunit.client.0.smithi064.stdout:6/179: symlink d3/d8/l31 0 2023-12-16T03:15:57.795 INFO:tasks.workunit.client.1.smithi184.stdout:6/594: dwrite d0/d5/f24 [0,4194304] 0 2023-12-16T03:15:57.795 INFO:tasks.workunit.client.1.smithi184.stdout:1/527: getdents d3/d28/d3c/d41/d46/d4a/d6a/d6d 0 2023-12-16T03:15:57.795 INFO:tasks.workunit.client.1.smithi184.stdout:1/528: dread - d3/d28/d36/f9b zero size 2023-12-16T03:15:57.795 INFO:tasks.workunit.client.1.smithi184.stdout:6/595: unlink d0/d5/d22/d25/dbf/cc0 0 2023-12-16T03:15:57.796 INFO:tasks.workunit.client.1.smithi184.stdout:1/529: getdents d3/d28/d3c/d41/d46 0 2023-12-16T03:15:57.799 INFO:tasks.workunit.client.0.smithi064.stdout:6/180: mknod d3/d8/d1f/c32 0 2023-12-16T03:15:57.804 INFO:tasks.workunit.client.1.smithi184.stdout:7/440: dwrite d0/d6b/f78 [0,4194304] 0 2023-12-16T03:15:57.805 INFO:tasks.workunit.client.0.smithi064.stdout:6/181: dread d3/d9/fb [0,4194304] 0 2023-12-16T03:15:57.805 INFO:tasks.workunit.client.0.smithi064.stdout:0/158: dwrite d2/d7/d10/d21/f24 [0,4194304] 0 2023-12-16T03:15:57.805 INFO:tasks.workunit.client.0.smithi064.stdout:6/182: write d3/d8/d13/f2b [228807,80393] 0 2023-12-16T03:15:57.808 INFO:tasks.workunit.client.0.smithi064.stdout:0/159: link d2/d7/d10/l12 d2/d7/l30 0 2023-12-16T03:15:57.809 INFO:tasks.workunit.client.0.smithi064.stdout:6/183: symlink d3/d8/l33 0 2023-12-16T03:15:57.809 INFO:tasks.workunit.client.0.smithi064.stdout:0/160: read d2/f16 [2393227,95583] 0 2023-12-16T03:15:57.809 INFO:tasks.workunit.client.0.smithi064.stdout:0/161: readlink d2/d8/da/df/l18 0 2023-12-16T03:15:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:57 smithi184 ceph-mon[121180]: pgmap v193: 65 pgs: 65 active+clean; 953 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 60 MiB/s rd, 119 MiB/s wr, 736 op/s 2023-12-16T03:15:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:57 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:15:57.810 INFO:tasks.workunit.client.0.smithi064.stdout:6/184: truncate d3/d8/da/fe 1321739 0 2023-12-16T03:15:57.811 INFO:tasks.workunit.client.0.smithi064.stdout:0/162: mkdir d2/d7/d10/d21/d31 0 2023-12-16T03:15:57.812 INFO:tasks.workunit.client.0.smithi064.stdout:0/163: dread d2/d7/d10/f1f [0,4194304] 0 2023-12-16T03:15:57.813 INFO:tasks.workunit.client.0.smithi064.stdout:6/185: link d3/d8/d1f/d26/l2f d3/d8/d1f/l34 0 2023-12-16T03:15:57.813 INFO:tasks.workunit.client.0.smithi064.stdout:6/186: fsync d3/d9/f20 0 2023-12-16T03:15:57.813 INFO:tasks.workunit.client.0.smithi064.stdout:6/187: truncate d3/d8/d13/f2b 535712 0 2023-12-16T03:15:57.814 INFO:tasks.workunit.client.0.smithi064.stdout:0/164: creat d2/f32 x:0 0 0 2023-12-16T03:15:57.814 INFO:tasks.workunit.client.1.smithi184.stdout:1/530: write d3/d34/d39/f66 [1998250,38036] 0 2023-12-16T03:15:57.815 INFO:tasks.workunit.client.0.smithi064.stdout:6/188: mknod d3/c35 0 2023-12-16T03:15:57.815 INFO:tasks.workunit.client.0.smithi064.stdout:0/165: creat d2/d29/f33 x:0 0 0 2023-12-16T03:15:57.816 INFO:tasks.workunit.client.0.smithi064.stdout:0/166: read d2/d7/d10/f1f [60504,89090] 0 2023-12-16T03:15:57.816 INFO:tasks.workunit.client.1.smithi184.stdout:6/596: dread d0/d5/d26/f82 [0,4194304] 0 2023-12-16T03:15:57.829 INFO:tasks.workunit.client.0.smithi064.stdout:7/237: dwrite d7/d13/d20/f21 [0,4194304] 0 2023-12-16T03:15:57.837 INFO:tasks.workunit.client.0.smithi064.stdout:7/238: mknod d7/d13/c4d 0 2023-12-16T03:15:57.837 INFO:tasks.workunit.client.0.smithi064.stdout:7/239: write d7/f9 [2040741,95471] 0 2023-12-16T03:15:57.839 INFO:tasks.workunit.client.1.smithi184.stdout:8/567: dwrite d2/d37/f4c [4194304,4194304] 0 2023-12-16T03:15:57.839 INFO:tasks.workunit.client.1.smithi184.stdout:8/568: write d2/d12/d21/f53 [1145441,55455] 0 2023-12-16T03:15:57.841 INFO:tasks.workunit.client.1.smithi184.stdout:8/569: symlink d2/d37/d7c/lb7 0 2023-12-16T03:15:57.841 INFO:tasks.workunit.client.1.smithi184.stdout:8/570: mkdir d2/d37/db8 0 2023-12-16T03:15:57.842 INFO:tasks.workunit.client.1.smithi184.stdout:8/571: creat d2/d12/db4/fb9 x:0 0 0 2023-12-16T03:15:57.850 INFO:tasks.workunit.client.0.smithi064.stdout:7/240: symlink d7/d26/l4e 0 2023-12-16T03:15:57.850 INFO:tasks.workunit.client.0.smithi064.stdout:7/241: stat d7/d13/d20/d37/c3f 0 2023-12-16T03:15:57.852 INFO:tasks.workunit.client.0.smithi064.stdout:7/242: rename d7/d26/d30/l41 to d7/l4f 0 2023-12-16T03:15:57.852 INFO:tasks.workunit.client.0.smithi064.stdout:7/243: write d7/fb [1711641,80835] 0 2023-12-16T03:15:57.857 INFO:tasks.workunit.client.0.smithi064.stdout:7/244: rmdir d7/d1c 0 2023-12-16T03:15:57.857 INFO:tasks.workunit.client.0.smithi064.stdout:7/245: write d7/f9 [2021469,35954] 0 2023-12-16T03:15:57.857 INFO:tasks.workunit.client.0.smithi064.stdout:7/246: truncate d7/f9 2312790 0 2023-12-16T03:15:57.862 INFO:tasks.workunit.client.0.smithi064.stdout:7/247: dread d7/f3b [0,4194304] 0 2023-12-16T03:15:57.867 INFO:tasks.workunit.client.0.smithi064.stdout:7/248: dread d7/d26/d30/f39 [0,4194304] 0 2023-12-16T03:15:57.868 INFO:tasks.workunit.client.0.smithi064.stdout:7/249: mkdir d7/d3e/d42/d48/d50 0 2023-12-16T03:15:57.868 INFO:tasks.workunit.client.0.smithi064.stdout:7/250: write d7/d3e/d42/f44 [275140,85182] 0 2023-12-16T03:15:57.870 INFO:tasks.workunit.client.0.smithi064.stdout:7/251: dread d7/d13/d20/f3a [0,4194304] 0 2023-12-16T03:15:57.870 INFO:tasks.workunit.client.1.smithi184.stdout:9/740: dwrite d0/f36 [0,4194304] 0 2023-12-16T03:15:57.871 INFO:tasks.workunit.client.0.smithi064.stdout:1/242: dwrite d3/dd/f2d [0,4194304] 0 2023-12-16T03:15:57.872 INFO:tasks.workunit.client.0.smithi064.stdout:1/243: stat d3/dd/d11/c1e 0 2023-12-16T03:15:57.872 INFO:tasks.workunit.client.0.smithi064.stdout:7/252: mkdir d7/d3e/d42/d48/d51 0 2023-12-16T03:15:57.873 INFO:tasks.workunit.client.1.smithi184.stdout:0/592: dwrite dc/d22/d1d/d35/f65 [0,4194304] 0 2023-12-16T03:15:57.873 INFO:tasks.workunit.client.1.smithi184.stdout:0/593: chown dc/d10/f14 127 1 2023-12-16T03:15:57.873 INFO:tasks.workunit.client.0.smithi064.stdout:4/262: dwrite d0/da/f16 [4194304,4194304] 0 2023-12-16T03:15:57.873 INFO:tasks.workunit.client.0.smithi064.stdout:4/263: truncate d0/d1e/d36/f46 975585 0 2023-12-16T03:15:57.873 INFO:tasks.workunit.client.0.smithi064.stdout:8/315: dwrite d0/db/d12/d44/f4a [0,4194304] 0 2023-12-16T03:15:57.874 INFO:tasks.workunit.client.0.smithi064.stdout:2/220: dwrite d1/f3a [0,4194304] 0 2023-12-16T03:15:57.874 INFO:tasks.workunit.client.0.smithi064.stdout:1/244: creat d3/d36/d44/f51 x:0 0 0 2023-12-16T03:15:57.874 INFO:tasks.workunit.client.1.smithi184.stdout:6/597: dwrite d0/d5/d22/d25/d3f/f78 [0,4194304] 0 2023-12-16T03:15:57.874 INFO:tasks.workunit.client.1.smithi184.stdout:1/531: dwrite d3/d13/f90 [4194304,4194304] 0 2023-12-16T03:15:57.875 INFO:tasks.workunit.client.1.smithi184.stdout:7/441: dwrite d0/f77 [0,4194304] 0 2023-12-16T03:15:57.875 INFO:tasks.workunit.client.1.smithi184.stdout:7/442: fsync d0/d3/d2e/d79/d1e/f20 0 2023-12-16T03:15:57.875 INFO:tasks.workunit.client.0.smithi064.stdout:0/167: dwrite d2/f16 [0,4194304] 0 2023-12-16T03:15:57.876 INFO:tasks.workunit.client.0.smithi064.stdout:7/253: mkdir d7/d3e/d42/d43/d46/d52 0 2023-12-16T03:15:57.878 INFO:tasks.workunit.client.0.smithi064.stdout:4/264: truncate d0/d12/d17/f1d 1194222 0 2023-12-16T03:15:57.878 INFO:tasks.workunit.client.0.smithi064.stdout:4/265: write d0/d1e/f2c [1020405,19288] 0 2023-12-16T03:15:57.879 INFO:tasks.workunit.client.1.smithi184.stdout:0/594: link lb dc/d22/d45/d66/d80/da3/dcb/lcc 0 2023-12-16T03:15:57.879 INFO:tasks.workunit.client.0.smithi064.stdout:4/266: read d0/f2 [5848411,1103] 0 2023-12-16T03:15:57.881 INFO:tasks.workunit.client.1.smithi184.stdout:8/572: dwrite d2/d6a/f84 [8388608,4194304] 0 2023-12-16T03:15:57.891 INFO:tasks.workunit.client.1.smithi184.stdout:6/598: write d0/d5/d12/fb8 [2298696,54158] 0 2023-12-16T03:15:57.894 INFO:tasks.workunit.client.1.smithi184.stdout:6/599: creat d0/d5/d22/d34/d53/fc1 x:0 0 0 2023-12-16T03:15:57.896 INFO:tasks.workunit.client.0.smithi064.stdout:1/245: dread d3/dd/f2d [0,4194304] 0 2023-12-16T03:15:57.898 INFO:tasks.workunit.client.0.smithi064.stdout:0/168: symlink d2/d7/d10/l34 0 2023-12-16T03:15:57.898 INFO:tasks.workunit.client.0.smithi064.stdout:0/169: chown d2/f27 11875635 1 2023-12-16T03:15:57.900 INFO:tasks.workunit.client.0.smithi064.stdout:4/267: creat d0/d1e/d36/f4d x:0 0 0 2023-12-16T03:15:57.900 INFO:tasks.workunit.client.0.smithi064.stdout:4/268: chown d0/f5 1664 1 2023-12-16T03:15:57.902 INFO:tasks.workunit.client.0.smithi064.stdout:2/221: rename d1/c12 to d1/d15/d23/d2d/c3d 0 2023-12-16T03:15:57.902 INFO:tasks.workunit.client.0.smithi064.stdout:2/222: readlink d1/lb 0 2023-12-16T03:15:57.904 INFO:tasks.workunit.client.0.smithi064.stdout:0/170: creat d2/d7/d10/d21/d31/f35 x:0 0 0 2023-12-16T03:15:57.904 INFO:tasks.workunit.client.0.smithi064.stdout:0/171: stat d2/d7/f23 0 2023-12-16T03:15:57.921 INFO:tasks.workunit.client.0.smithi064.stdout:0/172: dread d2/f16 [0,4194304] 0 2023-12-16T03:15:57.921 INFO:tasks.workunit.client.0.smithi064.stdout:0/173: read - d2/f32 zero size 2023-12-16T03:15:57.922 INFO:tasks.workunit.client.0.smithi064.stdout:1/246: dread d3/f26 [0,4194304] 0 2023-12-16T03:15:57.923 INFO:tasks.workunit.client.0.smithi064.stdout:0/174: rename d2/d7/l30 to d2/d7/l36 0 2023-12-16T03:15:57.923 INFO:tasks.workunit.client.1.smithi184.stdout:8/573: dwrite d2/d6a/f74 [0,4194304] 0 2023-12-16T03:15:57.925 INFO:tasks.workunit.client.1.smithi184.stdout:6/600: write d0/d5/d42/f80 [1127792,4294] 0 2023-12-16T03:15:57.926 INFO:tasks.workunit.client.1.smithi184.stdout:6/601: fsync d0/d5/f2c 0 2023-12-16T03:15:57.926 INFO:tasks.workunit.client.1.smithi184.stdout:8/574: unlink d2/d4/d10/d7a/d83/f90 0 2023-12-16T03:15:57.928 INFO:tasks.workunit.client.1.smithi184.stdout:8/575: creat d2/d12/d21/d2d/d31/fba x:0 0 0 2023-12-16T03:15:57.929 INFO:tasks.workunit.client.1.smithi184.stdout:8/576: write d2/d4/d10/d7a/d83/d8b/fab [742165,20320] 0 2023-12-16T03:15:57.931 INFO:tasks.workunit.client.1.smithi184.stdout:6/602: read d0/d5/d22/d25/d47/f8f [2272220,11105] 0 2023-12-16T03:15:57.932 INFO:tasks.workunit.client.0.smithi064.stdout:7/254: dread d7/f9 [0,4194304] 0 2023-12-16T03:15:57.933 INFO:tasks.workunit.client.0.smithi064.stdout:7/255: creat d7/f53 x:0 0 0 2023-12-16T03:15:57.934 INFO:tasks.workunit.client.0.smithi064.stdout:7/256: readlink d7/d26/l4e 0 2023-12-16T03:15:57.934 INFO:tasks.workunit.client.0.smithi064.stdout:7/257: write d7/f9 [888211,127962] 0 2023-12-16T03:15:57.936 INFO:tasks.workunit.client.0.smithi064.stdout:7/258: mknod d7/d3e/d42/d48/d51/c54 0 2023-12-16T03:15:57.936 INFO:tasks.workunit.client.1.smithi184.stdout:3/577: sync 2023-12-16T03:15:57.937 INFO:tasks.workunit.client.1.smithi184.stdout:4/454: sync 2023-12-16T03:15:57.937 INFO:tasks.workunit.client.1.smithi184.stdout:3/578: stat c10 0 2023-12-16T03:15:57.937 INFO:tasks.workunit.client.1.smithi184.stdout:4/455: chown d1/d11/d5a/d63/d72/c8d 183 1 2023-12-16T03:15:57.937 INFO:tasks.workunit.client.1.smithi184.stdout:1/532: dwrite d3/d28/d36/f48 [0,4194304] 0 2023-12-16T03:15:57.939 INFO:tasks.workunit.client.1.smithi184.stdout:5/399: sync 2023-12-16T03:15:57.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/577: dread d2/d12/d21/d2d/d31/f68 [0,4194304] 0 2023-12-16T03:15:57.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/578: fdatasync d2/d6a/f74 0 2023-12-16T03:15:57.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/579: write d2/d12/d21/d2d/fa2 [1049835,116975] 0 2023-12-16T03:15:57.941 INFO:tasks.workunit.client.1.smithi184.stdout:3/579: creat d12/d18/fd8 x:0 0 0 2023-12-16T03:15:57.941 INFO:tasks.workunit.client.1.smithi184.stdout:3/580: chown d12/d18/d1f/d23/c5e 180122776 1 2023-12-16T03:15:57.941 INFO:tasks.workunit.client.1.smithi184.stdout:1/533: getdents d3/d28/d3c 0 2023-12-16T03:15:57.941 INFO:tasks.workunit.client.0.smithi064.stdout:2/223: dwrite d1/f8 [0,4194304] 0 2023-12-16T03:15:57.942 INFO:tasks.workunit.client.0.smithi064.stdout:6/189: dwrite d3/d8/d13/f2b [0,4194304] 0 2023-12-16T03:15:57.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:57 smithi064 ceph-mon[111958]: pgmap v193: 65 pgs: 65 active+clean; 953 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 60 MiB/s rd, 119 MiB/s wr, 736 op/s 2023-12-16T03:15:57.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:57.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:15:57.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:57 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:15:57.945 INFO:tasks.workunit.client.1.smithi184.stdout:3/581: link d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/fc9 d12/d37/d81/fd9 0 2023-12-16T03:15:57.945 INFO:tasks.workunit.client.1.smithi184.stdout:3/582: chown d12/d18/d1f/d23/d2a/d42/d52/f58 1403623 1 2023-12-16T03:15:57.945 INFO:tasks.workunit.client.1.smithi184.stdout:0/595: dwrite dc/f12 [0,4194304] 0 2023-12-16T03:15:57.948 INFO:tasks.workunit.client.1.smithi184.stdout:1/534: unlink d3/d28/d3c/d41/f9e 0 2023-12-16T03:15:57.949 INFO:tasks.workunit.client.1.smithi184.stdout:0/596: mknod dc/ccd 0 2023-12-16T03:15:57.949 INFO:tasks.workunit.client.0.smithi064.stdout:6/190: link d3/d8/d13/c30 d3/d9/d2d/c36 0 2023-12-16T03:15:57.951 INFO:tasks.workunit.client.1.smithi184.stdout:6/603: dread d0/d5/d22/d37/d4d/d9c/fa9 [0,4194304] 0 2023-12-16T03:15:57.951 INFO:tasks.workunit.client.1.smithi184.stdout:1/535: rename d3/d13/d2c/f37 to d3/d28/d38/faf 0 2023-12-16T03:15:57.951 INFO:tasks.workunit.client.1.smithi184.stdout:2/375: sync 2023-12-16T03:15:57.952 INFO:tasks.workunit.client.1.smithi184.stdout:9/741: dwrite d0/d30/f44 [0,4194304] 0 2023-12-16T03:15:57.952 INFO:tasks.workunit.client.1.smithi184.stdout:9/742: stat d0/d3a/d47/c7d 0 2023-12-16T03:15:57.952 INFO:tasks.workunit.client.1.smithi184.stdout:9/743: truncate d0/d13/d20/d5b/d53/fa7 797586 0 2023-12-16T03:15:57.952 INFO:tasks.workunit.client.1.smithi184.stdout:0/597: creat dc/d22/d45/d66/d80/da3/dcb/fce x:0 0 0 2023-12-16T03:15:57.953 INFO:tasks.workunit.client.0.smithi064.stdout:0/175: dwrite d2/d7/f23 [0,4194304] 0 2023-12-16T03:15:57.956 INFO:tasks.workunit.client.0.smithi064.stdout:4/269: write d0/d12/d17/f1d [231145,55244] 0 2023-12-16T03:15:57.956 INFO:tasks.workunit.client.0.smithi064.stdout:4/270: fdatasync d0/d14/f26 0 2023-12-16T03:15:57.957 INFO:tasks.workunit.client.0.smithi064.stdout:0/176: link f1 d2/d8/da/df/f37 0 2023-12-16T03:15:57.958 INFO:tasks.workunit.client.0.smithi064.stdout:4/271: read d0/d1e/f2c [79563,26011] 0 2023-12-16T03:15:57.959 INFO:tasks.workunit.client.1.smithi184.stdout:6/604: creat d0/d5/d22/d37/fc2 x:0 0 0 2023-12-16T03:15:57.959 INFO:tasks.workunit.client.1.smithi184.stdout:6/605: write d0/d5/d22/d34/fb6 [1024182,6548] 0 2023-12-16T03:15:57.960 INFO:tasks.workunit.client.1.smithi184.stdout:1/536: creat d3/d28/d3c/d24/d8e/fb0 x:0 0 0 2023-12-16T03:15:57.961 INFO:tasks.workunit.client.0.smithi064.stdout:7/259: dwrite d7/d3e/f47 [0,4194304] 0 2023-12-16T03:15:57.963 INFO:tasks.workunit.client.0.smithi064.stdout:8/316: dwrite d0/d1d/d3c/d42/f5d [0,4194304] 0 2023-12-16T03:15:57.964 INFO:tasks.workunit.client.0.smithi064.stdout:0/177: mknod d2/d7/d10/c38 0 2023-12-16T03:15:57.964 INFO:tasks.workunit.client.0.smithi064.stdout:0/178: truncate d2/d7/f2b 912813 0 2023-12-16T03:15:57.965 INFO:tasks.workunit.client.1.smithi184.stdout:2/376: dread d3/d29/d2f/d2e/f5d [0,4194304] 0 2023-12-16T03:15:57.966 INFO:tasks.workunit.client.1.smithi184.stdout:1/537: mkdir d3/d28/d3c/d41/d77/db1 0 2023-12-16T03:15:57.966 INFO:tasks.workunit.client.1.smithi184.stdout:1/538: fsync d3/d28/d3c/d41/d46/d4a/f50 0 2023-12-16T03:15:57.967 INFO:tasks.workunit.client.0.smithi064.stdout:0/179: write d2/d7/d10/f1f [366149,81604] 0 2023-12-16T03:15:57.967 INFO:tasks.workunit.client.0.smithi064.stdout:4/272: mknod d0/d12/d48/c4e 0 2023-12-16T03:15:57.967 INFO:tasks.workunit.client.1.smithi184.stdout:9/744: creat d0/d76/da2/f104 x:0 0 0 2023-12-16T03:15:57.968 INFO:tasks.workunit.client.1.smithi184.stdout:2/377: creat d3/d29/d2f/d46/d77/f80 x:0 0 0 2023-12-16T03:15:57.971 INFO:tasks.workunit.client.1.smithi184.stdout:9/745: write d0/d13/d20/db0/fa0 [4158776,129654] 0 2023-12-16T03:15:57.971 INFO:tasks.workunit.client.1.smithi184.stdout:2/378: mknod d3/d29/d2f/d2e/c81 0 2023-12-16T03:15:57.973 INFO:tasks.workunit.client.1.smithi184.stdout:2/379: mkdir d3/d9/d19/d82 0 2023-12-16T03:15:57.975 INFO:tasks.workunit.client.0.smithi064.stdout:7/260: write d7/d13/d20/f21 [3676680,31918] 0 2023-12-16T03:15:57.975 INFO:tasks.workunit.client.0.smithi064.stdout:7/261: chown d7/d3e/d42/d48/d51 146616 1 2023-12-16T03:15:57.975 INFO:tasks.workunit.client.0.smithi064.stdout:7/262: readlink d7/d13/l24 0 2023-12-16T03:15:57.976 INFO:tasks.workunit.client.1.smithi184.stdout:2/380: truncate d3/d29/d2f/f22 2533073 0 2023-12-16T03:15:57.976 INFO:tasks.workunit.client.1.smithi184.stdout:2/381: chown d3/d13/f18 45 1 2023-12-16T03:15:57.978 INFO:tasks.workunit.client.1.smithi184.stdout:2/382: mkdir d3/d13/d28/d83 0 2023-12-16T03:15:57.978 INFO:tasks.workunit.client.1.smithi184.stdout:2/383: fdatasync d3/d29/d2f/d46/d77/f80 0 2023-12-16T03:15:57.979 INFO:tasks.workunit.client.1.smithi184.stdout:2/384: mknod d3/d13/d28/d83/c84 0 2023-12-16T03:15:57.979 INFO:tasks.workunit.client.0.smithi064.stdout:4/273: creat d0/d12/d48/f4f x:0 0 0 2023-12-16T03:15:57.980 INFO:tasks.workunit.client.1.smithi184.stdout:2/385: creat d3/d9/f85 x:0 0 0 2023-12-16T03:15:57.980 INFO:tasks.workunit.client.1.smithi184.stdout:2/386: chown d3/f65 268 1 2023-12-16T03:15:57.980 INFO:tasks.workunit.client.1.smithi184.stdout:2/387: write d3/f75 [1022421,9132] 0 2023-12-16T03:15:57.980 INFO:tasks.workunit.client.1.smithi184.stdout:2/388: truncate d3/d9/f3b 199527 0 2023-12-16T03:15:57.980 INFO:tasks.workunit.client.1.smithi184.stdout:2/389: readlink d3/d29/d2f/l38 0 2023-12-16T03:15:57.980 INFO:tasks.workunit.client.1.smithi184.stdout:2/390: chown d3/d29/d2f/l38 263719 1 2023-12-16T03:15:57.980 INFO:tasks.workunit.client.1.smithi184.stdout:2/391: readlink d3/d9/l60 0 2023-12-16T03:15:57.981 INFO:tasks.workunit.client.0.smithi064.stdout:8/317: creat d0/da/d16/f6e x:0 0 0 2023-12-16T03:15:57.981 INFO:tasks.workunit.client.0.smithi064.stdout:8/318: fsync d0/f7 0 2023-12-16T03:15:57.981 INFO:tasks.workunit.client.0.smithi064.stdout:8/319: readlink d0/d1d/d48/l51 0 2023-12-16T03:15:57.981 INFO:tasks.workunit.client.1.smithi184.stdout:1/539: write d3/d28/d3c/d41/d63/f64 [1819359,125980] 0 2023-12-16T03:15:57.981 INFO:tasks.workunit.client.1.smithi184.stdout:2/392: getdents d3/d29/d4d/d5b 0 2023-12-16T03:15:57.983 INFO:tasks.workunit.client.0.smithi064.stdout:8/320: write d0/d1d/d24/d2f/f41 [2446397,121671] 0 2023-12-16T03:15:57.984 INFO:tasks.workunit.client.1.smithi184.stdout:1/540: link d3/d28/d38/fac d3/d28/d3c/d41/d46/d4a/d6a/d6d/fb2 0 2023-12-16T03:15:57.984 INFO:tasks.workunit.client.1.smithi184.stdout:1/541: truncate d3/d28/d3c/d41/d46/d4a/d6a/d6d/fb2 364255 0 2023-12-16T03:15:57.985 INFO:tasks.workunit.client.1.smithi184.stdout:2/393: truncate d3/d9/d19/f1c 6682610 0 2023-12-16T03:15:57.986 INFO:tasks.workunit.client.1.smithi184.stdout:1/542: mknod d3/cb3 0 2023-12-16T03:15:57.987 INFO:tasks.workunit.client.1.smithi184.stdout:2/394: creat d3/d9/f86 x:0 0 0 2023-12-16T03:15:57.987 INFO:tasks.workunit.client.1.smithi184.stdout:2/395: write d3/d29/d2f/d31/f67 [92556,122383] 0 2023-12-16T03:15:57.988 INFO:tasks.workunit.client.1.smithi184.stdout:1/543: symlink d3/lb4 0 2023-12-16T03:15:57.989 INFO:tasks.workunit.client.1.smithi184.stdout:1/544: write d3/d13/f29 [4562108,92732] 0 2023-12-16T03:15:57.991 INFO:tasks.workunit.client.1.smithi184.stdout:2/396: rename d3/d29/d2f/d31 to d3/d9/d19/d87 0 2023-12-16T03:15:57.993 INFO:tasks.workunit.client.1.smithi184.stdout:1/545: rename d3/d34/d76/f79 to d3/d28/d38/d52/fb5 0 2023-12-16T03:15:57.994 INFO:tasks.workunit.client.1.smithi184.stdout:2/397: creat d3/d29/d61/f88 x:0 0 0 2023-12-16T03:15:57.994 INFO:tasks.workunit.client.1.smithi184.stdout:4/456: dwrite d1/d11/d1b/f87 [0,4194304] 0 2023-12-16T03:15:57.995 INFO:tasks.workunit.client.1.smithi184.stdout:1/546: mknod d3/d28/d3c/d24/cb6 0 2023-12-16T03:15:57.996 INFO:tasks.workunit.client.1.smithi184.stdout:2/398: creat d3/d29/d4d/d5b/f89 x:0 0 0 2023-12-16T03:15:57.996 INFO:tasks.workunit.client.1.smithi184.stdout:2/399: chown d3 6 1 2023-12-16T03:15:57.996 INFO:tasks.workunit.client.1.smithi184.stdout:2/400: dread - d3/f76 zero size 2023-12-16T03:15:57.999 INFO:tasks.workunit.client.1.smithi184.stdout:4/457: creat d1/d29/f95 x:0 0 0 2023-12-16T03:15:57.999 INFO:tasks.workunit.client.1.smithi184.stdout:1/547: mkdir d3/d28/d3c/d41/d46/d4a/d6a/d6d/d99/db7 0 2023-12-16T03:15:58.000 INFO:tasks.workunit.client.0.smithi064.stdout:4/274: dread d0/da/f16 [0,4194304] 0 2023-12-16T03:15:58.000 INFO:tasks.workunit.client.0.smithi064.stdout:4/275: getdents d0/d42/d4c 0 2023-12-16T03:15:58.001 INFO:tasks.workunit.client.1.smithi184.stdout:4/458: creat d1/d29/d34/d5c/d76/d33/f96 x:0 0 0 2023-12-16T03:15:58.001 INFO:tasks.workunit.client.0.smithi064.stdout:4/276: unlink d0/d12/d17/f31 0 2023-12-16T03:15:58.004 INFO:tasks.workunit.client.0.smithi064.stdout:4/277: rmdir d0/d1e 39 2023-12-16T03:15:58.004 INFO:tasks.workunit.client.1.smithi184.stdout:5/400: dwrite d1/d3/d9/d49/f55 [4194304,4194304] 0 2023-12-16T03:15:58.006 INFO:tasks.workunit.client.1.smithi184.stdout:1/548: dread d3/d28/f87 [0,4194304] 0 2023-12-16T03:15:58.007 INFO:tasks.workunit.client.0.smithi064.stdout:8/321: dwrite d0/da/d3e/f53 [0,4194304] 0 2023-12-16T03:15:58.009 INFO:tasks.workunit.client.1.smithi184.stdout:5/401: rmdir d1/d3/d9/de 39 2023-12-16T03:15:58.011 INFO:tasks.workunit.client.0.smithi064.stdout:8/322: mkdir d0/db/d37/d3a/d6f 0 2023-12-16T03:15:58.016 INFO:tasks.workunit.client.1.smithi184.stdout:1/549: dread d3/d28/d3c/d41/d46/d4a/f50 [0,4194304] 0 2023-12-16T03:15:58.017 INFO:tasks.workunit.client.0.smithi064.stdout:8/323: dread d0/d1d/f20 [0,4194304] 0 2023-12-16T03:15:58.017 INFO:tasks.workunit.client.0.smithi064.stdout:8/324: chown d0/da/d3e/f53 3152 1 2023-12-16T03:15:58.018 INFO:tasks.workunit.client.1.smithi184.stdout:1/550: mknod d3/d28/d3c/cb8 0 2023-12-16T03:15:58.018 INFO:tasks.workunit.client.1.smithi184.stdout:2/401: dread d3/d13/d28/f74 [0,4194304] 0 2023-12-16T03:15:58.019 INFO:tasks.workunit.client.0.smithi064.stdout:8/325: mkdir d0/d1d/d24/d2f/d50/d70 0 2023-12-16T03:15:58.020 INFO:tasks.workunit.client.1.smithi184.stdout:2/402: write d3/f6 [3495655,64417] 0 2023-12-16T03:15:58.020 INFO:tasks.workunit.client.1.smithi184.stdout:2/403: stat d3/d29/d2f/f45 0 2023-12-16T03:15:58.021 INFO:tasks.workunit.client.1.smithi184.stdout:5/402: dread d1/d3/d9/f40 [0,4194304] 0 2023-12-16T03:15:58.021 INFO:tasks.workunit.client.1.smithi184.stdout:5/403: readlink d1/d3/d9/de/d30/l43 0 2023-12-16T03:15:58.021 INFO:tasks.workunit.client.1.smithi184.stdout:1/551: dread d3/d28/d3c/d41/d46/d4a/f50 [0,4194304] 0 2023-12-16T03:15:58.023 INFO:tasks.workunit.client.1.smithi184.stdout:2/404: mkdir d3/d29/d8a 0 2023-12-16T03:15:58.023 INFO:tasks.workunit.client.1.smithi184.stdout:5/404: stat d1/d3/c44 0 2023-12-16T03:15:58.025 INFO:tasks.workunit.client.1.smithi184.stdout:2/405: creat d3/d29/d2f/f8b x:0 0 0 2023-12-16T03:15:58.026 INFO:tasks.workunit.client.1.smithi184.stdout:2/406: creat d3/d9/f8c x:0 0 0 2023-12-16T03:15:58.028 INFO:tasks.workunit.client.1.smithi184.stdout:8/580: dwrite d2/d12/d21/d8a/fb2 [0,4194304] 0 2023-12-16T03:15:58.028 INFO:tasks.workunit.client.1.smithi184.stdout:2/407: link d3/d13/c63 d3/d9/c8d 0 2023-12-16T03:15:58.028 INFO:tasks.workunit.client.1.smithi184.stdout:2/408: dread - d3/d29/d2f/f54 zero size 2023-12-16T03:15:58.028 INFO:tasks.workunit.client.1.smithi184.stdout:2/409: write d3/d29/d2f/f54 [447976,65416] 0 2023-12-16T03:15:58.029 INFO:tasks.workunit.client.0.smithi064.stdout:6/191: dwrite d3/d8/d1f/f22 [0,4194304] 0 2023-12-16T03:15:58.030 INFO:tasks.workunit.client.0.smithi064.stdout:6/192: readlink d3/d9/l19 0 2023-12-16T03:15:58.030 INFO:tasks.workunit.client.1.smithi184.stdout:3/583: dwrite d12/d1e/d89/f96 [0,4194304] 0 2023-12-16T03:15:58.032 INFO:tasks.workunit.client.1.smithi184.stdout:8/581: rename d2/d12/d21/d8a/c9b to d2/d4/da6/cbb 0 2023-12-16T03:15:58.032 INFO:tasks.workunit.client.1.smithi184.stdout:8/582: readlink d2/d4/d10/d11/l9f 0 2023-12-16T03:15:58.032 INFO:tasks.workunit.client.1.smithi184.stdout:8/583: fsync d2/d4/f2e 0 2023-12-16T03:15:58.032 INFO:tasks.workunit.client.1.smithi184.stdout:8/584: truncate d2/d12/d21/d2d/d31/fba 511255 0 2023-12-16T03:15:58.033 INFO:tasks.workunit.client.1.smithi184.stdout:2/410: getdents d3/d13 0 2023-12-16T03:15:58.033 INFO:tasks.workunit.client.1.smithi184.stdout:2/411: dread - d3/d29/d2f/d46/f6b zero size 2023-12-16T03:15:58.033 INFO:tasks.workunit.client.1.smithi184.stdout:6/606: dwrite d0/d5/d22/f29 [0,4194304] 0 2023-12-16T03:15:58.033 INFO:tasks.workunit.client.1.smithi184.stdout:6/607: fsync d0/d5/d12/d1b/f51 0 2023-12-16T03:15:58.033 INFO:tasks.workunit.client.1.smithi184.stdout:6/608: readlink d0/d5/d22/d25/d3f/d6f/lb3 0 2023-12-16T03:15:58.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/746: dwrite d0/d13/f2a [0,4194304] 0 2023-12-16T03:15:58.034 INFO:tasks.workunit.client.0.smithi064.stdout:6/193: write d3/d9/f18 [1315107,130591] 0 2023-12-16T03:15:58.035 INFO:tasks.workunit.client.1.smithi184.stdout:3/584: truncate d12/d1e/d89/fd5 2714710 0 2023-12-16T03:15:58.035 INFO:tasks.workunit.client.1.smithi184.stdout:3/585: dread - d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f3c zero size 2023-12-16T03:15:58.035 INFO:tasks.workunit.client.1.smithi184.stdout:3/586: read - d12/d18/d1f/d23/d2a/d3e/d48/d7b/f85 zero size 2023-12-16T03:15:58.035 INFO:tasks.workunit.client.1.smithi184.stdout:3/587: write d12/d18/d1f/d23/d2a/d3e/d48/d7b/f85 [922875,73312] 0 2023-12-16T03:15:58.036 INFO:tasks.workunit.client.0.smithi064.stdout:6/194: rename d3/d8/d13/f2c to d3/d8/da/f37 0 2023-12-16T03:15:58.037 INFO:tasks.workunit.client.1.smithi184.stdout:2/412: creat d3/d29/d2f/d2e/f8e x:0 0 0 2023-12-16T03:15:58.037 INFO:tasks.workunit.client.1.smithi184.stdout:2/413: chown d3 886087841 1 2023-12-16T03:15:58.037 INFO:tasks.workunit.client.1.smithi184.stdout:2/414: chown d3/d29/d2f/d46/f7e 191100670 1 2023-12-16T03:15:58.037 INFO:tasks.workunit.client.1.smithi184.stdout:2/415: fdatasync d3/d13/d28/f3e 0 2023-12-16T03:15:58.037 INFO:tasks.workunit.client.1.smithi184.stdout:2/416: write d3/d9/f86 [44495,112476] 0 2023-12-16T03:15:58.038 INFO:tasks.workunit.client.1.smithi184.stdout:6/609: mknod d0/d5/d22/d34/cc3 0 2023-12-16T03:15:58.038 INFO:tasks.workunit.client.1.smithi184.stdout:6/610: truncate d0/d5/d22/d25/d47/f8f 4515161 0 2023-12-16T03:15:58.038 INFO:tasks.workunit.client.1.smithi184.stdout:6/611: write d0/d5/d22/d25/d47/fac [420087,96515] 0 2023-12-16T03:15:58.039 INFO:tasks.workunit.client.0.smithi064.stdout:6/195: symlink d3/d8/da/l38 0 2023-12-16T03:15:58.042 INFO:tasks.workunit.client.1.smithi184.stdout:9/747: creat d0/d76/da2/dc4/f105 x:0 0 0 2023-12-16T03:15:58.042 INFO:tasks.workunit.client.1.smithi184.stdout:3/588: creat d12/d18/d1f/d23/d2a/d42/d52/d76/fda x:0 0 0 2023-12-16T03:15:58.043 INFO:tasks.workunit.client.0.smithi064.stdout:6/196: read d3/d8/d13/f1b [2545865,55684] 0 2023-12-16T03:15:58.043 INFO:tasks.workunit.client.1.smithi184.stdout:6/612: creat d0/d5/d22/d37/d45/fc4 x:0 0 0 2023-12-16T03:15:58.043 INFO:tasks.workunit.client.1.smithi184.stdout:6/613: chown d0/d5/d22/d37/c5e 2149 1 2023-12-16T03:15:58.043 INFO:tasks.workunit.client.1.smithi184.stdout:6/614: readlink d0/d5/l10 0 2023-12-16T03:15:58.043 INFO:tasks.workunit.client.1.smithi184.stdout:6/615: chown d0/d5/d22/d37/l9d 757489 1 2023-12-16T03:15:58.044 INFO:tasks.workunit.client.0.smithi064.stdout:6/197: read d3/f5 [3279048,113063] 0 2023-12-16T03:15:58.044 INFO:tasks.workunit.client.0.smithi064.stdout:9/188: sync 2023-12-16T03:15:58.044 INFO:tasks.workunit.client.0.smithi064.stdout:3/293: sync 2023-12-16T03:15:58.044 INFO:tasks.workunit.client.0.smithi064.stdout:5/231: sync 2023-12-16T03:15:58.044 INFO:tasks.workunit.client.0.smithi064.stdout:5/232: fdatasync d0/de/f36 0 2023-12-16T03:15:58.044 INFO:tasks.workunit.client.0.smithi064.stdout:5/233: fsync d0/f3 0 2023-12-16T03:15:58.047 INFO:tasks.workunit.client.0.smithi064.stdout:3/294: rmdir db/d13/d39 39 2023-12-16T03:15:58.047 INFO:tasks.workunit.client.0.smithi064.stdout:3/295: readlink db/d12/d21/l22 0 2023-12-16T03:15:58.047 INFO:tasks.workunit.client.0.smithi064.stdout:9/189: creat d2/f33 x:0 0 0 2023-12-16T03:15:58.047 INFO:tasks.workunit.client.0.smithi064.stdout:8/326: dwrite d0/da/f30 [0,4194304] 0 2023-12-16T03:15:58.048 INFO:tasks.workunit.client.1.smithi184.stdout:4/459: dwrite d1/d11/d1b/f87 [0,4194304] 0 2023-12-16T03:15:58.048 INFO:tasks.workunit.client.1.smithi184.stdout:8/585: dread d2/d4/f2e [0,4194304] 0 2023-12-16T03:15:58.048 INFO:tasks.workunit.client.1.smithi184.stdout:8/586: write d2/d4/d10/d2a/f5c [4386653,129630] 0 2023-12-16T03:15:58.048 INFO:tasks.workunit.client.1.smithi184.stdout:8/587: chown d2/d6a/faf 30179343 1 2023-12-16T03:15:58.048 INFO:tasks.workunit.client.1.smithi184.stdout:9/748: mkdir d0/d13/d20/d5b/d43/dc7/d106 0 2023-12-16T03:15:58.048 INFO:tasks.workunit.client.1.smithi184.stdout:9/749: stat d0/d13/f69 0 2023-12-16T03:15:58.049 INFO:tasks.workunit.client.0.smithi064.stdout:3/296: truncate db/d12/d1a/f40 618782 0 2023-12-16T03:15:58.050 INFO:tasks.workunit.client.0.smithi064.stdout:9/190: mkdir d2/d2d/d31/d34 0 2023-12-16T03:15:58.050 INFO:tasks.workunit.client.1.smithi184.stdout:6/616: mkdir d0/d5/d12/d1b/d33/d3d/d96/dc5 0 2023-12-16T03:15:58.051 INFO:tasks.workunit.client.0.smithi064.stdout:8/327: mknod d0/db/d12/d1c/d59/c71 0 2023-12-16T03:15:58.051 INFO:tasks.workunit.client.1.smithi184.stdout:4/460: creat d1/d12/d13/d40/d43/d5e/d6a/f97 x:0 0 0 2023-12-16T03:15:58.051 INFO:tasks.workunit.client.0.smithi064.stdout:3/297: getdents db/d12 0 2023-12-16T03:15:58.052 INFO:tasks.workunit.client.0.smithi064.stdout:3/298: stat db/d12/d1a/d2c/f44 0 2023-12-16T03:15:58.053 INFO:tasks.workunit.client.0.smithi064.stdout:9/191: mknod d2/c35 0 2023-12-16T03:15:58.053 INFO:tasks.workunit.client.0.smithi064.stdout:9/192: stat d2/c1e 0 2023-12-16T03:15:58.053 INFO:tasks.workunit.client.0.smithi064.stdout:9/193: fdatasync f1 0 2023-12-16T03:15:58.053 INFO:tasks.workunit.client.0.smithi064.stdout:8/328: rmdir d0/d1d/d48 39 2023-12-16T03:15:58.054 INFO:tasks.workunit.client.0.smithi064.stdout:8/329: fdatasync d0/d1d/f20 0 2023-12-16T03:15:58.054 INFO:tasks.workunit.client.0.smithi064.stdout:0/180: dwrite d2/f16 [0,4194304] 0 2023-12-16T03:15:58.054 INFO:tasks.workunit.client.1.smithi184.stdout:8/588: rename d2/d4/da6/laa to d2/d37/lbc 0 2023-12-16T03:15:58.054 INFO:tasks.workunit.client.1.smithi184.stdout:8/589: chown d2/d4/d10/d11/d72/cad 2256 1 2023-12-16T03:15:58.054 INFO:tasks.workunit.client.0.smithi064.stdout:3/299: mknod db/d13/d39/c68 0 2023-12-16T03:15:58.055 INFO:tasks.workunit.client.0.smithi064.stdout:0/181: creat d2/d7/d10/d21/f39 x:0 0 0 2023-12-16T03:15:58.055 INFO:tasks.workunit.client.1.smithi184.stdout:4/461: dread d1/d29/d34/d5c/d76/d33/f81 [0,4194304] 0 2023-12-16T03:15:58.055 INFO:tasks.workunit.client.1.smithi184.stdout:4/462: truncate d1/d29/d34/d5c/d76/f8f 302212 0 2023-12-16T03:15:58.056 INFO:tasks.workunit.client.1.smithi184.stdout:6/617: creat d0/fc6 x:0 0 0 2023-12-16T03:15:58.057 INFO:tasks.workunit.client.0.smithi064.stdout:3/300: creat db/d12/d21/f69 x:0 0 0 2023-12-16T03:15:58.058 INFO:tasks.workunit.client.0.smithi064.stdout:7/263: dwrite d7/d3e/d42/f44 [0,4194304] 0 2023-12-16T03:15:58.059 INFO:tasks.workunit.client.0.smithi064.stdout:7/264: chown d7/d3e/d42 41 1 2023-12-16T03:15:58.059 INFO:tasks.workunit.client.1.smithi184.stdout:3/589: dread d12/d18/d68/f69 [0,4194304] 0 2023-12-16T03:15:58.059 INFO:tasks.workunit.client.1.smithi184.stdout:3/590: chown d12/d18/d68/l75 874271885 1 2023-12-16T03:15:58.060 INFO:tasks.workunit.client.0.smithi064.stdout:3/301: mkdir db/d12/d1a/d2c/d34/d4c/d6a 0 2023-12-16T03:15:58.061 INFO:tasks.workunit.client.1.smithi184.stdout:8/590: rmdir d2/d4/d10/d75 39 2023-12-16T03:15:58.061 INFO:tasks.workunit.client.1.smithi184.stdout:6/618: symlink d0/d36/d8a/lc7 0 2023-12-16T03:15:58.061 INFO:tasks.workunit.client.1.smithi184.stdout:9/750: write d0/d3a/d47/f93 [196115,110565] 0 2023-12-16T03:15:58.066 INFO:tasks.workunit.client.0.smithi064.stdout:6/198: dread d3/fd [0,4194304] 0 2023-12-16T03:15:58.066 INFO:tasks.workunit.client.1.smithi184.stdout:6/619: symlink d0/d5/d12/d1b/d33/lc8 0 2023-12-16T03:15:58.066 INFO:tasks.workunit.client.1.smithi184.stdout:1/552: dwrite d3/d28/d3c/d41/d46/d4a/fad [0,4194304] 0 2023-12-16T03:15:58.068 INFO:tasks.workunit.client.0.smithi064.stdout:7/265: truncate d7/d26/f27 816830 0 2023-12-16T03:15:58.068 INFO:tasks.workunit.client.0.smithi064.stdout:7/266: write d7/f53 [829121,112748] 0 2023-12-16T03:15:58.068 INFO:tasks.workunit.client.0.smithi064.stdout:7/267: chown d7/d13/d20/d37/c3f 52 1 2023-12-16T03:15:58.071 INFO:tasks.workunit.client.1.smithi184.stdout:1/553: dread d3/d28/d38/d52/fb5 [0,4194304] 0 2023-12-16T03:15:58.072 INFO:tasks.workunit.client.0.smithi064.stdout:7/268: creat d7/d3e/f55 x:0 0 0 2023-12-16T03:15:58.074 INFO:tasks.workunit.client.1.smithi184.stdout:2/417: dwrite d3/d29/d2f/d46/d77/f7f [0,4194304] 0 2023-12-16T03:15:58.074 INFO:tasks.workunit.client.1.smithi184.stdout:5/405: dwrite d1/d3/d9/de/d15/f52 [0,4194304] 0 2023-12-16T03:15:58.074 INFO:tasks.workunit.client.1.smithi184.stdout:2/418: write d3/d9/d19/f4f [339552,48377] 0 2023-12-16T03:15:58.075 INFO:tasks.workunit.client.1.smithi184.stdout:2/419: fdatasync d3/d29/f30 0 2023-12-16T03:15:58.075 INFO:tasks.workunit.client.1.smithi184.stdout:9/751: write d0/d13/d20/d5b/f56 [2070744,72075] 0 2023-12-16T03:15:58.076 INFO:tasks.workunit.client.0.smithi064.stdout:4/278: dwrite d0/f5 [0,4194304] 0 2023-12-16T03:15:58.076 INFO:tasks.workunit.client.0.smithi064.stdout:4/279: read - d0/d12/f35 zero size 2023-12-16T03:15:58.077 INFO:tasks.workunit.client.0.smithi064.stdout:3/302: dread db/d12/d21/f49 [0,4194304] 0 2023-12-16T03:15:58.083 INFO:tasks.workunit.client.0.smithi064.stdout:0/182: dread d2/d7/d10/d21/f24 [0,4194304] 0 2023-12-16T03:15:58.083 INFO:tasks.workunit.client.0.smithi064.stdout:0/183: fdatasync d2/d8/da/df/f37 0 2023-12-16T03:15:58.083 INFO:tasks.workunit.client.0.smithi064.stdout:0/184: readlink d2/d7/d10/d21/l25 0 2023-12-16T03:15:58.083 INFO:tasks.workunit.client.0.smithi064.stdout:7/269: mknod d7/d3e/d42/d43/d46/d52/c56 0 2023-12-16T03:15:58.084 INFO:tasks.workunit.client.1.smithi184.stdout:1/554: mknod d3/d28/cb9 0 2023-12-16T03:15:58.086 INFO:tasks.workunit.client.0.smithi064.stdout:7/270: rmdir d7/d3e/d42/d48/d50 0 2023-12-16T03:15:58.090 INFO:tasks.workunit.client.1.smithi184.stdout:5/406: creat d1/d3/d9/de/d15/f82 x:0 0 0 2023-12-16T03:15:58.090 INFO:tasks.workunit.client.0.smithi064.stdout:0/185: write d2/d8/f1b [4145744,42067] 0 2023-12-16T03:15:58.091 INFO:tasks.workunit.client.1.smithi184.stdout:5/407: mknod d1/d2a/c83 0 2023-12-16T03:15:58.091 INFO:tasks.workunit.client.1.smithi184.stdout:5/408: fsync d1/d3/d9/de/d15/d19/d5f/f41 0 2023-12-16T03:15:58.095 INFO:tasks.workunit.client.0.smithi064.stdout:7/271: dread d7/f3b [0,4194304] 0 2023-12-16T03:15:58.095 INFO:tasks.workunit.client.0.smithi064.stdout:4/280: read d0/f11 [3853177,97474] 0 2023-12-16T03:15:58.095 INFO:tasks.workunit.client.0.smithi064.stdout:7/272: write d7/d13/d20/f3a [711909,80824] 0 2023-12-16T03:15:58.099 INFO:tasks.workunit.client.0.smithi064.stdout:0/186: symlink d2/d7/l3a 0 2023-12-16T03:15:58.101 INFO:tasks.workunit.client.0.smithi064.stdout:4/281: rename d0/da/l40 to d0/d14/d33/l50 0 2023-12-16T03:15:58.101 INFO:tasks.workunit.client.0.smithi064.stdout:4/282: write d0/d1e/d36/f46 [1021037,100321] 0 2023-12-16T03:15:58.103 INFO:tasks.workunit.client.0.smithi064.stdout:0/187: symlink d2/d8/da/df/l3b 0 2023-12-16T03:15:58.104 INFO:tasks.workunit.client.0.smithi064.stdout:0/188: chown d2/d7/d10/f1a 32527728 1 2023-12-16T03:15:58.104 INFO:tasks.workunit.client.0.smithi064.stdout:0/189: chown d2/d8/da/c19 247 1 2023-12-16T03:15:58.104 INFO:tasks.workunit.client.0.smithi064.stdout:0/190: chown d2/d8/da/l13 96 1 2023-12-16T03:15:58.109 INFO:tasks.workunit.client.0.smithi064.stdout:8/330: dwrite d0/da/d3e/f53 [0,4194304] 0 2023-12-16T03:15:58.109 INFO:tasks.workunit.client.0.smithi064.stdout:8/331: readlink d0/d1d/d24/l1a 0 2023-12-16T03:15:58.110 INFO:tasks.workunit.client.0.smithi064.stdout:4/283: symlink d0/d12/d48/l51 0 2023-12-16T03:15:58.111 INFO:tasks.workunit.client.1.smithi184.stdout:8/591: dwrite d2/d4/d10/d11/fac [0,4194304] 0 2023-12-16T03:15:58.112 INFO:tasks.workunit.client.0.smithi064.stdout:0/191: creat d2/d7/d10/d21/d31/f3c x:0 0 0 2023-12-16T03:15:58.115 INFO:tasks.workunit.client.1.smithi184.stdout:9/752: dwrite d0/f2f [0,4194304] 0 2023-12-16T03:15:58.115 INFO:tasks.workunit.client.1.smithi184.stdout:9/753: fdatasync d0/d13/d20/f55 0 2023-12-16T03:15:58.117 INFO:tasks.workunit.client.1.smithi184.stdout:8/592: rename d2/d12/l55 to d2/d4/d10/lbd 0 2023-12-16T03:15:58.118 INFO:tasks.workunit.client.1.smithi184.stdout:8/593: readlink d2/d37/l79 0 2023-12-16T03:15:58.118 INFO:tasks.workunit.client.0.smithi064.stdout:4/284: creat d0/d42/f52 x:0 0 0 2023-12-16T03:15:58.118 INFO:tasks.workunit.client.0.smithi064.stdout:4/285: chown d0/d42/l4b 445 1 2023-12-16T03:15:58.122 INFO:tasks.workunit.client.0.smithi064.stdout:7/273: dread d7/d13/d20/f3a [0,4194304] 0 2023-12-16T03:15:58.125 INFO:tasks.workunit.client.1.smithi184.stdout:6/620: dwrite d0/d5/d12/d1b/d33/f58 [0,4194304] 0 2023-12-16T03:15:58.125 INFO:tasks.workunit.client.1.smithi184.stdout:4/463: dwrite d1/d29/d34/d5c/d76/f69 [0,4194304] 0 2023-12-16T03:15:58.126 INFO:tasks.workunit.client.1.smithi184.stdout:8/594: creat d2/d4/d10/d99/fbe x:0 0 0 2023-12-16T03:15:58.132 INFO:tasks.workunit.client.0.smithi064.stdout:6/199: dwrite d3/d8/d1f/f22 [0,4194304] 0 2023-12-16T03:15:58.133 INFO:tasks.workunit.client.1.smithi184.stdout:3/591: dwrite d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/fc9 [0,4194304] 0 2023-12-16T03:15:58.133 INFO:tasks.workunit.client.1.smithi184.stdout:8/595: symlink d2/d4/d10/d11/d72/lbf 0 2023-12-16T03:15:58.133 INFO:tasks.workunit.client.1.smithi184.stdout:5/409: dwrite d1/d3/fa [0,4194304] 0 2023-12-16T03:15:58.133 INFO:tasks.workunit.client.1.smithi184.stdout:5/410: stat d1/d3/d2f 0 2023-12-16T03:15:58.133 INFO:tasks.workunit.client.1.smithi184.stdout:5/411: chown d1/d3/d9/de/d30 3374 1 2023-12-16T03:15:58.133 INFO:tasks.workunit.client.0.smithi064.stdout:4/286: rename d0/d12/d17 to d0/d42/d53 0 2023-12-16T03:15:58.133 INFO:tasks.workunit.client.0.smithi064.stdout:7/274: creat d7/d26/d30/f57 x:0 0 0 2023-12-16T03:15:58.133 INFO:tasks.workunit.client.0.smithi064.stdout:7/275: write d7/f9 [2104818,103986] 0 2023-12-16T03:15:58.137 INFO:tasks.workunit.client.1.smithi184.stdout:3/592: mkdir d12/d1e/da3/ddb 0 2023-12-16T03:15:58.137 INFO:tasks.workunit.client.1.smithi184.stdout:3/593: write d12/d18/d1f/d23/d2a/d4a/fd2 [4999,120517] 0 2023-12-16T03:15:58.143 INFO:tasks.workunit.client.0.smithi064.stdout:4/287: creat d0/d42/d4c/f54 x:0 0 0 2023-12-16T03:15:58.143 INFO:tasks.workunit.client.0.smithi064.stdout:4/288: chown d0/d1e/f29 149844053 1 2023-12-16T03:15:58.143 INFO:tasks.workunit.client.0.smithi064.stdout:4/289: chown d0/da/c39 219 1 2023-12-16T03:15:58.144 INFO:tasks.workunit.client.0.smithi064.stdout:7/276: symlink d7/d3e/d42/d48/l58 0 2023-12-16T03:15:58.145 INFO:tasks.workunit.client.0.smithi064.stdout:6/200: dread d3/d8/d13/f1b [0,4194304] 0 2023-12-16T03:15:58.145 INFO:tasks.workunit.client.0.smithi064.stdout:6/201: chown d3/fd 12908877 1 2023-12-16T03:15:58.145 INFO:tasks.workunit.client.1.smithi184.stdout:6/621: dread d0/d5/d26/f75 [0,4194304] 0 2023-12-16T03:15:58.145 INFO:tasks.workunit.client.1.smithi184.stdout:6/622: chown d0/d5/f4a 1361118 1 2023-12-16T03:15:58.145 INFO:tasks.workunit.client.1.smithi184.stdout:8/596: truncate d2/d12/d21/d2d/d31/f3a 7845 0 2023-12-16T03:15:58.146 INFO:tasks.workunit.client.1.smithi184.stdout:6/623: symlink d0/d36/d8a/lc9 0 2023-12-16T03:15:58.146 INFO:tasks.workunit.client.1.smithi184.stdout:5/412: dread d1/d3/d2f/f6d [0,4194304] 0 2023-12-16T03:15:58.146 INFO:tasks.workunit.client.1.smithi184.stdout:8/597: creat d2/d37/d7c/fc0 x:0 0 0 2023-12-16T03:15:58.146 INFO:tasks.workunit.client.1.smithi184.stdout:5/413: creat d1/d3/d9/de/d15/d19/d5f/d45/f84 x:0 0 0 2023-12-16T03:15:58.147 INFO:tasks.workunit.client.1.smithi184.stdout:1/555: dwrite d3/d28/d3c/d41/f4d [0,4194304] 0 2023-12-16T03:15:58.147 INFO:tasks.workunit.client.0.smithi064.stdout:4/290: mkdir d0/d42/d55 0 2023-12-16T03:15:58.151 INFO:tasks.workunit.client.1.smithi184.stdout:1/556: creat d3/d28/d3c/d41/d77/fba x:0 0 0 2023-12-16T03:15:58.151 INFO:tasks.workunit.client.1.smithi184.stdout:1/557: write d3/d34/f4e [1554502,18362] 0 2023-12-16T03:15:58.151 INFO:tasks.workunit.client.1.smithi184.stdout:1/558: truncate d3/d13/f92 835628 0 2023-12-16T03:15:58.152 INFO:tasks.workunit.client.1.smithi184.stdout:5/414: creat d1/d3/d9/de/d15/d19/d48/f85 x:0 0 0 2023-12-16T03:15:58.152 INFO:tasks.workunit.client.0.smithi064.stdout:7/277: unlink d7/d13/d20/d37/c3f 0 2023-12-16T03:15:58.152 INFO:tasks.workunit.client.0.smithi064.stdout:6/202: creat d3/d8/d13/f39 x:0 0 0 2023-12-16T03:15:58.152 INFO:tasks.workunit.client.0.smithi064.stdout:4/291: dread d0/d14/d33/f38 [0,4194304] 0 2023-12-16T03:15:58.153 INFO:tasks.workunit.client.1.smithi184.stdout:6/624: symlink d0/d5/d12/lca 0 2023-12-16T03:15:58.153 INFO:tasks.workunit.client.0.smithi064.stdout:6/203: getdents d3/d8/d1f/d26 0 2023-12-16T03:15:58.153 INFO:tasks.workunit.client.0.smithi064.stdout:6/204: symlink d3/d8/d1f/d26/l3a 0 2023-12-16T03:15:58.154 INFO:tasks.workunit.client.1.smithi184.stdout:1/559: creat d3/d28/d3c/d41/d46/d4a/d6a/d6d/d99/db7/fbb x:0 0 0 2023-12-16T03:15:58.155 INFO:tasks.workunit.client.0.smithi064.stdout:6/205: creat d3/d8/d1f/d26/f3b x:0 0 0 2023-12-16T03:15:58.159 INFO:tasks.workunit.client.1.smithi184.stdout:3/594: dread fd [0,4194304] 0 2023-12-16T03:15:58.159 INFO:tasks.workunit.client.1.smithi184.stdout:3/595: read - d12/d18/d1f/d23/d2a/d3e/f9b zero size 2023-12-16T03:15:58.159 INFO:tasks.workunit.client.0.smithi064.stdout:7/278: write d7/f9 [1739098,99] 0 2023-12-16T03:15:58.160 INFO:tasks.workunit.client.0.smithi064.stdout:6/206: unlink d3/c21 0 2023-12-16T03:15:58.161 INFO:tasks.workunit.client.0.smithi064.stdout:7/279: dread d7/d13/f29 [0,4194304] 0 2023-12-16T03:15:58.162 INFO:tasks.workunit.client.0.smithi064.stdout:7/280: dread d7/d26/f27 [0,4194304] 0 2023-12-16T03:15:58.163 INFO:tasks.workunit.client.1.smithi184.stdout:3/596: creat d12/d18/d1f/d23/d2a/d42/d52/d76/d80/fdc x:0 0 0 2023-12-16T03:15:58.163 INFO:tasks.workunit.client.1.smithi184.stdout:2/420: dwrite d3/d9/d19/f4f [0,4194304] 0 2023-12-16T03:15:58.163 INFO:tasks.workunit.client.1.smithi184.stdout:2/421: dread - d3/d13/d28/f69 zero size 2023-12-16T03:15:58.164 INFO:tasks.workunit.client.0.smithi064.stdout:8/332: dwrite d0/f7 [0,4194304] 0 2023-12-16T03:15:58.166 INFO:tasks.workunit.client.1.smithi184.stdout:9/754: dwrite d0/d13/f91 [0,4194304] 0 2023-12-16T03:15:58.175 INFO:tasks.workunit.client.1.smithi184.stdout:4/464: dwrite d1/d29/d34/f48 [0,4194304] 0 2023-12-16T03:15:58.177 INFO:tasks.workunit.client.1.smithi184.stdout:3/597: creat d12/d18/d7a/dba/fdd x:0 0 0 2023-12-16T03:15:58.177 INFO:tasks.workunit.client.1.smithi184.stdout:4/465: write d1/d29/d34/d5c/d76/d3b/f3f [230939,99237] 0 2023-12-16T03:15:58.179 INFO:tasks.workunit.client.0.smithi064.stdout:0/192: dwrite d2/f5 [0,4194304] 0 2023-12-16T03:15:58.180 INFO:tasks.workunit.client.1.smithi184.stdout:8/598: dwrite d2/d12/d21/d2d/d31/f68 [0,4194304] 0 2023-12-16T03:15:58.180 INFO:tasks.workunit.client.1.smithi184.stdout:8/599: chown d2/f13 26 1 2023-12-16T03:15:58.180 INFO:tasks.workunit.client.1.smithi184.stdout:2/422: rmdir d3/d9/d19/d87 39 2023-12-16T03:15:58.180 INFO:tasks.workunit.client.1.smithi184.stdout:2/423: dread - d3/d9/f85 zero size 2023-12-16T03:15:58.181 INFO:tasks.workunit.client.1.smithi184.stdout:5/415: dwrite d1/d3/d9/de/d15/f57 [4194304,4194304] 0 2023-12-16T03:15:58.181 INFO:tasks.workunit.client.1.smithi184.stdout:9/755: link d0/d13/d6e/d84/le7 d0/d76/db2/l107 0 2023-12-16T03:15:58.182 INFO:tasks.workunit.client.1.smithi184.stdout:8/600: dread d2/d12/d21/f53 [0,4194304] 0 2023-12-16T03:15:58.183 INFO:tasks.workunit.client.1.smithi184.stdout:8/601: stat d2/d12/d21/d30/fb1 0 2023-12-16T03:15:58.183 INFO:tasks.workunit.client.1.smithi184.stdout:8/602: chown d2/d12/db4/fb9 5100596 1 2023-12-16T03:15:58.183 INFO:tasks.workunit.client.1.smithi184.stdout:8/603: chown d2/d4/l1f 16023562 1 2023-12-16T03:15:58.183 INFO:tasks.workunit.client.0.smithi064.stdout:7/281: rmdir d7/d3e/d42 39 2023-12-16T03:15:58.183 INFO:tasks.workunit.client.0.smithi064.stdout:7/282: chown d7/d26/d30 10522109 1 2023-12-16T03:15:58.187 INFO:tasks.workunit.client.1.smithi184.stdout:4/466: rename d1/d11/d1b/d44 to d1/d11/d5a/d63/d72/d98 0 2023-12-16T03:15:58.189 INFO:tasks.workunit.client.0.smithi064.stdout:1/247: sync 2023-12-16T03:15:58.189 INFO:tasks.workunit.client.1.smithi184.stdout:2/424: symlink d3/d29/d2f/d2e/l8f 0 2023-12-16T03:15:58.189 INFO:tasks.workunit.client.0.smithi064.stdout:7/283: mknod d7/d13/d20/d4a/c59 0 2023-12-16T03:15:58.190 INFO:tasks.workunit.client.0.smithi064.stdout:2/224: sync 2023-12-16T03:15:58.190 INFO:tasks.workunit.client.1.smithi184.stdout:9/756: mknod d0/d76/c108 0 2023-12-16T03:15:58.191 INFO:tasks.workunit.client.1.smithi184.stdout:9/757: truncate d0/d13/f69 1180957 0 2023-12-16T03:15:58.193 INFO:tasks.workunit.client.0.smithi064.stdout:2/225: creat d1/d15/f3e x:0 0 0 2023-12-16T03:15:58.194 INFO:tasks.workunit.client.0.smithi064.stdout:2/226: chown d1/d15/d1b/l20 11308 1 2023-12-16T03:15:58.196 INFO:tasks.workunit.client.0.smithi064.stdout:2/227: creat d1/d15/d1e/f3f x:0 0 0 2023-12-16T03:15:58.197 INFO:tasks.workunit.client.0.smithi064.stdout:1/248: dread d3/f26 [0,4194304] 0 2023-12-16T03:15:58.197 INFO:tasks.workunit.client.0.smithi064.stdout:1/249: chown d3/dd/d11/c1e 1282898937 1 2023-12-16T03:15:58.198 INFO:tasks.workunit.client.1.smithi184.stdout:8/604: mknod d2/d12/d21/d2d/d31/d34/d96/cc1 0 2023-12-16T03:15:58.198 INFO:tasks.workunit.client.1.smithi184.stdout:3/598: dwrite d12/d18/d1f/d23/d2a/fbb [0,4194304] 0 2023-12-16T03:15:58.198 INFO:tasks.workunit.client.1.smithi184.stdout:4/467: mknod d1/d11/d5a/d63/c99 0 2023-12-16T03:15:58.198 INFO:tasks.workunit.client.1.smithi184.stdout:5/416: dread d1/d3/d2f/f3d [0,4194304] 0 2023-12-16T03:15:58.199 INFO:tasks.workunit.client.1.smithi184.stdout:2/425: rename d3/d9/d19/d87/f4e to d3/d29/d61/d6d/f90 0 2023-12-16T03:15:58.200 INFO:tasks.workunit.client.1.smithi184.stdout:9/758: getdents d0/d13/d20/d5b/d43/dc7 0 2023-12-16T03:15:58.200 INFO:tasks.workunit.client.1.smithi184.stdout:9/759: dread - d0/d76/da2/f104 zero size 2023-12-16T03:15:58.202 INFO:tasks.workunit.client.0.smithi064.stdout:1/250: rename d3/dd/c27 to d3/c52 0 2023-12-16T03:15:58.203 INFO:tasks.workunit.client.0.smithi064.stdout:2/228: read d1/f9 [931426,59337] 0 2023-12-16T03:15:58.206 INFO:tasks.workunit.client.1.smithi184.stdout:3/599: creat d12/d18/d1f/d23/d2a/d42/d52/d76/d80/fde x:0 0 0 2023-12-16T03:15:58.206 INFO:tasks.workunit.client.1.smithi184.stdout:3/600: write d12/d86/fc5 [874206,61126] 0 2023-12-16T03:15:58.206 INFO:tasks.workunit.client.1.smithi184.stdout:3/601: rename d12 to d12/d18/da1/dbd/dc8/ddf 22 2023-12-16T03:15:58.206 INFO:tasks.workunit.client.1.smithi184.stdout:3/602: readlink d12/d18/d1f/d23/d2a/d42/d52/d76/da5/lc0 0 2023-12-16T03:15:58.206 INFO:tasks.workunit.client.1.smithi184.stdout:3/603: read - d12/d18/d68/f9d zero size 2023-12-16T03:15:58.207 INFO:tasks.workunit.client.1.smithi184.stdout:1/560: rmdir d3/d28/d3c/d41 39 2023-12-16T03:15:58.207 INFO:tasks.workunit.client.1.smithi184.stdout:1/561: chown f0 6485811 1 2023-12-16T03:15:58.207 INFO:tasks.workunit.client.1.smithi184.stdout:1/562: fsync d3/d28/d3c/d41/d77/fba 0 2023-12-16T03:15:58.208 INFO:tasks.workunit.client.0.smithi064.stdout:1/251: unlink d3/d36/d44/d4d/f3a 0 2023-12-16T03:15:58.209 INFO:tasks.workunit.client.1.smithi184.stdout:8/605: dread d2/d4/d10/f59 [0,4194304] 0 2023-12-16T03:15:58.209 INFO:tasks.workunit.client.0.smithi064.stdout:2/229: fsync d1/f10 0 2023-12-16T03:15:58.210 INFO:tasks.workunit.client.1.smithi184.stdout:4/468: creat d1/d29/d37/f9a x:0 0 0 2023-12-16T03:15:58.210 INFO:tasks.workunit.client.1.smithi184.stdout:4/469: read - d1/d12/d13/d40/d43/d5e/d6a/f97 zero size 2023-12-16T03:15:58.210 INFO:tasks.workunit.client.1.smithi184.stdout:4/470: dread - d1/d29/f95 zero size 2023-12-16T03:15:58.211 INFO:tasks.workunit.client.0.smithi064.stdout:1/252: creat d3/dd/d23/d41/f53 x:0 0 0 2023-12-16T03:15:58.212 INFO:tasks.workunit.client.0.smithi064.stdout:2/230: symlink d1/d27/l40 0 2023-12-16T03:15:58.212 INFO:tasks.workunit.client.0.smithi064.stdout:2/231: stat d1/f6 0 2023-12-16T03:15:58.213 INFO:tasks.workunit.client.1.smithi184.stdout:5/417: creat d1/d3/d9/de/d30/f86 x:0 0 0 2023-12-16T03:15:58.213 INFO:tasks.workunit.client.1.smithi184.stdout:5/418: stat d1/d3/d9/de/d30/l46 0 2023-12-16T03:15:58.214 INFO:tasks.workunit.client.1.smithi184.stdout:9/760: link d0/d13/f21 d0/d76/dbf/f109 0 2023-12-16T03:15:58.214 INFO:tasks.workunit.client.1.smithi184.stdout:9/761: readlink d0/d30/ddf/df7/l101 0 2023-12-16T03:15:58.215 INFO:tasks.workunit.client.1.smithi184.stdout:3/604: link d12/d18/d68/l75 d12/d18/d1f/d23/d2a/d42/d52/d7f/d99/le0 0 2023-12-16T03:15:58.216 INFO:tasks.workunit.client.1.smithi184.stdout:3/605: chown d12/d1e/da3/lb9 103 1 2023-12-16T03:15:58.216 INFO:tasks.workunit.client.0.smithi064.stdout:1/253: write d3/dd/d23/d41/f4b [896473,96389] 0 2023-12-16T03:15:58.216 INFO:tasks.workunit.client.0.smithi064.stdout:1/254: chown d3/dd/d11/d3b/f3e 75140 1 2023-12-16T03:15:58.219 INFO:tasks.workunit.client.0.smithi064.stdout:1/255: read d3/d36/d44/d4d/f4e [2731891,49976] 0 2023-12-16T03:15:58.219 INFO:tasks.workunit.client.0.smithi064.stdout:1/256: truncate d3/d36/d44/f48 59120 0 2023-12-16T03:15:58.220 INFO:tasks.workunit.client.0.smithi064.stdout:2/232: dread d1/d15/f1a [0,4194304] 0 2023-12-16T03:15:58.221 INFO:tasks.workunit.client.1.smithi184.stdout:1/563: rename d3/d28 to d3/d34/dbc 0 2023-12-16T03:15:58.221 INFO:tasks.workunit.client.1.smithi184.stdout:9/762: creat d0/d30/ddf/f10a x:0 0 0 2023-12-16T03:15:58.221 INFO:tasks.workunit.client.0.smithi064.stdout:1/257: creat d3/dd/d23/d4f/f54 x:0 0 0 2023-12-16T03:15:58.223 INFO:tasks.workunit.client.0.smithi064.stdout:2/233: mknod d1/d27/d35/c41 0 2023-12-16T03:15:58.223 INFO:tasks.workunit.client.1.smithi184.stdout:3/606: mkdir d12/d18/d7a/dba/de1 0 2023-12-16T03:15:58.227 INFO:tasks.workunit.client.1.smithi184.stdout:1/564: dread d3/d34/dbc/d3c/d41/f4b [0,4194304] 0 2023-12-16T03:15:58.227 INFO:tasks.workunit.client.0.smithi064.stdout:2/234: truncate d1/f1d 3206552 0 2023-12-16T03:15:58.227 INFO:tasks.workunit.client.0.smithi064.stdout:7/284: dwrite d7/d13/d20/f21 [0,4194304] 0 2023-12-16T03:15:58.229 INFO:tasks.workunit.client.0.smithi064.stdout:2/235: mkdir d1/d15/d1e/d42 0 2023-12-16T03:15:58.230 INFO:tasks.workunit.client.0.smithi064.stdout:7/285: rmdir d7/d13 39 2023-12-16T03:15:58.230 INFO:tasks.workunit.client.0.smithi064.stdout:7/286: chown d7/d13/d20/d37 235380 1 2023-12-16T03:15:58.230 INFO:tasks.workunit.client.0.smithi064.stdout:7/287: readlink d7/l4f 0 2023-12-16T03:15:58.231 INFO:tasks.workunit.client.0.smithi064.stdout:7/288: getdents d7/d3e/d42/d48 0 2023-12-16T03:15:58.234 INFO:tasks.workunit.client.1.smithi184.stdout:9/763: mkdir d0/d13/d6e/d84/d10b 0 2023-12-16T03:15:58.234 INFO:tasks.workunit.client.1.smithi184.stdout:3/607: symlink d12/d1e/d89/le2 0 2023-12-16T03:15:58.235 INFO:tasks.workunit.client.1.smithi184.stdout:9/764: write d0/d3a/d47/f71 [4884972,48462] 0 2023-12-16T03:15:58.235 INFO:tasks.workunit.client.1.smithi184.stdout:9/765: write d0/d76/da2/dc4/dd0/ff1 [982185,116218] 0 2023-12-16T03:15:58.237 INFO:tasks.workunit.client.1.smithi184.stdout:1/565: link d3/d34/dbc/l8f d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/lbd 0 2023-12-16T03:15:58.237 INFO:tasks.workunit.client.1.smithi184.stdout:1/566: chown d3/d34/dbc/d3c/cb8 15604913 1 2023-12-16T03:15:58.237 INFO:tasks.workunit.client.1.smithi184.stdout:3/608: truncate d12/d1e/d89/fd5 1367442 0 2023-12-16T03:15:58.238 INFO:tasks.workunit.client.1.smithi184.stdout:9/766: mkdir d0/d13/d20/d10c 0 2023-12-16T03:15:58.240 INFO:tasks.workunit.client.1.smithi184.stdout:1/567: link d3/l22 d3/d34/d76/d91/lbe 0 2023-12-16T03:15:58.240 INFO:tasks.workunit.client.1.smithi184.stdout:7/443: sync 2023-12-16T03:15:58.248 INFO:tasks.workunit.client.1.smithi184.stdout:2/426: dwrite d3/d13/d28/f3e [0,4194304] 0 2023-12-16T03:15:58.248 INFO:tasks.workunit.client.1.smithi184.stdout:8/606: dwrite d2/d6a/da4/f88 [0,4194304] 0 2023-12-16T03:15:58.249 INFO:tasks.workunit.client.1.smithi184.stdout:4/471: dwrite d1/d12/d13/d40/d43/d5e/f83 [0,4194304] 0 2023-12-16T03:15:58.249 INFO:tasks.workunit.client.1.smithi184.stdout:5/419: dwrite d1/d3/f36 [0,4194304] 0 2023-12-16T03:15:58.250 INFO:tasks.workunit.client.0.smithi064.stdout:7/289: dread d7/d13/d20/f21 [0,4194304] 0 2023-12-16T03:15:58.251 INFO:tasks.workunit.client.1.smithi184.stdout:2/427: creat d3/d29/d61/f91 x:0 0 0 2023-12-16T03:15:58.253 INFO:tasks.workunit.client.0.smithi064.stdout:7/290: symlink d7/d13/d20/l5a 0 2023-12-16T03:15:58.255 INFO:tasks.workunit.client.1.smithi184.stdout:8/607: mkdir d2/d4/d10/d11/d72/dc2 0 2023-12-16T03:15:58.258 INFO:tasks.workunit.client.0.smithi064.stdout:7/291: creat d7/d3e/d42/d48/f5b x:0 0 0 2023-12-16T03:15:58.259 INFO:tasks.workunit.client.0.smithi064.stdout:1/258: truncate d3/dd/d23/d41/f4b 64549 0 2023-12-16T03:15:58.259 INFO:tasks.workunit.client.0.smithi064.stdout:1/259: fdatasync d3/dd/d2a/f3d 0 2023-12-16T03:15:58.259 INFO:tasks.workunit.client.0.smithi064.stdout:1/260: stat d3/f26 0 2023-12-16T03:15:58.261 INFO:tasks.workunit.client.0.smithi064.stdout:7/292: rename d7/d13/d20/d4a/c59 to d7/d3e/d42/d48/c5c 0 2023-12-16T03:15:58.261 INFO:tasks.workunit.client.1.smithi184.stdout:3/609: rename d12/d18/d7a/dba to d12/d18/d1f/d23/d51/dd7/de3 0 2023-12-16T03:15:58.261 INFO:tasks.workunit.client.1.smithi184.stdout:3/610: readlink d12/d1e/l41 0 2023-12-16T03:15:58.261 INFO:tasks.workunit.client.1.smithi184.stdout:3/611: chown d12/d86/fc5 314503543 1 2023-12-16T03:15:58.262 INFO:tasks.workunit.client.1.smithi184.stdout:4/472: creat d1/d12/f9b x:0 0 0 2023-12-16T03:15:58.262 INFO:tasks.workunit.client.0.smithi064.stdout:1/261: creat d3/f55 x:0 0 0 2023-12-16T03:15:58.263 INFO:tasks.workunit.client.1.smithi184.stdout:2/428: mknod d3/d29/d2f/d46/c92 0 2023-12-16T03:15:58.264 INFO:tasks.workunit.client.0.smithi064.stdout:7/293: symlink d7/d3e/d42/d48/d51/l5d 0 2023-12-16T03:15:58.264 INFO:tasks.workunit.client.0.smithi064.stdout:7/294: truncate d7/d3e/d42/d48/f49 333785 0 2023-12-16T03:15:58.265 INFO:tasks.workunit.client.1.smithi184.stdout:8/608: creat d2/d4/d10/d11/d72/dc2/fc3 x:0 0 0 2023-12-16T03:15:58.265 INFO:tasks.workunit.client.1.smithi184.stdout:8/609: truncate d2/d12/d21/d30/fb1 794579 0 2023-12-16T03:15:58.265 INFO:tasks.workunit.client.0.smithi064.stdout:1/262: read d3/d36/d44/f48 [27057,69451] 0 2023-12-16T03:15:58.265 INFO:tasks.workunit.client.1.smithi184.stdout:1/568: dwrite d3/d34/d39/f66 [0,4194304] 0 2023-12-16T03:15:58.266 INFO:tasks.workunit.client.1.smithi184.stdout:1/569: stat d3/d34/dbc/d36/l57 0 2023-12-16T03:15:58.266 INFO:tasks.workunit.client.0.smithi064.stdout:2/236: getdents d1/d15/d1e 0 2023-12-16T03:15:58.266 INFO:tasks.workunit.client.1.smithi184.stdout:2/429: read d3/d29/d61/f68 [272486,29681] 0 2023-12-16T03:15:58.266 INFO:tasks.workunit.client.1.smithi184.stdout:9/767: dwrite d0/d76/fde [0,4194304] 0 2023-12-16T03:15:58.267 INFO:tasks.workunit.client.0.smithi064.stdout:7/295: rmdir d7/d26 39 2023-12-16T03:15:58.267 INFO:tasks.workunit.client.1.smithi184.stdout:4/473: creat d1/d29/d34/f9c x:0 0 0 2023-12-16T03:15:58.267 INFO:tasks.workunit.client.1.smithi184.stdout:5/420: dwrite d1/d3/d9/de/d15/d19/d5f/f4c [0,4194304] 0 2023-12-16T03:15:58.269 INFO:tasks.workunit.client.1.smithi184.stdout:4/474: write d1/d12/d13/d40/f4d [975323,22649] 0 2023-12-16T03:15:58.269 INFO:tasks.workunit.client.1.smithi184.stdout:7/444: rename d0/d3/d4/l4c to d0/d3/l7f 0 2023-12-16T03:15:58.270 INFO:tasks.workunit.client.0.smithi064.stdout:2/237: mknod d1/d27/d35/c43 0 2023-12-16T03:15:58.271 INFO:tasks.workunit.client.0.smithi064.stdout:7/296: fsync d7/d3e/d42/d48/f5b 0 2023-12-16T03:15:58.271 INFO:tasks.workunit.client.0.smithi064.stdout:7/297: fsync d7/f9 0 2023-12-16T03:15:58.273 INFO:tasks.workunit.client.1.smithi184.stdout:1/570: truncate d3/d34/dbc/d3c/d24/f43 1301170 0 2023-12-16T03:15:58.273 INFO:tasks.workunit.client.1.smithi184.stdout:1/571: stat d3/l84 0 2023-12-16T03:15:58.273 INFO:tasks.workunit.client.0.smithi064.stdout:1/263: unlink d3/ca 0 2023-12-16T03:15:58.273 INFO:tasks.workunit.client.0.smithi064.stdout:5/234: sync 2023-12-16T03:15:58.274 INFO:tasks.workunit.client.0.smithi064.stdout:5/235: readlink d0/d7/l11 0 2023-12-16T03:15:58.275 INFO:tasks.workunit.client.0.smithi064.stdout:2/238: truncate d1/d15/f28 469999 0 2023-12-16T03:15:58.278 INFO:tasks.workunit.client.1.smithi184.stdout:9/768: truncate d0/d3a/d47/fa9 966320 0 2023-12-16T03:15:58.279 INFO:tasks.workunit.client.0.smithi064.stdout:1/264: creat d3/dd/d11/f56 x:0 0 0 2023-12-16T03:15:58.281 INFO:tasks.workunit.client.0.smithi064.stdout:7/298: rmdir d7 39 2023-12-16T03:15:58.281 INFO:tasks.workunit.client.0.smithi064.stdout:7/299: chown d7/d13/d20/d37 681 1 2023-12-16T03:15:58.281 INFO:tasks.workunit.client.0.smithi064.stdout:7/300: dread - d7/d26/d30/f57 zero size 2023-12-16T03:15:58.282 INFO:tasks.workunit.client.0.smithi064.stdout:1/265: mkdir d3/d22/d57 0 2023-12-16T03:15:58.282 INFO:tasks.workunit.client.0.smithi064.stdout:1/266: fdatasync f2 0 2023-12-16T03:15:58.282 INFO:tasks.workunit.client.0.smithi064.stdout:1/267: write d3/dd/d23/f2c [821036,23024] 0 2023-12-16T03:15:58.282 INFO:tasks.workunit.client.0.smithi064.stdout:1/268: dread - d3/dd/d11/d2f/f4c zero size 2023-12-16T03:15:58.282 INFO:tasks.workunit.client.0.smithi064.stdout:1/269: readlink d3/dd/l47 0 2023-12-16T03:15:58.283 INFO:tasks.workunit.client.0.smithi064.stdout:7/301: getdents d7/d26/d30 0 2023-12-16T03:15:58.283 INFO:tasks.workunit.client.0.smithi064.stdout:7/302: chown d7/d13/d20/f3a 188 1 2023-12-16T03:15:58.285 INFO:tasks.workunit.client.0.smithi064.stdout:5/236: dread d0/d7/f16 [4194304,4194304] 0 2023-12-16T03:15:58.287 INFO:tasks.workunit.client.0.smithi064.stdout:1/270: rename d3/d22/d4a to d3/d36/d44/d4d/d58 0 2023-12-16T03:15:58.287 INFO:tasks.workunit.client.0.smithi064.stdout:1/271: chown d3/dd/d2a/f3d 209 1 2023-12-16T03:15:58.288 INFO:tasks.workunit.client.1.smithi184.stdout:5/421: link d1/l42 d1/d2a/d31/d28/d72/l87 0 2023-12-16T03:15:58.288 INFO:tasks.workunit.client.1.smithi184.stdout:4/475: creat d1/f9d x:0 0 0 2023-12-16T03:15:58.288 INFO:tasks.workunit.client.0.smithi064.stdout:7/303: getdents d7/d13 0 2023-12-16T03:15:58.289 INFO:tasks.workunit.client.0.smithi064.stdout:5/237: symlink d0/d14/d25/l55 0 2023-12-16T03:15:58.291 INFO:tasks.workunit.client.1.smithi184.stdout:9/769: creat d0/d76/db7/d100/f10d x:0 0 0 2023-12-16T03:15:58.291 INFO:tasks.workunit.client.1.smithi184.stdout:9/770: chown d0/d13/d20/d5b/d53/lae 6117 1 2023-12-16T03:15:58.292 INFO:tasks.workunit.client.0.smithi064.stdout:1/272: unlink d3/f13 0 2023-12-16T03:15:58.292 INFO:tasks.workunit.client.0.smithi064.stdout:7/304: write d7/f9 [1453933,108775] 0 2023-12-16T03:15:58.292 INFO:tasks.workunit.client.0.smithi064.stdout:7/305: chown d7/d3e/d42/d43/d46/d52 722175 1 2023-12-16T03:15:58.292 INFO:tasks.workunit.client.1.smithi184.stdout:5/422: mknod d1/d3/d9/d2e/c88 0 2023-12-16T03:15:58.292 INFO:tasks.workunit.client.0.smithi064.stdout:1/273: read f2 [347761,107733] 0 2023-12-16T03:15:58.293 INFO:tasks.workunit.client.0.smithi064.stdout:5/238: creat d0/d7/d34/f56 x:0 0 0 2023-12-16T03:15:58.293 INFO:tasks.workunit.client.0.smithi064.stdout:5/239: write d0/d19/f4a [657530,127329] 0 2023-12-16T03:15:58.294 INFO:tasks.workunit.client.0.smithi064.stdout:7/306: creat d7/d3e/d42/d48/f5e x:0 0 0 2023-12-16T03:15:58.294 INFO:tasks.workunit.client.1.smithi184.stdout:5/423: mknod d1/d2a/c89 0 2023-12-16T03:15:58.295 INFO:tasks.workunit.client.1.smithi184.stdout:5/424: readlink d1/d3/d9/de/d30/l46 0 2023-12-16T03:15:58.296 INFO:tasks.workunit.client.0.smithi064.stdout:1/274: truncate d3/dd/d11/f17 3126999 0 2023-12-16T03:15:58.297 INFO:tasks.workunit.client.0.smithi064.stdout:1/275: write d3/d36/d44/d4d/f3f [1767583,98072] 0 2023-12-16T03:15:58.297 INFO:tasks.workunit.client.1.smithi184.stdout:5/425: creat d1/d2a/d64/f8a x:0 0 0 2023-12-16T03:15:58.297 INFO:tasks.workunit.client.0.smithi064.stdout:5/240: symlink d0/d14/d20/d37/d3c/l57 0 2023-12-16T03:15:58.298 INFO:tasks.workunit.client.1.smithi184.stdout:7/445: dwrite d0/d3/d2e/f5f [0,4194304] 0 2023-12-16T03:15:58.299 INFO:tasks.workunit.client.0.smithi064.stdout:2/239: dwrite d1/d15/d1e/f3f [0,4194304] 0 2023-12-16T03:15:58.299 INFO:tasks.workunit.client.0.smithi064.stdout:7/307: truncate d7/f3b 2698573 0 2023-12-16T03:15:58.300 INFO:tasks.workunit.client.0.smithi064.stdout:1/276: dread d3/d22/f28 [0,4194304] 0 2023-12-16T03:15:58.300 INFO:tasks.workunit.client.0.smithi064.stdout:5/241: symlink d0/de/d23/l58 0 2023-12-16T03:15:58.301 INFO:tasks.workunit.client.1.smithi184.stdout:5/426: write d1/d3/d9/de/d15/d19/d5f/f4c [2463851,8019] 0 2023-12-16T03:15:58.301 INFO:tasks.workunit.client.0.smithi064.stdout:5/242: read d0/d7/fa [564558,14622] 0 2023-12-16T03:15:58.302 INFO:tasks.workunit.client.1.smithi184.stdout:0/598: sync 2023-12-16T03:15:58.303 INFO:tasks.workunit.client.1.smithi184.stdout:9/771: dread d0/d3a/d47/f93 [0,4194304] 0 2023-12-16T03:15:58.304 INFO:tasks.workunit.client.0.smithi064.stdout:1/277: write d3/f5 [2496865,80401] 0 2023-12-16T03:15:58.304 INFO:tasks.workunit.client.0.smithi064.stdout:1/278: chown d3/f55 11356358 1 2023-12-16T03:15:58.306 INFO:tasks.workunit.client.0.smithi064.stdout:2/240: creat d1/d27/f44 x:0 0 0 2023-12-16T03:15:58.309 INFO:tasks.workunit.client.0.smithi064.stdout:2/241: creat d1/d27/d35/f45 x:0 0 0 2023-12-16T03:15:58.313 INFO:tasks.workunit.client.0.smithi064.stdout:2/242: rename d1/d15/f3e to d1/d27/d2f/f46 0 2023-12-16T03:15:58.314 INFO:tasks.workunit.client.1.smithi184.stdout:5/427: unlink d1/l42 0 2023-12-16T03:15:58.314 INFO:tasks.workunit.client.1.smithi184.stdout:0/599: unlink dc/d10/f14 0 2023-12-16T03:15:58.315 INFO:tasks.workunit.client.1.smithi184.stdout:0/600: creat dc/dab/fcf x:0 0 0 2023-12-16T03:15:58.321 INFO:tasks.workunit.client.1.smithi184.stdout:0/601: mknod dc/d10/d2d/d5f/d7c/cd0 0 2023-12-16T03:15:58.321 INFO:tasks.workunit.client.1.smithi184.stdout:0/602: read dc/d22/d48/f77 [25486,35626] 0 2023-12-16T03:15:58.326 INFO:tasks.workunit.client.1.smithi184.stdout:0/603: rename dc/d22/d1d/l44 to dc/d22/d1d/ld1 0 2023-12-16T03:15:58.326 INFO:tasks.workunit.client.1.smithi184.stdout:0/604: truncate dc/d10/d2d/d5f/fc2 814800 0 2023-12-16T03:15:58.329 INFO:tasks.workunit.client.1.smithi184.stdout:5/428: dread d1/f29 [0,4194304] 0 2023-12-16T03:15:58.329 INFO:tasks.workunit.client.1.smithi184.stdout:5/429: stat d1/d3/d9/de/d15/d19/d5f/l6e 0 2023-12-16T03:15:58.331 INFO:tasks.workunit.client.1.smithi184.stdout:5/430: creat d1/d3/d9/de/d30/f8b x:0 0 0 2023-12-16T03:15:58.335 INFO:tasks.workunit.client.1.smithi184.stdout:5/431: link d1/d3/d9/f40 d1/d3/d9/de/d15/d19/d53/f8c 0 2023-12-16T03:15:58.342 INFO:tasks.workunit.client.1.smithi184.stdout:0/605: write dc/d10/f11 [2824061,110776] 0 2023-12-16T03:15:58.347 INFO:tasks.workunit.client.1.smithi184.stdout:7/446: dwrite d0/d3/d2e/d79/d32/d39/f48 [0,4194304] 0 2023-12-16T03:15:58.353 INFO:tasks.workunit.client.1.smithi184.stdout:7/447: dread d0/d3/d4/f25 [0,4194304] 0 2023-12-16T03:15:58.353 INFO:tasks.workunit.client.1.smithi184.stdout:7/448: stat d0/c53 0 2023-12-16T03:15:58.354 INFO:tasks.workunit.client.1.smithi184.stdout:7/449: getdents d0/d3/d2e/d79/d32 0 2023-12-16T03:15:58.355 INFO:tasks.workunit.client.1.smithi184.stdout:7/450: truncate d0/d3/d2e/d79/d32/d39/f3e 3567327 0 2023-12-16T03:15:58.355 INFO:tasks.workunit.client.1.smithi184.stdout:7/451: write d0/d3/d2e/d79/d36/d3f/f6d [250498,61543] 0 2023-12-16T03:15:58.356 INFO:tasks.workunit.client.1.smithi184.stdout:7/452: mknod d0/d3/d2e/d79/c80 0 2023-12-16T03:15:58.359 INFO:tasks.workunit.client.1.smithi184.stdout:4/476: dwrite d1/d11/f7a [0,4194304] 0 2023-12-16T03:15:58.364 INFO:tasks.workunit.client.1.smithi184.stdout:9/772: dwrite d0/d76/da2/dc4/dd0/fff [0,4194304] 0 2023-12-16T03:15:58.365 INFO:tasks.workunit.client.1.smithi184.stdout:9/773: chown d0/cc5 147069 1 2023-12-16T03:15:58.365 INFO:tasks.workunit.client.0.smithi064.stdout:5/243: dwrite d0/d7/fa [0,4194304] 0 2023-12-16T03:15:58.365 INFO:tasks.workunit.client.0.smithi064.stdout:1/279: dwrite d3/dd/d2a/f3d [0,4194304] 0 2023-12-16T03:15:58.365 INFO:tasks.workunit.client.0.smithi064.stdout:2/243: dwrite d1/f3a [0,4194304] 0 2023-12-16T03:15:58.365 INFO:tasks.workunit.client.0.smithi064.stdout:2/244: dread - d1/d27/d2e/f34 zero size 2023-12-16T03:15:58.366 INFO:tasks.workunit.client.1.smithi184.stdout:9/774: unlink d0/d13/d20/d5b/d43/l5a 0 2023-12-16T03:15:58.367 INFO:tasks.workunit.client.0.smithi064.stdout:5/244: rename d0/l2b to d0/de/d23/l59 0 2023-12-16T03:15:58.367 INFO:tasks.workunit.client.0.smithi064.stdout:6/207: sync 2023-12-16T03:15:58.367 INFO:tasks.workunit.client.0.smithi064.stdout:9/194: sync 2023-12-16T03:15:58.367 INFO:tasks.workunit.client.0.smithi064.stdout:8/333: sync 2023-12-16T03:15:58.367 INFO:tasks.workunit.client.0.smithi064.stdout:9/195: getdents d2/d2c 0 2023-12-16T03:15:58.367 INFO:tasks.workunit.client.0.smithi064.stdout:9/196: dread - d2/f33 zero size 2023-12-16T03:15:58.367 INFO:tasks.workunit.client.0.smithi064.stdout:3/303: sync 2023-12-16T03:15:58.367 INFO:tasks.workunit.client.0.smithi064.stdout:9/197: fdatasync d2/f2a 0 2023-12-16T03:15:58.368 INFO:tasks.workunit.client.0.smithi064.stdout:1/280: creat d3/dd/f59 x:0 0 0 2023-12-16T03:15:58.369 INFO:tasks.workunit.client.0.smithi064.stdout:7/308: dwrite d7/f53 [0,4194304] 0 2023-12-16T03:15:58.370 INFO:tasks.workunit.client.0.smithi064.stdout:2/245: mknod d1/d27/d3b/c47 0 2023-12-16T03:15:58.370 INFO:tasks.workunit.client.0.smithi064.stdout:8/334: truncate d0/f7 4617895 0 2023-12-16T03:15:58.374 INFO:tasks.workunit.client.0.smithi064.stdout:1/281: symlink d3/dd/d23/d41/l5a 0 2023-12-16T03:15:58.375 INFO:tasks.workunit.client.0.smithi064.stdout:1/282: read - d3/d36/d44/f51 zero size 2023-12-16T03:15:58.375 INFO:tasks.workunit.client.0.smithi064.stdout:1/283: chown d3/dd/d23 18755931 1 2023-12-16T03:15:58.377 INFO:tasks.workunit.client.0.smithi064.stdout:9/198: mkdir d2/d2d/d36 0 2023-12-16T03:15:58.378 INFO:tasks.workunit.client.1.smithi184.stdout:4/477: dread d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:58.379 INFO:tasks.workunit.client.0.smithi064.stdout:2/246: symlink d1/d15/l48 0 2023-12-16T03:15:58.379 INFO:tasks.workunit.client.0.smithi064.stdout:1/284: dread d3/d36/d44/f48 [0,4194304] 0 2023-12-16T03:15:58.379 INFO:tasks.workunit.client.0.smithi064.stdout:1/285: stat d3/dd/d23/d4f/f54 0 2023-12-16T03:15:58.380 INFO:tasks.workunit.client.1.smithi184.stdout:5/432: dwrite d1/d3/d9/de/d30/f4e [0,4194304] 0 2023-12-16T03:15:58.380 INFO:tasks.workunit.client.1.smithi184.stdout:5/433: stat d1/d3/c44 0 2023-12-16T03:15:58.380 INFO:tasks.workunit.client.1.smithi184.stdout:0/606: dwrite dc/d22/d1d/d43/f59 [0,4194304] 0 2023-12-16T03:15:58.380 INFO:tasks.workunit.client.0.smithi064.stdout:3/304: dread db/d12/d21/f30 [0,4194304] 0 2023-12-16T03:15:58.380 INFO:tasks.workunit.client.0.smithi064.stdout:9/199: rename d2/dc/f29 to d2/d2d/d31/d34/f37 0 2023-12-16T03:15:58.381 INFO:tasks.workunit.client.0.smithi064.stdout:3/305: write db/d12/d21/f30 [3115775,70424] 0 2023-12-16T03:15:58.382 INFO:tasks.workunit.client.0.smithi064.stdout:3/306: read - db/d13/d39/f43 zero size 2023-12-16T03:15:58.383 INFO:tasks.workunit.client.0.smithi064.stdout:8/335: write d0/f3 [812579,31779] 0 2023-12-16T03:15:58.384 INFO:tasks.workunit.client.0.smithi064.stdout:9/200: mknod d2/c38 0 2023-12-16T03:15:58.384 INFO:tasks.workunit.client.0.smithi064.stdout:1/286: mknod d3/d22/d57/c5b 0 2023-12-16T03:15:58.384 INFO:tasks.workunit.client.0.smithi064.stdout:9/201: chown d2/c38 258951723 1 2023-12-16T03:15:58.385 INFO:tasks.workunit.client.0.smithi064.stdout:3/307: creat db/d4f/f6b x:0 0 0 2023-12-16T03:15:58.385 INFO:tasks.workunit.client.0.smithi064.stdout:3/308: truncate db/d4f/f6b 792775 0 2023-12-16T03:15:58.385 INFO:tasks.workunit.client.0.smithi064.stdout:2/247: mkdir d1/d15/d1b/d49 0 2023-12-16T03:15:58.386 INFO:tasks.workunit.client.0.smithi064.stdout:8/336: truncate d0/d1d/f20 97276 0 2023-12-16T03:15:58.386 INFO:tasks.workunit.client.1.smithi184.stdout:0/607: chown dc/d2a/f97 0 1 2023-12-16T03:15:58.389 INFO:tasks.workunit.client.0.smithi064.stdout:1/287: rename d3/d22/c24 to d3/d36/d44/d4d/d58/c5c 0 2023-12-16T03:15:58.391 INFO:tasks.workunit.client.0.smithi064.stdout:3/309: creat db/d12/d1a/d2c/d34/d4c/d6a/f6c x:0 0 0 2023-12-16T03:15:58.391 INFO:tasks.workunit.client.0.smithi064.stdout:3/310: truncate db/d12/d21/f61 314341 0 2023-12-16T03:15:58.391 INFO:tasks.workunit.client.0.smithi064.stdout:3/311: fdatasync db/d12/f58 0 2023-12-16T03:15:58.394 INFO:tasks.workunit.client.0.smithi064.stdout:4/292: sync 2023-12-16T03:15:58.394 INFO:tasks.workunit.client.0.smithi064.stdout:7/309: write d7/d13/d20/f21 [4083375,11938] 0 2023-12-16T03:15:58.394 INFO:tasks.workunit.client.0.smithi064.stdout:8/337: dread d0/db/d12/f15 [0,4194304] 0 2023-12-16T03:15:58.397 INFO:tasks.workunit.client.0.smithi064.stdout:2/248: rename d1/c39 to d1/d27/d35/c4a 0 2023-12-16T03:15:58.398 INFO:tasks.workunit.client.0.smithi064.stdout:6/208: dwrite d3/d9/f20 [0,4194304] 0 2023-12-16T03:15:58.400 INFO:tasks.workunit.client.0.smithi064.stdout:6/209: read d3/d8/da/f23 [359969,691] 0 2023-12-16T03:15:58.400 INFO:tasks.workunit.client.0.smithi064.stdout:9/202: write f1 [4371940,8574] 0 2023-12-16T03:15:58.400 INFO:tasks.workunit.client.0.smithi064.stdout:9/203: write d2/dc/f32 [413288,62166] 0 2023-12-16T03:15:58.401 INFO:tasks.workunit.client.0.smithi064.stdout:1/288: rename d3/d22/f49 to d3/d22/d57/f5d 0 2023-12-16T03:15:58.404 INFO:tasks.workunit.client.0.smithi064.stdout:5/245: dwrite d0/de/d23/f3f [0,4194304] 0 2023-12-16T03:15:58.406 INFO:tasks.workunit.client.0.smithi064.stdout:2/249: write d1/d15/f1f [752099,98662] 0 2023-12-16T03:15:58.407 INFO:tasks.workunit.client.0.smithi064.stdout:9/204: mkdir d2/dc/d24/d39 0 2023-12-16T03:15:58.412 INFO:tasks.workunit.client.1.smithi184.stdout:9/775: dwrite d0/d76/da2/dc4/dd0/ff1 [0,4194304] 0 2023-12-16T03:15:58.413 INFO:tasks.workunit.client.0.smithi064.stdout:1/289: rename d3/f5 to d3/dd/d11/d3b/f5e 0 2023-12-16T03:15:58.416 INFO:tasks.workunit.client.1.smithi184.stdout:9/776: creat d0/d76/db2/f10e x:0 0 0 2023-12-16T03:15:58.417 INFO:tasks.workunit.client.0.smithi064.stdout:5/246: mkdir d0/d14/d25/d44/d5a 0 2023-12-16T03:15:58.420 INFO:tasks.workunit.client.0.smithi064.stdout:6/210: mknod d3/d8/d1f/d26/c3c 0 2023-12-16T03:15:58.420 INFO:tasks.workunit.client.0.smithi064.stdout:6/211: dread - d3/d8/d1f/d26/f3b zero size 2023-12-16T03:15:58.425 INFO:tasks.workunit.client.0.smithi064.stdout:0/193: sync 2023-12-16T03:15:58.426 INFO:tasks.workunit.client.0.smithi064.stdout:0/194: mkdir d2/d8/d3d 0 2023-12-16T03:15:58.426 INFO:tasks.workunit.client.0.smithi064.stdout:0/195: stat d2/d7/d10/d21/d31/f3c 0 2023-12-16T03:15:58.429 INFO:tasks.workunit.client.0.smithi064.stdout:0/196: creat d2/f3e x:0 0 0 2023-12-16T03:15:58.433 INFO:tasks.workunit.client.1.smithi184.stdout:5/434: dwrite d1/d3/fa [0,4194304] 0 2023-12-16T03:15:58.433 INFO:tasks.workunit.client.1.smithi184.stdout:5/435: chown d1/d2a/d64 11 1 2023-12-16T03:15:58.433 INFO:tasks.workunit.client.1.smithi184.stdout:5/436: chown d1/d3/fd 66469334 1 2023-12-16T03:15:58.433 INFO:tasks.workunit.client.0.smithi064.stdout:0/197: write d2/d8/f1b [3943505,71295] 0 2023-12-16T03:15:58.434 INFO:tasks.workunit.client.1.smithi184.stdout:4/478: dwrite d1/d11/d5a/f6f [0,4194304] 0 2023-12-16T03:15:58.436 INFO:tasks.workunit.client.0.smithi064.stdout:0/198: creat d2/d7/d10/f3f x:0 0 0 2023-12-16T03:15:58.437 INFO:tasks.workunit.client.1.smithi184.stdout:5/437: rmdir d1 39 2023-12-16T03:15:58.442 INFO:tasks.workunit.client.1.smithi184.stdout:5/438: creat d1/d3/d9/de/d15/f8d x:0 0 0 2023-12-16T03:15:58.442 INFO:tasks.workunit.client.1.smithi184.stdout:5/439: fsync d1/f66 0 2023-12-16T03:15:58.450 INFO:tasks.workunit.client.1.smithi184.stdout:0/608: dwrite dc/d22/d45/d66/f84 [0,4194304] 0 2023-12-16T03:15:58.463 INFO:tasks.workunit.client.0.smithi064.stdout:3/312: dwrite db/d12/d1a/f54 [0,4194304] 0 2023-12-16T03:15:58.463 INFO:tasks.workunit.client.0.smithi064.stdout:4/293: dwrite d0/da/f16 [4194304,4194304] 0 2023-12-16T03:15:58.464 INFO:tasks.workunit.client.0.smithi064.stdout:3/313: fsync f4 0 2023-12-16T03:15:58.477 INFO:tasks.workunit.client.0.smithi064.stdout:3/314: dread f4 [0,4194304] 0 2023-12-16T03:15:58.486 INFO:tasks.workunit.client.0.smithi064.stdout:1/290: dwrite d3/d36/d44/d4d/f3f [0,4194304] 0 2023-12-16T03:15:58.488 INFO:tasks.workunit.client.0.smithi064.stdout:9/205: dwrite d2/dc/f15 [0,4194304] 0 2023-12-16T03:15:58.488 INFO:tasks.workunit.client.0.smithi064.stdout:6/212: dwrite d3/fd [0,4194304] 0 2023-12-16T03:15:58.489 INFO:tasks.workunit.client.1.smithi184.stdout:0/609: dwrite dc/f42 [0,4194304] 0 2023-12-16T03:15:58.489 INFO:tasks.workunit.client.1.smithi184.stdout:0/610: chown dc/d22/d45/d66/d80/da3/f91 1584 1 2023-12-16T03:15:58.489 INFO:tasks.workunit.client.1.smithi184.stdout:4/479: dwrite d1/d11/d1b/f79 [0,4194304] 0 2023-12-16T03:15:58.489 INFO:tasks.workunit.client.0.smithi064.stdout:3/315: dread db/d12/d1a/d2c/f5b [0,4194304] 0 2023-12-16T03:15:58.490 INFO:tasks.workunit.client.0.smithi064.stdout:3/316: chown db/d12/f58 724 1 2023-12-16T03:15:58.492 INFO:tasks.workunit.client.0.smithi064.stdout:0/199: dwrite d2/d8/f1c [0,4194304] 0 2023-12-16T03:15:58.492 INFO:tasks.workunit.client.1.smithi184.stdout:4/480: creat d1/d11/d1b/f9e x:0 0 0 2023-12-16T03:15:58.492 INFO:tasks.workunit.client.1.smithi184.stdout:4/481: chown d1/d11/d5a/d63/d72/d98/c8b 27698573 1 2023-12-16T03:15:58.493 INFO:tasks.workunit.client.1.smithi184.stdout:5/440: dwrite d1/d3/d9/de/d15/d19/d5f/d45/f84 [0,4194304] 0 2023-12-16T03:15:58.494 INFO:tasks.workunit.client.1.smithi184.stdout:5/441: chown d1/d3/d9/d2e 26284 1 2023-12-16T03:15:58.494 INFO:tasks.workunit.client.1.smithi184.stdout:4/482: mknod d1/d11/d1b/d1e/c9f 0 2023-12-16T03:15:58.494 INFO:tasks.workunit.client.1.smithi184.stdout:9/777: dwrite d0/d13/d20/f55 [0,4194304] 0 2023-12-16T03:15:58.494 INFO:tasks.workunit.client.1.smithi184.stdout:9/778: write d0/d3a/fc0 [444649,108040] 0 2023-12-16T03:15:58.495 INFO:tasks.workunit.client.1.smithi184.stdout:4/483: read d1/f28 [3060140,60798] 0 2023-12-16T03:15:58.497 INFO:tasks.workunit.client.1.smithi184.stdout:5/442: truncate d1/d3/d9/de/d15/d19/f23 770279 0 2023-12-16T03:15:58.498 INFO:tasks.workunit.client.0.smithi064.stdout:4/294: mkdir d0/d42/d56 0 2023-12-16T03:15:58.498 INFO:tasks.workunit.client.0.smithi064.stdout:4/295: fdatasync d0/d12/f2a 0 2023-12-16T03:15:58.498 INFO:tasks.workunit.client.0.smithi064.stdout:4/296: fsync d0/d14/d33/f38 0 2023-12-16T03:15:58.499 INFO:tasks.workunit.client.1.smithi184.stdout:5/443: symlink d1/d3/d9/d2e/l8e 0 2023-12-16T03:15:58.499 INFO:tasks.workunit.client.1.smithi184.stdout:4/484: getdents d1/d12/d13/d40/d43/d5e/d6a 0 2023-12-16T03:15:58.503 INFO:tasks.workunit.client.1.smithi184.stdout:5/444: symlink d1/d3/d9/de/l8f 0 2023-12-16T03:15:58.503 INFO:tasks.workunit.client.1.smithi184.stdout:4/485: symlink d1/d29/d34/d5c/d76/d33/d4a/la0 0 2023-12-16T03:15:58.505 INFO:tasks.workunit.client.1.smithi184.stdout:9/779: write d0/d13/d20/d5b/f56 [1466508,50956] 0 2023-12-16T03:15:58.505 INFO:tasks.workunit.client.1.smithi184.stdout:0/611: dread dc/d22/d45/d66/d80/fb6 [0,4194304] 0 2023-12-16T03:15:58.505 INFO:tasks.workunit.client.1.smithi184.stdout:0/612: chown dc/d10/c24 600 1 2023-12-16T03:15:58.505 INFO:tasks.workunit.client.1.smithi184.stdout:4/486: unlink d1/d29/d34/d5c/d76/f49 0 2023-12-16T03:15:58.506 INFO:tasks.workunit.client.1.smithi184.stdout:4/487: dread - d1/f9d zero size 2023-12-16T03:15:58.506 INFO:tasks.workunit.client.1.smithi184.stdout:6/625: sync 2023-12-16T03:15:58.507 INFO:tasks.workunit.client.1.smithi184.stdout:0/613: symlink dc/d22/d1d/d43/d5a/ld2 0 2023-12-16T03:15:58.508 INFO:tasks.workunit.client.1.smithi184.stdout:4/488: mkdir d1/d12/d13/da1 0 2023-12-16T03:15:58.510 INFO:tasks.workunit.client.1.smithi184.stdout:6/626: creat d0/d5/d22/d25/d47/fcb x:0 0 0 2023-12-16T03:15:58.512 INFO:tasks.workunit.client.1.smithi184.stdout:6/627: mkdir d0/d5/d22/d34/dcc 0 2023-12-16T03:15:58.512 INFO:tasks.workunit.client.0.smithi064.stdout:1/291: creat d3/dd/d11/d2f/f5f x:0 0 0 2023-12-16T03:15:58.515 INFO:tasks.workunit.client.0.smithi064.stdout:9/206: symlink d2/d2d/d31/d34/l3a 0 2023-12-16T03:15:58.515 INFO:tasks.workunit.client.1.smithi184.stdout:0/614: write dc/d22/d45/d66/fae [3751039,116647] 0 2023-12-16T03:15:58.520 INFO:tasks.workunit.client.1.smithi184.stdout:0/615: read dc/d22/d1d/d35/dc3/f67 [1659735,75127] 0 2023-12-16T03:15:58.521 INFO:tasks.workunit.client.0.smithi064.stdout:6/213: creat d3/d8/d1f/f3d x:0 0 0 2023-12-16T03:15:58.523 INFO:tasks.workunit.client.0.smithi064.stdout:3/317: creat db/d4f/f6d x:0 0 0 2023-12-16T03:15:58.523 INFO:tasks.workunit.client.0.smithi064.stdout:6/214: write d3/d9/f1c [690584,65291] 0 2023-12-16T03:15:58.523 INFO:tasks.workunit.client.1.smithi184.stdout:6/628: dread d0/d5/d22/d25/f2b [0,4194304] 0 2023-12-16T03:15:58.523 INFO:tasks.workunit.client.1.smithi184.stdout:6/629: fdatasync d0/d5/d12/f1c 0 2023-12-16T03:15:58.523 INFO:tasks.workunit.client.1.smithi184.stdout:6/630: chown d0/d5/d22 4 1 2023-12-16T03:15:58.526 INFO:tasks.workunit.client.1.smithi184.stdout:6/631: truncate d0/d5/d22/d25/d47/f8f 2300113 0 2023-12-16T03:15:58.527 INFO:tasks.workunit.client.1.smithi184.stdout:6/632: write d0/d5/d22/d25/f2b [2243550,61098] 0 2023-12-16T03:15:58.527 INFO:tasks.workunit.client.1.smithi184.stdout:6/633: write d0/d5/d42/f80 [2778351,101294] 0 2023-12-16T03:15:58.528 INFO:tasks.workunit.client.1.smithi184.stdout:6/634: creat d0/d5/d22/d34/fcd x:0 0 0 2023-12-16T03:15:58.542 INFO:tasks.workunit.client.0.smithi064.stdout:0/200: rmdir d2/d8 39 2023-12-16T03:15:58.544 INFO:tasks.workunit.client.1.smithi184.stdout:0/616: getdents dc/d22/d1d/d43/d5a 0 2023-12-16T03:15:58.545 INFO:tasks.workunit.client.1.smithi184.stdout:0/617: creat dc/d22/d45/d66/d80/fd3 x:0 0 0 2023-12-16T03:15:58.545 INFO:tasks.workunit.client.1.smithi184.stdout:0/618: chown dc/d22/d45/d66/d80 0 1 2023-12-16T03:15:58.545 INFO:tasks.workunit.client.1.smithi184.stdout:0/619: stat dc/d22/d48/f6d 0 2023-12-16T03:15:58.546 INFO:tasks.workunit.client.0.smithi064.stdout:4/297: symlink d0/d12/d48/l57 0 2023-12-16T03:15:58.547 INFO:tasks.workunit.client.1.smithi184.stdout:5/445: dwrite d1/d3/d9/de/d15/f61 [0,4194304] 0 2023-12-16T03:15:58.547 INFO:tasks.workunit.client.1.smithi184.stdout:5/446: readlink d1/d3/l60 0 2023-12-16T03:15:58.547 INFO:tasks.workunit.client.1.smithi184.stdout:4/489: dwrite d1/d11/d1b/d1e/f5d [0,4194304] 0 2023-12-16T03:15:58.547 INFO:tasks.workunit.client.0.smithi064.stdout:9/207: dwrite d2/dc/ff [0,4194304] 0 2023-12-16T03:15:58.549 INFO:tasks.workunit.client.1.smithi184.stdout:6/635: dwrite d0/d5/d22/fb1 [0,4194304] 0 2023-12-16T03:15:58.550 INFO:tasks.workunit.client.0.smithi064.stdout:8/338: rename d0/d1d/f20 to d0/db/d12/d1c/f72 0 2023-12-16T03:15:58.554 INFO:tasks.workunit.client.1.smithi184.stdout:5/447: mkdir d1/d3/d9/de/d15/d90 0 2023-12-16T03:15:58.554 INFO:tasks.workunit.client.1.smithi184.stdout:6/636: creat d0/d36/d8a/fce x:0 0 0 2023-12-16T03:15:58.554 INFO:tasks.workunit.client.1.smithi184.stdout:6/637: write d0/d36/d79/f7c [1029455,47773] 0 2023-12-16T03:15:58.555 INFO:tasks.workunit.client.1.smithi184.stdout:4/490: dread d1/d12/d13/f31 [0,4194304] 0 2023-12-16T03:15:58.556 INFO:tasks.workunit.client.1.smithi184.stdout:5/448: symlink d1/d2a/l91 0 2023-12-16T03:15:58.556 INFO:tasks.workunit.client.1.smithi184.stdout:5/449: chown d1/d3/d2f/f6d 26176 1 2023-12-16T03:15:58.557 INFO:tasks.workunit.client.0.smithi064.stdout:1/292: mkdir d3/dd/d23/d60 0 2023-12-16T03:15:58.557 INFO:tasks.workunit.client.1.smithi184.stdout:4/491: symlink d1/d29/d34/d5c/d76/la2 0 2023-12-16T03:15:58.559 INFO:tasks.workunit.client.1.smithi184.stdout:4/492: creat d1/d11/d5a/fa3 x:0 0 0 2023-12-16T03:15:58.559 INFO:tasks.workunit.client.1.smithi184.stdout:4/493: dread - d1/d11/d5a/fa3 zero size 2023-12-16T03:15:58.559 INFO:tasks.workunit.client.1.smithi184.stdout:4/494: readlink d1/d11/d1b/l30 0 2023-12-16T03:15:58.560 INFO:tasks.workunit.client.1.smithi184.stdout:4/495: creat d1/d29/d34/d5c/d76/d33/d4a/fa4 x:0 0 0 2023-12-16T03:15:58.561 INFO:tasks.workunit.client.1.smithi184.stdout:4/496: read d1/f54 [329015,3812] 0 2023-12-16T03:15:58.561 INFO:tasks.workunit.client.1.smithi184.stdout:5/450: read d1/d3/d9/de/d15/d19/d5f/d45/f84 [1773177,84557] 0 2023-12-16T03:15:58.561 INFO:tasks.workunit.client.1.smithi184.stdout:5/451: chown d1/d3/d9/de/d15/f82 5 1 2023-12-16T03:15:58.562 INFO:tasks.workunit.client.0.smithi064.stdout:3/318: mkdir db/d12/d1a/d2c/d6e 0 2023-12-16T03:15:58.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/497: symlink d1/d12/la5 0 2023-12-16T03:15:58.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/498: dread - d1/d29/d34/d5c/d76/d42/f92 zero size 2023-12-16T03:15:58.563 INFO:tasks.workunit.client.1.smithi184.stdout:0/620: dwrite dc/d22/d1d/d43/fb1 [0,4194304] 0 2023-12-16T03:15:58.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/499: symlink d1/la6 0 2023-12-16T03:15:58.564 INFO:tasks.workunit.client.1.smithi184.stdout:5/452: symlink d1/d3/d9/de/d30/l92 0 2023-12-16T03:15:58.565 INFO:tasks.workunit.client.0.smithi064.stdout:6/215: mknod d3/c3e 0 2023-12-16T03:15:58.567 INFO:tasks.workunit.client.0.smithi064.stdout:0/201: creat d2/d8/f40 x:0 0 0 2023-12-16T03:15:58.569 INFO:tasks.workunit.client.1.smithi184.stdout:0/621: symlink dc/d22/d1d/d43/d5a/ld4 0 2023-12-16T03:15:58.570 INFO:tasks.workunit.client.1.smithi184.stdout:4/500: rename d1/d29/d34/d5c/d76/d33/l77 to d1/d12/d13/da1/la7 0 2023-12-16T03:15:58.570 INFO:tasks.workunit.client.1.smithi184.stdout:4/501: fsync d1/d12/d13/d40/d43/d5e/d6a/f97 0 2023-12-16T03:15:58.570 INFO:tasks.workunit.client.1.smithi184.stdout:5/453: mknod d1/d2a/d31/d28/c93 0 2023-12-16T03:15:58.571 INFO:tasks.workunit.client.1.smithi184.stdout:4/502: creat d1/d12/d13/d40/d43/d5e/fa8 x:0 0 0 2023-12-16T03:15:58.573 INFO:tasks.workunit.client.1.smithi184.stdout:5/454: mknod d1/d3/d9/de/d15/d27/c94 0 2023-12-16T03:15:58.573 INFO:tasks.workunit.client.1.smithi184.stdout:5/455: chown d1/d3/d9/l5e 119 1 2023-12-16T03:15:58.573 INFO:tasks.workunit.client.1.smithi184.stdout:5/456: truncate d1/d3/d9/de/d30/f86 964933 0 2023-12-16T03:15:58.573 INFO:tasks.workunit.client.1.smithi184.stdout:5/457: write d1/d3/d9/d49/f55 [1346871,122645] 0 2023-12-16T03:15:58.574 INFO:tasks.workunit.client.0.smithi064.stdout:4/298: symlink d0/da/l58 0 2023-12-16T03:15:58.578 INFO:tasks.workunit.client.1.smithi184.stdout:4/503: write d1/d11/d1b/f87 [4036652,13449] 0 2023-12-16T03:15:58.579 INFO:tasks.workunit.client.1.smithi184.stdout:4/504: creat d1/d29/d34/d5c/d76/d3b/fa9 x:0 0 0 2023-12-16T03:15:58.581 INFO:tasks.workunit.client.0.smithi064.stdout:9/208: mkdir d2/d2d/d3b 0 2023-12-16T03:15:58.581 INFO:tasks.workunit.client.1.smithi184.stdout:4/505: mknod d1/d29/d34/d5c/d76/d33/d4a/caa 0 2023-12-16T03:15:58.582 INFO:tasks.workunit.client.1.smithi184.stdout:0/622: dread dc/d22/d1d/d43/d5a/f89 [0,4194304] 0 2023-12-16T03:15:58.583 INFO:tasks.workunit.client.0.smithi064.stdout:2/250: rename d1/d15/d1b/l20 to d1/d27/d35/l4b 0 2023-12-16T03:15:58.583 INFO:tasks.workunit.client.0.smithi064.stdout:2/251: chown d1/d15/f1a 550644 1 2023-12-16T03:15:58.584 INFO:tasks.workunit.client.0.smithi064.stdout:2/252: chown d1/f10 1457815 1 2023-12-16T03:15:58.584 INFO:tasks.workunit.client.1.smithi184.stdout:4/506: getdents d1/d12/d13 0 2023-12-16T03:15:58.586 INFO:tasks.workunit.client.1.smithi184.stdout:0/623: symlink dc/d22/d1d/d43/ld5 0 2023-12-16T03:15:58.586 INFO:tasks.workunit.client.0.smithi064.stdout:9/209: write d2/d2d/d31/f1c [3252182,101404] 0 2023-12-16T03:15:58.586 INFO:tasks.workunit.client.0.smithi064.stdout:9/210: write d2/f1d [321232,110244] 0 2023-12-16T03:15:58.588 INFO:tasks.workunit.client.1.smithi184.stdout:0/624: creat dc/d22/d45/d66/d80/da3/dcb/fd6 x:0 0 0 2023-12-16T03:15:58.588 INFO:tasks.workunit.client.0.smithi064.stdout:8/339: mkdir d0/d1d/d73 0 2023-12-16T03:15:58.589 INFO:tasks.workunit.client.0.smithi064.stdout:3/319: dwrite db/d12/d21/f30 [4194304,4194304] 0 2023-12-16T03:15:58.590 INFO:tasks.workunit.client.1.smithi184.stdout:0/625: dread dc/d22/d1d/d2c/d75/fbf [0,4194304] 0 2023-12-16T03:15:58.591 INFO:tasks.workunit.client.1.smithi184.stdout:0/626: read dc/d22/d1d/d35/f38 [2450465,77031] 0 2023-12-16T03:15:58.592 INFO:tasks.workunit.client.0.smithi064.stdout:4/299: dwrite d0/d12/f2a [0,4194304] 0 2023-12-16T03:15:58.593 INFO:tasks.workunit.client.1.smithi184.stdout:0/627: truncate dc/d10/d2d/f50 96547 0 2023-12-16T03:15:58.593 INFO:tasks.workunit.client.1.smithi184.stdout:0/628: truncate dc/d10/d2d/d5f/d7a/f9f 775060 0 2023-12-16T03:15:58.595 INFO:tasks.workunit.client.1.smithi184.stdout:0/629: creat dc/d10/d2d/fd7 x:0 0 0 2023-12-16T03:15:58.595 INFO:tasks.workunit.client.1.smithi184.stdout:0/630: fsync dc/d22/d1d/d43/d5a/f89 0 2023-12-16T03:15:58.595 INFO:tasks.workunit.client.1.smithi184.stdout:0/631: fdatasync dc/d22/d1d/d43/fb1 0 2023-12-16T03:15:58.595 INFO:tasks.workunit.client.0.smithi064.stdout:1/293: getdents d3/d36/d44/d4d 0 2023-12-16T03:15:58.597 INFO:tasks.workunit.client.1.smithi184.stdout:0/632: mkdir dc/d22/d1d/d35/dd8 0 2023-12-16T03:15:58.598 INFO:tasks.workunit.client.1.smithi184.stdout:0/633: creat dc/d22/d45/d66/fd9 x:0 0 0 2023-12-16T03:15:58.599 INFO:tasks.workunit.client.0.smithi064.stdout:6/216: unlink d3/d9/f1c 0 2023-12-16T03:15:58.601 INFO:tasks.workunit.client.0.smithi064.stdout:0/202: creat d2/d8/da/df/f41 x:0 0 0 2023-12-16T03:15:58.603 INFO:tasks.workunit.client.0.smithi064.stdout:8/340: rmdir d0/db/d12/d1c/d59/d5c 0 2023-12-16T03:15:58.606 INFO:tasks.workunit.client.0.smithi064.stdout:3/320: rmdir db/d12/d1a/d2c/d34 39 2023-12-16T03:15:58.607 INFO:tasks.workunit.client.0.smithi064.stdout:4/300: creat d0/d42/d4c/f59 x:0 0 0 2023-12-16T03:15:58.607 INFO:tasks.workunit.client.0.smithi064.stdout:3/321: dread db/d12/d1a/f38 [4194304,4194304] 0 2023-12-16T03:15:58.607 INFO:tasks.workunit.client.0.smithi064.stdout:1/294: dread d3/dd/d11/d3b/f5e [0,4194304] 0 2023-12-16T03:15:58.609 INFO:tasks.workunit.client.0.smithi064.stdout:6/217: symlink d3/d8/d1f/l3f 0 2023-12-16T03:15:58.609 INFO:tasks.workunit.client.0.smithi064.stdout:6/218: dread - d3/d8/d1f/f3d zero size 2023-12-16T03:15:58.611 INFO:tasks.workunit.client.0.smithi064.stdout:0/203: rmdir d2/d8/d3d 0 2023-12-16T03:15:58.612 INFO:tasks.workunit.client.0.smithi064.stdout:2/253: dwrite d1/f3a [0,4194304] 0 2023-12-16T03:15:58.612 INFO:tasks.workunit.client.1.smithi184.stdout:4/507: dwrite d1/d12/d13/f31 [0,4194304] 0 2023-12-16T03:15:58.613 INFO:tasks.workunit.client.1.smithi184.stdout:0/634: dread dc/f7b [0,4194304] 0 2023-12-16T03:15:58.614 INFO:tasks.workunit.client.0.smithi064.stdout:5/247: rename d0/d7/f16 to d0/f5b 0 2023-12-16T03:15:58.615 INFO:tasks.workunit.client.0.smithi064.stdout:3/322: mknod db/d12/c6f 0 2023-12-16T03:15:58.618 INFO:tasks.workunit.client.0.smithi064.stdout:8/341: dwrite d0/db/f66 [0,4194304] 0 2023-12-16T03:15:58.621 INFO:tasks.workunit.client.0.smithi064.stdout:6/219: creat d3/d8/d13/f40 x:0 0 0 2023-12-16T03:15:58.622 INFO:tasks.workunit.client.0.smithi064.stdout:0/204: mknod d2/d7/d10/d21/d31/c42 0 2023-12-16T03:15:58.622 INFO:tasks.workunit.client.0.smithi064.stdout:0/205: write d2/f32 [199340,97555] 0 2023-12-16T03:15:58.622 INFO:tasks.workunit.client.0.smithi064.stdout:0/206: chown d2/d8/l22 3104 1 2023-12-16T03:15:58.622 INFO:tasks.workunit.client.0.smithi064.stdout:0/207: write d2/d29/f2f [839483,93604] 0 2023-12-16T03:15:58.623 INFO:tasks.workunit.client.1.smithi184.stdout:4/508: symlink d1/d11/d5a/d63/d72/d98/lab 0 2023-12-16T03:15:58.624 INFO:tasks.workunit.client.1.smithi184.stdout:0/635: dread dc/d22/d1d/d2c/fb9 [0,4194304] 0 2023-12-16T03:15:58.627 INFO:tasks.workunit.client.1.smithi184.stdout:4/509: symlink d1/d11/d5a/lac 0 2023-12-16T03:15:58.627 INFO:tasks.workunit.client.1.smithi184.stdout:4/510: getdents d1/d12/d13/d40/d43/d5e/d6a 0 2023-12-16T03:15:58.628 INFO:tasks.workunit.client.1.smithi184.stdout:0/636: unlink dc/d22/d45/d66/fd9 0 2023-12-16T03:15:58.628 INFO:tasks.workunit.client.0.smithi064.stdout:2/254: unlink d1/f30 0 2023-12-16T03:15:58.628 INFO:tasks.workunit.client.0.smithi064.stdout:2/255: truncate d1/d27/d2f/f46 228871 0 2023-12-16T03:15:58.629 INFO:tasks.workunit.client.1.smithi184.stdout:0/637: mknod dc/dc9/cda 0 2023-12-16T03:15:58.629 INFO:tasks.workunit.client.1.smithi184.stdout:0/638: stat dc/d22/d1d/d2c 0 2023-12-16T03:15:58.637 INFO:tasks.workunit.client.0.smithi064.stdout:9/211: rename d2/d2d/d31 to d2/d2d/d3b/d3c 0 2023-12-16T03:15:58.638 INFO:tasks.workunit.client.0.smithi064.stdout:5/248: truncate d0/de/ff 247287 0 2023-12-16T03:15:58.640 INFO:tasks.workunit.client.0.smithi064.stdout:4/301: dwrite d0/d1e/f37 [0,4194304] 0 2023-12-16T03:15:58.644 INFO:tasks.workunit.client.0.smithi064.stdout:8/342: creat d0/db/d37/f74 x:0 0 0 2023-12-16T03:15:58.646 INFO:tasks.workunit.client.0.smithi064.stdout:6/220: mknod d3/d8/d13/c41 0 2023-12-16T03:15:58.646 INFO:tasks.workunit.client.0.smithi064.stdout:6/221: chown d3/d8/d13/c16 0 1 2023-12-16T03:15:58.648 INFO:tasks.workunit.client.1.smithi184.stdout:4/511: dread d1/d11/d5a/d63/d72/d98/f4b [0,4194304] 0 2023-12-16T03:15:58.648 INFO:tasks.workunit.client.1.smithi184.stdout:4/512: chown d1/d11/d5a/f6f 1 1 2023-12-16T03:15:58.648 INFO:tasks.workunit.client.1.smithi184.stdout:4/513: truncate d1/d12/d13/f31 4922286 0 2023-12-16T03:15:58.649 INFO:tasks.workunit.client.0.smithi064.stdout:0/208: mknod d2/d8/c43 0 2023-12-16T03:15:58.649 INFO:tasks.workunit.client.0.smithi064.stdout:3/323: dwrite db/d4f/f5d [0,4194304] 0 2023-12-16T03:15:58.649 INFO:tasks.workunit.client.1.smithi184.stdout:0/639: dwrite dc/d22/d1d/d43/fc4 [0,4194304] 0 2023-12-16T03:15:58.649 INFO:tasks.workunit.client.1.smithi184.stdout:0/640: fdatasync dc/d22/d1d/d43/fc4 0 2023-12-16T03:15:58.650 INFO:tasks.workunit.client.0.smithi064.stdout:2/256: link d1/d27/f44 d1/d15/d1b/f4c 0 2023-12-16T03:15:58.651 INFO:tasks.workunit.client.0.smithi064.stdout:6/222: write d3/d8/d13/f1b [1226874,40408] 0 2023-12-16T03:15:58.651 INFO:tasks.workunit.client.0.smithi064.stdout:6/223: fsync d3/f5 0 2023-12-16T03:15:58.652 INFO:tasks.workunit.client.0.smithi064.stdout:9/212: creat d2/dc/d24/d39/f3d x:0 0 0 2023-12-16T03:15:58.652 INFO:tasks.workunit.client.0.smithi064.stdout:9/213: truncate d2/d2d/d3b/d3c/d34/f37 268785 0 2023-12-16T03:15:58.653 INFO:tasks.workunit.client.0.smithi064.stdout:5/249: creat d0/d7/d34/f5c x:0 0 0 2023-12-16T03:15:58.653 INFO:tasks.workunit.client.0.smithi064.stdout:4/302: dwrite d0/f2e [0,4194304] 0 2023-12-16T03:15:58.653 INFO:tasks.workunit.client.0.smithi064.stdout:4/303: stat d0/d42/d4c/f54 0 2023-12-16T03:15:58.657 INFO:tasks.workunit.client.0.smithi064.stdout:8/343: creat d0/db/d12/d44/d68/f75 x:0 0 0 2023-12-16T03:15:58.658 INFO:tasks.workunit.client.1.smithi184.stdout:4/514: link d1/d29/d34/d5c/d76/d33/d4a/caa d1/d11/d5a/cad 0 2023-12-16T03:15:58.658 INFO:tasks.workunit.client.1.smithi184.stdout:4/515: readlink d1/d11/d5a/d63/d72/d98/lab 0 2023-12-16T03:15:58.659 INFO:tasks.workunit.client.0.smithi064.stdout:0/209: rename d2/d7/d10/d21/d31/f3c to d2/d8/da/d11/f44 0 2023-12-16T03:15:58.663 INFO:tasks.workunit.client.0.smithi064.stdout:3/324: truncate db/d12/d1a/f26 3384578 0 2023-12-16T03:15:58.664 INFO:tasks.workunit.client.0.smithi064.stdout:2/257: rmdir d1/d15/d23/d2d 39 2023-12-16T03:15:58.665 INFO:tasks.workunit.client.1.smithi184.stdout:0/641: dwrite dc/d22/d45/d66/d80/da3/dcb/fce [0,4194304] 0 2023-12-16T03:15:58.669 INFO:tasks.workunit.client.0.smithi064.stdout:9/214: mknod d2/d2d/c3e 0 2023-12-16T03:15:58.669 INFO:tasks.workunit.client.1.smithi184.stdout:4/516: mkdir d1/d11/d1b/dae 0 2023-12-16T03:15:58.670 INFO:tasks.workunit.client.0.smithi064.stdout:5/250: mkdir d0/d14/d25/d3e/d35/d5d 0 2023-12-16T03:15:58.672 INFO:tasks.workunit.client.0.smithi064.stdout:8/344: link d0/db/d37/f61 d0/db/f76 0 2023-12-16T03:15:58.674 INFO:tasks.workunit.client.0.smithi064.stdout:4/304: rename d0/d42/d55 to d0/d14/d5a 0 2023-12-16T03:15:58.674 INFO:tasks.workunit.client.0.smithi064.stdout:4/305: write d0/d14/d33/f38 [1293910,88414] 0 2023-12-16T03:15:58.679 INFO:tasks.workunit.client.1.smithi184.stdout:0/642: dwrite dc/d22/d1d/d43/d5a/f69 [0,4194304] 0 2023-12-16T03:15:58.680 INFO:tasks.workunit.client.1.smithi184.stdout:4/517: mknod d1/d12/d13/caf 0 2023-12-16T03:15:58.680 INFO:tasks.workunit.client.1.smithi184.stdout:4/518: chown d1/d29/d34/d5c/d76/d33 1228 1 2023-12-16T03:15:58.685 INFO:tasks.workunit.client.1.smithi184.stdout:0/643: creat dc/d22/d1d/d43/fdb x:0 0 0 2023-12-16T03:15:58.685 INFO:tasks.workunit.client.1.smithi184.stdout:4/519: symlink d1/d29/d37/lb0 0 2023-12-16T03:15:58.685 INFO:tasks.workunit.client.1.smithi184.stdout:0/644: readlink lb 0 2023-12-16T03:15:58.686 INFO:tasks.workunit.client.1.smithi184.stdout:0/645: chown dc/l51 25302396 1 2023-12-16T03:15:58.686 INFO:tasks.workunit.client.1.smithi184.stdout:0/646: stat dc/d22/d1d/d43/ld5 0 2023-12-16T03:15:58.686 INFO:tasks.workunit.client.1.smithi184.stdout:4/520: write d1/fd [1526599,18156] 0 2023-12-16T03:15:58.687 INFO:tasks.workunit.client.1.smithi184.stdout:0/647: mknod dc/dab/cdc 0 2023-12-16T03:15:58.687 INFO:tasks.workunit.client.1.smithi184.stdout:4/521: truncate d1/f54 298542 0 2023-12-16T03:15:58.687 INFO:tasks.workunit.client.1.smithi184.stdout:4/522: write d1/d29/d34/d5c/d76/f70 [1150777,76662] 0 2023-12-16T03:15:58.688 INFO:tasks.workunit.client.0.smithi064.stdout:6/224: symlink d3/d8/d1f/d26/l42 0 2023-12-16T03:15:58.688 INFO:tasks.workunit.client.0.smithi064.stdout:6/225: fdatasync d3/d9/f20 0 2023-12-16T03:15:58.688 INFO:tasks.workunit.client.0.smithi064.stdout:9/215: stat d2/dc/l10 0 2023-12-16T03:15:58.689 INFO:tasks.workunit.client.1.smithi184.stdout:0/648: rename dc/d22/d1d/d43/d5a/c7d to dc/d22/d1d/d35/dc3/d7f/cdd 0 2023-12-16T03:15:58.689 INFO:tasks.workunit.client.1.smithi184.stdout:0/649: write dc/d22/d48/f6d [200526,32171] 0 2023-12-16T03:15:58.689 INFO:tasks.workunit.client.1.smithi184.stdout:4/523: symlink d1/d11/d1b/d1e/lb1 0 2023-12-16T03:15:58.690 INFO:tasks.workunit.client.0.smithi064.stdout:5/251: mkdir d0/d14/d25/d5e 0 2023-12-16T03:15:58.691 INFO:tasks.workunit.client.1.smithi184.stdout:0/650: link dc/d22/d1d/d43/d5a/d60/c9b dc/d10/d2d/d5f/d7c/cde 0 2023-12-16T03:15:58.691 INFO:tasks.workunit.client.1.smithi184.stdout:0/651: chown dc/d10/d1c/c56 116325749 1 2023-12-16T03:15:58.691 INFO:tasks.workunit.client.1.smithi184.stdout:0/652: fdatasync dc/d22/d1d/d43/d5a/f89 0 2023-12-16T03:15:58.691 INFO:tasks.workunit.client.0.smithi064.stdout:8/345: mkdir d0/db/d12/d1c/d59/d77 0 2023-12-16T03:15:58.692 INFO:tasks.workunit.client.1.smithi184.stdout:0/653: mknod dc/d10/da7/dc0/cdf 0 2023-12-16T03:15:58.693 INFO:tasks.workunit.client.0.smithi064.stdout:9/216: dread d2/d2d/d3b/d3c/f20 [0,4194304] 0 2023-12-16T03:15:58.693 INFO:tasks.workunit.client.0.smithi064.stdout:4/306: symlink d0/d12/d48/l5b 0 2023-12-16T03:15:58.694 INFO:tasks.workunit.client.1.smithi184.stdout:0/654: write dc/d22/d1d/d43/f55 [528783,4173] 0 2023-12-16T03:15:58.694 INFO:tasks.workunit.client.1.smithi184.stdout:0/655: mknod dc/dc9/ce0 0 2023-12-16T03:15:58.695 INFO:tasks.workunit.client.0.smithi064.stdout:3/325: link l5 db/d12/d1a/d31/l70 0 2023-12-16T03:15:58.696 INFO:tasks.workunit.client.1.smithi184.stdout:4/524: write d1/f54 [197320,12929] 0 2023-12-16T03:15:58.697 INFO:tasks.workunit.client.1.smithi184.stdout:4/525: link d1/d12/d13/d40/d43/d5e/f83 d1/d12/d13/d40/d43/d45/fb2 0 2023-12-16T03:15:58.697 INFO:tasks.workunit.client.0.smithi064.stdout:2/258: link d1/l11 d1/d15/d1b/l4d 0 2023-12-16T03:15:58.699 INFO:tasks.workunit.client.0.smithi064.stdout:6/226: rename d3/d8/d13/f39 to d3/d8/da/f43 0 2023-12-16T03:15:58.699 INFO:tasks.workunit.client.0.smithi064.stdout:6/227: dread - d3/d8/da/f43 zero size 2023-12-16T03:15:58.700 INFO:tasks.workunit.client.0.smithi064.stdout:6/228: read d3/d8/d13/f24 [655674,56116] 0 2023-12-16T03:15:58.700 INFO:tasks.workunit.client.0.smithi064.stdout:6/229: readlink d3/d8/l33 0 2023-12-16T03:15:58.700 INFO:tasks.workunit.client.0.smithi064.stdout:6/230: dread - d3/d8/d13/f40 zero size 2023-12-16T03:15:58.700 INFO:tasks.workunit.client.0.smithi064.stdout:6/231: chown d3/d8/d13/f1b 3 1 2023-12-16T03:15:58.700 INFO:tasks.workunit.client.1.smithi184.stdout:4/526: mkdir d1/d12/db3 0 2023-12-16T03:15:58.701 INFO:tasks.workunit.client.0.smithi064.stdout:5/252: creat d0/f5f x:0 0 0 2023-12-16T03:15:58.701 INFO:tasks.workunit.client.0.smithi064.stdout:7/310: sync 2023-12-16T03:15:58.702 INFO:tasks.workunit.client.0.smithi064.stdout:8/346: creat d0/d1d/d24/d2f/d50/f78 x:0 0 0 2023-12-16T03:15:58.702 INFO:tasks.workunit.client.1.smithi184.stdout:4/527: rename d1/d12/d13/caf to d1/d12/d13/d40/d43/d5e/cb4 0 2023-12-16T03:15:58.703 INFO:tasks.workunit.client.0.smithi064.stdout:9/217: mkdir d2/d2d/d3f 0 2023-12-16T03:15:58.704 INFO:tasks.workunit.client.1.smithi184.stdout:4/528: creat d1/d12/db3/fb5 x:0 0 0 2023-12-16T03:15:58.704 INFO:tasks.workunit.client.0.smithi064.stdout:4/307: creat d0/d42/f5c x:0 0 0 2023-12-16T03:15:58.708 INFO:tasks.workunit.client.0.smithi064.stdout:2/259: unlink d1/d15/d1e/c22 0 2023-12-16T03:15:58.710 INFO:tasks.workunit.client.0.smithi064.stdout:5/253: creat d0/d14/d20/f60 x:0 0 0 2023-12-16T03:15:58.712 INFO:tasks.workunit.client.0.smithi064.stdout:7/311: creat d7/d3e/d42/d43/f5f x:0 0 0 2023-12-16T03:15:58.714 INFO:tasks.workunit.client.0.smithi064.stdout:8/347: mkdir d0/d1d/d73/d79 0 2023-12-16T03:15:58.715 INFO:tasks.workunit.client.0.smithi064.stdout:2/260: write d1/f10 [2916747,119816] 0 2023-12-16T03:15:58.715 INFO:tasks.workunit.client.0.smithi064.stdout:9/218: creat d2/f40 x:0 0 0 2023-12-16T03:15:58.715 INFO:tasks.workunit.client.1.smithi184.stdout:4/529: dread d1/d11/f23 [0,4194304] 0 2023-12-16T03:15:58.715 INFO:tasks.workunit.client.0.smithi064.stdout:8/348: dread d0/d1d/d24/d2f/f39 [0,4194304] 0 2023-12-16T03:15:58.716 INFO:tasks.workunit.client.1.smithi184.stdout:0/656: dwrite dc/d22/d45/d66/d80/da3/dcb/fd6 [0,4194304] 0 2023-12-16T03:15:58.717 INFO:tasks.workunit.client.0.smithi064.stdout:5/254: mknod d0/d14/d25/d3e/d35/d5d/c61 0 2023-12-16T03:15:58.718 INFO:tasks.workunit.client.1.smithi184.stdout:0/657: symlink dc/d22/d1d/d43/d5a/d60/le1 0 2023-12-16T03:15:58.719 INFO:tasks.workunit.client.0.smithi064.stdout:7/312: creat d7/d3e/d42/d48/d51/f60 x:0 0 0 2023-12-16T03:15:58.720 INFO:tasks.workunit.client.0.smithi064.stdout:7/313: fsync d7/f53 0 2023-12-16T03:15:58.720 INFO:tasks.workunit.client.0.smithi064.stdout:7/314: chown d7/d26/d30/f57 339563 1 2023-12-16T03:15:58.720 INFO:tasks.workunit.client.0.smithi064.stdout:7/315: write d7/d3e/d42/d43/f5f [367814,55694] 0 2023-12-16T03:15:58.720 INFO:tasks.workunit.client.0.smithi064.stdout:6/232: dwrite d3/fd [0,4194304] 0 2023-12-16T03:15:58.724 INFO:tasks.workunit.client.0.smithi064.stdout:0/210: fsync d2/d8/da/df/f41 0 2023-12-16T03:15:58.724 INFO:tasks.workunit.client.0.smithi064.stdout:0/211: dread - d2/d7/d10/f3f zero size 2023-12-16T03:15:58.724 INFO:tasks.workunit.client.0.smithi064.stdout:0/212: dread - d2/d7/d10/d21/f39 zero size 2023-12-16T03:15:58.724 INFO:tasks.workunit.client.0.smithi064.stdout:0/213: readlink d2/l6 0 2023-12-16T03:15:58.725 INFO:tasks.workunit.client.0.smithi064.stdout:2/261: mkdir d1/d15/d1b/d49/d4e 0 2023-12-16T03:15:58.730 INFO:tasks.workunit.client.0.smithi064.stdout:8/349: mknod d0/db/d37/d3a/d6f/c7a 0 2023-12-16T03:15:58.733 INFO:tasks.workunit.client.0.smithi064.stdout:5/255: creat d0/d14/d25/d5e/f62 x:0 0 0 2023-12-16T03:15:58.737 INFO:tasks.workunit.client.1.smithi184.stdout:3/612: sync 2023-12-16T03:15:58.737 INFO:tasks.workunit.client.1.smithi184.stdout:3/613: chown d12/d18/da1/dbd 22 1 2023-12-16T03:15:58.737 INFO:tasks.workunit.client.1.smithi184.stdout:2/430: sync 2023-12-16T03:15:58.737 INFO:tasks.workunit.client.1.smithi184.stdout:2/431: stat d3/d29/d4d/d5b/l6f 0 2023-12-16T03:15:58.737 INFO:tasks.workunit.client.1.smithi184.stdout:2/432: chown d3/d13/f66 176 1 2023-12-16T03:15:58.737 INFO:tasks.workunit.client.1.smithi184.stdout:8/610: sync 2023-12-16T03:15:58.742 INFO:tasks.workunit.client.0.smithi064.stdout:6/233: unlink d3/d8/d13/f2b 0 2023-12-16T03:15:58.742 INFO:tasks.workunit.client.0.smithi064.stdout:6/234: chown d3 42 1 2023-12-16T03:15:58.743 INFO:tasks.workunit.client.1.smithi184.stdout:8/611: write d2/d4/d10/f17 [226924,52907] 0 2023-12-16T03:15:58.747 INFO:tasks.workunit.client.1.smithi184.stdout:8/612: rename d2/d12/d21/d2d/d31/fba to d2/d6a/da4/fc4 0 2023-12-16T03:15:58.748 INFO:tasks.workunit.client.0.smithi064.stdout:8/350: truncate d0/f27 3803842 0 2023-12-16T03:15:58.748 INFO:tasks.workunit.client.0.smithi064.stdout:8/351: fsync d0/d1d/d24/d2f/f41 0 2023-12-16T03:15:58.748 INFO:tasks.workunit.client.0.smithi064.stdout:8/352: fsync d0/db/d12/d44/f4a 0 2023-12-16T03:15:58.749 INFO:tasks.workunit.client.1.smithi184.stdout:8/613: getdents d2/d12/db4 0 2023-12-16T03:15:58.749 INFO:tasks.workunit.client.0.smithi064.stdout:5/256: unlink d0/d14/d25/d5e/f62 0 2023-12-16T03:15:58.750 INFO:tasks.workunit.client.0.smithi064.stdout:6/235: chown d3/d8/d1f/d26/l29 1466606 1 2023-12-16T03:15:58.750 INFO:tasks.workunit.client.0.smithi064.stdout:6/236: write d3/d8/d1f/d26/f3b [432137,14255] 0 2023-12-16T03:15:58.750 INFO:tasks.workunit.client.0.smithi064.stdout:6/237: fsync d3/d9/f18 0 2023-12-16T03:15:58.750 INFO:tasks.workunit.client.0.smithi064.stdout:6/238: fsync d3/d9/fb 0 2023-12-16T03:15:58.752 INFO:tasks.workunit.client.0.smithi064.stdout:8/353: creat d0/da/d3e/d46/f7b x:0 0 0 2023-12-16T03:15:58.753 INFO:tasks.workunit.client.1.smithi184.stdout:8/614: mknod d2/d37/d7c/cc5 0 2023-12-16T03:15:58.762 INFO:tasks.workunit.client.0.smithi064.stdout:6/239: mkdir d3/d44 0 2023-12-16T03:15:58.762 INFO:tasks.workunit.client.0.smithi064.stdout:6/240: write d3/d8/da/f23 [1767560,55791] 0 2023-12-16T03:15:58.765 INFO:tasks.workunit.client.1.smithi184.stdout:4/530: dwrite d1/d29/d34/d5c/d76/f32 [0,4194304] 0 2023-12-16T03:15:58.765 INFO:tasks.workunit.client.1.smithi184.stdout:4/531: chown d1/d11/d5a/lac 0 1 2023-12-16T03:15:58.766 INFO:tasks.workunit.client.1.smithi184.stdout:4/532: rmdir d1/d11/d5a/d63/d72 39 2023-12-16T03:15:58.766 INFO:tasks.workunit.client.0.smithi064.stdout:9/219: dwrite d2/d2d/d3b/d3c/f27 [0,4194304] 0 2023-12-16T03:15:58.767 INFO:tasks.workunit.client.0.smithi064.stdout:9/220: write d2/f40 [323068,37955] 0 2023-12-16T03:15:58.767 INFO:tasks.workunit.client.0.smithi064.stdout:9/221: chown d2/d2d/d3b/d3c/d34/f37 289 1 2023-12-16T03:15:58.767 INFO:tasks.workunit.client.0.smithi064.stdout:6/241: rename d3/d8/d1f/f3d to d3/d9/f45 0 2023-12-16T03:15:58.771 INFO:tasks.workunit.client.1.smithi184.stdout:2/433: dread d3/d29/d2f/d2e/f1a [0,4194304] 0 2023-12-16T03:15:58.772 INFO:tasks.workunit.client.0.smithi064.stdout:6/242: dread d3/d8/da/f37 [0,4194304] 0 2023-12-16T03:15:58.772 INFO:tasks.workunit.client.1.smithi184.stdout:4/533: creat d1/d12/d13/da1/fb6 x:0 0 0 2023-12-16T03:15:58.772 INFO:tasks.workunit.client.1.smithi184.stdout:4/534: write d1/d12/d13/f94 [610442,78543] 0 2023-12-16T03:15:58.778 INFO:tasks.workunit.client.0.smithi064.stdout:9/222: link d2/c35 d2/d2d/d36/c41 0 2023-12-16T03:15:58.778 INFO:tasks.workunit.client.0.smithi064.stdout:9/223: fsync d2/f33 0 2023-12-16T03:15:58.779 INFO:tasks.workunit.client.1.smithi184.stdout:2/434: creat d3/d29/d2f/f93 x:0 0 0 2023-12-16T03:15:58.781 INFO:tasks.workunit.client.1.smithi184.stdout:2/435: creat d3/d29/d8a/f94 x:0 0 0 2023-12-16T03:15:58.782 INFO:tasks.workunit.client.0.smithi064.stdout:9/224: mkdir d2/dc/d24/d39/d42 0 2023-12-16T03:15:58.782 INFO:tasks.workunit.client.0.smithi064.stdout:9/225: chown d2/dc/d24/d39 1038 1 2023-12-16T03:15:58.783 INFO:tasks.workunit.client.0.smithi064.stdout:9/226: write d2/dc/f1f [2925406,56431] 0 2023-12-16T03:15:58.783 INFO:tasks.workunit.client.1.smithi184.stdout:2/436: symlink d3/d29/d2f/l95 0 2023-12-16T03:15:58.783 INFO:tasks.workunit.client.1.smithi184.stdout:2/437: write d3/d9/f85 [792233,3267] 0 2023-12-16T03:15:58.785 INFO:tasks.workunit.client.0.smithi064.stdout:6/243: dread d3/d8/d1f/f22 [0,4194304] 0 2023-12-16T03:15:58.785 INFO:tasks.workunit.client.0.smithi064.stdout:6/244: chown d3/c4 1514 1 2023-12-16T03:15:58.785 INFO:tasks.workunit.client.0.smithi064.stdout:6/245: chown d3/d44 4217 1 2023-12-16T03:15:58.786 INFO:tasks.workunit.client.1.smithi184.stdout:2/438: mkdir d3/d29/d61/d6d/d96 0 2023-12-16T03:15:58.786 INFO:tasks.workunit.client.0.smithi064.stdout:6/246: read d3/f5 [175543,18443] 0 2023-12-16T03:15:58.789 INFO:tasks.workunit.client.0.smithi064.stdout:6/247: read d3/d9/f18 [1232564,92809] 0 2023-12-16T03:15:58.789 INFO:tasks.workunit.client.0.smithi064.stdout:3/326: truncate db/d12/d21/f30 3511846 0 2023-12-16T03:15:58.801 INFO:tasks.workunit.client.0.smithi064.stdout:6/248: dread d3/d9/f18 [0,4194304] 0 2023-12-16T03:15:58.809 INFO:tasks.workunit.client.1.smithi184.stdout:3/614: dwrite d12/d37/f3f [0,4194304] 0 2023-12-16T03:15:58.812 INFO:tasks.workunit.client.0.smithi064.stdout:3/327: dwrite f6 [0,4194304] 0 2023-12-16T03:15:58.817 INFO:tasks.workunit.client.0.smithi064.stdout:9/227: dread d2/dc/f12 [0,4194304] 0 2023-12-16T03:15:58.817 INFO:tasks.workunit.client.0.smithi064.stdout:9/228: write d2/dc/f32 [272845,60339] 0 2023-12-16T03:15:58.821 INFO:tasks.workunit.client.0.smithi064.stdout:4/308: dwrite d0/d14/d33/f38 [0,4194304] 0 2023-12-16T03:15:58.821 INFO:tasks.workunit.client.0.smithi064.stdout:4/309: fdatasync d0/d1e/f37 0 2023-12-16T03:15:58.821 INFO:tasks.workunit.client.0.smithi064.stdout:4/310: read - d0/d12/f35 zero size 2023-12-16T03:15:58.822 INFO:tasks.workunit.client.1.smithi184.stdout:3/615: truncate d12/d1e/fb6 3095963 0 2023-12-16T03:15:58.828 INFO:tasks.workunit.client.0.smithi064.stdout:7/316: dwrite d7/d3e/d42/d43/f5f [0,4194304] 0 2023-12-16T03:15:58.828 INFO:tasks.workunit.client.0.smithi064.stdout:2/262: dwrite d1/d27/d2e/f34 [0,4194304] 0 2023-12-16T03:15:58.828 INFO:tasks.workunit.client.1.smithi184.stdout:0/658: dwrite dc/d22/d1a/f3e [0,4194304] 0 2023-12-16T03:15:58.829 INFO:tasks.workunit.client.1.smithi184.stdout:8/615: dwrite d2/d4/d10/d7a/f7f [0,4194304] 0 2023-12-16T03:15:58.829 INFO:tasks.workunit.client.1.smithi184.stdout:0/659: read dc/d22/d45/d66/d80/da3/f91 [453730,107102] 0 2023-12-16T03:15:58.830 INFO:tasks.workunit.client.0.smithi064.stdout:0/214: dwrite d2/f27 [0,4194304] 0 2023-12-16T03:15:58.830 INFO:tasks.workunit.client.0.smithi064.stdout:5/257: dwrite d0/d14/d20/f38 [0,4194304] 0 2023-12-16T03:15:58.830 INFO:tasks.workunit.client.0.smithi064.stdout:5/258: chown d0/de/ff 1305 1 2023-12-16T03:15:58.830 INFO:tasks.workunit.client.0.smithi064.stdout:5/259: write d0/d14/d25/d3e/d35/f54 [470114,68240] 0 2023-12-16T03:15:58.830 INFO:tasks.workunit.client.0.smithi064.stdout:8/354: dwrite d0/d1d/d24/d2f/f4b [0,4194304] 0 2023-12-16T03:15:58.830 INFO:tasks.workunit.client.0.smithi064.stdout:5/260: truncate d0/d14/d20/d37/d3c/f52 236300 0 2023-12-16T03:15:58.830 INFO:tasks.workunit.client.0.smithi064.stdout:8/355: readlink d0/db/d12/d44/l58 0 2023-12-16T03:15:58.831 INFO:tasks.workunit.client.0.smithi064.stdout:5/261: write d0/d19/f4a [531858,6364] 0 2023-12-16T03:15:58.831 INFO:tasks.workunit.client.1.smithi184.stdout:4/535: dwrite d1/d11/d1b/d1e/f5d [0,4194304] 0 2023-12-16T03:15:58.831 INFO:tasks.workunit.client.1.smithi184.stdout:2/439: dwrite d3/d29/d8a/f94 [0,4194304] 0 2023-12-16T03:15:58.833 INFO:tasks.workunit.client.1.smithi184.stdout:8/616: rename d2/d12/l78 to d2/d37/lc6 0 2023-12-16T03:15:58.833 INFO:tasks.workunit.client.1.smithi184.stdout:8/617: write d2/d12/d21/d30/fb1 [1448150,121121] 0 2023-12-16T03:15:58.833 INFO:tasks.workunit.client.1.smithi184.stdout:0/660: mknod dc/d22/d1d/d35/ce2 0 2023-12-16T03:15:58.835 INFO:tasks.workunit.client.0.smithi064.stdout:9/229: dwrite d2/f2e [0,4194304] 0 2023-12-16T03:15:58.836 INFO:tasks.workunit.client.1.smithi184.stdout:8/618: write d2/d12/d21/d8a/fb2 [102636,84159] 0 2023-12-16T03:15:58.836 INFO:tasks.workunit.client.1.smithi184.stdout:2/440: mknod d3/d9/d19/d82/c97 0 2023-12-16T03:15:58.837 INFO:tasks.workunit.client.1.smithi184.stdout:2/441: truncate d3/f50 1566251 0 2023-12-16T03:15:58.837 INFO:tasks.workunit.client.1.smithi184.stdout:0/661: mknod dc/d10/d2d/d5f/d7a/ce3 0 2023-12-16T03:15:58.839 INFO:tasks.workunit.client.1.smithi184.stdout:8/619: mknod d2/d6a/cc7 0 2023-12-16T03:15:58.840 INFO:tasks.workunit.client.1.smithi184.stdout:2/442: truncate d3/f3c 47848 0 2023-12-16T03:15:58.845 INFO:tasks.workunit.client.1.smithi184.stdout:0/662: creat dc/d22/d1d/fe4 x:0 0 0 2023-12-16T03:15:58.846 INFO:tasks.workunit.client.1.smithi184.stdout:2/443: creat d3/d29/d2f/d46/d77/f98 x:0 0 0 2023-12-16T03:15:58.846 INFO:tasks.workunit.client.1.smithi184.stdout:0/663: creat dc/d10/d2d/fe5 x:0 0 0 2023-12-16T03:15:58.847 INFO:tasks.workunit.client.1.smithi184.stdout:2/444: rename d3/d9/d19/f1c to d3/d29/d61/d6d/f99 0 2023-12-16T03:15:58.848 INFO:tasks.workunit.client.1.smithi184.stdout:0/664: creat dc/d10/d1c/fe6 x:0 0 0 2023-12-16T03:15:58.849 INFO:tasks.workunit.client.1.smithi184.stdout:0/665: dread - dc/d22/d45/d66/d80/fd3 zero size 2023-12-16T03:15:58.853 INFO:tasks.workunit.client.1.smithi184.stdout:2/445: creat d3/d13/f9a x:0 0 0 2023-12-16T03:15:58.854 INFO:tasks.workunit.client.1.smithi184.stdout:0/666: rmdir dc/d22/d1d/d43/d5a/d60 39 2023-12-16T03:15:58.856 INFO:tasks.workunit.client.1.smithi184.stdout:2/446: symlink d3/d9/d19/d87/l9b 0 2023-12-16T03:15:58.857 INFO:tasks.workunit.client.1.smithi184.stdout:2/447: creat d3/d29/d2f/d46/f9c x:0 0 0 2023-12-16T03:15:58.857 INFO:tasks.workunit.client.1.smithi184.stdout:0/667: write dc/f68 [3821368,1805] 0 2023-12-16T03:15:58.859 INFO:tasks.workunit.client.1.smithi184.stdout:2/448: rename d3/d29/d2f/d2e/f1b to d3/d29/d2f/d46/d77/f9d 0 2023-12-16T03:15:58.859 INFO:tasks.workunit.client.1.smithi184.stdout:2/449: chown d3/d9/d19/d87/l9b 1876425 1 2023-12-16T03:15:58.860 INFO:tasks.workunit.client.1.smithi184.stdout:2/450: symlink d3/d29/d2f/d2e/l9e 0 2023-12-16T03:15:58.862 INFO:tasks.workunit.client.0.smithi064.stdout:2/263: dwrite d1/f6 [0,4194304] 0 2023-12-16T03:15:58.866 INFO:tasks.workunit.client.1.smithi184.stdout:4/536: dwrite d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:58.866 INFO:tasks.workunit.client.1.smithi184.stdout:8/620: dwrite d2/d12/d21/f6e [0,4194304] 0 2023-12-16T03:15:58.866 INFO:tasks.workunit.client.1.smithi184.stdout:8/621: stat d2/d12/d21/d2d 0 2023-12-16T03:15:58.867 INFO:tasks.workunit.client.1.smithi184.stdout:8/622: write d2/d4/d10/d11/f29 [3305225,90066] 0 2023-12-16T03:15:58.867 INFO:tasks.workunit.client.1.smithi184.stdout:8/623: dread - d2/d4/d10/d99/fbe zero size 2023-12-16T03:15:58.867 INFO:tasks.workunit.client.1.smithi184.stdout:8/624: chown d2/d12/f58 123910 1 2023-12-16T03:15:58.870 INFO:tasks.workunit.client.1.smithi184.stdout:2/451: dread d3/d29/f30 [0,4194304] 0 2023-12-16T03:15:58.870 INFO:tasks.workunit.client.1.smithi184.stdout:8/625: rename d2/d12/d21/d2d/d31/d34/d96/cc1 to d2/d4/d10/d7a/cc8 0 2023-12-16T03:15:58.872 INFO:tasks.workunit.client.1.smithi184.stdout:8/626: symlink d2/d4/d10/d11/d72/lc9 0 2023-12-16T03:15:58.872 INFO:tasks.workunit.client.1.smithi184.stdout:8/627: stat d2/fc 0 2023-12-16T03:15:58.872 INFO:tasks.workunit.client.1.smithi184.stdout:8/628: fdatasync d2/d4/d10/d2a/f5c 0 2023-12-16T03:15:58.873 INFO:tasks.workunit.client.1.smithi184.stdout:8/629: mkdir d2/d12/d21/d2d/d31/d34/d96/dca 0 2023-12-16T03:15:58.875 INFO:tasks.workunit.client.1.smithi184.stdout:8/630: link d2/d37/d7c/lb7 d2/d4/d10/lcb 0 2023-12-16T03:15:58.877 INFO:tasks.workunit.client.1.smithi184.stdout:8/631: creat d2/d4/d10/d11/d77/fcc x:0 0 0 2023-12-16T03:15:58.877 INFO:tasks.workunit.client.1.smithi184.stdout:8/632: chown d2/d12/d21/d2d/d31/f63 124255791 1 2023-12-16T03:15:58.879 INFO:tasks.workunit.client.1.smithi184.stdout:8/633: unlink d2/d4/d10/d75/ca3 0 2023-12-16T03:15:58.884 INFO:tasks.workunit.client.1.smithi184.stdout:8/634: rmdir d2/d12/d21 39 2023-12-16T03:15:58.885 INFO:tasks.workunit.client.1.smithi184.stdout:8/635: getdents d2/d12/d21/d8a 0 2023-12-16T03:15:58.885 INFO:tasks.workunit.client.1.smithi184.stdout:8/636: chown d2/d4/f44 33489224 1 2023-12-16T03:15:58.885 INFO:tasks.workunit.client.1.smithi184.stdout:8/637: write d2/d37/d7c/fc0 [924143,77409] 0 2023-12-16T03:15:58.887 INFO:tasks.workunit.client.1.smithi184.stdout:8/638: mkdir d2/d12/d21/d8a/dcd 0 2023-12-16T03:15:58.887 INFO:tasks.workunit.client.1.smithi184.stdout:2/452: dread d3/d29/d2f/d2e/fa [4194304,4194304] 0 2023-12-16T03:15:58.887 INFO:tasks.workunit.client.1.smithi184.stdout:2/453: write d3/d13/d28/f69 [496529,36009] 0 2023-12-16T03:15:58.889 INFO:tasks.workunit.client.1.smithi184.stdout:4/537: dwrite d1/d11/f7a [0,4194304] 0 2023-12-16T03:15:58.889 INFO:tasks.workunit.client.1.smithi184.stdout:8/639: rename d2/d4/c4f to d2/d12/d21/d8a/dcd/cce 0 2023-12-16T03:15:58.889 INFO:tasks.workunit.client.1.smithi184.stdout:2/454: rename d3 to d3/d9/d19/d87/d9f 22 2023-12-16T03:15:58.889 INFO:tasks.workunit.client.1.smithi184.stdout:4/538: stat d1/d29/d34/d5c/d76/d33 0 2023-12-16T03:15:58.889 INFO:tasks.workunit.client.1.smithi184.stdout:4/539: truncate d1/d11/d5a/fa3 460212 0 2023-12-16T03:15:58.889 INFO:tasks.workunit.client.1.smithi184.stdout:4/540: chown d1/d11/d5a/d63 3676826 1 2023-12-16T03:15:58.890 INFO:tasks.workunit.client.1.smithi184.stdout:8/640: creat d2/d4/d10/d11/d72/dc2/fcf x:0 0 0 2023-12-16T03:15:58.891 INFO:tasks.workunit.client.1.smithi184.stdout:4/541: rmdir d1/d12 39 2023-12-16T03:15:58.892 INFO:tasks.workunit.client.1.smithi184.stdout:8/641: write d2/fc [399251,128303] 0 2023-12-16T03:15:58.892 INFO:tasks.workunit.client.1.smithi184.stdout:8/642: dread - d2/d6a/da4/fa7 zero size 2023-12-16T03:15:58.894 INFO:tasks.workunit.client.1.smithi184.stdout:8/643: symlink d2/d12/d21/d2d/d31/d34/d96/dca/ld0 0 2023-12-16T03:15:58.895 INFO:tasks.workunit.client.1.smithi184.stdout:8/644: chown d2/d4/l23 379971 1 2023-12-16T03:15:58.897 INFO:tasks.workunit.client.1.smithi184.stdout:8/645: rename d2/d4/l5f to d2/d4/da6/ld1 0 2023-12-16T03:15:58.902 INFO:tasks.workunit.client.1.smithi184.stdout:8/646: write d2/d4/f9 [3957579,35937] 0 2023-12-16T03:15:58.903 INFO:tasks.workunit.client.1.smithi184.stdout:2/455: dwrite d3/d29/d2f/d46/f6b [0,4194304] 0 2023-12-16T03:15:58.903 INFO:tasks.workunit.client.1.smithi184.stdout:2/456: fsync d3/d13/f66 0 2023-12-16T03:15:58.905 INFO:tasks.workunit.client.1.smithi184.stdout:8/647: write d2/d4/f40 [3327935,100065] 0 2023-12-16T03:15:58.905 INFO:tasks.workunit.client.1.smithi184.stdout:8/648: write d2/d12/db4/fb9 [764047,109392] 0 2023-12-16T03:15:58.906 INFO:tasks.workunit.client.1.smithi184.stdout:4/542: dread d1/d11/d1b/d1e/f24 [0,4194304] 0 2023-12-16T03:15:58.908 INFO:tasks.workunit.client.1.smithi184.stdout:2/457: mknod d3/d13/d28/ca0 0 2023-12-16T03:15:58.912 INFO:tasks.workunit.client.1.smithi184.stdout:8/649: rename d2/f33 to d2/d4/d10/d11/fd2 0 2023-12-16T03:15:58.914 INFO:tasks.workunit.client.1.smithi184.stdout:8/650: dread d2/d12/d21/f53 [0,4194304] 0 2023-12-16T03:15:58.914 INFO:tasks.workunit.client.1.smithi184.stdout:8/651: chown d2/d12 148006 1 2023-12-16T03:15:58.914 INFO:tasks.workunit.client.1.smithi184.stdout:4/543: mknod d1/d29/d34/cb7 0 2023-12-16T03:15:58.914 INFO:tasks.workunit.client.1.smithi184.stdout:8/652: read d2/d12/d21/d2d/fa2 [542130,90235] 0 2023-12-16T03:15:58.915 INFO:tasks.workunit.client.1.smithi184.stdout:8/653: write d2/d12/d21/d2d/d31/f6c [5010694,3069] 0 2023-12-16T03:15:58.916 INFO:tasks.workunit.client.1.smithi184.stdout:4/544: unlink d1/d29/d34/d5c/d76/la2 0 2023-12-16T03:15:58.916 INFO:tasks.workunit.client.1.smithi184.stdout:4/545: chown d1/d12/d13/d40 1362098 1 2023-12-16T03:15:58.918 INFO:tasks.workunit.client.1.smithi184.stdout:8/654: truncate d2/d12/f5a 187472 0 2023-12-16T03:15:58.918 INFO:tasks.workunit.client.1.smithi184.stdout:8/655: write d2/d12/d21/d30/fa1 [966175,3882] 0 2023-12-16T03:15:58.918 INFO:tasks.workunit.client.1.smithi184.stdout:8/656: chown d2/d12/d21/d2d/d31/d34/d96/dca 40751628 1 2023-12-16T03:15:58.918 INFO:tasks.workunit.client.1.smithi184.stdout:2/458: dread d3/f4 [0,4194304] 0 2023-12-16T03:15:58.920 INFO:tasks.workunit.client.1.smithi184.stdout:2/459: symlink d3/d29/la1 0 2023-12-16T03:15:58.921 INFO:tasks.workunit.client.1.smithi184.stdout:2/460: symlink d3/d13/d28/d83/la2 0 2023-12-16T03:15:58.921 INFO:tasks.workunit.client.1.smithi184.stdout:2/461: chown d3/d29/d2f/f54 349427 1 2023-12-16T03:15:58.923 INFO:tasks.workunit.client.1.smithi184.stdout:8/657: dread d2/d37/d7c/fc0 [0,4194304] 0 2023-12-16T03:15:58.924 INFO:tasks.workunit.client.1.smithi184.stdout:9/780: sync 2023-12-16T03:15:58.924 INFO:tasks.workunit.client.1.smithi184.stdout:1/572: sync 2023-12-16T03:15:58.924 INFO:tasks.workunit.client.1.smithi184.stdout:7/453: sync 2023-12-16T03:15:58.924 INFO:tasks.workunit.client.1.smithi184.stdout:6/638: sync 2023-12-16T03:15:58.924 INFO:tasks.workunit.client.1.smithi184.stdout:9/781: readlink d0/d13/d20/d5b/d43/l60 0 2023-12-16T03:15:58.925 INFO:tasks.workunit.client.1.smithi184.stdout:6/639: fsync d0/d5/d12/d1b/f51 0 2023-12-16T03:15:58.925 INFO:tasks.workunit.client.1.smithi184.stdout:6/640: fdatasync d0/d5/d22/d25/f2b 0 2023-12-16T03:15:58.925 INFO:tasks.workunit.client.1.smithi184.stdout:5/458: sync 2023-12-16T03:15:58.925 INFO:tasks.workunit.client.1.smithi184.stdout:8/658: creat d2/d6a/fd3 x:0 0 0 2023-12-16T03:15:58.925 INFO:tasks.workunit.client.1.smithi184.stdout:8/659: write d2/d12/d21/d30/f42 [1480090,40002] 0 2023-12-16T03:15:58.926 INFO:tasks.workunit.client.1.smithi184.stdout:8/660: chown d2/d4/d10/d11/fd2 25463086 1 2023-12-16T03:15:58.930 INFO:tasks.workunit.client.1.smithi184.stdout:9/782: rmdir d0/d76/da2/df4 0 2023-12-16T03:15:58.930 INFO:tasks.workunit.client.1.smithi184.stdout:6/641: mknod d0/d5/d22/d37/d4d/ccf 0 2023-12-16T03:15:58.930 INFO:tasks.workunit.client.1.smithi184.stdout:8/661: truncate d2/d6a/f84 10337973 0 2023-12-16T03:15:58.930 INFO:tasks.workunit.client.1.smithi184.stdout:7/454: dread d0/d3/f5 [4194304,4194304] 0 2023-12-16T03:15:58.930 INFO:tasks.workunit.client.1.smithi184.stdout:7/455: write d0/d3/d2e/d79/d36/f66 [211204,58094] 0 2023-12-16T03:15:58.933 INFO:tasks.workunit.client.1.smithi184.stdout:1/573: rename d3/d34/dbc/d3c/d41/d77/c8d to d3/d13/d2c/cbf 0 2023-12-16T03:15:58.935 INFO:tasks.workunit.client.1.smithi184.stdout:2/462: write d3/d13/d28/f3e [118288,105142] 0 2023-12-16T03:15:58.935 INFO:tasks.workunit.client.1.smithi184.stdout:9/783: mkdir d0/d3a/d10f 0 2023-12-16T03:15:58.935 INFO:tasks.workunit.client.1.smithi184.stdout:7/456: creat d0/d3/f81 x:0 0 0 2023-12-16T03:15:58.936 INFO:tasks.workunit.client.1.smithi184.stdout:4/546: dwrite d1/d12/f9b [0,4194304] 0 2023-12-16T03:15:58.937 INFO:tasks.workunit.client.1.smithi184.stdout:5/459: rename d1/d3/f36 to d1/d3/d9/d49/f95 0 2023-12-16T03:15:58.939 INFO:tasks.workunit.client.1.smithi184.stdout:1/574: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/fc0 x:0 0 0 2023-12-16T03:15:58.940 INFO:tasks.workunit.client.1.smithi184.stdout:5/460: write d1/d3/d9/d49/f95 [2476915,96676] 0 2023-12-16T03:15:58.941 INFO:tasks.workunit.client.1.smithi184.stdout:9/784: creat d0/d13/d20/db0/f110 x:0 0 0 2023-12-16T03:15:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:58 smithi064 ceph-mon[111958]: pgmap v194: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 84 MiB/s rd, 173 MiB/s wr, 780 op/s 2023-12-16T03:15:58.943 INFO:tasks.workunit.client.1.smithi184.stdout:7/457: symlink d0/d6b/l82 0 2023-12-16T03:15:58.943 INFO:tasks.workunit.client.1.smithi184.stdout:7/458: dread - d0/d6b/d69/f6e zero size 2023-12-16T03:15:58.945 INFO:tasks.workunit.client.1.smithi184.stdout:5/461: dread d1/f29 [0,4194304] 0 2023-12-16T03:15:58.946 INFO:tasks.workunit.client.1.smithi184.stdout:2/463: dread d3/d29/f2d [0,4194304] 0 2023-12-16T03:15:58.946 INFO:tasks.workunit.client.1.smithi184.stdout:2/464: readlink d3/d29/d2f/l42 0 2023-12-16T03:15:58.947 INFO:tasks.workunit.client.1.smithi184.stdout:4/547: mkdir d1/d12/db3/db8 0 2023-12-16T03:15:58.949 INFO:tasks.workunit.client.1.smithi184.stdout:1/575: creat d3/d34/d76/fc1 x:0 0 0 2023-12-16T03:15:58.950 INFO:tasks.workunit.client.1.smithi184.stdout:8/662: dwrite d2/d6a/da4/fa7 [0,4194304] 0 2023-12-16T03:15:58.952 INFO:tasks.workunit.client.1.smithi184.stdout:9/785: rmdir d0/d13/d20/d5b/d43/dc7/ddc/dd8/de0 0 2023-12-16T03:15:58.957 INFO:tasks.workunit.client.1.smithi184.stdout:7/459: rmdir d0/d3/d2e/d79/d34 39 2023-12-16T03:15:58.957 INFO:tasks.workunit.client.1.smithi184.stdout:7/460: write d0/d3/d2e/d79/d32/d39/f3e [3360138,99723] 0 2023-12-16T03:15:58.957 INFO:tasks.workunit.client.1.smithi184.stdout:5/462: symlink d1/d3/d9/de/d15/d19/d48/l96 0 2023-12-16T03:15:58.958 INFO:tasks.workunit.client.1.smithi184.stdout:4/548: creat d1/d12/d13/d40/d43/d5e/fb9 x:0 0 0 2023-12-16T03:15:58.960 INFO:tasks.workunit.client.1.smithi184.stdout:1/576: mknod d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/cc2 0 2023-12-16T03:15:58.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/663: mknod d2/d12/d21/d2d/d31/cd4 0 2023-12-16T03:15:58.965 INFO:tasks.workunit.client.1.smithi184.stdout:9/786: mknod d0/d13/d20/d5b/c111 0 2023-12-16T03:15:58.966 INFO:tasks.workunit.client.1.smithi184.stdout:9/787: stat d0/d3a/d47/fbc 0 2023-12-16T03:15:58.967 INFO:tasks.workunit.client.1.smithi184.stdout:2/465: dwrite d3/d29/d2f/d2e/f1a [0,4194304] 0 2023-12-16T03:15:58.969 INFO:tasks.workunit.client.1.smithi184.stdout:2/466: creat d3/d29/d4d/fa3 x:0 0 0 2023-12-16T03:15:58.970 INFO:tasks.workunit.client.1.smithi184.stdout:2/467: write d3/d13/d28/f74 [1629022,6126] 0 2023-12-16T03:15:58.970 INFO:tasks.workunit.client.1.smithi184.stdout:2/468: chown d3/d29/d2f/d46 1981 1 2023-12-16T03:15:58.971 INFO:tasks.workunit.client.0.smithi064.stdout:4/311: rename d0/da/l3a to d0/d42/d56/l5d 0 2023-12-16T03:15:58.975 INFO:tasks.workunit.client.1.smithi184.stdout:9/788: dread d0/d13/d20/d5b/d43/dab/faa [0,4194304] 0 2023-12-16T03:15:58.975 INFO:tasks.workunit.client.0.smithi064.stdout:7/317: symlink d7/d26/l61 0 2023-12-16T03:15:58.975 INFO:tasks.workunit.client.0.smithi064.stdout:6/249: fsync d3/d8/da/f43 0 2023-12-16T03:15:58.976 INFO:tasks.workunit.client.1.smithi184.stdout:2/469: rename d3/d29/d2f/l95 to d3/d9/la4 0 2023-12-16T03:15:58.976 INFO:tasks.workunit.client.0.smithi064.stdout:6/250: readlink d3/d8/l31 0 2023-12-16T03:15:58.980 INFO:tasks.workunit.client.1.smithi184.stdout:9/789: rmdir d0/d13/d20/d77 39 2023-12-16T03:15:58.980 INFO:tasks.workunit.client.1.smithi184.stdout:9/790: stat d0/d13/d20/cc2 0 2023-12-16T03:15:58.980 INFO:tasks.workunit.client.1.smithi184.stdout:9/791: truncate d0/d76/db7/d100/f10d 127587 0 2023-12-16T03:15:58.983 INFO:tasks.workunit.client.1.smithi184.stdout:2/470: dread d3/d9/f3b [0,4194304] 0 2023-12-16T03:15:58.983 INFO:tasks.workunit.client.1.smithi184.stdout:2/471: fdatasync d3/f6 0 2023-12-16T03:15:58.984 INFO:tasks.workunit.client.1.smithi184.stdout:2/472: link d3/d9/l4b d3/d13/d28/d83/la5 0 2023-12-16T03:15:58.985 INFO:tasks.workunit.client.0.smithi064.stdout:0/215: creat d2/d8/f45 x:0 0 0 2023-12-16T03:15:58.985 INFO:tasks.workunit.client.0.smithi064.stdout:0/216: write d2/d8/da/df/f41 [1018700,42721] 0 2023-12-16T03:15:58.986 INFO:tasks.workunit.client.1.smithi184.stdout:2/473: truncate d3/f14 2196856 0 2023-12-16T03:15:59.001 INFO:tasks.workunit.client.1.smithi184.stdout:2/474: dread d3/d29/d2f/d2e/f1a [0,4194304] 0 2023-12-16T03:15:59.001 INFO:tasks.workunit.client.1.smithi184.stdout:2/475: chown d3/d29/d2f 1 1 2023-12-16T03:15:59.001 INFO:tasks.workunit.client.0.smithi064.stdout:8/356: mkdir d0/da/d3e/d46/d54/d7c 0 2023-12-16T03:15:59.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/549: dwrite d1/d29/f2e [0,4194304] 0 2023-12-16T03:15:59.003 INFO:tasks.workunit.client.1.smithi184.stdout:1/577: dwrite d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/fc0 [0,4194304] 0 2023-12-16T03:15:59.003 INFO:tasks.workunit.client.1.smithi184.stdout:4/550: read d1/d12/f3e [3460293,65039] 0 2023-12-16T03:15:59.005 INFO:tasks.workunit.client.0.smithi064.stdout:5/262: link d0/d14/d4e/f53 d0/d50/d39/f63 0 2023-12-16T03:15:59.005 INFO:tasks.workunit.client.0.smithi064.stdout:4/312: dwrite d0/d42/d53/f1d [0,4194304] 0 2023-12-16T03:15:59.005 INFO:tasks.workunit.client.0.smithi064.stdout:4/313: write d0/d42/f5c [162690,16321] 0 2023-12-16T03:15:59.005 INFO:tasks.workunit.client.0.smithi064.stdout:8/357: write d0/d1d/d3c/d42/f5d [2025968,51087] 0 2023-12-16T03:15:59.006 INFO:tasks.workunit.client.1.smithi184.stdout:7/461: dwrite d0/d3/d2e/d79/d32/d39/f70 [0,4194304] 0 2023-12-16T03:15:59.010 INFO:tasks.workunit.client.0.smithi064.stdout:2/264: rmdir d1/d15/d23 39 2023-12-16T03:15:59.010 INFO:tasks.workunit.client.0.smithi064.stdout:2/265: readlink d1/d27/d35/l4b 0 2023-12-16T03:15:59.011 INFO:tasks.workunit.client.0.smithi064.stdout:2/266: write d1/f6 [168804,121585] 0 2023-12-16T03:15:59.017 INFO:tasks.workunit.client.0.smithi064.stdout:9/230: rename d2/c35 to d2/dc/d24/c43 0 2023-12-16T03:15:59.017 INFO:tasks.workunit.client.1.smithi184.stdout:2/476: dwrite d3/d9/d19/f7d [0,4194304] 0 2023-12-16T03:15:59.019 INFO:tasks.workunit.client.0.smithi064.stdout:7/318: mknod d7/d13/d20/c62 0 2023-12-16T03:15:59.019 INFO:tasks.workunit.client.0.smithi064.stdout:7/319: write d7/d3e/d42/d48/d51/f60 [3510,105817] 0 2023-12-16T03:15:59.020 INFO:tasks.workunit.client.0.smithi064.stdout:7/320: write d7/d13/d20/f28 [9151429,17318] 0 2023-12-16T03:15:59.020 INFO:tasks.workunit.client.0.smithi064.stdout:7/321: stat d7/d13/d20/f28 0 2023-12-16T03:15:59.020 INFO:tasks.workunit.client.0.smithi064.stdout:7/322: dread - d7/d26/d30/f57 zero size 2023-12-16T03:15:59.021 INFO:tasks.workunit.client.0.smithi064.stdout:6/251: mkdir d3/d8/d13/d46 0 2023-12-16T03:15:59.022 INFO:tasks.workunit.client.0.smithi064.stdout:0/217: mknod d2/d8/da/df/c46 0 2023-12-16T03:15:59.027 INFO:tasks.workunit.client.0.smithi064.stdout:5/263: rmdir d0/d50/d39 39 2023-12-16T03:15:59.027 INFO:tasks.workunit.client.0.smithi064.stdout:4/314: creat d0/d14/f5e x:0 0 0 2023-12-16T03:15:59.032 INFO:tasks.workunit.client.0.smithi064.stdout:4/315: write d0/f2 [10776276,67907] 0 2023-12-16T03:15:59.039 INFO:tasks.workunit.client.1.smithi184.stdout:2/477: dwrite d3/d29/d2f/d2e/f5d [0,4194304] 0 2023-12-16T03:15:59.048 INFO:tasks.workunit.client.1.smithi184.stdout:2/478: dread d3/d13/d28/f74 [0,4194304] 0 2023-12-16T03:15:59.055 INFO:tasks.workunit.client.0.smithi064.stdout:4/316: dwrite d0/d1e/f37 [0,4194304] 0 2023-12-16T03:15:59.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:58 smithi184 ceph-mon[121180]: pgmap v194: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 84 MiB/s rd, 173 MiB/s wr, 780 op/s 2023-12-16T03:15:59.072 INFO:tasks.workunit.client.1.smithi184.stdout:2/479: dwrite d3/d13/f9a [0,4194304] 0 2023-12-16T03:15:59.075 INFO:tasks.workunit.client.0.smithi064.stdout:8/358: creat d0/d1d/d3c/f7d x:0 0 0 2023-12-16T03:15:59.077 INFO:tasks.workunit.client.0.smithi064.stdout:2/267: rename d1/d27/d35/f45 to d1/d27/f4f 0 2023-12-16T03:15:59.077 INFO:tasks.workunit.client.0.smithi064.stdout:2/268: dread - d1/d15/d23/d2d/f3c zero size 2023-12-16T03:15:59.078 INFO:tasks.workunit.client.0.smithi064.stdout:9/231: symlink d2/d2d/d3f/l44 0 2023-12-16T03:15:59.078 INFO:tasks.workunit.client.0.smithi064.stdout:9/232: readlink d2/dc/l13 0 2023-12-16T03:15:59.080 INFO:tasks.workunit.client.0.smithi064.stdout:7/323: symlink d7/d3e/d42/d43/d46/d52/l63 0 2023-12-16T03:15:59.083 INFO:tasks.workunit.client.0.smithi064.stdout:6/252: rmdir d3/d8/d1f/d26 39 2023-12-16T03:15:59.083 INFO:tasks.workunit.client.0.smithi064.stdout:6/253: write d3/d8/d1f/f22 [2825671,66089] 0 2023-12-16T03:15:59.084 INFO:tasks.workunit.client.0.smithi064.stdout:0/218: mkdir d2/d29/d47 0 2023-12-16T03:15:59.086 INFO:tasks.workunit.client.0.smithi064.stdout:5/264: creat d0/d7/f64 x:0 0 0 2023-12-16T03:15:59.091 INFO:tasks.workunit.client.0.smithi064.stdout:9/233: dread d2/dc/f11 [0,4194304] 0 2023-12-16T03:15:59.108 INFO:tasks.workunit.client.0.smithi064.stdout:8/359: dwrite d0/da/fc [4194304,4194304] 0 2023-12-16T03:15:59.109 INFO:tasks.workunit.client.0.smithi064.stdout:8/360: dread d0/db/d12/d1c/f72 [0,4194304] 0 2023-12-16T03:15:59.110 INFO:tasks.workunit.client.0.smithi064.stdout:8/361: write d0/db/d37/d3a/f57 [538772,63147] 0 2023-12-16T03:15:59.116 INFO:tasks.workunit.client.0.smithi064.stdout:6/254: dwrite d3/d8/d1f/d26/f3b [0,4194304] 0 2023-12-16T03:15:59.120 INFO:tasks.workunit.client.0.smithi064.stdout:0/219: dwrite d2/d8/f1c [0,4194304] 0 2023-12-16T03:15:59.134 INFO:tasks.workunit.client.0.smithi064.stdout:8/362: dwrite d0/d1d/d24/f36 [0,4194304] 0 2023-12-16T03:15:59.136 INFO:tasks.workunit.client.0.smithi064.stdout:1/295: sync 2023-12-16T03:15:59.137 INFO:tasks.workunit.client.0.smithi064.stdout:3/328: sync 2023-12-16T03:15:59.137 INFO:tasks.workunit.client.0.smithi064.stdout:1/296: chown d3/d22 1748132989 1 2023-12-16T03:15:59.137 INFO:tasks.workunit.client.0.smithi064.stdout:1/297: chown d3/dd/l20 38247135 1 2023-12-16T03:15:59.146 INFO:tasks.workunit.client.0.smithi064.stdout:8/363: dread d0/f60 [0,4194304] 0 2023-12-16T03:15:59.151 INFO:tasks.workunit.client.0.smithi064.stdout:8/364: write d0/f2 [2082283,90133] 0 2023-12-16T03:15:59.170 INFO:tasks.workunit.client.1.smithi184.stdout:9/792: rmdir d0/d13/d20/d5b 39 2023-12-16T03:15:59.180 INFO:tasks.workunit.client.1.smithi184.stdout:4/551: creat d1/d12/d13/d40/d43/d5e/fba x:0 0 0 2023-12-16T03:15:59.183 INFO:tasks.workunit.client.1.smithi184.stdout:1/578: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fc3 x:0 0 0 2023-12-16T03:15:59.191 INFO:tasks.workunit.client.1.smithi184.stdout:4/552: dread d1/d12/d13/d40/f4d [0,4194304] 0 2023-12-16T03:15:59.201 INFO:tasks.workunit.client.1.smithi184.stdout:2/480: dwrite d3/f14 [0,4194304] 0 2023-12-16T03:15:59.215 INFO:tasks.workunit.client.1.smithi184.stdout:7/462: creat d0/d3/d2e/d79/d36/d3f/f83 x:0 0 0 2023-12-16T03:15:59.221 INFO:tasks.workunit.client.1.smithi184.stdout:4/553: dwrite d1/d12/db3/fb5 [0,4194304] 0 2023-12-16T03:15:59.221 INFO:tasks.workunit.client.1.smithi184.stdout:2/481: dwrite d3/fd [0,4194304] 0 2023-12-16T03:15:59.228 INFO:tasks.workunit.client.1.smithi184.stdout:9/793: rename d0/d13/d20/d5b/d53/d98 to d0/d13/d20/d5b/d43/dc7/ddc/dd8/d112 0 2023-12-16T03:15:59.237 INFO:tasks.workunit.client.1.smithi184.stdout:9/794: dread d0/d76/da2/dc4/dd0/ff1 [0,4194304] 0 2023-12-16T03:15:59.238 INFO:tasks.workunit.client.1.smithi184.stdout:2/482: dwrite d3/d29/d2f/f54 [0,4194304] 0 2023-12-16T03:15:59.484 INFO:tasks.workunit.client.1.smithi184.stdout:1/579: getdents d3/d34/dbc/d3c/d41/d46/d4a/d6a 0 2023-12-16T03:15:59.484 INFO:tasks.workunit.client.1.smithi184.stdout:1/580: dread - d3/d34/dbc/d3c/d41/d63/f9a zero size 2023-12-16T03:15:59.503 INFO:tasks.workunit.client.1.smithi184.stdout:1/581: dwrite f0 [0,4194304] 0 2023-12-16T03:15:59.503 INFO:tasks.workunit.client.1.smithi184.stdout:1/582: truncate d3/fa2 294611 0 2023-12-16T03:15:59.531 INFO:tasks.workunit.client.1.smithi184.stdout:7/463: rmdir d0/d3/d2e/d79/d32/d39 39 2023-12-16T03:15:59.618 INFO:tasks.workunit.client.1.smithi184.stdout:3/616: sync 2023-12-16T03:15:59.618 INFO:tasks.workunit.client.1.smithi184.stdout:5/463: sync 2023-12-16T03:15:59.618 INFO:tasks.workunit.client.1.smithi184.stdout:3/617: readlink d12/d18/d68/l75 0 2023-12-16T03:15:59.618 INFO:tasks.workunit.client.1.smithi184.stdout:6/642: sync 2023-12-16T03:15:59.618 INFO:tasks.workunit.client.1.smithi184.stdout:0/668: sync 2023-12-16T03:15:59.618 INFO:tasks.workunit.client.1.smithi184.stdout:8/664: sync 2023-12-16T03:15:59.618 INFO:tasks.workunit.client.1.smithi184.stdout:3/618: readlink d12/d18/d1f/d23/d2a/d42/d52/lb0 0 2023-12-16T03:15:59.618 INFO:tasks.workunit.client.1.smithi184.stdout:6/643: fsync d0/d5/f59 0 2023-12-16T03:15:59.619 INFO:tasks.workunit.client.1.smithi184.stdout:4/554: rename d1/d12/d13/f22 to d1/d11/d1b/fbb 0 2023-12-16T03:15:59.621 INFO:tasks.workunit.client.1.smithi184.stdout:6/644: dread d0/d5/d22/f3c [0,4194304] 0 2023-12-16T03:15:59.641 INFO:tasks.workunit.client.1.smithi184.stdout:2/483: mkdir d3/d29/d4d/d5b/da6 0 2023-12-16T03:15:59.641 INFO:tasks.workunit.client.1.smithi184.stdout:2/484: chown d3/d29/d2f/d2e/f35 212052286 1 2023-12-16T03:15:59.641 INFO:tasks.workunit.client.1.smithi184.stdout:2/485: fsync d3/d29/f78 0 2023-12-16T03:15:59.642 INFO:tasks.workunit.client.1.smithi184.stdout:1/583: creat d3/d34/dbc/d3c/fc4 x:0 0 0 2023-12-16T03:15:59.644 INFO:tasks.workunit.client.1.smithi184.stdout:8/665: dwrite d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:15:59.645 INFO:tasks.workunit.client.1.smithi184.stdout:7/464: mkdir d0/d3/d2e/d79/d36/d84 0 2023-12-16T03:15:59.645 INFO:tasks.workunit.client.1.smithi184.stdout:7/465: truncate d0/d3/d2e/d79/d1e/f2d 4764372 0 2023-12-16T03:15:59.645 INFO:tasks.workunit.client.1.smithi184.stdout:3/619: dwrite d12/d86/fc5 [0,4194304] 0 2023-12-16T03:15:59.645 INFO:tasks.workunit.client.1.smithi184.stdout:0/669: creat dc/d22/d45/d66/d80/fe7 x:0 0 0 2023-12-16T03:15:59.647 INFO:tasks.workunit.client.1.smithi184.stdout:9/795: rename d0/d13/d20/d5b/f8e to d0/d30/ddf/f113 0 2023-12-16T03:15:59.647 INFO:tasks.workunit.client.1.smithi184.stdout:9/796: dread - d0/d13/d20/d5b/d43/dab/fd3 zero size 2023-12-16T03:15:59.648 INFO:tasks.workunit.client.1.smithi184.stdout:4/555: symlink d1/d11/d5a/d63/d72/lbc 0 2023-12-16T03:15:59.650 INFO:tasks.workunit.client.1.smithi184.stdout:4/556: read d1/d12/f9b [3233537,56657] 0 2023-12-16T03:15:59.735 INFO:tasks.workunit.client.1.smithi184.stdout:6/645: symlink d0/d5/d12/d1b/d33/d3d/ld0 0 2023-12-16T03:15:59.735 INFO:tasks.workunit.client.1.smithi184.stdout:2/486: getdents d3/d29 0 2023-12-16T03:15:59.738 INFO:tasks.workunit.client.1.smithi184.stdout:1/584: link d3/d13/d2c/caa d3/d34/dbc/d3c/d41/d46/d4a/d6a/cc5 0 2023-12-16T03:15:59.738 INFO:tasks.workunit.client.1.smithi184.stdout:8/666: rmdir d2/d12/d21/d8a 39 2023-12-16T03:15:59.741 INFO:tasks.workunit.client.1.smithi184.stdout:7/466: creat d0/d3/d2e/d79/d36/d84/f85 x:0 0 0 2023-12-16T03:15:59.744 INFO:tasks.workunit.client.1.smithi184.stdout:0/670: truncate dc/d10/d1c/f49 7834587 0 2023-12-16T03:15:59.745 INFO:tasks.workunit.client.1.smithi184.stdout:5/464: mknod d1/c97 0 2023-12-16T03:15:59.748 INFO:tasks.workunit.client.1.smithi184.stdout:3/620: rename d12/d18/d1f/d23/d2a/d42/d52/d7f to d12/d86/de4 0 2023-12-16T03:15:59.748 INFO:tasks.workunit.client.1.smithi184.stdout:3/621: readlink d12/d18/d1f/d23/d2a/d42/d52/d76/da5/lc0 0 2023-12-16T03:15:59.749 INFO:tasks.workunit.client.1.smithi184.stdout:9/797: symlink d0/d3a/d47/l114 0 2023-12-16T03:15:59.750 INFO:tasks.workunit.client.1.smithi184.stdout:4/557: creat d1/d11/d5a/d63/fbd x:0 0 0 2023-12-16T03:15:59.751 INFO:tasks.workunit.client.1.smithi184.stdout:6/646: mkdir d0/d5/dd1 0 2023-12-16T03:15:59.752 INFO:tasks.workunit.client.1.smithi184.stdout:2/487: link d3/d29/d8a/f94 d3/d9/d19/fa7 0 2023-12-16T03:15:59.754 INFO:tasks.workunit.client.1.smithi184.stdout:6/647: dread d0/d5/d22/d25/d47/fac [0,4194304] 0 2023-12-16T03:15:59.755 INFO:tasks.workunit.client.1.smithi184.stdout:0/671: mknod dc/d22/d45/daf/ce8 0 2023-12-16T03:15:59.756 INFO:tasks.workunit.client.1.smithi184.stdout:5/465: truncate d1/d2a/d31/f73 180386 0 2023-12-16T03:15:59.756 INFO:tasks.workunit.client.1.smithi184.stdout:7/467: mknod d0/d3/d2e/d79/d32/c86 0 2023-12-16T03:15:59.756 INFO:tasks.workunit.client.1.smithi184.stdout:9/798: write d0/d13/f21 [249407,126452] 0 2023-12-16T03:15:59.756 INFO:tasks.workunit.client.1.smithi184.stdout:7/468: fdatasync d0/d3/f11 0 2023-12-16T03:15:59.756 INFO:tasks.workunit.client.1.smithi184.stdout:7/469: stat d0/d3/d2e/d79/d32/d35 0 2023-12-16T03:15:59.756 INFO:tasks.workunit.client.1.smithi184.stdout:9/799: chown d0/f36 2084624244 1 2023-12-16T03:15:59.758 INFO:tasks.workunit.client.1.smithi184.stdout:3/622: link d12/d18/d1f/l29 d12/d18/d1f/d23/d2a/d4a/d61/le5 0 2023-12-16T03:15:59.758 INFO:tasks.workunit.client.1.smithi184.stdout:4/558: creat d1/d29/d34/d5c/d76/d33/d4a/fbe x:0 0 0 2023-12-16T03:15:59.759 INFO:tasks.workunit.client.1.smithi184.stdout:1/585: dwrite d3/d13/f1f [0,4194304] 0 2023-12-16T03:15:59.763 INFO:tasks.workunit.client.1.smithi184.stdout:0/672: symlink dc/d10/d2d/le9 0 2023-12-16T03:15:59.764 INFO:tasks.workunit.client.1.smithi184.stdout:3/623: write f9 [1556721,78731] 0 2023-12-16T03:15:59.767 INFO:tasks.workunit.client.1.smithi184.stdout:5/466: creat d1/d3/d9/de/d15/d19/d48/f98 x:0 0 0 2023-12-16T03:15:59.769 INFO:tasks.workunit.client.1.smithi184.stdout:6/648: dread d0/d5/d12/f1c [0,4194304] 0 2023-12-16T03:15:59.771 INFO:tasks.workunit.client.1.smithi184.stdout:1/586: mknod d3/d34/dbc/d38/d52/cc6 0 2023-12-16T03:15:59.773 INFO:tasks.workunit.client.1.smithi184.stdout:3/624: symlink d12/le6 0 2023-12-16T03:15:59.774 INFO:tasks.workunit.client.1.smithi184.stdout:4/559: symlink d1/d12/db3/lbf 0 2023-12-16T03:15:59.774 INFO:tasks.workunit.client.1.smithi184.stdout:5/467: rmdir d1/d3/d9/d49 39 2023-12-16T03:15:59.774 INFO:tasks.workunit.client.1.smithi184.stdout:5/468: truncate d1/f66 1073428 0 2023-12-16T03:15:59.777 INFO:tasks.workunit.client.1.smithi184.stdout:1/587: mkdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/dc7 0 2023-12-16T03:15:59.781 INFO:tasks.workunit.client.1.smithi184.stdout:8/667: dwrite d2/d4/d10/d11/f15 [4194304,4194304] 0 2023-12-16T03:15:59.781 INFO:tasks.workunit.client.1.smithi184.stdout:4/560: symlink d1/d12/d13/d40/d43/d5e/lc0 0 2023-12-16T03:15:59.781 INFO:tasks.workunit.client.1.smithi184.stdout:1/588: unlink d3/d13/c93 0 2023-12-16T03:15:59.782 INFO:tasks.workunit.client.1.smithi184.stdout:1/589: chown d3/d34/dbc/d3c/d41/d63/c6b 1592221520 1 2023-12-16T03:15:59.783 INFO:tasks.workunit.client.1.smithi184.stdout:4/561: rmdir d1/d29/d34/d5c 39 2023-12-16T03:15:59.786 INFO:tasks.workunit.client.1.smithi184.stdout:5/469: symlink d1/d2a/d31/d28/d72/l99 0 2023-12-16T03:15:59.787 INFO:tasks.workunit.client.1.smithi184.stdout:1/590: dread d3/d34/dbc/f87 [0,4194304] 0 2023-12-16T03:15:59.788 INFO:tasks.workunit.client.1.smithi184.stdout:4/562: truncate d1/d12/d13/d40/d43/d45/fb2 818942 0 2023-12-16T03:15:59.790 INFO:tasks.workunit.client.1.smithi184.stdout:7/470: dwrite d0/d3/d4/f5e [0,4194304] 0 2023-12-16T03:15:59.793 INFO:tasks.workunit.client.1.smithi184.stdout:9/800: dwrite d0/d76/da2/db4/fec [0,4194304] 0 2023-12-16T03:15:59.793 INFO:tasks.workunit.client.1.smithi184.stdout:9/801: truncate d0/f8b 4955430 0 2023-12-16T03:15:59.794 INFO:tasks.workunit.client.1.smithi184.stdout:8/668: dread d2/d4/d10/d11/f1d [0,4194304] 0 2023-12-16T03:15:59.795 INFO:tasks.workunit.client.1.smithi184.stdout:7/471: write d0/d3/d2e/d79/d1e/f2d [1104627,113050] 0 2023-12-16T03:15:59.812 INFO:tasks.workunit.client.1.smithi184.stdout:0/673: dwrite dc/d22/d1d/d35/dc3/f9e [0,4194304] 0 2023-12-16T03:15:59.814 INFO:tasks.workunit.client.1.smithi184.stdout:3/625: dwrite d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f50 [0,4194304] 0 2023-12-16T03:15:59.814 INFO:tasks.workunit.client.1.smithi184.stdout:3/626: truncate d12/d37/d81/fd6 89839 0 2023-12-16T03:15:59.820 INFO:tasks.workunit.client.1.smithi184.stdout:4/563: creat d1/d12/fc1 x:0 0 0 2023-12-16T03:15:59.822 INFO:tasks.workunit.client.1.smithi184.stdout:1/591: dwrite d3/d34/dbc/f44 [0,4194304] 0 2023-12-16T03:15:59.822 INFO:tasks.workunit.client.1.smithi184.stdout:9/802: dwrite d0/d3a/d47/fbc [0,4194304] 0 2023-12-16T03:15:59.826 INFO:tasks.workunit.client.1.smithi184.stdout:1/592: dread d3/d34/f4e [0,4194304] 0 2023-12-16T03:15:59.833 INFO:tasks.workunit.client.1.smithi184.stdout:9/803: dread d0/d30/ddf/f113 [0,4194304] 0 2023-12-16T03:15:59.835 INFO:tasks.workunit.client.1.smithi184.stdout:1/593: dread d3/d34/d39/f66 [0,4194304] 0 2023-12-16T03:15:59.835 INFO:tasks.workunit.client.1.smithi184.stdout:1/594: write d3/d34/dbc/d3c/d24/f55 [306934,130329] 0 2023-12-16T03:15:59.885 INFO:tasks.workunit.client.1.smithi184.stdout:8/669: mknod d2/d12/d21/d30/d73/cd5 0 2023-12-16T03:15:59.885 INFO:tasks.workunit.client.1.smithi184.stdout:8/670: fsync d2/d6a/da4/f88 0 2023-12-16T03:15:59.891 INFO:tasks.workunit.client.1.smithi184.stdout:7/472: mknod d0/d3/d2e/d3b/c87 0 2023-12-16T03:15:59.891 INFO:tasks.workunit.client.1.smithi184.stdout:7/473: dread - d0/d3/d2e/d79/d36/d84/f85 zero size 2023-12-16T03:15:59.891 INFO:tasks.workunit.client.1.smithi184.stdout:7/474: chown d0/d3/d2e/d79/d32/c86 154 1 2023-12-16T03:15:59.898 INFO:tasks.workunit.client.1.smithi184.stdout:0/674: creat dc/d22/d1d/d2c/fea x:0 0 0 2023-12-16T03:15:59.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:15:59 smithi064 ceph-mon[111958]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:15:59.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/627: rename d12/d37/cad to d12/d37/d81/ce7 0 2023-12-16T03:15:59.994 INFO:tasks.workunit.client.1.smithi184.stdout:4/564: getdents d1/d11/d1b 0 2023-12-16T03:15:59.995 INFO:tasks.workunit.client.1.smithi184.stdout:3/628: dread d12/d18/d1f/d23/d2a/d4a/d61/fac [0,4194304] 0 2023-12-16T03:15:59.996 INFO:tasks.workunit.client.1.smithi184.stdout:9/804: rmdir d0/d30/ddf/df7 39 2023-12-16T03:15:59.996 INFO:tasks.workunit.client.1.smithi184.stdout:9/805: truncate d0/d30/f44 4219451 0 2023-12-16T03:15:59.997 INFO:tasks.workunit.client.1.smithi184.stdout:9/806: read - d0/d76/da2/f104 zero size 2023-12-16T03:15:59.999 INFO:tasks.workunit.client.1.smithi184.stdout:1/595: link d3/d34/dbc/d3c/fc4 d3/d34/dbc/d3c/d41/d46/fc8 0 2023-12-16T03:16:00.008 INFO:tasks.workunit.client.1.smithi184.stdout:1/596: dread d3/d34/dbc/d3c/f4f [0,4194304] 0 2023-12-16T03:16:00.016 INFO:tasks.workunit.client.1.smithi184.stdout:8/671: mkdir d2/d4/d10/d75/dd6 0 2023-12-16T03:16:00.019 INFO:tasks.workunit.client.1.smithi184.stdout:7/475: mknod d0/d3/d2e/d79/d32/d39/c88 0 2023-12-16T03:16:00.019 INFO:tasks.workunit.client.1.smithi184.stdout:7/476: readlink d0/d3/d2e/d79/d32/l6f 0 2023-12-16T03:16:00.022 INFO:tasks.workunit.client.1.smithi184.stdout:0/675: link dc/d10/d2d/le9 dc/d22/d45/leb 0 2023-12-16T03:16:00.023 INFO:tasks.workunit.client.1.smithi184.stdout:4/565: symlink d1/d11/d5a/d63/d72/lc2 0 2023-12-16T03:16:00.023 INFO:tasks.workunit.client.1.smithi184.stdout:3/629: getdents d12/d1e/d89/dc2 0 2023-12-16T03:16:00.023 INFO:tasks.workunit.client.1.smithi184.stdout:9/807: creat d0/d13/d20/d5b/d53/f115 x:0 0 0 2023-12-16T03:16:00.023 INFO:tasks.workunit.client.1.smithi184.stdout:9/808: fdatasync d0/d13/d20/d5b/d53/f115 0 2023-12-16T03:16:00.023 INFO:tasks.workunit.client.1.smithi184.stdout:9/809: fdatasync d0/d76/dbf/f109 0 2023-12-16T03:16:00.025 INFO:tasks.workunit.client.1.smithi184.stdout:1/597: rename d3/d13/c6e to d3/d34/dbc/d3c/d41/cc9 0 2023-12-16T03:16:00.026 INFO:tasks.workunit.client.1.smithi184.stdout:1/598: write d3/d34/d76/f85 [205119,124884] 0 2023-12-16T03:16:00.026 INFO:tasks.workunit.client.1.smithi184.stdout:1/599: read d3/d34/f4e [748586,47067] 0 2023-12-16T03:16:00.034 INFO:tasks.workunit.client.1.smithi184.stdout:8/672: dwrite d2/d6a/da4/f88 [0,4194304] 0 2023-12-16T03:16:00.047 INFO:tasks.workunit.client.1.smithi184.stdout:1/600: dwrite d3/d34/dbc/d3c/f25 [0,4194304] 0 2023-12-16T03:16:00.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:15:59 smithi184 ceph-mon[121180]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:16:00.124 INFO:tasks.workunit.client.1.smithi184.stdout:7/477: creat d0/f89 x:0 0 0 2023-12-16T03:16:00.125 INFO:tasks.workunit.client.1.smithi184.stdout:7/478: chown d0/d3/d2e/d79/f4d 668696 1 2023-12-16T03:16:00.125 INFO:tasks.workunit.client.1.smithi184.stdout:0/676: creat dc/d22/d1d/da5/fec x:0 0 0 2023-12-16T03:16:00.126 INFO:tasks.workunit.client.1.smithi184.stdout:4/566: mknod d1/d11/d1b/cc3 0 2023-12-16T03:16:00.128 INFO:tasks.workunit.client.1.smithi184.stdout:3/630: rename d12/d18/d1f/d23/d2a/d3e to d12/d1e/de8 0 2023-12-16T03:16:00.131 INFO:tasks.workunit.client.1.smithi184.stdout:8/673: mkdir d2/d37/d7c/dd7 0 2023-12-16T03:16:00.137 INFO:tasks.workunit.client.1.smithi184.stdout:1/601: mkdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca 0 2023-12-16T03:16:00.139 INFO:tasks.workunit.client.0.smithi064.stdout:7/324: unlink d7/l32 0 2023-12-16T03:16:00.149 INFO:tasks.workunit.client.0.smithi064.stdout:6/255: mkdir d3/d8/d1f/d26/d47 0 2023-12-16T03:16:00.149 INFO:tasks.workunit.client.0.smithi064.stdout:6/256: write d3/d8/d13/f40 [973439,109158] 0 2023-12-16T03:16:00.149 INFO:tasks.workunit.client.0.smithi064.stdout:6/257: chown d3/d8/d1f/d26/d47 12312142 1 2023-12-16T03:16:00.153 INFO:tasks.workunit.client.1.smithi184.stdout:7/479: mkdir d0/d3/d2e/d79/d32/d8a 0 2023-12-16T03:16:00.154 INFO:tasks.workunit.client.1.smithi184.stdout:0/677: truncate dc/f58 716486 0 2023-12-16T03:16:00.156 INFO:tasks.workunit.client.1.smithi184.stdout:4/567: symlink d1/d29/d34/d5c/d76/d42/lc4 0 2023-12-16T03:16:00.158 INFO:tasks.workunit.client.1.smithi184.stdout:9/810: rename d0/d13/d6e/d84/d10b to d0/d3a/d10f/d116 0 2023-12-16T03:16:00.158 INFO:tasks.workunit.client.1.smithi184.stdout:3/631: mkdir d12/d18/d1f/d23/d2a/d42/de9 0 2023-12-16T03:16:00.159 INFO:tasks.workunit.client.1.smithi184.stdout:7/480: truncate d0/d3/d2e/d79/dd/f1d 3754626 0 2023-12-16T03:16:00.159 INFO:tasks.workunit.client.1.smithi184.stdout:7/481: stat d0/f77 0 2023-12-16T03:16:00.160 INFO:tasks.workunit.client.1.smithi184.stdout:0/678: mkdir dc/d22/d53/ded 0 2023-12-16T03:16:00.162 INFO:tasks.workunit.client.1.smithi184.stdout:1/602: rename d3/d34/dbc/l2b to d3/d34/dbc/d3c/lcb 0 2023-12-16T03:16:00.162 INFO:tasks.workunit.client.1.smithi184.stdout:1/603: truncate d3/d34/dbc/d3c/d24/f55 1301000 0 2023-12-16T03:16:00.163 INFO:tasks.workunit.client.1.smithi184.stdout:9/811: mkdir d0/d13/d20/d5b/d43/dc7/dda/d117 0 2023-12-16T03:16:00.165 INFO:tasks.workunit.client.1.smithi184.stdout:1/604: mknod d3/d34/dbc/d38/d52/ccc 0 2023-12-16T03:16:00.165 INFO:tasks.workunit.client.1.smithi184.stdout:1/605: chown d3 53662 1 2023-12-16T03:16:00.165 INFO:tasks.workunit.client.1.smithi184.stdout:1/606: rename d3/d34/dbc/d3c to d3/d34/dbc/d3c/d41/dcd 22 2023-12-16T03:16:00.165 INFO:tasks.workunit.client.1.smithi184.stdout:1/607: write d3/d34/dbc/d3c/d41/d46/fc8 [114262,56030] 0 2023-12-16T03:16:00.167 INFO:tasks.workunit.client.1.smithi184.stdout:1/608: unlink d3/d34/c89 0 2023-12-16T03:16:00.167 INFO:tasks.workunit.client.1.smithi184.stdout:1/609: fdatasync d3/d34/dbc/d3c/d24/f43 0 2023-12-16T03:16:00.168 INFO:tasks.workunit.client.1.smithi184.stdout:1/610: creat d3/d34/dbc/d3c/d41/d46/d4a/fce x:0 0 0 2023-12-16T03:16:00.169 INFO:tasks.workunit.client.1.smithi184.stdout:1/611: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/fcf x:0 0 0 2023-12-16T03:16:00.169 INFO:tasks.workunit.client.1.smithi184.stdout:1/612: dread - d3/d34/dbc/d3c/d24/d8e/fb0 zero size 2023-12-16T03:16:00.170 INFO:tasks.workunit.client.1.smithi184.stdout:1/613: read d3/d34/dbc/d3c/f25 [2314304,58334] 0 2023-12-16T03:16:00.181 INFO:tasks.workunit.client.1.smithi184.stdout:8/674: dwrite d2/d4/d10/d11/d72/dc2/fcf [0,4194304] 0 2023-12-16T03:16:00.183 INFO:tasks.workunit.client.1.smithi184.stdout:9/812: dread d0/d13/d20/d5b/faf [0,4194304] 0 2023-12-16T03:16:00.189 INFO:tasks.workunit.client.1.smithi184.stdout:1/614: dread d3/d13/f90 [4194304,4194304] 0 2023-12-16T03:16:00.189 INFO:tasks.workunit.client.1.smithi184.stdout:8/675: read d2/d12/d21/d2d/d31/f6c [4343636,84674] 0 2023-12-16T03:16:00.189 INFO:tasks.workunit.client.1.smithi184.stdout:8/676: dread - d2/d12/d21/d30/f98 zero size 2023-12-16T03:16:00.189 INFO:tasks.workunit.client.1.smithi184.stdout:8/677: fdatasync d2/d12/d21/d2d/d31/f63 0 2023-12-16T03:16:00.189 INFO:tasks.workunit.client.1.smithi184.stdout:8/678: fdatasync d2/d4/d10/d99/fbe 0 2023-12-16T03:16:00.190 INFO:tasks.workunit.client.1.smithi184.stdout:1/615: creat d3/d34/dbc/d3c/d41/d46/fd0 x:0 0 0 2023-12-16T03:16:00.191 INFO:tasks.workunit.client.1.smithi184.stdout:8/679: creat d2/d4/d10/d7a/d83/fd8 x:0 0 0 2023-12-16T03:16:00.192 INFO:tasks.workunit.client.1.smithi184.stdout:1/616: mknod d3/d34/cd1 0 2023-12-16T03:16:00.193 INFO:tasks.workunit.client.1.smithi184.stdout:1/617: chown d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/dc7 1142038 1 2023-12-16T03:16:00.208 INFO:tasks.workunit.client.1.smithi184.stdout:7/482: write d0/d3/d2e/d79/d36/d3f/f4f [605986,15022] 0 2023-12-16T03:16:00.210 INFO:tasks.workunit.client.1.smithi184.stdout:1/618: dread d3/d34/dbc/d38/d52/f6c [0,4194304] 0 2023-12-16T03:16:00.210 INFO:tasks.workunit.client.1.smithi184.stdout:8/680: getdents d2/d4/d10/d7a/d83 0 2023-12-16T03:16:00.211 INFO:tasks.workunit.client.1.smithi184.stdout:1/619: symlink d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/ld2 0 2023-12-16T03:16:00.211 INFO:tasks.workunit.client.1.smithi184.stdout:1/620: fsync d3/d34/dbc/d3c/d41/f4d 0 2023-12-16T03:16:00.212 INFO:tasks.workunit.client.1.smithi184.stdout:3/632: dwrite d12/d1e/de8/d48/d7b/f85 [0,4194304] 0 2023-12-16T03:16:00.212 INFO:tasks.workunit.client.0.smithi064.stdout:6/258: dwrite d3/d9/f45 [0,4194304] 0 2023-12-16T03:16:00.213 INFO:tasks.workunit.client.0.smithi064.stdout:7/325: dwrite d7/d3e/d42/d48/f5b [0,4194304] 0 2023-12-16T03:16:00.214 INFO:tasks.workunit.client.1.smithi184.stdout:7/483: dread d0/d3/f64 [0,4194304] 0 2023-12-16T03:16:00.214 INFO:tasks.workunit.client.1.smithi184.stdout:1/621: truncate d3/d34/dbc/d36/f48 216303 0 2023-12-16T03:16:00.217 INFO:tasks.workunit.client.1.smithi184.stdout:7/484: truncate d0/d3/f5 4232448 0 2023-12-16T03:16:00.217 INFO:tasks.workunit.client.1.smithi184.stdout:7/485: stat d0/d3/d4/f25 0 2023-12-16T03:16:00.221 INFO:tasks.workunit.client.1.smithi184.stdout:1/622: rename d3/d34/dbc/d38/d52/fb5 to d3/d34/dbc/d3c/d41/d77/fd3 0 2023-12-16T03:16:00.222 INFO:tasks.workunit.client.0.smithi064.stdout:7/326: mknod d7/d3e/d42/c64 0 2023-12-16T03:16:00.222 INFO:tasks.workunit.client.0.smithi064.stdout:7/327: fdatasync d7/d3e/d42/d48/f5b 0 2023-12-16T03:16:00.224 INFO:tasks.workunit.client.0.smithi064.stdout:6/259: rename d3/c7 to d3/d8/d1f/d26/c48 0 2023-12-16T03:16:00.224 INFO:tasks.workunit.client.1.smithi184.stdout:4/568: dwrite d1/f8 [0,4194304] 0 2023-12-16T03:16:00.227 INFO:tasks.workunit.client.1.smithi184.stdout:1/623: rmdir d3/d34/dbc/d3c/d41/d77/db1 0 2023-12-16T03:16:00.227 INFO:tasks.workunit.client.1.smithi184.stdout:1/624: chown d3/fa2 1 1 2023-12-16T03:16:00.230 INFO:tasks.workunit.client.1.smithi184.stdout:4/569: rename d1/d11/d5a/d63/d72/d98/f4b to d1/d11/d1b/d1e/fc5 0 2023-12-16T03:16:00.232 INFO:tasks.workunit.client.1.smithi184.stdout:4/570: rename d1/d29/d34/f48 to d1/d29/d34/d5c/d76/d42/d90/fc6 0 2023-12-16T03:16:00.232 INFO:tasks.workunit.client.1.smithi184.stdout:9/813: dwrite d0/d13/d20/f8f [0,4194304] 0 2023-12-16T03:16:00.236 INFO:tasks.workunit.client.1.smithi184.stdout:4/571: mkdir d1/d29/d34/d5c/d76/dc7 0 2023-12-16T03:16:00.236 INFO:tasks.workunit.client.1.smithi184.stdout:9/814: write d0/f14 [1274454,24045] 0 2023-12-16T03:16:00.238 INFO:tasks.workunit.client.1.smithi184.stdout:4/572: write d1/d11/f23 [382253,58789] 0 2023-12-16T03:16:00.238 INFO:tasks.workunit.client.1.smithi184.stdout:9/815: link d0/d13/d6e/fe8 d0/d76/dbf/f118 0 2023-12-16T03:16:00.240 INFO:tasks.workunit.client.1.smithi184.stdout:4/573: symlink d1/d11/d5a/lc8 0 2023-12-16T03:16:00.240 INFO:tasks.workunit.client.1.smithi184.stdout:9/816: symlink d0/d76/db7/l119 0 2023-12-16T03:16:00.241 INFO:tasks.workunit.client.1.smithi184.stdout:9/817: truncate d0/d13/d20/f55 4394563 0 2023-12-16T03:16:00.241 INFO:tasks.workunit.client.1.smithi184.stdout:7/486: dwrite d0/d3/d2e/d79/d32/d39/f48 [0,4194304] 0 2023-12-16T03:16:00.241 INFO:tasks.workunit.client.1.smithi184.stdout:3/633: dwrite d12/d18/da1/dbd/dc8/fcd [0,4194304] 0 2023-12-16T03:16:00.243 INFO:tasks.workunit.client.1.smithi184.stdout:9/818: mkdir d0/d13/d20/d5b/d43/d11a 0 2023-12-16T03:16:00.244 INFO:tasks.workunit.client.1.smithi184.stdout:7/487: symlink d0/d3/d4/l8b 0 2023-12-16T03:16:00.248 INFO:tasks.workunit.client.1.smithi184.stdout:3/634: creat d12/d1e/da3/fea x:0 0 0 2023-12-16T03:16:00.248 INFO:tasks.workunit.client.1.smithi184.stdout:3/635: write d12/d18/d1f/d23/d2a/d4a/fd2 [70378,23488] 0 2023-12-16T03:16:00.248 INFO:tasks.workunit.client.1.smithi184.stdout:3/636: fsync d12/d18/f74 0 2023-12-16T03:16:00.249 INFO:tasks.workunit.client.1.smithi184.stdout:9/819: mknod d0/d13/d20/c11b 0 2023-12-16T03:16:00.249 INFO:tasks.workunit.client.1.smithi184.stdout:9/820: getdents d0/d13/d20/d10c 0 2023-12-16T03:16:00.250 INFO:tasks.workunit.client.1.smithi184.stdout:4/574: dread d1/d11/d5a/f6f [0,4194304] 0 2023-12-16T03:16:00.251 INFO:tasks.workunit.client.1.smithi184.stdout:7/488: symlink d0/d3/d2e/d79/d36/l8c 0 2023-12-16T03:16:00.251 INFO:tasks.workunit.client.1.smithi184.stdout:7/489: readlink d0/d6b/l58 0 2023-12-16T03:16:00.251 INFO:tasks.workunit.client.1.smithi184.stdout:7/490: chown d0/d3/f64 1637 1 2023-12-16T03:16:00.251 INFO:tasks.workunit.client.1.smithi184.stdout:7/491: fdatasync d0/d3/d2e/d79/d32/d39/f70 0 2023-12-16T03:16:00.251 INFO:tasks.workunit.client.1.smithi184.stdout:7/492: dread - d0/d3/d2e/d79/dd/d27/f76 zero size 2023-12-16T03:16:00.252 INFO:tasks.workunit.client.1.smithi184.stdout:3/637: dread d12/d18/d1f/d23/d2a/f55 [4194304,4194304] 0 2023-12-16T03:16:00.252 INFO:tasks.workunit.client.0.smithi064.stdout:6/260: dwrite d3/d8/d13/f1b [4194304,4194304] 0 2023-12-16T03:16:00.252 INFO:tasks.workunit.client.0.smithi064.stdout:6/261: fsync d3/d9/fb 0 2023-12-16T03:16:00.252 INFO:tasks.workunit.client.0.smithi064.stdout:6/262: chown d3/d8/c2a 16952 1 2023-12-16T03:16:00.253 INFO:tasks.workunit.client.1.smithi184.stdout:7/493: dread d0/d3/d2e/d79/f4d [0,4194304] 0 2023-12-16T03:16:00.253 INFO:tasks.workunit.client.1.smithi184.stdout:4/575: symlink d1/d12/d13/d40/d43/d45/lc9 0 2023-12-16T03:16:00.256 INFO:tasks.workunit.client.1.smithi184.stdout:3/638: rmdir d12/d18/d1f 39 2023-12-16T03:16:00.260 INFO:tasks.workunit.client.1.smithi184.stdout:9/821: getdents d0/d76/db7 0 2023-12-16T03:16:00.264 INFO:tasks.workunit.client.1.smithi184.stdout:7/494: unlink d0/d3/d2e/f5f 0 2023-12-16T03:16:00.265 INFO:tasks.workunit.client.1.smithi184.stdout:3/639: truncate d12/d18/d7a/f8f 4114019 0 2023-12-16T03:16:00.265 INFO:tasks.workunit.client.1.smithi184.stdout:3/640: write d12/d18/d1f/f5d [1024005,130141] 0 2023-12-16T03:16:00.266 INFO:tasks.workunit.client.1.smithi184.stdout:3/641: chown d12/d18/d68/f9a 2991 1 2023-12-16T03:16:00.266 INFO:tasks.workunit.client.1.smithi184.stdout:9/822: mknod d0/d76/db7/c11c 0 2023-12-16T03:16:00.267 INFO:tasks.workunit.client.1.smithi184.stdout:7/495: creat d0/d3/d2e/d79/d36/d3f/f8d x:0 0 0 2023-12-16T03:16:00.268 INFO:tasks.workunit.client.1.smithi184.stdout:4/576: dwrite d1/d29/d34/f9c [0,4194304] 0 2023-12-16T03:16:00.268 INFO:tasks.workunit.client.1.smithi184.stdout:4/577: fdatasync d1/d12/d13/d40/d43/d5e/d6a/f97 0 2023-12-16T03:16:00.268 INFO:tasks.workunit.client.0.smithi064.stdout:6/263: dread d3/fd [0,4194304] 0 2023-12-16T03:16:00.268 INFO:tasks.workunit.client.0.smithi064.stdout:6/264: chown d3/d8/d13/c16 397870302 1 2023-12-16T03:16:00.268 INFO:tasks.workunit.client.1.smithi184.stdout:3/642: rename d12/d1e/de8/d48/l83 to d12/d1e/leb 0 2023-12-16T03:16:00.271 INFO:tasks.workunit.client.1.smithi184.stdout:7/496: truncate d0/d3/d2e/d79/f2a 3276463 0 2023-12-16T03:16:00.271 INFO:tasks.workunit.client.1.smithi184.stdout:7/497: write d0/d3/d2e/d79/d36/f66 [1194737,29086] 0 2023-12-16T03:16:00.274 INFO:tasks.workunit.client.1.smithi184.stdout:4/578: rename d1/d29/d34/d5c/d76/d42/l7d to d1/d11/d5a/d63/lca 0 2023-12-16T03:16:00.274 INFO:tasks.workunit.client.1.smithi184.stdout:4/579: chown d1/d11/d5a/d63/d72/lc2 125343135 1 2023-12-16T03:16:00.279 INFO:tasks.workunit.client.1.smithi184.stdout:4/580: rename d1/c6d to d1/d12/d13/d40/ccb 0 2023-12-16T03:16:00.279 INFO:tasks.workunit.client.1.smithi184.stdout:9/823: dread d0/d13/d20/f8f [0,4194304] 0 2023-12-16T03:16:00.279 INFO:tasks.workunit.client.1.smithi184.stdout:9/824: fsync d0/d13/d20/f86 0 2023-12-16T03:16:00.284 INFO:tasks.workunit.client.1.smithi184.stdout:9/825: getdents d0/d76/da2 0 2023-12-16T03:16:00.284 INFO:tasks.workunit.client.1.smithi184.stdout:9/826: chown d0/d13/d20/d5b/d43/dc7 20809 1 2023-12-16T03:16:00.286 INFO:tasks.workunit.client.1.smithi184.stdout:9/827: creat d0/d13/d20/d5b/d43/f11d x:0 0 0 2023-12-16T03:16:00.288 INFO:tasks.workunit.client.0.smithi064.stdout:6/265: dread d3/d9/f20 [4194304,4194304] 0 2023-12-16T03:16:00.289 INFO:tasks.workunit.client.1.smithi184.stdout:9/828: mknod d0/d76/dbf/c11e 0 2023-12-16T03:16:00.289 INFO:tasks.workunit.client.0.smithi064.stdout:6/266: rename d3/d8/d1f/d26/c3c to d3/d8/da/c49 0 2023-12-16T03:16:00.301 INFO:tasks.workunit.client.1.smithi184.stdout:3/643: dwrite d12/d37/f95 [0,4194304] 0 2023-12-16T03:16:00.301 INFO:tasks.workunit.client.1.smithi184.stdout:4/581: dread d1/d12/d13/f31 [0,4194304] 0 2023-12-16T03:16:00.301 INFO:tasks.workunit.client.1.smithi184.stdout:3/644: creat d12/d18/d84/fec x:0 0 0 2023-12-16T03:16:00.303 INFO:tasks.workunit.client.1.smithi184.stdout:4/582: creat d1/d12/fcc x:0 0 0 2023-12-16T03:16:00.304 INFO:tasks.workunit.client.1.smithi184.stdout:7/498: dwrite d0/d6b/f78 [0,4194304] 0 2023-12-16T03:16:00.306 INFO:tasks.workunit.client.1.smithi184.stdout:3/645: write d12/d18/d1f/d23/d2a/d42/d52/f58 [3292166,73260] 0 2023-12-16T03:16:00.308 INFO:tasks.workunit.client.1.smithi184.stdout:3/646: rename fd to d12/d18/d1f/d93/fed 0 2023-12-16T03:16:00.314 INFO:tasks.workunit.client.1.smithi184.stdout:4/583: dread d1/d29/d34/f9c [0,4194304] 0 2023-12-16T03:16:00.315 INFO:tasks.workunit.client.1.smithi184.stdout:4/584: truncate d1/fd 2069378 0 2023-12-16T03:16:00.316 INFO:tasks.workunit.client.1.smithi184.stdout:9/829: dwrite d0/d13/d20/f55 [0,4194304] 0 2023-12-16T03:16:00.318 INFO:tasks.workunit.client.1.smithi184.stdout:9/830: mkdir d0/d76/dbf/d11f 0 2023-12-16T03:16:00.320 INFO:tasks.workunit.client.0.smithi064.stdout:6/267: dwrite d3/d8/da/f23 [0,4194304] 0 2023-12-16T03:16:00.321 INFO:tasks.workunit.client.1.smithi184.stdout:3/647: dread d12/d18/d1f/d23/d2a/fbb [0,4194304] 0 2023-12-16T03:16:00.322 INFO:tasks.workunit.client.1.smithi184.stdout:9/831: write d0/d13/f87 [3174757,125586] 0 2023-12-16T03:16:00.323 INFO:tasks.workunit.client.1.smithi184.stdout:3/648: mknod d12/d1e/da3/cee 0 2023-12-16T03:16:00.325 INFO:tasks.workunit.client.1.smithi184.stdout:9/832: mkdir d0/d76/da2/d120 0 2023-12-16T03:16:00.327 INFO:tasks.workunit.client.1.smithi184.stdout:7/499: dwrite d0/d6b/f78 [0,4194304] 0 2023-12-16T03:16:00.327 INFO:tasks.workunit.client.1.smithi184.stdout:7/500: dread - d0/d6b/d69/f6e zero size 2023-12-16T03:16:00.330 INFO:tasks.workunit.client.1.smithi184.stdout:3/649: creat d12/d18/d1f/d23/d2a/d42/de9/fef x:0 0 0 2023-12-16T03:16:00.330 INFO:tasks.workunit.client.1.smithi184.stdout:9/833: truncate d0/d76/db7/d100/f10d 772168 0 2023-12-16T03:16:00.330 INFO:tasks.workunit.client.1.smithi184.stdout:3/650: write d12/d18/d1f/d23/d51/dd7/de3/fdd [198423,63414] 0 2023-12-16T03:16:00.332 INFO:tasks.workunit.client.1.smithi184.stdout:7/501: rename d0/d3/d2e/d79/d36/d3f/f8d to d0/d3/d2e/d79/d32/d8a/f8e 0 2023-12-16T03:16:00.332 INFO:tasks.workunit.client.1.smithi184.stdout:3/651: symlink d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/lf0 0 2023-12-16T03:16:00.334 INFO:tasks.workunit.client.1.smithi184.stdout:7/502: mkdir d0/d3/d2e/d79/d32/d39/d8f 0 2023-12-16T03:16:00.335 INFO:tasks.workunit.client.1.smithi184.stdout:3/652: unlink d12/d18/d1f/d23/d2a/f55 0 2023-12-16T03:16:00.335 INFO:tasks.workunit.client.1.smithi184.stdout:3/653: chown d12/d18/f71 22663 1 2023-12-16T03:16:00.336 INFO:tasks.workunit.client.1.smithi184.stdout:7/503: creat d0/d6b/d69/f90 x:0 0 0 2023-12-16T03:16:00.340 INFO:tasks.workunit.client.1.smithi184.stdout:3/654: dread d12/d18/d1f/d23/d2a/fbb [0,4194304] 0 2023-12-16T03:16:00.341 INFO:tasks.workunit.client.1.smithi184.stdout:7/504: read d0/f77 [4012197,129283] 0 2023-12-16T03:16:00.341 INFO:tasks.workunit.client.1.smithi184.stdout:4/585: dwrite d1/d11/d5a/fa3 [0,4194304] 0 2023-12-16T03:16:00.341 INFO:tasks.workunit.client.1.smithi184.stdout:4/586: fdatasync d1/d29/d34/d5c/d76/d3b/f53 0 2023-12-16T03:16:00.342 INFO:tasks.workunit.client.0.smithi064.stdout:6/268: dwrite d3/d8/da/fe [0,4194304] 0 2023-12-16T03:16:00.343 INFO:tasks.workunit.client.1.smithi184.stdout:9/834: dread d0/d13/f2a [0,4194304] 0 2023-12-16T03:16:00.343 INFO:tasks.workunit.client.1.smithi184.stdout:9/835: chown d0/d13/l49 1451 1 2023-12-16T03:16:00.344 INFO:tasks.workunit.client.1.smithi184.stdout:3/655: write d12/d18/f71 [643513,19383] 0 2023-12-16T03:16:00.344 INFO:tasks.workunit.client.1.smithi184.stdout:3/656: dread - d12/d18/f32 zero size 2023-12-16T03:16:00.345 INFO:tasks.workunit.client.1.smithi184.stdout:7/505: write d0/d3/f1a [2228729,103606] 0 2023-12-16T03:16:00.345 INFO:tasks.workunit.client.1.smithi184.stdout:4/587: dread d1/d29/d34/f3d [0,4194304] 0 2023-12-16T03:16:00.347 INFO:tasks.workunit.client.1.smithi184.stdout:4/588: write d1/d12/f3e [3123939,101321] 0 2023-12-16T03:16:00.347 INFO:tasks.workunit.client.1.smithi184.stdout:9/836: mkdir d0/d3a/d121 0 2023-12-16T03:16:00.347 INFO:tasks.workunit.client.1.smithi184.stdout:4/589: chown d1/d12/d13/d40/ccb 58116202 1 2023-12-16T03:16:00.347 INFO:tasks.workunit.client.1.smithi184.stdout:4/590: fdatasync d1/d12/db3/fb5 0 2023-12-16T03:16:00.350 INFO:tasks.workunit.client.1.smithi184.stdout:3/657: symlink d12/d18/d1f/d23/d2a/d4a/d61/da9/lf1 0 2023-12-16T03:16:00.355 INFO:tasks.workunit.client.1.smithi184.stdout:7/506: mknod d0/d3/d68/c91 0 2023-12-16T03:16:00.357 INFO:tasks.workunit.client.1.smithi184.stdout:9/837: dread d0/d13/d20/d5b/faf [0,4194304] 0 2023-12-16T03:16:00.357 INFO:tasks.workunit.client.1.smithi184.stdout:9/838: read - d0/ff6 zero size 2023-12-16T03:16:00.357 INFO:tasks.workunit.client.1.smithi184.stdout:9/839: chown d0/d13/d20/d5b/fed 106875 1 2023-12-16T03:16:00.358 INFO:tasks.workunit.client.1.smithi184.stdout:7/507: creat d0/d3/d2e/d79/d36/d3f/f92 x:0 0 0 2023-12-16T03:16:00.358 INFO:tasks.workunit.client.1.smithi184.stdout:7/508: chown d0/d3/d2e/d79/d32/c86 337153338 1 2023-12-16T03:16:00.360 INFO:tasks.workunit.client.1.smithi184.stdout:9/840: symlink d0/d76/db7/d100/l122 0 2023-12-16T03:16:00.361 INFO:tasks.workunit.client.0.smithi064.stdout:6/269: dread d3/d9/fb [0,4194304] 0 2023-12-16T03:16:00.361 INFO:tasks.workunit.client.1.smithi184.stdout:7/509: getdents d0/d3/d2e/d79/dd/d27 0 2023-12-16T03:16:00.362 INFO:tasks.workunit.client.0.smithi064.stdout:6/270: mkdir d3/d8/d1f/d26/d47/d4a 0 2023-12-16T03:16:00.363 INFO:tasks.workunit.client.1.smithi184.stdout:7/510: write d0/d3/d4/f25 [247116,55267] 0 2023-12-16T03:16:00.363 INFO:tasks.workunit.client.1.smithi184.stdout:3/658: read f9 [116035,44927] 0 2023-12-16T03:16:00.364 INFO:tasks.workunit.client.0.smithi064.stdout:6/271: mknod d3/d8/da/c4b 0 2023-12-16T03:16:00.367 INFO:tasks.workunit.client.0.smithi064.stdout:6/272: link d3/d9/f18 d3/d8/f4c 0 2023-12-16T03:16:00.369 INFO:tasks.workunit.client.1.smithi184.stdout:3/659: mkdir d12/d1e/de8/df2 0 2023-12-16T03:16:00.371 INFO:tasks.workunit.client.1.smithi184.stdout:3/660: mkdir d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/df3 0 2023-12-16T03:16:00.371 INFO:tasks.workunit.client.1.smithi184.stdout:3/661: write d12/d37/d81/f87 [895849,62606] 0 2023-12-16T03:16:00.371 INFO:tasks.workunit.client.0.smithi064.stdout:6/273: dread d3/d8/f4c [0,4194304] 0 2023-12-16T03:16:00.371 INFO:tasks.workunit.client.0.smithi064.stdout:6/274: dread - d3/d8/da/f43 zero size 2023-12-16T03:16:00.372 INFO:tasks.workunit.client.1.smithi184.stdout:4/591: dwrite d1/d12/f17 [0,4194304] 0 2023-12-16T03:16:00.373 INFO:tasks.workunit.client.1.smithi184.stdout:4/592: write d1/d11/d5a/f60 [18653,126703] 0 2023-12-16T03:16:00.374 INFO:tasks.workunit.client.1.smithi184.stdout:3/662: mknod d12/d18/da1/cf4 0 2023-12-16T03:16:00.376 INFO:tasks.workunit.client.1.smithi184.stdout:4/593: truncate d1/d11/d1b/f87 2731254 0 2023-12-16T03:16:00.378 INFO:tasks.workunit.client.1.smithi184.stdout:3/663: mknod d12/d18/d1f/d23/d2a/d42/d52/d76/d80/cf5 0 2023-12-16T03:16:00.378 INFO:tasks.workunit.client.1.smithi184.stdout:4/594: write d1/d11/d5a/f6f [1474065,40840] 0 2023-12-16T03:16:00.380 INFO:tasks.workunit.client.1.smithi184.stdout:9/841: dwrite d0/d13/f87 [0,4194304] 0 2023-12-16T03:16:00.381 INFO:tasks.workunit.client.1.smithi184.stdout:3/664: creat d12/d18/d1f/d23/d2a/d42/d52/ff6 x:0 0 0 2023-12-16T03:16:00.384 INFO:tasks.workunit.client.1.smithi184.stdout:9/842: unlink d0/f57 0 2023-12-16T03:16:00.384 INFO:tasks.workunit.client.1.smithi184.stdout:9/843: truncate d0/d3a/d47/fa9 1796148 0 2023-12-16T03:16:00.385 INFO:tasks.workunit.client.1.smithi184.stdout:9/844: write d0/d76/dbf/f118 [553068,79159] 0 2023-12-16T03:16:00.386 INFO:tasks.workunit.client.1.smithi184.stdout:3/665: symlink d12/d18/d1f/d23/d2a/lf7 0 2023-12-16T03:16:00.386 INFO:tasks.workunit.client.1.smithi184.stdout:3/666: fdatasync d12/d1e/da3/fea 0 2023-12-16T03:16:00.386 INFO:tasks.workunit.client.1.smithi184.stdout:3/667: truncate d12/d18/d1f/d23/d2a/d4a/f91 1322908 0 2023-12-16T03:16:00.386 INFO:tasks.workunit.client.1.smithi184.stdout:3/668: truncate d12/d18/d1f/d23/d51/f90 89060 0 2023-12-16T03:16:00.388 INFO:tasks.workunit.client.1.smithi184.stdout:3/669: creat d12/d18/d1f/ff8 x:0 0 0 2023-12-16T03:16:00.388 INFO:tasks.workunit.client.1.smithi184.stdout:3/670: write d12/d37/fd1 [4864123,108504] 0 2023-12-16T03:16:00.389 INFO:tasks.workunit.client.1.smithi184.stdout:9/845: write d0/d3a/d47/f71 [1079373,46150] 0 2023-12-16T03:16:00.389 INFO:tasks.workunit.client.1.smithi184.stdout:9/846: readlink d0/d3a/l89 0 2023-12-16T03:16:00.393 INFO:tasks.workunit.client.1.smithi184.stdout:3/671: creat d12/d1e/de8/ff9 x:0 0 0 2023-12-16T03:16:00.393 INFO:tasks.workunit.client.1.smithi184.stdout:9/847: link d0/d30/ce4 d0/d13/d6e/c123 0 2023-12-16T03:16:00.393 INFO:tasks.workunit.client.1.smithi184.stdout:9/848: write d0/d76/dbf/ffb [777503,44445] 0 2023-12-16T03:16:00.393 INFO:tasks.workunit.client.0.smithi064.stdout:6/275: dwrite d3/d8/da/f43 [0,4194304] 0 2023-12-16T03:16:00.393 INFO:tasks.workunit.client.0.smithi064.stdout:6/276: write d3/d9/f18 [4661534,60931] 0 2023-12-16T03:16:00.394 INFO:tasks.workunit.client.0.smithi064.stdout:6/277: write d3/d8/da/f23 [2286869,9488] 0 2023-12-16T03:16:00.398 INFO:tasks.workunit.client.1.smithi184.stdout:3/672: symlink d12/d18/d7a/lfa 0 2023-12-16T03:16:00.401 INFO:tasks.workunit.client.1.smithi184.stdout:9/849: link d0/d13/d6e/c123 d0/d13/d6e/c124 0 2023-12-16T03:16:00.408 INFO:tasks.workunit.client.1.smithi184.stdout:7/511: dwrite d0/d3/d2e/d79/dd/f1d [0,4194304] 0 2023-12-16T03:16:00.419 INFO:tasks.workunit.client.1.smithi184.stdout:7/512: dread d0/d3/d2e/d79/d32/d39/f48 [0,4194304] 0 2023-12-16T03:16:00.420 INFO:tasks.workunit.client.1.smithi184.stdout:2/488: sync 2023-12-16T03:16:00.421 INFO:tasks.workunit.client.1.smithi184.stdout:2/489: creat d3/d9/d19/d82/fa8 x:0 0 0 2023-12-16T03:16:00.429 INFO:tasks.workunit.client.0.smithi064.stdout:6/278: dwrite d3/d8/da/f23 [4194304,4194304] 0 2023-12-16T03:16:00.430 INFO:tasks.workunit.client.1.smithi184.stdout:9/850: dwrite d0/d13/d20/db0/f83 [0,4194304] 0 2023-12-16T03:16:00.430 INFO:tasks.workunit.client.1.smithi184.stdout:3/673: dwrite d12/d18/f32 [0,4194304] 0 2023-12-16T03:16:00.431 INFO:tasks.workunit.client.1.smithi184.stdout:9/851: dread d0/d3a/f59 [0,4194304] 0 2023-12-16T03:16:00.431 INFO:tasks.workunit.client.1.smithi184.stdout:9/852: write d0/d13/d20/d5b/d53/fa7 [142713,25600] 0 2023-12-16T03:16:00.433 INFO:tasks.workunit.client.1.smithi184.stdout:2/490: dread d3/d13/d28/f3e [0,4194304] 0 2023-12-16T03:16:00.433 INFO:tasks.workunit.client.1.smithi184.stdout:2/491: read d3/d13/f66 [1022849,5346] 0 2023-12-16T03:16:00.434 INFO:tasks.workunit.client.1.smithi184.stdout:3/674: creat d12/d18/d7a/db4/ffb x:0 0 0 2023-12-16T03:16:00.434 INFO:tasks.workunit.client.1.smithi184.stdout:9/853: truncate d0/f78 925762 0 2023-12-16T03:16:00.435 INFO:tasks.workunit.client.1.smithi184.stdout:2/492: getdents d3/d13/d28 0 2023-12-16T03:16:00.437 INFO:tasks.workunit.client.1.smithi184.stdout:7/513: dwrite d0/f89 [0,4194304] 0 2023-12-16T03:16:00.437 INFO:tasks.workunit.client.1.smithi184.stdout:3/675: rename d12/d1e/da3 to d12/d18/d1f/d23/d2a/dfc 0 2023-12-16T03:16:00.437 INFO:tasks.workunit.client.1.smithi184.stdout:3/676: chown d12/d1e/de8/d48/l4f 68595527 1 2023-12-16T03:16:00.438 INFO:tasks.workunit.client.1.smithi184.stdout:9/854: rmdir d0/d13/d20/d5b/d43/dc7 39 2023-12-16T03:16:00.439 INFO:tasks.workunit.client.1.smithi184.stdout:2/493: symlink d3/d13/la9 0 2023-12-16T03:16:00.444 INFO:tasks.workunit.client.1.smithi184.stdout:7/514: rename d0/d3/d2e/d79/dd/d27/f60 to d0/d3/d2e/d79/d36/d84/f93 0 2023-12-16T03:16:00.445 INFO:tasks.workunit.client.0.smithi064.stdout:6/279: dread d3/d8/da/f23 [4194304,4194304] 0 2023-12-16T03:16:00.445 INFO:tasks.workunit.client.1.smithi184.stdout:3/677: rename d12/d18/d1f/d23/d51/f79 to d12/d18/d1f/d23/d51/ffd 0 2023-12-16T03:16:00.445 INFO:tasks.workunit.client.0.smithi064.stdout:6/280: read d3/d8/da/f37 [3168413,5622] 0 2023-12-16T03:16:00.458 INFO:tasks.workunit.client.1.smithi184.stdout:3/678: dwrite d12/d18/f7c [0,4194304] 0 2023-12-16T03:16:00.474 INFO:tasks.workunit.client.1.smithi184.stdout:2/494: stat d3/d29/c34 0 2023-12-16T03:16:00.474 INFO:tasks.workunit.client.1.smithi184.stdout:2/495: dread - d3/d29/d2f/d46/f7e zero size 2023-12-16T03:16:00.474 INFO:tasks.workunit.client.1.smithi184.stdout:2/496: write d3/f3c [397516,45219] 0 2023-12-16T03:16:00.474 INFO:tasks.workunit.client.1.smithi184.stdout:2/497: chown d3/f48 95 1 2023-12-16T03:16:00.477 INFO:tasks.workunit.client.0.smithi064.stdout:9/234: getdents d2/d2d/d3b/d3c/d34 0 2023-12-16T03:16:00.478 INFO:tasks.workunit.client.1.smithi184.stdout:2/498: dread d3/d29/f30 [0,4194304] 0 2023-12-16T03:16:00.479 INFO:tasks.workunit.client.1.smithi184.stdout:2/499: stat c2 0 2023-12-16T03:16:00.480 INFO:tasks.workunit.client.1.smithi184.stdout:7/515: mkdir d0/d6b/d94 0 2023-12-16T03:16:00.481 INFO:tasks.workunit.client.0.smithi064.stdout:0/220: getdents d2/d8/da/df 0 2023-12-16T03:16:00.481 INFO:tasks.workunit.client.0.smithi064.stdout:0/221: write d2/d8/f40 [174185,88288] 0 2023-12-16T03:16:00.481 INFO:tasks.workunit.client.0.smithi064.stdout:0/222: chown d2/d7/d10/l12 476797476 1 2023-12-16T03:16:00.482 INFO:tasks.workunit.client.0.smithi064.stdout:0/223: read d2/f5 [1478674,67027] 0 2023-12-16T03:16:00.483 INFO:tasks.workunit.client.0.smithi064.stdout:8/365: mkdir d0/db/d12/d1c/d6a/d7e 0 2023-12-16T03:16:00.483 INFO:tasks.workunit.client.0.smithi064.stdout:8/366: stat d0/da/d3e/f53 0 2023-12-16T03:16:00.484 INFO:tasks.workunit.client.0.smithi064.stdout:6/281: link d3/d9/d2d/c36 d3/d8/d1f/d26/c4d 0 2023-12-16T03:16:00.484 INFO:tasks.workunit.client.0.smithi064.stdout:6/282: chown d3/l6 84030051 1 2023-12-16T03:16:00.484 INFO:tasks.workunit.client.0.smithi064.stdout:6/283: chown d3/d8/l31 123 1 2023-12-16T03:16:00.487 INFO:tasks.workunit.client.0.smithi064.stdout:8/367: link d0/da/d3e/d46/c6c d0/d1d/d3c/c7f 0 2023-12-16T03:16:00.487 INFO:tasks.workunit.client.1.smithi184.stdout:3/679: mknod d12/d18/da1/dbd/cfe 0 2023-12-16T03:16:00.488 INFO:tasks.workunit.client.1.smithi184.stdout:3/680: chown d12/d37 4212 1 2023-12-16T03:16:00.490 INFO:tasks.workunit.client.0.smithi064.stdout:8/368: symlink d0/db/d4c/l80 0 2023-12-16T03:16:00.490 INFO:tasks.workunit.client.0.smithi064.stdout:9/235: dwrite d2/f33 [0,4194304] 0 2023-12-16T03:16:00.491 INFO:tasks.workunit.client.1.smithi184.stdout:2/500: link d3/fd d3/d9/faa 0 2023-12-16T03:16:00.493 INFO:tasks.workunit.client.0.smithi064.stdout:6/284: unlink d3/d8/d1f/d26/l2f 0 2023-12-16T03:16:00.496 INFO:tasks.workunit.client.0.smithi064.stdout:2/269: creat d1/d15/d23/d2d/f50 x:0 0 0 2023-12-16T03:16:00.497 INFO:tasks.workunit.client.0.smithi064.stdout:2/270: fdatasync d1/d15/d1e/f3f 0 2023-12-16T03:16:00.497 INFO:tasks.workunit.client.0.smithi064.stdout:8/369: getdents d0/da/d3e/d46 0 2023-12-16T03:16:00.499 INFO:tasks.workunit.client.1.smithi184.stdout:7/516: symlink d0/d3/l95 0 2023-12-16T03:16:00.504 INFO:tasks.workunit.client.1.smithi184.stdout:7/517: write d0/d3/f7 [4133781,15638] 0 2023-12-16T03:16:00.507 INFO:tasks.workunit.client.1.smithi184.stdout:7/518: mknod d0/d6b/d94/c96 0 2023-12-16T03:16:00.507 INFO:tasks.workunit.client.0.smithi064.stdout:3/329: symlink db/d12/d1a/d2c/d34/d4c/l71 0 2023-12-16T03:16:00.508 INFO:tasks.workunit.client.0.smithi064.stdout:9/236: getdents d2/d2d/d3b/d3c 0 2023-12-16T03:16:00.508 INFO:tasks.workunit.client.0.smithi064.stdout:3/330: dread - db/d12/d21/f65 zero size 2023-12-16T03:16:00.510 INFO:tasks.workunit.client.0.smithi064.stdout:0/224: link d2/d8/da/c15 d2/d8/da/df/c48 0 2023-12-16T03:16:00.510 INFO:tasks.workunit.client.0.smithi064.stdout:0/225: chown d2/d7/d10/f3f 636787 1 2023-12-16T03:16:00.510 INFO:tasks.workunit.client.0.smithi064.stdout:0/226: fdatasync d2/d7/d10/f1a 0 2023-12-16T03:16:00.512 INFO:tasks.workunit.client.0.smithi064.stdout:3/331: unlink db/c5f 0 2023-12-16T03:16:00.513 INFO:tasks.workunit.client.1.smithi184.stdout:7/519: write d0/d3/d2e/d79/d1e/f2d [2982344,66523] 0 2023-12-16T03:16:00.515 INFO:tasks.workunit.client.0.smithi064.stdout:3/332: read f6 [3396645,25007] 0 2023-12-16T03:16:00.517 INFO:tasks.workunit.client.0.smithi064.stdout:9/237: creat d2/d2d/d3b/d3c/d34/f45 x:0 0 0 2023-12-16T03:16:00.517 INFO:tasks.workunit.client.0.smithi064.stdout:9/238: write d2/dc/f11 [5006848,111332] 0 2023-12-16T03:16:00.518 INFO:tasks.workunit.client.0.smithi064.stdout:3/333: truncate db/d4f/f6b 704788 0 2023-12-16T03:16:00.519 INFO:tasks.workunit.client.0.smithi064.stdout:3/334: write db/f16 [4260686,90751] 0 2023-12-16T03:16:00.522 INFO:tasks.workunit.client.0.smithi064.stdout:9/239: creat d2/d2d/d3f/f46 x:0 0 0 2023-12-16T03:16:00.528 INFO:tasks.workunit.client.0.smithi064.stdout:9/240: link d2/d2d/d3b/d3c/l18 d2/d2d/l47 0 2023-12-16T03:16:00.530 INFO:tasks.workunit.client.0.smithi064.stdout:1/298: rename d3/d36/d44/d4d/d58/c5c to d3/d36/d44/d4d/d58/c61 0 2023-12-16T03:16:00.531 INFO:tasks.workunit.client.0.smithi064.stdout:1/299: mknod d3/dd/d11/d38/c62 0 2023-12-16T03:16:00.539 INFO:tasks.workunit.client.0.smithi064.stdout:9/241: dread d2/dc/ff [0,4194304] 0 2023-12-16T03:16:00.539 INFO:tasks.workunit.client.0.smithi064.stdout:9/242: chown d2/d2d/d3f/f46 244448437 1 2023-12-16T03:16:00.546 INFO:tasks.workunit.client.1.smithi184.stdout:7/520: dwrite d0/d3/f1a [0,4194304] 0 2023-12-16T03:16:00.566 INFO:tasks.workunit.client.1.smithi184.stdout:3/681: dwrite d12/d1e/d89/f96 [0,4194304] 0 2023-12-16T03:16:00.567 INFO:tasks.workunit.client.1.smithi184.stdout:3/682: creat d12/d1e/fff x:0 0 0 2023-12-16T03:16:00.567 INFO:tasks.workunit.client.1.smithi184.stdout:3/683: chown c10 50 1 2023-12-16T03:16:00.568 INFO:tasks.workunit.client.1.smithi184.stdout:3/684: symlink d12/d18/da1/dbd/l100 0 2023-12-16T03:16:00.568 INFO:tasks.workunit.client.1.smithi184.stdout:3/685: creat d12/d1e/f101 x:0 0 0 2023-12-16T03:16:00.569 INFO:tasks.workunit.client.1.smithi184.stdout:3/686: write d12/d1e/f20 [325689,43030] 0 2023-12-16T03:16:00.570 INFO:tasks.workunit.client.1.smithi184.stdout:3/687: mkdir d12/d86/de4/d102 0 2023-12-16T03:16:00.570 INFO:tasks.workunit.client.1.smithi184.stdout:3/688: fdatasync d12/d18/d1f/d23/d2a/d42/d52/f6f 0 2023-12-16T03:16:00.570 INFO:tasks.workunit.client.1.smithi184.stdout:3/689: mknod d12/d1e/de8/d48/d7b/c103 0 2023-12-16T03:16:00.572 INFO:tasks.workunit.client.1.smithi184.stdout:3/690: unlink d12/d18/d7a/f8f 0 2023-12-16T03:16:00.572 INFO:tasks.workunit.client.1.smithi184.stdout:3/691: getdents d12/d1e/de8/d48 0 2023-12-16T03:16:00.596 INFO:tasks.workunit.client.0.smithi064.stdout:2/271: dwrite d1/d15/d23/d2d/f50 [0,4194304] 0 2023-12-16T03:16:00.597 INFO:tasks.workunit.client.0.smithi064.stdout:2/272: chown d1/d15/f28 0 1 2023-12-16T03:16:00.598 INFO:tasks.workunit.client.0.smithi064.stdout:6/285: dwrite d3/d8/f4c [0,4194304] 0 2023-12-16T03:16:00.598 INFO:tasks.workunit.client.1.smithi184.stdout:2/501: dwrite d3/d13/f18 [0,4194304] 0 2023-12-16T03:16:00.598 INFO:tasks.workunit.client.1.smithi184.stdout:2/502: write d3/f48 [1002613,6143] 0 2023-12-16T03:16:00.598 INFO:tasks.workunit.client.1.smithi184.stdout:2/503: chown d3/d9/d19/d87/l36 2834713 1 2023-12-16T03:16:00.600 INFO:tasks.workunit.client.0.smithi064.stdout:2/273: rename d1/f9 to d1/d15/d23/f51 0 2023-12-16T03:16:00.603 INFO:tasks.workunit.client.0.smithi064.stdout:6/286: unlink d3/d8/d13/f40 0 2023-12-16T03:16:00.606 INFO:tasks.workunit.client.0.smithi064.stdout:1/300: dwrite d3/dd/d11/f34 [0,4194304] 0 2023-12-16T03:16:00.606 INFO:tasks.workunit.client.0.smithi064.stdout:8/370: dwrite d0/db/d37/f61 [0,4194304] 0 2023-12-16T03:16:00.606 INFO:tasks.workunit.client.0.smithi064.stdout:8/371: chown d0/d1d/d24/l1a 6 1 2023-12-16T03:16:00.606 INFO:tasks.workunit.client.0.smithi064.stdout:0/227: dwrite d2/f32 [0,4194304] 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:9/243: dwrite d2/dc/ff [4194304,4194304] 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:0/228: truncate d2/d29/f33 222266 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:0/229: chown d2/d7/d10 3 1 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:9/244: truncate d2/f40 1223795 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:0/230: stat d2/d8/l22 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:0/231: truncate d2/d7/d10/d21/d31/f35 100204 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:0/232: fsync d2/f5 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:3/335: dwrite db/d12/d1a/d2c/d34/f3d [0,4194304] 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:3/336: write f4 [4359149,4229] 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:2/274: creat d1/d27/d35/f52 x:0 0 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:2/275: fsync d1/d15/f1f 0 2023-12-16T03:16:00.607 INFO:tasks.workunit.client.0.smithi064.stdout:2/276: fsync d1/d27/d2e/f34 0 2023-12-16T03:16:00.608 INFO:tasks.workunit.client.0.smithi064.stdout:2/277: read d1/f7 [939613,37572] 0 2023-12-16T03:16:00.608 INFO:tasks.workunit.client.1.smithi184.stdout:7/521: dwrite d0/d3/d2e/d79/d1e/f5d [0,4194304] 0 2023-12-16T03:16:00.608 INFO:tasks.workunit.client.1.smithi184.stdout:3/692: dwrite d12/d18/d7a/fbe [0,4194304] 0 2023-12-16T03:16:00.613 INFO:tasks.workunit.client.0.smithi064.stdout:1/301: link d3/dd/d23/d41/f53 d3/dd/d23/d60/f63 0 2023-12-16T03:16:00.613 INFO:tasks.workunit.client.0.smithi064.stdout:1/302: write d3/d36/f45 [4895774,118259] 0 2023-12-16T03:16:00.618 INFO:tasks.workunit.client.0.smithi064.stdout:5/265: sync 2023-12-16T03:16:00.618 INFO:tasks.workunit.client.0.smithi064.stdout:4/317: sync 2023-12-16T03:16:00.623 INFO:tasks.workunit.client.0.smithi064.stdout:8/372: unlink d0/db/d12/d44/d68/f75 0 2023-12-16T03:16:00.623 INFO:tasks.workunit.client.0.smithi064.stdout:8/373: read - d0/da/d16/f6e zero size 2023-12-16T03:16:00.631 INFO:tasks.workunit.client.1.smithi184.stdout:2/504: getdents d3/d9/d19/d87 0 2023-12-16T03:16:00.632 INFO:tasks.workunit.client.0.smithi064.stdout:9/245: creat d2/dc/d24/d39/d42/f48 x:0 0 0 2023-12-16T03:16:00.633 INFO:tasks.workunit.client.1.smithi184.stdout:7/522: creat d0/d3/f97 x:0 0 0 2023-12-16T03:16:00.634 INFO:tasks.workunit.client.1.smithi184.stdout:7/523: write d0/d3/d2e/d79/d32/d8a/f8e [120466,129329] 0 2023-12-16T03:16:00.635 INFO:tasks.workunit.client.1.smithi184.stdout:3/693: symlink d12/d86/l104 0 2023-12-16T03:16:00.636 INFO:tasks.workunit.client.1.smithi184.stdout:2/505: mkdir d3/d29/d4d/dab 0 2023-12-16T03:16:00.636 INFO:tasks.workunit.client.0.smithi064.stdout:3/337: stat db/d12/d1a/l4d 0 2023-12-16T03:16:00.637 INFO:tasks.workunit.client.1.smithi184.stdout:7/524: mknod d0/d3/d2e/d3b/c98 0 2023-12-16T03:16:00.638 INFO:tasks.workunit.client.0.smithi064.stdout:1/303: creat d3/dd/d11/d2f/f64 x:0 0 0 2023-12-16T03:16:00.639 INFO:tasks.workunit.client.0.smithi064.stdout:6/287: dwrite d3/d8/da/f43 [0,4194304] 0 2023-12-16T03:16:00.640 INFO:tasks.workunit.client.1.smithi184.stdout:3/694: symlink d12/d18/d68/l105 0 2023-12-16T03:16:00.640 INFO:tasks.workunit.client.0.smithi064.stdout:3/338: read db/d12/f58 [2877873,80543] 0 2023-12-16T03:16:00.642 INFO:tasks.workunit.client.1.smithi184.stdout:2/506: mkdir d3/d13/d28/dac 0 2023-12-16T03:16:00.644 INFO:tasks.workunit.client.0.smithi064.stdout:4/318: link d0/d12/d48/c4e d0/d14/d5a/c5f 0 2023-12-16T03:16:00.644 INFO:tasks.workunit.client.0.smithi064.stdout:4/319: fsync d0/d12/f2a 0 2023-12-16T03:16:00.644 INFO:tasks.workunit.client.0.smithi064.stdout:0/233: dwrite d2/f27 [4194304,4194304] 0 2023-12-16T03:16:00.644 INFO:tasks.workunit.client.0.smithi064.stdout:0/234: write d2/d7/d10/f14 [4793222,2749] 0 2023-12-16T03:16:00.644 INFO:tasks.workunit.client.0.smithi064.stdout:0/235: chown d2/d7/d10/f1a 76765 1 2023-12-16T03:16:00.645 INFO:tasks.workunit.client.0.smithi064.stdout:0/236: truncate d2/d8/f45 4494 0 2023-12-16T03:16:00.645 INFO:tasks.workunit.client.0.smithi064.stdout:0/237: truncate d2/d8/f1c 4802529 0 2023-12-16T03:16:00.645 INFO:tasks.workunit.client.1.smithi184.stdout:3/695: mkdir d12/d18/d1f/d23/d2a/d4a/d61/da9/d106 0 2023-12-16T03:16:00.646 INFO:tasks.workunit.client.1.smithi184.stdout:3/696: chown d12/d18/d1f/d23/d2a/d4a/c7d 771 1 2023-12-16T03:16:00.647 INFO:tasks.workunit.client.0.smithi064.stdout:9/246: creat d2/d2d/d3b/f49 x:0 0 0 2023-12-16T03:16:00.647 INFO:tasks.workunit.client.0.smithi064.stdout:9/247: readlink d2/dc/l1a 0 2023-12-16T03:16:00.647 INFO:tasks.workunit.client.0.smithi064.stdout:2/278: dwrite d1/d27/f29 [4194304,4194304] 0 2023-12-16T03:16:00.648 INFO:tasks.workunit.client.1.smithi184.stdout:2/507: rmdir d3/d29/d61/d6d 39 2023-12-16T03:16:00.650 INFO:tasks.workunit.client.0.smithi064.stdout:1/304: link d3/d22/f32 d3/d36/f65 0 2023-12-16T03:16:00.651 INFO:tasks.workunit.client.1.smithi184.stdout:3/697: symlink d12/d18/da1/dbd/l107 0 2023-12-16T03:16:00.653 INFO:tasks.workunit.client.0.smithi064.stdout:6/288: unlink d3/d8/da/l14 0 2023-12-16T03:16:00.654 INFO:tasks.workunit.client.1.smithi184.stdout:2/508: mknod d3/d29/cad 0 2023-12-16T03:16:00.657 INFO:tasks.workunit.client.0.smithi064.stdout:5/266: link d0/l12 d0/d14/d25/l65 0 2023-12-16T03:16:00.659 INFO:tasks.workunit.client.1.smithi184.stdout:6/649: sync 2023-12-16T03:16:00.659 INFO:tasks.workunit.client.1.smithi184.stdout:6/650: chown d0/d5/d22/d25/l2e 24499355 1 2023-12-16T03:16:00.660 INFO:tasks.workunit.client.0.smithi064.stdout:3/339: mknod db/d12/d21/c72 0 2023-12-16T03:16:00.660 INFO:tasks.workunit.client.0.smithi064.stdout:5/267: write d0/de/d23/f3f [3730176,55359] 0 2023-12-16T03:16:00.661 INFO:tasks.workunit.client.1.smithi184.stdout:2/509: rmdir d3/d29/d61/d6d/d96 0 2023-12-16T03:16:00.663 INFO:tasks.workunit.client.1.smithi184.stdout:2/510: symlink d3/d13/d28/dac/lae 0 2023-12-16T03:16:00.665 INFO:tasks.workunit.client.1.smithi184.stdout:7/525: dwrite d0/d3/d2e/d79/d32/d39/f73 [0,4194304] 0 2023-12-16T03:16:00.665 INFO:tasks.workunit.client.1.smithi184.stdout:7/526: dread - d0/d6b/d69/f6e zero size 2023-12-16T03:16:00.666 INFO:tasks.workunit.client.0.smithi064.stdout:5/268: write d0/d7/fa [507515,115915] 0 2023-12-16T03:16:00.667 INFO:tasks.workunit.client.0.smithi064.stdout:4/320: dwrite d0/f8 [0,4194304] 0 2023-12-16T03:16:00.667 INFO:tasks.workunit.client.0.smithi064.stdout:4/321: read - d0/d12/f35 zero size 2023-12-16T03:16:00.667 INFO:tasks.workunit.client.0.smithi064.stdout:4/322: chown d0/d14/d33/l3c 4282 1 2023-12-16T03:16:00.667 INFO:tasks.workunit.client.0.smithi064.stdout:4/323: write d0/d42/f5c [895984,121648] 0 2023-12-16T03:16:00.667 INFO:tasks.workunit.client.0.smithi064.stdout:9/248: symlink d2/dc/d24/d39/d42/l4a 0 2023-12-16T03:16:00.667 INFO:tasks.workunit.client.1.smithi184.stdout:2/511: truncate d3/d29/d61/d6d/f99 4990397 0 2023-12-16T03:16:00.668 INFO:tasks.workunit.client.0.smithi064.stdout:0/238: rmdir d2/d29 39 2023-12-16T03:16:00.672 INFO:tasks.workunit.client.0.smithi064.stdout:2/279: rename d1/d15/d1e/c32 to d1/d15/d23/d2d/c53 0 2023-12-16T03:16:00.672 INFO:tasks.workunit.client.0.smithi064.stdout:2/280: chown d1/d15/d1b 7 1 2023-12-16T03:16:00.673 INFO:tasks.workunit.client.1.smithi184.stdout:7/527: stat d0/d3/d2e/d79/l16 0 2023-12-16T03:16:00.673 INFO:tasks.workunit.client.0.smithi064.stdout:2/281: write d1/d27/f29 [7307371,17451] 0 2023-12-16T03:16:00.674 INFO:tasks.workunit.client.0.smithi064.stdout:1/305: mknod d3/dd/d11/d3b/c66 0 2023-12-16T03:16:00.675 INFO:tasks.workunit.client.1.smithi184.stdout:2/512: unlink d3/d29/c70 0 2023-12-16T03:16:00.676 INFO:tasks.workunit.client.1.smithi184.stdout:3/698: dread d12/d18/d1f/d93/fed [0,4194304] 0 2023-12-16T03:16:00.676 INFO:tasks.workunit.client.0.smithi064.stdout:6/289: symlink d3/d8/d1f/d26/d47/l4e 0 2023-12-16T03:16:00.679 INFO:tasks.workunit.client.0.smithi064.stdout:3/340: truncate db/d12/d1a/d2c/f5b 2821221 0 2023-12-16T03:16:00.679 INFO:tasks.workunit.client.0.smithi064.stdout:3/341: getdents db/d12/d1a/d2c/d6e 0 2023-12-16T03:16:00.680 INFO:tasks.workunit.client.1.smithi184.stdout:2/513: mkdir d3/d13/d28/dac/daf 0 2023-12-16T03:16:00.680 INFO:tasks.workunit.client.1.smithi184.stdout:7/528: symlink d0/d6b/l99 0 2023-12-16T03:16:00.681 INFO:tasks.workunit.client.1.smithi184.stdout:6/651: dread d0/d5/d12/d1b/d33/f58 [0,4194304] 0 2023-12-16T03:16:00.684 INFO:tasks.workunit.client.1.smithi184.stdout:3/699: creat d12/d37/f108 x:0 0 0 2023-12-16T03:16:00.684 INFO:tasks.workunit.client.1.smithi184.stdout:3/700: write d12/d37/d81/fd6 [824795,78429] 0 2023-12-16T03:16:00.686 INFO:tasks.workunit.client.1.smithi184.stdout:3/701: write d12/d1e/d89/f96 [4067107,99419] 0 2023-12-16T03:16:00.687 INFO:tasks.workunit.client.0.smithi064.stdout:5/269: dwrite d0/d14/d20/d37/d3c/f52 [0,4194304] 0 2023-12-16T03:16:00.687 INFO:tasks.workunit.client.0.smithi064.stdout:5/270: write d0/d7/f1e [1086304,42538] 0 2023-12-16T03:16:00.687 INFO:tasks.workunit.client.0.smithi064.stdout:5/271: dread - d0/d14/d4e/f53 zero size 2023-12-16T03:16:00.687 INFO:tasks.workunit.client.1.smithi184.stdout:2/514: dread d3/d9/f86 [0,4194304] 0 2023-12-16T03:16:00.687 INFO:tasks.workunit.client.1.smithi184.stdout:7/529: creat d0/d3/d2e/d79/f9a x:0 0 0 2023-12-16T03:16:00.691 INFO:tasks.workunit.client.1.smithi184.stdout:6/652: symlink d0/d5/ld2 0 2023-12-16T03:16:00.691 INFO:tasks.workunit.client.0.smithi064.stdout:4/324: creat d0/d1e/f60 x:0 0 0 2023-12-16T03:16:00.693 INFO:tasks.workunit.client.1.smithi184.stdout:2/515: creat d3/d29/fb0 x:0 0 0 2023-12-16T03:16:00.694 INFO:tasks.workunit.client.1.smithi184.stdout:2/516: chown d3/d13/l59 346855 1 2023-12-16T03:16:00.695 INFO:tasks.workunit.client.0.smithi064.stdout:9/249: getdents d2/dc/d24 0 2023-12-16T03:16:00.695 INFO:tasks.workunit.client.0.smithi064.stdout:9/250: write d2/dc/f12 [4440669,122532] 0 2023-12-16T03:16:00.696 INFO:tasks.workunit.client.1.smithi184.stdout:6/653: creat d0/d5/d22/fd3 x:0 0 0 2023-12-16T03:16:00.698 INFO:tasks.workunit.client.0.smithi064.stdout:0/239: link d2/d8/f45 d2/d7/f49 0 2023-12-16T03:16:00.700 INFO:tasks.workunit.client.1.smithi184.stdout:2/517: creat d3/d13/d28/dac/fb1 x:0 0 0 2023-12-16T03:16:00.700 INFO:tasks.workunit.client.1.smithi184.stdout:2/518: stat d3/d13/f9a 0 2023-12-16T03:16:00.700 INFO:tasks.workunit.client.0.smithi064.stdout:2/282: mknod d1/d27/c54 0 2023-12-16T03:16:00.701 INFO:tasks.workunit.client.0.smithi064.stdout:2/283: chown d1/d15/f1a 63464 1 2023-12-16T03:16:00.701 INFO:tasks.workunit.client.0.smithi064.stdout:2/284: chown d1/d15/d23/d2d/c53 1630492127 1 2023-12-16T03:16:00.701 INFO:tasks.workunit.client.0.smithi064.stdout:6/290: dwrite d3/d9/fb [0,4194304] 0 2023-12-16T03:16:00.703 INFO:tasks.workunit.client.1.smithi184.stdout:6/654: symlink d0/d5/d22/d25/dbf/ld4 0 2023-12-16T03:16:00.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/655: chown d0/d5/d12/d1b/lba 304 1 2023-12-16T03:16:00.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/656: chown d0/d5/d22/l4f 13651513 1 2023-12-16T03:16:00.704 INFO:tasks.workunit.client.1.smithi184.stdout:2/519: read d3/d29/d61/f68 [3306725,90082] 0 2023-12-16T03:16:00.704 INFO:tasks.workunit.client.0.smithi064.stdout:1/306: mkdir d3/d36/d44/d4d/d67 0 2023-12-16T03:16:00.704 INFO:tasks.workunit.client.0.smithi064.stdout:1/307: dread - d3/d36/d44/f51 zero size 2023-12-16T03:16:00.704 INFO:tasks.workunit.client.0.smithi064.stdout:2/285: dread d1/d15/f1a [0,4194304] 0 2023-12-16T03:16:00.705 INFO:tasks.workunit.client.0.smithi064.stdout:3/342: creat db/d12/d4e/f73 x:0 0 0 2023-12-16T03:16:00.707 INFO:tasks.workunit.client.0.smithi064.stdout:5/272: dread d0/d7/f1a [0,4194304] 0 2023-12-16T03:16:00.710 INFO:tasks.workunit.client.0.smithi064.stdout:3/343: dread db/d12/d21/f30 [0,4194304] 0 2023-12-16T03:16:00.710 INFO:tasks.workunit.client.0.smithi064.stdout:3/344: stat db/d13 0 2023-12-16T03:16:00.711 INFO:tasks.workunit.client.1.smithi184.stdout:2/520: rmdir d3/d29/d4d/dab 0 2023-12-16T03:16:00.711 INFO:tasks.workunit.client.1.smithi184.stdout:2/521: write d3/d29/d4d/fa3 [1043674,113845] 0 2023-12-16T03:16:00.711 INFO:tasks.workunit.client.1.smithi184.stdout:2/522: fdatasync d3/f50 0 2023-12-16T03:16:00.711 INFO:tasks.workunit.client.1.smithi184.stdout:2/523: truncate d3/d29/d2f/d46/d77/f98 919384 0 2023-12-16T03:16:00.713 INFO:tasks.workunit.client.0.smithi064.stdout:3/345: read db/d12/d21/f49 [3008592,119036] 0 2023-12-16T03:16:00.714 INFO:tasks.workunit.client.0.smithi064.stdout:6/291: dread d3/d8/da/f37 [0,4194304] 0 2023-12-16T03:16:00.715 INFO:tasks.workunit.client.0.smithi064.stdout:6/292: fdatasync d3/d8/f4c 0 2023-12-16T03:16:00.715 INFO:tasks.workunit.client.1.smithi184.stdout:7/530: dwrite d0/d3/d2e/d79/dd/f46 [0,4194304] 0 2023-12-16T03:16:00.715 INFO:tasks.workunit.client.1.smithi184.stdout:7/531: dread - d0/d3/f97 zero size 2023-12-16T03:16:00.715 INFO:tasks.workunit.client.1.smithi184.stdout:7/532: fsync d0/d3/d2e/d79/d36/d84/f93 0 2023-12-16T03:16:00.715 INFO:tasks.workunit.client.0.smithi064.stdout:4/325: rmdir d0/d42/d4c 39 2023-12-16T03:16:00.719 INFO:tasks.workunit.client.0.smithi064.stdout:9/251: mkdir d2/d2d/d3b/d3c/d4b 0 2023-12-16T03:16:00.722 INFO:tasks.workunit.client.0.smithi064.stdout:0/240: link d2/d8/da/c19 d2/d8/da/d11/c4a 0 2023-12-16T03:16:00.722 INFO:tasks.workunit.client.0.smithi064.stdout:5/273: rmdir d0/d14/d4e 39 2023-12-16T03:16:00.724 INFO:tasks.workunit.client.1.smithi184.stdout:2/524: creat d3/d13/d28/fb2 x:0 0 0 2023-12-16T03:16:00.725 INFO:tasks.workunit.client.1.smithi184.stdout:7/533: dread d0/d3/d2e/d79/d32/d39/f70 [0,4194304] 0 2023-12-16T03:16:00.728 INFO:tasks.workunit.client.1.smithi184.stdout:7/534: creat d0/d3/d2e/d79/d36/d84/f9b x:0 0 0 2023-12-16T03:16:00.729 INFO:tasks.workunit.client.0.smithi064.stdout:5/274: write d0/d7/f1d [102124,92857] 0 2023-12-16T03:16:00.729 INFO:tasks.workunit.client.0.smithi064.stdout:4/326: dread d0/d14/d33/f38 [0,4194304] 0 2023-12-16T03:16:00.730 INFO:tasks.workunit.client.1.smithi184.stdout:6/657: dwrite d0/d36/d8a/fce [0,4194304] 0 2023-12-16T03:16:00.730 INFO:tasks.workunit.client.0.smithi064.stdout:3/346: creat db/d12/d21/f74 x:0 0 0 2023-12-16T03:16:00.738 INFO:tasks.workunit.client.0.smithi064.stdout:9/252: creat d2/d2d/d3b/d3c/d4b/f4c x:0 0 0 2023-12-16T03:16:00.738 INFO:tasks.workunit.client.0.smithi064.stdout:9/253: write d2/d2d/d3b/d3c/d4b/f4c [220088,19286] 0 2023-12-16T03:16:00.738 INFO:tasks.workunit.client.0.smithi064.stdout:9/254: stat d2/f2e 0 2023-12-16T03:16:00.738 INFO:tasks.workunit.client.0.smithi064.stdout:9/255: chown d2/dc/f32 0 1 2023-12-16T03:16:00.738 INFO:tasks.workunit.client.0.smithi064.stdout:5/275: dread d0/f3 [0,4194304] 0 2023-12-16T03:16:00.738 INFO:tasks.workunit.client.0.smithi064.stdout:5/276: chown d0/de 29362 1 2023-12-16T03:16:00.738 INFO:tasks.workunit.client.1.smithi184.stdout:7/535: dread d0/d3/d4/f5e [0,4194304] 0 2023-12-16T03:16:00.738 INFO:tasks.workunit.client.1.smithi184.stdout:6/658: creat d0/d36/d79/fd5 x:0 0 0 2023-12-16T03:16:00.741 INFO:tasks.workunit.client.0.smithi064.stdout:3/347: mkdir db/d12/d1a/d2c/d6e/d75 0 2023-12-16T03:16:00.742 INFO:tasks.workunit.client.1.smithi184.stdout:7/536: mkdir d0/d3/d2e/d79/d32/d39/d9c 0 2023-12-16T03:16:00.742 INFO:tasks.workunit.client.1.smithi184.stdout:6/659: dread d0/f18 [0,4194304] 0 2023-12-16T03:16:00.742 INFO:tasks.workunit.client.0.smithi064.stdout:6/293: mknod d3/d9/d2d/c4f 0 2023-12-16T03:16:00.743 INFO:tasks.workunit.client.0.smithi064.stdout:6/294: readlink d3/d8/l33 0 2023-12-16T03:16:00.747 INFO:tasks.workunit.client.1.smithi184.stdout:6/660: rename d0/d5/d12/d1b/d33/d3d/l65 to d0/d5/d22/d37/d45/d90/ld6 0 2023-12-16T03:16:00.748 INFO:tasks.workunit.client.0.smithi064.stdout:4/327: dwrite d0/d42/d53/f1d [0,4194304] 0 2023-12-16T03:16:00.748 INFO:tasks.workunit.client.0.smithi064.stdout:5/277: creat d0/d14/d25/d3e/d35/d5d/f66 x:0 0 0 2023-12-16T03:16:00.748 INFO:tasks.workunit.client.0.smithi064.stdout:4/328: read - d0/d14/f5e zero size 2023-12-16T03:16:00.748 INFO:tasks.workunit.client.0.smithi064.stdout:4/329: read - d0/d42/f52 zero size 2023-12-16T03:16:00.749 INFO:tasks.workunit.client.0.smithi064.stdout:0/241: unlink d2/d8/da/df/c1e 0 2023-12-16T03:16:00.750 INFO:tasks.workunit.client.0.smithi064.stdout:0/242: chown d2/f16 32948072 1 2023-12-16T03:16:00.751 INFO:tasks.workunit.client.1.smithi184.stdout:7/537: dread d0/d3/d2e/d79/d36/d3f/f4f [0,4194304] 0 2023-12-16T03:16:00.751 INFO:tasks.workunit.client.1.smithi184.stdout:7/538: chown d0/d3/d2e/d79/f2a 1296048515 1 2023-12-16T03:16:00.751 INFO:tasks.workunit.client.1.smithi184.stdout:7/539: truncate d0/d3/d2e/d79/d36/d3f/f6d 809092 0 2023-12-16T03:16:00.751 INFO:tasks.workunit.client.1.smithi184.stdout:6/661: creat d0/d5/d22/d25/d47/fd7 x:0 0 0 2023-12-16T03:16:00.754 INFO:tasks.workunit.client.0.smithi064.stdout:5/278: mkdir d0/de/d23/d67 0 2023-12-16T03:16:00.754 INFO:tasks.workunit.client.0.smithi064.stdout:5/279: readlink d0/d14/d25/l55 0 2023-12-16T03:16:00.755 INFO:tasks.workunit.client.1.smithi184.stdout:7/540: mknod d0/d6b/d69/c9d 0 2023-12-16T03:16:00.756 INFO:tasks.workunit.client.0.smithi064.stdout:6/295: creat d3/d8/d13/d46/f50 x:0 0 0 2023-12-16T03:16:00.758 INFO:tasks.workunit.client.1.smithi184.stdout:7/541: write d0/d3/d2e/d79/d32/d39/f3e [1009350,83604] 0 2023-12-16T03:16:00.759 INFO:tasks.workunit.client.0.smithi064.stdout:4/330: link d0/d12/d48/c4e d0/d42/d56/c61 0 2023-12-16T03:16:00.761 INFO:tasks.workunit.client.0.smithi064.stdout:0/243: rename d2/l4 to d2/d7/d10/l4b 0 2023-12-16T03:16:00.762 INFO:tasks.workunit.client.0.smithi064.stdout:3/348: dwrite db/d12/f27 [0,4194304] 0 2023-12-16T03:16:00.763 INFO:tasks.workunit.client.0.smithi064.stdout:5/280: truncate d0/f17 1345991 0 2023-12-16T03:16:00.763 INFO:tasks.workunit.client.0.smithi064.stdout:5/281: chown d0/d19/d48 22963677 1 2023-12-16T03:16:00.766 INFO:tasks.workunit.client.0.smithi064.stdout:4/331: rmdir d0 39 2023-12-16T03:16:00.768 INFO:tasks.workunit.client.0.smithi064.stdout:3/349: mknod db/d12/d1a/d2c/d6e/d75/c76 0 2023-12-16T03:16:00.771 INFO:tasks.workunit.client.0.smithi064.stdout:5/282: rename d0/d14/d20/d37/l42 to d0/d19/l68 0 2023-12-16T03:16:00.772 INFO:tasks.workunit.client.0.smithi064.stdout:6/296: mknod d3/d8/d1f/d26/c51 0 2023-12-16T03:16:00.773 INFO:tasks.workunit.client.0.smithi064.stdout:4/332: link d0/d1e/f2c d0/d42/d4c/f62 0 2023-12-16T03:16:00.775 INFO:tasks.workunit.client.0.smithi064.stdout:4/333: creat d0/d42/f63 x:0 0 0 2023-12-16T03:16:00.775 INFO:tasks.workunit.client.0.smithi064.stdout:4/334: readlink d0/d12/l3e 0 2023-12-16T03:16:00.777 INFO:tasks.workunit.client.0.smithi064.stdout:6/297: write d3/d9/f20 [3777329,46092] 0 2023-12-16T03:16:00.777 INFO:tasks.workunit.client.0.smithi064.stdout:6/298: chown d3/d8/da/c4b 429 1 2023-12-16T03:16:00.778 INFO:tasks.workunit.client.0.smithi064.stdout:9/256: dwrite d2/d2d/d3b/d3c/d4b/f4c [0,4194304] 0 2023-12-16T03:16:00.778 INFO:tasks.workunit.client.0.smithi064.stdout:9/257: readlink d2/l1b 0 2023-12-16T03:16:00.780 INFO:tasks.workunit.client.0.smithi064.stdout:0/244: rmdir d2/d29/d47 0 2023-12-16T03:16:00.782 INFO:tasks.workunit.client.0.smithi064.stdout:0/245: creat d2/d8/f4c x:0 0 0 2023-12-16T03:16:00.783 INFO:tasks.workunit.client.0.smithi064.stdout:6/299: mknod d3/d9/d2d/c52 0 2023-12-16T03:16:00.786 INFO:tasks.workunit.client.0.smithi064.stdout:0/246: rename d2/d7/d10/f3f to d2/d8/da/df/f4d 0 2023-12-16T03:16:00.786 INFO:tasks.workunit.client.0.smithi064.stdout:0/247: write d2/d7/d10/f1f [874340,31958] 0 2023-12-16T03:16:00.787 INFO:tasks.workunit.client.0.smithi064.stdout:9/258: dread d2/dc/f1f [0,4194304] 0 2023-12-16T03:16:00.787 INFO:tasks.workunit.client.0.smithi064.stdout:9/259: write d2/dc/f2b [1878009,58631] 0 2023-12-16T03:16:00.788 INFO:tasks.workunit.client.0.smithi064.stdout:0/248: creat d2/d8/da/f4e x:0 0 0 2023-12-16T03:16:00.789 INFO:tasks.workunit.client.0.smithi064.stdout:9/260: write d2/dc/f11 [4955855,36345] 0 2023-12-16T03:16:00.789 INFO:tasks.workunit.client.0.smithi064.stdout:0/249: mknod d2/d7/d10/d21/c4f 0 2023-12-16T03:16:00.789 INFO:tasks.workunit.client.0.smithi064.stdout:9/261: readlink d2/dc/l1a 0 2023-12-16T03:16:00.789 INFO:tasks.workunit.client.0.smithi064.stdout:9/262: readlink d2/dc/l10 0 2023-12-16T03:16:00.790 INFO:tasks.workunit.client.0.smithi064.stdout:0/250: symlink d2/d8/da/l50 0 2023-12-16T03:16:00.790 INFO:tasks.workunit.client.1.smithi184.stdout:6/662: dwrite d0/d5/d12/d1b/d33/f58 [0,4194304] 0 2023-12-16T03:16:00.791 INFO:tasks.workunit.client.0.smithi064.stdout:9/263: mknod d2/c4d 0 2023-12-16T03:16:00.791 INFO:tasks.workunit.client.1.smithi184.stdout:6/663: creat d0/d5/d22/d25/dbf/dbe/fd8 x:0 0 0 2023-12-16T03:16:00.792 INFO:tasks.workunit.client.0.smithi064.stdout:9/264: mknod d2/d2d/d3f/c4e 0 2023-12-16T03:16:00.792 INFO:tasks.workunit.client.0.smithi064.stdout:9/265: fsync d2/dc/d24/d39/f3d 0 2023-12-16T03:16:00.794 INFO:tasks.workunit.client.0.smithi064.stdout:9/266: rename d2/d2d/d3f/c4e to d2/d2d/d3b/d3c/c4f 0 2023-12-16T03:16:00.795 INFO:tasks.workunit.client.0.smithi064.stdout:6/300: dread d3/d9/f45 [0,4194304] 0 2023-12-16T03:16:00.796 INFO:tasks.workunit.client.1.smithi184.stdout:6/664: write d0/d5/d22/fb [2581782,69934] 0 2023-12-16T03:16:00.796 INFO:tasks.workunit.client.1.smithi184.stdout:6/665: stat d0/d5/d22/d25/l84 0 2023-12-16T03:16:00.796 INFO:tasks.workunit.client.1.smithi184.stdout:6/666: fdatasync d0/d5/d22/d37/d45/fb5 0 2023-12-16T03:16:00.797 INFO:tasks.workunit.client.1.smithi184.stdout:6/667: write d0/d5/d22/f3c [805687,130612] 0 2023-12-16T03:16:00.800 INFO:tasks.workunit.client.1.smithi184.stdout:7/542: dwrite d0/d6b/f78 [0,4194304] 0 2023-12-16T03:16:00.801 INFO:tasks.workunit.client.1.smithi184.stdout:7/543: fdatasync d0/d3/f81 0 2023-12-16T03:16:00.801 INFO:tasks.workunit.client.1.smithi184.stdout:7/544: chown d0/f77 3 1 2023-12-16T03:16:00.802 INFO:tasks.workunit.client.0.smithi064.stdout:0/251: dread d2/d8/f1b [0,4194304] 0 2023-12-16T03:16:00.802 INFO:tasks.workunit.client.0.smithi064.stdout:4/335: dwrite d0/d14/f5e [0,4194304] 0 2023-12-16T03:16:00.802 INFO:tasks.workunit.client.0.smithi064.stdout:3/350: dwrite db/d4f/f6d [0,4194304] 0 2023-12-16T03:16:00.802 INFO:tasks.workunit.client.0.smithi064.stdout:9/267: fsync d2/d2d/d3b/d3c/d4b/f4c 0 2023-12-16T03:16:00.802 INFO:tasks.workunit.client.0.smithi064.stdout:0/252: getdents d2/d7 0 2023-12-16T03:16:00.804 INFO:tasks.workunit.client.0.smithi064.stdout:9/268: write d2/f2e [681899,129314] 0 2023-12-16T03:16:00.804 INFO:tasks.workunit.client.0.smithi064.stdout:9/269: chown d2/dc/d24/c43 2 1 2023-12-16T03:16:00.810 INFO:tasks.workunit.client.0.smithi064.stdout:6/301: dread d3/d9/f18 [0,4194304] 0 2023-12-16T03:16:00.810 INFO:tasks.workunit.client.0.smithi064.stdout:5/283: dwrite d0/d14/d20/d37/d3c/f52 [0,4194304] 0 2023-12-16T03:16:00.810 INFO:tasks.workunit.client.1.smithi184.stdout:6/668: rmdir d0/d5/d12/d1b/d33 39 2023-12-16T03:16:00.811 INFO:tasks.workunit.client.0.smithi064.stdout:9/270: write d2/f2a [3616212,101881] 0 2023-12-16T03:16:00.811 INFO:tasks.workunit.client.0.smithi064.stdout:9/271: chown d2/d2c 3425795 1 2023-12-16T03:16:00.811 INFO:tasks.workunit.client.0.smithi064.stdout:9/272: chown d2/l2f 280922 1 2023-12-16T03:16:00.811 INFO:tasks.workunit.client.0.smithi064.stdout:6/302: write d3/d8/f4c [1738849,12672] 0 2023-12-16T03:16:00.811 INFO:tasks.workunit.client.0.smithi064.stdout:6/303: write d3/d8/d13/d46/f50 [665518,50794] 0 2023-12-16T03:16:00.812 INFO:tasks.workunit.client.0.smithi064.stdout:4/336: mknod d0/d1e/c64 0 2023-12-16T03:16:00.815 INFO:tasks.workunit.client.1.smithi184.stdout:6/669: write d0/d5/d12/d1b/d33/f91 [787221,46055] 0 2023-12-16T03:16:00.816 INFO:tasks.workunit.client.0.smithi064.stdout:3/351: mknod db/d12/d1a/d2c/c77 0 2023-12-16T03:16:00.818 INFO:tasks.workunit.client.0.smithi064.stdout:0/253: mknod d2/d7/d10/c51 0 2023-12-16T03:16:00.818 INFO:tasks.workunit.client.0.smithi064.stdout:0/254: dread - d2/d8/da/d11/f44 zero size 2023-12-16T03:16:00.818 INFO:tasks.workunit.client.0.smithi064.stdout:0/255: write d2/d7/d10/d21/f39 [987866,111962] 0 2023-12-16T03:16:00.819 INFO:tasks.workunit.client.0.smithi064.stdout:0/256: fdatasync d2/d8/f40 0 2023-12-16T03:16:00.819 INFO:tasks.workunit.client.1.smithi184.stdout:7/545: dwrite d0/d3/d2e/d79/d1e/f5d [0,4194304] 0 2023-12-16T03:16:00.822 INFO:tasks.workunit.client.1.smithi184.stdout:6/670: truncate d0/d5/d26/f82 2434522 0 2023-12-16T03:16:00.823 INFO:tasks.workunit.client.1.smithi184.stdout:6/671: fsync d0/d5/d26/f38 0 2023-12-16T03:16:00.824 INFO:tasks.workunit.client.0.smithi064.stdout:5/284: dread d0/d50/f33 [0,4194304] 0 2023-12-16T03:16:00.827 INFO:tasks.workunit.client.1.smithi184.stdout:6/672: write d0/d5/d22/d34/d53/f5a [2032686,123990] 0 2023-12-16T03:16:00.833 INFO:tasks.workunit.client.0.smithi064.stdout:4/337: mknod d0/d42/c65 0 2023-12-16T03:16:00.833 INFO:tasks.workunit.client.0.smithi064.stdout:4/338: fsync d0/f2e 0 2023-12-16T03:16:00.837 INFO:tasks.workunit.client.0.smithi064.stdout:0/257: creat d2/d7/d10/f52 x:0 0 0 2023-12-16T03:16:00.837 INFO:tasks.workunit.client.0.smithi064.stdout:0/258: read - d2/d8/f4c zero size 2023-12-16T03:16:00.838 INFO:tasks.workunit.client.0.smithi064.stdout:0/259: readlink d2/d8/da/l13 0 2023-12-16T03:16:00.838 INFO:tasks.workunit.client.0.smithi064.stdout:0/260: readlink d2/d7/l3a 0 2023-12-16T03:16:00.838 INFO:tasks.workunit.client.0.smithi064.stdout:0/261: chown d2/d8/da/cc 833833925 1 2023-12-16T03:16:00.838 INFO:tasks.workunit.client.0.smithi064.stdout:0/262: read d2/d8/f40 [47329,70268] 0 2023-12-16T03:16:00.840 INFO:tasks.workunit.client.0.smithi064.stdout:5/285: creat d0/d19/d48/f69 x:0 0 0 2023-12-16T03:16:00.841 INFO:tasks.workunit.client.0.smithi064.stdout:5/286: dread d0/d7/f1d [0,4194304] 0 2023-12-16T03:16:00.841 INFO:tasks.workunit.client.0.smithi064.stdout:5/287: chown d0/d50/d39 32360807 1 2023-12-16T03:16:00.844 INFO:tasks.workunit.client.0.smithi064.stdout:9/273: rename d2/dc/f12 to d2/d2d/d3b/d3c/d34/f50 0 2023-12-16T03:16:00.844 INFO:tasks.workunit.client.0.smithi064.stdout:9/274: chown d2/d2d 2369342 1 2023-12-16T03:16:00.846 INFO:tasks.workunit.client.1.smithi184.stdout:7/546: dwrite d0/d3/d2e/d79/d32/d39/f3e [0,4194304] 0 2023-12-16T03:16:00.846 INFO:tasks.workunit.client.1.smithi184.stdout:6/673: dwrite d0/d5/d22/d25/f2b [4194304,4194304] 0 2023-12-16T03:16:00.847 INFO:tasks.workunit.client.0.smithi064.stdout:4/339: rename d0/d14 to d0/d42/d66 0 2023-12-16T03:16:00.848 INFO:tasks.workunit.client.0.smithi064.stdout:3/352: dwrite db/d12/d21/f49 [0,4194304] 0 2023-12-16T03:16:00.848 INFO:tasks.workunit.client.0.smithi064.stdout:9/275: creat d2/dc/d24/d39/d42/f51 x:0 0 0 2023-12-16T03:16:00.855 INFO:tasks.workunit.client.1.smithi184.stdout:6/674: creat d0/d5/dd1/fd9 x:0 0 0 2023-12-16T03:16:00.857 INFO:tasks.workunit.client.0.smithi064.stdout:3/353: creat db/d13/d39/f78 x:0 0 0 2023-12-16T03:16:00.861 INFO:tasks.workunit.client.0.smithi064.stdout:3/354: dread db/d12/d1a/d2c/d34/d4c/f63 [0,4194304] 0 2023-12-16T03:16:00.861 INFO:tasks.workunit.client.0.smithi064.stdout:3/355: read db/d4f/f6b [583394,36828] 0 2023-12-16T03:16:00.861 INFO:tasks.workunit.client.1.smithi184.stdout:7/547: unlink d0/d3/d2e/d79/d1e/f5d 0 2023-12-16T03:16:00.867 INFO:tasks.workunit.client.0.smithi064.stdout:4/340: truncate d0/d42/d66/f5e 444781 0 2023-12-16T03:16:00.867 INFO:tasks.workunit.client.0.smithi064.stdout:4/341: dread - d0/d42/d4c/f59 zero size 2023-12-16T03:16:00.868 INFO:tasks.workunit.client.0.smithi064.stdout:4/342: truncate d0/d42/d66/f26 225504 0 2023-12-16T03:16:00.868 INFO:tasks.workunit.client.1.smithi184.stdout:5/470: sync 2023-12-16T03:16:00.869 INFO:tasks.workunit.client.1.smithi184.stdout:7/548: mknod d0/d3/d2e/d79/d32/d35/c9e 0 2023-12-16T03:16:00.871 INFO:tasks.workunit.client.0.smithi064.stdout:4/343: creat d0/d42/d56/f67 x:0 0 0 2023-12-16T03:16:00.871 INFO:tasks.workunit.client.0.smithi064.stdout:0/263: dwrite d2/d8/da/f4e [0,4194304] 0 2023-12-16T03:16:00.872 INFO:tasks.workunit.client.0.smithi064.stdout:5/288: dwrite d0/d14/d25/d3e/d35/f54 [0,4194304] 0 2023-12-16T03:16:00.872 INFO:tasks.workunit.client.1.smithi184.stdout:5/471: symlink d1/d3/d9/d49/d74/l9a 0 2023-12-16T03:16:00.873 INFO:tasks.workunit.client.1.smithi184.stdout:7/549: link d0/c57 d0/d3/d68/c9f 0 2023-12-16T03:16:00.876 INFO:tasks.workunit.client.1.smithi184.stdout:5/472: unlink d1/d2a/l91 0 2023-12-16T03:16:00.878 INFO:tasks.workunit.client.1.smithi184.stdout:6/675: dwrite d0/d5/d22/f29 [0,4194304] 0 2023-12-16T03:16:00.879 INFO:tasks.workunit.client.0.smithi064.stdout:9/276: dwrite d2/d2d/d3b/d3c/f1c [0,4194304] 0 2023-12-16T03:16:00.879 INFO:tasks.workunit.client.0.smithi064.stdout:0/264: symlink d2/d7/l53 0 2023-12-16T03:16:00.880 INFO:tasks.workunit.client.1.smithi184.stdout:5/473: mknod d1/d3/d9/de/d30/d68/c9b 0 2023-12-16T03:16:00.887 INFO:tasks.workunit.client.0.smithi064.stdout:5/289: rename d0/d14/d25/l65 to d0/de/l6a 0 2023-12-16T03:16:00.887 INFO:tasks.workunit.client.0.smithi064.stdout:5/290: write d0/d50/d39/f3a [616659,86740] 0 2023-12-16T03:16:00.887 INFO:tasks.workunit.client.0.smithi064.stdout:5/291: dread - d0/d50/d39/f63 zero size 2023-12-16T03:16:00.892 INFO:tasks.workunit.client.1.smithi184.stdout:6/676: link d0/d5/l10 d0/d5/d12/lda 0 2023-12-16T03:16:00.894 INFO:tasks.workunit.client.0.smithi064.stdout:9/277: mkdir d2/d2d/d3f/d52 0 2023-12-16T03:16:00.894 INFO:tasks.workunit.client.0.smithi064.stdout:9/278: chown d2/d2d/d3b 1036411253 1 2023-12-16T03:16:00.901 INFO:tasks.workunit.client.1.smithi184.stdout:6/677: creat d0/d5/d22/d37/d4d/fdb x:0 0 0 2023-12-16T03:16:00.912 INFO:tasks.workunit.client.0.smithi064.stdout:5/292: creat d0/d14/d20/d37/d3c/f6b x:0 0 0 2023-12-16T03:16:00.914 INFO:tasks.workunit.client.0.smithi064.stdout:5/293: creat d0/f6c x:0 0 0 2023-12-16T03:16:00.914 INFO:tasks.workunit.client.0.smithi064.stdout:5/294: write d0/d50/d39/f3a [1135583,10694] 0 2023-12-16T03:16:00.916 INFO:tasks.workunit.client.0.smithi064.stdout:5/295: unlink d0/d19/d48/c4f 0 2023-12-16T03:16:00.917 INFO:tasks.workunit.client.0.smithi064.stdout:5/296: rmdir d0/d7/d34 39 2023-12-16T03:16:00.925 INFO:tasks.workunit.client.1.smithi184.stdout:5/474: dwrite d1/d3/d9/de/d15/d19/d5f/f41 [0,4194304] 0 2023-12-16T03:16:00.925 INFO:tasks.workunit.client.1.smithi184.stdout:5/475: chown d1/d3/d9/de/d15/d19/l20 194861 1 2023-12-16T03:16:00.925 INFO:tasks.workunit.client.1.smithi184.stdout:5/476: write d1/d3/d9/de/d15/d19/d48/f85 [945348,118051] 0 2023-12-16T03:16:00.926 INFO:tasks.workunit.client.1.smithi184.stdout:7/550: dwrite d0/d3/f1a [0,4194304] 0 2023-12-16T03:16:00.926 INFO:tasks.workunit.client.1.smithi184.stdout:7/551: write d0/d3/d2e/d79/d36/d84/f93 [363568,89183] 0 2023-12-16T03:16:00.926 INFO:tasks.workunit.client.1.smithi184.stdout:6/678: dwrite d0/d5/d22/d25/f92 [0,4194304] 0 2023-12-16T03:16:00.927 INFO:tasks.workunit.client.0.smithi064.stdout:4/344: dwrite d0/f11 [0,4194304] 0 2023-12-16T03:16:00.927 INFO:tasks.workunit.client.0.smithi064.stdout:4/345: truncate d0/d1e/d36/f4d 850470 0 2023-12-16T03:16:00.927 INFO:tasks.workunit.client.1.smithi184.stdout:6/679: write d0/d5/d22/d25/d47/f64 [65972,113245] 0 2023-12-16T03:16:00.927 INFO:tasks.workunit.client.1.smithi184.stdout:6/680: dread - d0/d5/d12/d1b/f51 zero size 2023-12-16T03:16:00.928 INFO:tasks.workunit.client.0.smithi064.stdout:9/279: dwrite d2/d2d/d3f/f46 [0,4194304] 0 2023-12-16T03:16:00.929 INFO:tasks.workunit.client.1.smithi184.stdout:5/477: stat d1/c6 0 2023-12-16T03:16:00.929 INFO:tasks.workunit.client.1.smithi184.stdout:5/478: stat d1/d3/d9/l5e 0 2023-12-16T03:16:00.931 INFO:tasks.workunit.client.1.smithi184.stdout:7/552: truncate d0/d3/d2e/d79/d1e/f20 7339643 0 2023-12-16T03:16:00.932 INFO:tasks.workunit.client.0.smithi064.stdout:0/265: getdents d2/d7 0 2023-12-16T03:16:00.932 INFO:tasks.workunit.client.0.smithi064.stdout:0/266: fsync d2/d8/f45 0 2023-12-16T03:16:00.932 INFO:tasks.workunit.client.0.smithi064.stdout:0/267: write f1 [2200414,114413] 0 2023-12-16T03:16:00.933 INFO:tasks.workunit.client.1.smithi184.stdout:7/553: dread d0/d3/d2e/d79/f4d [0,4194304] 0 2023-12-16T03:16:00.933 INFO:tasks.workunit.client.1.smithi184.stdout:7/554: write d0/d3/d2e/d79/d32/d39/f48 [2751378,75467] 0 2023-12-16T03:16:00.934 INFO:tasks.workunit.client.0.smithi064.stdout:4/346: rename d0/d42/d53/c2d to d0/d42/d66/d33/c68 0 2023-12-16T03:16:00.935 INFO:tasks.workunit.client.0.smithi064.stdout:4/347: write d0/d42/d53/f1d [4185001,39166] 0 2023-12-16T03:16:00.937 INFO:tasks.workunit.client.0.smithi064.stdout:5/297: dwrite d0/f6c [0,4194304] 0 2023-12-16T03:16:00.937 INFO:tasks.workunit.client.0.smithi064.stdout:5/298: chown d0/d19/f4a 234 1 2023-12-16T03:16:00.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:00 smithi064 ceph-mon[111958]: pgmap v195: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 119 MiB/s rd, 252 MiB/s wr, 678 op/s 2023-12-16T03:16:00.942 INFO:tasks.workunit.client.0.smithi064.stdout:9/280: creat d2/d2d/d36/f53 x:0 0 0 2023-12-16T03:16:00.942 INFO:tasks.workunit.client.0.smithi064.stdout:9/281: write d2/f1d [1455472,119314] 0 2023-12-16T03:16:00.942 INFO:tasks.workunit.client.0.smithi064.stdout:9/282: fdatasync d2/dc/d24/d39/d42/f48 0 2023-12-16T03:16:00.946 INFO:tasks.workunit.client.0.smithi064.stdout:0/268: unlink d2/d8/da/df/c48 0 2023-12-16T03:16:00.953 INFO:tasks.workunit.client.1.smithi184.stdout:6/681: truncate d0/d5/d12/f1c 5355568 0 2023-12-16T03:16:00.954 INFO:tasks.workunit.client.0.smithi064.stdout:5/299: symlink d0/d14/d25/d44/d5a/l6d 0 2023-12-16T03:16:00.955 INFO:tasks.workunit.client.0.smithi064.stdout:0/269: getdents d2/d7/d10 0 2023-12-16T03:16:00.957 INFO:tasks.workunit.client.0.smithi064.stdout:4/348: dwrite d0/d42/d66/f30 [0,4194304] 0 2023-12-16T03:16:00.957 INFO:tasks.workunit.client.1.smithi184.stdout:5/479: creat d1/d3/d9/de/d15/d19/f9c x:0 0 0 2023-12-16T03:16:00.958 INFO:tasks.workunit.client.1.smithi184.stdout:5/480: fdatasync d1/d2a/d64/f8a 0 2023-12-16T03:16:00.958 INFO:tasks.workunit.client.1.smithi184.stdout:5/481: chown d1/d3/d9/de/d15/d27/c94 91292 1 2023-12-16T03:16:00.958 INFO:tasks.workunit.client.0.smithi064.stdout:5/300: getdents d0/d14/d25/d3e 0 2023-12-16T03:16:00.958 INFO:tasks.workunit.client.0.smithi064.stdout:5/301: readlink d0/de/d23/l59 0 2023-12-16T03:16:00.961 INFO:tasks.workunit.client.0.smithi064.stdout:9/283: dwrite d2/d2d/d3b/d3c/d34/f45 [0,4194304] 0 2023-12-16T03:16:00.961 INFO:tasks.workunit.client.0.smithi064.stdout:4/349: write d0/da/f16 [8015240,66954] 0 2023-12-16T03:16:00.967 INFO:tasks.workunit.client.1.smithi184.stdout:7/555: creat d0/d3/d2e/d79/d32/d39/d8f/fa0 x:0 0 0 2023-12-16T03:16:00.967 INFO:tasks.workunit.client.1.smithi184.stdout:7/556: read - d0/d3/d2e/d79/d36/d3f/f5b zero size 2023-12-16T03:16:00.967 INFO:tasks.workunit.client.1.smithi184.stdout:6/682: mknod d0/d5/d22/d25/d47/cdc 0 2023-12-16T03:16:00.967 INFO:tasks.workunit.client.1.smithi184.stdout:5/482: dread d1/d3/d9/de/d15/d19/d5f/d45/f84 [0,4194304] 0 2023-12-16T03:16:00.967 INFO:tasks.workunit.client.1.smithi184.stdout:5/483: write d1/d3/d9/de/d15/d19/f9c [834412,273] 0 2023-12-16T03:16:00.969 INFO:tasks.workunit.client.0.smithi064.stdout:9/284: link d2/d2d/c3e d2/d2d/d3b/c54 0 2023-12-16T03:16:00.970 INFO:tasks.workunit.client.1.smithi184.stdout:7/557: mknod d0/d3/d2e/d79/dd/d27/ca1 0 2023-12-16T03:16:00.971 INFO:tasks.workunit.client.1.smithi184.stdout:6/683: creat d0/d36/fdd x:0 0 0 2023-12-16T03:16:00.971 INFO:tasks.workunit.client.1.smithi184.stdout:6/684: truncate d0/d5/d22/d25/f5f 1380906 0 2023-12-16T03:16:00.973 INFO:tasks.workunit.client.1.smithi184.stdout:5/484: creat d1/d3/d9/de/d15/d90/f9d x:0 0 0 2023-12-16T03:16:00.973 INFO:tasks.workunit.client.0.smithi064.stdout:0/270: dwrite d2/d8/da/d11/f44 [0,4194304] 0 2023-12-16T03:16:00.973 INFO:tasks.workunit.client.0.smithi064.stdout:0/271: dread - d2/d8/f4c zero size 2023-12-16T03:16:00.974 INFO:tasks.workunit.client.1.smithi184.stdout:7/558: mknod d0/d3/d2e/d79/d32/d39/ca2 0 2023-12-16T03:16:00.978 INFO:tasks.workunit.client.1.smithi184.stdout:5/485: chown d1/d3/d9/de/d15/l21 1076 1 2023-12-16T03:16:00.978 INFO:tasks.workunit.client.1.smithi184.stdout:6/685: dread d0/d5/d22/d25/d47/f8f [0,4194304] 0 2023-12-16T03:16:00.978 INFO:tasks.workunit.client.1.smithi184.stdout:6/686: chown d0/d5/d22/d25/f2b 435129 1 2023-12-16T03:16:00.979 INFO:tasks.workunit.client.0.smithi064.stdout:0/272: mknod d2/d7/d10/d21/c54 0 2023-12-16T03:16:00.980 INFO:tasks.workunit.client.1.smithi184.stdout:6/687: read d0/d5/f59 [490440,115148] 0 2023-12-16T03:16:00.980 INFO:tasks.workunit.client.1.smithi184.stdout:7/559: dread d0/d3/d2e/d79/d32/d39/f70 [0,4194304] 0 2023-12-16T03:16:00.983 INFO:tasks.workunit.client.0.smithi064.stdout:9/285: rmdir d2/d2c 0 2023-12-16T03:16:00.983 INFO:tasks.workunit.client.0.smithi064.stdout:9/286: chown d2/d2d/d3b/f49 1818562306 1 2023-12-16T03:16:00.984 INFO:tasks.workunit.client.0.smithi064.stdout:9/287: stat d2/d2d/d3b/d3c/d4b 0 2023-12-16T03:16:00.985 INFO:tasks.workunit.client.1.smithi184.stdout:7/560: link d0/d3/d2e/d79/d32/d35/c67 d0/d6b/d69/ca3 0 2023-12-16T03:16:00.986 INFO:tasks.workunit.client.0.smithi064.stdout:4/350: dwrite d0/d42/d4c/f59 [0,4194304] 0 2023-12-16T03:16:00.989 INFO:tasks.workunit.client.1.smithi184.stdout:5/486: link d1/d3/d9/de/d15/l34 d1/d3/d9/de/d15/d19/d5f/d45/l9e 0 2023-12-16T03:16:00.990 INFO:tasks.workunit.client.0.smithi064.stdout:4/351: write d0/f2 [4301321,81488] 0 2023-12-16T03:16:00.990 INFO:tasks.workunit.client.0.smithi064.stdout:4/352: fsync d0/d42/d66/d33/f38 0 2023-12-16T03:16:00.993 INFO:tasks.workunit.client.1.smithi184.stdout:2/525: sync 2023-12-16T03:16:00.993 INFO:tasks.workunit.client.1.smithi184.stdout:9/855: sync 2023-12-16T03:16:00.993 INFO:tasks.workunit.client.1.smithi184.stdout:1/625: sync 2023-12-16T03:16:00.993 INFO:tasks.workunit.client.1.smithi184.stdout:8/681: sync 2023-12-16T03:16:00.993 INFO:tasks.workunit.client.1.smithi184.stdout:8/682: write d2/d4/d10/d11/f15 [9378920,129569] 0 2023-12-16T03:16:00.993 INFO:tasks.workunit.client.1.smithi184.stdout:0/679: sync 2023-12-16T03:16:00.995 INFO:tasks.workunit.client.0.smithi064.stdout:5/302: rename d0/d14/d25/d44 to d0/d14/d25/d3e/d35/d5d/d6e 0 2023-12-16T03:16:00.995 INFO:tasks.workunit.client.1.smithi184.stdout:7/561: rename d0/d3/d4/f25 to d0/d6b/d69/fa4 0 2023-12-16T03:16:00.996 INFO:tasks.workunit.client.0.smithi064.stdout:4/353: creat d0/d1e/f69 x:0 0 0 2023-12-16T03:16:00.996 INFO:tasks.workunit.client.0.smithi064.stdout:4/354: readlink d0/d12/l3e 0 2023-12-16T03:16:00.998 INFO:tasks.workunit.client.1.smithi184.stdout:2/526: dread d3/f3c [0,4194304] 0 2023-12-16T03:16:00.998 INFO:tasks.workunit.client.1.smithi184.stdout:9/856: mknod d0/d76/c125 0 2023-12-16T03:16:00.999 INFO:tasks.workunit.client.1.smithi184.stdout:3/702: sync 2023-12-16T03:16:00.999 INFO:tasks.workunit.client.0.smithi064.stdout:5/303: mknod d0/d14/d25/c6f 0 2023-12-16T03:16:01.001 INFO:tasks.workunit.client.1.smithi184.stdout:7/562: creat d0/d3/d2e/d79/d32/d35/fa5 x:0 0 0 2023-12-16T03:16:01.001 INFO:tasks.workunit.client.1.smithi184.stdout:7/563: chown d0/l7a 4842 1 2023-12-16T03:16:01.001 INFO:tasks.workunit.client.1.smithi184.stdout:7/564: stat d0/d3/d2e/d79/d32/l4b 0 2023-12-16T03:16:01.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/595: sync 2023-12-16T03:16:01.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/596: write d1/d29/d34/d5c/d76/d33/f96 [10038,75472] 0 2023-12-16T03:16:01.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/597: chown d1/d29/d34/d5c/d76/d3b/f53 10952683 1 2023-12-16T03:16:01.002 INFO:tasks.workunit.client.0.smithi064.stdout:4/355: symlink d0/d42/d53/l6a 0 2023-12-16T03:16:01.003 INFO:tasks.workunit.client.1.smithi184.stdout:8/683: dread d2/d6a/da4/f8e [4194304,4194304] 0 2023-12-16T03:16:01.003 INFO:tasks.workunit.client.1.smithi184.stdout:5/487: dread d1/d3/d9/f39 [0,4194304] 0 2023-12-16T03:16:01.005 INFO:tasks.workunit.client.0.smithi064.stdout:5/304: rmdir d0/d14 39 2023-12-16T03:16:01.005 INFO:tasks.workunit.client.1.smithi184.stdout:2/527: creat d3/d29/d4d/d5b/fb3 x:0 0 0 2023-12-16T03:16:01.005 INFO:tasks.workunit.client.1.smithi184.stdout:2/528: write d3/d13/d28/f2c [2944691,123771] 0 2023-12-16T03:16:01.007 INFO:tasks.workunit.client.1.smithi184.stdout:9/857: dread d0/d76/dbf/f118 [0,4194304] 0 2023-12-16T03:16:01.009 INFO:tasks.workunit.client.0.smithi064.stdout:0/273: dwrite d2/d8/da/f4e [0,4194304] 0 2023-12-16T03:16:01.009 INFO:tasks.workunit.client.0.smithi064.stdout:9/288: dwrite d2/d2d/d3b/d3c/d4b/f4c [0,4194304] 0 2023-12-16T03:16:01.012 INFO:tasks.workunit.client.1.smithi184.stdout:0/680: rename dc/d22/d1d/d2c/l64 to dc/d10/da7/lee 0 2023-12-16T03:16:01.013 INFO:tasks.workunit.client.1.smithi184.stdout:0/681: fdatasync dc/d22/d1d/d35/dc3/f67 0 2023-12-16T03:16:01.013 INFO:tasks.workunit.client.0.smithi064.stdout:5/305: mkdir d0/d14/d20/d37/d70 0 2023-12-16T03:16:01.013 INFO:tasks.workunit.client.1.smithi184.stdout:4/598: link d1/d12/db3/fb5 d1/d12/d13/da1/fcd 0 2023-12-16T03:16:01.020 INFO:tasks.workunit.client.1.smithi184.stdout:5/488: rmdir d1/d3/d9/d49 39 2023-12-16T03:16:01.020 INFO:tasks.workunit.client.1.smithi184.stdout:5/489: readlink d1/d3/d9/de/d15/d19/d48/l96 0 2023-12-16T03:16:01.020 INFO:tasks.workunit.client.1.smithi184.stdout:9/858: creat d0/d76/da2/db4/f126 x:0 0 0 2023-12-16T03:16:01.020 INFO:tasks.workunit.client.1.smithi184.stdout:9/859: dread - d0/d76/dbf/fe9 zero size 2023-12-16T03:16:01.020 INFO:tasks.workunit.client.1.smithi184.stdout:9/860: readlink d0/d13/d20/d5b/d43/dc7/ddc/lca 0 2023-12-16T03:16:01.020 INFO:tasks.workunit.client.1.smithi184.stdout:9/861: readlink d0/d3a/d47/l114 0 2023-12-16T03:16:01.021 INFO:tasks.workunit.client.1.smithi184.stdout:9/862: truncate d0/d76/da2/dc4/f105 109173 0 2023-12-16T03:16:01.021 INFO:tasks.workunit.client.1.smithi184.stdout:4/599: dread d1/fd [0,4194304] 0 2023-12-16T03:16:01.021 INFO:tasks.workunit.client.1.smithi184.stdout:4/600: truncate d1/d12/f17 8967790 0 2023-12-16T03:16:01.023 INFO:tasks.workunit.client.1.smithi184.stdout:0/682: rmdir dc/d22/d45/d66 39 2023-12-16T03:16:01.025 INFO:tasks.workunit.client.0.smithi064.stdout:9/289: rmdir d2/dc/d24/d39/d42 39 2023-12-16T03:16:01.027 INFO:tasks.workunit.client.1.smithi184.stdout:2/529: dread d3/d29/d2f/d2e/f1a [0,4194304] 0 2023-12-16T03:16:01.029 INFO:tasks.workunit.client.1.smithi184.stdout:8/684: symlink d2/d12/d21/d8a/ld9 0 2023-12-16T03:16:01.030 INFO:tasks.workunit.client.1.smithi184.stdout:8/685: chown d2/d12/d21/d8a/dcd/cce 376336913 1 2023-12-16T03:16:01.030 INFO:tasks.workunit.client.1.smithi184.stdout:8/686: write d2/d6a/da4/f7d [271013,58420] 0 2023-12-16T03:16:01.034 INFO:tasks.workunit.client.1.smithi184.stdout:8/687: write d2/d12/d21/d2d/d31/f6c [3120047,60457] 0 2023-12-16T03:16:01.034 INFO:tasks.workunit.client.1.smithi184.stdout:9/863: dread d0/d13/d20/f28 [0,4194304] 0 2023-12-16T03:16:01.035 INFO:tasks.workunit.client.1.smithi184.stdout:7/565: dwrite d0/d3/d2e/d79/d32/d39/f48 [0,4194304] 0 2023-12-16T03:16:01.035 INFO:tasks.workunit.client.1.smithi184.stdout:0/683: rename dc/d22/d1d/d43/d5a/d60/c9b to dc/d10/d2d/cef 0 2023-12-16T03:16:01.036 INFO:tasks.workunit.client.1.smithi184.stdout:3/703: dwrite d12/d18/d1f/d93/fed [4194304,4194304] 0 2023-12-16T03:16:01.037 INFO:tasks.workunit.client.0.smithi064.stdout:0/274: dread d2/d8/f45 [0,4194304] 0 2023-12-16T03:16:01.038 INFO:tasks.workunit.client.0.smithi064.stdout:4/356: dread d0/f2 [8388608,4194304] 0 2023-12-16T03:16:01.040 INFO:tasks.workunit.client.1.smithi184.stdout:1/626: dwrite d3/d34/dbc/d3c/d24/d8e/f97 [0,4194304] 0 2023-12-16T03:16:01.041 INFO:tasks.workunit.client.0.smithi064.stdout:9/290: mknod d2/d2d/d3b/d3c/d4b/c55 0 2023-12-16T03:16:01.043 INFO:tasks.workunit.client.1.smithi184.stdout:2/530: mknod d3/d29/cb4 0 2023-12-16T03:16:01.043 INFO:tasks.workunit.client.1.smithi184.stdout:2/531: dread - d3/d9/f8c zero size 2023-12-16T03:16:01.043 INFO:tasks.workunit.client.1.smithi184.stdout:2/532: readlink d3/d13/d28/dac/lae 0 2023-12-16T03:16:01.043 INFO:tasks.workunit.client.1.smithi184.stdout:9/864: mknod d0/d3a/d47/c127 0 2023-12-16T03:16:01.044 INFO:tasks.workunit.client.0.smithi064.stdout:0/275: mknod d2/d7/c55 0 2023-12-16T03:16:01.048 INFO:tasks.workunit.client.1.smithi184.stdout:5/490: dwrite d1/d3/d9/de/d15/d19/d3a/f4b [4194304,4194304] 0 2023-12-16T03:16:01.048 INFO:tasks.workunit.client.1.smithi184.stdout:5/491: read d1/d3/d9/de/d15/d19/d5f/d45/f84 [736336,57376] 0 2023-12-16T03:16:01.049 INFO:tasks.workunit.client.1.smithi184.stdout:5/492: dread - d1/d3/d9/de/d15/d27/f81 zero size 2023-12-16T03:16:01.050 INFO:tasks.workunit.client.1.smithi184.stdout:9/865: dread d0/d13/f24 [0,4194304] 0 2023-12-16T03:16:01.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:00 smithi184 ceph-mon[121180]: pgmap v195: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 119 MiB/s rd, 252 MiB/s wr, 678 op/s 2023-12-16T03:16:01.067 INFO:tasks.workunit.client.1.smithi184.stdout:7/566: dwrite d0/f89 [4194304,4194304] 0 2023-12-16T03:16:01.068 INFO:tasks.workunit.client.0.smithi064.stdout:0/276: dwrite d2/d8/f45 [0,4194304] 0 2023-12-16T03:16:01.068 INFO:tasks.workunit.client.0.smithi064.stdout:0/277: fsync d2/d29/f2c 0 2023-12-16T03:16:01.070 INFO:tasks.workunit.client.1.smithi184.stdout:0/684: dwrite dc/d22/d1d/d43/f59 [0,4194304] 0 2023-12-16T03:16:01.093 INFO:tasks.workunit.client.0.smithi064.stdout:5/306: rename d0/d14/d25/d3e/d35/d5d/d6e to d0/d14/d20/d37/d70/d71 0 2023-12-16T03:16:01.095 INFO:tasks.workunit.client.0.smithi064.stdout:4/357: creat d0/d42/d53/f6b x:0 0 0 2023-12-16T03:16:01.095 INFO:tasks.workunit.client.0.smithi064.stdout:4/358: fdatasync d0/f5 0 2023-12-16T03:16:01.095 INFO:tasks.workunit.client.0.smithi064.stdout:4/359: truncate d0/d42/f63 447118 0 2023-12-16T03:16:01.095 INFO:tasks.workunit.client.0.smithi064.stdout:4/360: write d0/d12/f35 [281938,45214] 0 2023-12-16T03:16:01.095 INFO:tasks.workunit.client.0.smithi064.stdout:4/361: chown d0/d1e/l28 39 1 2023-12-16T03:16:01.098 INFO:tasks.workunit.client.0.smithi064.stdout:9/291: unlink d2/dc/f2b 0 2023-12-16T03:16:01.099 INFO:tasks.workunit.client.0.smithi064.stdout:0/278: dwrite d2/d8/f1b [4194304,4194304] 0 2023-12-16T03:16:01.099 INFO:tasks.workunit.client.1.smithi184.stdout:0/685: dwrite dc/d10/d1c/f2f [0,4194304] 0 2023-12-16T03:16:01.105 INFO:tasks.workunit.client.0.smithi064.stdout:0/279: dread d2/d29/f2f [0,4194304] 0 2023-12-16T03:16:01.105 INFO:tasks.workunit.client.0.smithi064.stdout:0/280: write d2/d7/d10/d21/f24 [4411350,117541] 0 2023-12-16T03:16:01.111 INFO:tasks.workunit.client.1.smithi184.stdout:2/533: link d3/d29/d2f/f54 d3/d29/d61/fb5 0 2023-12-16T03:16:01.111 INFO:tasks.workunit.client.1.smithi184.stdout:2/534: readlink d3/d29/d2f/l58 0 2023-12-16T03:16:01.111 INFO:tasks.workunit.client.0.smithi064.stdout:5/307: getdents d0/d14/d20/d37/d70/d71 0 2023-12-16T03:16:01.111 INFO:tasks.workunit.client.0.smithi064.stdout:5/308: read d0/d14/d20/f2f [3173393,78909] 0 2023-12-16T03:16:01.111 INFO:tasks.workunit.client.0.smithi064.stdout:5/309: write d0/d50/d39/f63 [330393,63212] 0 2023-12-16T03:16:01.114 INFO:tasks.workunit.client.1.smithi184.stdout:5/493: creat d1/d3/d9/de/d15/d19/d5f/d45/f9f x:0 0 0 2023-12-16T03:16:01.114 INFO:tasks.workunit.client.0.smithi064.stdout:4/362: dwrite d0/d42/f5c [0,4194304] 0 2023-12-16T03:16:01.114 INFO:tasks.workunit.client.0.smithi064.stdout:9/292: rmdir d2/d2d/d3f/d52 0 2023-12-16T03:16:01.115 INFO:tasks.workunit.client.0.smithi064.stdout:9/293: write d2/dc/d24/d39/d42/f51 [3135,20109] 0 2023-12-16T03:16:01.118 INFO:tasks.workunit.client.0.smithi064.stdout:0/281: creat d2/d8/da/d11/f56 x:0 0 0 2023-12-16T03:16:01.124 INFO:tasks.workunit.client.0.smithi064.stdout:4/363: mknod d0/d42/d56/c6c 0 2023-12-16T03:16:01.124 INFO:tasks.workunit.client.0.smithi064.stdout:4/364: chown d0/l6 100604 1 2023-12-16T03:16:01.125 INFO:tasks.workunit.client.0.smithi064.stdout:9/294: creat d2/dc/d24/d39/f56 x:0 0 0 2023-12-16T03:16:01.125 INFO:tasks.workunit.client.0.smithi064.stdout:4/365: read d0/da/f16 [7892791,100037] 0 2023-12-16T03:16:01.128 INFO:tasks.workunit.client.0.smithi064.stdout:0/282: unlink d2/d7/d10/d21/c54 0 2023-12-16T03:16:01.128 INFO:tasks.workunit.client.0.smithi064.stdout:0/283: fsync d2/d29/f2f 0 2023-12-16T03:16:01.129 INFO:tasks.workunit.client.0.smithi064.stdout:5/310: dwrite d0/f3 [0,4194304] 0 2023-12-16T03:16:01.129 INFO:tasks.workunit.client.0.smithi064.stdout:5/311: chown d0/de 84 1 2023-12-16T03:16:01.130 INFO:tasks.workunit.client.1.smithi184.stdout:0/686: creat dc/d22/d1d/d2c/d75/ff0 x:0 0 0 2023-12-16T03:16:01.130 INFO:tasks.workunit.client.1.smithi184.stdout:0/687: stat dc/d22/d45/d66/d80 0 2023-12-16T03:16:01.130 INFO:tasks.workunit.client.1.smithi184.stdout:0/688: chown dc/d22/d1d/cb2 17 1 2023-12-16T03:16:01.130 INFO:tasks.workunit.client.0.smithi064.stdout:0/284: mknod d2/c57 0 2023-12-16T03:16:01.131 INFO:tasks.workunit.client.0.smithi064.stdout:9/295: write d2/d2d/d3b/d3c/f1c [3953509,19687] 0 2023-12-16T03:16:01.131 INFO:tasks.workunit.client.1.smithi184.stdout:8/688: rename d2/d12/d21/d30 to d2/d12/d21/d8a/dda 0 2023-12-16T03:16:01.140 INFO:tasks.workunit.client.1.smithi184.stdout:0/689: write dc/d22/d1d/d43/f55 [2077086,18819] 0 2023-12-16T03:16:01.175 INFO:tasks.workunit.client.1.smithi184.stdout:2/535: unlink d3/f4 0 2023-12-16T03:16:01.176 INFO:tasks.workunit.client.1.smithi184.stdout:2/536: dread - d3/f76 zero size 2023-12-16T03:16:01.177 INFO:tasks.workunit.client.1.smithi184.stdout:5/494: mknod d1/d3/d9/de/d15/d19/d53/ca0 0 2023-12-16T03:16:01.178 INFO:tasks.workunit.client.0.smithi064.stdout:5/312: creat d0/d14/d20/d37/d70/d71/f72 x:0 0 0 2023-12-16T03:16:01.178 INFO:tasks.workunit.client.0.smithi064.stdout:5/313: write d0/d50/d39/f63 [274734,16962] 0 2023-12-16T03:16:01.180 INFO:tasks.workunit.client.0.smithi064.stdout:0/285: link d2/d8/c2e d2/d8/da/d11/c58 0 2023-12-16T03:16:01.181 INFO:tasks.workunit.client.0.smithi064.stdout:5/314: write d0/d7/f1e [267642,61257] 0 2023-12-16T03:16:01.182 INFO:tasks.workunit.client.1.smithi184.stdout:8/689: rmdir d2/d12/d21/d8a/dda/d73 39 2023-12-16T03:16:01.183 INFO:tasks.workunit.client.0.smithi064.stdout:9/296: getdents d2/d2d/d36 0 2023-12-16T03:16:01.188 INFO:tasks.workunit.client.1.smithi184.stdout:0/690: link dc/d22/d45/d66/f84 dc/d10/d2d/ff1 0 2023-12-16T03:16:01.188 INFO:tasks.workunit.client.1.smithi184.stdout:1/627: rename d3/c18 to d3/d13/cd4 0 2023-12-16T03:16:01.191 INFO:tasks.workunit.client.1.smithi184.stdout:2/537: rmdir d3/d29/d2f/d2e 39 2023-12-16T03:16:01.191 INFO:tasks.workunit.client.1.smithi184.stdout:2/538: chown d3/d9/d19/f7d 21048874 1 2023-12-16T03:16:01.192 INFO:tasks.workunit.client.0.smithi064.stdout:0/286: readlink d2/d8/da/df/l3b 0 2023-12-16T03:16:01.193 INFO:tasks.workunit.client.1.smithi184.stdout:5/495: dwrite d1/d3/d9/de/d15/f52 [0,4194304] 0 2023-12-16T03:16:01.193 INFO:tasks.workunit.client.1.smithi184.stdout:5/496: fdatasync d1/d3/d9/de/d15/d19/f1d 0 2023-12-16T03:16:01.194 INFO:tasks.workunit.client.1.smithi184.stdout:5/497: fdatasync d1/d3/d2f/f6d 0 2023-12-16T03:16:01.194 INFO:tasks.workunit.client.0.smithi064.stdout:5/315: mkdir d0/d19/d73 0 2023-12-16T03:16:01.194 INFO:tasks.workunit.client.0.smithi064.stdout:5/316: fdatasync d0/f15 0 2023-12-16T03:16:01.195 INFO:tasks.workunit.client.1.smithi184.stdout:8/690: creat d2/d12/fdb x:0 0 0 2023-12-16T03:16:01.196 INFO:tasks.workunit.client.0.smithi064.stdout:9/297: rename d2/d2d/d3f to d2/dc/d24/d39/d42/d57 0 2023-12-16T03:16:01.198 INFO:tasks.workunit.client.1.smithi184.stdout:2/539: write d3/d9/d19/f37 [1063627,47043] 0 2023-12-16T03:16:01.199 INFO:tasks.workunit.client.1.smithi184.stdout:9/866: rename d0/c26 to d0/d13/d20/d5b/d43/dc7/ddc/dd8/c128 0 2023-12-16T03:16:01.199 INFO:tasks.workunit.client.1.smithi184.stdout:9/867: fdatasync d0/d76/dbf/ffb 0 2023-12-16T03:16:01.200 INFO:tasks.workunit.client.1.smithi184.stdout:9/868: dread d0/d13/f69 [0,4194304] 0 2023-12-16T03:16:01.200 INFO:tasks.workunit.client.1.smithi184.stdout:9/869: write d0/d13/d20/f8f [2965166,75840] 0 2023-12-16T03:16:01.204 INFO:tasks.workunit.client.0.smithi064.stdout:5/317: creat d0/d14/d20/d37/d70/f74 x:0 0 0 2023-12-16T03:16:01.204 INFO:tasks.workunit.client.1.smithi184.stdout:0/691: creat dc/d2a/ff2 x:0 0 0 2023-12-16T03:16:01.204 INFO:tasks.workunit.client.1.smithi184.stdout:1/628: symlink d3/d34/dbc/d38/ld5 0 2023-12-16T03:16:01.206 INFO:tasks.workunit.client.1.smithi184.stdout:5/498: rmdir d1/d3/d2f 39 2023-12-16T03:16:01.206 INFO:tasks.workunit.client.1.smithi184.stdout:5/499: chown d1/d2a/d31/d28/f65 0 1 2023-12-16T03:16:01.208 INFO:tasks.workunit.client.1.smithi184.stdout:8/691: mkdir d2/d37/d7c/ddc 0 2023-12-16T03:16:01.209 INFO:tasks.workunit.client.1.smithi184.stdout:6/688: sync 2023-12-16T03:16:01.212 INFO:tasks.workunit.client.1.smithi184.stdout:2/540: mknod d3/d13/d28/d83/cb6 0 2023-12-16T03:16:01.217 INFO:tasks.workunit.client.1.smithi184.stdout:4/601: sync 2023-12-16T03:16:01.217 INFO:tasks.workunit.client.0.smithi064.stdout:5/318: stat d0/de/d23/l59 0 2023-12-16T03:16:01.217 INFO:tasks.workunit.client.1.smithi184.stdout:9/870: rmdir d0/d76/da2/dc4/ddb 39 2023-12-16T03:16:01.218 INFO:tasks.workunit.client.1.smithi184.stdout:0/692: mkdir dc/d22/d1d/d43/d5a/df3 0 2023-12-16T03:16:01.219 INFO:tasks.workunit.client.0.smithi064.stdout:9/298: rename d2/dc/d24/d39/f56 to d2/d2d/d3b/d3c/d4b/f58 0 2023-12-16T03:16:01.222 INFO:tasks.workunit.client.1.smithi184.stdout:1/629: mkdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6 0 2023-12-16T03:16:01.224 INFO:tasks.workunit.client.0.smithi064.stdout:5/319: link d0/lc d0/d19/l75 0 2023-12-16T03:16:01.225 INFO:tasks.workunit.client.1.smithi184.stdout:5/500: creat d1/d3/d9/de/d15/d19/d48/fa1 x:0 0 0 2023-12-16T03:16:01.225 INFO:tasks.workunit.client.1.smithi184.stdout:5/501: write d1/d3/d9/de/d30/d68/f76 [3334726,120016] 0 2023-12-16T03:16:01.225 INFO:tasks.workunit.client.0.smithi064.stdout:9/299: creat d2/dc/d24/d39/d42/f59 x:0 0 0 2023-12-16T03:16:01.228 INFO:tasks.workunit.client.0.smithi064.stdout:9/300: link d2/d2d/d3b/d3c/f20 d2/dc/d24/f5a 0 2023-12-16T03:16:01.231 INFO:tasks.workunit.client.1.smithi184.stdout:4/602: dwrite d1/d29/d34/d5c/d76/d33/f65 [0,4194304] 0 2023-12-16T03:16:01.231 INFO:tasks.workunit.client.1.smithi184.stdout:4/603: truncate d1/d12/d13/f94 1346753 0 2023-12-16T03:16:01.232 INFO:tasks.workunit.client.1.smithi184.stdout:3/704: sync 2023-12-16T03:16:01.232 INFO:tasks.workunit.client.1.smithi184.stdout:7/567: sync 2023-12-16T03:16:01.232 INFO:tasks.workunit.client.1.smithi184.stdout:3/705: chown d12/d18/d1f/d23/d2a/d4a/d61 21 1 2023-12-16T03:16:01.232 INFO:tasks.workunit.client.1.smithi184.stdout:3/706: chown d12/d18/d1f/d23/d2a/d42/de9/fef 4214 1 2023-12-16T03:16:01.232 INFO:tasks.workunit.client.1.smithi184.stdout:6/689: creat d0/d36/d8a/fde x:0 0 0 2023-12-16T03:16:01.232 INFO:tasks.workunit.client.1.smithi184.stdout:0/693: link dc/d22/d48/f6d dc/d22/d1d/d8e/ff4 0 2023-12-16T03:16:01.232 INFO:tasks.workunit.client.1.smithi184.stdout:1/630: stat d3/d13/d2c/cbf 0 2023-12-16T03:16:01.233 INFO:tasks.workunit.client.1.smithi184.stdout:1/631: chown d3/d34/dbc/d38 12888249 1 2023-12-16T03:16:01.233 INFO:tasks.workunit.client.1.smithi184.stdout:1/632: fdatasync f0 0 2023-12-16T03:16:01.233 INFO:tasks.workunit.client.1.smithi184.stdout:1/633: chown d3/d34/dbc/d3c/c2e 108764824 1 2023-12-16T03:16:01.233 INFO:tasks.workunit.client.1.smithi184.stdout:1/634: fsync d3/d34/dbc/d3c/d41/d46/fd0 0 2023-12-16T03:16:01.233 INFO:tasks.workunit.client.1.smithi184.stdout:6/690: write d0/d5/d22/d25/d47/f8f [2877877,126716] 0 2023-12-16T03:16:01.233 INFO:tasks.workunit.client.1.smithi184.stdout:6/691: chown d0/d5/l10 0 1 2023-12-16T03:16:01.233 INFO:tasks.workunit.client.1.smithi184.stdout:7/568: write d0/d3/d4/f5e [2983894,118589] 0 2023-12-16T03:16:01.234 INFO:tasks.workunit.client.0.smithi064.stdout:9/301: symlink d2/d2d/d3b/l5b 0 2023-12-16T03:16:01.234 INFO:tasks.workunit.client.0.smithi064.stdout:5/320: dread d0/de/d23/f3f [0,4194304] 0 2023-12-16T03:16:01.234 INFO:tasks.workunit.client.1.smithi184.stdout:5/502: mknod d1/d3/d9/de/d15/d19/d5f/d45/ca2 0 2023-12-16T03:16:01.234 INFO:tasks.workunit.client.1.smithi184.stdout:5/503: dread - d1/d3/d9/de/d15/d90/f9d zero size 2023-12-16T03:16:01.238 INFO:tasks.workunit.client.0.smithi064.stdout:5/321: rename d0/d7/f1a to d0/d14/d20/d37/d3c/f76 0 2023-12-16T03:16:01.242 INFO:tasks.workunit.client.1.smithi184.stdout:4/604: symlink d1/d29/d34/lce 0 2023-12-16T03:16:01.243 INFO:tasks.workunit.client.0.smithi064.stdout:5/322: symlink d0/d19/d48/l77 0 2023-12-16T03:16:01.256 INFO:tasks.workunit.client.1.smithi184.stdout:8/692: symlink d2/d12/d21/d8a/ldd 0 2023-12-16T03:16:01.257 INFO:tasks.workunit.client.1.smithi184.stdout:6/692: mknod d0/d5/cdf 0 2023-12-16T03:16:01.257 INFO:tasks.workunit.client.1.smithi184.stdout:6/693: stat d0/d5/d22/cb2 0 2023-12-16T03:16:01.260 INFO:tasks.workunit.client.1.smithi184.stdout:1/635: symlink d3/d34/dbc/d3c/d41/ld7 0 2023-12-16T03:16:01.260 INFO:tasks.workunit.client.1.smithi184.stdout:1/636: chown d3/d13/d2c/cae 372726358 1 2023-12-16T03:16:01.260 INFO:tasks.workunit.client.1.smithi184.stdout:1/637: fdatasync d3/d34/dbc/f87 0 2023-12-16T03:16:01.260 INFO:tasks.workunit.client.1.smithi184.stdout:1/638: chown d3/l22 175 1 2023-12-16T03:16:01.263 INFO:tasks.workunit.client.1.smithi184.stdout:7/569: rename d0/d3/d2e/d79/d32/d35/c67 to d0/d3/d2e/d79/dd/d75/ca6 0 2023-12-16T03:16:01.264 INFO:tasks.workunit.client.1.smithi184.stdout:6/694: rmdir d0/d5/d22/d34/d53 39 2023-12-16T03:16:01.264 INFO:tasks.workunit.client.1.smithi184.stdout:7/570: chown d0/d3/d2e/c72 800551721 1 2023-12-16T03:16:01.264 INFO:tasks.workunit.client.1.smithi184.stdout:6/695: truncate d0/d36/d79/f7c 1405823 0 2023-12-16T03:16:01.264 INFO:tasks.workunit.client.1.smithi184.stdout:7/571: creat d0/d3/d68/fa7 x:0 0 0 2023-12-16T03:16:01.265 INFO:tasks.workunit.client.1.smithi184.stdout:1/639: write d3/d34/dbc/d3c/d41/d63/f7e [3469059,94289] 0 2023-12-16T03:16:01.266 INFO:tasks.workunit.client.1.smithi184.stdout:6/696: unlink d0/d5/d12/d1b/d33/d3d/f89 0 2023-12-16T03:16:01.266 INFO:tasks.workunit.client.1.smithi184.stdout:6/697: truncate d0/d5/d12/d1b/f5b 4611656 0 2023-12-16T03:16:01.266 INFO:tasks.workunit.client.1.smithi184.stdout:7/572: mknod d0/d3/d2e/d79/dd/d27/ca8 0 2023-12-16T03:16:01.268 INFO:tasks.workunit.client.1.smithi184.stdout:6/698: mkdir d0/d5/d26/de0 0 2023-12-16T03:16:01.268 INFO:tasks.workunit.client.1.smithi184.stdout:6/699: fsync d0/d5/d22/d25/d47/f73 0 2023-12-16T03:16:01.270 INFO:tasks.workunit.client.1.smithi184.stdout:6/700: mkdir d0/d5/d22/d25/dbf/dbe/de1 0 2023-12-16T03:16:01.277 INFO:tasks.workunit.client.1.smithi184.stdout:6/701: creat d0/d5/d12/d1b/d33/d3d/d96/fe2 x:0 0 0 2023-12-16T03:16:01.279 INFO:tasks.workunit.client.1.smithi184.stdout:0/694: dwrite dc/d22/d1d/d8e/ff4 [0,4194304] 0 2023-12-16T03:16:01.282 INFO:tasks.workunit.client.1.smithi184.stdout:6/702: write d0/d5/d12/f1c [3498065,17541] 0 2023-12-16T03:16:01.283 INFO:tasks.workunit.client.0.smithi064.stdout:9/302: dwrite d2/dc/d24/d39/f3d [0,4194304] 0 2023-12-16T03:16:01.283 INFO:tasks.workunit.client.0.smithi064.stdout:9/303: read - d2/d2d/d36/f53 zero size 2023-12-16T03:16:01.283 INFO:tasks.workunit.client.1.smithi184.stdout:0/695: symlink dc/d22/d45/d66/d80/da3/lf5 0 2023-12-16T03:16:01.286 INFO:tasks.workunit.client.0.smithi064.stdout:9/304: rename d2/d2d/d3b/l5b to d2/d2d/d3b/d3c/l5c 0 2023-12-16T03:16:01.287 INFO:tasks.workunit.client.1.smithi184.stdout:0/696: truncate dc/d22/d1d/d35/dc3/f67 3881034 0 2023-12-16T03:16:01.288 INFO:tasks.workunit.client.1.smithi184.stdout:0/697: unlink dc/d22/d1d/d35/f65 0 2023-12-16T03:16:01.290 INFO:tasks.workunit.client.1.smithi184.stdout:0/698: creat dc/d22/ff6 x:0 0 0 2023-12-16T03:16:01.291 INFO:tasks.workunit.client.1.smithi184.stdout:0/699: mkdir dc/d22/d1d/d35/df7 0 2023-12-16T03:16:01.299 INFO:tasks.workunit.client.1.smithi184.stdout:4/605: dwrite d1/d11/d5a/fa3 [0,4194304] 0 2023-12-16T03:16:01.301 INFO:tasks.workunit.client.1.smithi184.stdout:4/606: unlink d1/d11/d1b/d1e/f24 0 2023-12-16T03:16:01.303 INFO:tasks.workunit.client.1.smithi184.stdout:4/607: mkdir d1/d12/d13/d40/d43/d45/dcf 0 2023-12-16T03:16:01.305 INFO:tasks.workunit.client.1.smithi184.stdout:3/707: dwrite d12/d18/d1f/d23/d2a/d42/d52/ff6 [0,4194304] 0 2023-12-16T03:16:01.305 INFO:tasks.workunit.client.1.smithi184.stdout:3/708: truncate d12/d37/f6a 2541415 0 2023-12-16T03:16:01.309 INFO:tasks.workunit.client.0.smithi064.stdout:5/323: dwrite d0/de/d23/f3f [0,4194304] 0 2023-12-16T03:16:01.309 INFO:tasks.workunit.client.0.smithi064.stdout:5/324: stat d0/de 0 2023-12-16T03:16:01.309 INFO:tasks.workunit.client.0.smithi064.stdout:5/325: fsync d0/d19/f4a 0 2023-12-16T03:16:01.309 INFO:tasks.workunit.client.0.smithi064.stdout:5/326: chown d0/l12 617596 1 2023-12-16T03:16:01.311 INFO:tasks.workunit.client.1.smithi184.stdout:5/504: dwrite d1/d2a/f13 [0,4194304] 0 2023-12-16T03:16:01.312 INFO:tasks.workunit.client.1.smithi184.stdout:7/573: dwrite d0/d3/d2e/f3a [0,4194304] 0 2023-12-16T03:16:01.315 INFO:tasks.workunit.client.1.smithi184.stdout:5/505: unlink d1/d3/d9/de/d15/d19/c7b 0 2023-12-16T03:16:01.322 INFO:tasks.workunit.client.1.smithi184.stdout:5/506: creat d1/d3/d9/de/d15/d90/fa3 x:0 0 0 2023-12-16T03:16:01.322 INFO:tasks.workunit.client.1.smithi184.stdout:5/507: dread - d1/d3/d9/de/d15/d19/f1d zero size 2023-12-16T03:16:01.323 INFO:tasks.workunit.client.1.smithi184.stdout:8/693: dwrite d2/d37/f4c [0,4194304] 0 2023-12-16T03:16:01.323 INFO:tasks.workunit.client.1.smithi184.stdout:3/709: dread d12/d37/d81/fd9 [0,4194304] 0 2023-12-16T03:16:01.331 INFO:tasks.workunit.client.1.smithi184.stdout:1/640: write d3/d34/dbc/f58 [224370,92086] 0 2023-12-16T03:16:01.331 INFO:tasks.workunit.client.1.smithi184.stdout:6/703: dwrite d0/d5/d12/fb9 [0,4194304] 0 2023-12-16T03:16:01.335 INFO:tasks.workunit.client.1.smithi184.stdout:8/694: creat d2/d4/d10/d7a/d83/fde x:0 0 0 2023-12-16T03:16:01.335 INFO:tasks.workunit.client.1.smithi184.stdout:8/695: readlink d2/d4/d10/d11/l18 0 2023-12-16T03:16:01.335 INFO:tasks.workunit.client.1.smithi184.stdout:8/696: chown d2/d12/d21/d2d 88 1 2023-12-16T03:16:01.335 INFO:tasks.workunit.client.1.smithi184.stdout:3/710: mknod d12/d18/d1f/d23/d2a/d42/c109 0 2023-12-16T03:16:01.335 INFO:tasks.workunit.client.0.smithi064.stdout:9/305: dwrite d2/d2d/d3b/d3c/f20 [4194304,4194304] 0 2023-12-16T03:16:01.338 INFO:tasks.workunit.client.1.smithi184.stdout:6/704: creat d0/d5/d22/d25/d47/fe3 x:0 0 0 2023-12-16T03:16:01.339 INFO:tasks.workunit.client.1.smithi184.stdout:3/711: mknod d12/d1e/de8/d48/c10a 0 2023-12-16T03:16:01.339 INFO:tasks.workunit.client.1.smithi184.stdout:6/705: symlink d0/d5/d22/d34/le4 0 2023-12-16T03:16:01.341 INFO:tasks.workunit.client.1.smithi184.stdout:6/706: creat d0/d5/d12/d1b/d33/d3d/d96/fe5 x:0 0 0 2023-12-16T03:16:01.341 INFO:tasks.workunit.client.1.smithi184.stdout:6/707: chown d0/d5/cdf 3 1 2023-12-16T03:16:01.341 INFO:tasks.workunit.client.1.smithi184.stdout:6/708: dread - d0/d5/d22/d25/dbf/dbe/fd8 zero size 2023-12-16T03:16:01.343 INFO:tasks.workunit.client.1.smithi184.stdout:6/709: link d0/d36/d8a/l72 d0/d5/dd1/le6 0 2023-12-16T03:16:01.344 INFO:tasks.workunit.client.1.smithi184.stdout:8/697: dread d2/d6a/f84 [4194304,4194304] 0 2023-12-16T03:16:01.344 INFO:tasks.workunit.client.1.smithi184.stdout:8/698: stat d2/d4/d10/d7a/f7f 0 2023-12-16T03:16:01.344 INFO:tasks.workunit.client.1.smithi184.stdout:8/699: write d2/d12/d21/d8a/dda/f98 [997818,41281] 0 2023-12-16T03:16:01.345 INFO:tasks.workunit.client.1.smithi184.stdout:8/700: chown d2/d37 53 1 2023-12-16T03:16:01.345 INFO:tasks.workunit.client.1.smithi184.stdout:4/608: dwrite d1/d11/d5a/fa3 [0,4194304] 0 2023-12-16T03:16:01.345 INFO:tasks.workunit.client.1.smithi184.stdout:4/609: fsync d1/d12/d13/d40/d43/d5e/d6a/f97 0 2023-12-16T03:16:01.345 INFO:tasks.workunit.client.1.smithi184.stdout:8/701: mknod d2/d4/d10/d7a/d83/d8b/cdf 0 2023-12-16T03:16:01.346 INFO:tasks.workunit.client.1.smithi184.stdout:4/610: mkdir d1/d12/db3/db8/dd0 0 2023-12-16T03:16:01.346 INFO:tasks.workunit.client.1.smithi184.stdout:4/611: write d1/d12/d13/f94 [1907225,48748] 0 2023-12-16T03:16:01.347 INFO:tasks.workunit.client.1.smithi184.stdout:3/712: write d12/d18/f74 [1208500,74684] 0 2023-12-16T03:16:01.347 INFO:tasks.workunit.client.1.smithi184.stdout:8/702: mkdir d2/d4/d10/d7a/d83/d8b/de0 0 2023-12-16T03:16:01.348 INFO:tasks.workunit.client.0.smithi064.stdout:9/306: dread d2/dc/f11 [4194304,4194304] 0 2023-12-16T03:16:01.349 INFO:tasks.workunit.client.1.smithi184.stdout:4/612: mknod d1/d29/d34/d5c/d76/d42/d90/cd1 0 2023-12-16T03:16:01.350 INFO:tasks.workunit.client.1.smithi184.stdout:6/710: write d0/d5/f1f [3375819,7441] 0 2023-12-16T03:16:01.350 INFO:tasks.workunit.client.1.smithi184.stdout:6/711: readlink d0/d5/d12/lda 0 2023-12-16T03:16:01.350 INFO:tasks.workunit.client.1.smithi184.stdout:8/703: read d2/f13 [2129499,87456] 0 2023-12-16T03:16:01.351 INFO:tasks.workunit.client.0.smithi064.stdout:9/307: mknod d2/d2d/d3b/d3c/d4b/c5d 0 2023-12-16T03:16:01.351 INFO:tasks.workunit.client.0.smithi064.stdout:9/308: fdatasync d2/d2d/d3b/d3c/f27 0 2023-12-16T03:16:01.351 INFO:tasks.workunit.client.0.smithi064.stdout:9/309: readlink l0 0 2023-12-16T03:16:01.352 INFO:tasks.workunit.client.1.smithi184.stdout:3/713: mkdir d12/d18/d1f/d23/d2a/d4a/d61/da9/d106/d10b 0 2023-12-16T03:16:01.352 INFO:tasks.workunit.client.1.smithi184.stdout:4/613: mkdir d1/d12/db3/db8/dd2 0 2023-12-16T03:16:01.354 INFO:tasks.workunit.client.1.smithi184.stdout:3/714: creat d12/d18/d1f/d23/d2a/d4a/d61/da9/d106/d10b/f10c x:0 0 0 2023-12-16T03:16:01.354 INFO:tasks.workunit.client.1.smithi184.stdout:3/715: chown d12/d18/d1f/d23/d51/f5a 1 1 2023-12-16T03:16:01.355 INFO:tasks.workunit.client.1.smithi184.stdout:7/574: dwrite d0/d6b/d69/f90 [0,4194304] 0 2023-12-16T03:16:01.355 INFO:tasks.workunit.client.1.smithi184.stdout:7/575: fsync d0/d3/f11 0 2023-12-16T03:16:01.355 INFO:tasks.workunit.client.0.smithi064.stdout:8/374: sync 2023-12-16T03:16:01.355 INFO:tasks.workunit.client.0.smithi064.stdout:1/308: sync 2023-12-16T03:16:01.356 INFO:tasks.workunit.client.0.smithi064.stdout:7/328: sync 2023-12-16T03:16:01.356 INFO:tasks.workunit.client.0.smithi064.stdout:7/329: fsync d7/d13/f29 0 2023-12-16T03:16:01.357 INFO:tasks.workunit.client.0.smithi064.stdout:5/327: dwrite d0/d14/d20/d37/f51 [0,4194304] 0 2023-12-16T03:16:01.357 INFO:tasks.workunit.client.0.smithi064.stdout:5/328: write d0/d14/d25/d3e/d35/d5d/f66 [674731,53564] 0 2023-12-16T03:16:01.357 INFO:tasks.workunit.client.1.smithi184.stdout:1/641: dwrite d3/d34/dbc/d36/f9b [0,4194304] 0 2023-12-16T03:16:01.357 INFO:tasks.workunit.client.1.smithi184.stdout:1/642: write d3/d34/dbc/d3c/f25 [4405982,93163] 0 2023-12-16T03:16:01.357 INFO:tasks.workunit.client.1.smithi184.stdout:5/508: dwrite d1/d3/d9/f50 [0,4194304] 0 2023-12-16T03:16:01.357 INFO:tasks.workunit.client.1.smithi184.stdout:4/614: rmdir d1/d11/d1b/dae 0 2023-12-16T03:16:01.360 INFO:tasks.workunit.client.0.smithi064.stdout:1/309: link d3/dd/d23/f2c d3/d22/f68 0 2023-12-16T03:16:01.360 INFO:tasks.workunit.client.0.smithi064.stdout:1/310: stat d3/d22/l46 0 2023-12-16T03:16:01.363 INFO:tasks.workunit.client.0.smithi064.stdout:5/329: dread d0/d50/d39/f3a [0,4194304] 0 2023-12-16T03:16:01.364 INFO:tasks.workunit.client.0.smithi064.stdout:8/375: creat d0/da/d3e/d46/f81 x:0 0 0 2023-12-16T03:16:01.364 INFO:tasks.workunit.client.0.smithi064.stdout:8/376: write d0/da/d3e/d46/f5e [300901,89825] 0 2023-12-16T03:16:01.365 INFO:tasks.workunit.client.0.smithi064.stdout:9/310: dread d2/d2d/d3b/d3c/f20 [0,4194304] 0 2023-12-16T03:16:01.365 INFO:tasks.workunit.client.0.smithi064.stdout:9/311: fsync d2/d2d/d3b/f49 0 2023-12-16T03:16:01.367 INFO:tasks.workunit.client.0.smithi064.stdout:7/330: symlink d7/d3e/d42/d43/d46/l65 0 2023-12-16T03:16:01.372 INFO:tasks.workunit.client.1.smithi184.stdout:3/716: mknod d12/d18/d1f/d23/d2a/d36/c10d 0 2023-12-16T03:16:01.373 INFO:tasks.workunit.client.1.smithi184.stdout:3/717: chown d12/d18/d1f/d23/d2a/d42/d52/d76/d80/cf5 258 1 2023-12-16T03:16:01.373 INFO:tasks.workunit.client.1.smithi184.stdout:7/576: rename d0/d3/d7e to d0/d3/d2e/da9 0 2023-12-16T03:16:01.375 INFO:tasks.workunit.client.1.smithi184.stdout:8/704: dwrite d2/d12/fdb [0,4194304] 0 2023-12-16T03:16:01.375 INFO:tasks.workunit.client.1.smithi184.stdout:6/712: dwrite d0/d5/d26/f38 [0,4194304] 0 2023-12-16T03:16:01.378 INFO:tasks.workunit.client.0.smithi064.stdout:1/311: rename d3/d36/d44/f48 to d3/dd/d11/d3b/f69 0 2023-12-16T03:16:01.381 INFO:tasks.workunit.client.0.smithi064.stdout:5/330: mknod d0/d19/d48/c78 0 2023-12-16T03:16:01.382 INFO:tasks.workunit.client.1.smithi184.stdout:6/713: dread d0/f18 [0,4194304] 0 2023-12-16T03:16:01.382 INFO:tasks.workunit.client.1.smithi184.stdout:6/714: write d0/d5/d22/d34/d53/f5a [4894190,93293] 0 2023-12-16T03:16:01.385 INFO:tasks.workunit.client.0.smithi064.stdout:8/377: link d0/db/d37/f43 d0/db/d12/f82 0 2023-12-16T03:16:01.386 INFO:tasks.workunit.client.0.smithi064.stdout:8/378: dread - d0/da/d3e/f69 zero size 2023-12-16T03:16:01.386 INFO:tasks.workunit.client.0.smithi064.stdout:5/331: dread d0/d14/d20/f2f [0,4194304] 0 2023-12-16T03:16:01.388 INFO:tasks.workunit.client.0.smithi064.stdout:9/312: mkdir d2/dc/d24/d39/d5e 0 2023-12-16T03:16:01.390 INFO:tasks.workunit.client.0.smithi064.stdout:7/331: rename d7/d26/l4e to d7/l66 0 2023-12-16T03:16:01.391 INFO:tasks.workunit.client.0.smithi064.stdout:7/332: write d7/f9 [2960437,69626] 0 2023-12-16T03:16:01.393 INFO:tasks.workunit.client.0.smithi064.stdout:8/379: symlink d0/db/d12/d44/l83 0 2023-12-16T03:16:01.393 INFO:tasks.workunit.client.1.smithi184.stdout:1/643: creat d3/d34/dbc/d3c/d41/d63/fd8 x:0 0 0 2023-12-16T03:16:01.393 INFO:tasks.workunit.client.1.smithi184.stdout:5/509: truncate d1/f66 12365 0 2023-12-16T03:16:01.394 INFO:tasks.workunit.client.1.smithi184.stdout:7/577: dwrite d0/d3/f1a [4194304,4194304] 0 2023-12-16T03:16:01.395 INFO:tasks.workunit.client.1.smithi184.stdout:4/615: creat d1/d12/d13/d40/fd3 x:0 0 0 2023-12-16T03:16:01.395 INFO:tasks.workunit.client.1.smithi184.stdout:7/578: chown d0/d3/d2e/d79/d32/d35/fa5 1379229 1 2023-12-16T03:16:01.396 INFO:tasks.workunit.client.0.smithi064.stdout:9/313: symlink d2/d2d/d3b/l5f 0 2023-12-16T03:16:01.396 INFO:tasks.workunit.client.0.smithi064.stdout:1/312: dwrite d3/dd/d23/d4f/f54 [0,4194304] 0 2023-12-16T03:16:01.396 INFO:tasks.workunit.client.0.smithi064.stdout:1/313: fdatasync d3/d22/d57/f5d 0 2023-12-16T03:16:01.398 INFO:tasks.workunit.client.0.smithi064.stdout:5/332: rename d0/d14/d20/d37/d3c/l57 to d0/d14/l79 0 2023-12-16T03:16:01.400 INFO:tasks.workunit.client.1.smithi184.stdout:3/718: mknod d12/d18/d1f/d23/d2a/d42/d52/d76/c10e 0 2023-12-16T03:16:01.401 INFO:tasks.workunit.client.0.smithi064.stdout:8/380: truncate d0/da/d16/f1b 1521912 0 2023-12-16T03:16:01.405 INFO:tasks.workunit.client.0.smithi064.stdout:9/314: creat d2/d2d/d36/f60 x:0 0 0 2023-12-16T03:16:01.405 INFO:tasks.workunit.client.0.smithi064.stdout:8/381: write d0/da/f30 [1045110,3679] 0 2023-12-16T03:16:01.405 INFO:tasks.workunit.client.0.smithi064.stdout:9/315: chown d2/dc/d24/d39/d42/d57/f46 0 1 2023-12-16T03:16:01.405 INFO:tasks.workunit.client.0.smithi064.stdout:8/382: dread - d0/d1d/d24/d2f/d50/f78 zero size 2023-12-16T03:16:01.405 INFO:tasks.workunit.client.0.smithi064.stdout:8/383: truncate d0/db/d37/d3a/f57 1780760 0 2023-12-16T03:16:01.410 INFO:tasks.workunit.client.1.smithi184.stdout:7/579: dread d0/d3/d2e/d79/dd/f46 [0,4194304] 0 2023-12-16T03:16:01.411 INFO:tasks.workunit.client.1.smithi184.stdout:6/715: unlink d0/d36/la5 0 2023-12-16T03:16:01.412 INFO:tasks.workunit.client.0.smithi064.stdout:9/316: creat d2/dc/d24/d39/f61 x:0 0 0 2023-12-16T03:16:01.413 INFO:tasks.workunit.client.1.smithi184.stdout:1/644: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/fd9 x:0 0 0 2023-12-16T03:16:01.413 INFO:tasks.workunit.client.0.smithi064.stdout:7/333: dwrite d7/d3e/f55 [0,4194304] 0 2023-12-16T03:16:01.417 INFO:tasks.workunit.client.0.smithi064.stdout:7/334: chown d7/d3e/d42/c64 23213182 1 2023-12-16T03:16:01.418 INFO:tasks.workunit.client.1.smithi184.stdout:5/510: symlink d1/d3/la4 0 2023-12-16T03:16:01.418 INFO:tasks.workunit.client.0.smithi064.stdout:1/314: dwrite d3/d22/d57/f5d [0,4194304] 0 2023-12-16T03:16:01.418 INFO:tasks.workunit.client.0.smithi064.stdout:7/335: dread d7/d26/f27 [0,4194304] 0 2023-12-16T03:16:01.421 INFO:tasks.workunit.client.0.smithi064.stdout:9/317: symlink d2/d2d/d3b/d3c/d4b/l62 0 2023-12-16T03:16:01.421 INFO:tasks.workunit.client.0.smithi064.stdout:9/318: write d2/f33 [4218671,40219] 0 2023-12-16T03:16:01.422 INFO:tasks.workunit.client.0.smithi064.stdout:6/304: sync 2023-12-16T03:16:01.422 INFO:tasks.workunit.client.0.smithi064.stdout:0/287: sync 2023-12-16T03:16:01.422 INFO:tasks.workunit.client.0.smithi064.stdout:3/356: sync 2023-12-16T03:16:01.422 INFO:tasks.workunit.client.0.smithi064.stdout:4/366: sync 2023-12-16T03:16:01.422 INFO:tasks.workunit.client.0.smithi064.stdout:2/286: sync 2023-12-16T03:16:01.422 INFO:tasks.workunit.client.0.smithi064.stdout:6/305: write d3/d8/da/f37 [5089784,15214] 0 2023-12-16T03:16:01.423 INFO:tasks.workunit.client.0.smithi064.stdout:3/357: write db/d12/d1a/d31/f47 [4051820,110926] 0 2023-12-16T03:16:01.437 INFO:tasks.workunit.client.1.smithi184.stdout:8/705: rename d2/d4/c6b to d2/d37/d7c/ddc/ce1 0 2023-12-16T03:16:01.439 INFO:tasks.workunit.client.0.smithi064.stdout:1/315: mkdir d3/dd/d11/d6a 0 2023-12-16T03:16:01.441 INFO:tasks.workunit.client.1.smithi184.stdout:7/580: getdents d0/d3/d2e/d79 0 2023-12-16T03:16:01.442 INFO:tasks.workunit.client.0.smithi064.stdout:1/316: write d3/d36/d44/d4d/f4e [4043392,62852] 0 2023-12-16T03:16:01.443 INFO:tasks.workunit.client.0.smithi064.stdout:1/317: truncate f2 1935795 0 2023-12-16T03:16:01.443 INFO:tasks.workunit.client.0.smithi064.stdout:1/318: fdatasync d3/d36/d44/f51 0 2023-12-16T03:16:01.444 INFO:tasks.workunit.client.0.smithi064.stdout:9/319: rename d2/d2d/d3b/d3c/f27 to d2/dc/d24/f63 0 2023-12-16T03:16:01.444 INFO:tasks.workunit.client.0.smithi064.stdout:9/320: write d2/dc/f32 [953337,49446] 0 2023-12-16T03:16:01.444 INFO:tasks.workunit.client.0.smithi064.stdout:9/321: dread - d2/dc/d24/d39/d42/f59 zero size 2023-12-16T03:16:01.448 INFO:tasks.workunit.client.0.smithi064.stdout:7/336: dwrite d7/d3e/d42/f44 [0,4194304] 0 2023-12-16T03:16:01.448 INFO:tasks.workunit.client.0.smithi064.stdout:3/358: dwrite db/d12/d1a/d2c/f5b [0,4194304] 0 2023-12-16T03:16:01.450 INFO:tasks.workunit.client.1.smithi184.stdout:1/645: truncate d3/d13/f29 1095058 0 2023-12-16T03:16:01.450 INFO:tasks.workunit.client.1.smithi184.stdout:1/646: dread - d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/fd9 zero size 2023-12-16T03:16:01.451 INFO:tasks.workunit.client.0.smithi064.stdout:4/367: creat d0/da/f6d x:0 0 0 2023-12-16T03:16:01.452 INFO:tasks.workunit.client.0.smithi064.stdout:6/306: dwrite d3/d8/da/fe [0,4194304] 0 2023-12-16T03:16:01.453 INFO:tasks.workunit.client.0.smithi064.stdout:6/307: write d3/d8/d13/d46/f50 [879018,71627] 0 2023-12-16T03:16:01.453 INFO:tasks.workunit.client.0.smithi064.stdout:0/288: dread d2/d8/da/df/f41 [0,4194304] 0 2023-12-16T03:16:01.454 INFO:tasks.workunit.client.1.smithi184.stdout:7/581: write d0/d3/d2e/d79/f2a [2856206,125725] 0 2023-12-16T03:16:01.454 INFO:tasks.workunit.client.1.smithi184.stdout:7/582: chown d0/d6b/l6a 17519 1 2023-12-16T03:16:01.454 INFO:tasks.workunit.client.1.smithi184.stdout:5/511: mkdir d1/d3/d9/de/da5 0 2023-12-16T03:16:01.455 INFO:tasks.workunit.client.0.smithi064.stdout:6/308: write d3/d9/f20 [422984,49902] 0 2023-12-16T03:16:01.456 INFO:tasks.workunit.client.0.smithi064.stdout:2/287: mkdir d1/d15/d1e/d55 0 2023-12-16T03:16:01.459 INFO:tasks.workunit.client.1.smithi184.stdout:4/616: rename d1/d12/f17 to d1/d11/d5a/d63/d72/fd4 0 2023-12-16T03:16:01.462 INFO:tasks.workunit.client.1.smithi184.stdout:6/716: mkdir d0/d5/d12/de7 0 2023-12-16T03:16:01.464 INFO:tasks.workunit.client.0.smithi064.stdout:7/337: getdents d7 0 2023-12-16T03:16:01.465 INFO:tasks.workunit.client.1.smithi184.stdout:7/583: rmdir d0/d3/d4 39 2023-12-16T03:16:01.468 INFO:tasks.workunit.client.1.smithi184.stdout:5/512: creat d1/d3/d9/d49/d74/fa6 x:0 0 0 2023-12-16T03:16:01.469 INFO:tasks.workunit.client.0.smithi064.stdout:7/338: write d7/f3b [1506821,81267] 0 2023-12-16T03:16:01.470 INFO:tasks.workunit.client.0.smithi064.stdout:3/359: mknod db/d12/d1a/d2c/d6e/d75/c79 0 2023-12-16T03:16:01.470 INFO:tasks.workunit.client.0.smithi064.stdout:3/360: read db/d12/d21/f5c [689224,53958] 0 2023-12-16T03:16:01.473 INFO:tasks.workunit.client.1.smithi184.stdout:8/706: dwrite d2/f13 [0,4194304] 0 2023-12-16T03:16:01.474 INFO:tasks.workunit.client.1.smithi184.stdout:3/719: rename d12/d18/d1f/d23/d2a/d4a/c7d to d12/d18/d1f/d23/d51/dd7/de3/de1/c10f 0 2023-12-16T03:16:01.474 INFO:tasks.workunit.client.1.smithi184.stdout:3/720: fsync d12/d1e/de8/d48/fcf 0 2023-12-16T03:16:01.474 INFO:tasks.workunit.client.1.smithi184.stdout:3/721: dread - d12/d1e/f101 zero size 2023-12-16T03:16:01.474 INFO:tasks.workunit.client.1.smithi184.stdout:3/722: chown d12/d18/d7a 1315541534 1 2023-12-16T03:16:01.474 INFO:tasks.workunit.client.1.smithi184.stdout:3/723: write d12/d1e/de8/ff9 [645280,38053] 0 2023-12-16T03:16:01.474 INFO:tasks.workunit.client.1.smithi184.stdout:3/724: chown d12/d1e/de8/l73 202232277 1 2023-12-16T03:16:01.474 INFO:tasks.workunit.client.1.smithi184.stdout:1/647: rename d3/d34/dbc/d36 to d3/d34/dbc/d36/d9f/dda 22 2023-12-16T03:16:01.475 INFO:tasks.workunit.client.0.smithi064.stdout:9/322: dwrite d2/dc/f1f [4194304,4194304] 0 2023-12-16T03:16:01.478 INFO:tasks.workunit.client.1.smithi184.stdout:4/617: dread d1/d11/d1b/d1e/f5d [0,4194304] 0 2023-12-16T03:16:01.478 INFO:tasks.workunit.client.1.smithi184.stdout:4/618: dread - d1/d12/d13/d40/fd3 zero size 2023-12-16T03:16:01.482 INFO:tasks.workunit.client.1.smithi184.stdout:6/717: dread d0/d5/d12/d1b/d33/f58 [0,4194304] 0 2023-12-16T03:16:01.487 INFO:tasks.workunit.client.1.smithi184.stdout:7/584: dwrite d0/d6b/f78 [0,4194304] 0 2023-12-16T03:16:01.488 INFO:tasks.workunit.client.1.smithi184.stdout:7/585: stat d0/d3/d2e/d3b/c87 0 2023-12-16T03:16:01.502 INFO:tasks.workunit.client.0.smithi064.stdout:4/368: unlink d0/d42/d66/d5a/c5f 0 2023-12-16T03:16:01.507 INFO:tasks.workunit.client.1.smithi184.stdout:7/586: dwrite d0/d3/d4/f5e [0,4194304] 0 2023-12-16T03:16:01.529 INFO:tasks.workunit.client.0.smithi064.stdout:4/369: dwrite d0/d42/d66/f5e [0,4194304] 0 2023-12-16T03:16:01.529 INFO:tasks.workunit.client.0.smithi064.stdout:8/384: truncate d0/da/d3e/d46/f5e 374063 0 2023-12-16T03:16:01.531 INFO:tasks.workunit.client.1.smithi184.stdout:8/707: creat d2/fe2 x:0 0 0 2023-12-16T03:16:01.533 INFO:tasks.workunit.client.1.smithi184.stdout:3/725: mkdir d12/d86/de4/d110 0 2023-12-16T03:16:01.534 INFO:tasks.workunit.client.0.smithi064.stdout:0/289: creat d2/d7/d10/d21/d31/f59 x:0 0 0 2023-12-16T03:16:01.538 INFO:tasks.workunit.client.1.smithi184.stdout:4/619: symlink d1/d12/db3/db8/dd2/ld5 0 2023-12-16T03:16:01.538 INFO:tasks.workunit.client.1.smithi184.stdout:4/620: truncate d1/d29/d34/d5c/d76/f8f 959460 0 2023-12-16T03:16:01.539 INFO:tasks.workunit.client.1.smithi184.stdout:4/621: dread d1/d11/d1b/fbb [0,4194304] 0 2023-12-16T03:16:01.540 INFO:tasks.workunit.client.0.smithi064.stdout:6/309: link d3/d8/da/l38 d3/l53 0 2023-12-16T03:16:01.540 INFO:tasks.workunit.client.0.smithi064.stdout:6/310: read d3/d8/d1f/d26/f3b [1336531,8199] 0 2023-12-16T03:16:01.541 INFO:tasks.workunit.client.0.smithi064.stdout:0/290: dread d2/d7/f49 [0,4194304] 0 2023-12-16T03:16:01.542 INFO:tasks.workunit.client.0.smithi064.stdout:2/288: creat d1/d27/d3b/f56 x:0 0 0 2023-12-16T03:16:01.542 INFO:tasks.workunit.client.1.smithi184.stdout:6/718: dread d0/d5/d22/d25/f5f [0,4194304] 0 2023-12-16T03:16:01.544 INFO:tasks.workunit.client.1.smithi184.stdout:7/587: symlink d0/d3/d2e/da9/laa 0 2023-12-16T03:16:01.544 INFO:tasks.workunit.client.1.smithi184.stdout:7/588: readlink d0/d3/d2e/d79/d1e/l5a 0 2023-12-16T03:16:01.545 INFO:tasks.workunit.client.0.smithi064.stdout:2/289: write d1/f10 [1739565,12245] 0 2023-12-16T03:16:01.546 INFO:tasks.workunit.client.0.smithi064.stdout:7/339: symlink d7/d3e/d42/d43/d46/d52/l67 0 2023-12-16T03:16:01.547 INFO:tasks.workunit.client.1.smithi184.stdout:8/708: stat d2/d12/d21/d2d/la8 0 2023-12-16T03:16:01.551 INFO:tasks.workunit.client.1.smithi184.stdout:9/871: sync 2023-12-16T03:16:01.551 INFO:tasks.workunit.client.1.smithi184.stdout:0/700: sync 2023-12-16T03:16:01.551 INFO:tasks.workunit.client.1.smithi184.stdout:2/541: sync 2023-12-16T03:16:01.551 INFO:tasks.workunit.client.1.smithi184.stdout:3/726: creat d12/d18/d7a/db4/f111 x:0 0 0 2023-12-16T03:16:01.551 INFO:tasks.workunit.client.1.smithi184.stdout:7/589: dread d0/d3/d2e/d79/d36/f4e [0,4194304] 0 2023-12-16T03:16:01.552 INFO:tasks.workunit.client.0.smithi064.stdout:3/361: unlink db/d4f/f6d 0 2023-12-16T03:16:01.552 INFO:tasks.workunit.client.1.smithi184.stdout:9/872: dread d0/d3a/f70 [0,4194304] 0 2023-12-16T03:16:01.552 INFO:tasks.workunit.client.1.smithi184.stdout:9/873: dread - d0/d13/d20/db0/f7c zero size 2023-12-16T03:16:01.555 INFO:tasks.workunit.client.0.smithi064.stdout:7/340: dread d7/d3e/f47 [0,4194304] 0 2023-12-16T03:16:01.558 INFO:tasks.workunit.client.1.smithi184.stdout:4/622: link d1/d12/d13/d40/d43/d5e/l85 d1/d12/d13/d40/d43/d5e/d6a/ld6 0 2023-12-16T03:16:01.559 INFO:tasks.workunit.client.0.smithi064.stdout:9/323: truncate d2/d2d/d3b/d3c/d34/f45 1753278 0 2023-12-16T03:16:01.560 INFO:tasks.workunit.client.0.smithi064.stdout:6/311: dwrite d3/d9/f45 [0,4194304] 0 2023-12-16T03:16:01.563 INFO:tasks.workunit.client.1.smithi184.stdout:6/719: creat d0/d5/dd1/fe8 x:0 0 0 2023-12-16T03:16:01.564 INFO:tasks.workunit.client.1.smithi184.stdout:6/720: stat d0/d5/d22/d37/d4d/d9c 0 2023-12-16T03:16:01.564 INFO:tasks.workunit.client.1.smithi184.stdout:6/721: stat d0/d5/d22/d25/dbf/dbe/fd8 0 2023-12-16T03:16:01.566 INFO:tasks.workunit.client.1.smithi184.stdout:2/542: symlink d3/d13/lb7 0 2023-12-16T03:16:01.566 INFO:tasks.workunit.client.1.smithi184.stdout:2/543: write d3/d13/f66 [3155739,35568] 0 2023-12-16T03:16:01.566 INFO:tasks.workunit.client.1.smithi184.stdout:2/544: write d3/f14 [4684288,35161] 0 2023-12-16T03:16:01.568 INFO:tasks.workunit.client.1.smithi184.stdout:3/727: unlink d12/f19 0 2023-12-16T03:16:01.570 INFO:tasks.workunit.client.1.smithi184.stdout:3/728: write d12/d18/d1f/d23/d2a/d42/d52/ff6 [80304,50362] 0 2023-12-16T03:16:01.571 INFO:tasks.workunit.client.0.smithi064.stdout:9/324: dread f1 [0,4194304] 0 2023-12-16T03:16:01.572 INFO:tasks.workunit.client.0.smithi064.stdout:9/325: chown d2/d2d/l47 1654716037 1 2023-12-16T03:16:01.574 INFO:tasks.workunit.client.1.smithi184.stdout:7/590: mkdir d0/d3/d2e/d79/d32/d39/d8f/dab 0 2023-12-16T03:16:01.574 INFO:tasks.workunit.client.1.smithi184.stdout:7/591: fsync d0/d3/d2e/d79/d36/d3f/f83 0 2023-12-16T03:16:01.578 INFO:tasks.workunit.client.1.smithi184.stdout:8/709: dread d2/d4/d10/f17 [0,4194304] 0 2023-12-16T03:16:01.578 INFO:tasks.workunit.client.1.smithi184.stdout:8/710: fsync d2/d6a/da4/fc4 0 2023-12-16T03:16:01.578 INFO:tasks.workunit.client.1.smithi184.stdout:8/711: fdatasync d2/d4/f9 0 2023-12-16T03:16:01.578 INFO:tasks.workunit.client.1.smithi184.stdout:4/623: rmdir d1/d29/d34/d5c 39 2023-12-16T03:16:01.578 INFO:tasks.workunit.client.1.smithi184.stdout:4/624: chown d1/f51 1875691 1 2023-12-16T03:16:01.580 INFO:tasks.workunit.client.0.smithi064.stdout:4/370: mknod d0/d12/d48/c6e 0 2023-12-16T03:16:01.580 INFO:tasks.workunit.client.1.smithi184.stdout:6/722: dread d0/d5/d22/fb1 [0,4194304] 0 2023-12-16T03:16:01.581 INFO:tasks.workunit.client.1.smithi184.stdout:2/545: unlink d3/d29/d61/d6d/c72 0 2023-12-16T03:16:01.584 INFO:tasks.workunit.client.0.smithi064.stdout:8/385: rename d0/d1d/d24/l17 to d0/da/d3e/l84 0 2023-12-16T03:16:01.588 INFO:tasks.workunit.client.0.smithi064.stdout:3/362: creat db/d12/d4e/d56/f7a x:0 0 0 2023-12-16T03:16:01.590 INFO:tasks.workunit.client.1.smithi184.stdout:7/592: mkdir d0/d3/d2e/d79/d1e/dac 0 2023-12-16T03:16:01.594 INFO:tasks.workunit.client.0.smithi064.stdout:2/290: dwrite d1/f10 [0,4194304] 0 2023-12-16T03:16:01.594 INFO:tasks.workunit.client.0.smithi064.stdout:7/341: dwrite d7/f9 [0,4194304] 0 2023-12-16T03:16:01.594 INFO:tasks.workunit.client.0.smithi064.stdout:9/326: getdents d2/d2d/d3b/d3c/d34 0 2023-12-16T03:16:01.594 INFO:tasks.workunit.client.0.smithi064.stdout:9/327: fdatasync d2/d2d/d3b/d3c/d34/f37 0 2023-12-16T03:16:01.597 INFO:tasks.workunit.client.0.smithi064.stdout:4/371: creat d0/da/f6f x:0 0 0 2023-12-16T03:16:01.599 INFO:tasks.workunit.client.1.smithi184.stdout:2/546: mknod d3/d13/d28/dac/daf/cb8 0 2023-12-16T03:16:01.599 INFO:tasks.workunit.client.1.smithi184.stdout:2/547: stat d3/d29/d2f/d2e/l8f 0 2023-12-16T03:16:01.600 INFO:tasks.workunit.client.0.smithi064.stdout:6/312: rename d3/d9/fb to d3/d8/d1f/d26/d47/d4a/f54 0 2023-12-16T03:16:01.603 INFO:tasks.workunit.client.1.smithi184.stdout:2/548: dread d3/f75 [0,4194304] 0 2023-12-16T03:16:01.603 INFO:tasks.workunit.client.1.smithi184.stdout:2/549: write d3/d29/d2f/d46/f7e [529336,8559] 0 2023-12-16T03:16:01.604 INFO:tasks.workunit.client.0.smithi064.stdout:0/291: mknod d2/d8/da/df/c5a 0 2023-12-16T03:16:01.608 INFO:tasks.workunit.client.1.smithi184.stdout:4/625: dwrite d1/d12/d13/d40/d43/d5e/fa8 [0,4194304] 0 2023-12-16T03:16:01.608 INFO:tasks.workunit.client.1.smithi184.stdout:4/626: stat d1/d11/d1b/cc3 0 2023-12-16T03:16:01.608 INFO:tasks.workunit.client.1.smithi184.stdout:4/627: fdatasync d1/f51 0 2023-12-16T03:16:01.609 INFO:tasks.workunit.client.0.smithi064.stdout:4/372: dread d0/d42/f5c [0,4194304] 0 2023-12-16T03:16:01.610 INFO:tasks.workunit.client.0.smithi064.stdout:2/291: mkdir d1/d15/d1e/d55/d57 0 2023-12-16T03:16:01.611 INFO:tasks.workunit.client.0.smithi064.stdout:2/292: chown d1/d27/d35/l4b 196837 1 2023-12-16T03:16:01.611 INFO:tasks.workunit.client.1.smithi184.stdout:8/712: dwrite d2/d12/d21/d2d/d31/f63 [0,4194304] 0 2023-12-16T03:16:01.611 INFO:tasks.workunit.client.1.smithi184.stdout:8/713: chown d2/d6a/da4/f88 335 1 2023-12-16T03:16:01.612 INFO:tasks.workunit.client.0.smithi064.stdout:7/342: mknod d7/d13/d20/d37/c68 0 2023-12-16T03:16:01.614 INFO:tasks.workunit.client.1.smithi184.stdout:6/723: dwrite d0/d5/d12/d1b/f4c [4194304,4194304] 0 2023-12-16T03:16:01.620 INFO:tasks.workunit.client.0.smithi064.stdout:9/328: mknod d2/d2d/d36/c64 0 2023-12-16T03:16:01.623 INFO:tasks.workunit.client.0.smithi064.stdout:3/363: rename db/d12/d1a/d2c/f44 to db/d12/d1a/d2c/d34/d4c/f7b 0 2023-12-16T03:16:01.626 INFO:tasks.workunit.client.0.smithi064.stdout:6/313: symlink d3/d8/d1f/l55 0 2023-12-16T03:16:01.629 INFO:tasks.workunit.client.0.smithi064.stdout:0/292: mkdir d2/d5b 0 2023-12-16T03:16:01.630 INFO:tasks.workunit.client.0.smithi064.stdout:4/373: mkdir d0/d42/d4c/d70 0 2023-12-16T03:16:01.630 INFO:tasks.workunit.client.0.smithi064.stdout:4/374: truncate d0/d12/d48/f4f 427488 0 2023-12-16T03:16:01.631 INFO:tasks.workunit.client.0.smithi064.stdout:8/386: mkdir d0/da/d3e/d46/d54/d7c/d85 0 2023-12-16T03:16:01.633 INFO:tasks.workunit.client.0.smithi064.stdout:9/329: symlink d2/d2d/l65 0 2023-12-16T03:16:01.634 INFO:tasks.workunit.client.0.smithi064.stdout:9/330: write d2/f2a [5200162,26396] 0 2023-12-16T03:16:01.636 INFO:tasks.workunit.client.0.smithi064.stdout:2/293: rename d1/d27/d2f to d1/d15/d58 0 2023-12-16T03:16:01.636 INFO:tasks.workunit.client.0.smithi064.stdout:2/294: chown d1/d15/d1b 196 1 2023-12-16T03:16:01.636 INFO:tasks.workunit.client.0.smithi064.stdout:2/295: write d1/f1d [4098635,91569] 0 2023-12-16T03:16:01.636 INFO:tasks.workunit.client.0.smithi064.stdout:2/296: dread - d1/d27/d3b/f56 zero size 2023-12-16T03:16:01.636 INFO:tasks.workunit.client.0.smithi064.stdout:3/364: chown db/d12/d1a/f1d 1039 1 2023-12-16T03:16:01.636 INFO:tasks.workunit.client.0.smithi064.stdout:3/365: dread - db/d13/d39/f66 zero size 2023-12-16T03:16:01.637 INFO:tasks.workunit.client.0.smithi064.stdout:3/366: readlink db/d12/d1a/d2c/d34/d4c/l62 0 2023-12-16T03:16:01.637 INFO:tasks.workunit.client.0.smithi064.stdout:6/314: stat d3/d8/d1f/d26/c4d 0 2023-12-16T03:16:01.637 INFO:tasks.workunit.client.0.smithi064.stdout:6/315: fdatasync d3/d9/f45 0 2023-12-16T03:16:01.638 INFO:tasks.workunit.client.0.smithi064.stdout:0/293: getdents d2/d7/d10/d21 0 2023-12-16T03:16:01.641 INFO:tasks.workunit.client.0.smithi064.stdout:9/331: mknod d2/dc/c66 0 2023-12-16T03:16:01.642 INFO:tasks.workunit.client.0.smithi064.stdout:2/297: creat d1/d15/d1e/f59 x:0 0 0 2023-12-16T03:16:01.643 INFO:tasks.workunit.client.0.smithi064.stdout:3/367: truncate db/f16 1555030 0 2023-12-16T03:16:01.646 INFO:tasks.workunit.client.0.smithi064.stdout:4/375: dread d0/d1e/f37 [0,4194304] 0 2023-12-16T03:16:01.646 INFO:tasks.workunit.client.0.smithi064.stdout:4/376: chown d0/d42/d56/l5d 13273 1 2023-12-16T03:16:01.646 INFO:tasks.workunit.client.0.smithi064.stdout:0/294: creat d2/d8/da/df/f5c x:0 0 0 2023-12-16T03:16:01.647 INFO:tasks.workunit.client.0.smithi064.stdout:2/298: creat d1/d27/d3b/f5a x:0 0 0 2023-12-16T03:16:01.647 INFO:tasks.workunit.client.0.smithi064.stdout:2/299: chown d1/d27/d2e 3 1 2023-12-16T03:16:01.650 INFO:tasks.workunit.client.0.smithi064.stdout:2/300: creat d1/d27/d2e/f5b x:0 0 0 2023-12-16T03:16:01.650 INFO:tasks.workunit.client.0.smithi064.stdout:2/301: readlink d1/d15/d1b/l25 0 2023-12-16T03:16:01.650 INFO:tasks.workunit.client.1.smithi184.stdout:8/714: dwrite d2/d6a/da4/f7d [0,4194304] 0 2023-12-16T03:16:01.653 INFO:tasks.workunit.client.0.smithi064.stdout:2/302: creat d1/d15/d23/d2d/f5c x:0 0 0 2023-12-16T03:16:01.653 INFO:tasks.workunit.client.0.smithi064.stdout:6/316: dread d3/d8/d1f/d26/f3b [0,4194304] 0 2023-12-16T03:16:01.653 INFO:tasks.workunit.client.0.smithi064.stdout:6/317: chown d3/d9/l19 894 1 2023-12-16T03:16:01.655 INFO:tasks.workunit.client.0.smithi064.stdout:2/303: mknod d1/d27/d3b/c5d 0 2023-12-16T03:16:01.655 INFO:tasks.workunit.client.1.smithi184.stdout:6/724: dwrite d0/d5/d12/d1b/d33/f58 [0,4194304] 0 2023-12-16T03:16:01.657 INFO:tasks.workunit.client.0.smithi064.stdout:7/343: dwrite d7/d3e/d42/d48/f49 [0,4194304] 0 2023-12-16T03:16:01.657 INFO:tasks.workunit.client.0.smithi064.stdout:3/368: dread db/d12/f3b [0,4194304] 0 2023-12-16T03:16:01.657 INFO:tasks.workunit.client.0.smithi064.stdout:3/369: chown db/d12/d21/f65 989 1 2023-12-16T03:16:01.657 INFO:tasks.workunit.client.0.smithi064.stdout:7/344: read d7/d26/f27 [643151,8693] 0 2023-12-16T03:16:01.658 INFO:tasks.workunit.client.0.smithi064.stdout:9/332: dread d2/dc/f11 [0,4194304] 0 2023-12-16T03:16:01.658 INFO:tasks.workunit.client.0.smithi064.stdout:9/333: readlink d2/d2d/d3b/d3c/d4b/l62 0 2023-12-16T03:16:01.659 INFO:tasks.workunit.client.0.smithi064.stdout:2/304: symlink d1/d15/d58/l5e 0 2023-12-16T03:16:01.659 INFO:tasks.workunit.client.0.smithi064.stdout:8/387: dwrite d0/da/d3e/d46/f7b [0,4194304] 0 2023-12-16T03:16:01.659 INFO:tasks.workunit.client.0.smithi064.stdout:8/388: chown d0 2117 1 2023-12-16T03:16:01.664 INFO:tasks.workunit.client.0.smithi064.stdout:7/345: creat d7/d13/d20/d37/f69 x:0 0 0 2023-12-16T03:16:01.664 INFO:tasks.workunit.client.0.smithi064.stdout:7/346: stat d7/d3e/d42/d48/d51/f60 0 2023-12-16T03:16:01.664 INFO:tasks.workunit.client.0.smithi064.stdout:7/347: chown d7/d3e/d42/d43/d46/d52/l67 185909 1 2023-12-16T03:16:01.665 INFO:tasks.workunit.client.0.smithi064.stdout:2/305: creat d1/d15/d1e/d42/f5f x:0 0 0 2023-12-16T03:16:01.665 INFO:tasks.workunit.client.0.smithi064.stdout:2/306: chown d1/l11 772 1 2023-12-16T03:16:01.669 INFO:tasks.workunit.client.0.smithi064.stdout:8/389: mknod d0/d1d/d24/d2f/d50/c86 0 2023-12-16T03:16:01.671 INFO:tasks.workunit.client.0.smithi064.stdout:7/348: mknod d7/d3e/d42/d43/d46/c6a 0 2023-12-16T03:16:01.671 INFO:tasks.workunit.client.0.smithi064.stdout:7/349: chown d7/d26/l40 53510 1 2023-12-16T03:16:01.671 INFO:tasks.workunit.client.1.smithi184.stdout:8/715: dread d2/d4/d10/d11/f1d [0,4194304] 0 2023-12-16T03:16:01.672 INFO:tasks.workunit.client.1.smithi184.stdout:1/648: rename d3/d34/cd1 to d3/d34/dbc/d38/cdb 0 2023-12-16T03:16:01.673 INFO:tasks.workunit.client.0.smithi064.stdout:2/307: mkdir d1/d15/d1e/d60 0 2023-12-16T03:16:01.674 INFO:tasks.workunit.client.0.smithi064.stdout:9/334: dread d2/dc/d24/d39/f3d [0,4194304] 0 2023-12-16T03:16:01.676 INFO:tasks.workunit.client.0.smithi064.stdout:7/350: creat d7/d3e/d42/d48/f6b x:0 0 0 2023-12-16T03:16:01.679 INFO:tasks.workunit.client.0.smithi064.stdout:9/335: mkdir d2/dc/d67 0 2023-12-16T03:16:01.680 INFO:tasks.workunit.client.1.smithi184.stdout:8/716: creat d2/d4/da6/fe3 x:0 0 0 2023-12-16T03:16:01.681 INFO:tasks.workunit.client.0.smithi064.stdout:0/295: dwrite d2/d7/d10/d21/f39 [0,4194304] 0 2023-12-16T03:16:01.685 INFO:tasks.workunit.client.1.smithi184.stdout:7/593: rename d0/d6b/f78 to d0/d6b/d69/fad 0 2023-12-16T03:16:01.685 INFO:tasks.workunit.client.1.smithi184.stdout:4/628: mkdir d1/d11/d5a/dd7 0 2023-12-16T03:16:01.685 INFO:tasks.workunit.client.1.smithi184.stdout:7/594: write d0/d3/d2e/d79/d36/d3f/f92 [91878,65569] 0 2023-12-16T03:16:01.685 INFO:tasks.workunit.client.0.smithi064.stdout:9/336: symlink d2/dc/d24/d39/l68 0 2023-12-16T03:16:01.686 INFO:tasks.workunit.client.0.smithi064.stdout:4/377: dwrite d0/d1e/f2c [0,4194304] 0 2023-12-16T03:16:01.686 INFO:tasks.workunit.client.1.smithi184.stdout:8/717: symlink d2/d12/le4 0 2023-12-16T03:16:01.689 INFO:tasks.workunit.client.1.smithi184.stdout:2/550: rename d3/d13/d28/f3e to d3/d13/d28/d83/fb9 0 2023-12-16T03:16:01.689 INFO:tasks.workunit.client.1.smithi184.stdout:2/551: stat d3/d29/d4d/d5b/da6 0 2023-12-16T03:16:01.689 INFO:tasks.workunit.client.1.smithi184.stdout:4/629: read d1/d29/d34/d5c/d76/f32 [3957819,33351] 0 2023-12-16T03:16:01.691 INFO:tasks.workunit.client.0.smithi064.stdout:0/296: symlink d2/d7/d10/d21/l5d 0 2023-12-16T03:16:01.692 INFO:tasks.workunit.client.0.smithi064.stdout:3/370: dwrite db/d12/f18 [0,4194304] 0 2023-12-16T03:16:01.692 INFO:tasks.workunit.client.1.smithi184.stdout:7/595: creat d0/d6b/fae x:0 0 0 2023-12-16T03:16:01.693 INFO:tasks.workunit.client.1.smithi184.stdout:3/729: getdents d12 0 2023-12-16T03:16:01.695 INFO:tasks.workunit.client.0.smithi064.stdout:9/337: unlink l0 0 2023-12-16T03:16:01.701 INFO:tasks.workunit.client.1.smithi184.stdout:2/552: rmdir d3/d9/d19 39 2023-12-16T03:16:01.701 INFO:tasks.workunit.client.1.smithi184.stdout:2/553: chown d3/d29/d2f/d2e/fa 8113 1 2023-12-16T03:16:01.702 INFO:tasks.workunit.client.0.smithi064.stdout:4/378: creat d0/d42/f71 x:0 0 0 2023-12-16T03:16:01.705 INFO:tasks.workunit.client.1.smithi184.stdout:1/649: dwrite d3/d34/dbc/d36/f48 [0,4194304] 0 2023-12-16T03:16:01.707 INFO:tasks.workunit.client.0.smithi064.stdout:3/371: symlink db/d12/d1a/d2c/l7c 0 2023-12-16T03:16:01.709 INFO:tasks.workunit.client.1.smithi184.stdout:2/554: write d3/d29/d2f/d46/f6b [3020591,73429] 0 2023-12-16T03:16:01.711 INFO:tasks.workunit.client.0.smithi064.stdout:9/338: link d2/ce d2/c69 0 2023-12-16T03:16:01.713 INFO:tasks.workunit.client.0.smithi064.stdout:0/297: write d2/d8/da/df/f37 [931771,109213] 0 2023-12-16T03:16:01.713 INFO:tasks.workunit.client.0.smithi064.stdout:7/351: dwrite d7/f53 [0,4194304] 0 2023-12-16T03:16:01.713 INFO:tasks.workunit.client.0.smithi064.stdout:4/379: unlink d0/da/ld 0 2023-12-16T03:16:01.715 INFO:tasks.workunit.client.0.smithi064.stdout:3/372: creat db/d12/d1a/f7d x:0 0 0 2023-12-16T03:16:01.717 INFO:tasks.workunit.client.0.smithi064.stdout:7/352: creat d7/f6c x:0 0 0 2023-12-16T03:16:01.718 INFO:tasks.workunit.client.0.smithi064.stdout:4/380: creat d0/d42/f72 x:0 0 0 2023-12-16T03:16:01.718 INFO:tasks.workunit.client.0.smithi064.stdout:4/381: chown d0/l10 26072 1 2023-12-16T03:16:01.718 INFO:tasks.workunit.client.0.smithi064.stdout:4/382: dread - d0/da/f6d zero size 2023-12-16T03:16:01.719 INFO:tasks.workunit.client.0.smithi064.stdout:4/383: fdatasync d0/d42/d66/f26 0 2023-12-16T03:16:01.719 INFO:tasks.workunit.client.1.smithi184.stdout:2/555: write d3/d13/f9a [2386555,59825] 0 2023-12-16T03:16:01.719 INFO:tasks.workunit.client.0.smithi064.stdout:3/373: truncate db/f19 3102903 0 2023-12-16T03:16:01.721 INFO:tasks.workunit.client.0.smithi064.stdout:4/384: unlink d0/f8 0 2023-12-16T03:16:01.721 INFO:tasks.workunit.client.0.smithi064.stdout:4/385: read - d0/d1e/f60 zero size 2023-12-16T03:16:01.722 INFO:tasks.workunit.client.0.smithi064.stdout:9/339: dread d2/dc/f15 [0,4194304] 0 2023-12-16T03:16:01.722 INFO:tasks.workunit.client.1.smithi184.stdout:2/556: creat d3/d29/d2f/d46/fba x:0 0 0 2023-12-16T03:16:01.722 INFO:tasks.workunit.client.1.smithi184.stdout:2/557: stat d3/d13/f9a 0 2023-12-16T03:16:01.723 INFO:tasks.workunit.client.0.smithi064.stdout:3/374: getdents db 0 2023-12-16T03:16:01.723 INFO:tasks.workunit.client.0.smithi064.stdout:3/375: chown db/d12/d1a/d2c/d6e/d75/c76 13451125 1 2023-12-16T03:16:01.724 INFO:tasks.workunit.client.0.smithi064.stdout:7/353: write d7/d26/d30/f33 [693169,43478] 0 2023-12-16T03:16:01.724 INFO:tasks.workunit.client.0.smithi064.stdout:7/354: chown d7/d3e/d42/d43/d46/l65 970 1 2023-12-16T03:16:01.725 INFO:tasks.workunit.client.1.smithi184.stdout:2/558: getdents d3/d9/d19/d82 0 2023-12-16T03:16:01.725 INFO:tasks.workunit.client.1.smithi184.stdout:2/559: write d3/d13/d28/fb2 [735714,99256] 0 2023-12-16T03:16:01.727 INFO:tasks.workunit.client.0.smithi064.stdout:6/318: rename d3/d8/d1f/d26/d47/d4a/f54 to d3/d8/d1f/f56 0 2023-12-16T03:16:01.728 INFO:tasks.workunit.client.1.smithi184.stdout:4/630: dwrite d1/f93 [0,4194304] 0 2023-12-16T03:16:01.729 INFO:tasks.workunit.client.0.smithi064.stdout:9/340: symlink d2/d2d/d3b/d3c/l6a 0 2023-12-16T03:16:01.730 INFO:tasks.workunit.client.1.smithi184.stdout:1/650: dwrite d3/d34/dbc/f58 [0,4194304] 0 2023-12-16T03:16:01.731 INFO:tasks.workunit.client.1.smithi184.stdout:3/730: dwrite d12/d18/d1f/d23/d51/ffd [0,4194304] 0 2023-12-16T03:16:01.731 INFO:tasks.workunit.client.1.smithi184.stdout:8/718: dwrite d2/d4/d10/d11/fac [0,4194304] 0 2023-12-16T03:16:01.731 INFO:tasks.workunit.client.1.smithi184.stdout:8/719: readlink d2/d4/d10/d11/l18 0 2023-12-16T03:16:01.733 INFO:tasks.workunit.client.0.smithi064.stdout:9/341: mkdir d2/d2d/d6b 0 2023-12-16T03:16:01.737 INFO:tasks.workunit.client.1.smithi184.stdout:2/560: dread d3/d9/d19/f37 [0,4194304] 0 2023-12-16T03:16:01.737 INFO:tasks.workunit.client.1.smithi184.stdout:4/631: mknod d1/d11/d1b/cd8 0 2023-12-16T03:16:01.739 INFO:tasks.workunit.client.0.smithi064.stdout:9/342: mkdir d2/d2d/d6c 0 2023-12-16T03:16:01.742 INFO:tasks.workunit.client.0.smithi064.stdout:7/355: rmdir d7/d13/d20/d4a 0 2023-12-16T03:16:01.743 INFO:tasks.workunit.client.0.smithi064.stdout:7/356: dread - d7/d3e/d42/d48/f6b zero size 2023-12-16T03:16:01.745 INFO:tasks.workunit.client.1.smithi184.stdout:3/731: dread d12/d1e/de8/d48/fc7 [0,4194304] 0 2023-12-16T03:16:01.745 INFO:tasks.workunit.client.1.smithi184.stdout:3/732: truncate d12/d1e/de8/ff9 798565 0 2023-12-16T03:16:01.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/298: dread f1 [0,4194304] 0 2023-12-16T03:16:01.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/299: write d2/d8/f4c [493266,22046] 0 2023-12-16T03:16:01.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/300: fdatasync d2/d8/da/df/f4d 0 2023-12-16T03:16:01.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/301: chown d2/d7/d10 502 1 2023-12-16T03:16:01.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/302: stat d2/d29 0 2023-12-16T03:16:01.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/303: chown d2/d7/d10/d21/l5d 3061 1 2023-12-16T03:16:01.746 INFO:tasks.workunit.client.0.smithi064.stdout:9/343: creat d2/dc/f6d x:0 0 0 2023-12-16T03:16:01.747 INFO:tasks.workunit.client.1.smithi184.stdout:4/632: dread d1/d11/d1b/d1e/fc5 [0,4194304] 0 2023-12-16T03:16:01.747 INFO:tasks.workunit.client.1.smithi184.stdout:4/633: chown d1/d11/d5a/lac 1596216557 1 2023-12-16T03:16:01.747 INFO:tasks.workunit.client.1.smithi184.stdout:4/634: chown d1/d29 5 1 2023-12-16T03:16:01.747 INFO:tasks.workunit.client.1.smithi184.stdout:6/725: rename d0/d5/d22/d25/l66 to d0/d5/d22/d37/d4d/le9 0 2023-12-16T03:16:01.749 INFO:tasks.workunit.client.0.smithi064.stdout:6/319: dwrite d3/d8/da/f43 [0,4194304] 0 2023-12-16T03:16:01.751 INFO:tasks.workunit.client.0.smithi064.stdout:9/344: link d2/dc/d24/d39/d42/f59 d2/dc/d24/d39/d42/f6e 0 2023-12-16T03:16:01.752 INFO:tasks.workunit.client.0.smithi064.stdout:7/357: write d7/d3e/d42/f44 [3157566,110040] 0 2023-12-16T03:16:01.752 INFO:tasks.workunit.client.0.smithi064.stdout:5/333: sync 2023-12-16T03:16:01.752 INFO:tasks.workunit.client.0.smithi064.stdout:5/334: chown d0/f5 1060367 1 2023-12-16T03:16:01.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/319: sync 2023-12-16T03:16:01.752 INFO:tasks.workunit.client.0.smithi064.stdout:5/335: chown d0/d14/d25/d3e/d35 778019909 1 2023-12-16T03:16:01.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/320: fdatasync f2 0 2023-12-16T03:16:01.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/321: write d3/dd/d11/f56 [246803,70472] 0 2023-12-16T03:16:01.754 INFO:tasks.workunit.client.0.smithi064.stdout:0/304: mkdir d2/d8/da/df/d5e 0 2023-12-16T03:16:01.757 INFO:tasks.workunit.client.0.smithi064.stdout:9/345: stat d2/ce 0 2023-12-16T03:16:01.758 INFO:tasks.workunit.client.0.smithi064.stdout:5/336: dread d0/d7/f1e [0,4194304] 0 2023-12-16T03:16:01.760 INFO:tasks.workunit.client.1.smithi184.stdout:0/701: creat dc/d10/d2d/d5f/ff8 x:0 0 0 2023-12-16T03:16:01.762 INFO:tasks.workunit.client.0.smithi064.stdout:7/358: mknod d7/d3e/d42/d43/d46/d52/c6d 0 2023-12-16T03:16:01.764 INFO:tasks.workunit.client.0.smithi064.stdout:6/320: rmdir d3/d8/da 39 2023-12-16T03:16:01.767 INFO:tasks.workunit.client.0.smithi064.stdout:1/322: unlink d3/dd/d23/f2c 0 2023-12-16T03:16:01.771 INFO:tasks.workunit.client.1.smithi184.stdout:5/513: rmdir d1/d2a/d31 39 2023-12-16T03:16:01.771 INFO:tasks.workunit.client.1.smithi184.stdout:5/514: chown d1/c6 110238691 1 2023-12-16T03:16:01.773 INFO:tasks.workunit.client.0.smithi064.stdout:0/305: dwrite d2/d8/da/f4e [4194304,4194304] 0 2023-12-16T03:16:01.773 INFO:tasks.workunit.client.0.smithi064.stdout:0/306: read - d2/d7/d10/d21/d31/f59 zero size 2023-12-16T03:16:01.773 INFO:tasks.workunit.client.0.smithi064.stdout:0/307: readlink d2/d8/da/l50 0 2023-12-16T03:16:01.774 INFO:tasks.workunit.client.0.smithi064.stdout:9/346: mkdir d2/dc/d24/d39/d5e/d6f 0 2023-12-16T03:16:01.776 INFO:tasks.workunit.client.0.smithi064.stdout:9/347: write d2/dc/ff [3287634,15003] 0 2023-12-16T03:16:01.776 INFO:tasks.workunit.client.0.smithi064.stdout:9/348: chown d2/l1b 1405942552 1 2023-12-16T03:16:01.779 INFO:tasks.workunit.client.0.smithi064.stdout:7/359: dwrite d7/d3e/d42/d48/f6b [0,4194304] 0 2023-12-16T03:16:01.781 INFO:tasks.workunit.client.1.smithi184.stdout:3/733: rmdir d12/d18/d1f/d23/d2a/dfc/ddb 0 2023-12-16T03:16:01.782 INFO:tasks.workunit.client.1.smithi184.stdout:2/561: truncate d3/d29/d2f/d2e/f7 585787 0 2023-12-16T03:16:01.782 INFO:tasks.workunit.client.1.smithi184.stdout:4/635: creat d1/d12/d13/d40/d43/d5e/fd9 x:0 0 0 2023-12-16T03:16:01.782 INFO:tasks.workunit.client.1.smithi184.stdout:1/651: rename d3/d34/dbc/d3c/d41/d77/ca7 to d3/d34/cdc 0 2023-12-16T03:16:01.782 INFO:tasks.workunit.client.1.smithi184.stdout:2/562: write d3/d9/d19/f26 [1293718,4389] 0 2023-12-16T03:16:01.782 INFO:tasks.workunit.client.1.smithi184.stdout:6/726: creat d0/d5/d22/d34/fea x:0 0 0 2023-12-16T03:16:01.786 INFO:tasks.workunit.client.1.smithi184.stdout:0/702: rmdir dc/d22/d53 39 2023-12-16T03:16:01.787 INFO:tasks.workunit.client.0.smithi064.stdout:5/337: symlink d0/d19/d48/l7a 0 2023-12-16T03:16:01.788 INFO:tasks.workunit.client.1.smithi184.stdout:5/515: mknod d1/d3/d2f/ca7 0 2023-12-16T03:16:01.789 INFO:tasks.workunit.client.0.smithi064.stdout:6/321: symlink d3/l57 0 2023-12-16T03:16:01.792 INFO:tasks.workunit.client.1.smithi184.stdout:3/734: mknod d12/d18/da1/dbd/dc8/c112 0 2023-12-16T03:16:01.793 INFO:tasks.workunit.client.0.smithi064.stdout:1/323: dread d3/dd/d11/d3b/f69 [0,4194304] 0 2023-12-16T03:16:01.794 INFO:tasks.workunit.client.1.smithi184.stdout:1/652: truncate d3/d34/dbc/d3c/d41/d77/f78 5550082 0 2023-12-16T03:16:01.796 INFO:tasks.workunit.client.0.smithi064.stdout:5/338: dread d0/f5 [0,4194304] 0 2023-12-16T03:16:01.796 INFO:tasks.workunit.client.1.smithi184.stdout:2/563: symlink d3/d9/lbb 0 2023-12-16T03:16:01.798 INFO:tasks.workunit.client.0.smithi064.stdout:0/308: unlink d2/d8/f2d 0 2023-12-16T03:16:01.798 INFO:tasks.workunit.client.1.smithi184.stdout:3/735: write d12/d1e/d89/f96 [2903113,56992] 0 2023-12-16T03:16:01.800 INFO:tasks.workunit.client.1.smithi184.stdout:6/727: getdents d0/d5/d22 0 2023-12-16T03:16:01.801 INFO:tasks.workunit.client.1.smithi184.stdout:4/636: dwrite d1/d11/d1b/f9e [0,4194304] 0 2023-12-16T03:16:01.802 INFO:tasks.workunit.client.1.smithi184.stdout:0/703: creat dc/d10/da7/dc0/ff9 x:0 0 0 2023-12-16T03:16:01.803 INFO:tasks.workunit.client.0.smithi064.stdout:9/349: truncate d2/dc/d24/d39/d42/d57/f46 2490904 0 2023-12-16T03:16:01.804 INFO:tasks.workunit.client.1.smithi184.stdout:5/516: symlink d1/d3/d9/de/d15/d19/la8 0 2023-12-16T03:16:01.805 INFO:tasks.workunit.client.1.smithi184.stdout:5/517: read d1/d3/d9/de/d15/d19/f2c [909129,104102] 0 2023-12-16T03:16:01.806 INFO:tasks.workunit.client.1.smithi184.stdout:2/564: rename d3/d29/d2f/c7b to d3/d29/d4d/cbc 0 2023-12-16T03:16:01.808 INFO:tasks.workunit.client.1.smithi184.stdout:7/596: getdents d0/d6b/d69 0 2023-12-16T03:16:01.808 INFO:tasks.workunit.client.1.smithi184.stdout:7/597: chown d0/d3/d2e/d79/d32 545197 1 2023-12-16T03:16:01.810 INFO:tasks.workunit.client.1.smithi184.stdout:3/736: getdents d12/d18/d1f/d23/d2a/d4a/d61/da9/d106/d10b 0 2023-12-16T03:16:01.812 INFO:tasks.workunit.client.0.smithi064.stdout:7/360: unlink d7/d3e/d42/c4c 0 2023-12-16T03:16:01.814 INFO:tasks.workunit.client.1.smithi184.stdout:6/728: symlink d0/d5/d22/d25/dbf/dbe/de1/leb 0 2023-12-16T03:16:01.814 INFO:tasks.workunit.client.1.smithi184.stdout:6/729: write d0/d5/d22/fb [5273159,5528] 0 2023-12-16T03:16:01.814 INFO:tasks.workunit.client.1.smithi184.stdout:6/730: truncate d0/d5/d12/fb9 4640798 0 2023-12-16T03:16:01.816 INFO:tasks.workunit.client.0.smithi064.stdout:6/322: mkdir d3/d8/d13/d58 0 2023-12-16T03:16:01.817 INFO:tasks.workunit.client.0.smithi064.stdout:6/323: read d3/d8/da/f43 [2429502,109014] 0 2023-12-16T03:16:01.820 INFO:tasks.workunit.client.0.smithi064.stdout:1/324: rmdir d3/d36/d44/d4d/d67 0 2023-12-16T03:16:01.820 INFO:tasks.workunit.client.0.smithi064.stdout:1/325: write d3/d22/f28 [857849,69862] 0 2023-12-16T03:16:01.823 INFO:tasks.workunit.client.0.smithi064.stdout:5/339: creat d0/d7/d34/f7b x:0 0 0 2023-12-16T03:16:01.828 INFO:tasks.workunit.client.1.smithi184.stdout:0/704: creat dc/d22/d45/d66/ffa x:0 0 0 2023-12-16T03:16:01.830 INFO:tasks.workunit.client.0.smithi064.stdout:9/350: unlink d2/l28 0 2023-12-16T03:16:01.832 INFO:tasks.workunit.client.1.smithi184.stdout:5/518: rmdir d1/d3/d9/de/d15/d19/d3a 39 2023-12-16T03:16:01.832 INFO:tasks.workunit.client.1.smithi184.stdout:5/519: rename d1/d3/d9 to d1/d3/d9/d2e/da9 22 2023-12-16T03:16:01.832 INFO:tasks.workunit.client.0.smithi064.stdout:8/390: truncate d0/da/d3e/d46/f5e 355838 0 2023-12-16T03:16:01.835 INFO:tasks.workunit.client.0.smithi064.stdout:7/361: truncate d7/d3e/d42/d48/f5b 3130019 0 2023-12-16T03:16:01.835 INFO:tasks.workunit.client.0.smithi064.stdout:7/362: read - d7/d3e/d42/d48/f5e zero size 2023-12-16T03:16:01.840 INFO:tasks.workunit.client.1.smithi184.stdout:2/565: mknod d3/d13/d28/dac/daf/cbd 0 2023-12-16T03:16:01.840 INFO:tasks.workunit.client.1.smithi184.stdout:7/598: creat d0/d3/d2e/d79/d1e/faf x:0 0 0 2023-12-16T03:16:01.841 INFO:tasks.workunit.client.1.smithi184.stdout:3/737: symlink d12/d18/d1f/d23/d2a/d42/d52/d76/l113 0 2023-12-16T03:16:01.841 INFO:tasks.workunit.client.1.smithi184.stdout:3/738: chown d12/d18/d1f/d23/d2a/d4a/c7e 44 1 2023-12-16T03:16:01.841 INFO:tasks.workunit.client.0.smithi064.stdout:8/391: creat d0/d1d/d24/d2f/d50/f87 x:0 0 0 2023-12-16T03:16:01.842 INFO:tasks.workunit.client.0.smithi064.stdout:8/392: symlink d0/db/d12/d1c/l88 0 2023-12-16T03:16:01.845 INFO:tasks.workunit.client.0.smithi064.stdout:1/326: rmdir d3/dd/d23/d41 39 2023-12-16T03:16:01.845 INFO:tasks.workunit.client.1.smithi184.stdout:0/705: mkdir dc/d22/d48/dfb 0 2023-12-16T03:16:01.845 INFO:tasks.workunit.client.1.smithi184.stdout:0/706: fsync dc/d10/d1c/f49 0 2023-12-16T03:16:01.846 INFO:tasks.workunit.client.1.smithi184.stdout:4/637: dwrite d1/d29/d34/d5c/d76/d3b/fa9 [0,4194304] 0 2023-12-16T03:16:01.849 INFO:tasks.workunit.client.1.smithi184.stdout:4/638: write d1/d11/f23 [2294003,36960] 0 2023-12-16T03:16:01.849 INFO:tasks.workunit.client.1.smithi184.stdout:4/639: write d1/d29/d34/d5c/d76/f70 [1970377,96282] 0 2023-12-16T03:16:01.849 INFO:tasks.workunit.client.1.smithi184.stdout:5/520: mkdir d1/d3/d9/de/d15/d19/daa 0 2023-12-16T03:16:01.849 INFO:tasks.workunit.client.0.smithi064.stdout:4/386: getdents d0 0 2023-12-16T03:16:01.849 INFO:tasks.workunit.client.0.smithi064.stdout:4/387: write d0/d1e/f37 [4775531,16275] 0 2023-12-16T03:16:01.849 INFO:tasks.workunit.client.0.smithi064.stdout:7/363: dread d7/f3b [0,4194304] 0 2023-12-16T03:16:01.849 INFO:tasks.workunit.client.0.smithi064.stdout:7/364: write d7/f6c [569636,21479] 0 2023-12-16T03:16:01.849 INFO:tasks.workunit.client.1.smithi184.stdout:2/566: rename d3/d13/d28/fb2 to d3/d13/d28/fbe 0 2023-12-16T03:16:01.852 INFO:tasks.workunit.client.1.smithi184.stdout:7/599: creat d0/d3/d2e/d79/d32/d39/fb0 x:0 0 0 2023-12-16T03:16:01.855 INFO:tasks.workunit.client.1.smithi184.stdout:3/739: rename d12/d1e/f20 to d12/d18/db7/f114 0 2023-12-16T03:16:01.855 INFO:tasks.workunit.client.1.smithi184.stdout:3/740: readlink d12/d18/d1f/d23/d2a/lf7 0 2023-12-16T03:16:01.856 INFO:tasks.workunit.client.0.smithi064.stdout:1/327: write d3/dd/d11/f1f [677370,26114] 0 2023-12-16T03:16:01.856 INFO:tasks.workunit.client.1.smithi184.stdout:6/731: dwrite d0/d5/d22/d25/d3f/f78 [4194304,4194304] 0 2023-12-16T03:16:01.857 INFO:tasks.workunit.client.1.smithi184.stdout:6/732: read d0/d5/d22/d34/fb6 [325065,104977] 0 2023-12-16T03:16:01.857 INFO:tasks.workunit.client.0.smithi064.stdout:4/388: rmdir d0/d1e/d36 39 2023-12-16T03:16:01.857 INFO:tasks.workunit.client.0.smithi064.stdout:5/340: dwrite d0/d14/d20/f2f [0,4194304] 0 2023-12-16T03:16:01.858 INFO:tasks.workunit.client.0.smithi064.stdout:6/324: dwrite d3/d8/da/f37 [0,4194304] 0 2023-12-16T03:16:01.858 INFO:tasks.workunit.client.0.smithi064.stdout:4/389: write d0/d1e/f29 [7811769,106411] 0 2023-12-16T03:16:01.858 INFO:tasks.workunit.client.0.smithi064.stdout:4/390: truncate d0/da/f6d 956520 0 2023-12-16T03:16:01.860 INFO:tasks.workunit.client.1.smithi184.stdout:0/707: dread dc/d22/d45/d66/fae [0,4194304] 0 2023-12-16T03:16:01.860 INFO:tasks.workunit.client.1.smithi184.stdout:0/708: chown dc/dc9/cda 2950488 1 2023-12-16T03:16:01.860 INFO:tasks.workunit.client.1.smithi184.stdout:0/709: write dc/d22/d1d/d35/f38 [3601511,90655] 0 2023-12-16T03:16:01.860 INFO:tasks.workunit.client.1.smithi184.stdout:0/710: readlink dc/d22/d45/d66/d80/da3/lc1 0 2023-12-16T03:16:01.860 INFO:tasks.workunit.client.0.smithi064.stdout:7/365: write d7/f9 [826929,61361] 0 2023-12-16T03:16:01.862 INFO:tasks.workunit.client.0.smithi064.stdout:1/328: creat d3/d36/d44/d4d/f6b x:0 0 0 2023-12-16T03:16:01.863 INFO:tasks.workunit.client.0.smithi064.stdout:7/366: write d7/d3e/d42/d48/f49 [144047,42556] 0 2023-12-16T03:16:01.866 INFO:tasks.workunit.client.1.smithi184.stdout:4/640: symlink d1/d12/d13/lda 0 2023-12-16T03:16:01.868 INFO:tasks.workunit.client.0.smithi064.stdout:6/325: truncate d3/d8/da/fe 1618015 0 2023-12-16T03:16:01.873 INFO:tasks.workunit.client.1.smithi184.stdout:5/521: unlink d1/d3/d2f/l3c 0 2023-12-16T03:16:01.873 INFO:tasks.workunit.client.0.smithi064.stdout:5/341: dread d0/f6c [0,4194304] 0 2023-12-16T03:16:01.873 INFO:tasks.workunit.client.0.smithi064.stdout:5/342: fdatasync d0/d7/d34/f5c 0 2023-12-16T03:16:01.874 INFO:tasks.workunit.client.0.smithi064.stdout:8/393: dwrite d0/db/d12/f15 [0,4194304] 0 2023-12-16T03:16:01.874 INFO:tasks.workunit.client.0.smithi064.stdout:8/394: dread - d0/da/d16/f6e zero size 2023-12-16T03:16:01.874 INFO:tasks.workunit.client.0.smithi064.stdout:4/391: creat d0/d42/d66/f73 x:0 0 0 2023-12-16T03:16:01.875 INFO:tasks.workunit.client.1.smithi184.stdout:7/600: truncate d0/d3/d2e/d79/d32/d39/f70 3277361 0 2023-12-16T03:16:01.875 INFO:tasks.workunit.client.1.smithi184.stdout:7/601: chown d0/d3/d2e/d79/d36/d3f/f92 0 1 2023-12-16T03:16:01.877 INFO:tasks.workunit.client.0.smithi064.stdout:1/329: mknod d3/dd/c6c 0 2023-12-16T03:16:01.878 INFO:tasks.workunit.client.0.smithi064.stdout:1/330: chown d3/d22/f28 177139 1 2023-12-16T03:16:01.878 INFO:tasks.workunit.client.0.smithi064.stdout:1/331: write d3/dd/d23/d60/f63 [806916,7694] 0 2023-12-16T03:16:01.878 INFO:tasks.workunit.client.0.smithi064.stdout:1/332: write d3/d36/d44/f51 [685042,108398] 0 2023-12-16T03:16:01.882 INFO:tasks.workunit.client.1.smithi184.stdout:4/641: dread d1/f51 [0,4194304] 0 2023-12-16T03:16:01.883 INFO:tasks.workunit.client.1.smithi184.stdout:5/522: write d1/d3/d9/de/d15/d19/d5f/f4c [1120772,91506] 0 2023-12-16T03:16:01.883 INFO:tasks.workunit.client.0.smithi064.stdout:7/367: creat d7/d13/f6e x:0 0 0 2023-12-16T03:16:01.883 INFO:tasks.workunit.client.0.smithi064.stdout:7/368: stat d7/d3e/d42/d43/f5f 0 2023-12-16T03:16:01.883 INFO:tasks.workunit.client.0.smithi064.stdout:7/369: chown d7/d3e/d42/d48 21 1 2023-12-16T03:16:01.886 INFO:tasks.workunit.client.0.smithi064.stdout:5/343: dread d0/d7/f1d [0,4194304] 0 2023-12-16T03:16:01.886 INFO:tasks.workunit.client.0.smithi064.stdout:5/344: readlink d0/d14/d25/l55 0 2023-12-16T03:16:01.886 INFO:tasks.workunit.client.0.smithi064.stdout:5/345: write d0/d14/d25/d3e/d35/f54 [4276482,76381] 0 2023-12-16T03:16:01.886 INFO:tasks.workunit.client.0.smithi064.stdout:5/346: readlink d0/d14/d20/l22 0 2023-12-16T03:16:01.888 INFO:tasks.workunit.client.1.smithi184.stdout:3/741: mkdir d12/d18/da1/d115 0 2023-12-16T03:16:01.892 INFO:tasks.workunit.client.0.smithi064.stdout:4/392: dread d0/d42/d66/f30 [0,4194304] 0 2023-12-16T03:16:01.893 INFO:tasks.workunit.client.1.smithi184.stdout:6/733: dwrite d0/d36/d8a/fce [4194304,4194304] 0 2023-12-16T03:16:01.893 INFO:tasks.workunit.client.1.smithi184.stdout:6/734: dread - d0/d36/d8a/fde zero size 2023-12-16T03:16:01.909 INFO:tasks.workunit.client.1.smithi184.stdout:0/711: dwrite dc/d22/d1d/d2c/d75/ff0 [0,4194304] 0 2023-12-16T03:16:01.911 INFO:tasks.workunit.client.0.smithi064.stdout:8/395: dwrite d0/db/d12/d1c/f72 [0,4194304] 0 2023-12-16T03:16:01.911 INFO:tasks.workunit.client.0.smithi064.stdout:8/396: stat d0/db 0 2023-12-16T03:16:01.911 INFO:tasks.workunit.client.0.smithi064.stdout:8/397: dread - d0/da/f65 zero size 2023-12-16T03:16:01.911 INFO:tasks.workunit.client.0.smithi064.stdout:8/398: dread - d0/d1d/d24/d2f/f64 zero size 2023-12-16T03:16:01.911 INFO:tasks.workunit.client.0.smithi064.stdout:8/399: fdatasync d0/db/d12/d1c/f1f 0 2023-12-16T03:16:01.912 INFO:tasks.workunit.client.1.smithi184.stdout:7/602: dwrite d0/d6b/d69/fad [4194304,4194304] 0 2023-12-16T03:16:01.912 INFO:tasks.workunit.client.1.smithi184.stdout:5/523: dwrite d1/d3/d9/de/d30/d68/f76 [0,4194304] 0 2023-12-16T03:16:01.913 INFO:tasks.workunit.client.1.smithi184.stdout:3/742: dwrite d12/d18/d1f/d23/d2a/d42/d52/d76/d80/fde [0,4194304] 0 2023-12-16T03:16:01.916 INFO:tasks.workunit.client.1.smithi184.stdout:0/712: dread dc/d10/f25 [0,4194304] 0 2023-12-16T03:16:01.916 INFO:tasks.workunit.client.1.smithi184.stdout:0/713: truncate dc/d22/d1d/d2c/fea 857500 0 2023-12-16T03:16:01.918 INFO:tasks.workunit.client.0.smithi064.stdout:8/400: dread d0/db/d37/f43 [0,4194304] 0 2023-12-16T03:16:01.934 INFO:tasks.workunit.client.1.smithi184.stdout:7/603: dwrite d0/d3/d2e/d79/d32/d39/f48 [0,4194304] 0 2023-12-16T03:16:01.946 INFO:tasks.workunit.client.1.smithi184.stdout:7/604: dread d0/d3/d4/f5e [0,4194304] 0 2023-12-16T03:16:01.946 INFO:tasks.workunit.client.1.smithi184.stdout:0/714: dwrite dc/d22/d1d/d8e/fa4 [0,4194304] 0 2023-12-16T03:16:01.946 INFO:tasks.workunit.client.1.smithi184.stdout:0/715: write dc/d2a/ff2 [533023,91276] 0 2023-12-16T03:16:01.947 INFO:tasks.workunit.client.0.smithi064.stdout:8/401: dwrite d0/d1d/d3c/f7d [0,4194304] 0 2023-12-16T03:16:01.947 INFO:tasks.workunit.client.0.smithi064.stdout:8/402: readlink d0/d1d/d48/l51 0 2023-12-16T03:16:01.947 INFO:tasks.workunit.client.0.smithi064.stdout:8/403: chown d0/db/d12/d44 933 1 2023-12-16T03:16:01.954 INFO:tasks.workunit.client.0.smithi064.stdout:1/333: mknod d3/dd/d23/d41/c6d 0 2023-12-16T03:16:01.955 INFO:tasks.workunit.client.1.smithi184.stdout:4/642: creat d1/d12/db3/db8/fdb x:0 0 0 2023-12-16T03:16:01.958 INFO:tasks.workunit.client.0.smithi064.stdout:7/370: getdents d7 0 2023-12-16T03:16:01.963 INFO:tasks.workunit.client.1.smithi184.stdout:6/735: mknod d0/d5/d22/d25/d3f/d6f/da8/cec 0 2023-12-16T03:16:01.964 INFO:tasks.workunit.client.0.smithi064.stdout:8/404: dwrite d0/db/d12/f15 [0,4194304] 0 2023-12-16T03:16:01.967 INFO:tasks.workunit.client.0.smithi064.stdout:5/347: creat d0/d50/d39/f7c x:0 0 0 2023-12-16T03:16:01.967 INFO:tasks.workunit.client.0.smithi064.stdout:5/348: fdatasync d0/d50/f30 0 2023-12-16T03:16:01.967 INFO:tasks.workunit.client.0.smithi064.stdout:5/349: truncate d0/d14/d20/f3d 110739 0 2023-12-16T03:16:01.970 INFO:tasks.workunit.client.0.smithi064.stdout:4/393: symlink d0/d1e/d36/l74 0 2023-12-16T03:16:01.970 INFO:tasks.workunit.client.0.smithi064.stdout:4/394: dread - d0/d42/d53/f6b zero size 2023-12-16T03:16:01.970 INFO:tasks.workunit.client.0.smithi064.stdout:4/395: write d0/d42/f5c [4831415,47031] 0 2023-12-16T03:16:01.970 INFO:tasks.workunit.client.0.smithi064.stdout:4/396: fsync d0/d1e/f60 0 2023-12-16T03:16:01.976 INFO:tasks.workunit.client.1.smithi184.stdout:3/743: creat d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/f116 x:0 0 0 2023-12-16T03:16:01.976 INFO:tasks.workunit.client.1.smithi184.stdout:3/744: fdatasync d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f50 0 2023-12-16T03:16:01.976 INFO:tasks.workunit.client.1.smithi184.stdout:3/745: write d12/d1e/de8/d48/fc7 [904117,95719] 0 2023-12-16T03:16:01.976 INFO:tasks.workunit.client.1.smithi184.stdout:3/746: readlink d12/d18/d1f/d23/d2a/lf7 0 2023-12-16T03:16:01.977 INFO:tasks.workunit.client.1.smithi184.stdout:9/874: sync 2023-12-16T03:16:01.977 INFO:tasks.workunit.client.1.smithi184.stdout:9/875: write d0/d13/d20/d5b/d43/dc7/ddc/ff2 [836347,85513] 0 2023-12-16T03:16:01.977 INFO:tasks.workunit.client.1.smithi184.stdout:9/876: truncate d0/d13/d20/d5b/d43/dc7/ddc/dd8/d112/ff8 157319 0 2023-12-16T03:16:01.979 INFO:tasks.workunit.client.1.smithi184.stdout:3/747: dread d12/d37/d81/f87 [0,4194304] 0 2023-12-16T03:16:01.994 INFO:tasks.workunit.client.1.smithi184.stdout:9/877: dwrite d0/d30/ddf/f10a [0,4194304] 0 2023-12-16T03:16:01.994 INFO:tasks.workunit.client.1.smithi184.stdout:9/878: readlink d0/d76/db2/l107 0 2023-12-16T03:16:01.994 INFO:tasks.workunit.client.1.smithi184.stdout:9/879: chown d0/d13/l49 110920 1 2023-12-16T03:16:02.001 INFO:tasks.workunit.client.0.smithi064.stdout:8/405: symlink d0/d1d/d3c/l89 0 2023-12-16T03:16:02.003 INFO:tasks.workunit.client.0.smithi064.stdout:5/350: creat d0/f7d x:0 0 0 2023-12-16T03:16:02.003 INFO:tasks.workunit.client.0.smithi064.stdout:5/351: chown d0/d14/d25/l55 185108 1 2023-12-16T03:16:02.006 INFO:tasks.workunit.client.1.smithi184.stdout:7/605: creat d0/d3/d2e/d79/d34/fb1 x:0 0 0 2023-12-16T03:16:02.006 INFO:tasks.workunit.client.1.smithi184.stdout:9/880: dread d0/d30/f75 [0,4194304] 0 2023-12-16T03:16:02.006 INFO:tasks.workunit.client.0.smithi064.stdout:1/334: dwrite d3/d22/f68 [0,4194304] 0 2023-12-16T03:16:02.006 INFO:tasks.workunit.client.0.smithi064.stdout:1/335: fsync d3/dd/d23/d4f/f54 0 2023-12-16T03:16:02.007 INFO:tasks.workunit.client.1.smithi184.stdout:7/606: read d0/d3/d2e/d79/f2a [1077327,63669] 0 2023-12-16T03:16:02.007 INFO:tasks.workunit.client.1.smithi184.stdout:0/716: truncate dc/d10/d2d/d5f/d7a/f9f 642040 0 2023-12-16T03:16:02.009 INFO:tasks.workunit.client.1.smithi184.stdout:0/717: write dc/d22/d45/d66/d80/fb6 [3801239,45263] 0 2023-12-16T03:16:02.009 INFO:tasks.workunit.client.1.smithi184.stdout:4/643: creat d1/d11/fdc x:0 0 0 2023-12-16T03:16:02.011 INFO:tasks.workunit.client.1.smithi184.stdout:0/718: write dc/d22/d45/d66/d80/da3/f91 [1183419,11572] 0 2023-12-16T03:16:02.020 INFO:tasks.workunit.client.0.smithi064.stdout:8/406: dwrite d0/da/fc [0,4194304] 0 2023-12-16T03:16:02.020 INFO:tasks.workunit.client.0.smithi064.stdout:8/407: stat d0/d1d/d24/f36 0 2023-12-16T03:16:02.025 INFO:tasks.workunit.client.0.smithi064.stdout:7/371: unlink d7/d3e/d42/d48/f6b 0 2023-12-16T03:16:02.028 INFO:tasks.workunit.client.1.smithi184.stdout:6/736: mknod d0/d5/d22/d25/dbf/dbe/de1/ced 0 2023-12-16T03:16:02.033 INFO:tasks.workunit.client.1.smithi184.stdout:3/748: rename d12/d18/d7a to d12/d86/de4/d99/d117 0 2023-12-16T03:16:02.035 INFO:tasks.workunit.client.0.smithi064.stdout:1/336: rename d3/dd/d23/d60/f63 to d3/d36/d44/d4d/d58/f6e 0 2023-12-16T03:16:02.038 INFO:tasks.workunit.client.0.smithi064.stdout:8/408: creat d0/d1d/d3c/d40/f8a x:0 0 0 2023-12-16T03:16:02.038 INFO:tasks.workunit.client.0.smithi064.stdout:8/409: readlink d0/db/d12/d1c/l29 0 2023-12-16T03:16:02.041 INFO:tasks.workunit.client.0.smithi064.stdout:7/372: mkdir d7/d13/d20/d6f 0 2023-12-16T03:16:02.041 INFO:tasks.workunit.client.0.smithi064.stdout:7/373: readlink d7/d13/d20/l5a 0 2023-12-16T03:16:02.044 INFO:tasks.workunit.client.0.smithi064.stdout:8/410: creat d0/db/d12/d44/f8b x:0 0 0 2023-12-16T03:16:02.044 INFO:tasks.workunit.client.0.smithi064.stdout:8/411: write d0/db/d12/d44/f8b [435428,2549] 0 2023-12-16T03:16:02.049 INFO:tasks.workunit.client.1.smithi184.stdout:9/881: creat d0/d76/da2/d120/f129 x:0 0 0 2023-12-16T03:16:02.054 INFO:tasks.workunit.client.0.smithi064.stdout:4/397: fsync d0/d42/d66/f73 0 2023-12-16T03:16:02.054 INFO:tasks.workunit.client.0.smithi064.stdout:4/398: truncate d0/d42/d66/f5e 5160735 0 2023-12-16T03:16:02.054 INFO:tasks.workunit.client.0.smithi064.stdout:4/399: fdatasync d0/d42/d66/d33/f38 0 2023-12-16T03:16:02.055 INFO:tasks.workunit.client.1.smithi184.stdout:4/644: creat d1/d12/fdd x:0 0 0 2023-12-16T03:16:02.057 INFO:tasks.workunit.client.1.smithi184.stdout:7/607: rename d0/d3/f97 to d0/d3/d2e/d79/d36/d84/fb2 0 2023-12-16T03:16:02.059 INFO:tasks.workunit.client.0.smithi064.stdout:4/400: mkdir d0/d42/d66/d5a/d75 0 2023-12-16T03:16:02.061 INFO:tasks.workunit.client.0.smithi064.stdout:4/401: write d0/d1e/f37 [2255019,107888] 0 2023-12-16T03:16:02.063 INFO:tasks.workunit.client.1.smithi184.stdout:6/737: mkdir d0/dee 0 2023-12-16T03:16:02.063 INFO:tasks.workunit.client.1.smithi184.stdout:6/738: chown d0/d5/d12/d1b/f9b 60542 1 2023-12-16T03:16:02.065 INFO:tasks.workunit.client.1.smithi184.stdout:4/645: dread d1/d12/d13/f94 [0,4194304] 0 2023-12-16T03:16:02.065 INFO:tasks.workunit.client.1.smithi184.stdout:4/646: chown d1/l14 15785 1 2023-12-16T03:16:02.065 INFO:tasks.workunit.client.1.smithi184.stdout:7/608: creat d0/d3/d2e/d79/dd/d75/fb3 x:0 0 0 2023-12-16T03:16:02.065 INFO:tasks.workunit.client.1.smithi184.stdout:7/609: readlink d0/d3/l95 0 2023-12-16T03:16:02.067 INFO:tasks.workunit.client.1.smithi184.stdout:0/719: rename dc/d22/d1a/c4f to dc/d22/d45/d66/d80/da3/dcb/cfc 0 2023-12-16T03:16:02.069 INFO:tasks.workunit.client.0.smithi064.stdout:4/402: rename d0/d42/d66/d33/l3c to d0/l76 0 2023-12-16T03:16:02.069 INFO:tasks.workunit.client.0.smithi064.stdout:4/403: fsync d0/d1e/f29 0 2023-12-16T03:16:02.071 INFO:tasks.workunit.client.0.smithi064.stdout:4/404: symlink d0/d12/d48/l77 0 2023-12-16T03:16:02.071 INFO:tasks.workunit.client.0.smithi064.stdout:4/405: fdatasync d0/d42/d66/f73 0 2023-12-16T03:16:02.071 INFO:tasks.workunit.client.0.smithi064.stdout:4/406: readlink d0/d1e/l28 0 2023-12-16T03:16:02.071 INFO:tasks.workunit.client.1.smithi184.stdout:4/647: mknod d1/d12/d13/cde 0 2023-12-16T03:16:02.072 INFO:tasks.workunit.client.1.smithi184.stdout:7/610: symlink d0/d3/d2e/d79/d36/lb4 0 2023-12-16T03:16:02.072 INFO:tasks.workunit.client.1.smithi184.stdout:7/611: stat d0/d3/d2e/d79/d32/d39/d8f/fa0 0 2023-12-16T03:16:02.074 INFO:tasks.workunit.client.1.smithi184.stdout:6/739: symlink d0/d5/d22/d25/d3f/lef 0 2023-12-16T03:16:02.074 INFO:tasks.workunit.client.1.smithi184.stdout:6/740: dread - d0/d5/dd1/fe8 zero size 2023-12-16T03:16:02.075 INFO:tasks.workunit.client.1.smithi184.stdout:4/648: creat d1/d12/fdf x:0 0 0 2023-12-16T03:16:02.076 INFO:tasks.workunit.client.0.smithi064.stdout:1/337: dwrite d3/dd/d23/d41/f53 [0,4194304] 0 2023-12-16T03:16:02.076 INFO:tasks.workunit.client.0.smithi064.stdout:7/374: dwrite d7/d13/d20/f3a [0,4194304] 0 2023-12-16T03:16:02.076 INFO:tasks.workunit.client.1.smithi184.stdout:3/749: dwrite d12/d1e/fb6 [0,4194304] 0 2023-12-16T03:16:02.076 INFO:tasks.workunit.client.1.smithi184.stdout:0/720: dread dc/d10/d2d/d5f/fc2 [0,4194304] 0 2023-12-16T03:16:02.077 INFO:tasks.workunit.client.0.smithi064.stdout:4/407: write d0/d42/d4c/f62 [568834,68104] 0 2023-12-16T03:16:02.081 INFO:tasks.workunit.client.1.smithi184.stdout:9/882: dwrite d0/d13/d20/d5b/d43/dc7/ddc/dd8/d112/ff8 [0,4194304] 0 2023-12-16T03:16:02.083 INFO:tasks.workunit.client.0.smithi064.stdout:1/338: symlink d3/dd/d23/d41/l6f 0 2023-12-16T03:16:02.083 INFO:tasks.workunit.client.0.smithi064.stdout:8/412: dwrite d0/da/d16/f6e [0,4194304] 0 2023-12-16T03:16:02.083 INFO:tasks.workunit.client.0.smithi064.stdout:8/413: chown d0/da/d3e/l84 864 1 2023-12-16T03:16:02.086 INFO:tasks.workunit.client.0.smithi064.stdout:1/339: chown d3/d22/l46 35 1 2023-12-16T03:16:02.087 INFO:tasks.workunit.client.1.smithi184.stdout:6/741: rename d0/f31 to d0/d5/d22/d25/d47/ff0 0 2023-12-16T03:16:02.088 INFO:tasks.workunit.client.1.smithi184.stdout:9/883: read d0/d13/d20/d5b/d43/dc7/ddc/dd8/ff5 [105345,68498] 0 2023-12-16T03:16:02.088 INFO:tasks.workunit.client.1.smithi184.stdout:4/649: link d1/d29/d34/d5c/d76/d33/d4a/l8c d1/d29/le0 0 2023-12-16T03:16:02.091 INFO:tasks.workunit.client.0.smithi064.stdout:7/375: dread d7/d26/d30/f33 [0,4194304] 0 2023-12-16T03:16:02.091 INFO:tasks.workunit.client.0.smithi064.stdout:7/376: chown d7/d3e/d42/d48/f49 484689 1 2023-12-16T03:16:02.093 INFO:tasks.workunit.client.1.smithi184.stdout:6/742: dread d0/d5/d22/d25/d47/f8f [0,4194304] 0 2023-12-16T03:16:02.095 INFO:tasks.workunit.client.0.smithi064.stdout:8/414: dread d0/db/f76 [0,4194304] 0 2023-12-16T03:16:02.095 INFO:tasks.workunit.client.0.smithi064.stdout:7/377: symlink d7/d13/d20/d37/l70 0 2023-12-16T03:16:02.097 INFO:tasks.workunit.client.1.smithi184.stdout:9/884: mkdir d0/d13/d20/d5b/d12a 0 2023-12-16T03:16:02.097 INFO:tasks.workunit.client.1.smithi184.stdout:9/885: write d0/d13/d20/db0/f7c [356781,92685] 0 2023-12-16T03:16:02.097 INFO:tasks.workunit.client.0.smithi064.stdout:7/378: dread d7/d26/f27 [0,4194304] 0 2023-12-16T03:16:02.098 INFO:tasks.workunit.client.0.smithi064.stdout:8/415: rmdir d0/d1d/d73/d79 0 2023-12-16T03:16:02.098 INFO:tasks.workunit.client.0.smithi064.stdout:8/416: fdatasync d0/db/d12/f82 0 2023-12-16T03:16:02.100 INFO:tasks.workunit.client.0.smithi064.stdout:2/308: sync 2023-12-16T03:16:02.100 INFO:tasks.workunit.client.1.smithi184.stdout:4/650: rename d1/d11/d5a/d63/d72/l80 to d1/d29/d34/d5c/d76/d33/le1 0 2023-12-16T03:16:02.100 INFO:tasks.workunit.client.1.smithi184.stdout:4/651: chown d1/d29/d34/c35 603223322 1 2023-12-16T03:16:02.101 INFO:tasks.workunit.client.1.smithi184.stdout:9/886: unlink d0/c15 0 2023-12-16T03:16:02.101 INFO:tasks.workunit.client.1.smithi184.stdout:9/887: write d0/d13/d20/d5b/d43/dc7/ddc/fba [1037026,88031] 0 2023-12-16T03:16:02.101 INFO:tasks.workunit.client.1.smithi184.stdout:9/888: fdatasync d0/d76/da2/f104 0 2023-12-16T03:16:02.102 INFO:tasks.workunit.client.0.smithi064.stdout:8/417: unlink d0/db/d12/d1c/c1e 0 2023-12-16T03:16:02.103 INFO:tasks.workunit.client.0.smithi064.stdout:8/418: fdatasync d0/f27 0 2023-12-16T03:16:02.103 INFO:tasks.workunit.client.1.smithi184.stdout:3/750: dwrite d12/d18/d1f/d23/d2a/f53 [4194304,4194304] 0 2023-12-16T03:16:02.103 INFO:tasks.workunit.client.1.smithi184.stdout:3/751: readlink d12/d18/d1f/d23/d2a/d42/d52/d76/da5/lc0 0 2023-12-16T03:16:02.103 INFO:tasks.workunit.client.0.smithi064.stdout:2/309: truncate d1/f8 3301396 0 2023-12-16T03:16:02.105 INFO:tasks.workunit.client.1.smithi184.stdout:3/752: rmdir d12/d1e 39 2023-12-16T03:16:02.105 INFO:tasks.workunit.client.0.smithi064.stdout:8/419: write d0/db/d12/d1c/f1f [3828404,10486] 0 2023-12-16T03:16:02.106 INFO:tasks.workunit.client.1.smithi184.stdout:4/652: write d1/d12/db3/fb5 [2650547,125360] 0 2023-12-16T03:16:02.107 INFO:tasks.workunit.client.0.smithi064.stdout:2/310: rename d1/d15/d1e/d42 to d1/d15/d1b/d61 0 2023-12-16T03:16:02.107 INFO:tasks.workunit.client.0.smithi064.stdout:1/340: dread d3/dd/f1a [0,4194304] 0 2023-12-16T03:16:02.108 INFO:tasks.workunit.client.0.smithi064.stdout:1/341: write d3/dd/d23/d41/f4b [613063,77693] 0 2023-12-16T03:16:02.109 INFO:tasks.workunit.client.0.smithi064.stdout:1/342: write d3/dd/d23/d41/f53 [2396846,66092] 0 2023-12-16T03:16:02.109 INFO:tasks.workunit.client.1.smithi184.stdout:3/753: write d12/f1b [4020926,122374] 0 2023-12-16T03:16:02.110 INFO:tasks.workunit.client.1.smithi184.stdout:6/743: dwrite d0/d36/d79/f7c [0,4194304] 0 2023-12-16T03:16:02.110 INFO:tasks.workunit.client.1.smithi184.stdout:6/744: readlink d0/d5/d42/l95 0 2023-12-16T03:16:02.111 INFO:tasks.workunit.client.0.smithi064.stdout:2/311: truncate d1/f10 3955444 0 2023-12-16T03:16:02.114 INFO:tasks.workunit.client.0.smithi064.stdout:1/343: dread d3/fe [0,4194304] 0 2023-12-16T03:16:02.115 INFO:tasks.workunit.client.0.smithi064.stdout:1/344: dread d3/dd/d11/d3b/f69 [0,4194304] 0 2023-12-16T03:16:02.117 INFO:tasks.workunit.client.1.smithi184.stdout:4/653: creat d1/d12/d13/da1/fe2 x:0 0 0 2023-12-16T03:16:02.117 INFO:tasks.workunit.client.1.smithi184.stdout:8/720: sync 2023-12-16T03:16:02.117 INFO:tasks.workunit.client.1.smithi184.stdout:4/654: write d1/f93 [4406696,4082] 0 2023-12-16T03:16:02.117 INFO:tasks.workunit.client.1.smithi184.stdout:3/754: unlink d12/d1e/fff 0 2023-12-16T03:16:02.118 INFO:tasks.workunit.client.0.smithi064.stdout:2/312: write d1/f4 [535451,12300] 0 2023-12-16T03:16:02.122 INFO:tasks.workunit.client.1.smithi184.stdout:9/889: dwrite d0/f36 [0,4194304] 0 2023-12-16T03:16:02.124 INFO:tasks.workunit.client.0.smithi064.stdout:1/345: write d3/dd/d2a/f3d [2642942,104935] 0 2023-12-16T03:16:02.125 INFO:tasks.workunit.client.0.smithi064.stdout:2/313: rename d1/d15/d1e/f59 to d1/d15/d1e/d60/f62 0 2023-12-16T03:16:02.127 INFO:tasks.workunit.client.1.smithi184.stdout:0/721: write dc/d10/d2d/d5f/d7a/f9f [1668446,6256] 0 2023-12-16T03:16:02.128 INFO:tasks.workunit.client.1.smithi184.stdout:6/745: rename d0/d5/d22/d37/d4d/ccf to d0/d5/dd1/cf1 0 2023-12-16T03:16:02.128 INFO:tasks.workunit.client.1.smithi184.stdout:8/721: link d2/d4/d10/d11/d72/c9d d2/d4/d10/d2a/ce5 0 2023-12-16T03:16:02.128 INFO:tasks.workunit.client.1.smithi184.stdout:9/890: write d0/d13/d20/f28 [2946220,41465] 0 2023-12-16T03:16:02.128 INFO:tasks.workunit.client.1.smithi184.stdout:0/722: write dc/d22/d1d/d43/fb1 [1760951,88096] 0 2023-12-16T03:16:02.130 INFO:tasks.workunit.client.0.smithi064.stdout:8/420: dwrite d0/d1d/d3c/d40/f8a [0,4194304] 0 2023-12-16T03:16:02.134 INFO:tasks.workunit.client.1.smithi184.stdout:3/755: mknod d12/d86/de4/c118 0 2023-12-16T03:16:02.134 INFO:tasks.workunit.client.1.smithi184.stdout:3/756: truncate d12/d18/d1f/d23/d2a/d42/d52/d76/fd4 290595 0 2023-12-16T03:16:02.134 INFO:tasks.workunit.client.1.smithi184.stdout:6/746: dread d0/d5/d22/d25/d47/f73 [0,4194304] 0 2023-12-16T03:16:02.136 INFO:tasks.workunit.client.0.smithi064.stdout:2/314: unlink d1/d27/f29 0 2023-12-16T03:16:02.137 INFO:tasks.workunit.client.0.smithi064.stdout:2/315: chown d1/d15/d23/d2d 117256122 1 2023-12-16T03:16:02.137 INFO:tasks.workunit.client.1.smithi184.stdout:8/722: mkdir d2/d37/d7c/ddc/de6 0 2023-12-16T03:16:02.140 INFO:tasks.workunit.client.1.smithi184.stdout:9/891: read - d0/d76/db7/feb zero size 2023-12-16T03:16:02.142 INFO:tasks.workunit.client.1.smithi184.stdout:4/655: dwrite d1/d11/d1b/f9e [0,4194304] 0 2023-12-16T03:16:02.143 INFO:tasks.workunit.client.1.smithi184.stdout:1/653: sync 2023-12-16T03:16:02.143 INFO:tasks.workunit.client.1.smithi184.stdout:1/654: dread - d3/d34/dbc/d3c/f7c zero size 2023-12-16T03:16:02.143 INFO:tasks.workunit.client.1.smithi184.stdout:1/655: chown d3/d34/d39 821085 1 2023-12-16T03:16:02.143 INFO:tasks.workunit.client.1.smithi184.stdout:9/892: dread d0/d3a/d47/fa9 [0,4194304] 0 2023-12-16T03:16:02.144 INFO:tasks.workunit.client.0.smithi064.stdout:8/421: truncate d0/f2 1297228 0 2023-12-16T03:16:02.144 INFO:tasks.workunit.client.0.smithi064.stdout:8/422: dread - d0/da/d3e/f69 zero size 2023-12-16T03:16:02.146 INFO:tasks.workunit.client.0.smithi064.stdout:2/316: mkdir d1/d15/d1b/d61/d63 0 2023-12-16T03:16:02.152 INFO:tasks.workunit.client.0.smithi064.stdout:2/317: creat d1/d15/d1e/f64 x:0 0 0 2023-12-16T03:16:02.154 INFO:tasks.workunit.client.0.smithi064.stdout:2/318: truncate d1/d15/f1f 8676105 0 2023-12-16T03:16:02.156 INFO:tasks.workunit.client.0.smithi064.stdout:2/319: mknod d1/d15/c65 0 2023-12-16T03:16:02.156 INFO:tasks.workunit.client.0.smithi064.stdout:2/320: dread - d1/d27/f4f zero size 2023-12-16T03:16:02.158 INFO:tasks.workunit.client.1.smithi184.stdout:5/524: sync 2023-12-16T03:16:02.158 INFO:tasks.workunit.client.1.smithi184.stdout:2/567: sync 2023-12-16T03:16:02.158 INFO:tasks.workunit.client.1.smithi184.stdout:2/568: chown d3/d29/d4d/d5b 1 1 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.1.smithi184.stdout:2/569: fsync d3/d29/d2f/f22 0 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.1.smithi184.stdout:2/570: fsync d3/d29/d61/fb5 0 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.1.smithi184.stdout:2/571: truncate d3/f65 921049 0 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.1.smithi184.stdout:2/572: chown d3/d9/d19 0 1 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.1.smithi184.stdout:3/757: symlink d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/l119 0 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.1.smithi184.stdout:8/723: getdents d2/d4/d10 0 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.1.smithi184.stdout:0/723: mknod dc/d22/d1d/d35/dd8/cfd 0 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.1.smithi184.stdout:0/724: fdatasync dc/d22/d1d/d2c/f74 0 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.0.smithi064.stdout:2/321: rename d1/d27/d35/c41 to d1/d15/d23/d2d/c66 0 2023-12-16T03:16:02.159 INFO:tasks.workunit.client.0.smithi064.stdout:2/322: truncate d1/d15/d23/d2d/f5c 931159 0 2023-12-16T03:16:02.163 INFO:tasks.workunit.client.1.smithi184.stdout:4/656: symlink d1/d12/d13/d40/d43/d45/dcf/le3 0 2023-12-16T03:16:02.163 INFO:tasks.workunit.client.1.smithi184.stdout:1/656: dread d3/d34/dbc/d36/f9b [0,4194304] 0 2023-12-16T03:16:02.163 INFO:tasks.workunit.client.1.smithi184.stdout:8/724: write d2/d4/d10/d75/fa5 [139263,31524] 0 2023-12-16T03:16:02.165 INFO:tasks.workunit.client.1.smithi184.stdout:3/758: dread d12/d1e/de8/d48/f88 [0,4194304] 0 2023-12-16T03:16:02.167 INFO:tasks.workunit.client.1.smithi184.stdout:1/657: write d3/d34/dbc/f44 [1545973,117303] 0 2023-12-16T03:16:02.167 INFO:tasks.workunit.client.1.smithi184.stdout:1/658: read - d3/d34/dbc/d3c/d41/d46/fd0 zero size 2023-12-16T03:16:02.168 INFO:tasks.workunit.client.0.smithi064.stdout:1/346: write d3/d36/d44/d4d/d58/f6e [4568494,103812] 0 2023-12-16T03:16:02.168 INFO:tasks.workunit.client.1.smithi184.stdout:4/657: dread d1/d12/d13/d40/d43/d5e/f83 [0,4194304] 0 2023-12-16T03:16:02.169 INFO:tasks.workunit.client.1.smithi184.stdout:4/658: fsync d1/f51 0 2023-12-16T03:16:02.169 INFO:tasks.workunit.client.1.smithi184.stdout:4/659: write d1/d12/d13/d40/d43/d5e/d6a/f97 [603030,85824] 0 2023-12-16T03:16:02.169 INFO:tasks.workunit.client.1.smithi184.stdout:4/660: chown d1/d11/f7a 242 1 2023-12-16T03:16:02.170 INFO:tasks.workunit.client.1.smithi184.stdout:6/747: mkdir d0/d5/d12/df2 0 2023-12-16T03:16:02.170 INFO:tasks.workunit.client.1.smithi184.stdout:0/725: mkdir dc/d10/d1c/dfe 0 2023-12-16T03:16:02.172 INFO:tasks.workunit.client.1.smithi184.stdout:8/725: creat d2/d12/d21/d8a/dda/d73/fe7 x:0 0 0 2023-12-16T03:16:02.172 INFO:tasks.workunit.client.1.smithi184.stdout:8/726: chown d2/d6a/lb0 11 1 2023-12-16T03:16:02.172 INFO:tasks.workunit.client.1.smithi184.stdout:1/659: write d3/d34/dbc/d3c/d41/d46/f8c [511764,42169] 0 2023-12-16T03:16:02.172 INFO:tasks.workunit.client.1.smithi184.stdout:3/759: creat d12/d18/d1f/d23/d2a/d4a/d61/f11a x:0 0 0 2023-12-16T03:16:02.173 INFO:tasks.workunit.client.1.smithi184.stdout:3/760: write d12/d18/d1f/d23/d2a/d42/d52/f6f [776785,103402] 0 2023-12-16T03:16:02.173 INFO:tasks.workunit.client.1.smithi184.stdout:4/661: creat d1/d12/db3/db8/dd0/fe4 x:0 0 0 2023-12-16T03:16:02.174 INFO:tasks.workunit.client.0.smithi064.stdout:1/347: write d3/dd/d23/d41/f53 [4144677,9241] 0 2023-12-16T03:16:02.174 INFO:tasks.workunit.client.0.smithi064.stdout:1/348: write d3/fe [144088,19805] 0 2023-12-16T03:16:02.174 INFO:tasks.workunit.client.1.smithi184.stdout:4/662: write d1/d12/d13/f94 [1442056,66191] 0 2023-12-16T03:16:02.174 INFO:tasks.workunit.client.1.smithi184.stdout:4/663: dread - d1/d11/d5a/d63/fbd zero size 2023-12-16T03:16:02.176 INFO:tasks.workunit.client.1.smithi184.stdout:6/748: rename d0/d5/d12/d1b/d33/d3d/d96/ca1 to d0/d5/d22/d37/d45/d90/cf3 0 2023-12-16T03:16:02.176 INFO:tasks.workunit.client.1.smithi184.stdout:6/749: dread - d0/d5/d22/d37/d4d/f5d zero size 2023-12-16T03:16:02.178 INFO:tasks.workunit.client.1.smithi184.stdout:8/727: mkdir d2/d12/d21/d2d/d31/d34/d96/dca/de8 0 2023-12-16T03:16:02.182 INFO:tasks.workunit.client.1.smithi184.stdout:3/761: truncate d12/d18/d1f/d23/d2a/d42/d52/d76/d80/fde 2227372 0 2023-12-16T03:16:02.183 INFO:tasks.workunit.client.1.smithi184.stdout:4/664: creat d1/d12/db3/fe5 x:0 0 0 2023-12-16T03:16:02.184 INFO:tasks.workunit.client.0.smithi064.stdout:3/376: sync 2023-12-16T03:16:02.186 INFO:tasks.workunit.client.0.smithi064.stdout:3/377: unlink db/d12/d21/f5c 0 2023-12-16T03:16:02.188 INFO:tasks.workunit.client.0.smithi064.stdout:3/378: mknod db/d12/d1a/d31/c7e 0 2023-12-16T03:16:02.188 INFO:tasks.workunit.client.0.smithi064.stdout:3/379: readlink db/d13/l60 0 2023-12-16T03:16:02.188 INFO:tasks.workunit.client.0.smithi064.stdout:3/380: chown db/d12/l55 1101 1 2023-12-16T03:16:02.191 INFO:tasks.workunit.client.1.smithi184.stdout:4/665: dread d1/d29/d34/d5c/d76/d33/f96 [0,4194304] 0 2023-12-16T03:16:02.191 INFO:tasks.workunit.client.1.smithi184.stdout:1/660: dread d3/d34/dbc/d3c/d41/d46/d4a/fad [0,4194304] 0 2023-12-16T03:16:02.191 INFO:tasks.workunit.client.1.smithi184.stdout:1/661: truncate d3/d34/dbc/d3c/d41/d77/fa3 1402007 0 2023-12-16T03:16:02.191 INFO:tasks.workunit.client.1.smithi184.stdout:9/893: dwrite d0/d13/f2a [0,4194304] 0 2023-12-16T03:16:02.191 INFO:tasks.workunit.client.1.smithi184.stdout:4/666: mkdir d1/d12/d13/d40/d43/d45/dcf/de6 0 2023-12-16T03:16:02.192 INFO:tasks.workunit.client.1.smithi184.stdout:1/662: link d3/d34/dbc/d3c/d41/d77/c7b d3/d34/dbc/d3c/d41/d46/d4a/cdd 0 2023-12-16T03:16:02.192 INFO:tasks.workunit.client.0.smithi064.stdout:8/423: dwrite d0/db/d12/d1c/f1f [0,4194304] 0 2023-12-16T03:16:02.195 INFO:tasks.workunit.client.1.smithi184.stdout:9/894: creat d0/d3a/d121/f12b x:0 0 0 2023-12-16T03:16:02.196 INFO:tasks.workunit.client.1.smithi184.stdout:9/895: fsync d0/d13/d20/d5b/f56 0 2023-12-16T03:16:02.196 INFO:tasks.workunit.client.1.smithi184.stdout:9/896: readlink d0/d76/db7/d100/l122 0 2023-12-16T03:16:02.196 INFO:tasks.workunit.client.1.smithi184.stdout:6/750: dread d0/d5/f1f [0,4194304] 0 2023-12-16T03:16:02.198 INFO:tasks.workunit.client.1.smithi184.stdout:1/663: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fde x:0 0 0 2023-12-16T03:16:02.200 INFO:tasks.workunit.client.0.smithi064.stdout:3/381: dread db/d12/d21/f30 [0,4194304] 0 2023-12-16T03:16:02.200 INFO:tasks.workunit.client.0.smithi064.stdout:3/382: readlink db/d12/d1a/d2c/d34/d4c/l52 0 2023-12-16T03:16:02.201 INFO:tasks.workunit.client.1.smithi184.stdout:8/728: dread d2/d12/d21/d8a/fb2 [0,4194304] 0 2023-12-16T03:16:02.203 INFO:tasks.workunit.client.1.smithi184.stdout:6/751: dread d0/d5/d12/f1c [4194304,4194304] 0 2023-12-16T03:16:02.203 INFO:tasks.workunit.client.1.smithi184.stdout:6/752: truncate d0/d5/d42/f80 3344272 0 2023-12-16T03:16:02.204 INFO:tasks.workunit.client.0.smithi064.stdout:8/424: mkdir d0/da/d3e/d46/d54/d8c 0 2023-12-16T03:16:02.207 INFO:tasks.workunit.client.1.smithi184.stdout:5/525: dwrite d1/d3/fa [4194304,4194304] 0 2023-12-16T03:16:02.207 INFO:tasks.workunit.client.1.smithi184.stdout:5/526: write d1/d2a/d31/f54 [4323351,58072] 0 2023-12-16T03:16:02.207 INFO:tasks.workunit.client.1.smithi184.stdout:5/527: chown d1/d3/d9/de/d15/d19/d5f/d45/l9e 0 1 2023-12-16T03:16:02.207 INFO:tasks.workunit.client.0.smithi064.stdout:3/383: readlink db/d12/d1a/l2a 0 2023-12-16T03:16:02.208 INFO:tasks.workunit.client.1.smithi184.stdout:2/573: dwrite d3/d13/d28/f2c [0,4194304] 0 2023-12-16T03:16:02.208 INFO:tasks.workunit.client.1.smithi184.stdout:2/574: chown d3/d13/d28/dac/daf/cbd 2 1 2023-12-16T03:16:02.209 INFO:tasks.workunit.client.0.smithi064.stdout:1/349: dwrite d3/dd/d11/d3b/f3e [0,4194304] 0 2023-12-16T03:16:02.209 INFO:tasks.workunit.client.1.smithi184.stdout:8/729: link d2/d4/f2e d2/d37/db8/fe9 0 2023-12-16T03:16:02.211 INFO:tasks.workunit.client.1.smithi184.stdout:5/528: write d1/d3/d9/de/d15/f61 [347975,73866] 0 2023-12-16T03:16:02.211 INFO:tasks.workunit.client.1.smithi184.stdout:6/753: creat d0/d5/d22/d25/d3f/d6f/ff4 x:0 0 0 2023-12-16T03:16:02.211 INFO:tasks.workunit.client.1.smithi184.stdout:6/754: fsync d0/d5/d12/d1b/d33/d3d/d96/fe5 0 2023-12-16T03:16:02.211 INFO:tasks.workunit.client.1.smithi184.stdout:5/529: write d1/d3/f62 [949438,50113] 0 2023-12-16T03:16:02.211 INFO:tasks.workunit.client.1.smithi184.stdout:5/530: chown d1/d3/d9/de/d15/d19/f2c 1657 1 2023-12-16T03:16:02.213 INFO:tasks.workunit.client.1.smithi184.stdout:8/730: write d2/d6a/f74 [681041,63071] 0 2023-12-16T03:16:02.215 INFO:tasks.workunit.client.1.smithi184.stdout:3/762: dwrite d12/d18/f71 [0,4194304] 0 2023-12-16T03:16:02.216 INFO:tasks.workunit.client.0.smithi064.stdout:1/350: mknod d3/dd/d11/c70 0 2023-12-16T03:16:02.216 INFO:tasks.workunit.client.0.smithi064.stdout:1/351: chown d3/fe 28 1 2023-12-16T03:16:02.218 INFO:tasks.workunit.client.0.smithi064.stdout:1/352: symlink d3/dd/d23/d41/l71 0 2023-12-16T03:16:02.221 INFO:tasks.workunit.client.1.smithi184.stdout:2/575: symlink d3/d13/d28/lbf 0 2023-12-16T03:16:02.221 INFO:tasks.workunit.client.1.smithi184.stdout:4/667: dwrite d1/d12/f3e [4194304,4194304] 0 2023-12-16T03:16:02.223 INFO:tasks.workunit.client.0.smithi064.stdout:1/353: write d3/f26 [135188,40540] 0 2023-12-16T03:16:02.223 INFO:tasks.workunit.client.0.smithi064.stdout:1/354: chown d3/d36/d44/d4d/f3f 45100 1 2023-12-16T03:16:02.227 INFO:tasks.workunit.client.1.smithi184.stdout:6/755: dread d0/d5/d26/f82 [0,4194304] 0 2023-12-16T03:16:02.227 INFO:tasks.workunit.client.1.smithi184.stdout:6/756: write d0/d5/d22/d37/d4d/fdb [228082,65118] 0 2023-12-16T03:16:02.229 INFO:tasks.workunit.client.1.smithi184.stdout:3/763: unlink d12/d86/fc5 0 2023-12-16T03:16:02.230 INFO:tasks.workunit.client.1.smithi184.stdout:3/764: chown d12/d18/d1f/d23/d2a/d42/d52/d76/c10e 12102459 1 2023-12-16T03:16:02.230 INFO:tasks.workunit.client.1.smithi184.stdout:8/731: dread d2/d12/f58 [0,4194304] 0 2023-12-16T03:16:02.237 INFO:tasks.workunit.client.1.smithi184.stdout:2/576: link d3/d13/d28/d83/la5 d3/d9/d19/d87/lc0 0 2023-12-16T03:16:02.238 INFO:tasks.workunit.client.1.smithi184.stdout:4/668: rmdir d1/d29/d34/d5c/d76/d33/d4a 39 2023-12-16T03:16:02.241 INFO:tasks.workunit.client.1.smithi184.stdout:5/531: dwrite d1/d3/d9/d49/d74/fa6 [0,4194304] 0 2023-12-16T03:16:02.241 INFO:tasks.workunit.client.1.smithi184.stdout:9/897: dwrite d0/f1f [8388608,4194304] 0 2023-12-16T03:16:02.248 INFO:tasks.workunit.client.1.smithi184.stdout:0/726: write dc/f58 [1574740,75416] 0 2023-12-16T03:16:02.249 INFO:tasks.workunit.client.1.smithi184.stdout:0/727: truncate dc/d22/d1d/fe4 685172 0 2023-12-16T03:16:02.249 INFO:tasks.workunit.client.1.smithi184.stdout:2/577: dread d3/fd [4194304,4194304] 0 2023-12-16T03:16:02.251 INFO:tasks.workunit.client.0.smithi064.stdout:3/384: dwrite db/f16 [0,4194304] 0 2023-12-16T03:16:02.253 INFO:tasks.workunit.client.1.smithi184.stdout:4/669: dread d1/d12/f3e [0,4194304] 0 2023-12-16T03:16:02.253 INFO:tasks.workunit.client.1.smithi184.stdout:4/670: write d1/d29/d34/d5c/d76/f8f [178160,74196] 0 2023-12-16T03:16:02.253 INFO:tasks.workunit.client.1.smithi184.stdout:4/671: truncate d1/d12/db3/fe5 178221 0 2023-12-16T03:16:02.253 INFO:tasks.workunit.client.0.smithi064.stdout:2/323: rename d1/d27/d35 to d1/d15/d67 0 2023-12-16T03:16:02.260 INFO:tasks.workunit.client.0.smithi064.stdout:8/425: rename d0/db/c49 to d0/db/d37/d3a/d6f/c8d 0 2023-12-16T03:16:02.260 INFO:tasks.workunit.client.0.smithi064.stdout:1/355: rename d3/d22 to d3/d22/d57/d72 22 2023-12-16T03:16:02.260 INFO:tasks.workunit.client.0.smithi064.stdout:8/426: write d0/db/d37/d3a/f57 [1795693,127800] 0 2023-12-16T03:16:02.263 INFO:tasks.workunit.client.1.smithi184.stdout:6/757: link d0/d5/d22/d25/d3f/lef d0/d5/d12/d1b/d33/d3d/d96/lf5 0 2023-12-16T03:16:02.267 INFO:tasks.workunit.client.1.smithi184.stdout:3/765: mknod d12/d18/d1f/d23/d2a/d42/d52/d76/da5/c11b 0 2023-12-16T03:16:02.268 INFO:tasks.workunit.client.1.smithi184.stdout:8/732: mknod d2/d4/d10/d7a/d83/cea 0 2023-12-16T03:16:02.268 INFO:tasks.workunit.client.1.smithi184.stdout:5/532: dwrite d1/d2a/d64/f8a [0,4194304] 0 2023-12-16T03:16:02.268 INFO:tasks.workunit.client.1.smithi184.stdout:5/533: fsync d1/d3/d9/de/d15/d19/d5f/d45/f9f 0 2023-12-16T03:16:02.268 INFO:tasks.workunit.client.1.smithi184.stdout:5/534: stat d1/d3/d9/f40 0 2023-12-16T03:16:02.268 INFO:tasks.workunit.client.1.smithi184.stdout:5/535: write d1/d2a/d31/f63 [971153,67041] 0 2023-12-16T03:16:02.276 INFO:tasks.workunit.client.1.smithi184.stdout:4/672: rmdir d1/d12/d13/d40/d43/d45/dcf 39 2023-12-16T03:16:02.277 INFO:tasks.workunit.client.1.smithi184.stdout:3/766: creat d12/d18/d1f/d23/f11c x:0 0 0 2023-12-16T03:16:02.277 INFO:tasks.workunit.client.1.smithi184.stdout:3/767: stat d12/d37/d81/l9c 0 2023-12-16T03:16:02.279 INFO:tasks.workunit.client.1.smithi184.stdout:2/578: mknod d3/d13/cc1 0 2023-12-16T03:16:02.279 INFO:tasks.workunit.client.1.smithi184.stdout:2/579: readlink d3/d29/d4d/d5b/l5c 0 2023-12-16T03:16:02.280 INFO:tasks.workunit.client.1.smithi184.stdout:2/580: chown d3/d29/d61/d6d 23 1 2023-12-16T03:16:02.282 INFO:tasks.workunit.client.0.smithi064.stdout:8/427: dread d0/f7 [0,4194304] 0 2023-12-16T03:16:02.283 INFO:tasks.workunit.client.1.smithi184.stdout:8/733: mkdir d2/d37/d7c/ddc/de6/deb 0 2023-12-16T03:16:02.283 INFO:tasks.workunit.client.1.smithi184.stdout:4/673: creat d1/d11/fe7 x:0 0 0 2023-12-16T03:16:02.283 INFO:tasks.workunit.client.1.smithi184.stdout:4/674: fsync d1/d29/d34/f9c 0 2023-12-16T03:16:02.283 INFO:tasks.workunit.client.1.smithi184.stdout:3/768: mkdir d12/d18/da1/d115/d11d 0 2023-12-16T03:16:02.285 INFO:tasks.workunit.client.1.smithi184.stdout:2/581: mknod d3/d29/d2f/d46/d77/cc2 0 2023-12-16T03:16:02.288 INFO:tasks.workunit.client.1.smithi184.stdout:8/734: truncate d2/d4/d10/d11/f29 2071549 0 2023-12-16T03:16:02.288 INFO:tasks.workunit.client.1.smithi184.stdout:8/735: stat d2/d4/d10/d7a/d83/d8b/fab 0 2023-12-16T03:16:02.288 INFO:tasks.workunit.client.1.smithi184.stdout:8/736: truncate d2/d12/db4/fb9 1386322 0 2023-12-16T03:16:02.289 INFO:tasks.workunit.client.1.smithi184.stdout:4/675: symlink d1/d12/db3/db8/dd0/le8 0 2023-12-16T03:16:02.290 INFO:tasks.workunit.client.1.smithi184.stdout:3/769: mknod d12/d18/da1/d115/d11d/c11e 0 2023-12-16T03:16:02.290 INFO:tasks.workunit.client.0.smithi064.stdout:2/324: dwrite d1/f3a [0,4194304] 0 2023-12-16T03:16:02.294 INFO:tasks.workunit.client.1.smithi184.stdout:0/728: dwrite dc/d22/d45/d66/d80/da3/dcb/fce [0,4194304] 0 2023-12-16T03:16:02.295 INFO:tasks.workunit.client.1.smithi184.stdout:0/729: read - dc/d10/d2d/d5f/d7a/f9d zero size 2023-12-16T03:16:02.295 INFO:tasks.workunit.client.1.smithi184.stdout:3/770: rmdir d12/d37 39 2023-12-16T03:16:02.295 INFO:tasks.workunit.client.1.smithi184.stdout:3/771: write d12/d18/d84/fec [265108,126173] 0 2023-12-16T03:16:02.295 INFO:tasks.workunit.client.0.smithi064.stdout:2/325: truncate d1/f6 2160497 0 2023-12-16T03:16:02.297 INFO:tasks.workunit.client.1.smithi184.stdout:0/730: symlink dc/d22/d1d/d35/lff 0 2023-12-16T03:16:02.298 INFO:tasks.workunit.client.1.smithi184.stdout:3/772: creat d12/d18/d1f/d23/d51/dd7/f11f x:0 0 0 2023-12-16T03:16:02.299 INFO:tasks.workunit.client.1.smithi184.stdout:3/773: chown d12/d18/db7 309078 1 2023-12-16T03:16:02.302 INFO:tasks.workunit.client.1.smithi184.stdout:3/774: symlink d12/d1e/d89/l120 0 2023-12-16T03:16:02.305 INFO:tasks.workunit.client.1.smithi184.stdout:3/775: creat d12/d18/d1f/d23/d2a/d42/f121 x:0 0 0 2023-12-16T03:16:02.305 INFO:tasks.workunit.client.1.smithi184.stdout:3/776: fdatasync d12/f1b 0 2023-12-16T03:16:02.305 INFO:tasks.workunit.client.1.smithi184.stdout:3/777: readlink d12/d18/d68/l105 0 2023-12-16T03:16:02.307 INFO:tasks.workunit.client.1.smithi184.stdout:4/676: dread d1/f93 [0,4194304] 0 2023-12-16T03:16:02.307 INFO:tasks.workunit.client.1.smithi184.stdout:4/677: truncate d1/d29/d34/f9c 4242562 0 2023-12-16T03:16:02.307 INFO:tasks.workunit.client.1.smithi184.stdout:4/678: fdatasync d1/d11/d1b/d1e/f57 0 2023-12-16T03:16:02.307 INFO:tasks.workunit.client.1.smithi184.stdout:4/679: write d1/d12/d13/d40/d43/d5e/fba [628018,58740] 0 2023-12-16T03:16:02.307 INFO:tasks.workunit.client.1.smithi184.stdout:3/778: mknod d12/d37/c122 0 2023-12-16T03:16:02.309 INFO:tasks.workunit.client.1.smithi184.stdout:2/582: rmdir d3/d13/d28 39 2023-12-16T03:16:02.309 INFO:tasks.workunit.client.1.smithi184.stdout:2/583: readlink d3/l52 0 2023-12-16T03:16:02.313 INFO:tasks.workunit.client.1.smithi184.stdout:2/584: write d3/d29/d8a/f94 [2789993,95362] 0 2023-12-16T03:16:02.315 INFO:tasks.workunit.client.1.smithi184.stdout:4/680: write d1/d29/d34/d5c/d76/f32 [664462,56167] 0 2023-12-16T03:16:02.315 INFO:tasks.workunit.client.1.smithi184.stdout:2/585: symlink d3/d9/d19/d87/lc3 0 2023-12-16T03:16:02.315 INFO:tasks.workunit.client.1.smithi184.stdout:5/536: dwrite d1/d3/fa [0,4194304] 0 2023-12-16T03:16:02.316 INFO:tasks.workunit.client.0.smithi064.stdout:3/385: dwrite db/d13/f25 [0,4194304] 0 2023-12-16T03:16:02.316 INFO:tasks.workunit.client.0.smithi064.stdout:3/386: fsync db/d13/d39/f78 0 2023-12-16T03:16:02.316 INFO:tasks.workunit.client.0.smithi064.stdout:3/387: read - db/d12/d1a/d2c/d34/d4c/d6a/f6c zero size 2023-12-16T03:16:02.318 INFO:tasks.workunit.client.0.smithi064.stdout:3/388: truncate db/d12/d1a/d2c/d34/d4c/f63 14580 0 2023-12-16T03:16:02.319 INFO:tasks.workunit.client.1.smithi184.stdout:4/681: creat d1/d12/db3/db8/dd2/fe9 x:0 0 0 2023-12-16T03:16:02.321 INFO:tasks.workunit.client.0.smithi064.stdout:0/309: sync 2023-12-16T03:16:02.321 INFO:tasks.workunit.client.0.smithi064.stdout:4/408: sync 2023-12-16T03:16:02.321 INFO:tasks.workunit.client.0.smithi064.stdout:9/351: sync 2023-12-16T03:16:02.322 INFO:tasks.workunit.client.0.smithi064.stdout:6/326: sync 2023-12-16T03:16:02.322 INFO:tasks.workunit.client.0.smithi064.stdout:5/352: sync 2023-12-16T03:16:02.322 INFO:tasks.workunit.client.0.smithi064.stdout:4/409: fdatasync d0/da/f6f 0 2023-12-16T03:16:02.322 INFO:tasks.workunit.client.0.smithi064.stdout:9/352: truncate d2/dc/f11 5561108 0 2023-12-16T03:16:02.322 INFO:tasks.workunit.client.1.smithi184.stdout:2/586: link d3/d29/d2f/d2e/l9e d3/d13/d6e/lc4 0 2023-12-16T03:16:02.324 INFO:tasks.workunit.client.0.smithi064.stdout:0/310: read d2/d7/f23 [1484695,130228] 0 2023-12-16T03:16:02.324 INFO:tasks.workunit.client.0.smithi064.stdout:6/327: symlink d3/d9/l59 0 2023-12-16T03:16:02.327 INFO:tasks.workunit.client.0.smithi064.stdout:9/353: creat d2/dc/d24/d39/d5e/d6f/f70 x:0 0 0 2023-12-16T03:16:02.329 INFO:tasks.workunit.client.1.smithi184.stdout:5/537: creat d1/d3/d9/de/d30/fab x:0 0 0 2023-12-16T03:16:02.330 INFO:tasks.workunit.client.0.smithi064.stdout:0/311: truncate d2/f5 1381672 0 2023-12-16T03:16:02.332 INFO:tasks.workunit.client.1.smithi184.stdout:4/682: mkdir d1/d12/d13/d40/d43/d45/dcf/dea 0 2023-12-16T03:16:02.332 INFO:tasks.workunit.client.0.smithi064.stdout:6/328: creat d3/d8/d1f/f5a x:0 0 0 2023-12-16T03:16:02.332 INFO:tasks.workunit.client.0.smithi064.stdout:6/329: fdatasync d3/d8/d13/d46/f50 0 2023-12-16T03:16:02.334 INFO:tasks.workunit.client.0.smithi064.stdout:8/428: dwrite d0/d1d/d24/d2f/d50/f87 [0,4194304] 0 2023-12-16T03:16:02.336 INFO:tasks.workunit.client.0.smithi064.stdout:1/356: dwrite d3/d22/f68 [0,4194304] 0 2023-12-16T03:16:02.336 INFO:tasks.workunit.client.0.smithi064.stdout:9/354: dread d2/d2d/d3b/d3c/d4b/f4c [0,4194304] 0 2023-12-16T03:16:02.336 INFO:tasks.workunit.client.0.smithi064.stdout:1/357: write d3/dd/d11/d2f/f64 [82922,89938] 0 2023-12-16T03:16:02.336 INFO:tasks.workunit.client.0.smithi064.stdout:6/330: mknod d3/d8/d1f/c5b 0 2023-12-16T03:16:02.337 INFO:tasks.workunit.client.0.smithi064.stdout:0/312: dread d2/d8/f40 [0,4194304] 0 2023-12-16T03:16:02.337 INFO:tasks.workunit.client.1.smithi184.stdout:2/587: rmdir d3/d9/d19 39 2023-12-16T03:16:02.340 INFO:tasks.workunit.client.1.smithi184.stdout:6/758: dwrite d0/d5/d12/d1b/f4c [4194304,4194304] 0 2023-12-16T03:16:02.341 INFO:tasks.workunit.client.1.smithi184.stdout:5/538: creat d1/d2a/fac x:0 0 0 2023-12-16T03:16:02.341 INFO:tasks.workunit.client.1.smithi184.stdout:5/539: truncate d1/d3/d9/d49/d74/f75 390596 0 2023-12-16T03:16:02.342 INFO:tasks.workunit.client.1.smithi184.stdout:7/612: sync 2023-12-16T03:16:02.345 INFO:tasks.workunit.client.0.smithi064.stdout:8/429: rename d0/f60 to d0/d1d/d3c/f8e 0 2023-12-16T03:16:02.346 INFO:tasks.workunit.client.1.smithi184.stdout:4/683: symlink d1/d29/d34/d5c/d76/d42/leb 0 2023-12-16T03:16:02.346 INFO:tasks.workunit.client.1.smithi184.stdout:4/684: dread - d1/d12/d13/d40/d43/d5e/fd9 zero size 2023-12-16T03:16:02.348 INFO:tasks.workunit.client.0.smithi064.stdout:1/358: mknod d3/dd/d11/d2f/c73 0 2023-12-16T03:16:02.348 INFO:tasks.workunit.client.1.smithi184.stdout:3/779: dwrite d12/d18/d1f/d23/d2a/d36/f5b [4194304,4194304] 0 2023-12-16T03:16:02.349 INFO:tasks.workunit.client.0.smithi064.stdout:9/355: write d2/dc/ff [6189782,19180] 0 2023-12-16T03:16:02.349 INFO:tasks.workunit.client.0.smithi064.stdout:9/356: rename d2/dc to d2/dc/d24/d39/d71 22 2023-12-16T03:16:02.349 INFO:tasks.workunit.client.0.smithi064.stdout:9/357: stat d2/d2d/d6b 0 2023-12-16T03:16:02.351 INFO:tasks.workunit.client.0.smithi064.stdout:1/359: write d3/dd/d11/f17 [3029547,25] 0 2023-12-16T03:16:02.351 INFO:tasks.workunit.client.0.smithi064.stdout:6/331: creat d3/d8/d13/d58/f5c x:0 0 0 2023-12-16T03:16:02.355 INFO:tasks.workunit.client.0.smithi064.stdout:9/358: write d2/d2d/d3b/d3c/d34/f45 [305011,44621] 0 2023-12-16T03:16:02.355 INFO:tasks.workunit.client.0.smithi064.stdout:9/359: readlink d2/dc/d24/d39/d42/l4a 0 2023-12-16T03:16:02.358 INFO:tasks.workunit.client.0.smithi064.stdout:6/332: write d3/d8/d13/f1b [2826473,68408] 0 2023-12-16T03:16:02.358 INFO:tasks.workunit.client.1.smithi184.stdout:2/588: rmdir d3/d29/d2f/d46/d77 39 2023-12-16T03:16:02.359 INFO:tasks.workunit.client.0.smithi064.stdout:6/333: chown d3/d8/d1f/c32 0 1 2023-12-16T03:16:02.359 INFO:tasks.workunit.client.0.smithi064.stdout:2/326: dwrite d1/d15/f1a [0,4194304] 0 2023-12-16T03:16:02.359 INFO:tasks.workunit.client.0.smithi064.stdout:2/327: write d1/d27/d3b/f56 [793274,67318] 0 2023-12-16T03:16:02.359 INFO:tasks.workunit.client.0.smithi064.stdout:2/328: write d1/d27/d2e/f5b [173958,18240] 0 2023-12-16T03:16:02.361 INFO:tasks.workunit.client.0.smithi064.stdout:4/410: dwrite d0/f11 [0,4194304] 0 2023-12-16T03:16:02.361 INFO:tasks.workunit.client.0.smithi064.stdout:4/411: readlink d0/d12/d48/l57 0 2023-12-16T03:16:02.361 INFO:tasks.workunit.client.0.smithi064.stdout:4/412: write d0/d12/f35 [1178106,67672] 0 2023-12-16T03:16:02.363 INFO:tasks.workunit.client.0.smithi064.stdout:6/334: symlink d3/d8/d1f/d26/d47/l5d 0 2023-12-16T03:16:02.363 INFO:tasks.workunit.client.0.smithi064.stdout:6/335: chown d3/d8/da/c1e 256660895 1 2023-12-16T03:16:02.363 INFO:tasks.workunit.client.0.smithi064.stdout:6/336: write d3/d8/d1f/f5a [471679,77532] 0 2023-12-16T03:16:02.363 INFO:tasks.workunit.client.0.smithi064.stdout:6/337: stat d3/d8/d13/f24 0 2023-12-16T03:16:02.368 INFO:tasks.workunit.client.1.smithi184.stdout:6/759: creat d0/d5/d22/d25/dbf/ff6 x:0 0 0 2023-12-16T03:16:02.368 INFO:tasks.workunit.client.1.smithi184.stdout:6/760: write d0/d5/d22/d34/fcd [392070,117545] 0 2023-12-16T03:16:02.368 INFO:tasks.workunit.client.1.smithi184.stdout:6/761: dread - d0/fc6 zero size 2023-12-16T03:16:02.369 INFO:tasks.workunit.client.1.smithi184.stdout:4/685: getdents d1/d29 0 2023-12-16T03:16:02.369 INFO:tasks.workunit.client.1.smithi184.stdout:4/686: readlink d1/d11/d5a/l89 0 2023-12-16T03:16:02.370 INFO:tasks.workunit.client.0.smithi064.stdout:3/389: dwrite db/d13/d39/f43 [0,4194304] 0 2023-12-16T03:16:02.372 INFO:tasks.workunit.client.1.smithi184.stdout:2/589: dread d3/d13/f9a [0,4194304] 0 2023-12-16T03:16:02.372 INFO:tasks.workunit.client.1.smithi184.stdout:3/780: symlink d12/d18/d1f/d23/d51/dd7/de3/l123 0 2023-12-16T03:16:02.372 INFO:tasks.workunit.client.1.smithi184.stdout:3/781: chown d12/d1e/de8/d48 237801991 1 2023-12-16T03:16:02.372 INFO:tasks.workunit.client.1.smithi184.stdout:2/590: write d3/d29/d4d/d5b/fb3 [872810,112472] 0 2023-12-16T03:16:02.372 INFO:tasks.workunit.client.1.smithi184.stdout:2/591: fdatasync d3/f50 0 2023-12-16T03:16:02.373 INFO:tasks.workunit.client.1.smithi184.stdout:2/592: write d3/d13/f9a [4214506,93197] 0 2023-12-16T03:16:02.373 INFO:tasks.workunit.client.1.smithi184.stdout:6/762: unlink d0/d5/f59 0 2023-12-16T03:16:02.376 INFO:tasks.workunit.client.1.smithi184.stdout:4/687: symlink d1/d12/d13/d40/d43/d5e/lec 0 2023-12-16T03:16:02.376 INFO:tasks.workunit.client.1.smithi184.stdout:4/688: chown d1/d12/fc1 8 1 2023-12-16T03:16:02.377 INFO:tasks.workunit.client.1.smithi184.stdout:4/689: truncate d1/f9d 383511 0 2023-12-16T03:16:02.377 INFO:tasks.workunit.client.1.smithi184.stdout:4/690: chown d1/d29/d34/d5c/d76/d42/c84 31576724 1 2023-12-16T03:16:02.377 INFO:tasks.workunit.client.1.smithi184.stdout:4/691: fsync d1/d11/f23 0 2023-12-16T03:16:02.377 INFO:tasks.workunit.client.1.smithi184.stdout:0/731: dwrite dc/d10/d2d/d5f/d7a/f9f [0,4194304] 0 2023-12-16T03:16:02.377 INFO:tasks.workunit.client.0.smithi064.stdout:7/379: sync 2023-12-16T03:16:02.381 INFO:tasks.workunit.client.0.smithi064.stdout:6/338: mkdir d3/d8/d13/d46/d5e 0 2023-12-16T03:16:02.383 INFO:tasks.workunit.client.0.smithi064.stdout:3/390: creat db/d13/f7f x:0 0 0 2023-12-16T03:16:02.384 INFO:tasks.workunit.client.1.smithi184.stdout:3/782: mknod d12/d18/d1f/d23/d2a/d42/d52/d76/c124 0 2023-12-16T03:16:02.384 INFO:tasks.workunit.client.1.smithi184.stdout:3/783: write d12/d1e/de8/d48/fcf [178881,24510] 0 2023-12-16T03:16:02.386 INFO:tasks.workunit.client.1.smithi184.stdout:2/593: creat d3/d13/d28/dac/fc5 x:0 0 0 2023-12-16T03:16:02.386 INFO:tasks.workunit.client.0.smithi064.stdout:3/391: mknod db/d12/c80 0 2023-12-16T03:16:02.390 INFO:tasks.workunit.client.1.smithi184.stdout:6/763: rmdir d0/d5/d22/d25 39 2023-12-16T03:16:02.390 INFO:tasks.workunit.client.1.smithi184.stdout:7/613: dwrite d0/d3/d2e/d79/d36/f4e [0,4194304] 0 2023-12-16T03:16:02.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/594: symlink d3/d13/lc6 0 2023-12-16T03:16:02.393 INFO:tasks.workunit.client.1.smithi184.stdout:0/732: read dc/d22/d1d/d2c/fea [847905,79447] 0 2023-12-16T03:16:02.396 INFO:tasks.workunit.client.1.smithi184.stdout:6/764: rename d0/d5/d12/d1b/d33/l7f to d0/d5/d22/d34/d53/lf7 0 2023-12-16T03:16:02.397 INFO:tasks.workunit.client.1.smithi184.stdout:7/614: rmdir d0/d3/d2e/d79/d1e/dac 0 2023-12-16T03:16:02.397 INFO:tasks.workunit.client.1.smithi184.stdout:7/615: fdatasync d0/d3/d2e/d79/d36/d84/f93 0 2023-12-16T03:16:02.398 INFO:tasks.workunit.client.1.smithi184.stdout:7/616: truncate d0/d3/d2e/d79/d36/d84/f93 876870 0 2023-12-16T03:16:02.398 INFO:tasks.workunit.client.1.smithi184.stdout:7/617: dread - d0/d3/d2e/d79/f9a zero size 2023-12-16T03:16:02.398 INFO:tasks.workunit.client.1.smithi184.stdout:7/618: chown d0/d3/d4 11 1 2023-12-16T03:16:02.398 INFO:tasks.workunit.client.1.smithi184.stdout:7/619: stat d0/d3/d2e/da9 0 2023-12-16T03:16:02.401 INFO:tasks.workunit.client.0.smithi064.stdout:0/313: dwrite d2/d7/f49 [4194304,4194304] 0 2023-12-16T03:16:02.401 INFO:tasks.workunit.client.0.smithi064.stdout:0/314: write d2/f27 [9384501,72202] 0 2023-12-16T03:16:02.402 INFO:tasks.workunit.client.1.smithi184.stdout:3/784: dread d12/d86/de4/d99/d117/fbe [0,4194304] 0 2023-12-16T03:16:02.402 INFO:tasks.workunit.client.1.smithi184.stdout:5/540: dwrite d1/d3/d9/d49/d74/fa6 [0,4194304] 0 2023-12-16T03:16:02.402 INFO:tasks.workunit.client.1.smithi184.stdout:5/541: dread - d1/d3/f5d zero size 2023-12-16T03:16:02.402 INFO:tasks.workunit.client.1.smithi184.stdout:0/733: symlink dc/d22/d45/daf/l100 0 2023-12-16T03:16:02.402 INFO:tasks.workunit.client.1.smithi184.stdout:0/734: dread - dc/d22/ff6 zero size 2023-12-16T03:16:02.403 INFO:tasks.workunit.client.1.smithi184.stdout:5/542: write d1/d2a/f13 [4161560,51501] 0 2023-12-16T03:16:02.404 INFO:tasks.workunit.client.1.smithi184.stdout:7/620: mkdir d0/d6b/d69/db5 0 2023-12-16T03:16:02.407 INFO:tasks.workunit.client.0.smithi064.stdout:7/380: dwrite d7/d13/d20/f21 [0,4194304] 0 2023-12-16T03:16:02.407 INFO:tasks.workunit.client.0.smithi064.stdout:7/381: readlink d7/d13/l2c 0 2023-12-16T03:16:02.410 INFO:tasks.workunit.client.1.smithi184.stdout:3/785: rmdir d12/d18/d1f/d23/d2a/d4a/d61/da9/d106 39 2023-12-16T03:16:02.410 INFO:tasks.workunit.client.0.smithi064.stdout:7/382: write d7/f3b [2216308,5465] 0 2023-12-16T03:16:02.410 INFO:tasks.workunit.client.0.smithi064.stdout:7/383: truncate d7/d13/d20/d37/f69 328414 0 2023-12-16T03:16:02.410 INFO:tasks.workunit.client.0.smithi064.stdout:1/360: dwrite d3/d36/d44/d4d/f4e [0,4194304] 0 2023-12-16T03:16:02.411 INFO:tasks.workunit.client.0.smithi064.stdout:4/413: dwrite d0/d42/d56/f67 [0,4194304] 0 2023-12-16T03:16:02.412 INFO:tasks.workunit.client.1.smithi184.stdout:6/765: dread d0/d36/f55 [4194304,4194304] 0 2023-12-16T03:16:02.412 INFO:tasks.workunit.client.1.smithi184.stdout:6/766: truncate d0/d5/f4a 945474 0 2023-12-16T03:16:02.412 INFO:tasks.workunit.client.1.smithi184.stdout:6/767: dread - d0/d5/d22/d25/dbf/dbe/fd8 zero size 2023-12-16T03:16:02.413 INFO:tasks.workunit.client.1.smithi184.stdout:0/735: truncate dc/d22/d45/d66/f84 83121 0 2023-12-16T03:16:02.413 INFO:tasks.workunit.client.1.smithi184.stdout:0/736: readlink dc/d22/l3d 0 2023-12-16T03:16:02.414 INFO:tasks.workunit.client.0.smithi064.stdout:7/384: dread d7/f6c [0,4194304] 0 2023-12-16T03:16:02.414 INFO:tasks.workunit.client.0.smithi064.stdout:7/385: chown d7/d13/d20/d37/c38 1 1 2023-12-16T03:16:02.417 INFO:tasks.workunit.client.1.smithi184.stdout:5/543: rename d1/d3/d9/de/d15/d19/daa to d1/d3/d9/de/d15/d19/d53/dad 0 2023-12-16T03:16:02.417 INFO:tasks.workunit.client.1.smithi184.stdout:5/544: readlink d1/d3/d9/de/d15/l21 0 2023-12-16T03:16:02.420 INFO:tasks.workunit.client.1.smithi184.stdout:3/786: mkdir d12/d1e/de8/df2/d125 0 2023-12-16T03:16:02.420 INFO:tasks.workunit.client.1.smithi184.stdout:3/787: chown d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/l119 1 1 2023-12-16T03:16:02.420 INFO:tasks.workunit.client.1.smithi184.stdout:3/788: fsync d12/f1b 0 2023-12-16T03:16:02.421 INFO:tasks.workunit.client.0.smithi064.stdout:1/361: mknod d3/d36/d44/d4d/d58/c74 0 2023-12-16T03:16:02.421 INFO:tasks.workunit.client.0.smithi064.stdout:1/362: chown d3/d36 49203573 1 2023-12-16T03:16:02.424 INFO:tasks.workunit.client.1.smithi184.stdout:1/664: sync 2023-12-16T03:16:02.427 INFO:tasks.workunit.client.1.smithi184.stdout:0/737: rmdir dc/d22/d45/daf 39 2023-12-16T03:16:02.429 INFO:tasks.workunit.client.0.smithi064.stdout:4/414: unlink d0/d42/d53/f21 0 2023-12-16T03:16:02.431 INFO:tasks.workunit.client.1.smithi184.stdout:0/738: read dc/d22/d1d/d43/f59 [1955173,66833] 0 2023-12-16T03:16:02.432 INFO:tasks.workunit.client.0.smithi064.stdout:0/315: rename d2/d7/d10/c51 to d2/d8/da/df/c5f 0 2023-12-16T03:16:02.435 INFO:tasks.workunit.client.0.smithi064.stdout:0/316: dread d2/d8/f4c [0,4194304] 0 2023-12-16T03:16:02.436 INFO:tasks.workunit.client.1.smithi184.stdout:3/789: creat d12/d37/f126 x:0 0 0 2023-12-16T03:16:02.436 INFO:tasks.workunit.client.0.smithi064.stdout:3/392: truncate db/d13/d39/f43 625407 0 2023-12-16T03:16:02.437 INFO:tasks.workunit.client.0.smithi064.stdout:3/393: chown db/d13/f24 10 1 2023-12-16T03:16:02.441 INFO:tasks.workunit.client.0.smithi064.stdout:7/386: rename d7/d13/l2c to d7/d13/d20/d37/l71 0 2023-12-16T03:16:02.442 INFO:tasks.workunit.client.0.smithi064.stdout:7/387: chown d7/d26 135 1 2023-12-16T03:16:02.442 INFO:tasks.workunit.client.0.smithi064.stdout:7/388: write d7/f3b [3274599,106067] 0 2023-12-16T03:16:02.442 INFO:tasks.workunit.client.0.smithi064.stdout:4/415: dread d0/d42/f5c [0,4194304] 0 2023-12-16T03:16:02.442 INFO:tasks.workunit.client.0.smithi064.stdout:8/430: dwrite d0/d1d/d24/d2f/d50/f87 [4194304,4194304] 0 2023-12-16T03:16:02.442 INFO:tasks.workunit.client.0.smithi064.stdout:6/339: dwrite d3/d8/d1f/f5a [0,4194304] 0 2023-12-16T03:16:02.442 INFO:tasks.workunit.client.0.smithi064.stdout:0/317: rmdir d2/d7 39 2023-12-16T03:16:02.443 INFO:tasks.workunit.client.1.smithi184.stdout:2/595: getdents d3/d13/d28/dac 0 2023-12-16T03:16:02.448 INFO:tasks.workunit.client.0.smithi064.stdout:8/431: dread d0/f3 [0,4194304] 0 2023-12-16T03:16:02.452 INFO:tasks.workunit.client.0.smithi064.stdout:7/389: creat d7/d3e/d42/f72 x:0 0 0 2023-12-16T03:16:02.454 INFO:tasks.workunit.client.0.smithi064.stdout:7/390: write d7/d3e/d42/f44 [94026,16567] 0 2023-12-16T03:16:02.455 INFO:tasks.workunit.client.0.smithi064.stdout:4/416: symlink d0/d42/l78 0 2023-12-16T03:16:02.455 INFO:tasks.workunit.client.0.smithi064.stdout:7/391: chown d7/d26/c2b 20 1 2023-12-16T03:16:02.457 INFO:tasks.workunit.client.1.smithi184.stdout:1/665: symlink d3/d34/dbc/d3c/d41/d77/ldf 0 2023-12-16T03:16:02.460 INFO:tasks.workunit.client.1.smithi184.stdout:6/768: symlink d0/d5/d12/lf8 0 2023-12-16T03:16:02.461 INFO:tasks.workunit.client.1.smithi184.stdout:5/545: mknod d1/d3/d9/de/d15/cae 0 2023-12-16T03:16:02.463 INFO:tasks.workunit.client.1.smithi184.stdout:0/739: dread dc/d10/d2d/d5f/fc2 [0,4194304] 0 2023-12-16T03:16:02.463 INFO:tasks.workunit.client.1.smithi184.stdout:0/740: chown dc/d22/d45/d66/c81 92 1 2023-12-16T03:16:02.463 INFO:tasks.workunit.client.1.smithi184.stdout:0/741: write dc/d2a/ff2 [1568037,66296] 0 2023-12-16T03:16:02.464 INFO:tasks.workunit.client.1.smithi184.stdout:6/769: write d0/d5/d12/d1b/d33/f58 [424228,35815] 0 2023-12-16T03:16:02.465 INFO:tasks.workunit.client.0.smithi064.stdout:4/417: dread d0/d42/d4c/f59 [0,4194304] 0 2023-12-16T03:16:02.465 INFO:tasks.workunit.client.0.smithi064.stdout:3/394: dwrite db/d12/d1a/f42 [0,4194304] 0 2023-12-16T03:16:02.466 INFO:tasks.workunit.client.1.smithi184.stdout:3/790: mkdir d12/d18/d1f/d93/d127 0 2023-12-16T03:16:02.467 INFO:tasks.workunit.client.1.smithi184.stdout:3/791: write d12/d37/f6a [1255121,38340] 0 2023-12-16T03:16:02.469 INFO:tasks.workunit.client.1.smithi184.stdout:3/792: read d12/d18/d1f/d23/d2a/d42/d52/f58 [3791447,80678] 0 2023-12-16T03:16:02.469 INFO:tasks.workunit.client.0.smithi064.stdout:8/432: dwrite d0/d1d/d3c/f55 [0,4194304] 0 2023-12-16T03:16:02.469 INFO:tasks.workunit.client.1.smithi184.stdout:1/666: symlink d3/d34/dbc/d3c/d41/d46/d4a/d6a/le0 0 2023-12-16T03:16:02.473 INFO:tasks.workunit.client.1.smithi184.stdout:5/546: rename d1/d2a/d64 to d1/d2a/d31/d58/daf 0 2023-12-16T03:16:02.473 INFO:tasks.workunit.client.1.smithi184.stdout:5/547: fsync d1/f29 0 2023-12-16T03:16:02.479 INFO:tasks.workunit.client.1.smithi184.stdout:6/770: symlink d0/d5/d12/d1b/d33/lf9 0 2023-12-16T03:16:02.479 INFO:tasks.workunit.client.1.smithi184.stdout:6/771: chown d0/d5/d22/f49 3127 1 2023-12-16T03:16:02.482 INFO:tasks.workunit.client.0.smithi064.stdout:6/340: creat d3/d8/f5f x:0 0 0 2023-12-16T03:16:02.483 INFO:tasks.workunit.client.1.smithi184.stdout:3/793: creat d12/d86/de4/d99/d117/db4/f128 x:0 0 0 2023-12-16T03:16:02.484 INFO:tasks.workunit.client.1.smithi184.stdout:3/794: truncate d12/d86/de4/d99/d117/db4/f128 1046243 0 2023-12-16T03:16:02.484 INFO:tasks.workunit.client.0.smithi064.stdout:6/341: write d3/d8/d13/f24 [3236683,2076] 0 2023-12-16T03:16:02.484 INFO:tasks.workunit.client.0.smithi064.stdout:6/342: chown d3/d8/d13/c41 11 1 2023-12-16T03:16:02.485 INFO:tasks.workunit.client.0.smithi064.stdout:0/318: creat d2/d8/da/df/d5e/f60 x:0 0 0 2023-12-16T03:16:02.485 INFO:tasks.workunit.client.0.smithi064.stdout:0/319: chown d2/d8/da/df/c5a 18171 1 2023-12-16T03:16:02.486 INFO:tasks.workunit.client.1.smithi184.stdout:1/667: mkdir d3/d34/dbc/d3c/d41/d63/de1 0 2023-12-16T03:16:02.488 INFO:tasks.workunit.client.1.smithi184.stdout:1/668: write d3/d34/dbc/d3c/d41/d63/fa9 [668496,112402] 0 2023-12-16T03:16:02.488 INFO:tasks.workunit.client.1.smithi184.stdout:1/669: chown d3/d34/d39/f66 452 1 2023-12-16T03:16:02.488 INFO:tasks.workunit.client.1.smithi184.stdout:1/670: write d3/d34/dbc/d38/fac [1117802,7819] 0 2023-12-16T03:16:02.489 INFO:tasks.workunit.client.0.smithi064.stdout:1/363: rename d3/d22/f32 to d3/dd/d11/d6a/f75 0 2023-12-16T03:16:02.490 INFO:tasks.workunit.client.0.smithi064.stdout:1/364: write d3/dd/d11/d3b/f5e [3386723,6265] 0 2023-12-16T03:16:02.492 INFO:tasks.workunit.client.1.smithi184.stdout:5/548: link d1/c25 d1/d3/d9/de/d15/d19/cb0 0 2023-12-16T03:16:02.495 INFO:tasks.workunit.client.1.smithi184.stdout:6/772: unlink d0/d36/d79/f7c 0 2023-12-16T03:16:02.496 INFO:tasks.workunit.client.0.smithi064.stdout:7/392: creat d7/d3e/d42/f73 x:0 0 0 2023-12-16T03:16:02.496 INFO:tasks.workunit.client.0.smithi064.stdout:4/418: dwrite d0/f11 [0,4194304] 0 2023-12-16T03:16:02.497 INFO:tasks.workunit.client.1.smithi184.stdout:1/671: dread d3/d34/dbc/d36/f48 [0,4194304] 0 2023-12-16T03:16:02.498 INFO:tasks.workunit.client.1.smithi184.stdout:3/795: link d12/d18/d68/la8 d12/d18/l129 0 2023-12-16T03:16:02.498 INFO:tasks.workunit.client.1.smithi184.stdout:3/796: chown d12/d18/d1f/d23/c5e 14043 1 2023-12-16T03:16:02.502 INFO:tasks.workunit.client.1.smithi184.stdout:6/773: creat d0/d5/d22/d37/d4d/d9c/ffa x:0 0 0 2023-12-16T03:16:02.503 INFO:tasks.workunit.client.0.smithi064.stdout:3/395: truncate db/d12/f27 255077 0 2023-12-16T03:16:02.505 INFO:tasks.workunit.client.1.smithi184.stdout:1/672: mkdir d3/d34/dbc/d3c/d41/d46/d4a/de2 0 2023-12-16T03:16:02.505 INFO:tasks.workunit.client.0.smithi064.stdout:6/343: dwrite d3/d8/d13/d58/f5c [0,4194304] 0 2023-12-16T03:16:02.506 INFO:tasks.workunit.client.0.smithi064.stdout:6/344: fdatasync d3/d8/f4c 0 2023-12-16T03:16:02.509 INFO:tasks.workunit.client.1.smithi184.stdout:6/774: unlink d0/d5/d22/d25/d47/f8f 0 2023-12-16T03:16:02.509 INFO:tasks.workunit.client.1.smithi184.stdout:9/898: sync 2023-12-16T03:16:02.509 INFO:tasks.workunit.client.1.smithi184.stdout:3/797: dread d12/d18/d1f/d23/d2a/d42/d52/f58 [0,4194304] 0 2023-12-16T03:16:02.509 INFO:tasks.workunit.client.1.smithi184.stdout:1/673: creat d3/d34/dbc/d3c/d41/d63/fe3 x:0 0 0 2023-12-16T03:16:02.511 INFO:tasks.workunit.client.0.smithi064.stdout:0/320: mknod d2/d8/da/d11/c61 0 2023-12-16T03:16:02.511 INFO:tasks.workunit.client.1.smithi184.stdout:3/798: write d12/d1e/de8/d48/f88 [77424,105989] 0 2023-12-16T03:16:02.511 INFO:tasks.workunit.client.1.smithi184.stdout:8/737: sync 2023-12-16T03:16:02.513 INFO:tasks.workunit.client.1.smithi184.stdout:9/899: symlink d0/d13/d20/l12c 0 2023-12-16T03:16:02.515 INFO:tasks.workunit.client.0.smithi064.stdout:8/433: rename d0/d1d/d3c/d40 to d0/da/d3e/d46/d8f 0 2023-12-16T03:16:02.516 INFO:tasks.workunit.client.1.smithi184.stdout:5/549: dwrite d1/d2a/d31/d58/f7f [0,4194304] 0 2023-12-16T03:16:02.516 INFO:tasks.workunit.client.1.smithi184.stdout:1/674: rmdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6 39 2023-12-16T03:16:02.516 INFO:tasks.workunit.client.0.smithi064.stdout:6/345: dread d3/d8/da/f43 [0,4194304] 0 2023-12-16T03:16:02.517 INFO:tasks.workunit.client.1.smithi184.stdout:5/550: write d1/d3/d9/de/d15/d19/d5f/f4c [119824,56313] 0 2023-12-16T03:16:02.518 INFO:tasks.workunit.client.1.smithi184.stdout:3/799: mknod d12/d18/d1f/d23/c12a 0 2023-12-16T03:16:02.518 INFO:tasks.workunit.client.0.smithi064.stdout:1/365: symlink d3/dd/d11/d38/l76 0 2023-12-16T03:16:02.520 INFO:tasks.workunit.client.1.smithi184.stdout:8/738: unlink d2/d4/d10/d11/d77/fa0 0 2023-12-16T03:16:02.521 INFO:tasks.workunit.client.0.smithi064.stdout:7/393: mkdir d7/d13/d74 0 2023-12-16T03:16:02.522 INFO:tasks.workunit.client.1.smithi184.stdout:6/775: mknod d0/d5/d12/cfb 0 2023-12-16T03:16:02.523 INFO:tasks.workunit.client.1.smithi184.stdout:6/776: write d0/d5/d12/d1b/d33/f58 [3510673,109554] 0 2023-12-16T03:16:02.523 INFO:tasks.workunit.client.0.smithi064.stdout:4/419: creat d0/d12/f79 x:0 0 0 2023-12-16T03:16:02.523 INFO:tasks.workunit.client.0.smithi064.stdout:4/420: stat d0/d12/f35 0 2023-12-16T03:16:02.523 INFO:tasks.workunit.client.0.smithi064.stdout:4/421: write d0/d1e/d36/f4d [1216322,97185] 0 2023-12-16T03:16:02.524 INFO:tasks.workunit.client.1.smithi184.stdout:6/777: write d0/d5/d26/f97 [2143181,31132] 0 2023-12-16T03:16:02.524 INFO:tasks.workunit.client.1.smithi184.stdout:6/778: chown d0/d5/d12/d1b/d33/d3d/da2/dbc 1234220991 1 2023-12-16T03:16:02.524 INFO:tasks.workunit.client.1.smithi184.stdout:9/900: symlink d0/d13/d20/d5b/d43/dc7/ddc/dd8/l12d 0 2023-12-16T03:16:02.524 INFO:tasks.workunit.client.1.smithi184.stdout:9/901: chown d0/d13/d20/d5b/d43/lad 42 1 2023-12-16T03:16:02.524 INFO:tasks.workunit.client.1.smithi184.stdout:9/902: readlink d0/d3a/d47/l114 0 2023-12-16T03:16:02.525 INFO:tasks.workunit.client.0.smithi064.stdout:3/396: creat db/d12/d1a/d2c/d34/d4c/d6a/f81 x:0 0 0 2023-12-16T03:16:02.527 INFO:tasks.workunit.client.1.smithi184.stdout:1/675: mknod d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/ce4 0 2023-12-16T03:16:02.528 INFO:tasks.workunit.client.1.smithi184.stdout:1/676: chown d3/d34/dbc/d3c 85939160 1 2023-12-16T03:16:02.529 INFO:tasks.workunit.client.1.smithi184.stdout:5/551: creat d1/d3/d9/de/d30/fb1 x:0 0 0 2023-12-16T03:16:02.529 INFO:tasks.workunit.client.1.smithi184.stdout:5/552: write d1/d3/d9/de/d30/d68/f76 [4796832,107595] 0 2023-12-16T03:16:02.530 INFO:tasks.workunit.client.1.smithi184.stdout:5/553: read d1/d3/d9/de/f37 [3062972,117933] 0 2023-12-16T03:16:02.530 INFO:tasks.workunit.client.0.smithi064.stdout:0/321: truncate d2/d8/f1b 4682056 0 2023-12-16T03:16:02.530 INFO:tasks.workunit.client.0.smithi064.stdout:0/322: dread - d2/d7/d10/d21/d31/f59 zero size 2023-12-16T03:16:02.531 INFO:tasks.workunit.client.1.smithi184.stdout:3/800: mkdir d12/d18/d1f/d23/d2a/d4a/d12b 0 2023-12-16T03:16:02.532 INFO:tasks.workunit.client.0.smithi064.stdout:8/434: mknod d0/d1d/d24/d2f/d50/d70/c90 0 2023-12-16T03:16:02.535 INFO:tasks.workunit.client.1.smithi184.stdout:8/739: creat d2/d12/d21/d2d/fec x:0 0 0 2023-12-16T03:16:02.535 INFO:tasks.workunit.client.1.smithi184.stdout:8/740: chown d2/d37/d7c/lb7 34 1 2023-12-16T03:16:02.535 INFO:tasks.workunit.client.1.smithi184.stdout:8/741: write d2/d12/f58 [69143,62734] 0 2023-12-16T03:16:02.536 INFO:tasks.workunit.client.0.smithi064.stdout:6/346: rename d3/lf to d3/d9/l60 0 2023-12-16T03:16:02.539 INFO:tasks.workunit.client.0.smithi064.stdout:1/366: creat d3/dd/d11/d38/f77 x:0 0 0 2023-12-16T03:16:02.539 INFO:tasks.workunit.client.0.smithi064.stdout:1/367: read d3/dd/f2d [4067394,41171] 0 2023-12-16T03:16:02.540 INFO:tasks.workunit.client.0.smithi064.stdout:7/394: mknod d7/d3e/c75 0 2023-12-16T03:16:02.542 INFO:tasks.workunit.client.1.smithi184.stdout:9/903: link d0/d3a/fc8 d0/d13/d20/d5b/f12e 0 2023-12-16T03:16:02.542 INFO:tasks.workunit.client.1.smithi184.stdout:9/904: stat d0/d76/c108 0 2023-12-16T03:16:02.542 INFO:tasks.workunit.client.1.smithi184.stdout:9/905: dread - d0/d13/d20/d5b/d43/dab/fd3 zero size 2023-12-16T03:16:02.542 INFO:tasks.workunit.client.1.smithi184.stdout:9/906: fdatasync d0/d30/f41 0 2023-12-16T03:16:02.543 INFO:tasks.workunit.client.0.smithi064.stdout:4/422: link d0/da/f6f d0/da/f7a 0 2023-12-16T03:16:02.544 INFO:tasks.workunit.client.1.smithi184.stdout:1/677: mknod d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/ce5 0 2023-12-16T03:16:02.545 INFO:tasks.workunit.client.0.smithi064.stdout:3/397: link db/d12/f58 db/d12/d1a/d2c/d34/d4c/f82 0 2023-12-16T03:16:02.547 INFO:tasks.workunit.client.0.smithi064.stdout:0/323: creat d2/d8/da/f62 x:0 0 0 2023-12-16T03:16:02.549 INFO:tasks.workunit.client.0.smithi064.stdout:8/435: mknod d0/db/d12/d1c/d59/c91 0 2023-12-16T03:16:02.555 INFO:tasks.workunit.client.0.smithi064.stdout:6/347: rmdir d3/d8/da 39 2023-12-16T03:16:02.556 INFO:tasks.workunit.client.0.smithi064.stdout:1/368: dread d3/d22/f28 [0,4194304] 0 2023-12-16T03:16:02.557 INFO:tasks.workunit.client.0.smithi064.stdout:1/369: dread d3/dd/d23/d41/f53 [4194304,4194304] 0 2023-12-16T03:16:02.559 INFO:tasks.workunit.client.0.smithi064.stdout:1/370: dread d3/dd/d23/d41/f4b [0,4194304] 0 2023-12-16T03:16:02.559 INFO:tasks.workunit.client.0.smithi064.stdout:1/371: fdatasync d3/dd/f1a 0 2023-12-16T03:16:02.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:02.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:02 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:02.561 INFO:tasks.workunit.client.1.smithi184.stdout:5/554: link d1/d2a/d31/d58/f7f d1/d3/fb2 0 2023-12-16T03:16:02.564 INFO:tasks.workunit.client.1.smithi184.stdout:3/801: unlink d12/f1b 0 2023-12-16T03:16:02.564 INFO:tasks.workunit.client.0.smithi064.stdout:6/348: dread d3/d9/f20 [4194304,4194304] 0 2023-12-16T03:16:02.567 INFO:tasks.workunit.client.1.smithi184.stdout:8/742: creat d2/d6a/da4/fed x:0 0 0 2023-12-16T03:16:02.567 INFO:tasks.workunit.client.0.smithi064.stdout:7/395: creat d7/d13/f76 x:0 0 0 2023-12-16T03:16:02.568 INFO:tasks.workunit.client.1.smithi184.stdout:6/779: symlink d0/lfc 0 2023-12-16T03:16:02.568 INFO:tasks.workunit.client.1.smithi184.stdout:6/780: write d0/d5/f1f [4477453,95981] 0 2023-12-16T03:16:02.572 INFO:tasks.workunit.client.1.smithi184.stdout:9/907: truncate d0/d13/f91 1737186 0 2023-12-16T03:16:02.572 INFO:tasks.workunit.client.0.smithi064.stdout:3/398: mknod db/d12/d1a/d2c/d34/c83 0 2023-12-16T03:16:02.576 INFO:tasks.workunit.client.0.smithi064.stdout:0/324: rmdir d2/d7/d10/d21/d31 39 2023-12-16T03:16:02.577 INFO:tasks.workunit.client.1.smithi184.stdout:3/802: write d12/d18/d1f/d23/d2a/f53 [4994829,70964] 0 2023-12-16T03:16:02.580 INFO:tasks.workunit.client.0.smithi064.stdout:8/436: rename d0/da/d16/f1b to d0/db/d4c/f92 0 2023-12-16T03:16:02.582 INFO:tasks.workunit.client.1.smithi184.stdout:9/908: symlink d0/d76/db7/d100/l12f 0 2023-12-16T03:16:02.582 INFO:tasks.workunit.client.1.smithi184.stdout:9/909: dread - d0/d13/d20/d5b/d43/dc7/ddc/ff3 zero size 2023-12-16T03:16:02.583 INFO:tasks.workunit.client.0.smithi064.stdout:1/372: symlink d3/dd/d23/d60/l78 0 2023-12-16T03:16:02.584 INFO:tasks.workunit.client.0.smithi064.stdout:6/349: creat d3/f61 x:0 0 0 2023-12-16T03:16:02.587 INFO:tasks.workunit.client.0.smithi064.stdout:3/399: symlink db/d12/d1a/d2c/d6e/l84 0 2023-12-16T03:16:02.588 INFO:tasks.workunit.client.1.smithi184.stdout:5/555: dwrite d1/d3/d9/de/d15/d19/f23 [0,4194304] 0 2023-12-16T03:16:02.589 INFO:tasks.workunit.client.0.smithi064.stdout:4/423: rmdir d0/da 39 2023-12-16T03:16:02.589 INFO:tasks.workunit.client.1.smithi184.stdout:8/743: dwrite d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:16:02.589 INFO:tasks.workunit.client.1.smithi184.stdout:5/556: write d1/d3/d9/de/d15/d19/d48/f85 [595866,87751] 0 2023-12-16T03:16:02.590 INFO:tasks.workunit.client.0.smithi064.stdout:0/325: creat d2/d7/f63 x:0 0 0 2023-12-16T03:16:02.594 INFO:tasks.workunit.client.0.smithi064.stdout:7/396: rename d7/f6c to d7/d3e/d42/d43/d46/f77 0 2023-12-16T03:16:02.594 INFO:tasks.workunit.client.0.smithi064.stdout:7/397: fdatasync d7/d3e/f55 0 2023-12-16T03:16:02.594 INFO:tasks.workunit.client.0.smithi064.stdout:7/398: chown d7/l4f 304 1 2023-12-16T03:16:02.594 INFO:tasks.workunit.client.0.smithi064.stdout:7/399: write d7/d26/d30/f57 [329061,43754] 0 2023-12-16T03:16:02.594 INFO:tasks.workunit.client.1.smithi184.stdout:3/803: creat d12/d86/de4/d99/d117/f12c x:0 0 0 2023-12-16T03:16:02.595 INFO:tasks.workunit.client.0.smithi064.stdout:8/437: mkdir d0/d1d/d3c/d42/d93 0 2023-12-16T03:16:02.595 INFO:tasks.workunit.client.0.smithi064.stdout:8/438: write d0/da/f65 [323800,42609] 0 2023-12-16T03:16:02.596 INFO:tasks.workunit.client.0.smithi064.stdout:1/373: creat d3/dd/d23/d60/f79 x:0 0 0 2023-12-16T03:16:02.598 INFO:tasks.workunit.client.0.smithi064.stdout:1/374: write d3/dd/f3c [797043,14768] 0 2023-12-16T03:16:02.599 INFO:tasks.workunit.client.0.smithi064.stdout:3/400: mknod db/c85 0 2023-12-16T03:16:02.601 INFO:tasks.workunit.client.1.smithi184.stdout:8/744: mkdir d2/d4/d10/d11/d72/dc2/dee 0 2023-12-16T03:16:02.601 INFO:tasks.workunit.client.0.smithi064.stdout:4/424: rmdir d0 39 2023-12-16T03:16:02.601 INFO:tasks.workunit.client.0.smithi064.stdout:4/425: chown d0/l10 24130 1 2023-12-16T03:16:02.603 INFO:tasks.workunit.client.0.smithi064.stdout:7/400: creat d7/d3e/f78 x:0 0 0 2023-12-16T03:16:02.603 INFO:tasks.workunit.client.0.smithi064.stdout:7/401: chown c2 0 1 2023-12-16T03:16:02.603 INFO:tasks.workunit.client.1.smithi184.stdout:5/557: dread d1/d2a/d31/d58/daf/f8a [0,4194304] 0 2023-12-16T03:16:02.604 INFO:tasks.workunit.client.0.smithi064.stdout:8/439: creat d0/db/d12/d1c/d59/d77/f94 x:0 0 0 2023-12-16T03:16:02.606 INFO:tasks.workunit.client.0.smithi064.stdout:4/426: dread d0/d12/f35 [0,4194304] 0 2023-12-16T03:16:02.606 INFO:tasks.workunit.client.0.smithi064.stdout:1/375: creat d3/dd/d11/d6a/f7a x:0 0 0 2023-12-16T03:16:02.607 INFO:tasks.workunit.client.0.smithi064.stdout:8/440: write d0/db/d12/d1c/f72 [1232730,76604] 0 2023-12-16T03:16:02.608 INFO:tasks.workunit.client.1.smithi184.stdout:4/692: sync 2023-12-16T03:16:02.608 INFO:tasks.workunit.client.1.smithi184.stdout:7/621: sync 2023-12-16T03:16:02.608 INFO:tasks.workunit.client.1.smithi184.stdout:4/693: chown d1/f28 598575 1 2023-12-16T03:16:02.608 INFO:tasks.workunit.client.1.smithi184.stdout:7/622: read d0/d3/d2e/d79/d32/d8a/f8e [179792,29460] 0 2023-12-16T03:16:02.609 INFO:tasks.workunit.client.0.smithi064.stdout:3/401: creat db/d13/d39/f86 x:0 0 0 2023-12-16T03:16:02.612 INFO:tasks.workunit.client.0.smithi064.stdout:7/402: creat d7/d26/f79 x:0 0 0 2023-12-16T03:16:02.613 INFO:tasks.workunit.client.0.smithi064.stdout:9/360: sync 2023-12-16T03:16:02.613 INFO:tasks.workunit.client.0.smithi064.stdout:2/329: sync 2023-12-16T03:16:02.613 INFO:tasks.workunit.client.0.smithi064.stdout:5/353: sync 2023-12-16T03:16:02.613 INFO:tasks.workunit.client.0.smithi064.stdout:9/361: chown d2/dc/d24/d39 4070446 1 2023-12-16T03:16:02.613 INFO:tasks.workunit.client.0.smithi064.stdout:9/362: stat d2/dc/ff 0 2023-12-16T03:16:02.613 INFO:tasks.workunit.client.0.smithi064.stdout:9/363: write d2/dc/f6d [1029334,117103] 0 2023-12-16T03:16:02.614 INFO:tasks.workunit.client.1.smithi184.stdout:9/910: mkdir d0/d76/db7/d130 0 2023-12-16T03:16:02.615 INFO:tasks.workunit.client.0.smithi064.stdout:4/427: write d0/f11 [1109765,33051] 0 2023-12-16T03:16:02.617 INFO:tasks.workunit.client.0.smithi064.stdout:1/376: creat d3/f7b x:0 0 0 2023-12-16T03:16:02.617 INFO:tasks.workunit.client.1.smithi184.stdout:3/804: mknod d12/d1e/de8/c12d 0 2023-12-16T03:16:02.618 INFO:tasks.workunit.client.1.smithi184.stdout:8/745: creat d2/d6a/fef x:0 0 0 2023-12-16T03:16:02.619 INFO:tasks.workunit.client.1.smithi184.stdout:9/911: rename d0/d76/db2/cb6 to d0/d76/da2/dc4/ddb/c131 0 2023-12-16T03:16:02.620 INFO:tasks.workunit.client.0.smithi064.stdout:0/326: dwrite d2/d8/f4c [0,4194304] 0 2023-12-16T03:16:02.621 INFO:tasks.workunit.client.0.smithi064.stdout:8/441: mkdir d0/db/d37/d3a/d95 0 2023-12-16T03:16:02.621 INFO:tasks.workunit.client.0.smithi064.stdout:8/442: fsync d0/da/fc 0 2023-12-16T03:16:02.624 INFO:tasks.workunit.client.1.smithi184.stdout:3/805: mknod d12/d86/de4/d99/c12e 0 2023-12-16T03:16:02.624 INFO:tasks.workunit.client.0.smithi064.stdout:3/402: truncate db/d12/d21/f49 3234917 0 2023-12-16T03:16:02.624 INFO:tasks.workunit.client.0.smithi064.stdout:6/350: dwrite d3/fd [0,4194304] 0 2023-12-16T03:16:02.626 INFO:tasks.workunit.client.1.smithi184.stdout:8/746: mknod d2/d12/d21/d2d/d31/d34/d96/dca/de8/cf0 0 2023-12-16T03:16:02.626 INFO:tasks.workunit.client.0.smithi064.stdout:7/403: creat d7/d13/f7a x:0 0 0 2023-12-16T03:16:02.626 INFO:tasks.workunit.client.0.smithi064.stdout:7/404: truncate d7/d3e/f78 651808 0 2023-12-16T03:16:02.626 INFO:tasks.workunit.client.0.smithi064.stdout:7/405: write d7/f53 [4769619,105709] 0 2023-12-16T03:16:02.627 INFO:tasks.workunit.client.0.smithi064.stdout:9/364: dread d2/dc/d24/d39/f3d [0,4194304] 0 2023-12-16T03:16:02.627 INFO:tasks.workunit.client.0.smithi064.stdout:2/330: dread d1/f8 [0,4194304] 0 2023-12-16T03:16:02.628 INFO:tasks.workunit.client.0.smithi064.stdout:5/354: rename d0/d7/l11 to d0/d14/d20/d37/l7e 0 2023-12-16T03:16:02.628 INFO:tasks.workunit.client.0.smithi064.stdout:5/355: dread - d0/d7/d34/f5c zero size 2023-12-16T03:16:02.628 INFO:tasks.workunit.client.0.smithi064.stdout:5/356: write d0/d14/d4e/f53 [780220,25355] 0 2023-12-16T03:16:02.628 INFO:tasks.workunit.client.0.smithi064.stdout:5/357: dread - d0/d7/d34/f7b zero size 2023-12-16T03:16:02.628 INFO:tasks.workunit.client.0.smithi064.stdout:5/358: chown d0/d14/d20/d37 8216946 1 2023-12-16T03:16:02.629 INFO:tasks.workunit.client.1.smithi184.stdout:8/747: write d2/d4/d10/f17 [66879,24716] 0 2023-12-16T03:16:02.629 INFO:tasks.workunit.client.1.smithi184.stdout:8/748: fdatasync d2/d4/d10/d11/fac 0 2023-12-16T03:16:02.629 INFO:tasks.workunit.client.1.smithi184.stdout:8/749: write d2/d4/d10/d2a/f87 [1036028,38591] 0 2023-12-16T03:16:02.629 INFO:tasks.workunit.client.0.smithi064.stdout:4/428: symlink d0/da/l7b 0 2023-12-16T03:16:02.630 INFO:tasks.workunit.client.0.smithi064.stdout:1/377: dread d3/d36/f45 [0,4194304] 0 2023-12-16T03:16:02.630 INFO:tasks.workunit.client.0.smithi064.stdout:1/378: chown d3/dd/d11 1 1 2023-12-16T03:16:02.632 INFO:tasks.workunit.client.0.smithi064.stdout:0/327: truncate d2/d7/d10/f1a 414221 0 2023-12-16T03:16:02.633 INFO:tasks.workunit.client.0.smithi064.stdout:8/443: mknod d0/d1d/d3c/d42/c96 0 2023-12-16T03:16:02.633 INFO:tasks.workunit.client.1.smithi184.stdout:8/750: creat d2/d4/d10/d7a/ff1 x:0 0 0 2023-12-16T03:16:02.633 INFO:tasks.workunit.client.1.smithi184.stdout:8/751: fsync d2/d4/d10/d7a/d83/fd8 0 2023-12-16T03:16:02.634 INFO:tasks.workunit.client.0.smithi064.stdout:3/403: mknod db/d12/d1a/d2c/c87 0 2023-12-16T03:16:02.636 INFO:tasks.workunit.client.1.smithi184.stdout:8/752: symlink d2/d4/d10/d99/lf2 0 2023-12-16T03:16:02.637 INFO:tasks.workunit.client.0.smithi064.stdout:3/404: dread db/d12/d21/f30 [0,4194304] 0 2023-12-16T03:16:02.638 INFO:tasks.workunit.client.0.smithi064.stdout:3/405: fsync db/d13/f24 0 2023-12-16T03:16:02.639 INFO:tasks.workunit.client.0.smithi064.stdout:9/365: unlink d2/dc/l1a 0 2023-12-16T03:16:02.639 INFO:tasks.workunit.client.0.smithi064.stdout:6/351: read d3/d8/da/f23 [7222743,126588] 0 2023-12-16T03:16:02.639 INFO:tasks.workunit.client.1.smithi184.stdout:8/753: creat d2/d4/d10/d11/d72/dc2/ff3 x:0 0 0 2023-12-16T03:16:02.640 INFO:tasks.workunit.client.0.smithi064.stdout:2/331: rmdir d1/d15/d1b 39 2023-12-16T03:16:02.640 INFO:tasks.workunit.client.0.smithi064.stdout:2/332: truncate d1/d27/d3b/f56 864446 0 2023-12-16T03:16:02.640 INFO:tasks.workunit.client.0.smithi064.stdout:2/333: stat d1/d27/d2e/f34 0 2023-12-16T03:16:02.641 INFO:tasks.workunit.client.0.smithi064.stdout:5/359: mknod d0/d50/c7f 0 2023-12-16T03:16:02.644 INFO:tasks.workunit.client.0.smithi064.stdout:9/366: dread f1 [0,4194304] 0 2023-12-16T03:16:02.645 INFO:tasks.workunit.client.0.smithi064.stdout:4/429: link d0/d12/f35 d0/d42/d56/f7c 0 2023-12-16T03:16:02.645 INFO:tasks.workunit.client.0.smithi064.stdout:1/379: rename d3/f55 to d3/dd/d23/f7c 0 2023-12-16T03:16:02.647 INFO:tasks.workunit.client.0.smithi064.stdout:0/328: mkdir d2/d8/da/d11/d64 0 2023-12-16T03:16:02.648 INFO:tasks.workunit.client.0.smithi064.stdout:6/352: creat d3/d8/d1f/d26/f62 x:0 0 0 2023-12-16T03:16:02.650 INFO:tasks.workunit.client.0.smithi064.stdout:1/380: write d3/dd/f1a [1606872,89731] 0 2023-12-16T03:16:02.651 INFO:tasks.workunit.client.0.smithi064.stdout:7/406: dread d7/f9 [0,4194304] 0 2023-12-16T03:16:02.651 INFO:tasks.workunit.client.0.smithi064.stdout:7/407: getdents d7/d13/d20/d6f 0 2023-12-16T03:16:02.651 INFO:tasks.workunit.client.0.smithi064.stdout:5/360: mkdir d0/d14/d20/d37/d70/d71/d80 0 2023-12-16T03:16:02.651 INFO:tasks.workunit.client.0.smithi064.stdout:4/430: creat d0/d42/d4c/d70/f7d x:0 0 0 2023-12-16T03:16:02.652 INFO:tasks.workunit.client.0.smithi064.stdout:8/444: rmdir d0/db/d37 39 2023-12-16T03:16:02.652 INFO:tasks.workunit.client.0.smithi064.stdout:8/445: readlink d0/db/d4c/l80 0 2023-12-16T03:16:02.653 INFO:tasks.workunit.client.1.smithi184.stdout:7/623: dwrite d0/f50 [4194304,4194304] 0 2023-12-16T03:16:02.654 INFO:tasks.workunit.client.0.smithi064.stdout:5/361: creat d0/d14/d20/d37/d70/f81 x:0 0 0 2023-12-16T03:16:02.655 INFO:tasks.workunit.client.0.smithi064.stdout:4/431: creat d0/d1e/d36/f7e x:0 0 0 2023-12-16T03:16:02.657 INFO:tasks.workunit.client.1.smithi184.stdout:7/624: symlink d0/d3/d2e/da9/lb6 0 2023-12-16T03:16:02.657 INFO:tasks.workunit.client.1.smithi184.stdout:7/625: write d0/d3/d2e/d79/d32/d8a/f8e [397487,93034] 0 2023-12-16T03:16:02.657 INFO:tasks.workunit.client.1.smithi184.stdout:7/626: chown d0/d3/d68/c91 7880272 1 2023-12-16T03:16:02.658 INFO:tasks.workunit.client.0.smithi064.stdout:6/353: symlink d3/d8/d13/d46/l63 0 2023-12-16T03:16:02.660 INFO:tasks.workunit.client.1.smithi184.stdout:7/627: mknod d0/d3/d2e/d79/d32/cb7 0 2023-12-16T03:16:02.660 INFO:tasks.workunit.client.0.smithi064.stdout:8/446: dread d0/f2 [0,4194304] 0 2023-12-16T03:16:02.662 INFO:tasks.workunit.client.0.smithi064.stdout:8/447: dread d0/f2 [0,4194304] 0 2023-12-16T03:16:02.662 INFO:tasks.workunit.client.0.smithi064.stdout:4/432: rename d0/d12/c23 to d0/d42/c7f 0 2023-12-16T03:16:02.663 INFO:tasks.workunit.client.0.smithi064.stdout:5/362: dread d0/d14/d20/f3d [0,4194304] 0 2023-12-16T03:16:02.664 INFO:tasks.workunit.client.0.smithi064.stdout:5/363: getdents d0/d14/d4e 0 2023-12-16T03:16:02.664 INFO:tasks.workunit.client.0.smithi064.stdout:7/408: write d7/d13/d20/f28 [6401887,29607] 0 2023-12-16T03:16:02.665 INFO:tasks.workunit.client.1.smithi184.stdout:7/628: write d0/d6b/d69/f90 [2806837,78854] 0 2023-12-16T03:16:02.666 INFO:tasks.workunit.client.0.smithi064.stdout:0/329: write d2/d8/f1b [4119983,93175] 0 2023-12-16T03:16:02.666 INFO:tasks.workunit.client.0.smithi064.stdout:6/354: dread d3/d8/d1f/f22 [0,4194304] 0 2023-12-16T03:16:02.666 INFO:tasks.workunit.client.0.smithi064.stdout:0/330: chown f1 0 1 2023-12-16T03:16:02.667 INFO:tasks.workunit.client.0.smithi064.stdout:5/364: link d0/d19/f4a d0/de/d23/f82 0 2023-12-16T03:16:02.668 INFO:tasks.workunit.client.0.smithi064.stdout:3/406: dwrite db/d12/d1a/f42 [0,4194304] 0 2023-12-16T03:16:02.668 INFO:tasks.workunit.client.0.smithi064.stdout:7/409: getdents d7/d3e/d42/d43/d46/d52 0 2023-12-16T03:16:02.669 INFO:tasks.workunit.client.1.smithi184.stdout:9/912: dwrite d0/f8b [0,4194304] 0 2023-12-16T03:16:02.669 INFO:tasks.workunit.client.1.smithi184.stdout:4/694: dwrite d1/d29/f2e [0,4194304] 0 2023-12-16T03:16:02.671 INFO:tasks.workunit.client.1.smithi184.stdout:3/806: dwrite d12/d18/d1f/d23/d2a/d42/d52/f6f [0,4194304] 0 2023-12-16T03:16:02.671 INFO:tasks.workunit.client.1.smithi184.stdout:5/558: dwrite d1/d2a/f13 [4194304,4194304] 0 2023-12-16T03:16:02.672 INFO:tasks.workunit.client.0.smithi064.stdout:0/331: unlink d2/d7/d10/l34 0 2023-12-16T03:16:02.675 INFO:tasks.workunit.client.1.smithi184.stdout:8/754: dwrite d2/d4/d10/d7a/f7f [0,4194304] 0 2023-12-16T03:16:02.675 INFO:tasks.workunit.client.0.smithi064.stdout:6/355: creat d3/d8/d13/d46/d5e/f64 x:0 0 0 2023-12-16T03:16:02.677 INFO:tasks.workunit.client.1.smithi184.stdout:7/629: dread d0/d3/d2e/d79/d36/f4e [0,4194304] 0 2023-12-16T03:16:02.677 INFO:tasks.workunit.client.0.smithi064.stdout:0/332: dread d2/d7/d10/f1f [0,4194304] 0 2023-12-16T03:16:02.678 INFO:tasks.workunit.client.1.smithi184.stdout:4/695: symlink d1/d12/db3/db8/dd0/led 0 2023-12-16T03:16:02.679 INFO:tasks.workunit.client.1.smithi184.stdout:6/781: write d0/d5/d22/d25/f5f [92659,112280] 0 2023-12-16T03:16:02.682 INFO:tasks.workunit.client.0.smithi064.stdout:7/410: dread d7/d26/d30/f33 [0,4194304] 0 2023-12-16T03:16:02.683 INFO:tasks.workunit.client.0.smithi064.stdout:1/381: dwrite d3/dd/d11/d38/f77 [0,4194304] 0 2023-12-16T03:16:02.683 INFO:tasks.workunit.client.0.smithi064.stdout:1/382: chown d3/dd/d23/d60/f79 479209 1 2023-12-16T03:16:02.684 INFO:tasks.workunit.client.1.smithi184.stdout:7/630: write d0/d3/f5 [886980,26787] 0 2023-12-16T03:16:02.684 INFO:tasks.workunit.client.0.smithi064.stdout:6/356: write d3/d8/f4c [2663016,67538] 0 2023-12-16T03:16:02.684 INFO:tasks.workunit.client.0.smithi064.stdout:6/357: stat d3/d8/d13 0 2023-12-16T03:16:02.685 INFO:tasks.workunit.client.1.smithi184.stdout:7/631: read d0/d3/d2e/d79/d32/d39/f70 [1380147,16357] 0 2023-12-16T03:16:02.685 INFO:tasks.workunit.client.1.smithi184.stdout:7/632: chown d0/d3/d2e/d79/d34/l7b 14568764 1 2023-12-16T03:16:02.688 INFO:tasks.workunit.client.0.smithi064.stdout:5/365: getdents d0/d7/d34 0 2023-12-16T03:16:02.688 INFO:tasks.workunit.client.0.smithi064.stdout:5/366: chown d0/d50/f33 7732 1 2023-12-16T03:16:02.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:02.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:02 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:02.695 INFO:tasks.workunit.client.1.smithi184.stdout:4/696: dread d1/d12/d13/da1/fcd [0,4194304] 0 2023-12-16T03:16:02.696 INFO:tasks.workunit.client.1.smithi184.stdout:4/697: truncate d1/d12/d13/d40/d43/d5e/f83 1073713 0 2023-12-16T03:16:02.696 INFO:tasks.workunit.client.0.smithi064.stdout:3/407: creat db/d12/d4e/f88 x:0 0 0 2023-12-16T03:16:02.696 INFO:tasks.workunit.client.0.smithi064.stdout:3/408: dread - db/d12/d1a/d2c/d34/d4c/d6a/f6c zero size 2023-12-16T03:16:02.706 INFO:tasks.workunit.client.1.smithi184.stdout:5/559: truncate d1/f1a 3357008 0 2023-12-16T03:16:02.707 INFO:tasks.workunit.client.1.smithi184.stdout:9/913: dwrite d0/d30/ddf/f113 [0,4194304] 0 2023-12-16T03:16:02.708 INFO:tasks.workunit.client.1.smithi184.stdout:9/914: fdatasync d0/d76/fde 0 2023-12-16T03:16:02.709 INFO:tasks.workunit.client.1.smithi184.stdout:8/755: creat d2/d12/ff4 x:0 0 0 2023-12-16T03:16:02.713 INFO:tasks.workunit.client.0.smithi064.stdout:4/433: dwrite d0/d12/f79 [0,4194304] 0 2023-12-16T03:16:02.713 INFO:tasks.workunit.client.0.smithi064.stdout:4/434: write d0/d42/d66/f73 [59573,95033] 0 2023-12-16T03:16:02.713 INFO:tasks.workunit.client.0.smithi064.stdout:4/435: chown d0/da 101542318 1 2023-12-16T03:16:02.715 INFO:tasks.workunit.client.1.smithi184.stdout:6/782: dwrite d0/d5/d22/d25/d47/fac [0,4194304] 0 2023-12-16T03:16:02.716 INFO:tasks.workunit.client.0.smithi064.stdout:0/333: dwrite d2/d8/da/df/d5e/f60 [0,4194304] 0 2023-12-16T03:16:02.716 INFO:tasks.workunit.client.1.smithi184.stdout:3/807: dwrite d12/d37/f108 [0,4194304] 0 2023-12-16T03:16:02.717 INFO:tasks.workunit.client.0.smithi064.stdout:1/383: rmdir d3/dd/d11/d38 39 2023-12-16T03:16:02.718 INFO:tasks.workunit.client.1.smithi184.stdout:7/633: symlink d0/d3/d2e/d79/d32/d39/d9c/lb8 0 2023-12-16T03:16:02.719 INFO:tasks.workunit.client.1.smithi184.stdout:7/634: fsync d0/d3/d2e/d79/d1e/f20 0 2023-12-16T03:16:02.719 INFO:tasks.workunit.client.1.smithi184.stdout:7/635: truncate d0/d3/d2e/d79/dd/d75/fb3 923353 0 2023-12-16T03:16:02.719 INFO:tasks.workunit.client.1.smithi184.stdout:7/636: read d0/d3/d4/f5e [4178508,82310] 0 2023-12-16T03:16:02.719 INFO:tasks.workunit.client.0.smithi064.stdout:6/358: unlink d3/d8/d1f/d26/l3a 0 2023-12-16T03:16:02.719 INFO:tasks.workunit.client.0.smithi064.stdout:6/359: truncate d3/d8/d13/d46/d5e/f64 429342 0 2023-12-16T03:16:02.720 INFO:tasks.workunit.client.1.smithi184.stdout:4/698: creat d1/d12/db3/db8/dd2/fee x:0 0 0 2023-12-16T03:16:02.720 INFO:tasks.workunit.client.1.smithi184.stdout:4/699: chown d1/d12/d13/d40/d43/d5e/d6a 32122 1 2023-12-16T03:16:02.721 INFO:tasks.workunit.client.0.smithi064.stdout:5/367: creat d0/d7/d34/f83 x:0 0 0 2023-12-16T03:16:02.724 INFO:tasks.workunit.client.0.smithi064.stdout:3/409: creat db/d12/d4e/d56/f89 x:0 0 0 2023-12-16T03:16:02.725 INFO:tasks.workunit.client.0.smithi064.stdout:3/410: write f4 [2688252,93128] 0 2023-12-16T03:16:02.725 INFO:tasks.workunit.client.0.smithi064.stdout:3/411: chown db/d12/d1a/d31/f64 7469 1 2023-12-16T03:16:02.726 INFO:tasks.workunit.client.0.smithi064.stdout:7/411: dread d7/d3e/f78 [0,4194304] 0 2023-12-16T03:16:02.727 INFO:tasks.workunit.client.1.smithi184.stdout:5/560: link d1/d3/d9/de/d15/d19/d48/l96 d1/d3/d9/de/d15/d19/d48/lb3 0 2023-12-16T03:16:02.728 INFO:tasks.workunit.client.0.smithi064.stdout:6/360: dread d3/d9/f45 [0,4194304] 0 2023-12-16T03:16:02.728 INFO:tasks.workunit.client.0.smithi064.stdout:6/361: write d3/d8/d13/d46/f50 [1502329,16021] 0 2023-12-16T03:16:02.731 INFO:tasks.workunit.client.1.smithi184.stdout:9/915: mknod d0/d13/d20/d5b/d43/dab/c132 0 2023-12-16T03:16:02.734 INFO:tasks.workunit.client.0.smithi064.stdout:4/436: creat d0/d42/d66/d33/f80 x:0 0 0 2023-12-16T03:16:02.734 INFO:tasks.workunit.client.1.smithi184.stdout:8/756: creat d2/d4/d10/d11/d77/ff5 x:0 0 0 2023-12-16T03:16:02.743 INFO:tasks.workunit.client.0.smithi064.stdout:5/368: dread d0/d14/d20/d37/f51 [0,4194304] 0 2023-12-16T03:16:02.744 INFO:tasks.workunit.client.1.smithi184.stdout:6/783: mknod d0/dee/cfd 0 2023-12-16T03:16:02.744 INFO:tasks.workunit.client.1.smithi184.stdout:6/784: chown d0/d5/d26/f75 876746 1 2023-12-16T03:16:02.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/334: creat d2/d7/d10/d21/d31/f65 x:0 0 0 2023-12-16T03:16:02.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/335: dread - d2/d7/d10/d21/d31/f65 zero size 2023-12-16T03:16:02.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/336: getdents d2/d8/da/d11/d64 0 2023-12-16T03:16:02.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/337: stat d2/d8/da/d11 0 2023-12-16T03:16:02.747 INFO:tasks.workunit.client.0.smithi064.stdout:1/384: mknod d3/d36/c7d 0 2023-12-16T03:16:02.750 INFO:tasks.workunit.client.1.smithi184.stdout:5/561: dwrite d1/d3/d9/f50 [0,4194304] 0 2023-12-16T03:16:02.750 INFO:tasks.workunit.client.1.smithi184.stdout:3/808: getdents d12/d1e/de8/d48/d7b 0 2023-12-16T03:16:02.751 INFO:tasks.workunit.client.1.smithi184.stdout:9/916: dwrite d0/d76/dbf/f118 [0,4194304] 0 2023-12-16T03:16:02.752 INFO:tasks.workunit.client.0.smithi064.stdout:7/412: mknod d7/d3e/d42/d48/c7b 0 2023-12-16T03:16:02.753 INFO:tasks.workunit.client.0.smithi064.stdout:6/362: mkdir d3/d8/d13/d58/d65 0 2023-12-16T03:16:02.753 INFO:tasks.workunit.client.0.smithi064.stdout:6/363: write d3/d8/f5f [823357,89310] 0 2023-12-16T03:16:02.754 INFO:tasks.workunit.client.1.smithi184.stdout:7/637: stat d0/d3/d2e/l74 0 2023-12-16T03:16:02.754 INFO:tasks.workunit.client.1.smithi184.stdout:7/638: chown d0/d3/d2e/d79/d32 0 1 2023-12-16T03:16:02.754 INFO:tasks.workunit.client.1.smithi184.stdout:7/639: getdents d0/d6b/d69/db5 0 2023-12-16T03:16:02.754 INFO:tasks.workunit.client.1.smithi184.stdout:7/640: dread - d0/d3/d2e/d79/d32/d39/d8f/fa0 zero size 2023-12-16T03:16:02.754 INFO:tasks.workunit.client.1.smithi184.stdout:7/641: stat d0/d3/d2e/d79/f4d 0 2023-12-16T03:16:02.756 INFO:tasks.workunit.client.0.smithi064.stdout:4/437: creat d0/d42/d66/d33/f81 x:0 0 0 2023-12-16T03:16:02.759 INFO:tasks.workunit.client.1.smithi184.stdout:4/700: creat d1/d29/d34/d5c/d76/fef x:0 0 0 2023-12-16T03:16:02.759 INFO:tasks.workunit.client.1.smithi184.stdout:4/701: stat d1/d11/d1b 0 2023-12-16T03:16:02.760 INFO:tasks.workunit.client.0.smithi064.stdout:5/369: mkdir d0/d14/d25/d5e/d84 0 2023-12-16T03:16:02.763 INFO:tasks.workunit.client.1.smithi184.stdout:8/757: link d2/d4/d10/d7a/ff1 d2/d4/d10/d7a/d83/d8b/ff6 0 2023-12-16T03:16:02.765 INFO:tasks.workunit.client.0.smithi064.stdout:1/385: mknod d3/d22/d57/c7e 0 2023-12-16T03:16:02.766 INFO:tasks.workunit.client.1.smithi184.stdout:6/785: getdents d0/d5/d42 0 2023-12-16T03:16:02.766 INFO:tasks.workunit.client.1.smithi184.stdout:8/758: dread d2/d12/d21/d2d/fa2 [0,4194304] 0 2023-12-16T03:16:02.767 INFO:tasks.workunit.client.1.smithi184.stdout:8/759: fsync d2/d37/db8/fe9 0 2023-12-16T03:16:02.767 INFO:tasks.workunit.client.1.smithi184.stdout:9/917: dread d0/d3a/d47/f71 [0,4194304] 0 2023-12-16T03:16:02.768 INFO:tasks.workunit.client.1.smithi184.stdout:3/809: rename f4 to d12/d86/de4/d99/f12f 0 2023-12-16T03:16:02.769 INFO:tasks.workunit.client.0.smithi064.stdout:3/412: fsync db/d12/d4e/f88 0 2023-12-16T03:16:02.771 INFO:tasks.workunit.client.1.smithi184.stdout:8/760: read d2/d12/d21/d2d/d31/f68 [988813,106538] 0 2023-12-16T03:16:02.772 INFO:tasks.workunit.client.1.smithi184.stdout:8/761: fsync d2/d4/f44 0 2023-12-16T03:16:02.773 INFO:tasks.workunit.client.1.smithi184.stdout:7/642: dwrite d0/d3/d68/fa7 [0,4194304] 0 2023-12-16T03:16:02.773 INFO:tasks.workunit.client.1.smithi184.stdout:5/562: dwrite d1/d2a/d31/f73 [0,4194304] 0 2023-12-16T03:16:02.773 INFO:tasks.workunit.client.1.smithi184.stdout:4/702: creat d1/d29/d34/d5c/d76/d42/ff0 x:0 0 0 2023-12-16T03:16:02.776 INFO:tasks.workunit.client.1.smithi184.stdout:6/786: link d0/d5/d22/d25/d47/cdc d0/d36/d79/cfe 0 2023-12-16T03:16:02.779 INFO:tasks.workunit.client.1.smithi184.stdout:1/678: sync 2023-12-16T03:16:02.780 INFO:tasks.workunit.client.1.smithi184.stdout:0/742: sync 2023-12-16T03:16:02.780 INFO:tasks.workunit.client.1.smithi184.stdout:2/596: sync 2023-12-16T03:16:02.781 INFO:tasks.workunit.client.1.smithi184.stdout:9/918: creat d0/d13/d20/d5b/d43/dab/f133 x:0 0 0 2023-12-16T03:16:02.783 INFO:tasks.workunit.client.0.smithi064.stdout:7/413: truncate d7/d3e/d42/d43/f5f 482590 0 2023-12-16T03:16:02.783 INFO:tasks.workunit.client.1.smithi184.stdout:7/643: dread d0/d3/d2e/d79/dd/f1d [0,4194304] 0 2023-12-16T03:16:02.784 INFO:tasks.workunit.client.1.smithi184.stdout:3/810: getdents d12/d18/d1f/d23/d2a/d36 0 2023-12-16T03:16:02.784 INFO:tasks.workunit.client.1.smithi184.stdout:8/762: creat d2/d4/d10/d7a/ff7 x:0 0 0 2023-12-16T03:16:02.785 INFO:tasks.workunit.client.0.smithi064.stdout:6/364: truncate d3/d8/d13/d58/f5c 1496417 0 2023-12-16T03:16:02.787 INFO:tasks.workunit.client.0.smithi064.stdout:4/438: link d0/d42/d66/f26 d0/d42/d4c/d70/f82 0 2023-12-16T03:16:02.787 INFO:tasks.workunit.client.1.smithi184.stdout:3/811: dread d12/d18/d1f/d23/d2a/d4a/fd2 [0,4194304] 0 2023-12-16T03:16:02.787 INFO:tasks.workunit.client.1.smithi184.stdout:6/787: dread d0/d5/d22/d25/d47/fac [0,4194304] 0 2023-12-16T03:16:02.788 INFO:tasks.workunit.client.0.smithi064.stdout:4/439: write d0/d1e/d36/f4d [780583,119094] 0 2023-12-16T03:16:02.792 INFO:tasks.workunit.client.0.smithi064.stdout:5/370: symlink d0/d19/d48/l85 0 2023-12-16T03:16:02.794 INFO:tasks.workunit.client.1.smithi184.stdout:3/812: write d12/d18/d1f/d23/d2a/d36/f8d [959495,83550] 0 2023-12-16T03:16:02.794 INFO:tasks.workunit.client.1.smithi184.stdout:3/813: truncate d12/d86/de4/d99/d117/db4/ffb 192230 0 2023-12-16T03:16:02.795 INFO:tasks.workunit.client.0.smithi064.stdout:3/413: creat db/d12/d1a/d2c/d6e/d75/f8a x:0 0 0 2023-12-16T03:16:02.795 INFO:tasks.workunit.client.0.smithi064.stdout:3/414: chown db/d12/d1a/d2c/l7c 1 1 2023-12-16T03:16:02.795 INFO:tasks.workunit.client.0.smithi064.stdout:3/415: dread - db/d12/d1a/d2c/d34/d4c/d6a/f81 zero size 2023-12-16T03:16:02.798 INFO:tasks.workunit.client.0.smithi064.stdout:4/440: rename d0/l32 to d0/d42/l83 0 2023-12-16T03:16:02.800 INFO:tasks.workunit.client.0.smithi064.stdout:3/416: write db/d12/d1a/d2c/d34/f3d [3793730,14479] 0 2023-12-16T03:16:02.800 INFO:tasks.workunit.client.0.smithi064.stdout:3/417: stat db/d12/d1a/l4d 0 2023-12-16T03:16:02.800 INFO:tasks.workunit.client.0.smithi064.stdout:3/418: chown db/d12/d1a/d2c/l7c 8488003 1 2023-12-16T03:16:02.800 INFO:tasks.workunit.client.0.smithi064.stdout:6/365: dread d3/d9/f20 [4194304,4194304] 0 2023-12-16T03:16:02.800 INFO:tasks.workunit.client.1.smithi184.stdout:4/703: link d1/d11/d5a/d63/d72/d98/lab d1/d11/d1b/d1e/lf1 0 2023-12-16T03:16:02.800 INFO:tasks.workunit.client.1.smithi184.stdout:3/814: dread d12/d18/d68/f6e [0,4194304] 0 2023-12-16T03:16:02.801 INFO:tasks.workunit.client.1.smithi184.stdout:6/788: dread d0/d5/d22/d25/f92 [0,4194304] 0 2023-12-16T03:16:02.801 INFO:tasks.workunit.client.0.smithi064.stdout:5/371: unlink d0/d14/d20/d37/d70/f74 0 2023-12-16T03:16:02.802 INFO:tasks.workunit.client.1.smithi184.stdout:9/919: dwrite d0/d76/db7/feb [0,4194304] 0 2023-12-16T03:16:02.804 INFO:tasks.workunit.client.0.smithi064.stdout:4/441: symlink d0/d42/d66/d33/l84 0 2023-12-16T03:16:02.804 INFO:tasks.workunit.client.0.smithi064.stdout:4/442: chown d0/d12/l3e 15170446 1 2023-12-16T03:16:02.804 INFO:tasks.workunit.client.0.smithi064.stdout:4/443: chown d0/d42/d56 1741 1 2023-12-16T03:16:02.804 INFO:tasks.workunit.client.1.smithi184.stdout:2/597: truncate d3/d29/f78 1040741 0 2023-12-16T03:16:02.806 INFO:tasks.workunit.client.1.smithi184.stdout:1/679: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/fe6 x:0 0 0 2023-12-16T03:16:02.810 INFO:tasks.workunit.client.0.smithi064.stdout:3/419: creat db/d12/d1a/d2c/d34/f8b x:0 0 0 2023-12-16T03:16:02.810 INFO:tasks.workunit.client.1.smithi184.stdout:1/680: write f0 [804171,94571] 0 2023-12-16T03:16:02.811 INFO:tasks.workunit.client.1.smithi184.stdout:0/743: creat dc/d22/d1d/d35/f101 x:0 0 0 2023-12-16T03:16:02.814 INFO:tasks.workunit.client.1.smithi184.stdout:7/644: creat d0/d3/d2e/d79/d32/fb9 x:0 0 0 2023-12-16T03:16:02.816 INFO:tasks.workunit.client.0.smithi064.stdout:3/420: creat db/d12/d1a/d2c/d34/d4c/f8c x:0 0 0 2023-12-16T03:16:02.819 INFO:tasks.workunit.client.0.smithi064.stdout:3/421: write db/d12/d1a/f38 [2711553,43886] 0 2023-12-16T03:16:02.820 INFO:tasks.workunit.client.0.smithi064.stdout:6/366: symlink d3/d8/d13/d46/l66 0 2023-12-16T03:16:02.820 INFO:tasks.workunit.client.1.smithi184.stdout:7/645: write d0/f77 [1124101,30345] 0 2023-12-16T03:16:02.823 INFO:tasks.workunit.client.0.smithi064.stdout:3/422: creat db/d12/d4e/f8d x:0 0 0 2023-12-16T03:16:02.823 INFO:tasks.workunit.client.1.smithi184.stdout:8/763: link d2/d4/d10/d11/f3f d2/d37/d7c/dd7/ff8 0 2023-12-16T03:16:02.823 INFO:tasks.workunit.client.1.smithi184.stdout:5/563: mknod d1/d2a/d31/d28/d72/cb4 0 2023-12-16T03:16:02.823 INFO:tasks.workunit.client.1.smithi184.stdout:8/764: truncate d2/d12/d21/d8a/dda/d73/fe7 859411 0 2023-12-16T03:16:02.825 INFO:tasks.workunit.client.1.smithi184.stdout:4/704: rename d1/l10 to d1/d29/d34/lf2 0 2023-12-16T03:16:02.825 INFO:tasks.workunit.client.1.smithi184.stdout:4/705: write d1/d12/db3/db8/dd2/fee [153779,107785] 0 2023-12-16T03:16:02.826 INFO:tasks.workunit.client.0.smithi064.stdout:4/444: dwrite d0/d42/f5c [0,4194304] 0 2023-12-16T03:16:02.826 INFO:tasks.workunit.client.0.smithi064.stdout:6/367: mkdir d3/d8/d1f/d26/d47/d4a/d67 0 2023-12-16T03:16:02.828 INFO:tasks.workunit.client.0.smithi064.stdout:3/423: dread db/d13/d39/f43 [0,4194304] 0 2023-12-16T03:16:02.828 INFO:tasks.workunit.client.1.smithi184.stdout:3/815: symlink d12/d1e/d89/l130 0 2023-12-16T03:16:02.828 INFO:tasks.workunit.client.1.smithi184.stdout:3/816: chown d12/d18/d1f/d23/d2a/d42/d52/d76/c124 22319879 1 2023-12-16T03:16:02.828 INFO:tasks.workunit.client.1.smithi184.stdout:3/817: stat d12/d18/d1f/d23/d51/dd7/de3/de1 0 2023-12-16T03:16:02.829 INFO:tasks.workunit.client.1.smithi184.stdout:3/818: write d12/d18/d68/f9a [4975152,103913] 0 2023-12-16T03:16:02.830 INFO:tasks.workunit.client.0.smithi064.stdout:5/372: dwrite d0/d7/f2e [0,4194304] 0 2023-12-16T03:16:02.832 INFO:tasks.workunit.client.1.smithi184.stdout:6/789: rename d0/d5/d12/d1b/d33/d3d/da2/dbc to d0/d5/d12/d1b/d33/d3d/da2/dff 0 2023-12-16T03:16:02.837 INFO:tasks.workunit.client.0.smithi064.stdout:6/368: dread d3/d8/d1f/d26/f3b [0,4194304] 0 2023-12-16T03:16:02.841 INFO:tasks.workunit.client.0.smithi064.stdout:4/445: mkdir d0/d42/d4c/d70/d85 0 2023-12-16T03:16:02.841 INFO:tasks.workunit.client.1.smithi184.stdout:9/920: mkdir d0/d13/d20/d10c/d134 0 2023-12-16T03:16:02.841 INFO:tasks.workunit.client.1.smithi184.stdout:5/564: dread d1/d3/d9/de/d15/d19/f2c [0,4194304] 0 2023-12-16T03:16:02.842 INFO:tasks.workunit.client.1.smithi184.stdout:3/819: write d12/d1e/de8/d48/d7b/f85 [3748162,50023] 0 2023-12-16T03:16:02.842 INFO:tasks.workunit.client.1.smithi184.stdout:2/598: rmdir d3/d29/d61/d6d 39 2023-12-16T03:16:02.843 INFO:tasks.workunit.client.0.smithi064.stdout:4/446: dread d0/d42/d66/f26 [0,4194304] 0 2023-12-16T03:16:02.843 INFO:tasks.workunit.client.0.smithi064.stdout:4/447: fdatasync d0/d42/f52 0 2023-12-16T03:16:02.843 INFO:tasks.workunit.client.0.smithi064.stdout:4/448: chown d0/d12/f79 113897 1 2023-12-16T03:16:02.843 INFO:tasks.workunit.client.0.smithi064.stdout:4/449: write d0/d12/d48/f4f [822203,10177] 0 2023-12-16T03:16:02.843 INFO:tasks.workunit.client.0.smithi064.stdout:4/450: write d0/da/f7a [103038,26362] 0 2023-12-16T03:16:02.844 INFO:tasks.workunit.client.0.smithi064.stdout:3/424: creat db/d13/d39/f8e x:0 0 0 2023-12-16T03:16:02.844 INFO:tasks.workunit.client.1.smithi184.stdout:1/681: stat d3/d13/cd4 0 2023-12-16T03:16:02.844 INFO:tasks.workunit.client.1.smithi184.stdout:1/682: chown d3/d34/dbc/d3c/d41/d46/l88 252577 1 2023-12-16T03:16:02.844 INFO:tasks.workunit.client.1.smithi184.stdout:1/683: write d3/d34/d76/f85 [1445075,18061] 0 2023-12-16T03:16:02.845 INFO:tasks.workunit.client.1.smithi184.stdout:1/684: readlink d3/d34/dbc/d3c/d41/ld7 0 2023-12-16T03:16:02.850 INFO:tasks.workunit.client.0.smithi064.stdout:5/373: symlink d0/d14/d25/d3e/l86 0 2023-12-16T03:16:02.850 INFO:tasks.workunit.client.0.smithi064.stdout:4/451: link d0/d42/l4b d0/d42/d4c/l86 0 2023-12-16T03:16:02.851 INFO:tasks.workunit.client.1.smithi184.stdout:0/744: symlink dc/d22/d45/d66/d80/l102 0 2023-12-16T03:16:02.851 INFO:tasks.workunit.client.1.smithi184.stdout:8/765: dwrite d2/d6a/fd3 [0,4194304] 0 2023-12-16T03:16:02.852 INFO:tasks.workunit.client.1.smithi184.stdout:7/646: creat d0/d3/d2e/d79/d1e/fba x:0 0 0 2023-12-16T03:16:02.852 INFO:tasks.workunit.client.0.smithi064.stdout:5/374: dread d0/d19/f4a [0,4194304] 0 2023-12-16T03:16:02.854 INFO:tasks.workunit.client.0.smithi064.stdout:4/452: mkdir d0/d12/d48/d87 0 2023-12-16T03:16:02.854 INFO:tasks.workunit.client.1.smithi184.stdout:4/706: symlink d1/d12/d13/da1/lf3 0 2023-12-16T03:16:02.856 INFO:tasks.workunit.client.0.smithi064.stdout:3/425: symlink db/d12/d1a/l8f 0 2023-12-16T03:16:02.856 INFO:tasks.workunit.client.0.smithi064.stdout:3/426: chown db/d12/d1a/l4d 1906503764 1 2023-12-16T03:16:02.857 INFO:tasks.workunit.client.0.smithi064.stdout:4/453: rmdir d0/da 39 2023-12-16T03:16:02.859 INFO:tasks.workunit.client.1.smithi184.stdout:6/790: creat d0/d5/d22/d37/d4d/d87/f100 x:0 0 0 2023-12-16T03:16:02.859 INFO:tasks.workunit.client.1.smithi184.stdout:6/791: write d0/d5/d42/fad [1588966,941] 0 2023-12-16T03:16:02.860 INFO:tasks.workunit.client.0.smithi064.stdout:6/369: dwrite d3/d8/d1f/f5a [0,4194304] 0 2023-12-16T03:16:02.860 INFO:tasks.workunit.client.0.smithi064.stdout:6/370: chown d3/d8/d13/d46 1 1 2023-12-16T03:16:02.860 INFO:tasks.workunit.client.0.smithi064.stdout:3/427: mkdir db/d12/d1a/d2c/d90 0 2023-12-16T03:16:02.861 INFO:tasks.workunit.client.0.smithi064.stdout:4/454: creat d0/da/f88 x:0 0 0 2023-12-16T03:16:02.862 INFO:tasks.workunit.client.0.smithi064.stdout:4/455: chown d0/d1e/d36/f7e 1015911 1 2023-12-16T03:16:02.863 INFO:tasks.workunit.client.1.smithi184.stdout:9/921: unlink d0/d76/db2/f10e 0 2023-12-16T03:16:02.863 INFO:tasks.workunit.client.1.smithi184.stdout:9/922: readlink d0/d13/d6e/d84/lc3 0 2023-12-16T03:16:02.863 INFO:tasks.workunit.client.1.smithi184.stdout:9/923: fsync d0/d3a/d47/f67 0 2023-12-16T03:16:02.864 INFO:tasks.workunit.client.1.smithi184.stdout:5/565: rmdir d1/d3 39 2023-12-16T03:16:02.866 INFO:tasks.workunit.client.1.smithi184.stdout:4/707: dread d1/d12/d13/d40/d43/d5e/fa8 [0,4194304] 0 2023-12-16T03:16:02.872 INFO:tasks.workunit.client.0.smithi064.stdout:6/371: creat d3/d9/f68 x:0 0 0 2023-12-16T03:16:02.875 INFO:tasks.workunit.client.1.smithi184.stdout:3/820: link d12/d18/d1f/d23/d2a/d36/l5c d12/d18/d1f/d23/d2a/dfc/l131 0 2023-12-16T03:16:02.878 INFO:tasks.workunit.client.0.smithi064.stdout:4/456: creat d0/d1e/f89 x:0 0 0 2023-12-16T03:16:02.884 INFO:tasks.workunit.client.0.smithi064.stdout:6/372: symlink d3/d8/l69 0 2023-12-16T03:16:02.885 INFO:tasks.workunit.client.1.smithi184.stdout:2/599: rename d3/d29/d2f/d2e/c21 to d3/d9/d19/cc7 0 2023-12-16T03:16:02.885 INFO:tasks.workunit.client.1.smithi184.stdout:2/600: readlink d3/d29/d2f/l42 0 2023-12-16T03:16:02.885 INFO:tasks.workunit.client.1.smithi184.stdout:2/601: truncate d3/d29/d2f/d2e/f7 960213 0 2023-12-16T03:16:02.885 INFO:tasks.workunit.client.1.smithi184.stdout:1/685: symlink d3/d34/d76/d91/le7 0 2023-12-16T03:16:02.887 INFO:tasks.workunit.client.0.smithi064.stdout:3/428: mknod db/d12/d4e/c91 0 2023-12-16T03:16:02.889 INFO:tasks.workunit.client.1.smithi184.stdout:8/766: rmdir d2/d6a 39 2023-12-16T03:16:02.890 INFO:tasks.workunit.client.0.smithi064.stdout:4/457: mknod d0/d12/d48/d87/c8a 0 2023-12-16T03:16:02.894 INFO:tasks.workunit.client.0.smithi064.stdout:6/373: symlink d3/d9/l6a 0 2023-12-16T03:16:02.896 INFO:tasks.workunit.client.1.smithi184.stdout:7/647: mknod d0/d3/d2e/cbb 0 2023-12-16T03:16:02.896 INFO:tasks.workunit.client.1.smithi184.stdout:0/745: creat dc/d10/d2d/f103 x:0 0 0 2023-12-16T03:16:02.897 INFO:tasks.workunit.client.0.smithi064.stdout:3/429: mkdir db/d12/d1a/d2c/d6e/d75/d92 0 2023-12-16T03:16:02.897 INFO:tasks.workunit.client.1.smithi184.stdout:6/792: creat d0/f101 x:0 0 0 2023-12-16T03:16:02.898 INFO:tasks.workunit.client.1.smithi184.stdout:8/767: dread d2/d6a/da4/f88 [0,4194304] 0 2023-12-16T03:16:02.899 INFO:tasks.workunit.client.1.smithi184.stdout:9/924: symlink d0/d13/d20/db0/l135 0 2023-12-16T03:16:02.899 INFO:tasks.workunit.client.1.smithi184.stdout:9/925: write d0/d76/da2/dc4/f105 [1068104,76991] 0 2023-12-16T03:16:02.900 INFO:tasks.workunit.client.0.smithi064.stdout:6/374: truncate d3/d8/d13/f24 31376 0 2023-12-16T03:16:02.903 INFO:tasks.workunit.client.1.smithi184.stdout:3/821: dwrite d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f3c [0,4194304] 0 2023-12-16T03:16:02.903 INFO:tasks.workunit.client.0.smithi064.stdout:3/430: chown db/d12/d1a/l4a 6368 1 2023-12-16T03:16:02.903 INFO:tasks.workunit.client.0.smithi064.stdout:3/431: truncate db/d12/d1a/f54 4740501 0 2023-12-16T03:16:02.905 INFO:tasks.workunit.client.0.smithi064.stdout:3/432: mkdir db/d12/d1a/d2c/d34/d4c/d6a/d93 0 2023-12-16T03:16:02.905 INFO:tasks.workunit.client.0.smithi064.stdout:3/433: write db/d12/d4e/f73 [43578,79086] 0 2023-12-16T03:16:02.905 INFO:tasks.workunit.client.0.smithi064.stdout:3/434: stat db/d12/d1a/f28 0 2023-12-16T03:16:02.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/435: creat db/d12/d1a/d2c/d34/d4c/d6a/f94 x:0 0 0 2023-12-16T03:16:02.908 INFO:tasks.workunit.client.1.smithi184.stdout:4/708: symlink d1/d29/d34/d5c/d76/d3b/lf4 0 2023-12-16T03:16:02.908 INFO:tasks.workunit.client.1.smithi184.stdout:1/686: symlink d3/d34/dbc/d3c/d41/d46/d4a/le8 0 2023-12-16T03:16:02.909 INFO:tasks.workunit.client.1.smithi184.stdout:1/687: write d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/d99/db7/fbb [912584,78310] 0 2023-12-16T03:16:02.909 INFO:tasks.workunit.client.1.smithi184.stdout:7/648: symlink d0/d3/d2e/d79/d32/d39/d8f/lbc 0 2023-12-16T03:16:02.909 INFO:tasks.workunit.client.1.smithi184.stdout:6/793: dread d0/d5/d12/f1c [0,4194304] 0 2023-12-16T03:16:02.909 INFO:tasks.workunit.client.1.smithi184.stdout:6/794: chown d0/d5/d22/d25/c70 128912796 1 2023-12-16T03:16:02.909 INFO:tasks.workunit.client.1.smithi184.stdout:6/795: write d0/d5/dd1/fd9 [718337,113889] 0 2023-12-16T03:16:02.910 INFO:tasks.workunit.client.1.smithi184.stdout:0/746: truncate dc/d10/d1c/f2f 407763 0 2023-12-16T03:16:02.910 INFO:tasks.workunit.client.1.smithi184.stdout:0/747: fdatasync dc/d22/d1d/d8e/fa4 0 2023-12-16T03:16:02.911 INFO:tasks.workunit.client.0.smithi064.stdout:3/436: mknod db/d12/c95 0 2023-12-16T03:16:02.914 INFO:tasks.workunit.client.0.smithi064.stdout:3/437: mknod db/d12/d1a/d2c/d90/c96 0 2023-12-16T03:16:02.918 INFO:tasks.workunit.client.1.smithi184.stdout:3/822: creat d12/d18/d1f/d23/d2a/d42/de9/f132 x:0 0 0 2023-12-16T03:16:02.918 INFO:tasks.workunit.client.1.smithi184.stdout:3/823: chown d12/d18/d1f/d23/d51/dd7/de3/l123 129406 1 2023-12-16T03:16:02.919 INFO:tasks.workunit.client.0.smithi064.stdout:3/438: creat db/d12/d1a/f97 x:0 0 0 2023-12-16T03:16:02.919 INFO:tasks.workunit.client.0.smithi064.stdout:3/439: write db/d13/d39/f86 [98187,40891] 0 2023-12-16T03:16:02.920 INFO:tasks.workunit.client.1.smithi184.stdout:4/709: symlink d1/lf5 0 2023-12-16T03:16:02.922 INFO:tasks.workunit.client.0.smithi064.stdout:3/440: mknod db/d12/d1a/d31/c98 0 2023-12-16T03:16:02.922 INFO:tasks.workunit.client.0.smithi064.stdout:3/441: dread - db/d12/d1a/f1d zero size 2023-12-16T03:16:02.923 INFO:tasks.workunit.client.0.smithi064.stdout:3/442: read db/d4f/f6b [150659,114204] 0 2023-12-16T03:16:02.929 INFO:tasks.workunit.client.0.smithi064.stdout:4/458: dwrite d0/d42/d66/f30 [0,4194304] 0 2023-12-16T03:16:02.929 INFO:tasks.workunit.client.0.smithi064.stdout:4/459: read d0/da/f6f [106708,32023] 0 2023-12-16T03:16:02.930 INFO:tasks.workunit.client.1.smithi184.stdout:4/710: write d1/d12/d13/f31 [3770255,1772] 0 2023-12-16T03:16:02.931 INFO:tasks.workunit.client.1.smithi184.stdout:1/688: rename d3/d13/f29 to d3/d13/d2c/fe9 0 2023-12-16T03:16:02.931 INFO:tasks.workunit.client.1.smithi184.stdout:1/689: write d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/fe6 [48364,4055] 0 2023-12-16T03:16:02.931 INFO:tasks.workunit.client.1.smithi184.stdout:1/690: stat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5 0 2023-12-16T03:16:02.932 INFO:tasks.workunit.client.1.smithi184.stdout:1/691: readlink d3/d34/dbc/d3c/d41/d46/d4a/le8 0 2023-12-16T03:16:02.932 INFO:tasks.workunit.client.0.smithi064.stdout:4/460: rename d0/d42/d56/c61 to d0/d1e/d36/c8b 0 2023-12-16T03:16:02.933 INFO:tasks.workunit.client.0.smithi064.stdout:4/461: mkdir d0/d42/d4c/d70/d8c 0 2023-12-16T03:16:02.933 INFO:tasks.workunit.client.0.smithi064.stdout:4/462: stat d0/d42/d56/c6c 0 2023-12-16T03:16:02.933 INFO:tasks.workunit.client.0.smithi064.stdout:4/463: write d0/da/f6f [778752,70285] 0 2023-12-16T03:16:02.934 INFO:tasks.workunit.client.0.smithi064.stdout:4/464: getdents d0 0 2023-12-16T03:16:02.934 INFO:tasks.workunit.client.1.smithi184.stdout:7/649: fsync d0/d3/d2e/d79/d32/fb9 0 2023-12-16T03:16:02.935 INFO:tasks.workunit.client.1.smithi184.stdout:9/926: dread d0/d30/f41 [0,4194304] 0 2023-12-16T03:16:02.935 INFO:tasks.workunit.client.0.smithi064.stdout:4/465: symlink d0/d42/d4c/d70/d85/l8d 0 2023-12-16T03:16:02.936 INFO:tasks.workunit.client.1.smithi184.stdout:2/602: dwrite d3/d13/d28/dac/fb1 [0,4194304] 0 2023-12-16T03:16:02.936 INFO:tasks.workunit.client.1.smithi184.stdout:2/603: write d3/d29/d2f/d2e/f35 [4403275,57650] 0 2023-12-16T03:16:02.936 INFO:tasks.workunit.client.1.smithi184.stdout:2/604: readlink d3/d9/d19/d87/l36 0 2023-12-16T03:16:02.937 INFO:tasks.workunit.client.1.smithi184.stdout:8/768: getdents d2/d37/d7c/dd7 0 2023-12-16T03:16:02.937 INFO:tasks.workunit.client.1.smithi184.stdout:8/769: chown d2/d12/d21 815 1 2023-12-16T03:16:02.938 INFO:tasks.workunit.client.0.smithi064.stdout:4/466: mknod d0/d42/d66/d5a/d75/c8e 0 2023-12-16T03:16:02.940 INFO:tasks.workunit.client.1.smithi184.stdout:3/824: dread d12/d37/f67 [0,4194304] 0 2023-12-16T03:16:02.940 INFO:tasks.workunit.client.1.smithi184.stdout:3/825: truncate d12/d86/de4/d99/d117/db4/ffb 899651 0 2023-12-16T03:16:02.940 INFO:tasks.workunit.client.1.smithi184.stdout:3/826: chown d12/d18/d68/l105 892181136 1 2023-12-16T03:16:02.942 INFO:tasks.workunit.client.1.smithi184.stdout:8/770: dread d2/d12/d21/f8c [0,4194304] 0 2023-12-16T03:16:02.942 INFO:tasks.workunit.client.1.smithi184.stdout:8/771: chown d2/d6a/fef 909869 1 2023-12-16T03:16:02.943 INFO:tasks.workunit.client.0.smithi064.stdout:4/467: creat d0/d1e/d36/f8f x:0 0 0 2023-12-16T03:16:02.945 INFO:tasks.workunit.client.1.smithi184.stdout:9/927: mknod d0/d13/d20/d5b/d43/d11a/c136 0 2023-12-16T03:16:02.947 INFO:tasks.workunit.client.0.smithi064.stdout:4/468: mkdir d0/d42/d66/d5a/d90 0 2023-12-16T03:16:02.950 INFO:tasks.workunit.client.0.smithi064.stdout:4/469: link d0/d42/d56/f67 d0/d42/d4c/d70/f91 0 2023-12-16T03:16:02.952 INFO:tasks.workunit.client.0.smithi064.stdout:4/470: symlink d0/d42/d4c/d70/d85/l92 0 2023-12-16T03:16:02.955 INFO:tasks.workunit.client.1.smithi184.stdout:5/566: dread d1/f1a [0,4194304] 0 2023-12-16T03:16:02.955 INFO:tasks.workunit.client.1.smithi184.stdout:5/567: chown d1/d3/d9/de/d15/d19/f1d 1 1 2023-12-16T03:16:02.955 INFO:tasks.workunit.client.1.smithi184.stdout:2/605: mkdir d3/d13/d28/dac/daf/dc8 0 2023-12-16T03:16:02.958 INFO:tasks.workunit.client.1.smithi184.stdout:3/827: creat d12/d18/d84/f133 x:0 0 0 2023-12-16T03:16:02.958 INFO:tasks.workunit.client.1.smithi184.stdout:9/928: creat d0/d76/da2/d120/f137 x:0 0 0 2023-12-16T03:16:02.959 INFO:tasks.workunit.client.1.smithi184.stdout:9/929: creat d0/d76/dbf/d11f/f138 x:0 0 0 2023-12-16T03:16:02.965 INFO:tasks.workunit.client.1.smithi184.stdout:0/748: dwrite dc/d22/d1d/d43/d5a/f89 [4194304,4194304] 0 2023-12-16T03:16:02.965 INFO:tasks.workunit.client.1.smithi184.stdout:3/828: dread d12/d18/d1f/f5d [0,4194304] 0 2023-12-16T03:16:02.966 INFO:tasks.workunit.client.1.smithi184.stdout:2/606: rename d3/d29/d2f/l38 to d3/d29/d2f/d46/lc9 0 2023-12-16T03:16:02.971 INFO:tasks.workunit.client.0.smithi064.stdout:6/375: dwrite d3/d8/d13/d46/f50 [0,4194304] 0 2023-12-16T03:16:02.971 INFO:tasks.workunit.client.1.smithi184.stdout:0/749: mkdir dc/d22/d1d/d35/d104 0 2023-12-16T03:16:02.971 INFO:tasks.workunit.client.1.smithi184.stdout:0/750: write dc/d22/d1d/d43/f59 [3397140,69937] 0 2023-12-16T03:16:02.972 INFO:tasks.workunit.client.1.smithi184.stdout:0/751: chown dc/d22/d45/d66/c81 2120 1 2023-12-16T03:16:02.972 INFO:tasks.workunit.client.1.smithi184.stdout:2/607: unlink d3/d29/d4d/d5b/l5c 0 2023-12-16T03:16:02.974 INFO:tasks.workunit.client.1.smithi184.stdout:0/752: write dc/d22/d45/d66/fae [1767353,12799] 0 2023-12-16T03:16:02.980 INFO:tasks.workunit.client.1.smithi184.stdout:1/692: dwrite d3/d34/dbc/d3c/d41/d46/fd0 [0,4194304] 0 2023-12-16T03:16:02.988 INFO:tasks.workunit.client.0.smithi064.stdout:3/443: getdents db/d12/d1a/d2c/d6e/d75 0 2023-12-16T03:16:02.988 INFO:tasks.workunit.client.0.smithi064.stdout:3/444: dread - db/d12/d1a/d31/f64 zero size 2023-12-16T03:16:02.990 INFO:tasks.workunit.client.1.smithi184.stdout:2/608: unlink d3/d29/d2f/c5a 0 2023-12-16T03:16:02.990 INFO:tasks.workunit.client.1.smithi184.stdout:0/753: getdents dc/d10/d2d 0 2023-12-16T03:16:02.990 INFO:tasks.workunit.client.1.smithi184.stdout:0/754: truncate dc/dab/fba 258883 0 2023-12-16T03:16:02.990 INFO:tasks.workunit.client.1.smithi184.stdout:0/755: chown dc/d22/d1d/d43/d5a/f89 6959 1 2023-12-16T03:16:02.990 INFO:tasks.workunit.client.0.smithi064.stdout:3/445: creat db/d13/f99 x:0 0 0 2023-12-16T03:16:02.991 INFO:tasks.workunit.client.0.smithi064.stdout:3/446: truncate db/d13/f99 895942 0 2023-12-16T03:16:02.991 INFO:tasks.workunit.client.0.smithi064.stdout:3/447: chown db/d12/d1a/d2c/d34/f5a 7 1 2023-12-16T03:16:02.995 INFO:tasks.workunit.client.0.smithi064.stdout:3/448: mknod db/d4f/d51/c9a 0 2023-12-16T03:16:02.995 INFO:tasks.workunit.client.1.smithi184.stdout:1/693: creat d3/d34/dbc/d36/d9f/fea x:0 0 0 2023-12-16T03:16:02.995 INFO:tasks.workunit.client.1.smithi184.stdout:2/609: mknod d3/d29/d2f/d46/d77/cca 0 2023-12-16T03:16:02.998 INFO:tasks.workunit.client.0.smithi064.stdout:3/449: creat db/f9b x:0 0 0 2023-12-16T03:16:02.999 INFO:tasks.workunit.client.1.smithi184.stdout:0/756: getdents dc/d10/d1c 0 2023-12-16T03:16:03.000 INFO:tasks.workunit.client.1.smithi184.stdout:2/610: mkdir d3/d29/d2f/d2e/dcb 0 2023-12-16T03:16:03.002 INFO:tasks.workunit.client.1.smithi184.stdout:0/757: getdents dc/d22/d1d/d35/dd8 0 2023-12-16T03:16:03.002 INFO:tasks.workunit.client.1.smithi184.stdout:0/758: chown dc/d10/d2d/d5f/d7c/cd0 127335 1 2023-12-16T03:16:03.002 INFO:tasks.workunit.client.1.smithi184.stdout:9/930: dwrite d0/d13/d20/d5b/d53/f115 [0,4194304] 0 2023-12-16T03:16:03.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/711: dwrite d1/d12/db3/db8/fdb [0,4194304] 0 2023-12-16T03:16:03.003 INFO:tasks.workunit.client.1.smithi184.stdout:3/829: dwrite d12/d37/d81/fd9 [0,4194304] 0 2023-12-16T03:16:03.003 INFO:tasks.workunit.client.1.smithi184.stdout:2/611: truncate d3/d29/d2f/f54 199413 0 2023-12-16T03:16:03.004 INFO:tasks.workunit.client.1.smithi184.stdout:5/568: dwrite d1/f66 [0,4194304] 0 2023-12-16T03:16:03.005 INFO:tasks.workunit.client.0.smithi064.stdout:3/450: dread db/d13/f99 [0,4194304] 0 2023-12-16T03:16:03.005 INFO:tasks.workunit.client.0.smithi064.stdout:3/451: chown db/d13/d39/f66 47 1 2023-12-16T03:16:03.005 INFO:tasks.workunit.client.0.smithi064.stdout:3/452: fsync db/d12/d1a/d2c/d34/d4c/d6a/f6c 0 2023-12-16T03:16:03.005 INFO:tasks.workunit.client.0.smithi064.stdout:3/453: chown db/d12/d4e/d56/f89 51939549 1 2023-12-16T03:16:03.005 INFO:tasks.workunit.client.0.smithi064.stdout:3/454: stat db/d12/d1a/d2c/d34/f5a 0 2023-12-16T03:16:03.005 INFO:tasks.workunit.client.1.smithi184.stdout:8/772: dwrite d2/d4/d10/d7a/d83/d8b/fab [0,4194304] 0 2023-12-16T03:16:03.005 INFO:tasks.workunit.client.1.smithi184.stdout:8/773: write d2/d4/d10/d11/d77/f82 [450823,38513] 0 2023-12-16T03:16:03.009 INFO:tasks.workunit.client.1.smithi184.stdout:9/931: symlink d0/d3a/l139 0 2023-12-16T03:16:03.013 INFO:tasks.workunit.client.1.smithi184.stdout:4/712: rename d1/d12/d13/d40/c67 to d1/d12/d13/d40/d43/d45/dcf/cf6 0 2023-12-16T03:16:03.013 INFO:tasks.workunit.client.1.smithi184.stdout:4/713: chown d1/cf 656 1 2023-12-16T03:16:03.014 INFO:tasks.workunit.client.1.smithi184.stdout:4/714: write d1/d29/d34/f3d [4422371,112826] 0 2023-12-16T03:16:03.014 INFO:tasks.workunit.client.1.smithi184.stdout:4/715: read - d1/d12/d13/da1/fe2 zero size 2023-12-16T03:16:03.014 INFO:tasks.workunit.client.1.smithi184.stdout:2/612: write d3/d13/d28/f74 [2766306,87459] 0 2023-12-16T03:16:03.014 INFO:tasks.workunit.client.1.smithi184.stdout:2/613: chown d3/d29/d2f/f93 14332 1 2023-12-16T03:16:03.017 INFO:tasks.workunit.client.1.smithi184.stdout:0/759: dread dc/f68 [0,4194304] 0 2023-12-16T03:16:03.022 INFO:tasks.workunit.client.1.smithi184.stdout:8/774: link d2/d12/d21/d2d/d31/l4e d2/d12/d21/lf9 0 2023-12-16T03:16:03.022 INFO:tasks.workunit.client.1.smithi184.stdout:9/932: creat d0/d76/da2/d120/f13a x:0 0 0 2023-12-16T03:16:03.026 INFO:tasks.workunit.client.1.smithi184.stdout:5/569: dwrite d1/d3/d9/d49/d74/fa6 [0,4194304] 0 2023-12-16T03:16:03.026 INFO:tasks.workunit.client.1.smithi184.stdout:1/694: dwrite d3/d34/dbc/d3c/d41/d63/f7e [0,4194304] 0 2023-12-16T03:16:03.026 INFO:tasks.workunit.client.1.smithi184.stdout:1/695: chown d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/fd9 296 1 2023-12-16T03:16:03.026 INFO:tasks.workunit.client.1.smithi184.stdout:4/716: mknod d1/d11/d1b/d1e/cf7 0 2023-12-16T03:16:03.026 INFO:tasks.workunit.client.1.smithi184.stdout:3/830: rename d12/d1e/f101 to d12/d18/d1f/d93/d127/f134 0 2023-12-16T03:16:03.029 INFO:tasks.workunit.client.1.smithi184.stdout:8/775: symlink d2/d12/d21/d8a/dda/d73/lfa 0 2023-12-16T03:16:03.029 INFO:tasks.workunit.client.1.smithi184.stdout:8/776: write d2/d12/d21/d2d/d31/f3a [745703,79888] 0 2023-12-16T03:16:03.029 INFO:tasks.workunit.client.1.smithi184.stdout:0/760: dread dc/d10/d1c/f49 [0,4194304] 0 2023-12-16T03:16:03.031 INFO:tasks.workunit.client.1.smithi184.stdout:9/933: creat d0/d13/d20/d5b/d43/dc7/dda/d117/f13b x:0 0 0 2023-12-16T03:16:03.034 INFO:tasks.workunit.client.1.smithi184.stdout:5/570: mkdir d1/d3/d2f/db5 0 2023-12-16T03:16:03.035 INFO:tasks.workunit.client.1.smithi184.stdout:3/831: creat d12/d86/de4/f135 x:0 0 0 2023-12-16T03:16:03.035 INFO:tasks.workunit.client.1.smithi184.stdout:3/832: chown d12/d18/d1f/d23/d2a/dfc/lb9 158509469 1 2023-12-16T03:16:03.036 INFO:tasks.workunit.client.1.smithi184.stdout:3/833: chown d12/d18/l129 52458 1 2023-12-16T03:16:03.038 INFO:tasks.workunit.client.1.smithi184.stdout:2/614: dwrite d3/d13/d28/dac/fc5 [0,4194304] 0 2023-12-16T03:16:03.038 INFO:tasks.workunit.client.1.smithi184.stdout:2/615: read - d3/f76 zero size 2023-12-16T03:16:03.038 INFO:tasks.workunit.client.1.smithi184.stdout:9/934: mkdir d0/d13/d20/d5b/d53/d13c 0 2023-12-16T03:16:03.038 INFO:tasks.workunit.client.1.smithi184.stdout:9/935: chown d0/d76/da2/dc4/ddb/ff0 5 1 2023-12-16T03:16:03.038 INFO:tasks.workunit.client.1.smithi184.stdout:9/936: truncate d0/d3a/d47/f93 717802 0 2023-12-16T03:16:03.038 INFO:tasks.workunit.client.1.smithi184.stdout:9/937: chown d0/d13/d20/d5b/c103 3 1 2023-12-16T03:16:03.042 INFO:tasks.workunit.client.1.smithi184.stdout:3/834: dread d12/d18/d1f/d23/d2a/d36/f8d [0,4194304] 0 2023-12-16T03:16:03.042 INFO:tasks.workunit.client.1.smithi184.stdout:8/777: dread d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:16:03.045 INFO:tasks.workunit.client.1.smithi184.stdout:8/778: write d2/d12/d21/f6e [790345,83353] 0 2023-12-16T03:16:03.045 INFO:tasks.workunit.client.1.smithi184.stdout:8/779: chown d2/d4/d10/c1e 3 1 2023-12-16T03:16:03.047 INFO:tasks.workunit.client.1.smithi184.stdout:2/616: mknod d3/d13/ccc 0 2023-12-16T03:16:03.047 INFO:tasks.workunit.client.1.smithi184.stdout:9/938: creat d0/d13/d20/d5b/d43/dc7/ddc/dd8/d112/f13d x:0 0 0 2023-12-16T03:16:03.049 INFO:tasks.workunit.client.1.smithi184.stdout:2/617: read d3/d29/d2f/d2e/f1a [1882510,127220] 0 2023-12-16T03:16:03.049 INFO:tasks.workunit.client.1.smithi184.stdout:8/780: dread d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:16:03.056 INFO:tasks.workunit.client.1.smithi184.stdout:9/939: creat d0/d13/d20/f13e x:0 0 0 2023-12-16T03:16:03.056 INFO:tasks.workunit.client.1.smithi184.stdout:5/571: symlink d1/d2a/d31/d28/d72/lb6 0 2023-12-16T03:16:03.056 INFO:tasks.workunit.client.1.smithi184.stdout:5/572: stat d1/d3/d9/de/d15/d27/f81 0 2023-12-16T03:16:03.057 INFO:tasks.workunit.client.1.smithi184.stdout:8/781: mkdir d2/d4/d10/d7a/d83/d8b/de0/dfb 0 2023-12-16T03:16:03.057 INFO:tasks.workunit.client.1.smithi184.stdout:0/761: dwrite dc/d22/d1a/f3e [0,4194304] 0 2023-12-16T03:16:03.057 INFO:tasks.workunit.client.1.smithi184.stdout:0/762: write dc/d22/d45/d66/d80/fe7 [558061,70271] 0 2023-12-16T03:16:03.057 INFO:tasks.workunit.client.1.smithi184.stdout:0/763: write dc/d10/d1c/fe6 [176374,10058] 0 2023-12-16T03:16:03.057 INFO:tasks.workunit.client.1.smithi184.stdout:0/764: fdatasync dc/d22/d1a/f3e 0 2023-12-16T03:16:03.058 INFO:tasks.workunit.client.1.smithi184.stdout:9/940: truncate d0/d13/f2a 3654226 0 2023-12-16T03:16:03.062 INFO:tasks.workunit.client.1.smithi184.stdout:8/782: mkdir d2/d12/db4/dfc 0 2023-12-16T03:16:03.062 INFO:tasks.workunit.client.1.smithi184.stdout:0/765: symlink dc/d22/d1d/d2c/d75/l105 0 2023-12-16T03:16:03.069 INFO:tasks.workunit.client.0.smithi064.stdout:3/455: rmdir db 39 2023-12-16T03:16:03.070 INFO:tasks.workunit.client.1.smithi184.stdout:3/835: dwrite d12/d18/d1f/d23/d2a/fbb [0,4194304] 0 2023-12-16T03:16:03.075 INFO:tasks.workunit.client.1.smithi184.stdout:3/836: truncate d12/d18/d1f/d23/d2a/d36/f8d 359214 0 2023-12-16T03:16:03.076 INFO:tasks.workunit.client.1.smithi184.stdout:8/783: dread d2/d6a/da4/f7d [0,4194304] 0 2023-12-16T03:16:03.076 INFO:tasks.workunit.client.1.smithi184.stdout:3/837: symlink d12/d18/d68/l136 0 2023-12-16T03:16:03.077 INFO:tasks.workunit.client.1.smithi184.stdout:8/784: mkdir d2/d4/d10/d7a/d83/d8b/de0/dfd 0 2023-12-16T03:16:03.077 INFO:tasks.workunit.client.1.smithi184.stdout:8/785: write d2/d12/d21/d2d/fec [533088,43481] 0 2023-12-16T03:16:03.077 INFO:tasks.workunit.client.1.smithi184.stdout:8/786: truncate d2/d4/d10/d7a/d83/fde 406713 0 2023-12-16T03:16:03.079 INFO:tasks.workunit.client.1.smithi184.stdout:3/838: rename d12/d1e/de8/f9b to d12/d86/de4/d99/f137 0 2023-12-16T03:16:03.080 INFO:tasks.workunit.client.1.smithi184.stdout:8/787: mknod d2/d4/d10/d11/cfe 0 2023-12-16T03:16:03.084 INFO:tasks.workunit.client.1.smithi184.stdout:8/788: rename d2/d4/c7 to d2/d12/d21/d2d/d31/d34/d96/dca/cff 0 2023-12-16T03:16:03.086 INFO:tasks.workunit.client.1.smithi184.stdout:2/618: dwrite d3/d29/d2f/d2e/f3a [0,4194304] 0 2023-12-16T03:16:03.086 INFO:tasks.workunit.client.1.smithi184.stdout:2/619: chown d3/d13/d28/l6c 7548977 1 2023-12-16T03:16:03.086 INFO:tasks.workunit.client.1.smithi184.stdout:9/941: dwrite d0/d3a/f59 [0,4194304] 0 2023-12-16T03:16:03.086 INFO:tasks.workunit.client.1.smithi184.stdout:9/942: chown d0/d13/d20/d5b/d43/dc7/dda 137 1 2023-12-16T03:16:03.087 INFO:tasks.workunit.client.1.smithi184.stdout:5/573: dwrite d1/d3/fd [0,4194304] 0 2023-12-16T03:16:03.087 INFO:tasks.workunit.client.1.smithi184.stdout:8/789: creat d2/d12/d21/d2d/d31/d34/d96/f100 x:0 0 0 2023-12-16T03:16:03.087 INFO:tasks.workunit.client.0.smithi064.stdout:3/456: dread db/fd [0,4194304] 0 2023-12-16T03:16:03.090 INFO:tasks.workunit.client.0.smithi064.stdout:3/457: mknod db/d12/d1a/d2c/d6e/d75/d92/c9c 0 2023-12-16T03:16:03.090 INFO:tasks.workunit.client.0.smithi064.stdout:3/458: readlink db/d12/d1a/d31/l37 0 2023-12-16T03:16:03.093 INFO:tasks.workunit.client.1.smithi184.stdout:9/943: rmdir d0/d13/d6e/d84 39 2023-12-16T03:16:03.096 INFO:tasks.workunit.client.1.smithi184.stdout:5/574: mknod d1/d3/d9/de/d15/d19/d3a/cb7 0 2023-12-16T03:16:03.098 INFO:tasks.workunit.client.1.smithi184.stdout:9/944: truncate d0/d3a/d47/f71 2960222 0 2023-12-16T03:16:03.098 INFO:tasks.workunit.client.1.smithi184.stdout:9/945: stat d0/d13/d6e/fe8 0 2023-12-16T03:16:03.101 INFO:tasks.workunit.client.1.smithi184.stdout:9/946: getdents d0/d3a/d47 0 2023-12-16T03:16:03.104 INFO:tasks.workunit.client.0.smithi064.stdout:8/448: sync 2023-12-16T03:16:03.104 INFO:tasks.workunit.client.0.smithi064.stdout:0/338: sync 2023-12-16T03:16:03.104 INFO:tasks.workunit.client.0.smithi064.stdout:2/334: sync 2023-12-16T03:16:03.104 INFO:tasks.workunit.client.0.smithi064.stdout:9/367: sync 2023-12-16T03:16:03.104 INFO:tasks.workunit.client.0.smithi064.stdout:2/335: chown d1/d15/d1b 20113308 1 2023-12-16T03:16:03.104 INFO:tasks.workunit.client.0.smithi064.stdout:2/336: write d1/d15/d1b/d61/f5f [631041,36917] 0 2023-12-16T03:16:03.104 INFO:tasks.workunit.client.0.smithi064.stdout:2/337: read - d1/d27/f44 zero size 2023-12-16T03:16:03.105 INFO:tasks.workunit.client.1.smithi184.stdout:2/620: dread d3/d29/f2d [0,4194304] 0 2023-12-16T03:16:03.105 INFO:tasks.workunit.client.0.smithi064.stdout:0/339: chown d2/d8/da/df/l18 490531874 1 2023-12-16T03:16:03.110 INFO:tasks.workunit.client.1.smithi184.stdout:5/575: link d1/d2a/f13 d1/d3/d9/de/d15/fb8 0 2023-12-16T03:16:03.112 INFO:tasks.workunit.client.0.smithi064.stdout:2/338: write d1/d15/d1b/f33 [808785,9541] 0 2023-12-16T03:16:03.116 INFO:tasks.workunit.client.0.smithi064.stdout:8/449: rename d0/da/d16 to d0/db/d5a/d97 0 2023-12-16T03:16:03.119 INFO:tasks.workunit.client.0.smithi064.stdout:2/339: rename d1/d15/d1e to d1/d27/d2e/d68 0 2023-12-16T03:16:03.121 INFO:tasks.workunit.client.0.smithi064.stdout:8/450: truncate d0/da/f30 943857 0 2023-12-16T03:16:03.121 INFO:tasks.workunit.client.0.smithi064.stdout:8/451: fdatasync d0/db/f76 0 2023-12-16T03:16:03.123 INFO:tasks.workunit.client.1.smithi184.stdout:5/576: mkdir d1/d3/d9/de/d15/db9 0 2023-12-16T03:16:03.125 INFO:tasks.workunit.client.0.smithi064.stdout:0/340: dread d2/d7/d10/d21/f24 [0,4194304] 0 2023-12-16T03:16:03.126 INFO:tasks.workunit.client.0.smithi064.stdout:0/341: read f1 [2220092,15271] 0 2023-12-16T03:16:03.126 INFO:tasks.workunit.client.0.smithi064.stdout:0/342: dread - d2/d8/da/d11/f56 zero size 2023-12-16T03:16:03.126 INFO:tasks.workunit.client.0.smithi064.stdout:2/340: rename d1/d27/d3b to d1/d27/d2e/d69 0 2023-12-16T03:16:03.126 INFO:tasks.workunit.client.0.smithi064.stdout:2/341: read d1/d15/d58/f46 [205511,83130] 0 2023-12-16T03:16:03.126 INFO:tasks.workunit.client.0.smithi064.stdout:8/452: creat d0/da/d3e/f98 x:0 0 0 2023-12-16T03:16:03.128 INFO:tasks.workunit.client.1.smithi184.stdout:5/577: creat d1/d3/d2f/db5/fba x:0 0 0 2023-12-16T03:16:03.129 INFO:tasks.workunit.client.0.smithi064.stdout:0/343: mkdir d2/d29/d66 0 2023-12-16T03:16:03.129 INFO:tasks.workunit.client.0.smithi064.stdout:0/344: dread - d2/d8/da/df/f4d zero size 2023-12-16T03:16:03.131 INFO:tasks.workunit.client.0.smithi064.stdout:8/453: dread d0/db/f76 [0,4194304] 0 2023-12-16T03:16:03.132 INFO:tasks.workunit.client.0.smithi064.stdout:2/342: creat d1/d15/d23/d2d/f6a x:0 0 0 2023-12-16T03:16:03.135 INFO:tasks.workunit.client.1.smithi184.stdout:8/790: dwrite d2/d12/d21/d2d/d31/f6c [0,4194304] 0 2023-12-16T03:16:03.136 INFO:tasks.workunit.client.1.smithi184.stdout:3/839: dwrite d12/d18/d1f/d23/d2a/d42/d52/d76/fda [0,4194304] 0 2023-12-16T03:16:03.136 INFO:tasks.workunit.client.1.smithi184.stdout:3/840: write d12/d18/d1f/d23/d2a/d4a/f91 [1439701,41318] 0 2023-12-16T03:16:03.137 INFO:tasks.workunit.client.1.smithi184.stdout:8/791: rmdir d2/d4/d10/d7a/d83 39 2023-12-16T03:16:03.139 INFO:tasks.workunit.client.0.smithi064.stdout:0/345: read d2/f5 [424082,95086] 0 2023-12-16T03:16:03.139 INFO:tasks.workunit.client.0.smithi064.stdout:0/346: fdatasync d2/d7/d10/f1a 0 2023-12-16T03:16:03.148 INFO:tasks.workunit.client.0.smithi064.stdout:3/459: dwrite db/d13/d39/f86 [0,4194304] 0 2023-12-16T03:16:03.148 INFO:tasks.workunit.client.0.smithi064.stdout:3/460: dread - db/d12/d21/f69 zero size 2023-12-16T03:16:03.148 INFO:tasks.workunit.client.0.smithi064.stdout:0/347: read f1 [859359,55616] 0 2023-12-16T03:16:03.148 INFO:tasks.workunit.client.0.smithi064.stdout:9/368: dwrite d2/dc/ff [0,4194304] 0 2023-12-16T03:16:03.151 INFO:tasks.workunit.client.1.smithi184.stdout:3/841: creat d12/d18/d1f/d23/d2a/dfc/f138 x:0 0 0 2023-12-16T03:16:03.154 INFO:tasks.workunit.client.1.smithi184.stdout:2/621: dwrite d3/d29/d2f/d2e/fa [0,4194304] 0 2023-12-16T03:16:03.155 INFO:tasks.workunit.client.0.smithi064.stdout:3/461: creat db/d12/d1a/d2c/d34/d4c/f9d x:0 0 0 2023-12-16T03:16:03.155 INFO:tasks.workunit.client.0.smithi064.stdout:3/462: dread - db/d13/d39/f66 zero size 2023-12-16T03:16:03.156 INFO:tasks.workunit.client.1.smithi184.stdout:3/842: mkdir d12/d37/d139 0 2023-12-16T03:16:03.156 INFO:tasks.workunit.client.1.smithi184.stdout:3/843: chown d12/d18/f7c 1 1 2023-12-16T03:16:03.157 INFO:tasks.workunit.client.0.smithi064.stdout:0/348: unlink d2/d8/l22 0 2023-12-16T03:16:03.159 INFO:tasks.workunit.client.0.smithi064.stdout:3/463: rename db/d12/d1a/d2c/d34/c83 to db/d13/c9e 0 2023-12-16T03:16:03.159 INFO:tasks.workunit.client.1.smithi184.stdout:9/947: dwrite d0/f1f [8388608,4194304] 0 2023-12-16T03:16:03.160 INFO:tasks.workunit.client.1.smithi184.stdout:9/948: dread - d0/d13/d20/db0/f110 zero size 2023-12-16T03:16:03.160 INFO:tasks.workunit.client.0.smithi064.stdout:0/349: mkdir d2/d29/d66/d67 0 2023-12-16T03:16:03.160 INFO:tasks.workunit.client.0.smithi064.stdout:0/350: read d2/d7/d10/f1f [404877,94779] 0 2023-12-16T03:16:03.161 INFO:tasks.workunit.client.0.smithi064.stdout:0/351: dread - d2/d7/d10/f52 zero size 2023-12-16T03:16:03.161 INFO:tasks.workunit.client.0.smithi064.stdout:0/352: chown d2/f32 462000 1 2023-12-16T03:16:03.162 INFO:tasks.workunit.client.0.smithi064.stdout:3/464: rename db/d13/d39/c53 to db/c9f 0 2023-12-16T03:16:03.162 INFO:tasks.workunit.client.0.smithi064.stdout:3/465: dread - db/d12/d1a/d2c/d34/d4c/d6a/f81 zero size 2023-12-16T03:16:03.162 INFO:tasks.workunit.client.0.smithi064.stdout:3/466: stat db/d4f/d51 0 2023-12-16T03:16:03.164 INFO:tasks.workunit.client.0.smithi064.stdout:0/353: creat d2/d29/d66/d67/f68 x:0 0 0 2023-12-16T03:16:03.164 INFO:tasks.workunit.client.0.smithi064.stdout:0/354: write d2/d7/d10/d21/d31/f65 [701659,10086] 0 2023-12-16T03:16:03.170 INFO:tasks.workunit.client.1.smithi184.stdout:9/949: symlink d0/d30/l13f 0 2023-12-16T03:16:03.170 INFO:tasks.workunit.client.0.smithi064.stdout:8/454: dwrite d0/da/f65 [0,4194304] 0 2023-12-16T03:16:03.172 INFO:tasks.workunit.client.1.smithi184.stdout:9/950: rename d0/d13/d20/d5b/c103 to d0/d13/d20/d5b/c140 0 2023-12-16T03:16:03.175 INFO:tasks.workunit.client.1.smithi184.stdout:9/951: creat d0/d3a/d10f/f141 x:0 0 0 2023-12-16T03:16:03.179 INFO:tasks.workunit.client.1.smithi184.stdout:9/952: getdents d0/d76/db2 0 2023-12-16T03:16:03.179 INFO:tasks.workunit.client.1.smithi184.stdout:9/953: truncate d0/d76/db7/fcc 126765 0 2023-12-16T03:16:03.180 INFO:tasks.workunit.client.1.smithi184.stdout:9/954: symlink d0/d76/da2/l142 0 2023-12-16T03:16:03.182 INFO:tasks.workunit.client.1.smithi184.stdout:9/955: rename d0/d13/d6e/d84/la8 to d0/d76/da2/l143 0 2023-12-16T03:16:03.183 INFO:tasks.workunit.client.1.smithi184.stdout:9/956: creat d0/d13/d20/d5b/d43/dc7/ddc/dd8/f144 x:0 0 0 2023-12-16T03:16:03.184 INFO:tasks.workunit.client.0.smithi064.stdout:8/455: dread d0/d1d/d24/d2f/d50/f87 [4194304,4194304] 0 2023-12-16T03:16:03.185 INFO:tasks.workunit.client.1.smithi184.stdout:9/957: rename d0/d3a/f59 to d0/d76/db2/f145 0 2023-12-16T03:16:03.186 INFO:tasks.workunit.client.0.smithi064.stdout:8/456: creat d0/db/d37/f99 x:0 0 0 2023-12-16T03:16:03.186 INFO:tasks.workunit.client.0.smithi064.stdout:2/343: dwrite d1/d15/d23/d2d/f50 [0,4194304] 0 2023-12-16T03:16:03.186 INFO:tasks.workunit.client.0.smithi064.stdout:2/344: write d1/d27/d2e/f5b [442558,123455] 0 2023-12-16T03:16:03.186 INFO:tasks.workunit.client.0.smithi064.stdout:2/345: chown d1/d15/d1b/c2a 98751380 1 2023-12-16T03:16:03.187 INFO:tasks.workunit.client.1.smithi184.stdout:8/792: dwrite d2/d12/d21/d2d/d31/f6c [0,4194304] 0 2023-12-16T03:16:03.187 INFO:tasks.workunit.client.0.smithi064.stdout:2/346: write d1/d27/d2e/f5b [413199,62690] 0 2023-12-16T03:16:03.187 INFO:tasks.workunit.client.0.smithi064.stdout:2/347: write d1/d15/d1b/f4c [93760,87121] 0 2023-12-16T03:16:03.187 INFO:tasks.workunit.client.1.smithi184.stdout:9/958: rename d0/d13/d20/f8f to d0/d30/ddf/df7/f146 0 2023-12-16T03:16:03.188 INFO:tasks.workunit.client.0.smithi064.stdout:8/457: creat d0/d1d/d24/d2f/d50/d70/f9a x:0 0 0 2023-12-16T03:16:03.188 INFO:tasks.workunit.client.0.smithi064.stdout:8/458: write d0/db/d37/d3a/f57 [1863114,8086] 0 2023-12-16T03:16:03.188 INFO:tasks.workunit.client.1.smithi184.stdout:8/793: truncate d2/d4/d10/f14 3998660 0 2023-12-16T03:16:03.190 INFO:tasks.workunit.client.1.smithi184.stdout:9/959: mkdir d0/d76/da2/db4/d147 0 2023-12-16T03:16:03.190 INFO:tasks.workunit.client.1.smithi184.stdout:9/960: write d0/d13/d20/d5b/d43/dc7/dda/d117/f13b [264439,21833] 0 2023-12-16T03:16:03.190 INFO:tasks.workunit.client.1.smithi184.stdout:9/961: chown d0/d3a/d47/f71 39 1 2023-12-16T03:16:03.191 INFO:tasks.workunit.client.0.smithi064.stdout:2/348: truncate d1/f8 2508530 0 2023-12-16T03:16:03.195 INFO:tasks.workunit.client.0.smithi064.stdout:9/369: dwrite d2/d2d/d3b/d3c/d4b/f4c [0,4194304] 0 2023-12-16T03:16:03.196 INFO:tasks.workunit.client.0.smithi064.stdout:8/459: unlink d0/db/d37/f99 0 2023-12-16T03:16:03.196 INFO:tasks.workunit.client.0.smithi064.stdout:8/460: readlink d0/db/l2b 0 2023-12-16T03:16:03.196 INFO:tasks.workunit.client.0.smithi064.stdout:3/467: dwrite db/d4f/f6b [0,4194304] 0 2023-12-16T03:16:03.196 INFO:tasks.workunit.client.0.smithi064.stdout:3/468: dread - db/d12/d1a/d2c/d6e/d75/f8a zero size 2023-12-16T03:16:03.197 INFO:tasks.workunit.client.0.smithi064.stdout:0/355: dwrite f1 [0,4194304] 0 2023-12-16T03:16:03.197 INFO:tasks.workunit.client.1.smithi184.stdout:8/794: rename d2/d37/lbc to d2/d12/d21/l101 0 2023-12-16T03:16:03.198 INFO:tasks.workunit.client.0.smithi064.stdout:2/349: creat d1/d15/d1b/d49/f6b x:0 0 0 2023-12-16T03:16:03.198 INFO:tasks.workunit.client.0.smithi064.stdout:2/350: chown d1/d15/d1b/l36 3233 1 2023-12-16T03:16:03.199 INFO:tasks.workunit.client.1.smithi184.stdout:2/622: dwrite d3/d29/d61/f88 [0,4194304] 0 2023-12-16T03:16:03.199 INFO:tasks.workunit.client.1.smithi184.stdout:3/844: dwrite d12/d18/d1f/d23/d2a/d42/f121 [0,4194304] 0 2023-12-16T03:16:03.205 INFO:tasks.workunit.client.1.smithi184.stdout:8/795: link d2/d4/d10/d2a/f87 d2/d37/f102 0 2023-12-16T03:16:03.205 INFO:tasks.workunit.client.1.smithi184.stdout:8/796: fsync d2/d12/ff4 0 2023-12-16T03:16:03.206 INFO:tasks.workunit.client.0.smithi064.stdout:9/370: mknod d2/dc/d24/d39/d42/d57/c72 0 2023-12-16T03:16:03.206 INFO:tasks.workunit.client.0.smithi064.stdout:9/371: fdatasync d2/dc/d24/d39/d5e/d6f/f70 0 2023-12-16T03:16:03.206 INFO:tasks.workunit.client.0.smithi064.stdout:9/372: stat d2/c1e 0 2023-12-16T03:16:03.212 INFO:tasks.workunit.client.1.smithi184.stdout:2/623: link d3/d13/d28/ca0 d3/d29/d2f/d46/ccd 0 2023-12-16T03:16:03.213 INFO:tasks.workunit.client.1.smithi184.stdout:9/962: dwrite d0/d30/f44 [0,4194304] 0 2023-12-16T03:16:03.214 INFO:tasks.workunit.client.0.smithi064.stdout:3/469: rename db/d12/d1a/d2c/d90/c96 to db/d12/d1a/d2c/d34/d4c/ca0 0 2023-12-16T03:16:03.214 INFO:tasks.workunit.client.0.smithi064.stdout:3/470: write db/d12/d21/f61 [234361,113498] 0 2023-12-16T03:16:03.216 INFO:tasks.workunit.client.0.smithi064.stdout:9/373: creat d2/dc/d24/d39/d5e/f73 x:0 0 0 2023-12-16T03:16:03.218 INFO:tasks.workunit.client.1.smithi184.stdout:9/963: dread d0/f68 [0,4194304] 0 2023-12-16T03:16:03.218 INFO:tasks.workunit.client.0.smithi064.stdout:0/356: rename d2/d7/d10/d21/d31/c42 to d2/d8/da/d11/c69 0 2023-12-16T03:16:03.220 INFO:tasks.workunit.client.1.smithi184.stdout:8/797: creat d2/d4/d10/d2a/f103 x:0 0 0 2023-12-16T03:16:03.221 INFO:tasks.workunit.client.1.smithi184.stdout:3/845: dwrite d12/d18/f74 [4194304,4194304] 0 2023-12-16T03:16:03.222 INFO:tasks.workunit.client.1.smithi184.stdout:2/624: read d3/d29/d2f/d2e/f7 [226556,116712] 0 2023-12-16T03:16:03.222 INFO:tasks.workunit.client.1.smithi184.stdout:8/798: stat d2/d12/d21/d2d/d31/d34/d96/dca/cff 0 2023-12-16T03:16:03.223 INFO:tasks.workunit.client.0.smithi064.stdout:8/461: dwrite d0/da/f30 [0,4194304] 0 2023-12-16T03:16:03.226 INFO:tasks.workunit.client.0.smithi064.stdout:8/462: write d0/da/d3e/f53 [627977,46193] 0 2023-12-16T03:16:03.228 INFO:tasks.workunit.client.0.smithi064.stdout:9/374: mknod d2/dc/d24/d39/d5e/c74 0 2023-12-16T03:16:03.229 INFO:tasks.workunit.client.1.smithi184.stdout:6/796: sync 2023-12-16T03:16:03.231 INFO:tasks.workunit.client.1.smithi184.stdout:3/846: mknod d12/d18/d1f/d23/d2a/d36/c13a 0 2023-12-16T03:16:03.233 INFO:tasks.workunit.client.0.smithi064.stdout:3/471: rename db/f9b to db/d13/d39/fa1 0 2023-12-16T03:16:03.233 INFO:tasks.workunit.client.0.smithi064.stdout:3/472: write db/d13/d39/f43 [1567737,49923] 0 2023-12-16T03:16:03.235 INFO:tasks.workunit.client.0.smithi064.stdout:0/357: creat d2/d7/d10/f6a x:0 0 0 2023-12-16T03:16:03.235 INFO:tasks.workunit.client.0.smithi064.stdout:0/358: write d2/d8/da/df/f5c [432296,113575] 0 2023-12-16T03:16:03.237 INFO:tasks.workunit.client.1.smithi184.stdout:3/847: dread d12/d18/d84/fec [0,4194304] 0 2023-12-16T03:16:03.237 INFO:tasks.workunit.client.1.smithi184.stdout:3/848: read - d12/d18/d1f/d23/d51/dd7/f11f zero size 2023-12-16T03:16:03.240 INFO:tasks.workunit.client.1.smithi184.stdout:9/964: dwrite d0/d76/dbf/f109 [0,4194304] 0 2023-12-16T03:16:03.245 INFO:tasks.workunit.client.0.smithi064.stdout:8/463: creat d0/db/d37/f9b x:0 0 0 2023-12-16T03:16:03.247 INFO:tasks.workunit.client.0.smithi064.stdout:9/375: creat d2/d2d/d3b/d3c/d34/f75 x:0 0 0 2023-12-16T03:16:03.248 INFO:tasks.workunit.client.1.smithi184.stdout:3/849: mknod d12/d1e/c13b 0 2023-12-16T03:16:03.248 INFO:tasks.workunit.client.1.smithi184.stdout:3/850: fsync d12/d18/d68/f9d 0 2023-12-16T03:16:03.253 INFO:tasks.workunit.client.0.smithi064.stdout:3/473: creat db/d12/d21/fa2 x:0 0 0 2023-12-16T03:16:03.254 INFO:tasks.workunit.client.1.smithi184.stdout:9/965: symlink d0/d76/da2/db4/d147/l148 0 2023-12-16T03:16:03.257 INFO:tasks.workunit.client.0.smithi064.stdout:0/359: mkdir d2/d7/d6b 0 2023-12-16T03:16:03.258 INFO:tasks.workunit.client.1.smithi184.stdout:3/851: mknod d12/d18/d1f/d93/d127/c13c 0 2023-12-16T03:16:03.258 INFO:tasks.workunit.client.1.smithi184.stdout:6/797: dwrite d0/d5/d12/d1b/d33/d3d/d96/fe2 [0,4194304] 0 2023-12-16T03:16:03.258 INFO:tasks.workunit.client.1.smithi184.stdout:6/798: chown d0/d5/f1f 0 1 2023-12-16T03:16:03.258 INFO:tasks.workunit.client.0.smithi064.stdout:8/464: mkdir d0/d1d/d24/d9c 0 2023-12-16T03:16:03.259 INFO:tasks.workunit.client.0.smithi064.stdout:0/360: write d2/f16 [3440350,122669] 0 2023-12-16T03:16:03.260 INFO:tasks.workunit.client.1.smithi184.stdout:9/966: unlink d0/d3a/d47/lc1 0 2023-12-16T03:16:03.261 INFO:tasks.workunit.client.1.smithi184.stdout:9/967: fdatasync d0/d3a/fc8 0 2023-12-16T03:16:03.261 INFO:tasks.workunit.client.1.smithi184.stdout:9/968: chown d0/d13/d20/d5b/d43/l60 375663236 1 2023-12-16T03:16:03.261 INFO:tasks.workunit.client.1.smithi184.stdout:6/799: write d0/d5/f1f [312448,20395] 0 2023-12-16T03:16:03.263 INFO:tasks.workunit.client.0.smithi064.stdout:8/465: mkdir d0/da/d3e/d46/d9d 0 2023-12-16T03:16:03.265 INFO:tasks.workunit.client.0.smithi064.stdout:0/361: rename d2/d8/da/l50 to d2/l6c 0 2023-12-16T03:16:03.268 INFO:tasks.workunit.client.0.smithi064.stdout:3/474: mkdir db/d12/d4e/da3 0 2023-12-16T03:16:03.268 INFO:tasks.workunit.client.0.smithi064.stdout:3/475: write db/d13/d39/f78 [45454,79910] 0 2023-12-16T03:16:03.268 INFO:tasks.workunit.client.0.smithi064.stdout:3/476: dread - db/d12/d21/f69 zero size 2023-12-16T03:16:03.268 INFO:tasks.workunit.client.0.smithi064.stdout:3/477: chown db/d12/d4e/f73 6 1 2023-12-16T03:16:03.269 INFO:tasks.workunit.client.0.smithi064.stdout:0/362: truncate d2/d8/f1b 3883144 0 2023-12-16T03:16:03.269 INFO:tasks.workunit.client.0.smithi064.stdout:8/466: dread d0/f3 [0,4194304] 0 2023-12-16T03:16:03.269 INFO:tasks.workunit.client.0.smithi064.stdout:0/363: fsync d2/d7/d10/d21/f24 0 2023-12-16T03:16:03.272 INFO:tasks.workunit.client.0.smithi064.stdout:0/364: symlink d2/d7/d10/d21/l6d 0 2023-12-16T03:16:03.272 INFO:tasks.workunit.client.0.smithi064.stdout:0/365: stat d2/c57 0 2023-12-16T03:16:03.272 INFO:tasks.workunit.client.0.smithi064.stdout:0/366: write d2/d8/da/f62 [1041348,29659] 0 2023-12-16T03:16:03.272 INFO:tasks.workunit.client.0.smithi064.stdout:0/367: read d2/d8/f40 [234345,18787] 0 2023-12-16T03:16:03.273 INFO:tasks.workunit.client.0.smithi064.stdout:0/368: creat d2/d7/d6b/f6e x:0 0 0 2023-12-16T03:16:03.274 INFO:tasks.workunit.client.1.smithi184.stdout:9/969: rmdir d0/d76/da2/dc4 39 2023-12-16T03:16:03.274 INFO:tasks.workunit.client.1.smithi184.stdout:6/800: symlink d0/d5/d22/d37/d45/l102 0 2023-12-16T03:16:03.274 INFO:tasks.workunit.client.1.smithi184.stdout:6/801: fsync d0/d5/d22/f3c 0 2023-12-16T03:16:03.274 INFO:tasks.workunit.client.0.smithi064.stdout:0/369: creat d2/d29/d66/f6f x:0 0 0 2023-12-16T03:16:03.275 INFO:tasks.workunit.client.1.smithi184.stdout:6/802: rename d0/d5/d12/d1b/d33/l83 to d0/d5/d12/d1b/d33/d3d/l103 0 2023-12-16T03:16:03.275 INFO:tasks.workunit.client.1.smithi184.stdout:6/803: write d0/d5/d22/d25/d47/fcb [350893,106583] 0 2023-12-16T03:16:03.276 INFO:tasks.workunit.client.0.smithi064.stdout:0/370: mkdir d2/d7/d70 0 2023-12-16T03:16:03.276 INFO:tasks.workunit.client.0.smithi064.stdout:0/371: write d2/d7/f2b [1210284,104689] 0 2023-12-16T03:16:03.276 INFO:tasks.workunit.client.1.smithi184.stdout:9/970: symlink d0/d76/db7/l149 0 2023-12-16T03:16:03.277 INFO:tasks.workunit.client.1.smithi184.stdout:6/804: unlink d0/d5/d22/d37/d4d/le9 0 2023-12-16T03:16:03.280 INFO:tasks.workunit.client.0.smithi064.stdout:0/372: mknod d2/d8/da/d11/d64/c71 0 2023-12-16T03:16:03.280 INFO:tasks.workunit.client.0.smithi064.stdout:0/373: truncate d2/d7/d10/f52 450725 0 2023-12-16T03:16:03.282 INFO:tasks.workunit.client.0.smithi064.stdout:0/374: dread d2/d7/d10/f52 [0,4194304] 0 2023-12-16T03:16:03.284 INFO:tasks.workunit.client.0.smithi064.stdout:0/375: creat d2/d8/da/df/f72 x:0 0 0 2023-12-16T03:16:03.285 INFO:tasks.workunit.client.0.smithi064.stdout:0/376: dread d2/d29/f33 [0,4194304] 0 2023-12-16T03:16:03.285 INFO:tasks.workunit.client.0.smithi064.stdout:3/478: fdatasync db/d12/d1a/d2c/d34/d4c/f63 0 2023-12-16T03:16:03.287 INFO:tasks.workunit.client.0.smithi064.stdout:0/377: mknod d2/d7/d10/d21/c73 0 2023-12-16T03:16:03.287 INFO:tasks.workunit.client.0.smithi064.stdout:0/378: readlink d2/d8/da/l13 0 2023-12-16T03:16:03.288 INFO:tasks.workunit.client.0.smithi064.stdout:3/479: mkdir db/d13/d39/da4 0 2023-12-16T03:16:03.289 INFO:tasks.workunit.client.0.smithi064.stdout:3/480: readlink db/d12/d1a/l4a 0 2023-12-16T03:16:03.289 INFO:tasks.workunit.client.1.smithi184.stdout:2/625: dwrite d3/d29/fb0 [0,4194304] 0 2023-12-16T03:16:03.293 INFO:tasks.workunit.client.0.smithi064.stdout:8/467: dread d0/da/d3e/d46/f5e [0,4194304] 0 2023-12-16T03:16:03.294 INFO:tasks.workunit.client.0.smithi064.stdout:9/376: dwrite d2/dc/d24/d39/d42/f51 [0,4194304] 0 2023-12-16T03:16:03.295 INFO:tasks.workunit.client.1.smithi184.stdout:2/626: rename d3/d13/l59 to d3/d9/d19/d87/lce 0 2023-12-16T03:16:03.295 INFO:tasks.workunit.client.1.smithi184.stdout:2/627: write d3/d29/d4d/fa3 [2043694,44687] 0 2023-12-16T03:16:03.295 INFO:tasks.workunit.client.1.smithi184.stdout:2/628: write d3/d13/f9a [4250999,109844] 0 2023-12-16T03:16:03.298 INFO:tasks.workunit.client.1.smithi184.stdout:2/629: read d3/d9/d19/f26 [549074,107874] 0 2023-12-16T03:16:03.303 INFO:tasks.workunit.client.1.smithi184.stdout:3/852: dwrite f9 [0,4194304] 0 2023-12-16T03:16:03.303 INFO:tasks.workunit.client.1.smithi184.stdout:3/853: fdatasync d12/d1e/de8/d48/fc7 0 2023-12-16T03:16:03.304 INFO:tasks.workunit.client.1.smithi184.stdout:6/805: dwrite d0/d5/d22/d37/d4d/d9c/ffa [0,4194304] 0 2023-12-16T03:16:03.304 INFO:tasks.workunit.client.1.smithi184.stdout:6/806: fsync d0/d5/f2c 0 2023-12-16T03:16:03.304 INFO:tasks.workunit.client.1.smithi184.stdout:6/807: truncate d0/d5/d12/d1b/d33/d3d/d96/fe5 492870 0 2023-12-16T03:16:03.304 INFO:tasks.workunit.client.1.smithi184.stdout:6/808: write d0/d5/d22/d25/d3f/d6f/ff4 [689750,113868] 0 2023-12-16T03:16:03.306 INFO:tasks.workunit.client.1.smithi184.stdout:3/854: creat d12/d18/d1f/d23/d2a/d4a/d61/f13d x:0 0 0 2023-12-16T03:16:03.306 INFO:tasks.workunit.client.1.smithi184.stdout:3/855: write d12/d37/f98 [667618,44340] 0 2023-12-16T03:16:03.307 INFO:tasks.workunit.client.0.smithi064.stdout:9/377: dread d2/d2d/d3b/d3c/d34/f37 [0,4194304] 0 2023-12-16T03:16:03.308 INFO:tasks.workunit.client.0.smithi064.stdout:9/378: write d2/dc/f1f [843291,39158] 0 2023-12-16T03:16:03.312 INFO:tasks.workunit.client.0.smithi064.stdout:9/379: dread f1 [0,4194304] 0 2023-12-16T03:16:03.315 INFO:tasks.workunit.client.1.smithi184.stdout:6/809: creat d0/d5/d22/d25/d47/f104 x:0 0 0 2023-12-16T03:16:03.321 INFO:tasks.workunit.client.0.smithi064.stdout:3/481: dwrite db/d12/d1a/d2c/d34/f3d [0,4194304] 0 2023-12-16T03:16:03.321 INFO:tasks.workunit.client.0.smithi064.stdout:3/482: write db/d13/d39/f78 [580726,81446] 0 2023-12-16T03:16:03.322 INFO:tasks.workunit.client.1.smithi184.stdout:6/810: rmdir d0/d36/d79 39 2023-12-16T03:16:03.322 INFO:tasks.workunit.client.1.smithi184.stdout:6/811: chown d0/d5/cdf 0 1 2023-12-16T03:16:03.322 INFO:tasks.workunit.client.1.smithi184.stdout:3/856: dread d12/d86/de4/d99/d117/db4/ffb [0,4194304] 0 2023-12-16T03:16:03.324 INFO:tasks.workunit.client.1.smithi184.stdout:6/812: write d0/d5/d12/d1b/d33/d3d/d96/fe2 [3257120,50184] 0 2023-12-16T03:16:03.325 INFO:tasks.workunit.client.0.smithi064.stdout:3/483: getdents db/d12/d21 0 2023-12-16T03:16:03.326 INFO:tasks.workunit.client.1.smithi184.stdout:3/857: mknod d12/d1e/d89/c13e 0 2023-12-16T03:16:03.327 INFO:tasks.workunit.client.0.smithi064.stdout:3/484: rmdir db/d12/d1a/d2c/d6e 39 2023-12-16T03:16:03.328 INFO:tasks.workunit.client.0.smithi064.stdout:8/468: dwrite d0/da/f30 [0,4194304] 0 2023-12-16T03:16:03.329 INFO:tasks.workunit.client.0.smithi064.stdout:8/469: readlink d0/da/d3e/d46/d8f/l63 0 2023-12-16T03:16:03.331 INFO:tasks.workunit.client.1.smithi184.stdout:6/813: mknod d0/d5/d22/d25/dbf/dbe/c105 0 2023-12-16T03:16:03.333 INFO:tasks.workunit.client.1.smithi184.stdout:2/630: dwrite d3/d13/f66 [0,4194304] 0 2023-12-16T03:16:03.333 INFO:tasks.workunit.client.0.smithi064.stdout:0/379: dwrite d2/d7/d10/d21/f24 [0,4194304] 0 2023-12-16T03:16:03.333 INFO:tasks.workunit.client.0.smithi064.stdout:9/380: dwrite d2/d2d/d3b/d3c/d4b/f4c [0,4194304] 0 2023-12-16T03:16:03.333 INFO:tasks.workunit.client.0.smithi064.stdout:9/381: chown d2/d2d/d6c 258898028 1 2023-12-16T03:16:03.333 INFO:tasks.workunit.client.0.smithi064.stdout:9/382: dread - d2/d2d/d36/f53 zero size 2023-12-16T03:16:03.334 INFO:tasks.workunit.client.1.smithi184.stdout:3/858: creat d12/d18/d1f/d23/d2a/d4a/d61/da9/f13f x:0 0 0 2023-12-16T03:16:03.337 INFO:tasks.workunit.client.0.smithi064.stdout:8/470: link d0/db/l31 d0/da/d3e/d46/d54/d8c/l9e 0 2023-12-16T03:16:03.338 INFO:tasks.workunit.client.1.smithi184.stdout:6/814: truncate d0/d5/d12/f1c 3471603 0 2023-12-16T03:16:03.340 INFO:tasks.workunit.client.0.smithi064.stdout:3/485: link db/d12/d1a/f7d db/d12/d4e/fa5 0 2023-12-16T03:16:03.340 INFO:tasks.workunit.client.0.smithi064.stdout:3/486: chown db/d12/d21/f33 30164 1 2023-12-16T03:16:03.340 INFO:tasks.workunit.client.0.smithi064.stdout:3/487: dread - db/d12/d1a/d2c/d34/d4c/f9d zero size 2023-12-16T03:16:03.340 INFO:tasks.workunit.client.0.smithi064.stdout:3/488: read db/d13/d39/f78 [70336,21254] 0 2023-12-16T03:16:03.341 INFO:tasks.workunit.client.1.smithi184.stdout:2/631: getdents d3/d13/d6e 0 2023-12-16T03:16:03.342 INFO:tasks.workunit.client.1.smithi184.stdout:2/632: write d3/d9/f8c [399554,44151] 0 2023-12-16T03:16:03.342 INFO:tasks.workunit.client.1.smithi184.stdout:2/633: fdatasync d3/d29/d61/f91 0 2023-12-16T03:16:03.342 INFO:tasks.workunit.client.1.smithi184.stdout:2/634: chown d3/f76 14576 1 2023-12-16T03:16:03.343 INFO:tasks.workunit.client.0.smithi064.stdout:0/380: creat d2/d8/da/df/d5e/f74 x:0 0 0 2023-12-16T03:16:03.343 INFO:tasks.workunit.client.0.smithi064.stdout:0/381: chown d2/d8/da/d11/f44 166142 1 2023-12-16T03:16:03.343 INFO:tasks.workunit.client.0.smithi064.stdout:0/382: fsync d2/d7/d10/d21/d31/f35 0 2023-12-16T03:16:03.346 INFO:tasks.workunit.client.1.smithi184.stdout:3/859: rename d12/d1e/de8/d48/fc7 to d12/d18/da1/f140 0 2023-12-16T03:16:03.349 INFO:tasks.workunit.client.0.smithi064.stdout:9/383: symlink d2/dc/d24/d39/d42/d57/l76 0 2023-12-16T03:16:03.349 INFO:tasks.workunit.client.0.smithi064.stdout:9/384: truncate d2/f2a 5831780 0 2023-12-16T03:16:03.349 INFO:tasks.workunit.client.0.smithi064.stdout:9/385: fsync d2/d2d/d3b/d3c/d34/f50 0 2023-12-16T03:16:03.349 INFO:tasks.workunit.client.0.smithi064.stdout:9/386: chown d2/d2d/d3b/d3c/l23 5347 1 2023-12-16T03:16:03.349 INFO:tasks.workunit.client.0.smithi064.stdout:9/387: getdents d2/dc/d67 0 2023-12-16T03:16:03.350 INFO:tasks.workunit.client.1.smithi184.stdout:2/635: symlink d3/d9/d19/lcf 0 2023-12-16T03:16:03.350 INFO:tasks.workunit.client.1.smithi184.stdout:2/636: fdatasync d3/d29/d2f/d46/fba 0 2023-12-16T03:16:03.352 INFO:tasks.workunit.client.0.smithi064.stdout:8/471: creat d0/d1d/d24/d2f/f9f x:0 0 0 2023-12-16T03:16:03.354 INFO:tasks.workunit.client.1.smithi184.stdout:6/815: rename d0/d5/d22/d25/d3f/d6f/lb3 to d0/d5/d26/de0/l106 0 2023-12-16T03:16:03.356 INFO:tasks.workunit.client.0.smithi064.stdout:0/383: creat d2/d8/da/f75 x:0 0 0 2023-12-16T03:16:03.356 INFO:tasks.workunit.client.0.smithi064.stdout:0/384: stat d2/d7/d10 0 2023-12-16T03:16:03.357 INFO:tasks.workunit.client.1.smithi184.stdout:3/860: creat d12/d18/d1f/d23/f141 x:0 0 0 2023-12-16T03:16:03.358 INFO:tasks.workunit.client.0.smithi064.stdout:9/388: mkdir d2/dc/d24/d39/d77 0 2023-12-16T03:16:03.361 INFO:tasks.workunit.client.1.smithi184.stdout:2/637: creat d3/d13/d28/fd0 x:0 0 0 2023-12-16T03:16:03.362 INFO:tasks.workunit.client.0.smithi064.stdout:8/472: symlink d0/db/d12/d1c/d59/d77/la0 0 2023-12-16T03:16:03.362 INFO:tasks.workunit.client.0.smithi064.stdout:8/473: read - d0/da/d3e/f98 zero size 2023-12-16T03:16:03.362 INFO:tasks.workunit.client.0.smithi064.stdout:3/489: dwrite db/d12/d1a/f42 [0,4194304] 0 2023-12-16T03:16:03.364 INFO:tasks.workunit.client.1.smithi184.stdout:6/816: link d0/d5/d22/d37/d4d/d9c/fa9 d0/d5/d22/d25/dbf/dbe/de1/f107 0 2023-12-16T03:16:03.364 INFO:tasks.workunit.client.1.smithi184.stdout:6/817: stat d0/d36/d79 0 2023-12-16T03:16:03.364 INFO:tasks.workunit.client.1.smithi184.stdout:6/818: truncate d0/d5/d12/d1b/d33/d3d/d96/fe5 1019413 0 2023-12-16T03:16:03.365 INFO:tasks.workunit.client.0.smithi064.stdout:0/385: symlink d2/d7/d10/d21/d31/l76 0 2023-12-16T03:16:03.366 INFO:tasks.workunit.client.1.smithi184.stdout:2/638: mknod d3/d9/d19/cd1 0 2023-12-16T03:16:03.369 INFO:tasks.workunit.client.0.smithi064.stdout:8/474: mknod d0/d1d/d3c/d42/d93/ca1 0 2023-12-16T03:16:03.371 INFO:tasks.workunit.client.0.smithi064.stdout:1/386: sync 2023-12-16T03:16:03.371 INFO:tasks.workunit.client.0.smithi064.stdout:7/414: sync 2023-12-16T03:16:03.371 INFO:tasks.workunit.client.0.smithi064.stdout:7/415: write d7/d3e/f78 [715341,90311] 0 2023-12-16T03:16:03.372 INFO:tasks.workunit.client.1.smithi184.stdout:6/819: creat d0/d5/d22/d25/dbf/dbe/de1/f108 x:0 0 0 2023-12-16T03:16:03.372 INFO:tasks.workunit.client.0.smithi064.stdout:0/386: write d2/d8/da/f4e [5611175,22328] 0 2023-12-16T03:16:03.373 INFO:tasks.workunit.client.1.smithi184.stdout:2/639: getdents d3/d29/d8a 0 2023-12-16T03:16:03.377 INFO:tasks.workunit.client.1.smithi184.stdout:3/861: dwrite d12/d18/fa0 [0,4194304] 0 2023-12-16T03:16:03.377 INFO:tasks.workunit.client.1.smithi184.stdout:3/862: readlink l7 0 2023-12-16T03:16:03.377 INFO:tasks.workunit.client.1.smithi184.stdout:3/863: read - d12/d18/d68/f9d zero size 2023-12-16T03:16:03.377 INFO:tasks.workunit.client.1.smithi184.stdout:3/864: fdatasync d12/d18/fd8 0 2023-12-16T03:16:03.378 INFO:tasks.workunit.client.0.smithi064.stdout:8/475: mkdir d0/da/d3e/d46/d9d/da2 0 2023-12-16T03:16:03.378 INFO:tasks.workunit.client.1.smithi184.stdout:6/820: rmdir d0/d5/d42 39 2023-12-16T03:16:03.379 INFO:tasks.workunit.client.0.smithi064.stdout:1/387: mknod d3/dd/c7f 0 2023-12-16T03:16:03.381 INFO:tasks.workunit.client.1.smithi184.stdout:2/640: rmdir d3/d29/d2f 39 2023-12-16T03:16:03.381 INFO:tasks.workunit.client.1.smithi184.stdout:2/641: fdatasync d3/d29/d2f/d46/d77/f9d 0 2023-12-16T03:16:03.382 INFO:tasks.workunit.client.1.smithi184.stdout:2/642: chown d3/d13/d28/dac/fc5 10476888 1 2023-12-16T03:16:03.382 INFO:tasks.workunit.client.1.smithi184.stdout:6/821: write d0/d5/d12/fb8 [2014014,90137] 0 2023-12-16T03:16:03.385 INFO:tasks.workunit.client.0.smithi064.stdout:0/387: getdents d2/d8 0 2023-12-16T03:16:03.385 INFO:tasks.workunit.client.0.smithi064.stdout:0/388: chown d2/d7/d10/d21/l25 15159352 1 2023-12-16T03:16:03.385 INFO:tasks.workunit.client.1.smithi184.stdout:1/696: sync 2023-12-16T03:16:03.385 INFO:tasks.workunit.client.1.smithi184.stdout:7/650: sync 2023-12-16T03:16:03.385 INFO:tasks.workunit.client.1.smithi184.stdout:1/697: write d3/d34/dbc/d3c/f4f [4745710,103831] 0 2023-12-16T03:16:03.387 INFO:tasks.workunit.client.1.smithi184.stdout:3/865: dread d12/d1e/fb6 [4194304,4194304] 0 2023-12-16T03:16:03.388 INFO:tasks.workunit.client.0.smithi064.stdout:3/490: dwrite db/d13/d39/f66 [0,4194304] 0 2023-12-16T03:16:03.388 INFO:tasks.workunit.client.0.smithi064.stdout:3/491: chown ca 263193250 1 2023-12-16T03:16:03.388 INFO:tasks.workunit.client.1.smithi184.stdout:7/651: write d0/d3/d2e/d79/d1e/f20 [6855219,109472] 0 2023-12-16T03:16:03.390 INFO:tasks.workunit.client.1.smithi184.stdout:2/643: mknod d3/d29/d4d/d5b/da6/cd2 0 2023-12-16T03:16:03.390 INFO:tasks.workunit.client.1.smithi184.stdout:2/644: chown d3/d29/d61 38 1 2023-12-16T03:16:03.390 INFO:tasks.workunit.client.1.smithi184.stdout:3/866: read d12/d18/da1/f140 [2907375,113461] 0 2023-12-16T03:16:03.390 INFO:tasks.workunit.client.1.smithi184.stdout:3/867: chown d12/d18/d1f/d23/d2a/d36/f5b 67438250 1 2023-12-16T03:16:03.392 INFO:tasks.workunit.client.0.smithi064.stdout:8/476: creat d0/fa3 x:0 0 0 2023-12-16T03:16:03.393 INFO:tasks.workunit.client.0.smithi064.stdout:1/388: dwrite d3/d22/f28 [0,4194304] 0 2023-12-16T03:16:03.394 INFO:tasks.workunit.client.0.smithi064.stdout:7/416: rmdir d7 39 2023-12-16T03:16:03.395 INFO:tasks.workunit.client.0.smithi064.stdout:0/389: rename d2/d8/da/d11/c58 to d2/d5b/c77 0 2023-12-16T03:16:03.395 INFO:tasks.workunit.client.0.smithi064.stdout:0/390: fsync d2/f16 0 2023-12-16T03:16:03.396 INFO:tasks.workunit.client.1.smithi184.stdout:2/645: write d3/d9/d19/f4f [924343,127423] 0 2023-12-16T03:16:03.397 INFO:tasks.workunit.client.1.smithi184.stdout:6/822: creat d0/d5/d22/d25/d3f/d6f/d9e/f109 x:0 0 0 2023-12-16T03:16:03.400 INFO:tasks.workunit.client.1.smithi184.stdout:1/698: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/d99/feb x:0 0 0 2023-12-16T03:16:03.403 INFO:tasks.workunit.client.1.smithi184.stdout:7/652: read d0/d3/d2e/d79/dd/d75/fb3 [844326,28397] 0 2023-12-16T03:16:03.405 INFO:tasks.workunit.client.0.smithi064.stdout:9/389: rmdir d2 39 2023-12-16T03:16:03.405 INFO:tasks.workunit.client.0.smithi064.stdout:9/390: write d2/dc/d24/d39/f61 [975367,100716] 0 2023-12-16T03:16:03.405 INFO:tasks.workunit.client.0.smithi064.stdout:9/391: dread - d2/d2d/d3b/d3c/d34/f75 zero size 2023-12-16T03:16:03.408 INFO:tasks.workunit.client.1.smithi184.stdout:3/868: symlink d12/d1e/d89/dc2/l142 0 2023-12-16T03:16:03.412 INFO:tasks.workunit.client.1.smithi184.stdout:2/646: link d3/c79 d3/d29/d4d/cd3 0 2023-12-16T03:16:03.412 INFO:tasks.workunit.client.1.smithi184.stdout:2/647: readlink d3/d9/d19/d87/l9b 0 2023-12-16T03:16:03.416 INFO:tasks.workunit.client.0.smithi064.stdout:8/477: mkdir d0/d1d/d24/d2f/d50/d70/da4 0 2023-12-16T03:16:03.417 INFO:tasks.workunit.client.0.smithi064.stdout:7/417: dwrite d7/d3e/d42/d48/f5b [0,4194304] 0 2023-12-16T03:16:03.417 INFO:tasks.workunit.client.0.smithi064.stdout:7/418: dread - d7/d3e/d42/f72 zero size 2023-12-16T03:16:03.417 INFO:tasks.workunit.client.1.smithi184.stdout:7/653: getdents d0/d3/d2e 0 2023-12-16T03:16:03.419 INFO:tasks.workunit.client.1.smithi184.stdout:2/648: creat d3/d9/fd4 x:0 0 0 2023-12-16T03:16:03.419 INFO:tasks.workunit.client.1.smithi184.stdout:2/649: fdatasync d3/d29/d2f/f45 0 2023-12-16T03:16:03.420 INFO:tasks.workunit.client.1.smithi184.stdout:3/869: dread d12/d18/f71 [0,4194304] 0 2023-12-16T03:16:03.420 INFO:tasks.workunit.client.0.smithi064.stdout:1/389: link d3/dd/d11/d3b/f3e d3/dd/d11/f80 0 2023-12-16T03:16:03.423 INFO:tasks.workunit.client.0.smithi064.stdout:3/492: rename db/d12/d1a/d31/f47 to db/d12/d1a/d2c/d34/d4c/d6a/d93/fa6 0 2023-12-16T03:16:03.423 INFO:tasks.workunit.client.0.smithi064.stdout:3/493: truncate db/d12/d1a/d2c/d34/d4c/f9d 675988 0 2023-12-16T03:16:03.425 INFO:tasks.workunit.client.1.smithi184.stdout:7/654: mkdir d0/d3/d2e/d79/d32/d8a/dbd 0 2023-12-16T03:16:03.426 INFO:tasks.workunit.client.1.smithi184.stdout:6/823: truncate d0/d5/d12/fb8 4439339 0 2023-12-16T03:16:03.427 INFO:tasks.workunit.client.1.smithi184.stdout:1/699: dwrite d3/d34/dbc/d3c/d41/f4b [0,4194304] 0 2023-12-16T03:16:03.428 INFO:tasks.workunit.client.1.smithi184.stdout:1/700: read d3/d34/dbc/d3c/d41/d46/d4a/f50 [46400,82834] 0 2023-12-16T03:16:03.428 INFO:tasks.workunit.client.1.smithi184.stdout:7/655: write d0/d3/d2e/d79/f2a [1237806,74155] 0 2023-12-16T03:16:03.428 INFO:tasks.workunit.client.1.smithi184.stdout:7/656: truncate d0/d3/d2e/d79/d32/d39/f48 4824342 0 2023-12-16T03:16:03.428 INFO:tasks.workunit.client.1.smithi184.stdout:7/657: write d0/d3/d2e/d79/d36/d84/fb2 [97348,60956] 0 2023-12-16T03:16:03.429 INFO:tasks.workunit.client.0.smithi064.stdout:0/391: link d2/d8/da/d11/f56 d2/d8/da/d11/d64/f78 0 2023-12-16T03:16:03.430 INFO:tasks.workunit.client.1.smithi184.stdout:2/650: creat d3/d13/d6e/fd5 x:0 0 0 2023-12-16T03:16:03.431 INFO:tasks.workunit.client.0.smithi064.stdout:9/392: mknod d2/d2d/d36/c78 0 2023-12-16T03:16:03.432 INFO:tasks.workunit.client.1.smithi184.stdout:3/870: symlink d12/d18/l143 0 2023-12-16T03:16:03.434 INFO:tasks.workunit.client.0.smithi064.stdout:8/478: truncate d0/db/d12/d1c/f72 2995382 0 2023-12-16T03:16:03.434 INFO:tasks.workunit.client.0.smithi064.stdout:8/479: stat d0/f2 0 2023-12-16T03:16:03.434 INFO:tasks.workunit.client.0.smithi064.stdout:8/480: fsync d0/db/d12/f82 0 2023-12-16T03:16:03.436 INFO:tasks.workunit.client.1.smithi184.stdout:6/824: mkdir d0/d5/d12/df2/d10a 0 2023-12-16T03:16:03.436 INFO:tasks.workunit.client.0.smithi064.stdout:9/393: write d2/d2d/d3b/d3c/d34/f50 [1804833,120090] 0 2023-12-16T03:16:03.440 INFO:tasks.workunit.client.0.smithi064.stdout:0/392: symlink d2/d29/l79 0 2023-12-16T03:16:03.440 INFO:tasks.workunit.client.0.smithi064.stdout:0/393: write d2/d8/da/df/f37 [4795808,91902] 0 2023-12-16T03:16:03.440 INFO:tasks.workunit.client.0.smithi064.stdout:0/394: stat d2/d7/d10 0 2023-12-16T03:16:03.441 INFO:tasks.workunit.client.0.smithi064.stdout:4/471: sync 2023-12-16T03:16:03.441 INFO:tasks.workunit.client.0.smithi064.stdout:5/375: sync 2023-12-16T03:16:03.441 INFO:tasks.workunit.client.0.smithi064.stdout:5/376: dread - d0/d7/d34/f5c zero size 2023-12-16T03:16:03.444 INFO:tasks.workunit.client.0.smithi064.stdout:7/419: dwrite d7/d3e/d42/d48/f5e [0,4194304] 0 2023-12-16T03:16:03.444 INFO:tasks.workunit.client.0.smithi064.stdout:8/481: mknod d0/db/d37/d3a/d95/ca5 0 2023-12-16T03:16:03.444 INFO:tasks.workunit.client.0.smithi064.stdout:8/482: chown d0/d1d/c2e 223345 1 2023-12-16T03:16:03.445 INFO:tasks.workunit.client.0.smithi064.stdout:1/390: dwrite d3/dd/d23/d41/f4b [0,4194304] 0 2023-12-16T03:16:03.445 INFO:tasks.workunit.client.1.smithi184.stdout:1/701: creat d3/d34/dbc/d36/d9f/fec x:0 0 0 2023-12-16T03:16:03.446 INFO:tasks.workunit.client.0.smithi064.stdout:6/376: sync 2023-12-16T03:16:03.449 INFO:tasks.workunit.client.1.smithi184.stdout:7/658: rename d0/d3/d68 to d0/d6b/d94/dbe 0 2023-12-16T03:16:03.451 INFO:tasks.workunit.client.0.smithi064.stdout:9/394: symlink d2/dc/d24/d39/d5e/d6f/l79 0 2023-12-16T03:16:03.451 INFO:tasks.workunit.client.0.smithi064.stdout:9/395: stat d2/dc/d24/d39/d42/l4a 0 2023-12-16T03:16:03.451 INFO:tasks.workunit.client.0.smithi064.stdout:2/351: sync 2023-12-16T03:16:03.453 INFO:tasks.workunit.client.1.smithi184.stdout:2/651: mkdir d3/d29/d61/d6d/dd6 0 2023-12-16T03:16:03.456 INFO:tasks.workunit.client.0.smithi064.stdout:4/472: creat d0/d1e/d36/f93 x:0 0 0 2023-12-16T03:16:03.456 INFO:tasks.workunit.client.0.smithi064.stdout:4/473: chown d0/d12/d48/l51 170 1 2023-12-16T03:16:03.456 INFO:tasks.workunit.client.0.smithi064.stdout:4/474: dread - d0/d1e/d36/f93 zero size 2023-12-16T03:16:03.456 INFO:tasks.workunit.client.0.smithi064.stdout:4/475: chown d0/d1e/d36/f7e 0 1 2023-12-16T03:16:03.456 INFO:tasks.workunit.client.0.smithi064.stdout:4/476: readlink d0/da/l7b 0 2023-12-16T03:16:03.462 INFO:tasks.workunit.client.1.smithi184.stdout:2/652: creat d3/d29/d2f/fd7 x:0 0 0 2023-12-16T03:16:03.462 INFO:tasks.workunit.client.1.smithi184.stdout:2/653: chown d3/d29/d61/d6d 158583 1 2023-12-16T03:16:03.465 INFO:tasks.workunit.client.0.smithi064.stdout:3/494: rename db/d13 to db/d12/d1a/d2c/d34/d4c/d6a/da7 0 2023-12-16T03:16:03.467 INFO:tasks.workunit.client.0.smithi064.stdout:7/420: rmdir d7/d26 39 2023-12-16T03:16:03.469 INFO:tasks.workunit.client.1.smithi184.stdout:7/659: dread d0/d3/d2e/d79/d32/d39/f48 [0,4194304] 0 2023-12-16T03:16:03.469 INFO:tasks.workunit.client.1.smithi184.stdout:7/660: fdatasync d0/d3/d2e/d79/d36/f66 0 2023-12-16T03:16:03.470 INFO:tasks.workunit.client.0.smithi064.stdout:8/483: symlink d0/da/d3e/d46/d8f/la6 0 2023-12-16T03:16:03.470 INFO:tasks.workunit.client.0.smithi064.stdout:8/484: chown d0/da/d3e/d46/d8f/l63 607 1 2023-12-16T03:16:03.470 INFO:tasks.workunit.client.0.smithi064.stdout:8/485: readlink d0/da/d3e/d46/d8f/l63 0 2023-12-16T03:16:03.471 INFO:tasks.workunit.client.0.smithi064.stdout:1/391: dread d3/d36/f65 [0,4194304] 0 2023-12-16T03:16:03.472 INFO:tasks.workunit.client.1.smithi184.stdout:6/825: dwrite d0/d5/d22/d25/d47/fac [0,4194304] 0 2023-12-16T03:16:03.473 INFO:tasks.workunit.client.0.smithi064.stdout:9/396: creat d2/dc/d24/d39/d5e/d6f/f7a x:0 0 0 2023-12-16T03:16:03.473 INFO:tasks.workunit.client.0.smithi064.stdout:9/397: fsync d2/dc/d24/f5a 0 2023-12-16T03:16:03.473 INFO:tasks.workunit.client.0.smithi064.stdout:9/398: stat d2/dc/d24/d39 0 2023-12-16T03:16:03.474 INFO:tasks.workunit.client.0.smithi064.stdout:2/352: mknod d1/d27/d2e/c6c 0 2023-12-16T03:16:03.475 INFO:tasks.workunit.client.1.smithi184.stdout:6/826: read d0/d5/d22/d25/d3f/f81 [3841377,29663] 0 2023-12-16T03:16:03.475 INFO:tasks.workunit.client.0.smithi064.stdout:4/477: truncate d0/da/f16 4408587 0 2023-12-16T03:16:03.477 INFO:tasks.workunit.client.1.smithi184.stdout:7/661: symlink d0/d3/d2e/d3b/lbf 0 2023-12-16T03:16:03.478 INFO:tasks.workunit.client.0.smithi064.stdout:4/478: write d0/d42/d66/f5e [1160499,128953] 0 2023-12-16T03:16:03.479 INFO:tasks.workunit.client.0.smithi064.stdout:6/377: rename d3/d9/d2d/c36 to d3/d8/d13/d58/d65/c6b 0 2023-12-16T03:16:03.480 INFO:tasks.workunit.client.0.smithi064.stdout:3/495: mknod db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/ca8 0 2023-12-16T03:16:03.481 INFO:tasks.workunit.client.0.smithi064.stdout:1/392: mknod d3/dd/d23/d60/c81 0 2023-12-16T03:16:03.483 INFO:tasks.workunit.client.0.smithi064.stdout:6/378: symlink d3/d9/l6c 0 2023-12-16T03:16:03.485 INFO:tasks.workunit.client.1.smithi184.stdout:6/827: read d0/d5/d22/d25/d3f/d6f/ff4 [679819,14712] 0 2023-12-16T03:16:03.486 INFO:tasks.workunit.client.0.smithi064.stdout:3/496: getdents db/d12/d1a 0 2023-12-16T03:16:03.486 INFO:tasks.workunit.client.0.smithi064.stdout:3/497: fdatasync db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f66 0 2023-12-16T03:16:03.489 INFO:tasks.workunit.client.0.smithi064.stdout:1/393: symlink d3/d36/d44/d4d/l82 0 2023-12-16T03:16:03.489 INFO:tasks.workunit.client.0.smithi064.stdout:1/394: chown d3/d22 232018553 1 2023-12-16T03:16:03.494 INFO:tasks.workunit.client.1.smithi184.stdout:6/828: symlink d0/d5/dd1/l10b 0 2023-12-16T03:16:03.494 INFO:tasks.workunit.client.1.smithi184.stdout:6/829: fsync d0/d36/fdd 0 2023-12-16T03:16:03.495 INFO:tasks.workunit.client.1.smithi184.stdout:6/830: chown d0/d5/d12/d1b/d33/f91 108823 1 2023-12-16T03:16:03.495 INFO:tasks.workunit.client.0.smithi064.stdout:1/395: creat d3/d36/f83 x:0 0 0 2023-12-16T03:16:03.496 INFO:tasks.workunit.client.0.smithi064.stdout:1/396: symlink d3/dd/d23/l84 0 2023-12-16T03:16:03.496 INFO:tasks.workunit.client.0.smithi064.stdout:1/397: chown d3/dd/d11/d3b/f69 61338 1 2023-12-16T03:16:03.498 INFO:tasks.workunit.client.1.smithi184.stdout:6/831: link d0/d5/d22/d37/d45/d90/cf3 d0/d5/d12/d1b/d33/d3d/c10c 0 2023-12-16T03:16:03.498 INFO:tasks.workunit.client.1.smithi184.stdout:6/832: fsync d0/d5/d12/fb8 0 2023-12-16T03:16:03.498 INFO:tasks.workunit.client.1.smithi184.stdout:6/833: stat d0/d5/d22/d25/d3f/d6f/d9e 0 2023-12-16T03:16:03.498 INFO:tasks.workunit.client.1.smithi184.stdout:6/834: stat d0/d36/d8a/c85 0 2023-12-16T03:16:03.498 INFO:tasks.workunit.client.1.smithi184.stdout:6/835: chown d0/d5/d22/d25/dbf/dbe 376279484 1 2023-12-16T03:16:03.498 INFO:tasks.workunit.client.0.smithi064.stdout:1/398: dread d3/dd/d11/d3b/f69 [0,4194304] 0 2023-12-16T03:16:03.499 INFO:tasks.workunit.client.1.smithi184.stdout:6/836: write d0/d5/d22/d25/f92 [2137084,112412] 0 2023-12-16T03:16:03.500 INFO:tasks.workunit.client.0.smithi064.stdout:7/421: rename d7/d3e/d42/d43/d46 to d7/d3e/d42/d48/d51/d7c 0 2023-12-16T03:16:03.500 INFO:tasks.workunit.client.0.smithi064.stdout:5/377: dwrite d0/d50/f30 [0,4194304] 0 2023-12-16T03:16:03.500 INFO:tasks.workunit.client.0.smithi064.stdout:5/378: getdents d0/d14/d4e 0 2023-12-16T03:16:03.503 INFO:tasks.workunit.client.0.smithi064.stdout:9/399: rename d2/d2d/d3b/l5f to d2/dc/l7b 0 2023-12-16T03:16:03.503 INFO:tasks.workunit.client.0.smithi064.stdout:9/400: chown d2/d2d/d3b/d3c/d4b/f4c 26909409 1 2023-12-16T03:16:03.504 INFO:tasks.workunit.client.1.smithi184.stdout:7/662: dread d0/d3/d2e/d79/dd/f46 [0,4194304] 0 2023-12-16T03:16:03.504 INFO:tasks.workunit.client.1.smithi184.stdout:1/702: dwrite d3/d34/dbc/d3c/d41/d63/fe3 [0,4194304] 0 2023-12-16T03:16:03.504 INFO:tasks.workunit.client.1.smithi184.stdout:1/703: chown d3/c83 46 1 2023-12-16T03:16:03.504 INFO:tasks.workunit.client.1.smithi184.stdout:3/871: dwrite d12/d18/d1f/f44 [0,4194304] 0 2023-12-16T03:16:03.504 INFO:tasks.workunit.client.1.smithi184.stdout:1/704: fdatasync d3/d34/dbc/d3c/d41/d46/d4a/fce 0 2023-12-16T03:16:03.505 INFO:tasks.workunit.client.1.smithi184.stdout:3/872: read d12/d18/d1f/d23/d2a/d4a/d61/fac [316452,87911] 0 2023-12-16T03:16:03.505 INFO:tasks.workunit.client.1.smithi184.stdout:3/873: chown c10 583 1 2023-12-16T03:16:03.513 INFO:tasks.workunit.client.0.smithi064.stdout:5/379: mkdir d0/d19/d73/d87 0 2023-12-16T03:16:03.513 INFO:tasks.workunit.client.0.smithi064.stdout:0/395: dwrite d2/d8/da/df/f37 [0,4194304] 0 2023-12-16T03:16:03.518 INFO:tasks.workunit.client.0.smithi064.stdout:4/479: rename d0/d42/d56/c6c to d0/d42/d66/d5a/d75/c94 0 2023-12-16T03:16:03.520 INFO:tasks.workunit.client.0.smithi064.stdout:9/401: truncate d2/dc/f11 4507820 0 2023-12-16T03:16:03.520 INFO:tasks.workunit.client.0.smithi064.stdout:9/402: chown d2/d2d/d3b/d3c 29255 1 2023-12-16T03:16:03.521 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:03.521 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:03 smithi184 ceph-mon[121180]: pgmap v196: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 127 MiB/s rd, 274 MiB/s wr, 480 op/s 2023-12-16T03:16:03.521 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:03.521 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:03 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:03.522 INFO:tasks.workunit.client.1.smithi184.stdout:2/654: dwrite d3/d13/f18 [4194304,4194304] 0 2023-12-16T03:16:03.524 INFO:tasks.workunit.client.0.smithi064.stdout:3/498: dwrite db/d12/d1a/d2c/d34/d4c/d6a/f81 [0,4194304] 0 2023-12-16T03:16:03.524 INFO:tasks.workunit.client.0.smithi064.stdout:3/499: truncate db/d12/d1a/d31/f64 991531 0 2023-12-16T03:16:03.524 INFO:tasks.workunit.client.0.smithi064.stdout:8/486: dwrite d0/da/d3e/d46/f7b [4194304,4194304] 0 2023-12-16T03:16:03.524 INFO:tasks.workunit.client.0.smithi064.stdout:2/353: dwrite d1/d27/d2e/f5b [0,4194304] 0 2023-12-16T03:16:03.525 INFO:tasks.workunit.client.0.smithi064.stdout:6/379: dwrite d3/d8/d1f/f22 [0,4194304] 0 2023-12-16T03:16:03.525 INFO:tasks.workunit.client.0.smithi064.stdout:6/380: chown d3/d8/d13/d46/l66 3 1 2023-12-16T03:16:03.526 INFO:tasks.workunit.client.0.smithi064.stdout:1/399: rename d3/dd/f2d to d3/dd/d23/d41/f85 0 2023-12-16T03:16:03.531 INFO:tasks.workunit.client.0.smithi064.stdout:7/422: dwrite d7/d13/f6e [0,4194304] 0 2023-12-16T03:16:03.532 INFO:tasks.workunit.client.0.smithi064.stdout:4/480: creat d0/d1e/d36/f95 x:0 0 0 2023-12-16T03:16:03.532 INFO:tasks.workunit.client.0.smithi064.stdout:4/481: fsync d0/d42/d66/f73 0 2023-12-16T03:16:03.538 INFO:tasks.workunit.client.1.smithi184.stdout:7/663: rename d0/d6b/d69/f90 to d0/d3/d4/fc0 0 2023-12-16T03:16:03.538 INFO:tasks.workunit.client.1.smithi184.stdout:7/664: readlink d0/l7a 0 2023-12-16T03:16:03.539 INFO:tasks.workunit.client.1.smithi184.stdout:3/874: creat d12/d18/d1f/d23/d2a/f144 x:0 0 0 2023-12-16T03:16:03.542 INFO:tasks.workunit.client.1.smithi184.stdout:6/837: rmdir d0/d5/d12 39 2023-12-16T03:16:03.546 INFO:tasks.workunit.client.0.smithi064.stdout:8/487: truncate d0/d1d/d3c/d42/f5d 4168557 0 2023-12-16T03:16:03.546 INFO:tasks.workunit.client.0.smithi064.stdout:8/488: readlink d0/db/d4c/l80 0 2023-12-16T03:16:03.548 INFO:tasks.workunit.client.0.smithi064.stdout:7/423: fdatasync d7/d3e/f78 0 2023-12-16T03:16:03.548 INFO:tasks.workunit.client.1.smithi184.stdout:2/655: dwrite d3/d9/d19/f26 [0,4194304] 0 2023-12-16T03:16:03.549 INFO:tasks.workunit.client.0.smithi064.stdout:5/380: dwrite d0/f17 [0,4194304] 0 2023-12-16T03:16:03.550 INFO:tasks.workunit.client.0.smithi064.stdout:2/354: creat d1/d15/d1b/d61/d63/f6d x:0 0 0 2023-12-16T03:16:03.551 INFO:tasks.workunit.client.1.smithi184.stdout:3/875: mknod d12/d18/d1f/d23/d2a/d42/de9/c145 0 2023-12-16T03:16:03.551 INFO:tasks.workunit.client.1.smithi184.stdout:7/665: dread d0/d3/f5 [0,4194304] 0 2023-12-16T03:16:03.552 INFO:tasks.workunit.client.1.smithi184.stdout:2/656: dread d3/d13/d28/f69 [0,4194304] 0 2023-12-16T03:16:03.553 INFO:tasks.workunit.client.0.smithi064.stdout:6/381: mknod d3/d8/d13/d58/c6d 0 2023-12-16T03:16:03.554 INFO:tasks.workunit.client.1.smithi184.stdout:1/705: dwrite d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/fb2 [0,4194304] 0 2023-12-16T03:16:03.556 INFO:tasks.workunit.client.0.smithi064.stdout:0/396: rename d2/d8/da/df/d5e to d2/d7/d10/d21/d7a 0 2023-12-16T03:16:03.559 INFO:tasks.workunit.client.0.smithi064.stdout:1/400: unlink d3/dd/d23/d60/f79 0 2023-12-16T03:16:03.559 INFO:tasks.workunit.client.0.smithi064.stdout:1/401: chown d3/dd/c18 1358 1 2023-12-16T03:16:03.561 INFO:tasks.workunit.client.1.smithi184.stdout:2/657: creat d3/d29/d2f/fd8 x:0 0 0 2023-12-16T03:16:03.561 INFO:tasks.workunit.client.1.smithi184.stdout:2/658: write d3/d13/d6e/fd5 [369985,33474] 0 2023-12-16T03:16:03.561 INFO:tasks.workunit.client.1.smithi184.stdout:2/659: truncate d3/d29/d4d/d5b/f89 838770 0 2023-12-16T03:16:03.569 INFO:tasks.workunit.client.0.smithi064.stdout:4/482: getdents d0/d12 0 2023-12-16T03:16:03.571 INFO:tasks.workunit.client.0.smithi064.stdout:8/489: mknod d0/db/d37/d3a/d6f/ca7 0 2023-12-16T03:16:03.573 INFO:tasks.workunit.client.0.smithi064.stdout:7/424: mknod d7/d13/d20/d37/c7d 0 2023-12-16T03:16:03.575 INFO:tasks.workunit.client.0.smithi064.stdout:5/381: dread d0/f6c [0,4194304] 0 2023-12-16T03:16:03.575 INFO:tasks.workunit.client.1.smithi184.stdout:2/660: rename d3/d29/d2f/d2e/f12 to d3/d13/fd9 0 2023-12-16T03:16:03.577 INFO:tasks.workunit.client.1.smithi184.stdout:2/661: mkdir d3/d13/d28/d83/dda 0 2023-12-16T03:16:03.578 INFO:tasks.workunit.client.0.smithi064.stdout:2/355: symlink d1/d27/d2e/d68/d55/d57/l6e 0 2023-12-16T03:16:03.579 INFO:tasks.workunit.client.1.smithi184.stdout:5/578: sync 2023-12-16T03:16:03.579 INFO:tasks.workunit.client.1.smithi184.stdout:4/717: sync 2023-12-16T03:16:03.579 INFO:tasks.workunit.client.1.smithi184.stdout:0/766: sync 2023-12-16T03:16:03.580 INFO:tasks.workunit.client.0.smithi064.stdout:9/403: rename d2/ld to d2/d2d/l7c 0 2023-12-16T03:16:03.580 INFO:tasks.workunit.client.0.smithi064.stdout:9/404: chown d2/dc 674021 1 2023-12-16T03:16:03.581 INFO:tasks.workunit.client.0.smithi064.stdout:0/397: creat d2/d29/d66/d67/f7b x:0 0 0 2023-12-16T03:16:03.581 INFO:tasks.workunit.client.1.smithi184.stdout:2/662: write d3/d9/faa [4061039,32663] 0 2023-12-16T03:16:03.582 INFO:tasks.workunit.client.1.smithi184.stdout:4/718: unlink d1/f8 0 2023-12-16T03:16:03.583 INFO:tasks.workunit.client.0.smithi064.stdout:1/402: mkdir d3/dd/d23/d86 0 2023-12-16T03:16:03.584 INFO:tasks.workunit.client.0.smithi064.stdout:8/490: unlink d0/d1d/d24/d2f/l5b 0 2023-12-16T03:16:03.585 INFO:tasks.workunit.client.1.smithi184.stdout:4/719: write d1/d12/f9b [500616,63397] 0 2023-12-16T03:16:03.586 INFO:tasks.workunit.client.1.smithi184.stdout:0/767: creat dc/d10/d2d/d5f/d7c/f106 x:0 0 0 2023-12-16T03:16:03.588 INFO:tasks.workunit.client.0.smithi064.stdout:7/425: unlink d7/d13/c4d 0 2023-12-16T03:16:03.588 INFO:tasks.workunit.client.0.smithi064.stdout:7/426: fdatasync d7/d13/f6e 0 2023-12-16T03:16:03.589 INFO:tasks.workunit.client.0.smithi064.stdout:7/427: truncate d7/f9 4631996 0 2023-12-16T03:16:03.589 INFO:tasks.workunit.client.0.smithi064.stdout:7/428: readlink d7/d3e/d42/d48/d51/l5d 0 2023-12-16T03:16:03.589 INFO:tasks.workunit.client.1.smithi184.stdout:6/838: dwrite d0/d5/d22/d25/d3f/d6f/f93 [0,4194304] 0 2023-12-16T03:16:03.589 INFO:tasks.workunit.client.1.smithi184.stdout:6/839: fsync d0/d5/d22/d25/d3f/f81 0 2023-12-16T03:16:03.590 INFO:tasks.workunit.client.1.smithi184.stdout:8/799: sync 2023-12-16T03:16:03.590 INFO:tasks.workunit.client.1.smithi184.stdout:5/579: mkdir d1/dbb 0 2023-12-16T03:16:03.592 INFO:tasks.workunit.client.0.smithi064.stdout:5/382: unlink d0/d19/f4a 0 2023-12-16T03:16:03.592 INFO:tasks.workunit.client.0.smithi064.stdout:5/383: dread - d0/d14/d20/d37/d70/f81 zero size 2023-12-16T03:16:03.594 INFO:tasks.workunit.client.1.smithi184.stdout:7/666: dwrite d0/d6b/d69/f6e [0,4194304] 0 2023-12-16T03:16:03.594 INFO:tasks.workunit.client.1.smithi184.stdout:7/667: chown d0/d3/d2e/d79/c80 9068 1 2023-12-16T03:16:03.594 INFO:tasks.workunit.client.1.smithi184.stdout:7/668: fsync d0/d3/d2e/d79/dd/f46 0 2023-12-16T03:16:03.594 INFO:tasks.workunit.client.1.smithi184.stdout:1/706: dwrite d3/d34/dbc/d3c/d41/d77/fba [0,4194304] 0 2023-12-16T03:16:03.594 INFO:tasks.workunit.client.1.smithi184.stdout:1/707: write d3/d34/dbc/d3c/d41/d46/fc8 [569180,85846] 0 2023-12-16T03:16:03.594 INFO:tasks.workunit.client.1.smithi184.stdout:1/708: write d3/d34/dbc/d3c/d41/f62 [290687,20837] 0 2023-12-16T03:16:03.594 INFO:tasks.workunit.client.1.smithi184.stdout:1/709: fsync d3/d13/d2c/f81 0 2023-12-16T03:16:03.595 INFO:tasks.workunit.client.1.smithi184.stdout:0/768: creat dc/d10/d2d/f107 x:0 0 0 2023-12-16T03:16:03.596 INFO:tasks.workunit.client.0.smithi064.stdout:2/356: getdents d1/d15/d67 0 2023-12-16T03:16:03.596 INFO:tasks.workunit.client.0.smithi064.stdout:2/357: write d1/d27/d2e/d69/f5a [504852,24256] 0 2023-12-16T03:16:03.599 INFO:tasks.workunit.client.0.smithi064.stdout:3/500: rename db/d12/d1a/d2c/d90 to db/d4f/da9 0 2023-12-16T03:16:03.600 INFO:tasks.workunit.client.1.smithi184.stdout:2/663: dwrite d3/d29/f78 [0,4194304] 0 2023-12-16T03:16:03.600 INFO:tasks.workunit.client.1.smithi184.stdout:3/876: dwrite d12/d1e/f47 [0,4194304] 0 2023-12-16T03:16:03.602 INFO:tasks.workunit.client.0.smithi064.stdout:6/382: dwrite d3/f5 [0,4194304] 0 2023-12-16T03:16:03.602 INFO:tasks.workunit.client.0.smithi064.stdout:7/429: write d7/d13/f6e [4395756,129498] 0 2023-12-16T03:16:03.602 INFO:tasks.workunit.client.0.smithi064.stdout:7/430: chown d7/d26/l40 2412775 1 2023-12-16T03:16:03.603 INFO:tasks.workunit.client.0.smithi064.stdout:7/431: chown d7/d13/d20/f28 835867136 1 2023-12-16T03:16:03.603 INFO:tasks.workunit.client.0.smithi064.stdout:7/432: dread - d7/d3e/d42/f72 zero size 2023-12-16T03:16:03.603 INFO:tasks.workunit.client.0.smithi064.stdout:7/433: truncate d7/d26/d30/f57 1360204 0 2023-12-16T03:16:03.603 INFO:tasks.workunit.client.0.smithi064.stdout:8/491: write d0/d1d/d3c/d42/f5d [1625542,100175] 0 2023-12-16T03:16:03.603 INFO:tasks.workunit.client.0.smithi064.stdout:8/492: fdatasync d0/db/d37/f61 0 2023-12-16T03:16:03.603 INFO:tasks.workunit.client.0.smithi064.stdout:8/493: chown d0/db/d12/d1c/d6a/d7e 1285519 1 2023-12-16T03:16:03.604 INFO:tasks.workunit.client.0.smithi064.stdout:9/405: mkdir d2/dc/d24/d39/d77/d7d 0 2023-12-16T03:16:03.605 INFO:tasks.workunit.client.0.smithi064.stdout:1/403: mknod d3/dd/d11/d6a/c87 0 2023-12-16T03:16:03.606 INFO:tasks.workunit.client.1.smithi184.stdout:2/664: write d3/d9/d19/f26 [2934444,101725] 0 2023-12-16T03:16:03.606 INFO:tasks.workunit.client.1.smithi184.stdout:6/840: rename d0/d5/dd1/le6 to d0/d5/d22/d25/d3f/d6f/l10d 0 2023-12-16T03:16:03.606 INFO:tasks.workunit.client.1.smithi184.stdout:9/971: sync 2023-12-16T03:16:03.606 INFO:tasks.workunit.client.1.smithi184.stdout:8/800: rmdir d2/d12/d21/d2d/d31/d34/d96/dca 39 2023-12-16T03:16:03.606 INFO:tasks.workunit.client.1.smithi184.stdout:8/801: fsync d2/d4/d10/d7a/f7f 0 2023-12-16T03:16:03.609 INFO:tasks.workunit.client.1.smithi184.stdout:5/580: truncate d1/d3/d9/de/d15/f57 6241863 0 2023-12-16T03:16:03.610 INFO:tasks.workunit.client.0.smithi064.stdout:5/384: symlink d0/d19/l88 0 2023-12-16T03:16:03.613 INFO:tasks.workunit.client.0.smithi064.stdout:2/358: creat d1/d27/d2e/d68/d60/f6f x:0 0 0 2023-12-16T03:16:03.613 INFO:tasks.workunit.client.0.smithi064.stdout:6/383: dread d3/d8/da/f37 [0,4194304] 0 2023-12-16T03:16:03.616 INFO:tasks.workunit.client.0.smithi064.stdout:4/483: rename d0/d42/d66/d33/l84 to d0/d42/d66/d5a/d75/l96 0 2023-12-16T03:16:03.619 INFO:tasks.workunit.client.0.smithi064.stdout:3/501: mkdir db/d4f/daa 0 2023-12-16T03:16:03.624 INFO:tasks.workunit.client.1.smithi184.stdout:5/581: dread d1/d3/d9/f39 [0,4194304] 0 2023-12-16T03:16:03.625 INFO:tasks.workunit.client.0.smithi064.stdout:1/404: dwrite d3/dd/d11/d3b/f5e [4194304,4194304] 0 2023-12-16T03:16:03.626 INFO:tasks.workunit.client.0.smithi064.stdout:1/405: chown d3/d22/f68 124942455 1 2023-12-16T03:16:03.626 INFO:tasks.workunit.client.0.smithi064.stdout:1/406: chown d3/d22/d57 5 1 2023-12-16T03:16:03.626 INFO:tasks.workunit.client.0.smithi064.stdout:1/407: write d3/dd/d11/d3b/f5e [8904935,62174] 0 2023-12-16T03:16:03.628 INFO:tasks.workunit.client.0.smithi064.stdout:7/434: creat d7/d3e/d42/d43/f7e x:0 0 0 2023-12-16T03:16:03.628 INFO:tasks.workunit.client.0.smithi064.stdout:7/435: chown d7/d13/d20/d37/c7d 477 1 2023-12-16T03:16:03.628 INFO:tasks.workunit.client.0.smithi064.stdout:7/436: dread - d7/d13/f76 zero size 2023-12-16T03:16:03.629 INFO:tasks.workunit.client.0.smithi064.stdout:3/502: dread db/d12/f3b [0,4194304] 0 2023-12-16T03:16:03.629 INFO:tasks.workunit.client.1.smithi184.stdout:7/669: mkdir d0/d3/d2e/d79/d34/dc1 0 2023-12-16T03:16:03.630 INFO:tasks.workunit.client.0.smithi064.stdout:8/494: rmdir d0/da/d3e/d46/d54/d8c 39 2023-12-16T03:16:03.632 INFO:tasks.workunit.client.1.smithi184.stdout:1/710: unlink d3/l22 0 2023-12-16T03:16:03.633 INFO:tasks.workunit.client.1.smithi184.stdout:1/711: fdatasync d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/fe6 0 2023-12-16T03:16:03.633 INFO:tasks.workunit.client.1.smithi184.stdout:1/712: write d3/d34/dbc/d3c/d41/d77/f78 [5771369,2446] 0 2023-12-16T03:16:03.634 INFO:tasks.workunit.client.1.smithi184.stdout:0/769: mkdir dc/d10/da7/dc0/d108 0 2023-12-16T03:16:03.636 INFO:tasks.workunit.client.0.smithi064.stdout:9/406: getdents d2/d2d/d3b 0 2023-12-16T03:16:03.636 INFO:tasks.workunit.client.0.smithi064.stdout:9/407: write d2/dc/d24/d39/d42/f6e [1018924,71517] 0 2023-12-16T03:16:03.639 INFO:tasks.workunit.client.0.smithi064.stdout:6/384: dwrite d3/d8/da/fe [0,4194304] 0 2023-12-16T03:16:03.640 INFO:tasks.workunit.client.0.smithi064.stdout:2/359: dwrite d1/d15/f1a [0,4194304] 0 2023-12-16T03:16:03.642 INFO:tasks.workunit.client.0.smithi064.stdout:0/398: rename d2/d8/da/f4e to d2/f7c 0 2023-12-16T03:16:03.645 INFO:tasks.workunit.client.0.smithi064.stdout:4/484: mknod d0/d42/d66/d5a/c97 0 2023-12-16T03:16:03.645 INFO:tasks.workunit.client.0.smithi064.stdout:3/503: dwrite db/d12/d4e/f88 [0,4194304] 0 2023-12-16T03:16:03.645 INFO:tasks.workunit.client.0.smithi064.stdout:3/504: dread - db/d12/d1a/d2c/d34/d4c/d6a/f94 zero size 2023-12-16T03:16:03.650 INFO:tasks.workunit.client.0.smithi064.stdout:1/408: creat d3/d36/d44/d4d/f88 x:0 0 0 2023-12-16T03:16:03.652 INFO:tasks.workunit.client.1.smithi184.stdout:3/877: unlink d12/d1e/de8/l73 0 2023-12-16T03:16:03.654 INFO:tasks.workunit.client.0.smithi064.stdout:7/437: mknod d7/d3e/c7f 0 2023-12-16T03:16:03.654 INFO:tasks.workunit.client.0.smithi064.stdout:7/438: truncate d7/d3e/d42/f73 646685 0 2023-12-16T03:16:03.655 INFO:tasks.workunit.client.0.smithi064.stdout:7/439: write d7/d3e/d42/d48/d51/d7c/f77 [404481,48436] 0 2023-12-16T03:16:03.659 INFO:tasks.workunit.client.0.smithi064.stdout:5/385: creat d0/de/d23/f89 x:0 0 0 2023-12-16T03:16:03.660 INFO:tasks.workunit.client.1.smithi184.stdout:6/841: mkdir d0/d5/d22/d25/d47/d10e 0 2023-12-16T03:16:03.664 INFO:tasks.workunit.client.0.smithi064.stdout:9/408: mkdir d2/d7e 0 2023-12-16T03:16:03.665 INFO:tasks.workunit.client.1.smithi184.stdout:9/972: mkdir d0/d76/da2/db4/d14a 0 2023-12-16T03:16:03.665 INFO:tasks.workunit.client.1.smithi184.stdout:9/973: fdatasync d0/d30/f94 0 2023-12-16T03:16:03.665 INFO:tasks.workunit.client.1.smithi184.stdout:3/878: dread d12/d18/d68/f9a [0,4194304] 0 2023-12-16T03:16:03.665 INFO:tasks.workunit.client.1.smithi184.stdout:8/802: creat d2/d4/d10/d11/d77/f104 x:0 0 0 2023-12-16T03:16:03.667 INFO:tasks.workunit.client.0.smithi064.stdout:6/385: mkdir d3/d8/d13/d58/d65/d6e 0 2023-12-16T03:16:03.667 INFO:tasks.workunit.client.0.smithi064.stdout:0/399: dwrite d2/f3e [0,4194304] 0 2023-12-16T03:16:03.667 INFO:tasks.workunit.client.0.smithi064.stdout:0/400: write d2/d7/d10/f52 [992299,68411] 0 2023-12-16T03:16:03.667 INFO:tasks.workunit.client.0.smithi064.stdout:3/505: dwrite db/d12/d21/f49 [0,4194304] 0 2023-12-16T03:16:03.667 INFO:tasks.workunit.client.0.smithi064.stdout:3/506: truncate db/d4f/f6b 5222421 0 2023-12-16T03:16:03.667 INFO:tasks.workunit.client.0.smithi064.stdout:3/507: dread - db/d12/d1a/d2c/d6e/d75/f8a zero size 2023-12-16T03:16:03.667 INFO:tasks.workunit.client.0.smithi064.stdout:3/508: rename db/d12 to db/d12/d1a/d2c/d34/d4c/dab 22 2023-12-16T03:16:03.667 INFO:tasks.workunit.client.0.smithi064.stdout:3/509: chown db/d12/f3b 0 1 2023-12-16T03:16:03.668 INFO:tasks.workunit.client.0.smithi064.stdout:6/386: write d3/d9/f45 [1723656,6140] 0 2023-12-16T03:16:03.668 INFO:tasks.workunit.client.0.smithi064.stdout:0/401: write d2/f16 [3430731,23796] 0 2023-12-16T03:16:03.668 INFO:tasks.workunit.client.0.smithi064.stdout:0/402: chown d2/d8/da/f75 1 1 2023-12-16T03:16:03.670 INFO:tasks.workunit.client.0.smithi064.stdout:2/360: unlink d1/d15/d23/d2d/c66 0 2023-12-16T03:16:03.675 INFO:tasks.workunit.client.0.smithi064.stdout:0/403: dread d2/d7/d10/f14 [0,4194304] 0 2023-12-16T03:16:03.675 INFO:tasks.workunit.client.0.smithi064.stdout:0/404: dread - d2/d8/da/df/f72 zero size 2023-12-16T03:16:03.676 INFO:tasks.workunit.client.1.smithi184.stdout:5/582: rename d1/d3/d9/de/d30/f86 to d1/d3/d9/fbc 0 2023-12-16T03:16:03.679 INFO:tasks.workunit.client.1.smithi184.stdout:7/670: mkdir d0/d3/d2e/d79/d32/d39/d9c/dc2 0 2023-12-16T03:16:03.681 INFO:tasks.workunit.client.0.smithi064.stdout:4/485: link d0/d1e/f29 d0/d42/d4c/d70/d8c/f98 0 2023-12-16T03:16:03.681 INFO:tasks.workunit.client.0.smithi064.stdout:4/486: write d0/d42/d66/f26 [751497,70696] 0 2023-12-16T03:16:03.682 INFO:tasks.workunit.client.1.smithi184.stdout:3/879: dwrite d12/d18/d1f/d23/d2a/dfc/fa7 [0,4194304] 0 2023-12-16T03:16:03.683 INFO:tasks.workunit.client.0.smithi064.stdout:1/409: symlink d3/d36/d44/d4d/d58/l89 0 2023-12-16T03:16:03.687 INFO:tasks.workunit.client.1.smithi184.stdout:1/713: rmdir d3/d34/dbc/d36/d9f 39 2023-12-16T03:16:03.689 INFO:tasks.workunit.client.0.smithi064.stdout:7/440: creat d7/d13/d20/f80 x:0 0 0 2023-12-16T03:16:03.691 INFO:tasks.workunit.client.1.smithi184.stdout:3/880: dread d12/d37/d81/fd9 [0,4194304] 0 2023-12-16T03:16:03.691 INFO:tasks.workunit.client.1.smithi184.stdout:3/881: dread - d12/d18/d1f/d23/f11c zero size 2023-12-16T03:16:03.691 INFO:tasks.workunit.client.1.smithi184.stdout:3/882: fsync d12/d18/d1f/d23/d2a/d36/f5b 0 2023-12-16T03:16:03.691 INFO:tasks.workunit.client.1.smithi184.stdout:0/770: mkdir dc/d22/d45/d66/d80/da3/d109 0 2023-12-16T03:16:03.692 INFO:tasks.workunit.client.1.smithi184.stdout:3/883: readlink d12/d86/de4/d99/le0 0 2023-12-16T03:16:03.692 INFO:tasks.workunit.client.1.smithi184.stdout:0/771: chown dc/f58 30970 1 2023-12-16T03:16:03.692 INFO:tasks.workunit.client.1.smithi184.stdout:0/772: fsync dc/d22/d53/f95 0 2023-12-16T03:16:03.692 INFO:tasks.workunit.client.1.smithi184.stdout:3/884: write d12/d18/d1f/d23/d2a/d4a/d61/da9/d106/d10b/f10c [86382,21523] 0 2023-12-16T03:16:03.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:03.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:03 smithi064 ceph-mon[111958]: pgmap v196: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 127 MiB/s rd, 274 MiB/s wr, 480 op/s 2023-12-16T03:16:03.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:03.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:03 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:03.694 INFO:tasks.workunit.client.0.smithi064.stdout:8/495: mkdir d0/da/d3e/d46/d54/d7c/da8 0 2023-12-16T03:16:03.696 INFO:tasks.workunit.client.0.smithi064.stdout:5/386: creat d0/d14/d25/d3e/d35/f8a x:0 0 0 2023-12-16T03:16:03.696 INFO:tasks.workunit.client.0.smithi064.stdout:5/387: chown d0/d14/d20/l4d 355602626 1 2023-12-16T03:16:03.696 INFO:tasks.workunit.client.0.smithi064.stdout:5/388: readlink d0/d14/d25/l55 0 2023-12-16T03:16:03.697 INFO:tasks.workunit.client.0.smithi064.stdout:5/389: read d0/d19/f27 [2501225,28552] 0 2023-12-16T03:16:03.697 INFO:tasks.workunit.client.0.smithi064.stdout:5/390: readlink d0/d19/d48/l77 0 2023-12-16T03:16:03.698 INFO:tasks.workunit.client.0.smithi064.stdout:9/409: getdents d2/dc 0 2023-12-16T03:16:03.698 INFO:tasks.workunit.client.1.smithi184.stdout:2/665: mkdir d3/ddb 0 2023-12-16T03:16:03.698 INFO:tasks.workunit.client.1.smithi184.stdout:2/666: write d3/d29/d2f/d46/d77/f9d [3046978,82769] 0 2023-12-16T03:16:03.699 INFO:tasks.workunit.client.1.smithi184.stdout:6/842: symlink d0/d5/d22/d25/dbf/l10f 0 2023-12-16T03:16:03.700 INFO:tasks.workunit.client.1.smithi184.stdout:2/667: dread d3/d13/d6e/fd5 [0,4194304] 0 2023-12-16T03:16:03.700 INFO:tasks.workunit.client.1.smithi184.stdout:6/843: write d0/d5/d12/fb8 [60915,27645] 0 2023-12-16T03:16:03.701 INFO:tasks.workunit.client.1.smithi184.stdout:6/844: fsync d0/d5/f4a 0 2023-12-16T03:16:03.701 INFO:tasks.workunit.client.1.smithi184.stdout:6/845: chown d0/d5/d22/d37/d4d/d87/f100 8 1 2023-12-16T03:16:03.701 INFO:tasks.workunit.client.1.smithi184.stdout:9/974: creat d0/d76/dbf/f14b x:0 0 0 2023-12-16T03:16:03.705 INFO:tasks.workunit.client.1.smithi184.stdout:8/803: creat d2/d4/d10/d7a/d83/f105 x:0 0 0 2023-12-16T03:16:03.708 INFO:tasks.workunit.client.0.smithi064.stdout:3/510: symlink db/d12/d4e/d56/lac 0 2023-12-16T03:16:03.709 INFO:tasks.workunit.client.1.smithi184.stdout:5/583: creat d1/d3/d9/de/d15/db9/fbd x:0 0 0 2023-12-16T03:16:03.710 INFO:tasks.workunit.client.1.smithi184.stdout:5/584: write d1/f29 [5638922,124723] 0 2023-12-16T03:16:03.711 INFO:tasks.workunit.client.1.smithi184.stdout:7/671: truncate d0/d6b/d69/fad 1777616 0 2023-12-16T03:16:03.713 INFO:tasks.workunit.client.0.smithi064.stdout:2/361: symlink d1/d15/d23/d2d/l70 0 2023-12-16T03:16:03.713 INFO:tasks.workunit.client.0.smithi064.stdout:2/362: chown d1/d15/d1b/d49/d4e 3034748 1 2023-12-16T03:16:03.718 INFO:tasks.workunit.client.1.smithi184.stdout:1/714: truncate d3/d34/dbc/d3c/d41/d46/d4a/fad 854241 0 2023-12-16T03:16:03.721 INFO:tasks.workunit.client.1.smithi184.stdout:3/885: mknod d12/d86/de4/d110/c146 0 2023-12-16T03:16:03.723 INFO:tasks.workunit.client.1.smithi184.stdout:0/773: symlink dc/d22/d1d/d35/dd8/l10a 0 2023-12-16T03:16:03.723 INFO:tasks.workunit.client.1.smithi184.stdout:0/774: truncate dc/d10/d2d/fe5 55013 0 2023-12-16T03:16:03.727 INFO:tasks.workunit.client.1.smithi184.stdout:6/846: creat d0/d5/d12/d1b/d33/d3d/d96/f110 x:0 0 0 2023-12-16T03:16:03.727 INFO:tasks.workunit.client.1.smithi184.stdout:0/775: dread dc/d22/d53/f95 [0,4194304] 0 2023-12-16T03:16:03.727 INFO:tasks.workunit.client.1.smithi184.stdout:0/776: write dc/d10/d2d/fe5 [47934,45370] 0 2023-12-16T03:16:03.727 INFO:tasks.workunit.client.1.smithi184.stdout:0/777: write dc/d22/d45/d66/d80/fe7 [1121113,58295] 0 2023-12-16T03:16:03.729 INFO:tasks.workunit.client.1.smithi184.stdout:9/975: creat d0/d13/d20/d5b/d53/d13c/f14c x:0 0 0 2023-12-16T03:16:03.730 INFO:tasks.workunit.client.0.smithi064.stdout:0/405: symlink d2/d8/da/d11/l7d 0 2023-12-16T03:16:03.731 INFO:tasks.workunit.client.1.smithi184.stdout:8/804: mknod d2/d4/da6/c106 0 2023-12-16T03:16:03.752 INFO:tasks.workunit.client.0.smithi064.stdout:0/406: dwrite d2/d8/da/f62 [0,4194304] 0 2023-12-16T03:16:03.752 INFO:tasks.workunit.client.1.smithi184.stdout:8/805: dwrite d2/d4/da6/fe3 [0,4194304] 0 2023-12-16T03:16:03.753 INFO:tasks.workunit.client.1.smithi184.stdout:8/806: dread d2/d12/db4/fb9 [0,4194304] 0 2023-12-16T03:16:03.770 INFO:tasks.workunit.client.1.smithi184.stdout:8/807: dwrite d2/f13 [0,4194304] 0 2023-12-16T03:16:03.770 INFO:tasks.workunit.client.1.smithi184.stdout:8/808: dread - d2/d4/d10/d11/d77/ff5 zero size 2023-12-16T03:16:03.770 INFO:tasks.workunit.client.1.smithi184.stdout:8/809: fdatasync d2/d4/d10/d11/d72/dc2/fcf 0 2023-12-16T03:16:03.793 INFO:tasks.workunit.client.1.smithi184.stdout:5/585: unlink d1/d3/d9/de/d15/d19/f23 0 2023-12-16T03:16:03.797 INFO:tasks.workunit.client.1.smithi184.stdout:7/672: rename d0/d6b/l65 to d0/d3/d2e/d79/d32/d8a/lc3 0 2023-12-16T03:16:03.801 INFO:tasks.workunit.client.0.smithi064.stdout:4/487: rename d0/d42/l78 to d0/d42/d66/d33/l99 0 2023-12-16T03:16:03.802 INFO:tasks.workunit.client.1.smithi184.stdout:1/715: truncate d3/d34/dbc/d3c/d41/d46/f8c 1152688 0 2023-12-16T03:16:03.803 INFO:tasks.workunit.client.0.smithi064.stdout:1/410: mkdir d3/dd/d23/d41/d8a 0 2023-12-16T03:16:03.803 INFO:tasks.workunit.client.0.smithi064.stdout:1/411: chown d3/dd/d23/d41/f85 56153 1 2023-12-16T03:16:03.803 INFO:tasks.workunit.client.0.smithi064.stdout:1/412: fdatasync d3/dd/d11/f17 0 2023-12-16T03:16:03.804 INFO:tasks.workunit.client.0.smithi064.stdout:7/441: creat d7/d13/d74/f81 x:0 0 0 2023-12-16T03:16:03.805 INFO:tasks.workunit.client.1.smithi184.stdout:3/886: mkdir d12/d18/da1/d115/d11d/d147 0 2023-12-16T03:16:03.808 INFO:tasks.workunit.client.0.smithi064.stdout:8/496: creat d0/d1d/d3c/d42/d93/fa9 x:0 0 0 2023-12-16T03:16:03.809 INFO:tasks.workunit.client.1.smithi184.stdout:2/668: mknod d3/cdc 0 2023-12-16T03:16:03.811 INFO:tasks.workunit.client.1.smithi184.stdout:6/847: getdents d0/d5/d22/d25/dbf/dbe 0 2023-12-16T03:16:03.811 INFO:tasks.workunit.client.1.smithi184.stdout:6/848: chown d0/d5/d22/d25/d3f 4788293 1 2023-12-16T03:16:03.813 INFO:tasks.workunit.client.0.smithi064.stdout:9/410: rename d2/dc/d24/d39/d42/l4a to d2/dc/d24/d39/d42/l7f 0 2023-12-16T03:16:03.815 INFO:tasks.workunit.client.1.smithi184.stdout:0/778: link dc/d22/d45/d66/fae dc/d22/d1d/d8e/f10b 0 2023-12-16T03:16:03.817 INFO:tasks.workunit.client.0.smithi064.stdout:3/511: mknod db/d12/d1a/d31/cad 0 2023-12-16T03:16:03.817 INFO:tasks.workunit.client.0.smithi064.stdout:3/512: read db/d12/f3b [4165601,60862] 0 2023-12-16T03:16:03.818 INFO:tasks.workunit.client.0.smithi064.stdout:2/363: mknod d1/d15/d23/c71 0 2023-12-16T03:16:03.822 INFO:tasks.workunit.client.1.smithi184.stdout:9/976: link d0/d3a/d47/l114 d0/d76/da2/dc4/l14d 0 2023-12-16T03:16:03.822 INFO:tasks.workunit.client.1.smithi184.stdout:9/977: chown d0/d13/d20/d5b/d43/dc7/ddc/cb8 107 1 2023-12-16T03:16:03.824 INFO:tasks.workunit.client.0.smithi064.stdout:0/407: link d2/d7/d10/d21/d31/f59 d2/d7/d10/f7e 0 2023-12-16T03:16:03.826 INFO:tasks.workunit.client.0.smithi064.stdout:4/488: symlink d0/d42/d66/d33/l9a 0 2023-12-16T03:16:03.826 INFO:tasks.workunit.client.0.smithi064.stdout:4/489: write d0/da/f6d [1937041,66526] 0 2023-12-16T03:16:03.826 INFO:tasks.workunit.client.0.smithi064.stdout:4/490: read - d0/d1e/d36/f7e zero size 2023-12-16T03:16:03.827 INFO:tasks.workunit.client.0.smithi064.stdout:1/413: dwrite d3/dd/d11/d2f/f4c [0,4194304] 0 2023-12-16T03:16:03.827 INFO:tasks.workunit.client.1.smithi184.stdout:8/810: symlink d2/d4/d10/d11/d72/dc2/l107 0 2023-12-16T03:16:03.828 INFO:tasks.workunit.client.1.smithi184.stdout:0/779: dread dc/d22/d1d/d35/dc3/f9e [0,4194304] 0 2023-12-16T03:16:03.828 INFO:tasks.workunit.client.1.smithi184.stdout:0/780: chown dc/d22/d1d/d2c/d75/l105 1 1 2023-12-16T03:16:03.828 INFO:tasks.workunit.client.1.smithi184.stdout:0/781: chown dc/d22/d1d/d8e/f10b 2 1 2023-12-16T03:16:03.829 INFO:tasks.workunit.client.1.smithi184.stdout:0/782: write dc/f12 [566255,78131] 0 2023-12-16T03:16:03.830 INFO:tasks.workunit.client.0.smithi064.stdout:7/442: mkdir d7/d13/d74/d82 0 2023-12-16T03:16:03.835 INFO:tasks.workunit.client.0.smithi064.stdout:1/414: dread d3/dd/d11/d3b/f5e [0,4194304] 0 2023-12-16T03:16:03.835 INFO:tasks.workunit.client.0.smithi064.stdout:5/391: mkdir d0/d7/d8b 0 2023-12-16T03:16:03.837 INFO:tasks.workunit.client.0.smithi064.stdout:9/411: mkdir d2/d2d/d36/d80 0 2023-12-16T03:16:03.842 INFO:tasks.workunit.client.0.smithi064.stdout:3/513: mknod db/d12/d1a/d2c/d34/d4c/cae 0 2023-12-16T03:16:03.842 INFO:tasks.workunit.client.0.smithi064.stdout:2/364: symlink d1/d15/d23/l72 0 2023-12-16T03:16:03.846 INFO:tasks.workunit.client.0.smithi064.stdout:0/408: creat d2/d7/d10/d21/d7a/f7f x:0 0 0 2023-12-16T03:16:03.846 INFO:tasks.workunit.client.1.smithi184.stdout:7/673: rmdir d0/d3/d2e/d79/d32 39 2023-12-16T03:16:03.849 INFO:tasks.workunit.client.1.smithi184.stdout:1/716: getdents d3/d34/d76 0 2023-12-16T03:16:03.850 INFO:tasks.workunit.client.0.smithi064.stdout:4/491: getdents d0/d1e/d36 0 2023-12-16T03:16:03.854 INFO:tasks.workunit.client.1.smithi184.stdout:3/887: mknod d12/d18/d1f/d23/c148 0 2023-12-16T03:16:03.854 INFO:tasks.workunit.client.1.smithi184.stdout:3/888: chown d12/d37/d81/ce7 2830 1 2023-12-16T03:16:03.856 INFO:tasks.workunit.client.1.smithi184.stdout:2/669: getdents d3/d29/d2f/d2e 0 2023-12-16T03:16:03.856 INFO:tasks.workunit.client.1.smithi184.stdout:2/670: chown c2 3371957 1 2023-12-16T03:16:03.857 INFO:tasks.workunit.client.1.smithi184.stdout:6/849: mkdir d0/d5/d12/d1b/d33/d111 0 2023-12-16T03:16:03.858 INFO:tasks.workunit.client.0.smithi064.stdout:7/443: unlink d7/d3e/d42/c64 0 2023-12-16T03:16:03.860 INFO:tasks.workunit.client.0.smithi064.stdout:1/415: dwrite d3/dd/d23/d41/f85 [0,4194304] 0 2023-12-16T03:16:03.860 INFO:tasks.workunit.client.1.smithi184.stdout:9/978: creat d0/d13/d20/d10c/d134/f14e x:0 0 0 2023-12-16T03:16:03.860 INFO:tasks.workunit.client.1.smithi184.stdout:7/674: dread d0/f77 [0,4194304] 0 2023-12-16T03:16:03.860 INFO:tasks.workunit.client.1.smithi184.stdout:7/675: readlink d0/d3/d2e/d79/d36/lb4 0 2023-12-16T03:16:03.860 INFO:tasks.workunit.client.1.smithi184.stdout:7/676: truncate d0/d3/d2e/d79/d32/d39/fb0 763922 0 2023-12-16T03:16:03.863 INFO:tasks.workunit.client.0.smithi064.stdout:8/497: mknod d0/da/d3e/d46/d54/d7c/caa 0 2023-12-16T03:16:03.869 INFO:tasks.workunit.client.1.smithi184.stdout:8/811: rename d2/d4/d10/d7a/ff1 to d2/d12/d21/d8a/dcd/f108 0 2023-12-16T03:16:03.869 INFO:tasks.workunit.client.0.smithi064.stdout:5/392: fsync d0/de/d23/f82 0 2023-12-16T03:16:03.869 INFO:tasks.workunit.client.0.smithi064.stdout:5/393: write d0/d14/d20/d37/d70/d71/f72 [8935,34865] 0 2023-12-16T03:16:03.869 INFO:tasks.workunit.client.0.smithi064.stdout:7/444: dread d7/d13/d20/f28 [4194304,4194304] 0 2023-12-16T03:16:03.871 INFO:tasks.workunit.client.0.smithi064.stdout:9/412: symlink d2/d2d/d6c/l81 0 2023-12-16T03:16:03.872 INFO:tasks.workunit.client.0.smithi064.stdout:2/365: mknod d1/d15/d1b/d49/c73 0 2023-12-16T03:16:03.873 INFO:tasks.workunit.client.0.smithi064.stdout:2/366: chown d1/d27/d2e/d68/d60/f62 7819 1 2023-12-16T03:16:03.879 INFO:tasks.workunit.client.0.smithi064.stdout:8/498: mkdir d0/db/d37/d3a/dab 0 2023-12-16T03:16:03.879 INFO:tasks.workunit.client.0.smithi064.stdout:8/499: chown d0/db/d37/d3a/d6f 104 1 2023-12-16T03:16:03.879 INFO:tasks.workunit.client.1.smithi184.stdout:6/850: link d0/d5/d22/d37/d4d/f5d d0/dee/f112 0 2023-12-16T03:16:03.879 INFO:tasks.workunit.client.1.smithi184.stdout:6/851: fsync d0/d5/d22/d25/d47/fd7 0 2023-12-16T03:16:03.879 INFO:tasks.workunit.client.1.smithi184.stdout:6/852: readlink d0/d5/d12/d1b/d33/d3d/ld0 0 2023-12-16T03:16:03.880 INFO:tasks.workunit.client.1.smithi184.stdout:1/717: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fed x:0 0 0 2023-12-16T03:16:03.881 INFO:tasks.workunit.client.0.smithi064.stdout:5/394: creat d0/d50/f8c x:0 0 0 2023-12-16T03:16:03.881 INFO:tasks.workunit.client.0.smithi064.stdout:5/395: readlink d0/d19/d48/l85 0 2023-12-16T03:16:03.881 INFO:tasks.workunit.client.1.smithi184.stdout:2/671: dread d3/d29/d2f/d2e/f1a [0,4194304] 0 2023-12-16T03:16:03.881 INFO:tasks.workunit.client.1.smithi184.stdout:2/672: stat c2 0 2023-12-16T03:16:03.881 INFO:tasks.workunit.client.1.smithi184.stdout:2/673: truncate d3/d29/d61/f91 682882 0 2023-12-16T03:16:03.884 INFO:tasks.workunit.client.0.smithi064.stdout:7/445: symlink d7/d3e/l83 0 2023-12-16T03:16:03.885 INFO:tasks.workunit.client.0.smithi064.stdout:3/514: dwrite db/d12/d1a/d2c/d34/d4c/d6a/d93/fa6 [4194304,4194304] 0 2023-12-16T03:16:03.885 INFO:tasks.workunit.client.0.smithi064.stdout:3/515: readlink db/d12/d4e/l35 0 2023-12-16T03:16:03.885 INFO:tasks.workunit.client.1.smithi184.stdout:7/677: mknod d0/d3/d2e/d79/d32/d39/cc4 0 2023-12-16T03:16:03.887 INFO:tasks.workunit.client.1.smithi184.stdout:9/979: write d0/d13/d20/f28 [1523045,81038] 0 2023-12-16T03:16:03.887 INFO:tasks.workunit.client.1.smithi184.stdout:9/980: dread - d0/d13/d20/d10c/d134/f14e zero size 2023-12-16T03:16:03.888 INFO:tasks.workunit.client.1.smithi184.stdout:8/812: mknod d2/d4/d10/d7a/d83/c109 0 2023-12-16T03:16:03.888 INFO:tasks.workunit.client.0.smithi064.stdout:4/492: dwrite d0/d42/d53/f1d [0,4194304] 0 2023-12-16T03:16:03.890 INFO:tasks.workunit.client.1.smithi184.stdout:0/783: symlink dc/d22/l10c 0 2023-12-16T03:16:03.890 INFO:tasks.workunit.client.1.smithi184.stdout:0/784: write dc/d10/d2d/fe5 [935974,9953] 0 2023-12-16T03:16:03.893 INFO:tasks.workunit.client.0.smithi064.stdout:9/413: symlink d2/d2d/d36/l82 0 2023-12-16T03:16:03.893 INFO:tasks.workunit.client.0.smithi064.stdout:2/367: creat d1/d27/d2e/f74 x:0 0 0 2023-12-16T03:16:03.893 INFO:tasks.workunit.client.0.smithi064.stdout:9/414: fsync d2/f40 0 2023-12-16T03:16:03.893 INFO:tasks.workunit.client.0.smithi064.stdout:2/368: write d1/d27/d2e/d68/d60/f62 [23457,40450] 0 2023-12-16T03:16:03.893 INFO:tasks.workunit.client.0.smithi064.stdout:2/369: chown d1/d15/d23/d2d 15 1 2023-12-16T03:16:03.895 INFO:tasks.workunit.client.1.smithi184.stdout:6/853: unlink d0/d5/d22/d25/d47/cdc 0 2023-12-16T03:16:03.895 INFO:tasks.workunit.client.0.smithi064.stdout:0/409: rename d2/d8/da/f75 to d2/d8/da/df/f80 0 2023-12-16T03:16:03.896 INFO:tasks.workunit.client.1.smithi184.stdout:2/674: rmdir d3/d29 39 2023-12-16T03:16:03.896 INFO:tasks.workunit.client.0.smithi064.stdout:9/415: read d2/d2d/d3b/d3c/d34/f45 [1057090,117140] 0 2023-12-16T03:16:03.898 INFO:tasks.workunit.client.0.smithi064.stdout:5/396: creat d0/d14/d20/d37/d70/d71/d5a/f8d x:0 0 0 2023-12-16T03:16:03.899 INFO:tasks.workunit.client.1.smithi184.stdout:7/678: getdents d0/d6b/d94/dbe 0 2023-12-16T03:16:03.901 INFO:tasks.workunit.client.1.smithi184.stdout:3/889: dwrite d12/d18/d1f/d23/f141 [0,4194304] 0 2023-12-16T03:16:03.901 INFO:tasks.workunit.client.1.smithi184.stdout:3/890: write d12/d1e/de8/ff9 [1463345,15266] 0 2023-12-16T03:16:03.903 INFO:tasks.workunit.client.0.smithi064.stdout:8/500: dwrite d0/d1d/d24/d2f/f41 [0,4194304] 0 2023-12-16T03:16:03.905 INFO:tasks.workunit.client.1.smithi184.stdout:8/813: creat d2/d4/d10/d11/d72/dc2/f10a x:0 0 0 2023-12-16T03:16:03.905 INFO:tasks.workunit.client.1.smithi184.stdout:9/981: symlink d0/l14f 0 2023-12-16T03:16:03.905 INFO:tasks.workunit.client.1.smithi184.stdout:9/982: write d0/d3a/fc8 [694645,127753] 0 2023-12-16T03:16:03.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/516: link db/d12/d1a/f54 db/d4f/faf 0 2023-12-16T03:16:03.907 INFO:tasks.workunit.client.0.smithi064.stdout:1/416: dwrite d3/f7b [0,4194304] 0 2023-12-16T03:16:03.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/517: fdatasync db/d12/d1a/d2c/d34/d4c/f9d 0 2023-12-16T03:16:03.910 INFO:tasks.workunit.client.1.smithi184.stdout:0/785: mkdir dc/d22/d48/dfb/d10d 0 2023-12-16T03:16:03.910 INFO:tasks.workunit.client.1.smithi184.stdout:0/786: truncate dc/d22/d1a/fb3 198399 0 2023-12-16T03:16:03.910 INFO:tasks.workunit.client.1.smithi184.stdout:0/787: write dc/d10/d2d/f107 [424468,82751] 0 2023-12-16T03:16:03.910 INFO:tasks.workunit.client.1.smithi184.stdout:0/788: dread - dc/d22/ff6 zero size 2023-12-16T03:16:03.910 INFO:tasks.workunit.client.1.smithi184.stdout:4/720: sync 2023-12-16T03:16:03.911 INFO:tasks.workunit.client.0.smithi064.stdout:2/370: creat d1/d15/f75 x:0 0 0 2023-12-16T03:16:03.913 INFO:tasks.workunit.client.1.smithi184.stdout:2/675: mknod d3/d29/cdd 0 2023-12-16T03:16:03.915 INFO:tasks.workunit.client.0.smithi064.stdout:0/410: creat d2/d5b/f81 x:0 0 0 2023-12-16T03:16:03.916 INFO:tasks.workunit.client.1.smithi184.stdout:7/679: symlink d0/d3/d2e/d79/d32/d39/d8f/lc5 0 2023-12-16T03:16:03.916 INFO:tasks.workunit.client.1.smithi184.stdout:7/680: dread - d0/d3/d2e/d79/d36/d3f/f5b zero size 2023-12-16T03:16:03.919 INFO:tasks.workunit.client.0.smithi064.stdout:3/518: dread db/d4f/f6b [0,4194304] 0 2023-12-16T03:16:03.919 INFO:tasks.workunit.client.0.smithi064.stdout:3/519: fdatasync db/d12/f18 0 2023-12-16T03:16:03.922 INFO:tasks.workunit.client.0.smithi064.stdout:5/397: rename d0/d14/d20/f2f to d0/d19/f8e 0 2023-12-16T03:16:03.922 INFO:tasks.workunit.client.0.smithi064.stdout:5/398: fdatasync d0/d50/d39/f3a 0 2023-12-16T03:16:03.922 INFO:tasks.workunit.client.0.smithi064.stdout:5/399: read - d0/d7/d34/f5c zero size 2023-12-16T03:16:03.925 INFO:tasks.workunit.client.1.smithi184.stdout:3/891: creat d12/d18/d1f/d23/d2a/d42/de9/f149 x:0 0 0 2023-12-16T03:16:03.925 INFO:tasks.workunit.client.1.smithi184.stdout:3/892: chown d12/d18/d1f/d23/d51/dd7/de3/de1 15 1 2023-12-16T03:16:03.925 INFO:tasks.workunit.client.1.smithi184.stdout:3/893: dread - d12/d18/d1f/d23/d2a/d42/d52/d76/da5/fc3 zero size 2023-12-16T03:16:03.927 INFO:tasks.workunit.client.1.smithi184.stdout:8/814: mknod d2/d4/d10/d75/dd6/c10b 0 2023-12-16T03:16:03.929 INFO:tasks.workunit.client.1.smithi184.stdout:9/983: symlink d0/d76/da2/dc4/dd0/l150 0 2023-12-16T03:16:03.930 INFO:tasks.workunit.client.1.smithi184.stdout:0/789: mknod dc/d22/d1d/c10e 0 2023-12-16T03:16:03.932 INFO:tasks.workunit.client.1.smithi184.stdout:4/721: rename d1/d12/db3/lbf to d1/d12/d13/d40/d43/d45/lf8 0 2023-12-16T03:16:03.935 INFO:tasks.workunit.client.0.smithi064.stdout:4/493: dwrite d0/d1e/f60 [0,4194304] 0 2023-12-16T03:16:03.936 INFO:tasks.workunit.client.1.smithi184.stdout:2/676: symlink d3/d9/d19/lde 0 2023-12-16T03:16:03.936 INFO:tasks.workunit.client.0.smithi064.stdout:8/501: rmdir d0/d1d/d24/d2f 39 2023-12-16T03:16:03.938 INFO:tasks.workunit.client.1.smithi184.stdout:7/681: rmdir d0/d3/d2e/d79/d36 39 2023-12-16T03:16:03.939 INFO:tasks.workunit.client.1.smithi184.stdout:2/677: write d3/d29/d2f/d2e/f3a [266453,9293] 0 2023-12-16T03:16:03.939 INFO:tasks.workunit.client.1.smithi184.stdout:2/678: chown d3/d29/f30 59741547 1 2023-12-16T03:16:03.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/815: dread d2/d4/da6/fe3 [0,4194304] 0 2023-12-16T03:16:03.940 INFO:tasks.workunit.client.1.smithi184.stdout:3/894: creat d12/d37/f14a x:0 0 0 2023-12-16T03:16:03.940 INFO:tasks.workunit.client.1.smithi184.stdout:3/895: readlink d12/d1e/d89/dc2/l142 0 2023-12-16T03:16:03.940 INFO:tasks.workunit.client.1.smithi184.stdout:2/679: write d3/f75 [176494,89975] 0 2023-12-16T03:16:03.942 INFO:tasks.workunit.client.0.smithi064.stdout:8/502: dread d0/f3 [0,4194304] 0 2023-12-16T03:16:03.942 INFO:tasks.workunit.client.0.smithi064.stdout:8/503: chown d0/da/d3e/d46 52 1 2023-12-16T03:16:03.942 INFO:tasks.workunit.client.1.smithi184.stdout:1/718: dwrite d3/d34/dbc/d3c/d41/d46/f69 [0,4194304] 0 2023-12-16T03:16:03.942 INFO:tasks.workunit.client.1.smithi184.stdout:6/854: dwrite d0/d5/d12/d1b/d33/d3d/d96/fe2 [4194304,4194304] 0 2023-12-16T03:16:03.943 INFO:tasks.workunit.client.1.smithi184.stdout:9/984: mknod d0/d76/da2/db4/d147/c151 0 2023-12-16T03:16:03.943 INFO:tasks.workunit.client.1.smithi184.stdout:5/586: dwrite d1/f1a [0,4194304] 0 2023-12-16T03:16:03.943 INFO:tasks.workunit.client.0.smithi064.stdout:1/417: dwrite d3/d36/d44/d4d/d58/f6e [0,4194304] 0 2023-12-16T03:16:03.946 INFO:tasks.workunit.client.1.smithi184.stdout:0/790: unlink dc/d22/d53/f82 0 2023-12-16T03:16:03.946 INFO:tasks.workunit.client.1.smithi184.stdout:0/791: read - dc/d22/d45/d66/d80/fd3 zero size 2023-12-16T03:16:03.947 INFO:tasks.workunit.client.0.smithi064.stdout:8/504: write d0/d1d/d24/d2f/f4b [661944,104853] 0 2023-12-16T03:16:03.949 INFO:tasks.workunit.client.1.smithi184.stdout:4/722: link d1/d12/f3e d1/d12/db3/db8/dd0/ff9 0 2023-12-16T03:16:03.952 INFO:tasks.workunit.client.1.smithi184.stdout:8/816: mknod d2/d6a/da4/c10c 0 2023-12-16T03:16:03.954 INFO:tasks.workunit.client.1.smithi184.stdout:0/792: fsync dc/d10/d2d/fe5 0 2023-12-16T03:16:03.955 INFO:tasks.workunit.client.1.smithi184.stdout:3/896: creat d12/d18/d1f/d93/d127/f14b x:0 0 0 2023-12-16T03:16:03.955 INFO:tasks.workunit.client.1.smithi184.stdout:3/897: readlink d12/d18/d1f/d23/d2a/d42/d52/d76/l113 0 2023-12-16T03:16:03.955 INFO:tasks.workunit.client.1.smithi184.stdout:3/898: readlink d12/d18/l35 0 2023-12-16T03:16:03.956 INFO:tasks.workunit.client.1.smithi184.stdout:7/682: dwrite d0/d6b/fae [0,4194304] 0 2023-12-16T03:16:03.956 INFO:tasks.workunit.client.1.smithi184.stdout:7/683: fsync d0/d3/d2e/d79/d32/d39/f70 0 2023-12-16T03:16:03.956 INFO:tasks.workunit.client.1.smithi184.stdout:7/684: write d0/d3/f81 [358666,127580] 0 2023-12-16T03:16:03.956 INFO:tasks.workunit.client.1.smithi184.stdout:2/680: mkdir d3/d13/ddf 0 2023-12-16T03:16:03.957 INFO:tasks.workunit.client.0.smithi064.stdout:8/505: dread d0/d1d/d3c/f8e [0,4194304] 0 2023-12-16T03:16:03.957 INFO:tasks.workunit.client.0.smithi064.stdout:9/416: getdents d2/d2d/d36 0 2023-12-16T03:16:03.957 INFO:tasks.workunit.client.1.smithi184.stdout:8/817: write d2/d6a/f84 [4530231,36898] 0 2023-12-16T03:16:03.958 INFO:tasks.workunit.client.1.smithi184.stdout:2/681: read d3/d29/fb0 [2961529,2724] 0 2023-12-16T03:16:03.958 INFO:tasks.workunit.client.1.smithi184.stdout:2/682: chown d3/d29/d2f/d46/d77/cca 6 1 2023-12-16T03:16:03.961 INFO:tasks.workunit.client.1.smithi184.stdout:1/719: mkdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/dee 0 2023-12-16T03:16:03.961 INFO:tasks.workunit.client.1.smithi184.stdout:1/720: read - d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fc3 zero size 2023-12-16T03:16:03.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/818: dread d2/d12/fdb [0,4194304] 0 2023-12-16T03:16:03.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/819: write d2/d12/d21/d8a/dda/f98 [1885007,7135] 0 2023-12-16T03:16:03.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/820: truncate d2/d12/d21/d2d/d31/d34/d96/f100 443117 0 2023-12-16T03:16:03.967 INFO:tasks.workunit.client.1.smithi184.stdout:6/855: mknod d0/d5/d22/d25/d47/c113 0 2023-12-16T03:16:03.968 INFO:tasks.workunit.client.1.smithi184.stdout:9/985: unlink d0/l8a 0 2023-12-16T03:16:03.970 INFO:tasks.workunit.client.1.smithi184.stdout:5/587: symlink d1/d3/d9/de/d30/d80/lbe 0 2023-12-16T03:16:03.972 INFO:tasks.workunit.client.0.smithi064.stdout:0/411: rename d2/d7/l36 to d2/d29/d66/l82 0 2023-12-16T03:16:03.972 INFO:tasks.workunit.client.0.smithi064.stdout:0/412: write d2/d8/da/df/f5c [1058127,110266] 0 2023-12-16T03:16:03.976 INFO:tasks.workunit.client.0.smithi064.stdout:0/413: write d2/f16 [446125,63549] 0 2023-12-16T03:16:03.976 INFO:tasks.workunit.client.0.smithi064.stdout:0/414: chown d2/d7/d10/d21/d31/l76 121008 1 2023-12-16T03:16:03.977 INFO:tasks.workunit.client.0.smithi064.stdout:5/400: chown d0/de/d23/l59 0 1 2023-12-16T03:16:03.978 INFO:tasks.workunit.client.1.smithi184.stdout:8/821: dwrite d2/d4/f76 [0,4194304] 0 2023-12-16T03:16:03.979 INFO:tasks.workunit.client.0.smithi064.stdout:7/446: truncate d7/d26/d30/f57 197607 0 2023-12-16T03:16:03.980 INFO:tasks.workunit.client.0.smithi064.stdout:2/371: rmdir d1/d15/d23/d2d 39 2023-12-16T03:16:03.980 INFO:tasks.workunit.client.0.smithi064.stdout:0/415: dread d2/d7/d10/f14 [0,4194304] 0 2023-12-16T03:16:03.982 INFO:tasks.workunit.client.1.smithi184.stdout:0/793: truncate dc/f68 809890 0 2023-12-16T03:16:03.984 INFO:tasks.workunit.client.1.smithi184.stdout:3/899: rmdir d12/d18/da1/d115 39 2023-12-16T03:16:03.985 INFO:tasks.workunit.client.0.smithi064.stdout:4/494: creat d0/d1e/d36/f9b x:0 0 0 2023-12-16T03:16:03.987 INFO:tasks.workunit.client.0.smithi064.stdout:1/418: creat d3/dd/d23/d60/f8b x:0 0 0 2023-12-16T03:16:03.989 INFO:tasks.workunit.client.0.smithi064.stdout:8/506: mknod d0/da/d3e/d46/d54/cac 0 2023-12-16T03:16:03.991 INFO:tasks.workunit.client.1.smithi184.stdout:7/685: creat d0/d3/d2e/d79/dd/fc6 x:0 0 0 2023-12-16T03:16:03.992 INFO:tasks.workunit.client.0.smithi064.stdout:9/417: rmdir d2/d2d/d36/d80 0 2023-12-16T03:16:03.995 INFO:tasks.workunit.client.1.smithi184.stdout:5/588: dwrite d1/d3/d9/de/d15/d19/d48/f85 [0,4194304] 0 2023-12-16T03:16:03.996 INFO:tasks.workunit.client.1.smithi184.stdout:9/986: dwrite d0/d76/db7/d100/f10d [0,4194304] 0 2023-12-16T03:16:03.996 INFO:tasks.workunit.client.1.smithi184.stdout:2/683: rmdir d3/d29/d2f/d2e 39 2023-12-16T03:16:03.996 INFO:tasks.workunit.client.0.smithi064.stdout:5/401: rmdir d0/d14/d20/d37/d3c 39 2023-12-16T03:16:03.997 INFO:tasks.workunit.client.1.smithi184.stdout:3/900: dread d12/d18/d1f/d23/d2a/d42/d52/d76/fda [0,4194304] 0 2023-12-16T03:16:03.999 INFO:tasks.workunit.client.1.smithi184.stdout:1/721: mkdir d3/d34/d39/def 0 2023-12-16T03:16:04.000 INFO:tasks.workunit.client.0.smithi064.stdout:7/447: rename d7/d13/l24 to d7/d3e/d42/d48/d51/d7c/l84 0 2023-12-16T03:16:04.003 INFO:tasks.workunit.client.0.smithi064.stdout:0/416: mknod d2/d29/d66/c83 0 2023-12-16T03:16:04.005 INFO:tasks.workunit.client.1.smithi184.stdout:6/856: mkdir d0/d5/d12/d1b/d33/d114 0 2023-12-16T03:16:04.008 INFO:tasks.workunit.client.1.smithi184.stdout:2/684: write d3/d9/d19/f7d [3900349,95792] 0 2023-12-16T03:16:04.008 INFO:tasks.workunit.client.1.smithi184.stdout:2/685: chown d3/d29/d2f/d2e/f53 0 1 2023-12-16T03:16:04.008 INFO:tasks.workunit.client.1.smithi184.stdout:4/723: rmdir d1/d12/db3 39 2023-12-16T03:16:04.008 INFO:tasks.workunit.client.1.smithi184.stdout:4/724: fdatasync d1/d29/d34/d5c/d76/d3b/f3f 0 2023-12-16T03:16:04.009 INFO:tasks.workunit.client.0.smithi064.stdout:4/495: creat d0/d12/d48/d87/f9c x:0 0 0 2023-12-16T03:16:04.010 INFO:tasks.workunit.client.0.smithi064.stdout:1/419: truncate d3/dd/d11/d3b/f3e 3133385 0 2023-12-16T03:16:04.015 INFO:tasks.workunit.client.1.smithi184.stdout:8/822: mkdir d2/d12/d21/d2d/d31/d34/d96/dca/d10d 0 2023-12-16T03:16:04.019 INFO:tasks.workunit.client.1.smithi184.stdout:0/794: rmdir dc/d22/d1d/d43/d5a 39 2023-12-16T03:16:04.021 INFO:tasks.workunit.client.1.smithi184.stdout:7/686: unlink d0/d3/d2e/cbb 0 2023-12-16T03:16:04.022 INFO:tasks.workunit.client.0.smithi064.stdout:0/417: creat d2/d7/d10/f84 x:0 0 0 2023-12-16T03:16:04.022 INFO:tasks.workunit.client.0.smithi064.stdout:0/418: fdatasync d2/d8/f1c 0 2023-12-16T03:16:04.022 INFO:tasks.workunit.client.0.smithi064.stdout:0/419: dread - d2/d7/d10/d21/d7a/f74 zero size 2023-12-16T03:16:04.022 INFO:tasks.workunit.client.0.smithi064.stdout:0/420: stat d2/d8/da/df/f37 0 2023-12-16T03:16:04.029 INFO:tasks.workunit.client.1.smithi184.stdout:3/901: dwrite d12/d18/d68/f9e [0,4194304] 0 2023-12-16T03:16:04.029 INFO:tasks.workunit.client.0.smithi064.stdout:1/420: link d3/dd/d11/c1e d3/dd/d11/d6a/c8c 0 2023-12-16T03:16:04.029 INFO:tasks.workunit.client.1.smithi184.stdout:5/589: dwrite d1/d2a/d31/d58/daf/f8a [0,4194304] 0 2023-12-16T03:16:04.034 INFO:tasks.workunit.client.0.smithi064.stdout:2/372: rename d1/d27/d2e/d68/d55 to d1/d76 0 2023-12-16T03:16:04.034 INFO:tasks.workunit.client.0.smithi064.stdout:5/402: dread d0/de/d23/f3f [0,4194304] 0 2023-12-16T03:16:04.036 INFO:tasks.workunit.client.0.smithi064.stdout:1/421: dread d3/dd/d11/d3b/f69 [0,4194304] 0 2023-12-16T03:16:04.039 INFO:tasks.workunit.client.1.smithi184.stdout:9/987: rename d0/d13/d20/d5b/d43/dc7/ddc/dd8/l12d to d0/d76/da2/db4/l152 0 2023-12-16T03:16:04.040 INFO:tasks.workunit.client.1.smithi184.stdout:9/988: read d0/d13/f69 [949176,88184] 0 2023-12-16T03:16:04.040 INFO:tasks.workunit.client.1.smithi184.stdout:9/989: stat d0/d13/d20/d5b/d43/dab/c132 0 2023-12-16T03:16:04.041 INFO:tasks.workunit.client.0.smithi064.stdout:8/507: rename d0/db/d12/d44/l83 to d0/d1d/d24/d9c/lad 0 2023-12-16T03:16:04.041 INFO:tasks.workunit.client.0.smithi064.stdout:8/508: stat d0/da/d3e/d46/d54/d7c/da8 0 2023-12-16T03:16:04.043 INFO:tasks.workunit.client.1.smithi184.stdout:4/725: dwrite d1/d29/d34/d5c/d76/d42/f92 [0,4194304] 0 2023-12-16T03:16:04.044 INFO:tasks.workunit.client.0.smithi064.stdout:2/373: creat d1/d15/d1b/d61/f77 x:0 0 0 2023-12-16T03:16:04.044 INFO:tasks.workunit.client.0.smithi064.stdout:2/374: stat d1/d76/d57 0 2023-12-16T03:16:04.044 INFO:tasks.workunit.client.1.smithi184.stdout:1/722: getdents d3/d34/dbc/d3c/d41/d63 0 2023-12-16T03:16:04.044 INFO:tasks.workunit.client.1.smithi184.stdout:3/902: dread d12/f25 [0,4194304] 0 2023-12-16T03:16:04.046 INFO:tasks.workunit.client.1.smithi184.stdout:6/857: creat d0/d5/d22/d25/dbf/dbe/f115 x:0 0 0 2023-12-16T03:16:04.049 INFO:tasks.workunit.client.0.smithi064.stdout:0/421: dwrite d2/d7/d10/f14 [0,4194304] 0 2023-12-16T03:16:04.051 INFO:tasks.workunit.client.0.smithi064.stdout:7/448: rename d7/d13/d20/c62 to d7/d3e/d42/d48/c85 0 2023-12-16T03:16:04.053 INFO:tasks.workunit.client.1.smithi184.stdout:2/686: creat d3/d29/d4d/d5b/da6/fe0 x:0 0 0 2023-12-16T03:16:04.055 INFO:tasks.workunit.client.0.smithi064.stdout:7/449: read d7/d3e/d42/f44 [3950478,90542] 0 2023-12-16T03:16:04.055 INFO:tasks.workunit.client.0.smithi064.stdout:8/509: creat d0/da/d3e/d46/d9d/da2/fae x:0 0 0 2023-12-16T03:16:04.055 INFO:tasks.workunit.client.1.smithi184.stdout:4/726: dread d1/d12/db3/db8/dd0/ff9 [0,4194304] 0 2023-12-16T03:16:04.055 INFO:tasks.workunit.client.1.smithi184.stdout:4/727: dread - d1/d29/d34/d5c/d76/d42/ff0 zero size 2023-12-16T03:16:04.056 INFO:tasks.workunit.client.1.smithi184.stdout:2/687: write d3/f75 [573198,2942] 0 2023-12-16T03:16:04.057 INFO:tasks.workunit.client.1.smithi184.stdout:8/823: creat d2/d37/d7c/ddc/de6/deb/f10e x:0 0 0 2023-12-16T03:16:04.058 INFO:tasks.workunit.client.0.smithi064.stdout:1/422: rmdir d3/dd 39 2023-12-16T03:16:04.059 INFO:tasks.workunit.client.1.smithi184.stdout:4/728: read d1/d29/d34/d5c/d76/d3b/f3f [2166718,11872] 0 2023-12-16T03:16:04.059 INFO:tasks.workunit.client.1.smithi184.stdout:4/729: read - d1/d11/d5a/d63/fbd zero size 2023-12-16T03:16:04.059 INFO:tasks.workunit.client.1.smithi184.stdout:4/730: truncate d1/d29/d34/d5c/d76/d3b/fa9 4533236 0 2023-12-16T03:16:04.059 INFO:tasks.workunit.client.1.smithi184.stdout:4/731: readlink d1/d11/d5a/lc8 0 2023-12-16T03:16:04.061 INFO:tasks.workunit.client.1.smithi184.stdout:2/688: dread d3/d29/d2f/d2e/f1a [0,4194304] 0 2023-12-16T03:16:04.061 INFO:tasks.workunit.client.0.smithi064.stdout:2/375: creat d1/d27/d2e/d69/f78 x:0 0 0 2023-12-16T03:16:04.061 INFO:tasks.workunit.client.0.smithi064.stdout:2/376: fsync d1/d27/d2e/f5b 0 2023-12-16T03:16:04.064 INFO:tasks.workunit.client.0.smithi064.stdout:0/422: mkdir d2/d7/d10/d85 0 2023-12-16T03:16:04.067 INFO:tasks.workunit.client.0.smithi064.stdout:4/496: rename d0/d42/d4c/d70/d85/l8d to d0/d42/d66/d33/l9d 0 2023-12-16T03:16:04.070 INFO:tasks.workunit.client.0.smithi064.stdout:7/450: creat d7/d13/d20/d37/f86 x:0 0 0 2023-12-16T03:16:04.072 INFO:tasks.workunit.client.1.smithi184.stdout:9/990: truncate d0/d30/f75 7515441 0 2023-12-16T03:16:04.073 INFO:tasks.workunit.client.0.smithi064.stdout:8/510: creat d0/db/d12/d1c/d6a/faf x:0 0 0 2023-12-16T03:16:04.075 INFO:tasks.workunit.client.1.smithi184.stdout:1/723: dwrite d3/d34/dbc/d3c/d24/f43 [0,4194304] 0 2023-12-16T03:16:04.075 INFO:tasks.workunit.client.1.smithi184.stdout:7/687: dwrite d0/d3/d2e/d79/d32/fb9 [0,4194304] 0 2023-12-16T03:16:04.075 INFO:tasks.workunit.client.0.smithi064.stdout:1/423: readlink d3/dd/d23/d41/l6f 0 2023-12-16T03:16:04.076 INFO:tasks.workunit.client.0.smithi064.stdout:8/511: dread d0/d1d/d24/d2f/f39 [0,4194304] 0 2023-12-16T03:16:04.078 INFO:tasks.workunit.client.0.smithi064.stdout:0/423: symlink d2/l86 0 2023-12-16T03:16:04.080 INFO:tasks.workunit.client.1.smithi184.stdout:6/858: symlink d0/d5/d22/d37/d4d/d9c/l116 0 2023-12-16T03:16:04.080 INFO:tasks.workunit.client.1.smithi184.stdout:6/859: write d0/dee/f112 [981008,2342] 0 2023-12-16T03:16:04.080 INFO:tasks.workunit.client.1.smithi184.stdout:6/860: read d0/d5/d22/d37/d4d/f5d [326515,51167] 0 2023-12-16T03:16:04.080 INFO:tasks.workunit.client.1.smithi184.stdout:6/861: write d0/d5/d22/d25/d3f/d6f/ff4 [283523,1355] 0 2023-12-16T03:16:04.082 INFO:tasks.workunit.client.1.smithi184.stdout:9/991: dread d0/d3a/d47/fbc [0,4194304] 0 2023-12-16T03:16:04.083 INFO:tasks.workunit.client.0.smithi064.stdout:5/403: rename d0/d14/d25 to d0/d19/d48/d8f 0 2023-12-16T03:16:04.085 INFO:tasks.workunit.client.0.smithi064.stdout:8/512: dread d0/da/f30 [0,4194304] 0 2023-12-16T03:16:04.086 INFO:tasks.workunit.client.0.smithi064.stdout:4/497: creat d0/d42/d4c/d70/f9e x:0 0 0 2023-12-16T03:16:04.086 INFO:tasks.workunit.client.0.smithi064.stdout:4/498: chown d0/d1e/c64 1064831 1 2023-12-16T03:16:04.086 INFO:tasks.workunit.client.1.smithi184.stdout:7/688: dread d0/d3/d2e/d79/d32/fb9 [0,4194304] 0 2023-12-16T03:16:04.087 INFO:tasks.workunit.client.0.smithi064.stdout:5/404: write d0/d14/d20/d37/d3c/f76 [502006,110551] 0 2023-12-16T03:16:04.087 INFO:tasks.workunit.client.0.smithi064.stdout:5/405: chown d0/d7/d34/f56 51986 1 2023-12-16T03:16:04.087 INFO:tasks.workunit.client.0.smithi064.stdout:5/406: write d0/d14/d20/d37/d3c/f6b [614952,74193] 0 2023-12-16T03:16:04.088 INFO:tasks.workunit.client.1.smithi184.stdout:8/824: link d2/d12/d21/f6e d2/d12/d21/d2d/d31/d34/d96/dca/f10f 0 2023-12-16T03:16:04.088 INFO:tasks.workunit.client.1.smithi184.stdout:8/825: fdatasync d2/d4/d10/d11/f3d 0 2023-12-16T03:16:04.089 INFO:tasks.workunit.client.0.smithi064.stdout:7/451: link d7/d3e/l83 d7/d13/d74/d82/l87 0 2023-12-16T03:16:04.089 INFO:tasks.workunit.client.0.smithi064.stdout:7/452: read d7/d3e/d42/d48/d51/f60 [62986,93896] 0 2023-12-16T03:16:04.091 INFO:tasks.workunit.client.0.smithi064.stdout:1/424: rename d3/fe to d3/dd/d23/d4f/f8d 0 2023-12-16T03:16:04.091 INFO:tasks.workunit.client.1.smithi184.stdout:2/689: dread d3/f50 [0,4194304] 0 2023-12-16T03:16:04.092 INFO:tasks.workunit.client.1.smithi184.stdout:5/590: mknod d1/d2a/d31/d28/d72/cbf 0 2023-12-16T03:16:04.092 INFO:tasks.workunit.client.1.smithi184.stdout:5/591: write d1/d3/d9/de/d15/d90/fa3 [543319,127372] 0 2023-12-16T03:16:04.093 INFO:tasks.workunit.client.0.smithi064.stdout:8/513: symlink d0/d1d/d73/lb0 0 2023-12-16T03:16:04.094 INFO:tasks.workunit.client.0.smithi064.stdout:4/499: creat d0/da/f9f x:0 0 0 2023-12-16T03:16:04.095 INFO:tasks.workunit.client.0.smithi064.stdout:5/407: symlink d0/d19/d48/d8f/d3e/l90 0 2023-12-16T03:16:04.097 INFO:tasks.workunit.client.1.smithi184.stdout:1/724: rename d3/d34/f65 to d3/d34/dbc/d3c/d41/d46/ff0 0 2023-12-16T03:16:04.099 INFO:tasks.workunit.client.0.smithi064.stdout:8/514: dread d0/db/d12/d1c/f35 [0,4194304] 0 2023-12-16T03:16:04.100 INFO:tasks.workunit.client.0.smithi064.stdout:0/424: rename d2/d29/f33 to d2/d7/d10/d21/d31/f87 0 2023-12-16T03:16:04.100 INFO:tasks.workunit.client.0.smithi064.stdout:4/500: dread d0/d42/d66/f26 [0,4194304] 0 2023-12-16T03:16:04.102 INFO:tasks.workunit.client.1.smithi184.stdout:6/862: mkdir d0/d5/d22/d25/d117 0 2023-12-16T03:16:04.102 INFO:tasks.workunit.client.1.smithi184.stdout:2/690: rmdir d3/d13/d28/d83 39 2023-12-16T03:16:04.102 INFO:tasks.workunit.client.1.smithi184.stdout:2/691: chown d3/d13/ddf 963711101 1 2023-12-16T03:16:04.103 INFO:tasks.workunit.client.0.smithi064.stdout:4/501: mknod d0/d12/ca0 0 2023-12-16T03:16:04.105 INFO:tasks.workunit.client.0.smithi064.stdout:7/453: rename d7/d3e/d42/d48/d51/d7c/d52/l67 to d7/d3e/d42/d43/l88 0 2023-12-16T03:16:04.106 INFO:tasks.workunit.client.0.smithi064.stdout:5/408: mkdir d0/de/d23/d91 0 2023-12-16T03:16:04.108 INFO:tasks.workunit.client.1.smithi184.stdout:9/992: rename d0/d13/d20/c7b to d0/d3a/d121/c153 0 2023-12-16T03:16:04.108 INFO:tasks.workunit.client.1.smithi184.stdout:9/993: dread - d0/d13/d20/d5b/d53/f58 zero size 2023-12-16T03:16:04.108 INFO:tasks.workunit.client.1.smithi184.stdout:9/994: chown d0/d3a/d47/c72 563151310 1 2023-12-16T03:16:04.109 INFO:tasks.workunit.client.1.smithi184.stdout:9/995: chown d0/d3a/d121/f12b 30140 1 2023-12-16T03:16:04.109 INFO:tasks.workunit.client.0.smithi064.stdout:7/454: getdents d7/d3e/d42 0 2023-12-16T03:16:04.110 INFO:tasks.workunit.client.1.smithi184.stdout:1/725: creat d3/d34/dbc/d38/d52/ff1 x:0 0 0 2023-12-16T03:16:04.111 INFO:tasks.workunit.client.0.smithi064.stdout:4/502: write d0/d42/f5c [1427924,108465] 0 2023-12-16T03:16:04.111 INFO:tasks.workunit.client.0.smithi064.stdout:4/503: read - d0/d42/f71 zero size 2023-12-16T03:16:04.112 INFO:tasks.workunit.client.0.smithi064.stdout:5/409: unlink d0/de/d23/f82 0 2023-12-16T03:16:04.112 INFO:tasks.workunit.client.0.smithi064.stdout:5/410: write d0/d7/d34/f56 [160150,66805] 0 2023-12-16T03:16:04.113 INFO:tasks.workunit.client.0.smithi064.stdout:5/411: write d0/d14/d20/d37/d70/f81 [236722,1009] 0 2023-12-16T03:16:04.113 INFO:tasks.workunit.client.0.smithi064.stdout:5/412: dread - d0/f7d zero size 2023-12-16T03:16:04.113 INFO:tasks.workunit.client.0.smithi064.stdout:5/413: readlink d0/de/l1f 0 2023-12-16T03:16:04.113 INFO:tasks.workunit.client.1.smithi184.stdout:6/863: truncate d0/d5/d22/d37/d4d/d9c/ffa 3137460 0 2023-12-16T03:16:04.114 INFO:tasks.workunit.client.0.smithi064.stdout:0/425: dread d2/f3e [0,4194304] 0 2023-12-16T03:16:04.114 INFO:tasks.workunit.client.1.smithi184.stdout:2/692: mknod d3/d13/ce1 0 2023-12-16T03:16:04.115 INFO:tasks.workunit.client.1.smithi184.stdout:2/693: read - d3/f76 zero size 2023-12-16T03:16:04.115 INFO:tasks.workunit.client.1.smithi184.stdout:2/694: readlink d3/d13/d28/l6c 0 2023-12-16T03:16:04.117 INFO:tasks.workunit.client.0.smithi064.stdout:5/414: fdatasync d0/d14/d20/d37/d3c/f6b 0 2023-12-16T03:16:04.117 INFO:tasks.workunit.client.0.smithi064.stdout:5/415: write d0/d19/f27 [4245375,90900] 0 2023-12-16T03:16:04.118 INFO:tasks.workunit.client.1.smithi184.stdout:9/996: rename d0/d13/d6e/d84/l9c to d0/d76/da2/db4/l154 0 2023-12-16T03:16:04.118 INFO:tasks.workunit.client.1.smithi184.stdout:9/997: write d0/d13/d20/d5b/d43/f11d [867321,53133] 0 2023-12-16T03:16:04.121 INFO:tasks.workunit.client.1.smithi184.stdout:0/795: dwrite dc/f68 [0,4194304] 0 2023-12-16T03:16:04.121 INFO:tasks.workunit.client.1.smithi184.stdout:0/796: truncate dc/d22/d45/d66/f72 520975 0 2023-12-16T03:16:04.123 INFO:tasks.workunit.client.1.smithi184.stdout:1/726: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/ff2 x:0 0 0 2023-12-16T03:16:04.125 INFO:tasks.workunit.client.0.smithi064.stdout:0/426: mkdir d2/d7/d10/d85/d88 0 2023-12-16T03:16:04.125 INFO:tasks.workunit.client.0.smithi064.stdout:5/416: mkdir d0/d19/d48/d92 0 2023-12-16T03:16:04.126 INFO:tasks.workunit.client.1.smithi184.stdout:6/864: unlink d0/d5/d22/d25/d47/fd7 0 2023-12-16T03:16:04.127 INFO:tasks.workunit.client.0.smithi064.stdout:1/425: write d3/dd/d23/d4f/f54 [1138504,122254] 0 2023-12-16T03:16:04.130 INFO:tasks.workunit.client.1.smithi184.stdout:2/695: rmdir d3/d29/d2f 39 2023-12-16T03:16:04.132 INFO:tasks.workunit.client.0.smithi064.stdout:0/427: link d2/d7/cd d2/d7/d10/c89 0 2023-12-16T03:16:04.133 INFO:tasks.workunit.client.0.smithi064.stdout:0/428: readlink d2/d29/l79 0 2023-12-16T03:16:04.133 INFO:tasks.workunit.client.1.smithi184.stdout:7/689: dwrite d0/f50 [4194304,4194304] 0 2023-12-16T03:16:04.135 INFO:tasks.workunit.client.1.smithi184.stdout:5/592: dread d1/d3/d9/d49/f55 [0,4194304] 0 2023-12-16T03:16:04.135 INFO:tasks.workunit.client.1.smithi184.stdout:9/998: creat d0/d3a/f155 x:0 0 0 2023-12-16T03:16:04.135 INFO:tasks.workunit.client.1.smithi184.stdout:9/999: chown d0/d13/l49 0 1 2023-12-16T03:16:04.137 INFO:tasks.workunit.client.0.smithi064.stdout:5/417: creat d0/d19/d48/d8f/d5e/f93 x:0 0 0 2023-12-16T03:16:04.138 INFO:tasks.workunit.client.1.smithi184.stdout:0/797: mknod dc/d22/d1d/c10f 0 2023-12-16T03:16:04.138 INFO:tasks.workunit.client.1.smithi184.stdout:0/798: write dc/d22/d45/d66/ffa [54515,102440] 0 2023-12-16T03:16:04.139 INFO:tasks.workunit.client.1.smithi184.stdout:1/727: rmdir d3/d34/dbc/d3c/d41 39 2023-12-16T03:16:04.140 INFO:tasks.workunit.client.0.smithi064.stdout:5/418: rmdir d0/d7 39 2023-12-16T03:16:04.140 INFO:tasks.workunit.client.0.smithi064.stdout:5/419: dread - d0/d14/d20/f60 zero size 2023-12-16T03:16:04.140 INFO:tasks.workunit.client.0.smithi064.stdout:5/420: getdents d0/de/d23/d91 0 2023-12-16T03:16:04.142 INFO:tasks.workunit.client.1.smithi184.stdout:6/865: symlink d0/d5/d22/d25/dbf/l118 0 2023-12-16T03:16:04.142 INFO:tasks.workunit.client.1.smithi184.stdout:6/866: truncate d0/d5/d12/d1b/f51 567090 0 2023-12-16T03:16:04.142 INFO:tasks.workunit.client.1.smithi184.stdout:6/867: readlink d0/d5/d12/d1b/d33/d3d/ld0 0 2023-12-16T03:16:04.143 INFO:tasks.workunit.client.1.smithi184.stdout:2/696: symlink d3/d29/d2f/le2 0 2023-12-16T03:16:04.144 INFO:tasks.workunit.client.1.smithi184.stdout:7/690: mknod d0/d3/d2e/d79/d36/cc7 0 2023-12-16T03:16:04.151 INFO:tasks.workunit.client.1.smithi184.stdout:1/728: creat d3/d34/dbc/d3c/d41/d77/ff3 x:0 0 0 2023-12-16T03:16:04.151 INFO:tasks.workunit.client.1.smithi184.stdout:6/868: rmdir d0/dee 39 2023-12-16T03:16:04.151 INFO:tasks.workunit.client.1.smithi184.stdout:0/799: creat dc/d10/d2d/f110 x:0 0 0 2023-12-16T03:16:04.154 INFO:tasks.workunit.client.1.smithi184.stdout:2/697: symlink d3/d13/d28/le3 0 2023-12-16T03:16:04.154 INFO:tasks.workunit.client.1.smithi184.stdout:4/732: dread d1/d11/d1b/d1e/f5d [0,4194304] 0 2023-12-16T03:16:04.154 INFO:tasks.workunit.client.1.smithi184.stdout:4/733: chown d1/d12/db3 0 1 2023-12-16T03:16:04.154 INFO:tasks.workunit.client.1.smithi184.stdout:4/734: chown d1/d12/d13/d40/d43/d5e/fa8 15 1 2023-12-16T03:16:04.154 INFO:tasks.workunit.client.1.smithi184.stdout:7/691: rmdir d0/d3/d2e/d79/d32/d8a/dbd 0 2023-12-16T03:16:04.155 INFO:tasks.workunit.client.1.smithi184.stdout:2/698: mknod d3/d29/d61/d6d/dd6/ce4 0 2023-12-16T03:16:04.157 INFO:tasks.workunit.client.1.smithi184.stdout:4/735: truncate d1/d29/d34/d5c/d76/f8f 184449 0 2023-12-16T03:16:04.158 INFO:tasks.workunit.client.1.smithi184.stdout:7/692: creat d0/d3/d2e/d79/d36/fc8 x:0 0 0 2023-12-16T03:16:04.158 INFO:tasks.workunit.client.1.smithi184.stdout:5/593: dread d1/d2a/d31/f73 [0,4194304] 0 2023-12-16T03:16:04.162 INFO:tasks.workunit.client.1.smithi184.stdout:6/869: write d0/d5/d12/fb9 [3755610,73428] 0 2023-12-16T03:16:04.162 INFO:tasks.workunit.client.1.smithi184.stdout:6/870: chown d0/d5/d22/l1d 813466281 1 2023-12-16T03:16:04.164 INFO:tasks.workunit.client.1.smithi184.stdout:4/736: link d1/d12/db3/db8/fdb d1/d29/d34/ffa 0 2023-12-16T03:16:04.164 INFO:tasks.workunit.client.1.smithi184.stdout:4/737: read - d1/d12/db3/db8/dd0/fe4 zero size 2023-12-16T03:16:04.166 INFO:tasks.workunit.client.0.smithi064.stdout:4/504: dwrite d0/da/f9f [0,4194304] 0 2023-12-16T03:16:04.168 INFO:tasks.workunit.client.1.smithi184.stdout:5/594: symlink d1/dbb/lc0 0 2023-12-16T03:16:04.168 INFO:tasks.workunit.client.1.smithi184.stdout:7/693: mkdir d0/d3/d2e/d79/d32/d39/d8f/dab/dc9 0 2023-12-16T03:16:04.169 INFO:tasks.workunit.client.0.smithi064.stdout:0/429: dwrite d2/d7/d10/f6a [0,4194304] 0 2023-12-16T03:16:04.169 INFO:tasks.workunit.client.1.smithi184.stdout:3/903: dwrite d12/d18/d1f/d23/d2a/d42/d52/f58 [4194304,4194304] 0 2023-12-16T03:16:04.171 INFO:tasks.workunit.client.0.smithi064.stdout:2/377: dwrite d1/d15/d1b/d61/d63/f6d [0,4194304] 0 2023-12-16T03:16:04.171 INFO:tasks.workunit.client.0.smithi064.stdout:2/378: chown d1/d15/d1b/c2a 55643666 1 2023-12-16T03:16:04.171 INFO:tasks.workunit.client.0.smithi064.stdout:2/379: write d1/d27/d2e/d69/f5a [1464588,131067] 0 2023-12-16T03:16:04.171 INFO:tasks.workunit.client.0.smithi064.stdout:8/515: dwrite d0/d1d/d3c/f7d [0,4194304] 0 2023-12-16T03:16:04.172 INFO:tasks.workunit.client.1.smithi184.stdout:4/738: creat d1/d29/d34/d5c/d76/d42/d90/ffb x:0 0 0 2023-12-16T03:16:04.172 INFO:tasks.workunit.client.1.smithi184.stdout:8/826: dwrite d2/d6a/da4/fed [0,4194304] 0 2023-12-16T03:16:04.172 INFO:tasks.workunit.client.1.smithi184.stdout:2/699: dread d3/d9/d19/f37 [0,4194304] 0 2023-12-16T03:16:04.182 INFO:tasks.workunit.client.0.smithi064.stdout:4/505: mknod d0/d12/ca1 0 2023-12-16T03:16:04.182 INFO:tasks.workunit.client.0.smithi064.stdout:4/506: chown d0/d42/d66/d5a/c97 51764417 1 2023-12-16T03:16:04.182 INFO:tasks.workunit.client.0.smithi064.stdout:4/507: truncate d0/d42/f72 497673 0 2023-12-16T03:16:04.183 INFO:tasks.workunit.client.0.smithi064.stdout:2/380: dread d1/d27/f44 [0,4194304] 0 2023-12-16T03:16:04.183 INFO:tasks.workunit.client.0.smithi064.stdout:2/381: chown d1/d76/d57/l6e 298441615 1 2023-12-16T03:16:04.183 INFO:tasks.workunit.client.0.smithi064.stdout:2/382: dread - d1/d15/d1b/d49/f6b zero size 2023-12-16T03:16:04.184 INFO:tasks.workunit.client.1.smithi184.stdout:5/595: mkdir d1/d3/d2f/dc1 0 2023-12-16T03:16:04.185 INFO:tasks.workunit.client.0.smithi064.stdout:5/421: dwrite d0/d7/f1e [0,4194304] 0 2023-12-16T03:16:04.186 INFO:tasks.workunit.client.0.smithi064.stdout:1/426: dwrite d3/dd/d11/f17 [0,4194304] 0 2023-12-16T03:16:04.188 INFO:tasks.workunit.client.0.smithi064.stdout:2/383: write d1/f4 [588369,7875] 0 2023-12-16T03:16:04.188 INFO:tasks.workunit.client.0.smithi064.stdout:2/384: truncate d1/d15/f28 1257888 0 2023-12-16T03:16:04.188 INFO:tasks.workunit.client.0.smithi064.stdout:7/455: rename d7/d13 to d7/d3e/d42/d89 0 2023-12-16T03:16:04.191 INFO:tasks.workunit.client.1.smithi184.stdout:3/904: mknod d12/d18/d1f/d23/d2a/d42/de9/c14c 0 2023-12-16T03:16:04.191 INFO:tasks.workunit.client.1.smithi184.stdout:3/905: readlink d12/d18/d1f/d23/d2a/d42/d52/d76/da5/lc0 0 2023-12-16T03:16:04.192 INFO:tasks.workunit.client.0.smithi064.stdout:0/430: read d2/d7/d10/d21/d31/f35 [59833,78595] 0 2023-12-16T03:16:04.192 INFO:tasks.workunit.client.1.smithi184.stdout:0/800: dwrite dc/d10/d2d/fd7 [0,4194304] 0 2023-12-16T03:16:04.193 INFO:tasks.workunit.client.1.smithi184.stdout:4/739: mknod d1/d12/d13/d40/d43/d45/dcf/cfc 0 2023-12-16T03:16:04.196 INFO:tasks.workunit.client.1.smithi184.stdout:1/729: dwrite d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/fd9 [0,4194304] 0 2023-12-16T03:16:04.197 INFO:tasks.workunit.client.1.smithi184.stdout:1/730: stat d3/d34/dbc/d3c/lc 0 2023-12-16T03:16:04.197 INFO:tasks.workunit.client.1.smithi184.stdout:1/731: chown d3/d34/dbc/d3c/d41/d46/d4a/d6a/le0 757533 1 2023-12-16T03:16:04.197 INFO:tasks.workunit.client.1.smithi184.stdout:6/871: dwrite d0/d5/d12/d1b/f5b [0,4194304] 0 2023-12-16T03:16:04.198 INFO:tasks.workunit.client.1.smithi184.stdout:7/694: dwrite d0/d3/d2e/d79/dd/d27/f76 [0,4194304] 0 2023-12-16T03:16:04.198 INFO:tasks.workunit.client.1.smithi184.stdout:7/695: chown d0/d3/d2e/d79/dd/d27/ca8 22503 1 2023-12-16T03:16:04.198 INFO:tasks.workunit.client.1.smithi184.stdout:7/696: chown d0/d3/f64 19675358 1 2023-12-16T03:16:04.201 INFO:tasks.workunit.client.0.smithi064.stdout:2/385: dread d1/d27/d2e/f5b [0,4194304] 0 2023-12-16T03:16:04.202 INFO:tasks.workunit.client.1.smithi184.stdout:8/827: mkdir d2/d12/d21/d8a/dcd/d110 0 2023-12-16T03:16:04.204 INFO:tasks.workunit.client.0.smithi064.stdout:4/508: mknod d0/da/ca2 0 2023-12-16T03:16:04.205 INFO:tasks.workunit.client.1.smithi184.stdout:5/596: rmdir d1/d3/d9/de/d15/db9 39 2023-12-16T03:16:04.205 INFO:tasks.workunit.client.1.smithi184.stdout:5/597: stat d1/d3/d9/de/d15/f8d 0 2023-12-16T03:16:04.207 INFO:tasks.workunit.client.1.smithi184.stdout:3/906: creat d12/d18/d1f/d23/d2a/dfc/f14d x:0 0 0 2023-12-16T03:16:04.207 INFO:tasks.workunit.client.1.smithi184.stdout:3/907: fsync d12/d18/d68/f9a 0 2023-12-16T03:16:04.211 INFO:tasks.workunit.client.0.smithi064.stdout:5/422: mknod d0/d19/d48/c94 0 2023-12-16T03:16:04.213 INFO:tasks.workunit.client.0.smithi064.stdout:1/427: creat d3/d36/d44/f8e x:0 0 0 2023-12-16T03:16:04.215 INFO:tasks.workunit.client.1.smithi184.stdout:0/801: creat dc/d22/d45/daf/f111 x:0 0 0 2023-12-16T03:16:04.217 INFO:tasks.workunit.client.0.smithi064.stdout:1/428: write d3/dd/d11/d38/f77 [2757392,40766] 0 2023-12-16T03:16:04.217 INFO:tasks.workunit.client.0.smithi064.stdout:1/429: write d3/dd/d11/d6a/f75 [79438,89339] 0 2023-12-16T03:16:04.217 INFO:tasks.workunit.client.0.smithi064.stdout:1/430: chown d3/d36/d44/d4d 30367709 1 2023-12-16T03:16:04.217 INFO:tasks.workunit.client.0.smithi064.stdout:1/431: fsync d3/d22/d57/f5d 0 2023-12-16T03:16:04.217 INFO:tasks.workunit.client.0.smithi064.stdout:8/516: rename d0/da/d3e/d46/d8f/l63 to d0/db/d5a/d97/lb1 0 2023-12-16T03:16:04.217 INFO:tasks.workunit.client.0.smithi064.stdout:7/456: rename d7/d3e/d42/d89 to d7/d3e/d42/d89/d74/d8a 22 2023-12-16T03:16:04.217 INFO:tasks.workunit.client.0.smithi064.stdout:7/457: rename d7/d26 to d7/d26/d8b 22 2023-12-16T03:16:04.220 INFO:tasks.workunit.client.1.smithi184.stdout:4/740: symlink d1/d29/d34/d5c/d76/lfd 0 2023-12-16T03:16:04.221 INFO:tasks.workunit.client.0.smithi064.stdout:0/431: unlink d2/d8/da/d11/f44 0 2023-12-16T03:16:04.229 INFO:tasks.workunit.client.1.smithi184.stdout:1/732: mknod d3/d34/dbc/d3c/d41/d46/d4a/de2/cf4 0 2023-12-16T03:16:04.237 INFO:tasks.workunit.client.1.smithi184.stdout:6/872: mknod d0/d5/d12/d1b/d33/d3d/da2/c119 0 2023-12-16T03:16:04.242 INFO:tasks.workunit.client.0.smithi064.stdout:2/386: link d1/d15/d23/d2d/f6a d1/d27/d2e/d68/d60/f79 0 2023-12-16T03:16:04.244 INFO:tasks.workunit.client.0.smithi064.stdout:4/509: creat d0/d1e/d36/fa3 x:0 0 0 2023-12-16T03:16:04.247 INFO:tasks.workunit.client.1.smithi184.stdout:7/697: creat d0/fca x:0 0 0 2023-12-16T03:16:04.251 INFO:tasks.workunit.client.0.smithi064.stdout:8/517: symlink d0/d1d/d24/d9c/lb2 0 2023-12-16T03:16:04.256 INFO:tasks.workunit.client.0.smithi064.stdout:0/432: mknod d2/d8/da/d11/d64/c8a 0 2023-12-16T03:16:04.258 INFO:tasks.workunit.client.0.smithi064.stdout:5/423: mkdir d0/de/d23/d67/d95 0 2023-12-16T03:16:04.260 INFO:tasks.workunit.client.1.smithi184.stdout:8/828: creat d2/d12/d21/d8a/dda/d73/f111 x:0 0 0 2023-12-16T03:16:04.261 INFO:tasks.workunit.client.1.smithi184.stdout:5/598: unlink d1/d3/d9/de/d15/d19/l20 0 2023-12-16T03:16:04.262 INFO:tasks.workunit.client.0.smithi064.stdout:0/433: write d2/d7/d10/f1a [291808,56930] 0 2023-12-16T03:16:04.263 INFO:tasks.workunit.client.0.smithi064.stdout:8/518: rename d0/d1d/d3c/f55 to d0/db/d12/d1c/d59/d77/fb3 0 2023-12-16T03:16:04.263 INFO:tasks.workunit.client.0.smithi064.stdout:8/519: write d0/d1d/d24/d2f/f64 [619168,83230] 0 2023-12-16T03:16:04.263 INFO:tasks.workunit.client.0.smithi064.stdout:8/520: chown d0/f3 15 1 2023-12-16T03:16:04.263 INFO:tasks.workunit.client.0.smithi064.stdout:8/521: chown d0/db/d5a/d97/d38 212023399 1 2023-12-16T03:16:04.265 INFO:tasks.workunit.client.0.smithi064.stdout:7/458: mknod d7/d3e/d42/d48/d51/d7c/c8c 0 2023-12-16T03:16:04.265 INFO:tasks.workunit.client.0.smithi064.stdout:7/459: dread - d7/d3e/d42/d89/d74/f81 zero size 2023-12-16T03:16:04.268 INFO:tasks.workunit.client.0.smithi064.stdout:0/434: mkdir d2/d5b/d8b 0 2023-12-16T03:16:04.268 INFO:tasks.workunit.client.0.smithi064.stdout:0/435: chown d2/d7/d10/d21/f24 75 1 2023-12-16T03:16:04.270 INFO:tasks.workunit.client.0.smithi064.stdout:7/460: creat d7/d3e/d42/d48/d51/f8d x:0 0 0 2023-12-16T03:16:04.272 INFO:tasks.workunit.client.0.smithi064.stdout:0/436: mknod d2/d5b/d8b/c8c 0 2023-12-16T03:16:04.272 INFO:tasks.workunit.client.0.smithi064.stdout:0/437: stat d2/d7/l53 0 2023-12-16T03:16:04.273 INFO:tasks.workunit.client.0.smithi064.stdout:7/461: mknod d7/d3e/d42/d48/d51/d7c/c8e 0 2023-12-16T03:16:04.280 INFO:tasks.workunit.client.0.smithi064.stdout:3/520: sync 2023-12-16T03:16:04.280 INFO:tasks.workunit.client.0.smithi064.stdout:6/387: sync 2023-12-16T03:16:04.286 INFO:tasks.workunit.client.0.smithi064.stdout:6/388: dread d3/d8/d1f/f22 [0,4194304] 0 2023-12-16T03:16:04.287 INFO:tasks.workunit.client.1.smithi184.stdout:4/741: creat d1/d12/db3/ffe x:0 0 0 2023-12-16T03:16:04.288 INFO:tasks.workunit.client.1.smithi184.stdout:4/742: chown d1/d29/d34/d5c/d76/d42/l64 11413 1 2023-12-16T03:16:04.288 INFO:tasks.workunit.client.1.smithi184.stdout:7/698: mkdir d0/d3/d2e/d79/d32/d39/dcb 0 2023-12-16T03:16:04.288 INFO:tasks.workunit.client.0.smithi064.stdout:6/389: mknod d3/d44/c6f 0 2023-12-16T03:16:04.291 INFO:tasks.workunit.client.1.smithi184.stdout:1/733: mknod d3/d13/cf5 0 2023-12-16T03:16:04.291 INFO:tasks.workunit.client.1.smithi184.stdout:6/873: link d0/d5/d22/d25/c70 d0/d5/d12/c11a 0 2023-12-16T03:16:04.291 INFO:tasks.workunit.client.1.smithi184.stdout:5/599: symlink d1/d3/d9/de/d15/d19/d3a/lc2 0 2023-12-16T03:16:04.291 INFO:tasks.workunit.client.0.smithi064.stdout:6/390: creat d3/d8/d13/d46/f70 x:0 0 0 2023-12-16T03:16:04.295 INFO:tasks.workunit.client.0.smithi064.stdout:8/522: write d0/db/f4f [1080163,128558] 0 2023-12-16T03:16:04.295 INFO:tasks.workunit.client.0.smithi064.stdout:8/523: chown d0/db/d5a/d97/lb1 158106 1 2023-12-16T03:16:04.296 INFO:tasks.workunit.client.1.smithi184.stdout:6/874: mkdir d0/d5/d22/d25/dbf/d11b 0 2023-12-16T03:16:04.296 INFO:tasks.workunit.client.0.smithi064.stdout:6/391: dread d3/d8/d13/d58/f5c [0,4194304] 0 2023-12-16T03:16:04.296 INFO:tasks.workunit.client.0.smithi064.stdout:6/392: write d3/d8/d13/d46/d5e/f64 [528296,32412] 0 2023-12-16T03:16:04.296 INFO:tasks.workunit.client.0.smithi064.stdout:8/524: mknod d0/db/d37/cb4 0 2023-12-16T03:16:04.297 INFO:tasks.workunit.client.1.smithi184.stdout:7/699: rename d0/d3/l15 to d0/d3/d2e/d79/d32/d39/dcb/lcc 0 2023-12-16T03:16:04.298 INFO:tasks.workunit.client.1.smithi184.stdout:4/743: symlink d1/d12/d13/d40/d43/lff 0 2023-12-16T03:16:04.298 INFO:tasks.workunit.client.1.smithi184.stdout:4/744: chown d1/d29/f2e 365862 1 2023-12-16T03:16:04.298 INFO:tasks.workunit.client.0.smithi064.stdout:6/393: rename d3/d8/d13/d46/f50 to d3/d44/f71 0 2023-12-16T03:16:04.299 INFO:tasks.workunit.client.0.smithi064.stdout:8/525: creat d0/db/d12/d1c/d59/fb5 x:0 0 0 2023-12-16T03:16:04.300 INFO:tasks.workunit.client.0.smithi064.stdout:8/526: creat d0/fb6 x:0 0 0 2023-12-16T03:16:04.303 INFO:tasks.workunit.client.1.smithi184.stdout:1/734: rename d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/lbd to d3/d34/dbc/d3c/d41/d63/de1/lf6 0 2023-12-16T03:16:04.304 INFO:tasks.workunit.client.1.smithi184.stdout:4/745: stat d1/d29/d34/d5c/d76/d33/d4a/l50 0 2023-12-16T03:16:04.304 INFO:tasks.workunit.client.1.smithi184.stdout:4/746: chown d1/d11/d5a/lac 849 1 2023-12-16T03:16:04.305 INFO:tasks.workunit.client.0.smithi064.stdout:9/418: sync 2023-12-16T03:16:04.305 INFO:tasks.workunit.client.1.smithi184.stdout:1/735: rename d3/d34/dbc/d3c/d41/l59 to d3/d34/dbc/d3c/d24/lf7 0 2023-12-16T03:16:04.306 INFO:tasks.workunit.client.1.smithi184.stdout:1/736: dread - d3/d34/dbc/d36/d9f/fec zero size 2023-12-16T03:16:04.308 INFO:tasks.workunit.client.1.smithi184.stdout:1/737: mknod d3/d34/dbc/d3c/d41/d46/d4a/cf8 0 2023-12-16T03:16:04.310 INFO:tasks.workunit.client.0.smithi064.stdout:7/462: dwrite d7/d3e/d42/d89/d74/f81 [0,4194304] 0 2023-12-16T03:16:04.310 INFO:tasks.workunit.client.0.smithi064.stdout:6/394: dread d3/d8/d1f/d26/f3b [0,4194304] 0 2023-12-16T03:16:04.310 INFO:tasks.workunit.client.0.smithi064.stdout:6/395: fsync d3/d8/d1f/f5a 0 2023-12-16T03:16:04.310 INFO:tasks.workunit.client.0.smithi064.stdout:6/396: getdents d3/d8/d1f/d26/d47/d4a/d67 0 2023-12-16T03:16:04.310 INFO:tasks.workunit.client.0.smithi064.stdout:8/527: rmdir d0/db/d12/d44 39 2023-12-16T03:16:04.312 INFO:tasks.workunit.client.1.smithi184.stdout:3/908: dwrite d12/d86/de4/d99/d117/db4/f111 [0,4194304] 0 2023-12-16T03:16:04.315 INFO:tasks.workunit.client.1.smithi184.stdout:1/738: mkdir d3/d34/d76/df9 0 2023-12-16T03:16:04.317 INFO:tasks.workunit.client.0.smithi064.stdout:2/387: dwrite d1/d27/d2e/d68/f3f [0,4194304] 0 2023-12-16T03:16:04.317 INFO:tasks.workunit.client.0.smithi064.stdout:2/388: fdatasync d1/f6 0 2023-12-16T03:16:04.321 INFO:tasks.workunit.client.0.smithi064.stdout:7/463: symlink d7/d3e/d42/d48/l8f 0 2023-12-16T03:16:04.321 INFO:tasks.workunit.client.0.smithi064.stdout:6/397: rmdir d3/d8/d13/d58/d65 39 2023-12-16T03:16:04.325 INFO:tasks.workunit.client.0.smithi064.stdout:9/419: rmdir d2 39 2023-12-16T03:16:04.326 INFO:tasks.workunit.client.1.smithi184.stdout:7/700: dread d0/d3/d2e/d79/d36/d3f/f4f [0,4194304] 0 2023-12-16T03:16:04.329 INFO:tasks.workunit.client.1.smithi184.stdout:4/747: dread d1/d12/d13/da1/fcd [0,4194304] 0 2023-12-16T03:16:04.331 INFO:tasks.workunit.client.1.smithi184.stdout:8/829: dwrite d2/d37/f4c [0,4194304] 0 2023-12-16T03:16:04.332 INFO:tasks.workunit.client.0.smithi064.stdout:2/389: creat d1/d15/d23/f7a x:0 0 0 2023-12-16T03:16:04.332 INFO:tasks.workunit.client.0.smithi064.stdout:2/390: chown d1/d27/d2e/d69 660692 1 2023-12-16T03:16:04.333 INFO:tasks.workunit.client.1.smithi184.stdout:7/701: mknod d0/d3/d2e/d79/d32/ccd 0 2023-12-16T03:16:04.336 INFO:tasks.workunit.client.1.smithi184.stdout:4/748: creat d1/d29/d34/d5c/f100 x:0 0 0 2023-12-16T03:16:04.336 INFO:tasks.workunit.client.1.smithi184.stdout:4/749: truncate d1/d11/d5a/f60 817204 0 2023-12-16T03:16:04.336 INFO:tasks.workunit.client.1.smithi184.stdout:4/750: dread - d1/d11/fdc zero size 2023-12-16T03:16:04.337 INFO:tasks.workunit.client.0.smithi064.stdout:6/398: rename d3/d9/d2d/c52 to d3/d8/d13/d46/d5e/c72 0 2023-12-16T03:16:04.339 INFO:tasks.workunit.client.1.smithi184.stdout:8/830: creat d2/d37/d7c/dd7/f112 x:0 0 0 2023-12-16T03:16:04.339 INFO:tasks.workunit.client.0.smithi064.stdout:9/420: mkdir d2/d2d/d6c/d83 0 2023-12-16T03:16:04.340 INFO:tasks.workunit.client.0.smithi064.stdout:6/399: write d3/d8/da/f43 [3930266,19299] 0 2023-12-16T03:16:04.341 INFO:tasks.workunit.client.1.smithi184.stdout:7/702: creat d0/d3/d2e/da9/fce x:0 0 0 2023-12-16T03:16:04.342 INFO:tasks.workunit.client.0.smithi064.stdout:2/391: mkdir d1/d76/d7b 0 2023-12-16T03:16:04.343 INFO:tasks.workunit.client.1.smithi184.stdout:4/751: mknod d1/d29/d34/d5c/d76/d33/d4a/c101 0 2023-12-16T03:16:04.344 INFO:tasks.workunit.client.1.smithi184.stdout:4/752: readlink d1/d12/db3/db8/dd0/le8 0 2023-12-16T03:16:04.344 INFO:tasks.workunit.client.1.smithi184.stdout:4/753: truncate d1/d29/f95 320533 0 2023-12-16T03:16:04.344 INFO:tasks.workunit.client.1.smithi184.stdout:4/754: fsync d1/d29/d34/d5c/d76/d3b/f3f 0 2023-12-16T03:16:04.345 INFO:tasks.workunit.client.0.smithi064.stdout:9/421: link d2/d2d/d3b/d3c/d34/f37 d2/dc/d24/d39/d5e/d6f/f84 0 2023-12-16T03:16:04.347 INFO:tasks.workunit.client.1.smithi184.stdout:7/703: read d0/d3/d2e/d79/d32/d39/f70 [770879,59253] 0 2023-12-16T03:16:04.347 INFO:tasks.workunit.client.0.smithi064.stdout:6/400: read d3/d8/d1f/f5a [1876364,26021] 0 2023-12-16T03:16:04.349 INFO:tasks.workunit.client.1.smithi184.stdout:8/831: link d2/d12/d21/d8a/dda/fb1 d2/d12/d21/d2d/d31/f113 0 2023-12-16T03:16:04.351 INFO:tasks.workunit.client.0.smithi064.stdout:9/422: creat d2/f85 x:0 0 0 2023-12-16T03:16:04.355 INFO:tasks.workunit.client.1.smithi184.stdout:6/875: dwrite d0/d5/d22/d25/d47/fe3 [0,4194304] 0 2023-12-16T03:16:04.355 INFO:tasks.workunit.client.1.smithi184.stdout:0/802: dwrite dc/d22/d1a/fb3 [0,4194304] 0 2023-12-16T03:16:04.356 INFO:tasks.workunit.client.1.smithi184.stdout:8/832: symlink d2/d4/d10/d11/d72/dc2/dee/l114 0 2023-12-16T03:16:04.357 INFO:tasks.workunit.client.1.smithi184.stdout:6/876: write d0/d5/d22/d25/f2b [3143487,85080] 0 2023-12-16T03:16:04.357 INFO:tasks.workunit.client.0.smithi064.stdout:5/424: dwrite d0/de/d23/f89 [0,4194304] 0 2023-12-16T03:16:04.361 INFO:tasks.workunit.client.1.smithi184.stdout:4/755: dread d1/d11/d1b/d1e/f57 [0,4194304] 0 2023-12-16T03:16:04.364 INFO:tasks.workunit.client.1.smithi184.stdout:7/704: dread d0/d3/d2e/d79/dd/d27/f76 [0,4194304] 0 2023-12-16T03:16:04.365 INFO:tasks.workunit.client.1.smithi184.stdout:0/803: unlink dc/d22/d1d/d2c/d75/ff0 0 2023-12-16T03:16:04.367 INFO:tasks.workunit.client.0.smithi064.stdout:5/425: creat d0/d14/d4e/f96 x:0 0 0 2023-12-16T03:16:04.367 INFO:tasks.workunit.client.0.smithi064.stdout:5/426: dread - d0/d7/d34/f5c zero size 2023-12-16T03:16:04.370 INFO:tasks.workunit.client.1.smithi184.stdout:6/877: mknod d0/d36/d8a/c11c 0 2023-12-16T03:16:04.373 INFO:tasks.workunit.client.0.smithi064.stdout:3/521: dwrite db/d4f/faf [0,4194304] 0 2023-12-16T03:16:04.373 INFO:tasks.workunit.client.1.smithi184.stdout:5/600: dwrite d1/d3/d9/de/d15/d19/d48/f85 [0,4194304] 0 2023-12-16T03:16:04.373 INFO:tasks.workunit.client.1.smithi184.stdout:5/601: chown d1/d3/d2f/ca7 1 1 2023-12-16T03:16:04.373 INFO:tasks.workunit.client.1.smithi184.stdout:4/756: mkdir d1/d29/d37/d102 0 2023-12-16T03:16:04.373 INFO:tasks.workunit.client.1.smithi184.stdout:1/739: dwrite d3/d34/dbc/d3c/d41/f8a [0,4194304] 0 2023-12-16T03:16:04.374 INFO:tasks.workunit.client.0.smithi064.stdout:8/528: dwrite d0/f14 [0,4194304] 0 2023-12-16T03:16:04.374 INFO:tasks.workunit.client.0.smithi064.stdout:5/427: mkdir d0/d7/d97 0 2023-12-16T03:16:04.375 INFO:tasks.workunit.client.1.smithi184.stdout:7/705: unlink d0/d6b/c62 0 2023-12-16T03:16:04.377 INFO:tasks.workunit.client.0.smithi064.stdout:3/522: symlink db/d12/d1a/d2c/d34/d4c/d6a/d93/lb0 0 2023-12-16T03:16:04.378 INFO:tasks.workunit.client.1.smithi184.stdout:3/909: dwrite d12/d18/d1f/d23/d2a/d4a/f91 [0,4194304] 0 2023-12-16T03:16:04.380 INFO:tasks.workunit.client.1.smithi184.stdout:0/804: truncate dc/dab/fba 771862 0 2023-12-16T03:16:04.383 INFO:tasks.workunit.client.1.smithi184.stdout:6/878: truncate d0/d5/d22/fb1 3981790 0 2023-12-16T03:16:04.383 INFO:tasks.workunit.client.1.smithi184.stdout:6/879: write d0/fc6 [575270,74952] 0 2023-12-16T03:16:04.386 INFO:tasks.workunit.client.0.smithi064.stdout:7/464: dwrite d7/d3e/d42/f73 [0,4194304] 0 2023-12-16T03:16:04.387 INFO:tasks.workunit.client.0.smithi064.stdout:2/392: dwrite d1/d15/f75 [0,4194304] 0 2023-12-16T03:16:04.387 INFO:tasks.workunit.client.1.smithi184.stdout:8/833: dwrite d2/d4/d10/d11/d77/f82 [0,4194304] 0 2023-12-16T03:16:04.387 INFO:tasks.workunit.client.1.smithi184.stdout:8/834: truncate d2/d4/d10/d7a/d83/fd8 27160 0 2023-12-16T03:16:04.389 INFO:tasks.workunit.client.0.smithi064.stdout:6/401: dwrite d3/d8/da/fe [0,4194304] 0 2023-12-16T03:16:04.393 INFO:tasks.workunit.client.1.smithi184.stdout:1/740: dread d3/d34/dbc/d38/faf [0,4194304] 0 2023-12-16T03:16:04.393 INFO:tasks.workunit.client.1.smithi184.stdout:5/602: creat d1/d2a/d31/fc3 x:0 0 0 2023-12-16T03:16:04.397 INFO:tasks.workunit.client.1.smithi184.stdout:4/757: rename d1/d12/d13/d40/d43 to d1/d11/d5a/d63/d103 0 2023-12-16T03:16:04.397 INFO:tasks.workunit.client.1.smithi184.stdout:4/758: write d1/d11/d1b/d1e/fc5 [4462745,91049] 0 2023-12-16T03:16:04.399 INFO:tasks.workunit.client.1.smithi184.stdout:6/880: dread d0/d5/d22/d25/d3f/f78 [0,4194304] 0 2023-12-16T03:16:04.399 INFO:tasks.workunit.client.0.smithi064.stdout:7/465: fsync d7/d3e/d42/f44 0 2023-12-16T03:16:04.400 INFO:tasks.workunit.client.1.smithi184.stdout:3/910: mknod d12/d18/d1f/d23/d2a/d42/d52/d76/da5/c14e 0 2023-12-16T03:16:04.405 INFO:tasks.workunit.client.1.smithi184.stdout:5/603: dread d1/f1a [0,4194304] 0 2023-12-16T03:16:04.406 INFO:tasks.workunit.client.1.smithi184.stdout:5/604: dread - d1/d3/d9/de/d30/fab zero size 2023-12-16T03:16:04.406 INFO:tasks.workunit.client.1.smithi184.stdout:5/605: write d1/d3/d9/de/d15/d19/d48/f85 [4870344,74439] 0 2023-12-16T03:16:04.406 INFO:tasks.workunit.client.1.smithi184.stdout:5/606: write d1/d3/d9/f40 [5597854,18497] 0 2023-12-16T03:16:04.417 INFO:tasks.workunit.client.1.smithi184.stdout:0/805: symlink dc/d22/d1d/d35/d104/l112 0 2023-12-16T03:16:04.417 INFO:tasks.workunit.client.1.smithi184.stdout:0/806: fdatasync dc/d10/d2d/f41 0 2023-12-16T03:16:04.417 INFO:tasks.workunit.client.1.smithi184.stdout:0/807: readlink dc/d22/l10c 0 2023-12-16T03:16:04.418 INFO:tasks.workunit.client.0.smithi064.stdout:9/423: getdents d2 0 2023-12-16T03:16:04.419 INFO:tasks.workunit.client.0.smithi064.stdout:3/523: dwrite db/d12/d1a/f40 [0,4194304] 0 2023-12-16T03:16:04.419 INFO:tasks.workunit.client.0.smithi064.stdout:5/428: dwrite d0/d19/d48/d8f/d5e/f93 [0,4194304] 0 2023-12-16T03:16:04.419 INFO:tasks.workunit.client.0.smithi064.stdout:3/524: truncate db/d12/d4e/d56/f7a 371694 0 2023-12-16T03:16:04.419 INFO:tasks.workunit.client.0.smithi064.stdout:6/402: dwrite d3/d8/d13/d58/f5c [0,4194304] 0 2023-12-16T03:16:04.419 INFO:tasks.workunit.client.0.smithi064.stdout:6/403: truncate d3/d8/f5f 1877589 0 2023-12-16T03:16:04.420 INFO:tasks.workunit.client.1.smithi184.stdout:7/706: dwrite d0/fca [0,4194304] 0 2023-12-16T03:16:04.420 INFO:tasks.workunit.client.1.smithi184.stdout:7/707: chown d0/d3/d2e/d79/d32/d39 260512 1 2023-12-16T03:16:04.421 INFO:tasks.workunit.client.0.smithi064.stdout:7/466: creat d7/d3e/d42/d43/f90 x:0 0 0 2023-12-16T03:16:04.424 INFO:tasks.workunit.client.0.smithi064.stdout:3/525: write db/d12/d1a/d2c/d34/d4c/d6a/da7/f25 [3272059,3168] 0 2023-12-16T03:16:04.424 INFO:tasks.workunit.client.0.smithi064.stdout:8/529: rename d0/db/d12/d1c/d6a to d0/da/d3e/d46/d54/d7c/db7 0 2023-12-16T03:16:04.425 INFO:tasks.workunit.client.0.smithi064.stdout:9/424: unlink d2/d2d/d3b/d3c/d34/f45 0 2023-12-16T03:16:04.426 INFO:tasks.workunit.client.0.smithi064.stdout:9/425: write f1 [2116565,44787] 0 2023-12-16T03:16:04.429 INFO:tasks.workunit.client.1.smithi184.stdout:8/835: mkdir d2/d4/d10/d7a/d83/d8b/d115 0 2023-12-16T03:16:04.429 INFO:tasks.workunit.client.0.smithi064.stdout:2/393: rmdir d1/d15/d23 39 2023-12-16T03:16:04.432 INFO:tasks.workunit.client.1.smithi184.stdout:1/741: mkdir d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa 0 2023-12-16T03:16:04.437 INFO:tasks.workunit.client.1.smithi184.stdout:4/759: link d1/d11/d1b/d1e/c9f d1/d29/d37/c104 0 2023-12-16T03:16:04.437 INFO:tasks.workunit.client.1.smithi184.stdout:4/760: write d1/f54 [826480,17748] 0 2023-12-16T03:16:04.437 INFO:tasks.workunit.client.1.smithi184.stdout:4/761: write d1/d12/d13/da1/fb6 [438034,120894] 0 2023-12-16T03:16:04.438 INFO:tasks.workunit.client.0.smithi064.stdout:5/429: creat d0/d14/d20/d37/d70/d71/d80/f98 x:0 0 0 2023-12-16T03:16:04.438 INFO:tasks.workunit.client.0.smithi064.stdout:5/430: write d0/d50/d39/f3a [1256627,63999] 0 2023-12-16T03:16:04.440 INFO:tasks.workunit.client.0.smithi064.stdout:8/530: dread d0/db/d5a/d97/f6e [0,4194304] 0 2023-12-16T03:16:04.440 INFO:tasks.workunit.client.0.smithi064.stdout:8/531: stat d0/d1d/d3c/d42 0 2023-12-16T03:16:04.443 INFO:tasks.workunit.client.1.smithi184.stdout:6/881: creat d0/d5/d12/d1b/d33/d111/f11d x:0 0 0 2023-12-16T03:16:04.444 INFO:tasks.workunit.client.0.smithi064.stdout:7/467: dwrite d7/d3e/d42/d48/d51/f8d [0,4194304] 0 2023-12-16T03:16:04.444 INFO:tasks.workunit.client.0.smithi064.stdout:5/431: write d0/d7/f1d [2741530,91021] 0 2023-12-16T03:16:04.444 INFO:tasks.workunit.client.0.smithi064.stdout:3/526: creat db/d4f/fb1 x:0 0 0 2023-12-16T03:16:04.444 INFO:tasks.workunit.client.0.smithi064.stdout:3/527: fsync db/d12/d1a/f28 0 2023-12-16T03:16:04.445 INFO:tasks.workunit.client.0.smithi064.stdout:7/468: read d7/d3e/d42/d89/d74/f81 [612155,11393] 0 2023-12-16T03:16:04.446 INFO:tasks.workunit.client.1.smithi184.stdout:3/911: creat d12/d18/da1/dbd/f14f x:0 0 0 2023-12-16T03:16:04.447 INFO:tasks.workunit.client.0.smithi064.stdout:6/404: rename d3/d9/d2d to d3/d8/d1f/d26/d47/d4a/d67/d73 0 2023-12-16T03:16:04.448 INFO:tasks.workunit.client.0.smithi064.stdout:6/405: fdatasync d3/d9/f20 0 2023-12-16T03:16:04.449 INFO:tasks.workunit.client.0.smithi064.stdout:9/426: creat d2/d2d/d6c/f86 x:0 0 0 2023-12-16T03:16:04.449 INFO:tasks.workunit.client.0.smithi064.stdout:8/532: fdatasync d0/db/f4f 0 2023-12-16T03:16:04.450 INFO:tasks.workunit.client.0.smithi064.stdout:8/533: readlink d0/da/d3e/d46/d54/d8c/l9e 0 2023-12-16T03:16:04.453 INFO:tasks.workunit.client.0.smithi064.stdout:2/394: getdents d1/d76 0 2023-12-16T03:16:04.454 INFO:tasks.workunit.client.1.smithi184.stdout:5/607: rename d1/d3/l14 to d1/d3/d9/de/d15/d19/d3a/lc4 0 2023-12-16T03:16:04.454 INFO:tasks.workunit.client.1.smithi184.stdout:1/742: dwrite d3/d34/dbc/d36/f9b [4194304,4194304] 0 2023-12-16T03:16:04.455 INFO:tasks.workunit.client.1.smithi184.stdout:5/608: chown d1/d3/l32 4821 1 2023-12-16T03:16:04.455 INFO:tasks.workunit.client.1.smithi184.stdout:0/808: mkdir dc/d2a/d113 0 2023-12-16T03:16:04.460 INFO:tasks.workunit.client.0.smithi064.stdout:5/432: mkdir d0/d50/d99 0 2023-12-16T03:16:04.461 INFO:tasks.workunit.client.1.smithi184.stdout:7/708: creat d0/d3/d2e/d79/d36/d3f/fcf x:0 0 0 2023-12-16T03:16:04.463 INFO:tasks.workunit.client.0.smithi064.stdout:3/528: mknod db/d12/d1a/d2c/d6e/d75/d92/cb2 0 2023-12-16T03:16:04.463 INFO:tasks.workunit.client.1.smithi184.stdout:8/836: rmdir d2/d4/d10/d75/dd6 39 2023-12-16T03:16:04.463 INFO:tasks.workunit.client.1.smithi184.stdout:8/837: dread - d2/d4/d10/d7a/ff7 zero size 2023-12-16T03:16:04.465 INFO:tasks.workunit.client.0.smithi064.stdout:7/469: mkdir d7/d3e/d42/d89/d20/d6f/d91 0 2023-12-16T03:16:04.466 INFO:tasks.workunit.client.1.smithi184.stdout:8/838: write d2/d12/d21/d2d/fec [355856,115193] 0 2023-12-16T03:16:04.466 INFO:tasks.workunit.client.1.smithi184.stdout:2/700: sync 2023-12-16T03:16:04.467 INFO:tasks.workunit.client.1.smithi184.stdout:3/912: dwrite d12/d18/d1f/d23/d2a/d4a/d61/f13d [0,4194304] 0 2023-12-16T03:16:04.468 INFO:tasks.workunit.client.0.smithi064.stdout:4/510: sync 2023-12-16T03:16:04.468 INFO:tasks.workunit.client.0.smithi064.stdout:1/432: sync 2023-12-16T03:16:04.468 INFO:tasks.workunit.client.0.smithi064.stdout:6/406: link d3/d8/d13/c41 d3/d44/c74 0 2023-12-16T03:16:04.469 INFO:tasks.workunit.client.0.smithi064.stdout:1/433: write d3/dd/f3c [4127844,60240] 0 2023-12-16T03:16:04.469 INFO:tasks.workunit.client.0.smithi064.stdout:6/407: read d3/d8/d1f/d26/f3b [3224001,74404] 0 2023-12-16T03:16:04.469 INFO:tasks.workunit.client.0.smithi064.stdout:6/408: chown d3/d8/d1f/l3f 115759 1 2023-12-16T03:16:04.472 INFO:tasks.workunit.client.1.smithi184.stdout:4/762: rmdir d1/d29/d34/d5c 39 2023-12-16T03:16:04.473 INFO:tasks.workunit.client.1.smithi184.stdout:4/763: readlink d1/d11/d5a/d63/d103/d5e/lc0 0 2023-12-16T03:16:04.473 INFO:tasks.workunit.client.1.smithi184.stdout:4/764: truncate d1/d12/db3/db8/dd2/fee 378184 0 2023-12-16T03:16:04.473 INFO:tasks.workunit.client.1.smithi184.stdout:4/765: readlink d1/l2 0 2023-12-16T03:16:04.473 INFO:tasks.workunit.client.1.smithi184.stdout:1/743: dread d3/d34/dbc/d3c/d41/d46/ff0 [0,4194304] 0 2023-12-16T03:16:04.473 INFO:tasks.workunit.client.1.smithi184.stdout:2/701: dread d3/d9/f85 [0,4194304] 0 2023-12-16T03:16:04.474 INFO:tasks.workunit.client.0.smithi064.stdout:9/427: symlink d2/d7e/l87 0 2023-12-16T03:16:04.474 INFO:tasks.workunit.client.0.smithi064.stdout:0/438: sync 2023-12-16T03:16:04.474 INFO:tasks.workunit.client.0.smithi064.stdout:0/439: truncate d2/d8/da/df/f72 85115 0 2023-12-16T03:16:04.474 INFO:tasks.workunit.client.0.smithi064.stdout:0/440: readlink d2/d8/da/d11/l7d 0 2023-12-16T03:16:04.475 INFO:tasks.workunit.client.0.smithi064.stdout:8/534: creat d0/db/d37/d3a/d95/fb8 x:0 0 0 2023-12-16T03:16:04.477 INFO:tasks.workunit.client.0.smithi064.stdout:6/409: read d3/d8/da/f23 [7337951,33445] 0 2023-12-16T03:16:04.477 INFO:tasks.workunit.client.0.smithi064.stdout:5/433: mkdir d0/d19/d48/d8f/d3e/d35/d5d/d9a 0 2023-12-16T03:16:04.477 INFO:tasks.workunit.client.0.smithi064.stdout:5/434: write d0/d14/d20/d37/d70/f81 [424393,19457] 0 2023-12-16T03:16:04.478 INFO:tasks.workunit.client.1.smithi184.stdout:6/882: creat d0/d5/d22/d25/dbf/f11e x:0 0 0 2023-12-16T03:16:04.479 INFO:tasks.workunit.client.1.smithi184.stdout:8/839: dread d2/d12/d21/d2d/d31/d34/d96/dca/f10f [0,4194304] 0 2023-12-16T03:16:04.482 INFO:tasks.workunit.client.1.smithi184.stdout:5/609: symlink d1/d3/d9/de/d15/d19/d53/dad/lc5 0 2023-12-16T03:16:04.483 INFO:tasks.workunit.client.0.smithi064.stdout:7/470: rename d7/d3e/d42/d48/d51/d7c/c8c to d7/d3e/d42/d89/d74/c92 0 2023-12-16T03:16:04.483 INFO:tasks.workunit.client.0.smithi064.stdout:7/471: fsync d7/d3e/d42/d89/d20/f28 0 2023-12-16T03:16:04.486 INFO:tasks.workunit.client.1.smithi184.stdout:0/809: rename dc/dc9/cda to dc/d22/d1d/d2c/d75/c114 0 2023-12-16T03:16:04.490 INFO:tasks.workunit.client.0.smithi064.stdout:4/511: mknod d0/da/ca4 0 2023-12-16T03:16:04.491 INFO:tasks.workunit.client.1.smithi184.stdout:7/709: creat d0/d3/d2e/d79/d36/d84/fd0 x:0 0 0 2023-12-16T03:16:04.492 INFO:tasks.workunit.client.0.smithi064.stdout:1/434: mknod d3/dd/d23/d41/c8f 0 2023-12-16T03:16:04.494 INFO:tasks.workunit.client.0.smithi064.stdout:4/512: read d0/d12/f2a [3366455,116850] 0 2023-12-16T03:16:04.494 INFO:tasks.workunit.client.0.smithi064.stdout:2/395: dwrite d1/f1d [0,4194304] 0 2023-12-16T03:16:04.494 INFO:tasks.workunit.client.0.smithi064.stdout:2/396: fsync d1/d15/d1b/f33 0 2023-12-16T03:16:04.494 INFO:tasks.workunit.client.1.smithi184.stdout:6/883: dread d0/d5/f24 [0,4194304] 0 2023-12-16T03:16:04.494 INFO:tasks.workunit.client.1.smithi184.stdout:6/884: truncate d0/d5/d22/d37/d4d/d87/f100 126673 0 2023-12-16T03:16:04.497 INFO:tasks.workunit.client.0.smithi064.stdout:0/441: dread d2/f32 [0,4194304] 0 2023-12-16T03:16:04.497 INFO:tasks.workunit.client.0.smithi064.stdout:9/428: creat d2/dc/d24/d39/d77/f88 x:0 0 0 2023-12-16T03:16:04.499 INFO:tasks.workunit.client.1.smithi184.stdout:3/913: mkdir d12/d1e/de8/d48/d150 0 2023-12-16T03:16:04.500 INFO:tasks.workunit.client.0.smithi064.stdout:8/535: creat d0/db/d5a/d97/fb9 x:0 0 0 2023-12-16T03:16:04.502 INFO:tasks.workunit.client.1.smithi184.stdout:1/744: symlink d3/d34/lfb 0 2023-12-16T03:16:04.503 INFO:tasks.workunit.client.0.smithi064.stdout:6/410: creat d3/d8/d13/d58/d65/f75 x:0 0 0 2023-12-16T03:16:04.503 INFO:tasks.workunit.client.0.smithi064.stdout:3/529: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/fa1 [0,4194304] 0 2023-12-16T03:16:04.503 INFO:tasks.workunit.client.1.smithi184.stdout:8/840: truncate d2/d12/d21/d8a/fb2 23330 0 2023-12-16T03:16:04.503 INFO:tasks.workunit.client.1.smithi184.stdout:8/841: write d2/d12/d21/f8c [1953821,54571] 0 2023-12-16T03:16:04.505 INFO:tasks.workunit.client.1.smithi184.stdout:5/610: rmdir d1/d3/d9/de/d30/d80 39 2023-12-16T03:16:04.508 INFO:tasks.workunit.client.0.smithi064.stdout:2/397: rename d1/d27/d2e/d68/d60 to d1/d15/d23/d2d/d7c 0 2023-12-16T03:16:04.510 INFO:tasks.workunit.client.0.smithi064.stdout:4/513: dread d0/d42/d56/f67 [0,4194304] 0 2023-12-16T03:16:04.510 INFO:tasks.workunit.client.0.smithi064.stdout:4/514: fdatasync d0/d1e/f69 0 2023-12-16T03:16:04.511 INFO:tasks.workunit.client.1.smithi184.stdout:4/766: rename d1/d11/d5a/d63/fbd to d1/d29/d34/d5c/d76/dc7/f105 0 2023-12-16T03:16:04.512 INFO:tasks.workunit.client.0.smithi064.stdout:0/442: creat d2/f8d x:0 0 0 2023-12-16T03:16:04.513 INFO:tasks.workunit.client.0.smithi064.stdout:9/429: dread d2/dc/d24/d39/d5e/d6f/f84 [0,4194304] 0 2023-12-16T03:16:04.515 INFO:tasks.workunit.client.0.smithi064.stdout:9/430: write d2/dc/f1f [2645462,70545] 0 2023-12-16T03:16:04.516 INFO:tasks.workunit.client.1.smithi184.stdout:8/842: dread d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:16:04.516 INFO:tasks.workunit.client.1.smithi184.stdout:0/810: creat dc/d22/d1d/d35/dd8/f115 x:0 0 0 2023-12-16T03:16:04.516 INFO:tasks.workunit.client.1.smithi184.stdout:8/843: write d2/d6a/faf [697237,62646] 0 2023-12-16T03:16:04.516 INFO:tasks.workunit.client.1.smithi184.stdout:8/844: readlink d2/d4/d10/d11/l9f 0 2023-12-16T03:16:04.517 INFO:tasks.workunit.client.1.smithi184.stdout:7/710: unlink d0/d3/d2e/d79/d36/d84/fb2 0 2023-12-16T03:16:04.517 INFO:tasks.workunit.client.1.smithi184.stdout:7/711: truncate d0/d3/d2e/d79/d36/d84/f85 610129 0 2023-12-16T03:16:04.517 INFO:tasks.workunit.client.1.smithi184.stdout:7/712: dread - d0/d3/d2e/d79/d1e/faf zero size 2023-12-16T03:16:04.519 INFO:tasks.workunit.client.1.smithi184.stdout:3/914: mkdir d12/d86/de4/d151 0 2023-12-16T03:16:04.519 INFO:tasks.workunit.client.0.smithi064.stdout:1/435: dread d3/d22/f2e [0,4194304] 0 2023-12-16T03:16:04.520 INFO:tasks.workunit.client.1.smithi184.stdout:2/702: dwrite d3/f50 [0,4194304] 0 2023-12-16T03:16:04.521 INFO:tasks.workunit.client.0.smithi064.stdout:0/443: dread d2/f32 [0,4194304] 0 2023-12-16T03:16:04.521 INFO:tasks.workunit.client.0.smithi064.stdout:0/444: write d2/f5 [4275376,48318] 0 2023-12-16T03:16:04.523 INFO:tasks.workunit.client.0.smithi064.stdout:2/398: write d1/d27/d2e/f34 [1049735,81389] 0 2023-12-16T03:16:04.523 INFO:tasks.workunit.client.0.smithi064.stdout:5/435: dwrite d0/d19/d48/d8f/d5e/f93 [0,4194304] 0 2023-12-16T03:16:04.523 INFO:tasks.workunit.client.0.smithi064.stdout:5/436: readlink d0/d14/d20/l4d 0 2023-12-16T03:16:04.523 INFO:tasks.workunit.client.0.smithi064.stdout:1/436: dread d3/d22/f2e [0,4194304] 0 2023-12-16T03:16:04.523 INFO:tasks.workunit.client.0.smithi064.stdout:1/437: chown d3/dd/f1a 451 1 2023-12-16T03:16:04.523 INFO:tasks.workunit.client.1.smithi184.stdout:6/885: dwrite d0/d5/d22/d25/d47/f64 [0,4194304] 0 2023-12-16T03:16:04.524 INFO:tasks.workunit.client.1.smithi184.stdout:6/886: dread - d0/d5/d22/d25/d47/f104 zero size 2023-12-16T03:16:04.524 INFO:tasks.workunit.client.1.smithi184.stdout:5/611: mkdir d1/d3/dc6 0 2023-12-16T03:16:04.525 INFO:tasks.workunit.client.0.smithi064.stdout:9/431: creat d2/d2d/d6c/f89 x:0 0 0 2023-12-16T03:16:04.525 INFO:tasks.workunit.client.0.smithi064.stdout:9/432: chown d2/d2d/d6c/f86 31317956 1 2023-12-16T03:16:04.526 INFO:tasks.workunit.client.0.smithi064.stdout:7/472: dwrite d7/d26/f27 [0,4194304] 0 2023-12-16T03:16:04.526 INFO:tasks.workunit.client.0.smithi064.stdout:6/411: dwrite d3/d8/da/fe [0,4194304] 0 2023-12-16T03:16:04.528 INFO:tasks.workunit.client.1.smithi184.stdout:1/745: rename d3/d13/d2c/cae to d3/d34/d76/df9/cfc 0 2023-12-16T03:16:04.531 INFO:tasks.workunit.client.0.smithi064.stdout:0/445: mkdir d2/d5b/d8b/d8e 0 2023-12-16T03:16:04.533 INFO:tasks.workunit.client.1.smithi184.stdout:0/811: getdents dc/d22/d1d/da5 0 2023-12-16T03:16:04.533 INFO:tasks.workunit.client.1.smithi184.stdout:0/812: truncate dc/d22/d53/f95 2360320 0 2023-12-16T03:16:04.533 INFO:tasks.workunit.client.1.smithi184.stdout:0/813: chown dc/dab/cb0 3 1 2023-12-16T03:16:04.537 INFO:tasks.workunit.client.1.smithi184.stdout:3/915: mknod d12/d18/d68/c152 0 2023-12-16T03:16:04.537 INFO:tasks.workunit.client.1.smithi184.stdout:3/916: chown d12/d18/d1f/d23/d2a/d36/f8d 9791846 1 2023-12-16T03:16:04.538 INFO:tasks.workunit.client.1.smithi184.stdout:3/917: fdatasync d12/d18/d1f/d23/d2a/d4a/fd2 0 2023-12-16T03:16:04.538 INFO:tasks.workunit.client.1.smithi184.stdout:3/918: chown d12/d37/f67 9311 1 2023-12-16T03:16:04.538 INFO:tasks.workunit.client.1.smithi184.stdout:3/919: dread - d12/d86/de4/d99/f137 zero size 2023-12-16T03:16:04.538 INFO:tasks.workunit.client.1.smithi184.stdout:3/920: write d12/d86/de4/d99/d117/fbe [4383612,100178] 0 2023-12-16T03:16:04.540 INFO:tasks.workunit.client.0.smithi064.stdout:6/412: dread d3/d8/f4c [0,4194304] 0 2023-12-16T03:16:04.542 INFO:tasks.workunit.client.0.smithi064.stdout:4/515: dwrite d0/d42/d66/d33/f38 [0,4194304] 0 2023-12-16T03:16:04.542 INFO:tasks.workunit.client.0.smithi064.stdout:4/516: stat d0/d12/d48/l57 0 2023-12-16T03:16:04.543 INFO:tasks.workunit.client.0.smithi064.stdout:9/433: fdatasync d2/dc/f1f 0 2023-12-16T03:16:04.543 INFO:tasks.workunit.client.0.smithi064.stdout:9/434: fdatasync d2/dc/d24/d39/d77/f88 0 2023-12-16T03:16:04.549 INFO:tasks.workunit.client.1.smithi184.stdout:2/703: link d3/d29/d61/d6d/f99 d3/d13/d28/dac/fe5 0 2023-12-16T03:16:04.550 INFO:tasks.workunit.client.0.smithi064.stdout:5/437: link d0/d19/f27 d0/d7/d97/f9b 0 2023-12-16T03:16:04.552 INFO:tasks.workunit.client.0.smithi064.stdout:1/438: mkdir d3/dd/d11/d2f/d90 0 2023-12-16T03:16:04.561 INFO:tasks.workunit.client.0.smithi064.stdout:7/473: unlink d7/d3e/d42/d89/d20/d37/c3c 0 2023-12-16T03:16:04.569 INFO:tasks.workunit.client.1.smithi184.stdout:8/845: rename d2/d12/l26 to d2/d4/d10/d7a/d83/d8b/d115/l116 0 2023-12-16T03:16:04.569 INFO:tasks.workunit.client.1.smithi184.stdout:8/846: readlink d2/d12/d21/lf9 0 2023-12-16T03:16:04.569 INFO:tasks.workunit.client.1.smithi184.stdout:8/847: write d2/d12/d21/d8a/dda/d73/fe7 [1262194,38354] 0 2023-12-16T03:16:04.569 INFO:tasks.workunit.client.1.smithi184.stdout:0/814: creat dc/d22/d48/dfb/f116 x:0 0 0 2023-12-16T03:16:04.569 INFO:tasks.workunit.client.1.smithi184.stdout:7/713: dwrite d0/d3/d2e/d79/d36/f4e [4194304,4194304] 0 2023-12-16T03:16:04.570 INFO:tasks.workunit.client.1.smithi184.stdout:2/704: creat d3/d13/d28/dac/daf/dc8/fe6 x:0 0 0 2023-12-16T03:16:04.570 INFO:tasks.workunit.client.1.smithi184.stdout:3/921: getdents d12/d86/de4 0 2023-12-16T03:16:04.572 INFO:tasks.workunit.client.0.smithi064.stdout:0/446: mknod d2/d29/c8f 0 2023-12-16T03:16:04.572 INFO:tasks.workunit.client.0.smithi064.stdout:0/447: readlink d2/d8/da/df/l3b 0 2023-12-16T03:16:04.572 INFO:tasks.workunit.client.0.smithi064.stdout:3/530: truncate db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/fa1 1511929 0 2023-12-16T03:16:04.573 INFO:tasks.workunit.client.1.smithi184.stdout:3/922: write d12/d37/d81/f87 [234649,60322] 0 2023-12-16T03:16:04.573 INFO:tasks.workunit.client.1.smithi184.stdout:0/815: symlink dc/d22/d45/d66/d80/da3/d109/l117 0 2023-12-16T03:16:04.573 INFO:tasks.workunit.client.1.smithi184.stdout:0/816: truncate dc/d10/d2d/f110 564942 0 2023-12-16T03:16:04.576 INFO:tasks.workunit.client.1.smithi184.stdout:5/612: dwrite d1/d3/d9/de/d15/d19/f1d [0,4194304] 0 2023-12-16T03:16:04.576 INFO:tasks.workunit.client.1.smithi184.stdout:4/767: dwrite d1/d11/fdc [0,4194304] 0 2023-12-16T03:16:04.576 INFO:tasks.workunit.client.1.smithi184.stdout:5/613: readlink d1/d3/d9/de/l8f 0 2023-12-16T03:16:04.577 INFO:tasks.workunit.client.0.smithi064.stdout:6/413: creat d3/d8/d1f/d26/d47/d4a/d67/d73/f76 x:0 0 0 2023-12-16T03:16:04.579 INFO:tasks.workunit.client.0.smithi064.stdout:9/435: mkdir d2/dc/d8a 0 2023-12-16T03:16:04.580 INFO:tasks.workunit.client.1.smithi184.stdout:7/714: dread d0/d3/f64 [0,4194304] 0 2023-12-16T03:16:04.582 INFO:tasks.workunit.client.1.smithi184.stdout:4/768: read d1/d11/d1b/fbb [322492,64790] 0 2023-12-16T03:16:04.582 INFO:tasks.workunit.client.0.smithi064.stdout:0/448: dread d2/f16 [0,4194304] 0 2023-12-16T03:16:04.582 INFO:tasks.workunit.client.0.smithi064.stdout:0/449: fsync d2/d7/d6b/f6e 0 2023-12-16T03:16:04.583 INFO:tasks.workunit.client.1.smithi184.stdout:2/705: link d3/d9/d19/f37 d3/d29/d61/fe7 0 2023-12-16T03:16:04.583 INFO:tasks.workunit.client.1.smithi184.stdout:7/715: dread d0/d3/d2e/d79/d36/d3f/f4f [0,4194304] 0 2023-12-16T03:16:04.584 INFO:tasks.workunit.client.0.smithi064.stdout:1/439: truncate d3/d22/d57/f5d 3417765 0 2023-12-16T03:16:04.584 INFO:tasks.workunit.client.1.smithi184.stdout:1/746: dwrite d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/d99/feb [0,4194304] 0 2023-12-16T03:16:04.584 INFO:tasks.workunit.client.1.smithi184.stdout:1/747: chown d3/d34/dbc/la0 21649 1 2023-12-16T03:16:04.585 INFO:tasks.workunit.client.1.smithi184.stdout:3/923: rmdir d12/d18/d1f/d23/d2a/d36 39 2023-12-16T03:16:04.585 INFO:tasks.workunit.client.0.smithi064.stdout:3/531: mkdir db/d4f/d51/db3 0 2023-12-16T03:16:04.587 INFO:tasks.workunit.client.0.smithi064.stdout:6/414: truncate d3/d8/d1f/f56 658937 0 2023-12-16T03:16:04.588 INFO:tasks.workunit.client.1.smithi184.stdout:1/748: dread d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/d99/db7/fbb [0,4194304] 0 2023-12-16T03:16:04.590 INFO:tasks.workunit.client.1.smithi184.stdout:6/887: dwrite d0/d36/d79/fd5 [0,4194304] 0 2023-12-16T03:16:04.590 INFO:tasks.workunit.client.0.smithi064.stdout:0/450: link d2/d7/d10/d21/l5d d2/d29/l90 0 2023-12-16T03:16:04.590 INFO:tasks.workunit.client.0.smithi064.stdout:0/451: write d2/d7/d10/d21/d31/f87 [441182,111205] 0 2023-12-16T03:16:04.591 INFO:tasks.workunit.client.0.smithi064.stdout:4/517: dwrite d0/da/f6d [0,4194304] 0 2023-12-16T03:16:04.592 INFO:tasks.workunit.client.0.smithi064.stdout:5/438: dwrite d0/d14/d20/d37/d70/f81 [0,4194304] 0 2023-12-16T03:16:04.593 INFO:tasks.workunit.client.0.smithi064.stdout:5/439: chown d0/f15 7520 1 2023-12-16T03:16:04.593 INFO:tasks.workunit.client.0.smithi064.stdout:1/440: symlink d3/dd/d11/d2f/l91 0 2023-12-16T03:16:04.596 INFO:tasks.workunit.client.0.smithi064.stdout:3/532: unlink db/d12/c95 0 2023-12-16T03:16:04.596 INFO:tasks.workunit.client.0.smithi064.stdout:3/533: chown db/d12/d1a/d2c/d34/f5a 0 1 2023-12-16T03:16:04.599 INFO:tasks.workunit.client.1.smithi184.stdout:0/817: mkdir dc/d22/d1d/d8e/d118 0 2023-12-16T03:16:04.600 INFO:tasks.workunit.client.1.smithi184.stdout:0/818: write dc/d22/d1d/d35/dc3/f6e [1094373,113940] 0 2023-12-16T03:16:04.600 INFO:tasks.workunit.client.1.smithi184.stdout:0/819: chown dc/d22/d1d/d35/dd8/l10a 1278 1 2023-12-16T03:16:04.600 INFO:tasks.workunit.client.0.smithi064.stdout:1/441: dread d3/dd/f42 [0,4194304] 0 2023-12-16T03:16:04.600 INFO:tasks.workunit.client.0.smithi064.stdout:3/534: write db/d12/d1a/f38 [304866,12359] 0 2023-12-16T03:16:04.600 INFO:tasks.workunit.client.0.smithi064.stdout:3/535: write db/d12/d1a/d2c/d34/f5a [18220,95122] 0 2023-12-16T03:16:04.601 INFO:tasks.workunit.client.0.smithi064.stdout:7/474: dwrite d7/d26/d30/f33 [0,4194304] 0 2023-12-16T03:16:04.606 INFO:tasks.workunit.client.0.smithi064.stdout:3/536: dread db/d12/d21/f61 [0,4194304] 0 2023-12-16T03:16:04.606 INFO:tasks.workunit.client.1.smithi184.stdout:4/769: creat d1/d12/db3/f106 x:0 0 0 2023-12-16T03:16:04.607 INFO:tasks.workunit.client.0.smithi064.stdout:6/415: dwrite d3/d8/d1f/d26/f62 [0,4194304] 0 2023-12-16T03:16:04.608 INFO:tasks.workunit.client.1.smithi184.stdout:4/770: write d1/d11/d1b/d1e/f41 [2166096,129846] 0 2023-12-16T03:16:04.608 INFO:tasks.workunit.client.1.smithi184.stdout:4/771: chown d1/d29/d34/d5c/d76/d33 179553 1 2023-12-16T03:16:04.609 INFO:tasks.workunit.client.0.smithi064.stdout:4/518: rename d0/d12/d48/f4f to d0/d42/d56/fa5 0 2023-12-16T03:16:04.611 INFO:tasks.workunit.client.1.smithi184.stdout:2/706: link d3/d9/d19/f7d d3/d13/d28/dac/fe8 0 2023-12-16T03:16:04.614 INFO:tasks.workunit.client.1.smithi184.stdout:7/716: creat d0/d3/d2e/d79/dd/d27/fd1 x:0 0 0 2023-12-16T03:16:04.615 INFO:tasks.workunit.client.1.smithi184.stdout:7/717: readlink d0/l43 0 2023-12-16T03:16:04.615 INFO:tasks.workunit.client.1.smithi184.stdout:7/718: write d0/d3/f7 [3780632,40427] 0 2023-12-16T03:16:04.619 INFO:tasks.workunit.client.0.smithi064.stdout:7/475: unlink d7/d3e/d42/d89/l1f 0 2023-12-16T03:16:04.621 INFO:tasks.workunit.client.0.smithi064.stdout:1/442: dwrite d3/dd/d23/d60/f8b [0,4194304] 0 2023-12-16T03:16:04.623 INFO:tasks.workunit.client.0.smithi064.stdout:3/537: dwrite db/f67 [0,4194304] 0 2023-12-16T03:16:04.623 INFO:tasks.workunit.client.0.smithi064.stdout:3/538: truncate db/d12/d1a/d2c/d34/d4c/f8c 549049 0 2023-12-16T03:16:04.623 INFO:tasks.workunit.client.1.smithi184.stdout:3/924: creat d12/d86/de4/d99/d117/db4/f153 x:0 0 0 2023-12-16T03:16:04.626 INFO:tasks.workunit.client.1.smithi184.stdout:1/749: mkdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/dfd 0 2023-12-16T03:16:04.626 INFO:tasks.workunit.client.1.smithi184.stdout:1/750: truncate d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fde 839046 0 2023-12-16T03:16:04.626 INFO:tasks.workunit.client.1.smithi184.stdout:1/751: chown d3/d34/dbc/d3c/d41/d63/fd8 181 1 2023-12-16T03:16:04.637 INFO:tasks.workunit.client.1.smithi184.stdout:6/888: getdents d0/d5/d12/d1b/d33/d3d/da2 0 2023-12-16T03:16:04.639 INFO:tasks.workunit.client.0.smithi064.stdout:1/443: dwrite d3/d36/f45 [0,4194304] 0 2023-12-16T03:16:04.643 INFO:tasks.workunit.client.0.smithi064.stdout:1/444: write d3/dd/f3c [3481959,50534] 0 2023-12-16T03:16:04.643 INFO:tasks.workunit.client.0.smithi064.stdout:1/445: chown d3/l30 5604 1 2023-12-16T03:16:04.650 INFO:tasks.workunit.client.0.smithi064.stdout:4/519: getdents d0/d12/d48/d87 0 2023-12-16T03:16:04.652 INFO:tasks.workunit.client.1.smithi184.stdout:0/820: mkdir dc/d22/d1d/d35/dc3/d7f/d119 0 2023-12-16T03:16:04.653 INFO:tasks.workunit.client.0.smithi064.stdout:5/440: mknod d0/c9c 0 2023-12-16T03:16:04.653 INFO:tasks.workunit.client.0.smithi064.stdout:5/441: getdents d0/d7/d8b 0 2023-12-16T03:16:04.654 INFO:tasks.workunit.client.1.smithi184.stdout:5/614: mknod d1/cc7 0 2023-12-16T03:16:04.654 INFO:tasks.workunit.client.0.smithi064.stdout:7/476: rmdir d7/d3e/d42/d89/d20/d6f 39 2023-12-16T03:16:04.657 INFO:tasks.workunit.client.0.smithi064.stdout:1/446: dwrite d3/dd/d23/d41/f4b [0,4194304] 0 2023-12-16T03:16:04.662 INFO:tasks.workunit.client.0.smithi064.stdout:3/539: getdents db/d12/d1a/d2c/d6e/d75/d92 0 2023-12-16T03:16:04.666 INFO:tasks.workunit.client.0.smithi064.stdout:6/416: truncate d3/d8/da/f37 339392 0 2023-12-16T03:16:04.668 INFO:tasks.workunit.client.0.smithi064.stdout:4/520: mkdir d0/da/da6 0 2023-12-16T03:16:04.669 INFO:tasks.workunit.client.0.smithi064.stdout:5/442: mknod d0/d14/d20/d37/d70/c9d 0 2023-12-16T03:16:04.671 INFO:tasks.workunit.client.1.smithi184.stdout:4/772: getdents d1/d12 0 2023-12-16T03:16:04.673 INFO:tasks.workunit.client.0.smithi064.stdout:7/477: getdents d7/d3e/d42/d48/d51/d7c/d52 0 2023-12-16T03:16:04.675 INFO:tasks.workunit.client.0.smithi064.stdout:1/447: dwrite d3/d36/d44/d4d/f6b [0,4194304] 0 2023-12-16T03:16:04.675 INFO:tasks.workunit.client.1.smithi184.stdout:2/707: creat d3/d29/d4d/d5b/fe9 x:0 0 0 2023-12-16T03:16:04.676 INFO:tasks.workunit.client.0.smithi064.stdout:3/540: mknod db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/da4/cb4 0 2023-12-16T03:16:04.681 INFO:tasks.workunit.client.0.smithi064.stdout:4/521: link d0/d42/l83 d0/d1e/d36/la7 0 2023-12-16T03:16:04.683 INFO:tasks.workunit.client.1.smithi184.stdout:7/719: mkdir d0/d3/d2e/d79/d36/d84/dd2 0 2023-12-16T03:16:04.683 INFO:tasks.workunit.client.1.smithi184.stdout:3/925: creat d12/d18/d1f/d23/d51/f154 x:0 0 0 2023-12-16T03:16:04.687 INFO:tasks.workunit.client.1.smithi184.stdout:1/752: mknod d3/d34/dbc/d3c/cfe 0 2023-12-16T03:16:04.689 INFO:tasks.workunit.client.1.smithi184.stdout:6/889: mknod d0/d5/d12/d1b/d33/d3d/c11f 0 2023-12-16T03:16:04.689 INFO:tasks.workunit.client.1.smithi184.stdout:6/890: write d0/d5/d22/d25/dbf/dbe/fd8 [564324,22531] 0 2023-12-16T03:16:04.690 INFO:tasks.workunit.client.0.smithi064.stdout:1/448: creat d3/d36/d44/d4d/f92 x:0 0 0 2023-12-16T03:16:04.692 INFO:tasks.workunit.client.1.smithi184.stdout:0/821: link dc/d10/d2d/d5f/d7a/f9f dc/d22/d1d/d35/dc3/d7f/d119/f11a 0 2023-12-16T03:16:04.692 INFO:tasks.workunit.client.1.smithi184.stdout:0/822: write dc/d22/d48/dfb/f116 [698156,762] 0 2023-12-16T03:16:04.694 INFO:tasks.workunit.client.1.smithi184.stdout:5/615: creat d1/d3/d9/de/d15/d19/d48/fc8 x:0 0 0 2023-12-16T03:16:04.694 INFO:tasks.workunit.client.1.smithi184.stdout:5/616: write d1/f7e [908938,36239] 0 2023-12-16T03:16:04.696 INFO:tasks.workunit.client.0.smithi064.stdout:3/541: mkdir db/d12/d1a/d2c/db5 0 2023-12-16T03:16:04.697 INFO:tasks.workunit.client.0.smithi064.stdout:1/449: write d3/dd/f1a [543512,48674] 0 2023-12-16T03:16:04.697 INFO:tasks.workunit.client.0.smithi064.stdout:1/450: stat d3/dd/d23/d60/l78 0 2023-12-16T03:16:04.697 INFO:tasks.workunit.client.1.smithi184.stdout:4/773: mkdir d1/d11/d5a/d63/d103/d45/dcf/de6/d107 0 2023-12-16T03:16:04.700 INFO:tasks.workunit.client.0.smithi064.stdout:6/417: link d3/d8/da/f43 d3/d8/d13/d46/f77 0 2023-12-16T03:16:04.701 INFO:tasks.workunit.client.1.smithi184.stdout:3/926: creat d12/d18/d1f/d23/d2a/d4a/d61/da9/d106/d10b/f155 x:0 0 0 2023-12-16T03:16:04.702 INFO:tasks.workunit.client.0.smithi064.stdout:3/542: truncate db/d12/d1a/d2c/d34/f3d 1864089 0 2023-12-16T03:16:04.703 INFO:tasks.workunit.client.0.smithi064.stdout:3/543: chown db/d12/d1a/d2c/d34/d4c/f82 595793 1 2023-12-16T03:16:04.703 INFO:tasks.workunit.client.0.smithi064.stdout:6/418: read d3/d9/f20 [1319492,48714] 0 2023-12-16T03:16:04.704 INFO:tasks.workunit.client.1.smithi184.stdout:1/753: creat d3/d34/dbc/d3c/d41/d77/fff x:0 0 0 2023-12-16T03:16:04.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/891: creat d0/d5/d22/d25/d47/d10e/f120 x:0 0 0 2023-12-16T03:16:04.705 INFO:tasks.workunit.client.0.smithi064.stdout:3/544: creat db/d4f/da9/fb6 x:0 0 0 2023-12-16T03:16:04.707 INFO:tasks.workunit.client.1.smithi184.stdout:0/823: mkdir dc/d22/d53/ded/d11b 0 2023-12-16T03:16:04.707 INFO:tasks.workunit.client.1.smithi184.stdout:0/824: truncate dc/d10/d2d/d5f/d7a/f9d 873252 0 2023-12-16T03:16:04.708 INFO:tasks.workunit.client.0.smithi064.stdout:6/419: mknod d3/c78 0 2023-12-16T03:16:04.708 INFO:tasks.workunit.client.0.smithi064.stdout:6/420: fsync d3/d8/d1f/f56 0 2023-12-16T03:16:04.709 INFO:tasks.workunit.client.1.smithi184.stdout:5/617: rmdir d1/d2a/d31/d28/d72 39 2023-12-16T03:16:04.709 INFO:tasks.workunit.client.1.smithi184.stdout:5/618: fdatasync d1/d3/d9/de/d15/d19/d5f/d45/f84 0 2023-12-16T03:16:04.710 INFO:tasks.workunit.client.0.smithi064.stdout:5/443: dwrite d0/d19/d48/d8f/d5e/f93 [4194304,4194304] 0 2023-12-16T03:16:04.710 INFO:tasks.workunit.client.0.smithi064.stdout:5/444: dread - d0/d14/d20/f60 zero size 2023-12-16T03:16:04.711 INFO:tasks.workunit.client.1.smithi184.stdout:2/708: dwrite d3/d29/d2f/d46/d77/f80 [0,4194304] 0 2023-12-16T03:16:04.713 INFO:tasks.workunit.client.0.smithi064.stdout:4/522: dwrite d0/d42/d66/d33/f80 [0,4194304] 0 2023-12-16T03:16:04.714 INFO:tasks.workunit.client.1.smithi184.stdout:4/774: write d1/d29/d34/f3d [3065139,11385] 0 2023-12-16T03:16:04.714 INFO:tasks.workunit.client.0.smithi064.stdout:3/545: rename db/d12/d1a/d2c/d34/d4c/f8c to db/d12/d1a/d2c/d34/d4c/d6a/da7/fb7 0 2023-12-16T03:16:04.714 INFO:tasks.workunit.client.0.smithi064.stdout:3/546: write db/d12/d1a/f7d [715879,71446] 0 2023-12-16T03:16:04.714 INFO:tasks.workunit.client.0.smithi064.stdout:1/451: dread d3/f26 [0,4194304] 0 2023-12-16T03:16:04.715 INFO:tasks.workunit.client.0.smithi064.stdout:7/478: dwrite d7/d3e/d42/d48/d51/f60 [0,4194304] 0 2023-12-16T03:16:04.715 INFO:tasks.workunit.client.0.smithi064.stdout:1/452: readlink d3/d36/d44/d4d/l82 0 2023-12-16T03:16:04.718 INFO:tasks.workunit.client.1.smithi184.stdout:7/720: dwrite d0/d3/d2e/d79/dd/f1d [4194304,4194304] 0 2023-12-16T03:16:04.719 INFO:tasks.workunit.client.1.smithi184.stdout:7/721: stat d0/l7a 0 2023-12-16T03:16:04.719 INFO:tasks.workunit.client.1.smithi184.stdout:7/722: truncate d0/d3/d2e/d79/d36/d3f/f6d 1606928 0 2023-12-16T03:16:04.719 INFO:tasks.workunit.client.1.smithi184.stdout:6/892: mkdir d0/d36/d121 0 2023-12-16T03:16:04.719 INFO:tasks.workunit.client.1.smithi184.stdout:6/893: write d0/d5/d12/d1b/d33/f7e [958179,70232] 0 2023-12-16T03:16:04.719 INFO:tasks.workunit.client.1.smithi184.stdout:6/894: write d0/d5/f4a [1916544,35744] 0 2023-12-16T03:16:04.720 INFO:tasks.workunit.client.0.smithi064.stdout:1/453: write d3/dd/d23/d41/f85 [846729,127880] 0 2023-12-16T03:16:04.720 INFO:tasks.workunit.client.0.smithi064.stdout:1/454: fsync d3/d22/d57/f5d 0 2023-12-16T03:16:04.721 INFO:tasks.workunit.client.0.smithi064.stdout:1/455: stat d3/dd/d11/f17 0 2023-12-16T03:16:04.722 INFO:tasks.workunit.client.0.smithi064.stdout:7/479: write d7/d3e/d42/d89/d20/f28 [2629685,103757] 0 2023-12-16T03:16:04.722 INFO:tasks.workunit.client.0.smithi064.stdout:7/480: write d7/d3e/d42/d89/d20/d37/f69 [448980,12559] 0 2023-12-16T03:16:04.722 INFO:tasks.workunit.client.0.smithi064.stdout:5/445: rename d0/d7/fa to d0/d19/d48/d92/f9e 0 2023-12-16T03:16:04.722 INFO:tasks.workunit.client.0.smithi064.stdout:5/446: fdatasync d0/d14/d20/d37/d70/d71/d5a/f8d 0 2023-12-16T03:16:04.722 INFO:tasks.workunit.client.0.smithi064.stdout:5/447: dread - d0/d7/d34/f7b zero size 2023-12-16T03:16:04.722 INFO:tasks.workunit.client.1.smithi184.stdout:0/825: creat dc/d10/d2d/d5f/f11c x:0 0 0 2023-12-16T03:16:04.723 INFO:tasks.workunit.client.1.smithi184.stdout:5/619: mknod d1/dbb/cc9 0 2023-12-16T03:16:04.723 INFO:tasks.workunit.client.1.smithi184.stdout:5/620: readlink d1/d3/d9/de/d15/d19/d48/lb3 0 2023-12-16T03:16:04.723 INFO:tasks.workunit.client.1.smithi184.stdout:5/621: fdatasync d1/d3/d2f/f3d 0 2023-12-16T03:16:04.723 INFO:tasks.workunit.client.0.smithi064.stdout:3/547: getdents db/d12/d1a/d2c/d34 0 2023-12-16T03:16:04.724 INFO:tasks.workunit.client.0.smithi064.stdout:1/456: write d3/dd/d23/d60/f8b [3568875,93535] 0 2023-12-16T03:16:04.724 INFO:tasks.workunit.client.0.smithi064.stdout:1/457: truncate d3/dd/d11/f17 4881450 0 2023-12-16T03:16:04.725 INFO:tasks.workunit.client.1.smithi184.stdout:0/826: dread dc/d22/d45/d66/f84 [0,4194304] 0 2023-12-16T03:16:04.726 INFO:tasks.workunit.client.1.smithi184.stdout:0/827: chown dc/d22 236303497 1 2023-12-16T03:16:04.726 INFO:tasks.workunit.client.1.smithi184.stdout:3/927: dwrite d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/f116 [0,4194304] 0 2023-12-16T03:16:04.728 INFO:tasks.workunit.client.0.smithi064.stdout:4/523: rename d0/c34 to d0/d42/ca8 0 2023-12-16T03:16:04.728 INFO:tasks.workunit.client.0.smithi064.stdout:4/524: readlink d0/d1e/l1f 0 2023-12-16T03:16:04.729 INFO:tasks.workunit.client.1.smithi184.stdout:2/709: symlink d3/d29/d2f/lea 0 2023-12-16T03:16:04.729 INFO:tasks.workunit.client.1.smithi184.stdout:2/710: stat d3/d13/d28 0 2023-12-16T03:16:04.730 INFO:tasks.workunit.client.1.smithi184.stdout:4/775: rename d1/d29/d34/d5c/l88 to d1/d12/db3/l108 0 2023-12-16T03:16:04.733 INFO:tasks.workunit.client.0.smithi064.stdout:7/481: rmdir d7/d3e/d42/d89 39 2023-12-16T03:16:04.735 INFO:tasks.workunit.client.0.smithi064.stdout:4/525: truncate d0/d12/f79 2758191 0 2023-12-16T03:16:04.736 INFO:tasks.workunit.client.1.smithi184.stdout:7/723: truncate d0/d3/f11 1541925 0 2023-12-16T03:16:04.736 INFO:tasks.workunit.client.1.smithi184.stdout:7/724: truncate d0/d3/d2e/d79/dd/d75/fb3 1715873 0 2023-12-16T03:16:04.737 INFO:tasks.workunit.client.0.smithi064.stdout:5/448: rename d0/d14/d4e/f96 to d0/d14/d20/d37/d3c/f9f 0 2023-12-16T03:16:04.738 INFO:tasks.workunit.client.0.smithi064.stdout:1/458: dread d3/d36/d44/d4d/d58/f6e [0,4194304] 0 2023-12-16T03:16:04.739 INFO:tasks.workunit.client.0.smithi064.stdout:3/548: rmdir db/d12/d1a/d2c/d34/d4c/d6a/da7 39 2023-12-16T03:16:04.739 INFO:tasks.workunit.client.0.smithi064.stdout:3/549: chown db/d12/d21 310 1 2023-12-16T03:16:04.739 INFO:tasks.workunit.client.0.smithi064.stdout:7/482: write d7/d3e/d42/d89/f6e [565348,92082] 0 2023-12-16T03:16:04.740 INFO:tasks.workunit.client.0.smithi064.stdout:6/421: dwrite d3/d8/d13/d46/f70 [0,4194304] 0 2023-12-16T03:16:04.741 INFO:tasks.workunit.client.1.smithi184.stdout:1/754: dwrite d3/d34/dbc/f44 [0,4194304] 0 2023-12-16T03:16:04.741 INFO:tasks.workunit.client.1.smithi184.stdout:1/755: dread - d3/d34/dbc/d3c/d41/d63/fd8 zero size 2023-12-16T03:16:04.742 INFO:tasks.workunit.client.0.smithi064.stdout:7/483: write d7/d3e/d42/d89/d20/f3a [4035860,19954] 0 2023-12-16T03:16:04.742 INFO:tasks.workunit.client.0.smithi064.stdout:7/484: dread - d7/d3e/d42/d89/f76 zero size 2023-12-16T03:16:04.742 INFO:tasks.workunit.client.0.smithi064.stdout:4/526: truncate d0/f2e 31660 0 2023-12-16T03:16:04.742 INFO:tasks.workunit.client.0.smithi064.stdout:4/527: readlink d0/d42/d4c/l86 0 2023-12-16T03:16:04.745 INFO:tasks.workunit.client.0.smithi064.stdout:5/449: unlink d0/f5f 0 2023-12-16T03:16:04.746 INFO:tasks.workunit.client.0.smithi064.stdout:3/550: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/fa1 [0,4194304] 0 2023-12-16T03:16:04.748 INFO:tasks.workunit.client.1.smithi184.stdout:6/895: mkdir d0/d5/d12/d1b/d33/d111/d122 0 2023-12-16T03:16:04.748 INFO:tasks.workunit.client.1.smithi184.stdout:6/896: truncate d0/d5/d22/d37/d4d/fdb 354793 0 2023-12-16T03:16:04.749 INFO:tasks.workunit.client.0.smithi064.stdout:1/459: symlink d3/dd/d11/l93 0 2023-12-16T03:16:04.749 INFO:tasks.workunit.client.0.smithi064.stdout:1/460: stat d3/d36/d44/d4d/f92 0 2023-12-16T03:16:04.750 INFO:tasks.workunit.client.0.smithi064.stdout:1/461: fsync d3/dd/f1a 0 2023-12-16T03:16:04.750 INFO:tasks.workunit.client.0.smithi064.stdout:6/422: dread d3/d8/da/f43 [0,4194304] 0 2023-12-16T03:16:04.750 INFO:tasks.workunit.client.0.smithi064.stdout:6/423: fsync d3/d8/da/fe 0 2023-12-16T03:16:04.751 INFO:tasks.workunit.client.1.smithi184.stdout:5/622: creat d1/dbb/fca x:0 0 0 2023-12-16T03:16:04.751 INFO:tasks.workunit.client.0.smithi064.stdout:7/485: write d7/d26/d30/f33 [3834298,106458] 0 2023-12-16T03:16:04.753 INFO:tasks.workunit.client.0.smithi064.stdout:3/551: dread db/d12/d4e/fa5 [0,4194304] 0 2023-12-16T03:16:04.753 INFO:tasks.workunit.client.0.smithi064.stdout:3/552: fsync db/f19 0 2023-12-16T03:16:04.758 INFO:tasks.workunit.client.1.smithi184.stdout:3/928: mknod d12/d18/d1f/d23/d2a/d4a/d12b/c156 0 2023-12-16T03:16:04.760 INFO:tasks.workunit.client.1.smithi184.stdout:2/711: truncate d3/d13/f9a 3680635 0 2023-12-16T03:16:04.762 INFO:tasks.workunit.client.1.smithi184.stdout:4/776: symlink d1/d11/d5a/d63/l109 0 2023-12-16T03:16:04.762 INFO:tasks.workunit.client.1.smithi184.stdout:4/777: chown d1/d12/d13/d40/ccb 29072 1 2023-12-16T03:16:04.763 INFO:tasks.workunit.client.1.smithi184.stdout:4/778: write d1/d11/d5a/f60 [515881,126666] 0 2023-12-16T03:16:04.764 INFO:tasks.workunit.client.1.smithi184.stdout:7/725: mkdir d0/dd3 0 2023-12-16T03:16:04.765 INFO:tasks.workunit.client.1.smithi184.stdout:4/779: write d1/d12/d13/f31 [4092541,110287] 0 2023-12-16T03:16:04.769 INFO:tasks.workunit.client.0.smithi064.stdout:7/486: dwrite d7/d3e/d42/d48/f49 [0,4194304] 0 2023-12-16T03:16:04.770 INFO:tasks.workunit.client.0.smithi064.stdout:7/487: dread - d7/d3e/d42/d89/d20/d37/f86 zero size 2023-12-16T03:16:04.771 INFO:tasks.workunit.client.1.smithi184.stdout:1/756: mknod d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/c100 0 2023-12-16T03:16:04.782 INFO:tasks.workunit.client.0.smithi064.stdout:6/424: rename d3/d8/d1f/l3f to d3/d8/da/l79 0 2023-12-16T03:16:04.787 INFO:tasks.workunit.client.0.smithi064.stdout:3/553: symlink db/d12/d1a/d2c/d34/d4c/d6a/lb8 0 2023-12-16T03:16:04.787 INFO:tasks.workunit.client.0.smithi064.stdout:3/554: getdents db/d4f/daa 0 2023-12-16T03:16:04.787 INFO:tasks.workunit.client.0.smithi064.stdout:3/555: truncate db/d12/d1a/f1d 843085 0 2023-12-16T03:16:04.790 INFO:tasks.workunit.client.1.smithi184.stdout:6/897: creat d0/d5/d22/d25/d3f/d6f/da8/f123 x:0 0 0 2023-12-16T03:16:04.792 INFO:tasks.workunit.client.0.smithi064.stdout:7/488: mkdir d7/d3e/d42/d89/d20/d6f/d93 0 2023-12-16T03:16:04.792 INFO:tasks.workunit.client.0.smithi064.stdout:7/489: fdatasync d7/f14 0 2023-12-16T03:16:04.792 INFO:tasks.workunit.client.0.smithi064.stdout:7/490: write d7/d3e/d42/d89/d20/f80 [423055,96066] 0 2023-12-16T03:16:04.793 INFO:tasks.workunit.client.0.smithi064.stdout:6/425: dread d3/fd [0,4194304] 0 2023-12-16T03:16:04.794 INFO:tasks.workunit.client.1.smithi184.stdout:5/623: rename d1/d3/d9/d2e/l8e to d1/d2a/lcb 0 2023-12-16T03:16:04.794 INFO:tasks.workunit.client.1.smithi184.stdout:5/624: chown d1/d3/d9/de/d15/d19/d5f/d45/l9e 3331697 1 2023-12-16T03:16:04.794 INFO:tasks.workunit.client.1.smithi184.stdout:5/625: readlink d1/d3/d9/d49/d74/l9a 0 2023-12-16T03:16:04.796 INFO:tasks.workunit.client.0.smithi064.stdout:1/462: mknod d3/c94 0 2023-12-16T03:16:04.799 INFO:tasks.workunit.client.0.smithi064.stdout:7/491: creat d7/d3e/d42/d48/d51/d7c/f94 x:0 0 0 2023-12-16T03:16:04.800 INFO:tasks.workunit.client.0.smithi064.stdout:3/556: dread db/d12/d1a/f28 [0,4194304] 0 2023-12-16T03:16:04.801 INFO:tasks.workunit.client.0.smithi064.stdout:1/463: rmdir d3/dd/d11/d3b 39 2023-12-16T03:16:04.804 INFO:tasks.workunit.client.0.smithi064.stdout:7/492: mkdir d7/d26/d95 0 2023-12-16T03:16:04.804 INFO:tasks.workunit.client.0.smithi064.stdout:7/493: write d7/d3e/d42/d89/f6e [587765,4963] 0 2023-12-16T03:16:04.805 INFO:tasks.workunit.client.0.smithi064.stdout:3/557: stat db/d12/d1a/c1f 0 2023-12-16T03:16:04.806 INFO:tasks.workunit.client.0.smithi064.stdout:6/426: dwrite d3/f61 [0,4194304] 0 2023-12-16T03:16:04.807 INFO:tasks.workunit.client.0.smithi064.stdout:1/464: mknod d3/dd/d23/d86/c95 0 2023-12-16T03:16:04.810 INFO:tasks.workunit.client.1.smithi184.stdout:7/726: creat d0/d3/d2e/d79/d32/fd4 x:0 0 0 2023-12-16T03:16:04.810 INFO:tasks.workunit.client.1.smithi184.stdout:1/757: mknod d3/d34/dbc/d3c/d24/c101 0 2023-12-16T03:16:04.810 INFO:tasks.workunit.client.1.smithi184.stdout:6/898: creat d0/d5/d22/d37/d4d/d87/f124 x:0 0 0 2023-12-16T03:16:04.810 INFO:tasks.workunit.client.0.smithi064.stdout:7/494: mknod d7/d3e/d42/d43/c96 0 2023-12-16T03:16:04.813 INFO:tasks.workunit.client.1.smithi184.stdout:3/929: rename d12/d86/de4/d99/d117/fbe to d12/d86/f157 0 2023-12-16T03:16:04.813 INFO:tasks.workunit.client.1.smithi184.stdout:3/930: dread - d12/d18/d1f/d23/d2a/f144 zero size 2023-12-16T03:16:04.813 INFO:tasks.workunit.client.0.smithi064.stdout:3/558: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/f99 [0,4194304] 0 2023-12-16T03:16:04.813 INFO:tasks.workunit.client.0.smithi064.stdout:3/559: truncate db/d12/d21/f69 12799 0 2023-12-16T03:16:04.816 INFO:tasks.workunit.client.0.smithi064.stdout:2/399: sync 2023-12-16T03:16:04.817 INFO:tasks.workunit.client.0.smithi064.stdout:0/452: sync 2023-12-16T03:16:04.817 INFO:tasks.workunit.client.0.smithi064.stdout:9/436: sync 2023-12-16T03:16:04.817 INFO:tasks.workunit.client.0.smithi064.stdout:9/437: write d2/dc/f26 [351477,107321] 0 2023-12-16T03:16:04.817 INFO:tasks.workunit.client.0.smithi064.stdout:8/536: sync 2023-12-16T03:16:04.819 INFO:tasks.workunit.client.1.smithi184.stdout:1/758: dread d3/d34/dbc/d3c/d41/f8a [0,4194304] 0 2023-12-16T03:16:04.821 INFO:tasks.workunit.client.0.smithi064.stdout:1/465: mkdir d3/d36/d44/d4d/d58/d96 0 2023-12-16T03:16:04.821 INFO:tasks.workunit.client.0.smithi064.stdout:1/466: stat d3/dd/d11/d3b/c66 0 2023-12-16T03:16:04.823 INFO:tasks.workunit.client.0.smithi064.stdout:7/495: symlink d7/d3e/d42/d89/d20/d37/l97 0 2023-12-16T03:16:04.824 INFO:tasks.workunit.client.1.smithi184.stdout:7/727: truncate d0/d6b/fae 3488074 0 2023-12-16T03:16:04.824 INFO:tasks.workunit.client.1.smithi184.stdout:7/728: dread - d0/d3/d2e/d79/d34/fb1 zero size 2023-12-16T03:16:04.824 INFO:tasks.workunit.client.0.smithi064.stdout:9/438: write d2/dc/d24/f63 [2509770,122582] 0 2023-12-16T03:16:04.826 INFO:tasks.workunit.client.0.smithi064.stdout:3/560: rename db/d12/d4e/f8d to db/d12/d1a/fb9 0 2023-12-16T03:16:04.827 INFO:tasks.workunit.client.1.smithi184.stdout:6/899: creat d0/d5/d22/d25/d3f/d6f/da8/f125 x:0 0 0 2023-12-16T03:16:04.828 INFO:tasks.workunit.client.0.smithi064.stdout:2/400: rmdir d1/d76/d7b 0 2023-12-16T03:16:04.831 INFO:tasks.workunit.client.0.smithi064.stdout:9/439: dread d2/dc/d24/d39/d42/f6e [0,4194304] 0 2023-12-16T03:16:04.831 INFO:tasks.workunit.client.0.smithi064.stdout:6/427: dwrite d3/d8/f5f [0,4194304] 0 2023-12-16T03:16:04.832 INFO:tasks.workunit.client.0.smithi064.stdout:6/428: fdatasync d3/d8/d13/d58/d65/f75 0 2023-12-16T03:16:04.832 INFO:tasks.workunit.client.0.smithi064.stdout:6/429: readlink d3/d8/l69 0 2023-12-16T03:16:04.832 INFO:tasks.workunit.client.0.smithi064.stdout:6/430: read d3/d8/da/fe [1765429,47271] 0 2023-12-16T03:16:04.832 INFO:tasks.workunit.client.0.smithi064.stdout:0/453: symlink d2/d7/l91 0 2023-12-16T03:16:04.833 INFO:tasks.workunit.client.0.smithi064.stdout:0/454: stat d2/d8/da 0 2023-12-16T03:16:04.833 INFO:tasks.workunit.client.0.smithi064.stdout:6/431: read d3/d8/d13/f24 [19677,36150] 0 2023-12-16T03:16:04.833 INFO:tasks.workunit.client.0.smithi064.stdout:7/496: dread d7/f14 [0,4194304] 0 2023-12-16T03:16:04.834 INFO:tasks.workunit.client.1.smithi184.stdout:4/780: rename d1/l1a to d1/d29/d34/d5c/d76/d3b/l10a 0 2023-12-16T03:16:04.834 INFO:tasks.workunit.client.1.smithi184.stdout:4/781: read - d1/d29/d34/d5c/d76/d42/d90/ffb zero size 2023-12-16T03:16:04.834 INFO:tasks.workunit.client.1.smithi184.stdout:3/931: creat d12/d18/d68/f158 x:0 0 0 2023-12-16T03:16:04.835 INFO:tasks.workunit.client.1.smithi184.stdout:4/782: read d1/d12/d13/d40/f4d [2356456,86243] 0 2023-12-16T03:16:04.835 INFO:tasks.workunit.client.1.smithi184.stdout:4/783: write d1/d12/db3/fe5 [482383,125157] 0 2023-12-16T03:16:04.835 INFO:tasks.workunit.client.0.smithi064.stdout:8/537: symlink d0/d1d/d24/d2f/d50/d70/lba 0 2023-12-16T03:16:04.836 INFO:tasks.workunit.client.0.smithi064.stdout:8/538: readlink d0/l9 0 2023-12-16T03:16:04.838 INFO:tasks.workunit.client.1.smithi184.stdout:5/626: unlink d1/d2a/d31/d28/d72/l87 0 2023-12-16T03:16:04.838 INFO:tasks.workunit.client.1.smithi184.stdout:5/627: dread - d1/d3/d9/de/d30/f8b zero size 2023-12-16T03:16:04.839 INFO:tasks.workunit.client.1.smithi184.stdout:1/759: symlink d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/l102 0 2023-12-16T03:16:04.840 INFO:tasks.workunit.client.1.smithi184.stdout:7/729: dwrite d0/d3/d2e/d79/d1e/faf [0,4194304] 0 2023-12-16T03:16:04.841 INFO:tasks.workunit.client.1.smithi184.stdout:8/848: sync 2023-12-16T03:16:04.841 INFO:tasks.workunit.client.0.smithi064.stdout:1/467: mkdir d3/d36/d97 0 2023-12-16T03:16:04.842 INFO:tasks.workunit.client.1.smithi184.stdout:8/849: write d2/d4/d10/d11/d72/dc2/fcf [3774387,118448] 0 2023-12-16T03:16:04.843 INFO:tasks.workunit.client.1.smithi184.stdout:6/900: symlink d0/d5/d22/d25/d47/l126 0 2023-12-16T03:16:04.845 INFO:tasks.workunit.client.1.smithi184.stdout:4/784: getdents d1/d29/d37 0 2023-12-16T03:16:04.847 INFO:tasks.workunit.client.1.smithi184.stdout:5/628: rmdir d1/d3/d2f 39 2023-12-16T03:16:04.853 INFO:tasks.workunit.client.0.smithi064.stdout:3/561: rename db/c85 to db/d12/d1a/d31/cba 0 2023-12-16T03:16:04.855 INFO:tasks.workunit.client.1.smithi184.stdout:7/730: link d0/f89 d0/d3/d2e/d79/d34/fd5 0 2023-12-16T03:16:04.856 INFO:tasks.workunit.client.0.smithi064.stdout:9/440: mkdir d2/d2d/d6b/d8b 0 2023-12-16T03:16:04.859 INFO:tasks.workunit.client.1.smithi184.stdout:8/850: mkdir d2/d37/d117 0 2023-12-16T03:16:04.859 INFO:tasks.workunit.client.1.smithi184.stdout:8/851: chown d2/d6a/fef 50 1 2023-12-16T03:16:04.859 INFO:tasks.workunit.client.1.smithi184.stdout:8/852: dread - d2/d6a/da4/f86 zero size 2023-12-16T03:16:04.860 INFO:tasks.workunit.client.1.smithi184.stdout:6/901: mknod d0/d36/d8a/c127 0 2023-12-16T03:16:04.861 INFO:tasks.workunit.client.0.smithi064.stdout:9/441: read d2/dc/d24/d39/d42/f51 [2882706,113189] 0 2023-12-16T03:16:04.861 INFO:tasks.workunit.client.0.smithi064.stdout:9/442: dread - d2/dc/d24/d39/d5e/d6f/f7a zero size 2023-12-16T03:16:04.862 INFO:tasks.workunit.client.1.smithi184.stdout:4/785: creat d1/d11/d5a/d63/f10b x:0 0 0 2023-12-16T03:16:04.864 INFO:tasks.workunit.client.0.smithi064.stdout:0/455: rmdir d2/d5b/d8b/d8e 0 2023-12-16T03:16:04.865 INFO:tasks.workunit.client.1.smithi184.stdout:1/760: dwrite d3/d34/dbc/d3c/d41/d63/f64 [0,4194304] 0 2023-12-16T03:16:04.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/629: mkdir d1/d3/d9/de/d15/d19/dcc 0 2023-12-16T03:16:04.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/630: chown d1/d3/d9/de/d15/cae 733130 1 2023-12-16T03:16:04.866 INFO:tasks.workunit.client.1.smithi184.stdout:3/932: dwrite d12/d37/d81/fd6 [0,4194304] 0 2023-12-16T03:16:04.867 INFO:tasks.workunit.client.0.smithi064.stdout:6/432: mkdir d3/d44/d7a 0 2023-12-16T03:16:04.868 INFO:tasks.workunit.client.1.smithi184.stdout:7/731: link d0/d3/d2e/d79/dd/fc6 d0/d6b/d69/fd6 0 2023-12-16T03:16:04.870 INFO:tasks.workunit.client.0.smithi064.stdout:7/497: creat d7/d3e/d42/d89/d74/f98 x:0 0 0 2023-12-16T03:16:04.871 INFO:tasks.workunit.client.1.smithi184.stdout:8/853: creat d2/d37/d7c/ddc/de6/f118 x:0 0 0 2023-12-16T03:16:04.871 INFO:tasks.workunit.client.1.smithi184.stdout:8/854: stat d2/d12/l7b 0 2023-12-16T03:16:04.872 INFO:tasks.workunit.client.0.smithi064.stdout:8/539: creat d0/d1d/d3c/d42/d93/fbb x:0 0 0 2023-12-16T03:16:04.873 INFO:tasks.workunit.client.1.smithi184.stdout:6/902: unlink d0/d5/d22/d25/d47/f64 0 2023-12-16T03:16:04.874 INFO:tasks.workunit.client.1.smithi184.stdout:6/903: write d0/d5/d26/f38 [2692412,47615] 0 2023-12-16T03:16:04.874 INFO:tasks.workunit.client.1.smithi184.stdout:6/904: truncate d0/d5/d22/d25/dbf/ff6 398144 0 2023-12-16T03:16:04.875 INFO:tasks.workunit.client.0.smithi064.stdout:1/468: creat d3/d36/d44/d4d/d58/d96/f98 x:0 0 0 2023-12-16T03:16:04.875 INFO:tasks.workunit.client.0.smithi064.stdout:1/469: readlink d3/dd/l47 0 2023-12-16T03:16:04.875 INFO:tasks.workunit.client.0.smithi064.stdout:1/470: chown d3/d22/d57/f5d 7608643 1 2023-12-16T03:16:04.875 INFO:tasks.workunit.client.0.smithi064.stdout:1/471: chown f2 32481 1 2023-12-16T03:16:04.876 INFO:tasks.workunit.client.1.smithi184.stdout:6/905: write d0/d5/d22/f49 [2059313,100796] 0 2023-12-16T03:16:04.876 INFO:tasks.workunit.client.1.smithi184.stdout:4/786: creat d1/d11/d5a/d63/d103/d45/dcf/dea/f10c x:0 0 0 2023-12-16T03:16:04.877 INFO:tasks.workunit.client.1.smithi184.stdout:7/732: dread d0/d3/d2e/d79/d1e/f20 [0,4194304] 0 2023-12-16T03:16:04.878 INFO:tasks.workunit.client.1.smithi184.stdout:1/761: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/dfd/f103 x:0 0 0 2023-12-16T03:16:04.879 INFO:tasks.workunit.client.1.smithi184.stdout:5/631: rename d1/d3/d9/de/d15/d19/d3a/l56 to d1/d3/d9/de/d30/d80/lcd 0 2023-12-16T03:16:04.880 INFO:tasks.workunit.client.0.smithi064.stdout:3/562: creat db/d12/d1a/d2c/d34/d4c/fbb x:0 0 0 2023-12-16T03:16:04.882 INFO:tasks.workunit.client.0.smithi064.stdout:2/401: rename d1/d15/d23/d2d/d7c to d1/d15/d7d 0 2023-12-16T03:16:04.884 INFO:tasks.workunit.client.1.smithi184.stdout:3/933: creat d12/d37/d81/f159 x:0 0 0 2023-12-16T03:16:04.885 INFO:tasks.workunit.client.0.smithi064.stdout:9/443: rmdir d2/dc/d24/d39/d77 39 2023-12-16T03:16:04.887 INFO:tasks.workunit.client.1.smithi184.stdout:8/855: mkdir d2/d4/d10/d11/d119 0 2023-12-16T03:16:04.888 INFO:tasks.workunit.client.0.smithi064.stdout:0/456: mkdir d2/d7/d10/d85/d88/d92 0 2023-12-16T03:16:04.890 INFO:tasks.workunit.client.0.smithi064.stdout:6/433: unlink d3/d8/l33 0 2023-12-16T03:16:04.892 INFO:tasks.workunit.client.1.smithi184.stdout:6/906: rmdir d0/d5/d12/d1b/d33/d3d/d96/dc5 0 2023-12-16T03:16:04.893 INFO:tasks.workunit.client.0.smithi064.stdout:7/498: unlink c2 0 2023-12-16T03:16:04.893 INFO:tasks.workunit.client.0.smithi064.stdout:7/499: chown d7/d3e/c7f 291 1 2023-12-16T03:16:04.897 INFO:tasks.workunit.client.1.smithi184.stdout:4/787: creat d1/d11/d1b/d1e/f10d x:0 0 0 2023-12-16T03:16:04.897 INFO:tasks.workunit.client.1.smithi184.stdout:4/788: write d1/d12/db3/db8/dd0/fe4 [576615,31489] 0 2023-12-16T03:16:04.897 INFO:tasks.workunit.client.1.smithi184.stdout:2/712: truncate d3/d13/f9a 2861782 0 2023-12-16T03:16:04.901 INFO:tasks.workunit.client.0.smithi064.stdout:1/472: creat d3/d36/d44/d4d/d58/d96/f99 x:0 0 0 2023-12-16T03:16:04.902 INFO:tasks.workunit.client.1.smithi184.stdout:7/733: rmdir d0/d3/d2e/d79/d32/d8a 39 2023-12-16T03:16:04.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/563: creat db/d4f/daa/fbc x:0 0 0 2023-12-16T03:16:04.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/564: readlink db/d12/d1a/d2c/d34/d4c/d6a/d93/lb0 0 2023-12-16T03:16:04.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/565: read - db/d12/d1a/d2c/d34/d4c/d6a/f94 zero size 2023-12-16T03:16:04.908 INFO:tasks.workunit.client.1.smithi184.stdout:1/762: symlink d3/d34/d39/def/l104 0 2023-12-16T03:16:04.908 INFO:tasks.workunit.client.0.smithi064.stdout:8/540: rmdir d0 39 2023-12-16T03:16:04.908 INFO:tasks.workunit.client.1.smithi184.stdout:1/763: write d3/d34/dbc/d3c/d41/f67 [561139,24247] 0 2023-12-16T03:16:04.909 INFO:tasks.workunit.client.1.smithi184.stdout:1/764: chown d3/d34/dbc/d3c/d41/f4d 36073706 1 2023-12-16T03:16:04.909 INFO:tasks.workunit.client.0.smithi064.stdout:2/402: rmdir d1/d15/d58 39 2023-12-16T03:16:04.909 INFO:tasks.workunit.client.0.smithi064.stdout:2/403: write d1/d27/f4f [971043,4892] 0 2023-12-16T03:16:04.911 INFO:tasks.workunit.client.1.smithi184.stdout:5/632: mknod d1/d3/d9/de/d15/d19/cce 0 2023-12-16T03:16:04.913 INFO:tasks.workunit.client.1.smithi184.stdout:3/934: symlink d12/l15a 0 2023-12-16T03:16:04.915 INFO:tasks.workunit.client.1.smithi184.stdout:8/856: mknod d2/d12/d21/d2d/d31/d34/d96/dca/d10d/c11a 0 2023-12-16T03:16:04.916 INFO:tasks.workunit.client.0.smithi064.stdout:0/457: mknod d2/d7/d10/d21/d7a/c93 0 2023-12-16T03:16:04.917 INFO:tasks.workunit.client.1.smithi184.stdout:6/907: symlink d0/d5/d12/d1b/d33/d3d/da2/dff/l128 0 2023-12-16T03:16:04.918 INFO:tasks.workunit.client.0.smithi064.stdout:9/444: link d2/dc/f32 d2/d2d/f8c 0 2023-12-16T03:16:04.919 INFO:tasks.workunit.client.0.smithi064.stdout:6/434: creat d3/d8/d13/f7b x:0 0 0 2023-12-16T03:16:04.923 INFO:tasks.workunit.client.0.smithi064.stdout:8/541: dwrite d0/db/d12/d1c/f72 [0,4194304] 0 2023-12-16T03:16:04.924 INFO:tasks.workunit.client.0.smithi064.stdout:7/500: creat d7/d3e/d42/d48/d51/d7c/d52/f99 x:0 0 0 2023-12-16T03:16:04.925 INFO:tasks.workunit.client.1.smithi184.stdout:4/789: link d1/d29/f2e d1/d11/d5a/d63/d103/d45/f10e 0 2023-12-16T03:16:04.926 INFO:tasks.workunit.client.0.smithi064.stdout:1/473: creat d3/dd/d23/d4f/f9a x:0 0 0 2023-12-16T03:16:04.926 INFO:tasks.workunit.client.0.smithi064.stdout:1/474: truncate d3/dd/d23/f7c 669385 0 2023-12-16T03:16:04.929 INFO:tasks.workunit.client.0.smithi064.stdout:3/566: mkdir db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/da4/dbd 0 2023-12-16T03:16:04.929 INFO:tasks.workunit.client.0.smithi064.stdout:3/567: chown db/d12/d4e/f73 395241756 1 2023-12-16T03:16:04.929 INFO:tasks.workunit.client.0.smithi064.stdout:3/568: write db/d4f/daa/fbc [441753,59533] 0 2023-12-16T03:16:04.930 INFO:tasks.workunit.client.1.smithi184.stdout:0/828: sync 2023-12-16T03:16:04.930 INFO:tasks.workunit.client.1.smithi184.stdout:0/829: stat dc/d22/d1d 0 2023-12-16T03:16:04.930 INFO:tasks.workunit.client.1.smithi184.stdout:0/830: truncate dc/d22/d45/d66/d80/fd3 1020447 0 2023-12-16T03:16:04.930 INFO:tasks.workunit.client.1.smithi184.stdout:0/831: getdents dc/d22/d1d/d43/d5a/df3 0 2023-12-16T03:16:04.930 INFO:tasks.workunit.client.1.smithi184.stdout:0/832: dread - dc/d22/d1d/d8e/f8f zero size 2023-12-16T03:16:04.931 INFO:tasks.workunit.client.0.smithi064.stdout:9/445: chown d2/d2d/d36/c41 3242 1 2023-12-16T03:16:04.932 INFO:tasks.workunit.client.0.smithi064.stdout:0/458: dwrite f1 [4194304,4194304] 0 2023-12-16T03:16:04.932 INFO:tasks.workunit.client.0.smithi064.stdout:0/459: readlink d2/d8/da/df/l3b 0 2023-12-16T03:16:04.933 INFO:tasks.workunit.client.0.smithi064.stdout:6/435: mkdir d3/d8/d1f/d26/d47/d7c 0 2023-12-16T03:16:04.933 INFO:tasks.workunit.client.0.smithi064.stdout:6/436: chown d3/d8/d1f/d26/d47/d4a/d67/d73/c4f 3 1 2023-12-16T03:16:04.934 INFO:tasks.workunit.client.0.smithi064.stdout:8/542: mkdir d0/db/d12/d44/d68/d6d/dbc 0 2023-12-16T03:16:04.934 INFO:tasks.workunit.client.0.smithi064.stdout:3/569: read f4 [461202,26935] 0 2023-12-16T03:16:04.935 INFO:tasks.workunit.client.1.smithi184.stdout:7/734: getdents d0/d3/d4 0 2023-12-16T03:16:04.938 INFO:tasks.workunit.client.0.smithi064.stdout:7/501: rename d7/d3e/d42/d48/l8f to d7/d3e/d42/d43/l9a 0 2023-12-16T03:16:04.938 INFO:tasks.workunit.client.0.smithi064.stdout:7/502: read - d7/d26/f79 zero size 2023-12-16T03:16:04.938 INFO:tasks.workunit.client.0.smithi064.stdout:1/475: mknod d3/dd/d23/d60/c9b 0 2023-12-16T03:16:04.940 INFO:tasks.workunit.client.1.smithi184.stdout:1/765: rmdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/d99/db7 39 2023-12-16T03:16:04.940 INFO:tasks.workunit.client.1.smithi184.stdout:1/766: chown d3/d13/d2c/cab 37 1 2023-12-16T03:16:04.941 INFO:tasks.workunit.client.1.smithi184.stdout:1/767: read d3/d13/f1f [3578521,84867] 0 2023-12-16T03:16:04.941 INFO:tasks.workunit.client.0.smithi064.stdout:9/446: getdents d2/dc/d24/d39/d5e 0 2023-12-16T03:16:04.943 INFO:tasks.workunit.client.1.smithi184.stdout:5/633: rename d1/d2a/d31/fc3 to d1/d3/d9/de/d15/d90/fcf 0 2023-12-16T03:16:04.944 INFO:tasks.workunit.client.0.smithi064.stdout:6/437: dread d3/d8/f5f [0,4194304] 0 2023-12-16T03:16:04.944 INFO:tasks.workunit.client.0.smithi064.stdout:6/438: dread - d3/d8/d13/f7b zero size 2023-12-16T03:16:04.944 INFO:tasks.workunit.client.0.smithi064.stdout:8/543: symlink d0/db/d12/lbd 0 2023-12-16T03:16:04.946 INFO:tasks.workunit.client.1.smithi184.stdout:3/935: mkdir d12/d1e/de8/d15b 0 2023-12-16T03:16:04.947 INFO:tasks.workunit.client.0.smithi064.stdout:7/503: symlink d7/d3e/d42/d89/d74/d82/l9b 0 2023-12-16T03:16:04.951 INFO:tasks.workunit.client.1.smithi184.stdout:4/790: creat d1/d11/d5a/f10f x:0 0 0 2023-12-16T03:16:04.953 INFO:tasks.workunit.client.0.smithi064.stdout:9/447: creat d2/d7e/f8d x:0 0 0 2023-12-16T03:16:04.954 INFO:tasks.workunit.client.1.smithi184.stdout:1/768: mknod d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/c105 0 2023-12-16T03:16:04.955 INFO:tasks.workunit.client.0.smithi064.stdout:6/439: rename d3/d8/d13/f1b to d3/f7d 0 2023-12-16T03:16:04.958 INFO:tasks.workunit.client.1.smithi184.stdout:8/857: rename d2/d12/d21/d8a/dda/d73/c91 to d2/d4/d10/d7a/d83/c11b 0 2023-12-16T03:16:04.958 INFO:tasks.workunit.client.1.smithi184.stdout:8/858: readlink d2/d12/d21/d8a/dda/d73/lfa 0 2023-12-16T03:16:04.959 INFO:tasks.workunit.client.0.smithi064.stdout:8/544: link d0/db/d12/d1c/d59/d77/fb3 d0/db/d12/d44/d68/fbe 0 2023-12-16T03:16:04.959 INFO:tasks.workunit.client.0.smithi064.stdout:8/545: readlink d0/ld 0 2023-12-16T03:16:04.962 INFO:tasks.workunit.client.1.smithi184.stdout:3/936: creat d12/d37/f15c x:0 0 0 2023-12-16T03:16:04.962 INFO:tasks.workunit.client.0.smithi064.stdout:7/504: truncate d7/d3e/d42/d89/d20/f28 8037489 0 2023-12-16T03:16:04.963 INFO:tasks.workunit.client.1.smithi184.stdout:4/791: mknod d1/d29/d34/d5c/d76/d42/d90/c110 0 2023-12-16T03:16:04.964 INFO:tasks.workunit.client.0.smithi064.stdout:0/460: dwrite d2/f16 [0,4194304] 0 2023-12-16T03:16:04.965 INFO:tasks.workunit.client.0.smithi064.stdout:1/476: link f2 d3/f9c 0 2023-12-16T03:16:04.966 INFO:tasks.workunit.client.1.smithi184.stdout:1/769: symlink d3/d34/dbc/d3c/d41/d46/d4a/de2/l106 0 2023-12-16T03:16:04.968 INFO:tasks.workunit.client.0.smithi064.stdout:9/448: creat d2/dc/d24/d39/d42/d57/f8e x:0 0 0 2023-12-16T03:16:04.968 INFO:tasks.workunit.client.0.smithi064.stdout:9/449: chown d2/d2d/l47 3467 1 2023-12-16T03:16:04.968 INFO:tasks.workunit.client.1.smithi184.stdout:3/937: dread d12/d18/d1f/d23/d2a/d42/d52/d76/d80/fde [0,4194304] 0 2023-12-16T03:16:04.969 INFO:tasks.workunit.client.0.smithi064.stdout:3/570: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/f24 [0,4194304] 0 2023-12-16T03:16:04.969 INFO:tasks.workunit.client.1.smithi184.stdout:6/908: rename d0/d5/d22/d37/d4d/d87/f124 to d0/d5/d22/d25/dbf/d11b/f129 0 2023-12-16T03:16:04.971 INFO:tasks.workunit.client.0.smithi064.stdout:8/546: rename d0/db/d4c to d0/db/d37/dbf 0 2023-12-16T03:16:04.973 INFO:tasks.workunit.client.1.smithi184.stdout:8/859: mkdir d2/d12/d21/d2d/d31/d34/d96/dca/d10d/d11c 0 2023-12-16T03:16:04.973 INFO:tasks.workunit.client.1.smithi184.stdout:8/860: write d2/d12/d21/d8a/dda/d73/fb3 [428435,65356] 0 2023-12-16T03:16:04.973 INFO:tasks.workunit.client.0.smithi064.stdout:7/505: creat d7/d3e/d42/f9c x:0 0 0 2023-12-16T03:16:04.975 INFO:tasks.workunit.client.1.smithi184.stdout:4/792: symlink d1/d12/db3/l111 0 2023-12-16T03:16:04.975 INFO:tasks.workunit.client.1.smithi184.stdout:4/793: truncate d1/d29/d34/d5c/d76/f8f 869187 0 2023-12-16T03:16:04.975 INFO:tasks.workunit.client.1.smithi184.stdout:4/794: chown d1/d11/d5a/d63/d103/d5e/lec 341 1 2023-12-16T03:16:04.976 INFO:tasks.workunit.client.0.smithi064.stdout:9/450: creat d2/dc/d24/d39/d5e/f8f x:0 0 0 2023-12-16T03:16:04.977 INFO:tasks.workunit.client.0.smithi064.stdout:9/451: write d2/d2d/d3b/d3c/d4b/f58 [446708,65742] 0 2023-12-16T03:16:04.977 INFO:tasks.workunit.client.0.smithi064.stdout:9/452: fdatasync d2/d2d/d3b/d3c/d4b/f4c 0 2023-12-16T03:16:04.977 INFO:tasks.workunit.client.0.smithi064.stdout:6/440: dwrite d3/d44/f71 [0,4194304] 0 2023-12-16T03:16:04.978 INFO:tasks.workunit.client.1.smithi184.stdout:1/770: mkdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/dee/d107 0 2023-12-16T03:16:04.984 INFO:tasks.workunit.client.0.smithi064.stdout:3/571: mknod db/d12/d4e/da3/cbe 0 2023-12-16T03:16:04.984 INFO:tasks.workunit.client.0.smithi064.stdout:3/572: fsync db/d12/d21/f61 0 2023-12-16T03:16:04.986 INFO:tasks.workunit.client.1.smithi184.stdout:6/909: mkdir d0/d5/d22/d25/d47/d12a 0 2023-12-16T03:16:04.986 INFO:tasks.workunit.client.1.smithi184.stdout:0/833: rename dc/d22/d1d/d2c/d75/l105 to dc/d10/da7/dc0/l11d 0 2023-12-16T03:16:04.986 INFO:tasks.workunit.client.1.smithi184.stdout:6/910: truncate d0/d5/d22/d25/dbf/dbe/de1/f107 5201507 0 2023-12-16T03:16:04.986 INFO:tasks.workunit.client.1.smithi184.stdout:6/911: dread - d0/d36/d8a/fde zero size 2023-12-16T03:16:04.986 INFO:tasks.workunit.client.1.smithi184.stdout:6/912: fsync d0/d36/d8a/fce 0 2023-12-16T03:16:04.987 INFO:tasks.workunit.client.0.smithi064.stdout:0/461: rename d2/d7/d10/d21/l6d to d2/d7/d10/d21/d31/l94 0 2023-12-16T03:16:04.987 INFO:tasks.workunit.client.0.smithi064.stdout:0/462: read - d2/d29/f2c zero size 2023-12-16T03:16:04.989 INFO:tasks.workunit.client.1.smithi184.stdout:8/861: unlink d2/d12/d21/d8a/ld9 0 2023-12-16T03:16:04.989 INFO:tasks.workunit.client.1.smithi184.stdout:8/862: chown d2/d4/d10/d11/d72/c9d 28085796 1 2023-12-16T03:16:04.992 INFO:tasks.workunit.client.0.smithi064.stdout:8/547: mkdir d0/da/d3e/dc0 0 2023-12-16T03:16:04.992 INFO:tasks.workunit.client.0.smithi064.stdout:8/548: fdatasync d0/db/d12/f15 0 2023-12-16T03:16:04.992 INFO:tasks.workunit.client.0.smithi064.stdout:8/549: read - d0/fa3 zero size 2023-12-16T03:16:04.995 INFO:tasks.workunit.client.0.smithi064.stdout:7/506: mknod d7/d26/d95/c9d 0 2023-12-16T03:16:04.997 INFO:tasks.workunit.client.0.smithi064.stdout:9/453: mkdir d2/dc/d8a/d90 0 2023-12-16T03:16:04.998 INFO:tasks.workunit.client.0.smithi064.stdout:9/454: dread - d2/dc/d24/d39/d5e/f8f zero size 2023-12-16T03:16:05.001 INFO:tasks.workunit.client.0.smithi064.stdout:1/477: rename d3/dd/d23/d41/d8a to d3/dd/d23/d60/d9d 0 2023-12-16T03:16:05.001 INFO:tasks.workunit.client.0.smithi064.stdout:8/550: mknod d0/db/d37/d3a/cc1 0 2023-12-16T03:16:05.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/795: truncate d1/d12/f3e 7988323 0 2023-12-16T03:16:05.002 INFO:tasks.workunit.client.1.smithi184.stdout:7/735: rename d0/d6b/d69/ca3 to d0/d3/d2e/d79/d32/d39/d8f/cd7 0 2023-12-16T03:16:05.002 INFO:tasks.workunit.client.1.smithi184.stdout:8/863: symlink d2/l11d 0 2023-12-16T03:16:05.002 INFO:tasks.workunit.client.0.smithi064.stdout:0/463: dread d2/f5 [0,4194304] 0 2023-12-16T03:16:05.003 INFO:tasks.workunit.client.1.smithi184.stdout:0/834: rename dc/d22/d45/d66/d80/da3/lf5 to dc/d22/d53/ded/d11b/l11e 0 2023-12-16T03:16:05.003 INFO:tasks.workunit.client.0.smithi064.stdout:8/551: write d0/d1d/d24/d2f/f41 [5288464,70989] 0 2023-12-16T03:16:05.005 INFO:tasks.workunit.client.0.smithi064.stdout:9/455: unlink d2/d2d/d6c/f86 0 2023-12-16T03:16:05.007 INFO:tasks.workunit.client.0.smithi064.stdout:3/573: rename db/d12/d1a/d2c/d6e to db/d4f/da9/dbf 0 2023-12-16T03:16:05.007 INFO:tasks.workunit.client.1.smithi184.stdout:8/864: write d2/d4/d10/d7a/d83/d8b/fab [2176006,8618] 0 2023-12-16T03:16:05.007 INFO:tasks.workunit.client.1.smithi184.stdout:3/938: dwrite d12/d18/da1/dbd/dc8/fcd [4194304,4194304] 0 2023-12-16T03:16:05.007 INFO:tasks.workunit.client.1.smithi184.stdout:4/796: dread d1/d29/d34/d5c/d76/d3b/f53 [0,4194304] 0 2023-12-16T03:16:05.010 INFO:tasks.workunit.client.0.smithi064.stdout:0/464: mknod d2/d7/d10/d85/c95 0 2023-12-16T03:16:05.010 INFO:tasks.workunit.client.0.smithi064.stdout:0/465: read - d2/d29/d66/d67/f68 zero size 2023-12-16T03:16:05.010 INFO:tasks.workunit.client.0.smithi064.stdout:0/466: chown d2/d8/da/d11/c61 1453127 1 2023-12-16T03:16:05.012 INFO:tasks.workunit.client.0.smithi064.stdout:7/507: rename d7/d26/d95/c9d to d7/c9e 0 2023-12-16T03:16:05.014 INFO:tasks.workunit.client.1.smithi184.stdout:4/797: creat d1/d11/d5a/d63/d103/d45/dcf/de6/f112 x:0 0 0 2023-12-16T03:16:05.015 INFO:tasks.workunit.client.0.smithi064.stdout:7/508: symlink d7/d26/l9f 0 2023-12-16T03:16:05.017 INFO:tasks.workunit.client.0.smithi064.stdout:7/509: symlink d7/d3e/d42/d89/d20/la0 0 2023-12-16T03:16:05.018 INFO:tasks.workunit.client.1.smithi184.stdout:4/798: mknod d1/d29/d37/d102/c113 0 2023-12-16T03:16:05.018 INFO:tasks.workunit.client.0.smithi064.stdout:7/510: mkdir d7/d3e/d42/d48/d51/da1 0 2023-12-16T03:16:05.023 INFO:tasks.workunit.client.1.smithi184.stdout:1/771: dwrite d3/d34/dbc/f58 [0,4194304] 0 2023-12-16T03:16:05.023 INFO:tasks.workunit.client.1.smithi184.stdout:6/913: dwrite d0/fc6 [0,4194304] 0 2023-12-16T03:16:05.023 INFO:tasks.workunit.client.1.smithi184.stdout:6/914: dread - d0/d5/d22/d25/d47/f99 zero size 2023-12-16T03:16:05.023 INFO:tasks.workunit.client.1.smithi184.stdout:6/915: write d0/d36/d8a/fde [259516,35911] 0 2023-12-16T03:16:05.023 INFO:tasks.workunit.client.1.smithi184.stdout:6/916: chown d0/d5/f2c 1718 1 2023-12-16T03:16:05.023 INFO:tasks.workunit.client.0.smithi064.stdout:7/511: read d7/d3e/d42/d48/f49 [728270,117511] 0 2023-12-16T03:16:05.028 INFO:tasks.workunit.client.1.smithi184.stdout:4/799: creat d1/d11/d5a/d63/d103/d45/dcf/de6/d107/f114 x:0 0 0 2023-12-16T03:16:05.030 INFO:tasks.workunit.client.0.smithi064.stdout:6/441: dwrite d3/f61 [4194304,4194304] 0 2023-12-16T03:16:05.030 INFO:tasks.workunit.client.0.smithi064.stdout:6/442: fsync d3/d9/f18 0 2023-12-16T03:16:05.030 INFO:tasks.workunit.client.0.smithi064.stdout:8/552: dread d0/da/d3e/d46/d8f/f8a [0,4194304] 0 2023-12-16T03:16:05.049 INFO:tasks.workunit.client.0.smithi064.stdout:6/443: rmdir d3/d8/d1f 39 2023-12-16T03:16:05.051 INFO:tasks.workunit.client.1.smithi184.stdout:1/772: symlink d3/d34/dbc/d3c/d41/d46/d4a/l108 0 2023-12-16T03:16:05.055 INFO:tasks.workunit.client.1.smithi184.stdout:4/800: creat d1/d11/d5a/d63/d103/f115 x:0 0 0 2023-12-16T03:16:05.056 INFO:tasks.workunit.client.1.smithi184.stdout:4/801: chown d1/d12/db3/fe5 220782813 1 2023-12-16T03:16:05.056 INFO:tasks.workunit.client.1.smithi184.stdout:4/802: write d1/d12/fc1 [809398,125182] 0 2023-12-16T03:16:05.059 INFO:tasks.workunit.client.1.smithi184.stdout:1/773: mkdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/d109 0 2023-12-16T03:16:05.059 INFO:tasks.workunit.client.1.smithi184.stdout:1/774: read - d3/d34/dbc/d3c/d41/d63/fd8 zero size 2023-12-16T03:16:05.060 INFO:tasks.workunit.client.1.smithi184.stdout:1/775: rmdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/dee/d107 0 2023-12-16T03:16:05.061 INFO:tasks.workunit.client.1.smithi184.stdout:1/776: stat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/ff2 0 2023-12-16T03:16:05.061 INFO:tasks.workunit.client.1.smithi184.stdout:1/777: truncate d3/d34/dbc/d3c/d41/f4b 4950456 0 2023-12-16T03:16:05.061 INFO:tasks.workunit.client.1.smithi184.stdout:1/778: creat d3/d34/dbc/d3c/d41/d46/d4a/de2/f10a x:0 0 0 2023-12-16T03:16:05.062 INFO:tasks.workunit.client.1.smithi184.stdout:1/779: mkdir d3/d13/d10b 0 2023-12-16T03:16:05.063 INFO:tasks.workunit.client.1.smithi184.stdout:1/780: symlink d3/d34/dbc/l10c 0 2023-12-16T03:16:05.064 INFO:tasks.workunit.client.1.smithi184.stdout:1/781: rmdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6 39 2023-12-16T03:16:05.064 INFO:tasks.workunit.client.1.smithi184.stdout:1/782: write d3/d34/dbc/d3c/d41/d63/f9a [257492,48792] 0 2023-12-16T03:16:05.064 INFO:tasks.workunit.client.1.smithi184.stdout:1/783: fdatasync d3/d34/dbc/d38/faf 0 2023-12-16T03:16:05.066 INFO:tasks.workunit.client.1.smithi184.stdout:1/784: mknod d3/d34/dbc/d3c/c10d 0 2023-12-16T03:16:05.067 INFO:tasks.workunit.client.1.smithi184.stdout:1/785: symlink d3/d34/d76/df9/l10e 0 2023-12-16T03:16:05.067 INFO:tasks.workunit.client.1.smithi184.stdout:1/786: chown d3/d34/dbc/d3c/d41/d77/fd3 6 1 2023-12-16T03:16:05.067 INFO:tasks.workunit.client.1.smithi184.stdout:8/865: dwrite d2/d4/d10/d11/f29 [0,4194304] 0 2023-12-16T03:16:05.070 INFO:tasks.workunit.client.0.smithi064.stdout:3/574: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/f99 [0,4194304] 0 2023-12-16T03:16:05.070 INFO:tasks.workunit.client.0.smithi064.stdout:3/575: chown db/d12/d1a/d2c/d34/d4c/d6a/da7/f7f 14661157 1 2023-12-16T03:16:05.077 INFO:tasks.workunit.client.1.smithi184.stdout:0/835: dwrite dc/d10/d2d/f107 [0,4194304] 0 2023-12-16T03:16:05.077 INFO:tasks.workunit.client.1.smithi184.stdout:0/836: truncate dc/d22/d1d/d35/dd8/f115 865259 0 2023-12-16T03:16:05.078 INFO:tasks.workunit.client.0.smithi064.stdout:8/553: dwrite d0/d1d/d3c/f8e [4194304,4194304] 0 2023-12-16T03:16:05.078 INFO:tasks.workunit.client.0.smithi064.stdout:0/467: dwrite d2/d7/f49 [4194304,4194304] 0 2023-12-16T03:16:05.078 INFO:tasks.workunit.client.0.smithi064.stdout:0/468: chown d2/d29/d66/l82 1 1 2023-12-16T03:16:05.078 INFO:tasks.workunit.client.1.smithi184.stdout:3/939: dwrite d12/d18/d68/f158 [0,4194304] 0 2023-12-16T03:16:05.078 INFO:tasks.workunit.client.1.smithi184.stdout:6/917: dwrite d0/d5/d22/d37/d4d/f5d [0,4194304] 0 2023-12-16T03:16:05.079 INFO:tasks.workunit.client.1.smithi184.stdout:6/918: fdatasync d0/d5/d22/d25/dbf/ff6 0 2023-12-16T03:16:05.079 INFO:tasks.workunit.client.0.smithi064.stdout:1/478: rename d3/dd/d23/d41 to d3/d36/d9e 0 2023-12-16T03:16:05.079 INFO:tasks.workunit.client.0.smithi064.stdout:6/444: dwrite d3/d9/f18 [0,4194304] 0 2023-12-16T03:16:05.086 INFO:tasks.workunit.client.0.smithi064.stdout:8/554: getdents d0/da/d3e/d46 0 2023-12-16T03:16:05.086 INFO:tasks.workunit.client.0.smithi064.stdout:8/555: chown d0/db/d12/d1c/d59 0 1 2023-12-16T03:16:05.086 INFO:tasks.workunit.client.0.smithi064.stdout:8/556: chown d0 0 1 2023-12-16T03:16:05.089 INFO:tasks.workunit.client.0.smithi064.stdout:0/469: link d2/d7/l91 d2/d7/d6b/l96 0 2023-12-16T03:16:05.089 INFO:tasks.workunit.client.0.smithi064.stdout:0/470: readlink d2/d7/l3a 0 2023-12-16T03:16:05.092 INFO:tasks.workunit.client.0.smithi064.stdout:7/512: rename d7/d3e/d42/d48/d51/d7c/d52/c56 to d7/ca2 0 2023-12-16T03:16:05.092 INFO:tasks.workunit.client.0.smithi064.stdout:7/513: fdatasync d7/d3e/d42/d89/d74/f98 0 2023-12-16T03:16:05.093 INFO:tasks.workunit.client.1.smithi184.stdout:0/837: link dc/d22/l10c dc/d22/d45/d66/d80/da3/l11f 0 2023-12-16T03:16:05.094 INFO:tasks.workunit.client.0.smithi064.stdout:1/479: mknod d3/dd/d11/d6a/c9f 0 2023-12-16T03:16:05.094 INFO:tasks.workunit.client.0.smithi064.stdout:1/480: fsync d3/d22/f68 0 2023-12-16T03:16:05.094 INFO:tasks.workunit.client.0.smithi064.stdout:1/481: fdatasync d3/dd/f59 0 2023-12-16T03:16:05.094 INFO:tasks.workunit.client.0.smithi064.stdout:1/482: stat d3/dd 0 2023-12-16T03:16:05.096 INFO:tasks.workunit.client.0.smithi064.stdout:3/576: dwrite db/d4f/faf [0,4194304] 0 2023-12-16T03:16:05.096 INFO:tasks.workunit.client.0.smithi064.stdout:3/577: fdatasync db/f67 0 2023-12-16T03:16:05.097 INFO:tasks.workunit.client.0.smithi064.stdout:3/578: write db/d4f/da9/dbf/d75/f8a [248393,74200] 0 2023-12-16T03:16:05.097 INFO:tasks.workunit.client.0.smithi064.stdout:8/557: symlink d0/d1d/d3c/lc2 0 2023-12-16T03:16:05.097 INFO:tasks.workunit.client.0.smithi064.stdout:8/558: getdents d0/db/d37/d3a/dab 0 2023-12-16T03:16:05.097 INFO:tasks.workunit.client.0.smithi064.stdout:8/559: fdatasync d0/da/d3e/d46/f81 0 2023-12-16T03:16:05.101 INFO:tasks.workunit.client.0.smithi064.stdout:0/471: mkdir d2/d29/d66/d97 0 2023-12-16T03:16:05.101 INFO:tasks.workunit.client.0.smithi064.stdout:0/472: fsync d2/f16 0 2023-12-16T03:16:05.102 INFO:tasks.workunit.client.1.smithi184.stdout:3/940: link d12/d18/d1f/d23/d51/dd7/de3/de1/c10f d12/d18/d1f/d23/d2a/d4a/d61/da9/c15d 0 2023-12-16T03:16:05.102 INFO:tasks.workunit.client.1.smithi184.stdout:3/941: chown d12/d86/de4/d99/d117/db4/f128 363861467 1 2023-12-16T03:16:05.102 INFO:tasks.workunit.client.0.smithi064.stdout:3/579: write db/f67 [796585,103508] 0 2023-12-16T03:16:05.104 INFO:tasks.workunit.client.0.smithi064.stdout:1/483: symlink d3/d36/d9e/la0 0 2023-12-16T03:16:05.107 INFO:tasks.workunit.client.1.smithi184.stdout:1/787: dwrite d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/fe6 [0,4194304] 0 2023-12-16T03:16:05.108 INFO:tasks.workunit.client.1.smithi184.stdout:8/866: dwrite d2/d12/d21/d8a/dda/d73/fb3 [0,4194304] 0 2023-12-16T03:16:05.108 INFO:tasks.workunit.client.1.smithi184.stdout:1/788: stat d3/d34/d76/l98 0 2023-12-16T03:16:05.108 INFO:tasks.workunit.client.0.smithi064.stdout:3/580: symlink db/d12/d1a/d2c/d34/d4c/lc0 0 2023-12-16T03:16:05.111 INFO:tasks.workunit.client.1.smithi184.stdout:6/919: rmdir d0/d5/d26 39 2023-12-16T03:16:05.112 INFO:tasks.workunit.client.0.smithi064.stdout:6/445: dwrite d3/f7d [8388608,4194304] 0 2023-12-16T03:16:05.112 INFO:tasks.workunit.client.0.smithi064.stdout:6/446: chown d3/d8/d1f/d26/l42 80065 1 2023-12-16T03:16:05.114 INFO:tasks.workunit.client.0.smithi064.stdout:3/581: getdents db 0 2023-12-16T03:16:05.115 INFO:tasks.workunit.client.0.smithi064.stdout:6/447: write d3/d8/d13/d58/f5c [356688,130317] 0 2023-12-16T03:16:05.118 INFO:tasks.workunit.client.1.smithi184.stdout:3/942: creat d12/d18/d1f/d23/d2a/dfc/f15e x:0 0 0 2023-12-16T03:16:05.119 INFO:tasks.workunit.client.0.smithi064.stdout:3/582: link db/d12/d1a/d31/f64 db/d4f/fc1 0 2023-12-16T03:16:05.119 INFO:tasks.workunit.client.0.smithi064.stdout:3/583: chown db/d12/f18 258 1 2023-12-16T03:16:05.119 INFO:tasks.workunit.client.0.smithi064.stdout:3/584: write db/d12/d1a/d31/f64 [554663,89791] 0 2023-12-16T03:16:05.120 INFO:tasks.workunit.client.0.smithi064.stdout:6/448: getdents d3/d8/da 0 2023-12-16T03:16:05.121 INFO:tasks.workunit.client.0.smithi064.stdout:6/449: stat d3/d8/f4c 0 2023-12-16T03:16:05.124 INFO:tasks.workunit.client.0.smithi064.stdout:6/450: mknod d3/d8/da/c7e 0 2023-12-16T03:16:05.125 INFO:tasks.workunit.client.1.smithi184.stdout:8/867: rmdir d2/d12/db4 39 2023-12-16T03:16:05.126 INFO:tasks.workunit.client.1.smithi184.stdout:8/868: write d2/d12/d21/f53 [854476,40218] 0 2023-12-16T03:16:05.126 INFO:tasks.workunit.client.1.smithi184.stdout:8/869: chown d2/fc 0 1 2023-12-16T03:16:05.126 INFO:tasks.workunit.client.1.smithi184.stdout:1/789: rmdir d3/d13/d2c 39 2023-12-16T03:16:05.127 INFO:tasks.workunit.client.1.smithi184.stdout:6/920: creat d0/d5/d12/d1b/d33/d111/f12b x:0 0 0 2023-12-16T03:16:05.129 INFO:tasks.workunit.client.0.smithi064.stdout:3/585: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/f24 [0,4194304] 0 2023-12-16T03:16:05.129 INFO:tasks.workunit.client.0.smithi064.stdout:3/586: dread - db/d12/d1a/d2c/d34/d4c/d6a/f6c zero size 2023-12-16T03:16:05.129 INFO:tasks.workunit.client.0.smithi064.stdout:3/587: readlink db/d12/d21/l22 0 2023-12-16T03:16:05.130 INFO:tasks.workunit.client.0.smithi064.stdout:3/588: symlink db/d12/d1a/d31/lc2 0 2023-12-16T03:16:05.137 INFO:tasks.workunit.client.1.smithi184.stdout:6/921: dread d0/d5/d22/f3c [0,4194304] 0 2023-12-16T03:16:05.137 INFO:tasks.workunit.client.1.smithi184.stdout:6/922: readlink d0/d5/d12/lca 0 2023-12-16T03:16:05.138 INFO:tasks.workunit.client.0.smithi064.stdout:8/560: dwrite d0/db/d12/d1c/d59/fb5 [0,4194304] 0 2023-12-16T03:16:05.138 INFO:tasks.workunit.client.0.smithi064.stdout:0/473: dwrite d2/d7/d10/d21/d31/f65 [0,4194304] 0 2023-12-16T03:16:05.138 INFO:tasks.workunit.client.0.smithi064.stdout:8/561: chown d0/db/d37/d3a/d6f 52 1 2023-12-16T03:16:05.139 INFO:tasks.workunit.client.0.smithi064.stdout:6/451: dread d3/d8/f4c [0,4194304] 0 2023-12-16T03:16:05.139 INFO:tasks.workunit.client.0.smithi064.stdout:1/484: dwrite d3/d36/f45 [4194304,4194304] 0 2023-12-16T03:16:05.140 INFO:tasks.workunit.client.1.smithi184.stdout:3/943: creat d12/d86/de4/d99/f15f x:0 0 0 2023-12-16T03:16:05.140 INFO:tasks.workunit.client.1.smithi184.stdout:1/790: creat d3/d34/dbc/d3c/f10f x:0 0 0 2023-12-16T03:16:05.140 INFO:tasks.workunit.client.1.smithi184.stdout:0/838: rmdir dc/d22/d1d/d43/d5a/df3 0 2023-12-16T03:16:05.142 INFO:tasks.workunit.client.1.smithi184.stdout:6/923: write d0/d5/d26/f38 [2840475,5802] 0 2023-12-16T03:16:05.144 INFO:tasks.workunit.client.1.smithi184.stdout:3/944: dread d12/d37/f67 [0,4194304] 0 2023-12-16T03:16:05.145 INFO:tasks.workunit.client.1.smithi184.stdout:6/924: read d0/d5/d12/d1b/f4c [5852846,106976] 0 2023-12-16T03:16:05.152 INFO:tasks.workunit.client.0.smithi064.stdout:3/589: dwrite db/d12/d1a/d2c/d34/f5a [0,4194304] 0 2023-12-16T03:16:05.152 INFO:tasks.workunit.client.1.smithi184.stdout:8/870: dwrite d2/d4/da6/fe3 [0,4194304] 0 2023-12-16T03:16:05.155 INFO:tasks.workunit.client.0.smithi064.stdout:3/590: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f43 [0,4194304] 0 2023-12-16T03:16:05.158 INFO:tasks.workunit.client.1.smithi184.stdout:6/925: dwrite d0/d5/d22/d25/d47/fe3 [0,4194304] 0 2023-12-16T03:16:05.161 INFO:tasks.workunit.client.0.smithi064.stdout:3/591: write db/fd [2254104,33749] 0 2023-12-16T03:16:05.222 INFO:tasks.workunit.client.1.smithi184.stdout:1/791: creat d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/f110 x:0 0 0 2023-12-16T03:16:05.223 INFO:tasks.workunit.client.1.smithi184.stdout:0/839: creat dc/d22/d1d/d8e/f120 x:0 0 0 2023-12-16T03:16:05.223 INFO:tasks.workunit.client.1.smithi184.stdout:0/840: write dc/d22/d1d/fe4 [101570,32151] 0 2023-12-16T03:16:05.224 INFO:tasks.workunit.client.1.smithi184.stdout:3/945: creat d12/d18/f160 x:0 0 0 2023-12-16T03:16:05.226 INFO:tasks.workunit.client.1.smithi184.stdout:2/713: sync 2023-12-16T03:16:05.226 INFO:tasks.workunit.client.1.smithi184.stdout:8/871: mknod d2/d37/c11e 0 2023-12-16T03:16:05.227 INFO:tasks.workunit.client.1.smithi184.stdout:8/872: write d2/d6a/f84 [7036702,13594] 0 2023-12-16T03:16:05.227 INFO:tasks.workunit.client.1.smithi184.stdout:8/873: chown d2/d4/f9 6 1 2023-12-16T03:16:05.228 INFO:tasks.workunit.client.0.smithi064.stdout:8/562: creat d0/d1d/d24/fc3 x:0 0 0 2023-12-16T03:16:05.232 INFO:tasks.workunit.client.0.smithi064.stdout:8/563: dread d0/da/f30 [0,4194304] 0 2023-12-16T03:16:05.232 INFO:tasks.workunit.client.0.smithi064.stdout:8/564: fdatasync d0/f3 0 2023-12-16T03:16:05.232 INFO:tasks.workunit.client.1.smithi184.stdout:2/714: write d3/d29/d2f/f22 [2527254,120542] 0 2023-12-16T03:16:05.232 INFO:tasks.workunit.client.1.smithi184.stdout:6/926: rename d0/d5/d42/f80 to d0/d5/d22/d37/f12c 0 2023-12-16T03:16:05.232 INFO:tasks.workunit.client.1.smithi184.stdout:6/927: chown d0/d5/d22/d37 32489 1 2023-12-16T03:16:05.233 INFO:tasks.workunit.client.1.smithi184.stdout:6/928: dread - d0/d5/d22/d25/d47/f99 zero size 2023-12-16T03:16:05.239 INFO:tasks.workunit.client.1.smithi184.stdout:1/792: unlink d3/d34/dbc/d3c/d41/d63/fe3 0 2023-12-16T03:16:05.242 INFO:tasks.workunit.client.1.smithi184.stdout:0/841: rmdir dc/d22/d1a 39 2023-12-16T03:16:05.245 INFO:tasks.workunit.client.1.smithi184.stdout:8/874: dwrite d2/d12/d21/d2d/d31/f63 [0,4194304] 0 2023-12-16T03:16:05.248 INFO:tasks.workunit.client.1.smithi184.stdout:2/715: link d3/d9/f8c d3/d13/feb 0 2023-12-16T03:16:05.248 INFO:tasks.workunit.client.1.smithi184.stdout:3/946: mkdir d12/d18/d1f/d23/d2a/d42/de9/d161 0 2023-12-16T03:16:05.251 INFO:tasks.workunit.client.1.smithi184.stdout:5/634: sync 2023-12-16T03:16:05.251 INFO:tasks.workunit.client.1.smithi184.stdout:1/793: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/f111 x:0 0 0 2023-12-16T03:16:05.251 INFO:tasks.workunit.client.1.smithi184.stdout:5/635: write d1/d3/d9/de/d15/d19/d48/fc8 [60296,35984] 0 2023-12-16T03:16:05.253 INFO:tasks.workunit.client.1.smithi184.stdout:0/842: mkdir dc/d2a/d113/d121 0 2023-12-16T03:16:05.255 INFO:tasks.workunit.client.0.smithi064.stdout:1/485: rename d3/d36/d9e/l6f to d3/d36/la1 0 2023-12-16T03:16:05.259 INFO:tasks.workunit.client.1.smithi184.stdout:3/947: symlink d12/d86/de4/d110/l162 0 2023-12-16T03:16:05.259 INFO:tasks.workunit.client.1.smithi184.stdout:3/948: fsync d12/d18/d1f/d93/d127/f14b 0 2023-12-16T03:16:05.259 INFO:tasks.workunit.client.1.smithi184.stdout:2/716: dread d3/d29/d4d/fa3 [0,4194304] 0 2023-12-16T03:16:05.259 INFO:tasks.workunit.client.1.smithi184.stdout:0/843: write dc/d22/d45/d66/d80/f8a [2468297,15302] 0 2023-12-16T03:16:05.261 INFO:tasks.workunit.client.1.smithi184.stdout:1/794: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/d109/f112 x:0 0 0 2023-12-16T03:16:05.262 INFO:tasks.workunit.client.0.smithi064.stdout:3/592: symlink db/d12/d4e/da3/lc3 0 2023-12-16T03:16:05.263 INFO:tasks.workunit.client.1.smithi184.stdout:6/929: dwrite d0/d36/d8a/fce [0,4194304] 0 2023-12-16T03:16:05.265 INFO:tasks.workunit.client.1.smithi184.stdout:1/795: dread d3/d34/dbc/f87 [0,4194304] 0 2023-12-16T03:16:05.266 INFO:tasks.workunit.client.1.smithi184.stdout:8/875: dwrite d2/d6a/f84 [0,4194304] 0 2023-12-16T03:16:05.268 INFO:tasks.workunit.client.0.smithi064.stdout:8/565: creat d0/d1d/d73/fc4 x:0 0 0 2023-12-16T03:16:05.271 INFO:tasks.workunit.client.1.smithi184.stdout:3/949: link d12/d86/de4/d99/f15f d12/d37/d139/f163 0 2023-12-16T03:16:05.271 INFO:tasks.workunit.client.1.smithi184.stdout:3/950: truncate d12/d18/d1f/d23/f11c 952567 0 2023-12-16T03:16:05.271 INFO:tasks.workunit.client.1.smithi184.stdout:2/717: symlink d3/d13/d28/dac/daf/dc8/lec 0 2023-12-16T03:16:05.271 INFO:tasks.workunit.client.1.smithi184.stdout:4/803: sync 2023-12-16T03:16:05.271 INFO:tasks.workunit.client.1.smithi184.stdout:7/736: sync 2023-12-16T03:16:05.271 INFO:tasks.workunit.client.1.smithi184.stdout:7/737: fsync d0/d6b/d94/dbe/fa7 0 2023-12-16T03:16:05.272 INFO:tasks.workunit.client.0.smithi064.stdout:6/452: rename d3/c78 to d3/d8/d1f/d26/d47/d4a/c7f 0 2023-12-16T03:16:05.272 INFO:tasks.workunit.client.0.smithi064.stdout:6/453: truncate d3/d8/d13/f24 142261 0 2023-12-16T03:16:05.272 INFO:tasks.workunit.client.0.smithi064.stdout:8/566: dread d0/db/d12/d1c/f35 [0,4194304] 0 2023-12-16T03:16:05.272 INFO:tasks.workunit.client.1.smithi184.stdout:0/844: getdents dc/d22/d45/d66 0 2023-12-16T03:16:05.273 INFO:tasks.workunit.client.0.smithi064.stdout:1/486: symlink d3/d36/d9e/la2 0 2023-12-16T03:16:05.275 INFO:tasks.workunit.client.0.smithi064.stdout:1/487: write d3/dd/d11/f17 [1394225,129932] 0 2023-12-16T03:16:05.275 INFO:tasks.workunit.client.0.smithi064.stdout:1/488: fdatasync d3/d22/f68 0 2023-12-16T03:16:05.275 INFO:tasks.workunit.client.0.smithi064.stdout:1/489: fdatasync d3/dd/d11/d3b/f69 0 2023-12-16T03:16:05.275 INFO:tasks.workunit.client.0.smithi064.stdout:3/593: creat db/d12/d1a/fc4 x:0 0 0 2023-12-16T03:16:05.278 INFO:tasks.workunit.client.0.smithi064.stdout:0/474: truncate d2/d7/f49 4503803 0 2023-12-16T03:16:05.278 INFO:tasks.workunit.client.0.smithi064.stdout:0/475: fdatasync d2/d8/da/df/f72 0 2023-12-16T03:16:05.279 INFO:tasks.workunit.client.0.smithi064.stdout:6/454: mkdir d3/d80 0 2023-12-16T03:16:05.281 INFO:tasks.workunit.client.0.smithi064.stdout:8/567: creat d0/d1d/fc5 x:0 0 0 2023-12-16T03:16:05.281 INFO:tasks.workunit.client.1.smithi184.stdout:4/804: dread d1/d11/d5a/fa3 [0,4194304] 0 2023-12-16T03:16:05.282 INFO:tasks.workunit.client.1.smithi184.stdout:6/930: symlink d0/d5/d22/d37/d45/l12d 0 2023-12-16T03:16:05.284 INFO:tasks.workunit.client.0.smithi064.stdout:1/490: mknod d3/dd/d23/d86/ca3 0 2023-12-16T03:16:05.287 INFO:tasks.workunit.client.0.smithi064.stdout:3/594: mkdir db/d12/d1a/d2c/db5/dc5 0 2023-12-16T03:16:05.287 INFO:tasks.workunit.client.0.smithi064.stdout:3/595: fdatasync db/d12/d1a/f26 0 2023-12-16T03:16:05.291 INFO:tasks.workunit.client.1.smithi184.stdout:1/796: link d3/d34/dbc/d3c/d24/c2f d3/d34/dbc/d3c/d41/d46/d4a/d6a/c113 0 2023-12-16T03:16:05.292 INFO:tasks.workunit.client.0.smithi064.stdout:0/476: symlink d2/d7/d6b/l98 0 2023-12-16T03:16:05.292 INFO:tasks.workunit.client.0.smithi064.stdout:0/477: write d2/f7c [9330155,26182] 0 2023-12-16T03:16:05.293 INFO:tasks.workunit.client.0.smithi064.stdout:6/455: creat d3/d8/d13/d58/f81 x:0 0 0 2023-12-16T03:16:05.296 INFO:tasks.workunit.client.1.smithi184.stdout:6/931: dwrite d0/d5/d26/f38 [4194304,4194304] 0 2023-12-16T03:16:05.296 INFO:tasks.workunit.client.1.smithi184.stdout:3/951: rmdir d12/d1e 39 2023-12-16T03:16:05.296 INFO:tasks.workunit.client.1.smithi184.stdout:6/932: stat d0/d5/d12/d1b/c21 0 2023-12-16T03:16:05.296 INFO:tasks.workunit.client.1.smithi184.stdout:6/933: readlink d0/d5/d22/d25/d47/l76 0 2023-12-16T03:16:05.296 INFO:tasks.workunit.client.1.smithi184.stdout:6/934: stat d0/d5/d42/fad 0 2023-12-16T03:16:05.298 INFO:tasks.workunit.client.0.smithi064.stdout:1/491: mknod d3/d36/d44/ca4 0 2023-12-16T03:16:05.298 INFO:tasks.workunit.client.0.smithi064.stdout:0/478: dread d2/d7/d10/f52 [0,4194304] 0 2023-12-16T03:16:05.300 INFO:tasks.workunit.client.1.smithi184.stdout:7/738: rename d0/l2 to d0/d3/d2e/d79/d32/d39/d8f/dab/dc9/ld8 0 2023-12-16T03:16:05.304 INFO:tasks.workunit.client.0.smithi064.stdout:4/528: sync 2023-12-16T03:16:05.305 INFO:tasks.workunit.client.0.smithi064.stdout:5/450: sync 2023-12-16T03:16:05.305 INFO:tasks.workunit.client.0.smithi064.stdout:2/404: sync 2023-12-16T03:16:05.305 INFO:tasks.workunit.client.0.smithi064.stdout:2/405: stat d1/d27/d2e/f5b 0 2023-12-16T03:16:05.306 INFO:tasks.workunit.client.1.smithi184.stdout:0/845: truncate dc/d22/d1a/f3e 4643308 0 2023-12-16T03:16:05.306 INFO:tasks.workunit.client.1.smithi184.stdout:0/846: dread dc/d22/d1d/fe4 [0,4194304] 0 2023-12-16T03:16:05.306 INFO:tasks.workunit.client.1.smithi184.stdout:1/797: mknod d3/d13/c114 0 2023-12-16T03:16:05.307 INFO:tasks.workunit.client.0.smithi064.stdout:8/568: rmdir d0/da/d3e/d46/d54 39 2023-12-16T03:16:05.307 INFO:tasks.workunit.client.0.smithi064.stdout:8/569: truncate d0/d1d/d73/fc4 395116 0 2023-12-16T03:16:05.307 INFO:tasks.workunit.client.0.smithi064.stdout:8/570: fdatasync d0/f3 0 2023-12-16T03:16:05.307 INFO:tasks.workunit.client.0.smithi064.stdout:8/571: truncate d0/d1d/d24/d2f/f39 1350074 0 2023-12-16T03:16:05.307 INFO:tasks.workunit.client.0.smithi064.stdout:8/572: fsync d0/da/fc 0 2023-12-16T03:16:05.307 INFO:tasks.workunit.client.0.smithi064.stdout:3/596: mknod db/d12/d1a/cc6 0 2023-12-16T03:16:05.307 INFO:tasks.workunit.client.0.smithi064.stdout:3/597: stat db/d12/d21/f3f 0 2023-12-16T03:16:05.307 INFO:tasks.workunit.client.0.smithi064.stdout:3/598: stat db/d4f/da9/dbf/l84 0 2023-12-16T03:16:05.307 INFO:tasks.workunit.client.0.smithi064.stdout:3/599: truncate db/d12/d1a/f1d 1676947 0 2023-12-16T03:16:05.308 INFO:tasks.workunit.client.1.smithi184.stdout:8/876: mknod d2/d12/d21/d8a/c11f 0 2023-12-16T03:16:05.308 INFO:tasks.workunit.client.1.smithi184.stdout:1/798: read d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/fc0 [4164494,18367] 0 2023-12-16T03:16:05.309 INFO:tasks.workunit.client.0.smithi064.stdout:6/456: write d3/d8/da/fe [3054808,68722] 0 2023-12-16T03:16:05.310 INFO:tasks.workunit.client.0.smithi064.stdout:1/492: creat d3/dd/d11/fa5 x:0 0 0 2023-12-16T03:16:05.312 INFO:tasks.workunit.client.0.smithi064.stdout:9/456: sync 2023-12-16T03:16:05.314 INFO:tasks.workunit.client.0.smithi064.stdout:0/479: mknod d2/d7/d10/d21/d7a/c99 0 2023-12-16T03:16:05.317 INFO:tasks.workunit.client.0.smithi064.stdout:5/451: stat d0/de/d23/l58 0 2023-12-16T03:16:05.317 INFO:tasks.workunit.client.0.smithi064.stdout:5/452: chown d0/f7d 13288477 1 2023-12-16T03:16:05.317 INFO:tasks.workunit.client.0.smithi064.stdout:5/453: readlink d0/d19/d48/l85 0 2023-12-16T03:16:05.318 INFO:tasks.workunit.client.1.smithi184.stdout:3/952: creat d12/d18/da1/d115/d11d/d147/f164 x:0 0 0 2023-12-16T03:16:05.318 INFO:tasks.workunit.client.1.smithi184.stdout:6/935: symlink d0/d5/d22/d34/l12e 0 2023-12-16T03:16:05.318 INFO:tasks.workunit.client.1.smithi184.stdout:2/718: mknod d3/ced 0 2023-12-16T03:16:05.320 INFO:tasks.workunit.client.0.smithi064.stdout:3/600: dread db/f16 [0,4194304] 0 2023-12-16T03:16:05.320 INFO:tasks.workunit.client.0.smithi064.stdout:4/529: mkdir d0/d42/d4c/d70/d8c/da9 0 2023-12-16T03:16:05.320 INFO:tasks.workunit.client.0.smithi064.stdout:4/530: fsync d0/d1e/f37 0 2023-12-16T03:16:05.323 INFO:tasks.workunit.client.1.smithi184.stdout:8/877: dwrite d2/d4/d10/d2a/f5c [0,4194304] 0 2023-12-16T03:16:05.324 INFO:tasks.workunit.client.0.smithi064.stdout:2/406: mknod d1/d15/c7e 0 2023-12-16T03:16:05.324 INFO:tasks.workunit.client.0.smithi064.stdout:2/407: write d1/d27/d2e/d69/f78 [262810,68710] 0 2023-12-16T03:16:05.324 INFO:tasks.workunit.client.0.smithi064.stdout:2/408: chown d1/f10 97538293 1 2023-12-16T03:16:05.324 INFO:tasks.workunit.client.0.smithi064.stdout:2/409: chown d1/d15/l48 5857258 1 2023-12-16T03:16:05.325 INFO:tasks.workunit.client.0.smithi064.stdout:2/410: read d1/f7 [3182906,75670] 0 2023-12-16T03:16:05.325 INFO:tasks.workunit.client.0.smithi064.stdout:2/411: truncate d1/d15/d58/f46 964374 0 2023-12-16T03:16:05.325 INFO:tasks.workunit.client.0.smithi064.stdout:2/412: chown d1/d15/d67/l4b 222 1 2023-12-16T03:16:05.325 INFO:tasks.workunit.client.0.smithi064.stdout:2/413: write d1/d15/d23/d2d/f6a [1014786,91896] 0 2023-12-16T03:16:05.326 INFO:tasks.workunit.client.0.smithi064.stdout:1/493: dread d3/d36/d44/d4d/f6b [0,4194304] 0 2023-12-16T03:16:05.328 INFO:tasks.workunit.client.0.smithi064.stdout:8/573: creat d0/db/d12/d44/d68/fc6 x:0 0 0 2023-12-16T03:16:05.328 INFO:tasks.workunit.client.0.smithi064.stdout:8/574: readlink d0/d1d/d3c/l89 0 2023-12-16T03:16:05.328 INFO:tasks.workunit.client.0.smithi064.stdout:8/575: chown d0/d1d/d24/d2f/l47 26 1 2023-12-16T03:16:05.329 INFO:tasks.workunit.client.1.smithi184.stdout:8/878: dread d2/d4/d10/d75/fa5 [0,4194304] 0 2023-12-16T03:16:05.329 INFO:tasks.workunit.client.1.smithi184.stdout:8/879: truncate d2/d4/d10/d11/d77/f104 763944 0 2023-12-16T03:16:05.330 INFO:tasks.workunit.client.1.smithi184.stdout:7/739: mknod d0/d3/d2e/d3b/cd9 0 2023-12-16T03:16:05.330 INFO:tasks.workunit.client.1.smithi184.stdout:0/847: unlink dc/d10/d2d/d5f/la2 0 2023-12-16T03:16:05.330 INFO:tasks.workunit.client.1.smithi184.stdout:1/799: symlink d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/l115 0 2023-12-16T03:16:05.331 INFO:tasks.workunit.client.0.smithi064.stdout:7/514: sync 2023-12-16T03:16:05.333 INFO:tasks.workunit.client.0.smithi064.stdout:0/480: dread f1 [0,4194304] 0 2023-12-16T03:16:05.333 INFO:tasks.workunit.client.0.smithi064.stdout:6/457: rename d3/d8/d13/d46/f70 to d3/d8/d13/d46/d5e/f82 0 2023-12-16T03:16:05.335 INFO:tasks.workunit.client.0.smithi064.stdout:9/457: fsync d2/d2d/d36/f60 0 2023-12-16T03:16:05.337 INFO:tasks.workunit.client.1.smithi184.stdout:3/953: mkdir d12/d86/de4/d99/d117/d165 0 2023-12-16T03:16:05.337 INFO:tasks.workunit.client.1.smithi184.stdout:3/954: truncate d12/d37/d81/f159 376601 0 2023-12-16T03:16:05.340 INFO:tasks.workunit.client.1.smithi184.stdout:6/936: creat d0/d5/d12/d1b/d33/d111/f12f x:0 0 0 2023-12-16T03:16:05.340 INFO:tasks.workunit.client.1.smithi184.stdout:6/937: write d0/d5/d12/d1b/d33/d3d/d96/f110 [694530,66456] 0 2023-12-16T03:16:05.341 INFO:tasks.workunit.client.0.smithi064.stdout:3/601: creat db/d12/d1a/d2c/d34/d4c/d6a/fc7 x:0 0 0 2023-12-16T03:16:05.344 INFO:tasks.workunit.client.0.smithi064.stdout:2/414: link d1/d27/d2e/d68/f64 d1/d15/d1b/d61/f7f 0 2023-12-16T03:16:05.348 INFO:tasks.workunit.client.1.smithi184.stdout:7/740: creat d0/d3/d2e/d79/dd/d75/fda x:0 0 0 2023-12-16T03:16:05.348 INFO:tasks.workunit.client.1.smithi184.stdout:0/848: symlink dc/d10/d2d/d5f/d7a/l122 0 2023-12-16T03:16:05.348 INFO:tasks.workunit.client.1.smithi184.stdout:0/849: write dc/d10/d2d/d5f/f11c [938958,52623] 0 2023-12-16T03:16:05.348 INFO:tasks.workunit.client.1.smithi184.stdout:1/800: dread d3/d34/dbc/d3c/d41/f4b [0,4194304] 0 2023-12-16T03:16:05.348 INFO:tasks.workunit.client.1.smithi184.stdout:1/801: fsync d3/d34/dbc/d3c/f33 0 2023-12-16T03:16:05.349 INFO:tasks.workunit.client.0.smithi064.stdout:8/576: creat d0/db/d12/d44/fc7 x:0 0 0 2023-12-16T03:16:05.350 INFO:tasks.workunit.client.0.smithi064.stdout:1/494: getdents d3/d22/d57 0 2023-12-16T03:16:05.351 INFO:tasks.workunit.client.0.smithi064.stdout:0/481: creat d2/d8/da/f9a x:0 0 0 2023-12-16T03:16:05.351 INFO:tasks.workunit.client.0.smithi064.stdout:0/482: readlink d2/d7/l3a 0 2023-12-16T03:16:05.352 INFO:tasks.workunit.client.1.smithi184.stdout:2/719: dwrite d3/f75 [0,4194304] 0 2023-12-16T03:16:05.352 INFO:tasks.workunit.client.1.smithi184.stdout:3/955: dread d12/d18/da1/f140 [0,4194304] 0 2023-12-16T03:16:05.353 INFO:tasks.workunit.client.0.smithi064.stdout:5/454: dwrite d0/d19/f8e [4194304,4194304] 0 2023-12-16T03:16:05.354 INFO:tasks.workunit.client.0.smithi064.stdout:4/531: rename d0/d42/d53/l6a to d0/d42/d4c/d70/laa 0 2023-12-16T03:16:05.354 INFO:tasks.workunit.client.0.smithi064.stdout:4/532: fsync d0/d1e/f60 0 2023-12-16T03:16:05.355 INFO:tasks.workunit.client.0.smithi064.stdout:5/455: dread d0/d19/d48/d8f/d3e/d35/d5d/f66 [0,4194304] 0 2023-12-16T03:16:05.355 INFO:tasks.workunit.client.0.smithi064.stdout:9/458: symlink d2/dc/d24/d39/d5e/d6f/l91 0 2023-12-16T03:16:05.356 INFO:tasks.workunit.client.0.smithi064.stdout:8/577: creat d0/db/d12/d44/fc8 x:0 0 0 2023-12-16T03:16:05.359 INFO:tasks.workunit.client.0.smithi064.stdout:1/495: mknod d3/dd/d11/d2f/ca6 0 2023-12-16T03:16:05.360 INFO:tasks.workunit.client.0.smithi064.stdout:1/496: chown d3/d22/f28 105487391 1 2023-12-16T03:16:05.360 INFO:tasks.workunit.client.0.smithi064.stdout:1/497: fdatasync d3/dd/d11/f34 0 2023-12-16T03:16:05.361 INFO:tasks.workunit.client.0.smithi064.stdout:4/533: dread d0/da/f6f [0,4194304] 0 2023-12-16T03:16:05.361 INFO:tasks.workunit.client.0.smithi064.stdout:7/515: dwrite d7/d3e/d42/f9c [0,4194304] 0 2023-12-16T03:16:05.362 INFO:tasks.workunit.client.0.smithi064.stdout:0/483: mknod d2/d7/d10/d21/c9b 0 2023-12-16T03:16:05.362 INFO:tasks.workunit.client.1.smithi184.stdout:6/938: link d0/d5/d22/d34/d53/f5a d0/d5/d12/d1b/f130 0 2023-12-16T03:16:05.362 INFO:tasks.workunit.client.1.smithi184.stdout:8/880: symlink d2/d4/l120 0 2023-12-16T03:16:05.362 INFO:tasks.workunit.client.1.smithi184.stdout:8/881: fdatasync d2/d4/d10/d7a/ff7 0 2023-12-16T03:16:05.363 INFO:tasks.workunit.client.1.smithi184.stdout:7/741: link d0/d3/d2e/d79/d1e/f20 d0/d3/d2e/d79/d36/d3f/fdb 0 2023-12-16T03:16:05.363 INFO:tasks.workunit.client.1.smithi184.stdout:7/742: truncate d0/d3/d2e/d79/f9a 653370 0 2023-12-16T03:16:05.366 INFO:tasks.workunit.client.1.smithi184.stdout:0/850: symlink dc/d10/d2d/d5f/d7c/l123 0 2023-12-16T03:16:05.366 INFO:tasks.workunit.client.1.smithi184.stdout:0/851: dread - dc/d22/d1d/d8e/f8f zero size 2023-12-16T03:16:05.368 INFO:tasks.workunit.client.0.smithi064.stdout:6/458: dwrite d3/f7d [8388608,4194304] 0 2023-12-16T03:16:05.368 INFO:tasks.workunit.client.0.smithi064.stdout:3/602: rename db/d12/d1a/d31/c7e to db/d4f/daa/cc8 0 2023-12-16T03:16:05.368 INFO:tasks.workunit.client.0.smithi064.stdout:3/603: stat db/d12/d4e/f73 0 2023-12-16T03:16:05.368 INFO:tasks.workunit.client.0.smithi064.stdout:3/604: stat db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/da4/dbd 0 2023-12-16T03:16:05.369 INFO:tasks.workunit.client.0.smithi064.stdout:6/459: dread d3/d9/f18 [4194304,4194304] 0 2023-12-16T03:16:05.369 INFO:tasks.workunit.client.1.smithi184.stdout:1/802: creat d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/f116 x:0 0 0 2023-12-16T03:16:05.369 INFO:tasks.workunit.client.1.smithi184.stdout:1/803: readlink d3/d34/dbc/l10c 0 2023-12-16T03:16:05.370 INFO:tasks.workunit.client.0.smithi064.stdout:9/459: mknod d2/d2d/d3b/c92 0 2023-12-16T03:16:05.373 INFO:tasks.workunit.client.0.smithi064.stdout:8/578: symlink d0/db/lc9 0 2023-12-16T03:16:05.379 INFO:tasks.workunit.client.0.smithi064.stdout:6/460: dread d3/d8/d1f/f22 [0,4194304] 0 2023-12-16T03:16:05.380 INFO:tasks.workunit.client.1.smithi184.stdout:3/956: dwrite d12/d86/de4/f135 [0,4194304] 0 2023-12-16T03:16:05.380 INFO:tasks.workunit.client.1.smithi184.stdout:3/957: chown d12/d18/d1f/d23/d2a/f53 7 1 2023-12-16T03:16:05.380 INFO:tasks.workunit.client.1.smithi184.stdout:3/958: write d12/d18/d1f/d23/f11c [1022364,125976] 0 2023-12-16T03:16:05.381 INFO:tasks.workunit.client.0.smithi064.stdout:3/605: dread db/d12/d21/f33 [0,4194304] 0 2023-12-16T03:16:05.381 INFO:tasks.workunit.client.1.smithi184.stdout:2/720: mknod d3/d13/d28/dac/daf/dc8/cee 0 2023-12-16T03:16:05.383 INFO:tasks.workunit.client.1.smithi184.stdout:8/882: mkdir d2/d4/d10/d11/d72/dc2/d121 0 2023-12-16T03:16:05.384 INFO:tasks.workunit.client.0.smithi064.stdout:1/498: creat d3/d36/d44/d4d/d58/fa7 x:0 0 0 2023-12-16T03:16:05.386 INFO:tasks.workunit.client.1.smithi184.stdout:7/743: mkdir d0/d3/d2e/d3b/ddc 0 2023-12-16T03:16:05.387 INFO:tasks.workunit.client.1.smithi184.stdout:7/744: chown d0/c6 853956 1 2023-12-16T03:16:05.392 INFO:tasks.workunit.client.1.smithi184.stdout:1/804: creat d3/d34/dbc/d3c/f117 x:0 0 0 2023-12-16T03:16:05.394 INFO:tasks.workunit.client.0.smithi064.stdout:4/534: unlink d0/d42/f71 0 2023-12-16T03:16:05.394 INFO:tasks.workunit.client.0.smithi064.stdout:4/535: chown d0/d42/d4c/d70/d85 300258 1 2023-12-16T03:16:05.394 INFO:tasks.workunit.client.0.smithi064.stdout:1/499: dread d3/dd/f3c [0,4194304] 0 2023-12-16T03:16:05.395 INFO:tasks.workunit.client.0.smithi064.stdout:1/500: fdatasync d3/dd/d11/f34 0 2023-12-16T03:16:05.397 INFO:tasks.workunit.client.0.smithi064.stdout:7/516: mkdir d7/d26/d30/da3 0 2023-12-16T03:16:05.402 INFO:tasks.workunit.client.1.smithi184.stdout:3/959: mkdir d12/d18/d1f/d23/d166 0 2023-12-16T03:16:05.402 INFO:tasks.workunit.client.1.smithi184.stdout:3/960: write d12/d37/f126 [119700,53680] 0 2023-12-16T03:16:05.402 INFO:tasks.workunit.client.1.smithi184.stdout:3/961: write d12/d18/d1f/d23/d2a/f144 [1035331,117033] 0 2023-12-16T03:16:05.402 INFO:tasks.workunit.client.0.smithi064.stdout:0/484: dwrite d2/d8/da/f62 [0,4194304] 0 2023-12-16T03:16:05.402 INFO:tasks.workunit.client.0.smithi064.stdout:0/485: stat d2/d7/c55 0 2023-12-16T03:16:05.405 INFO:tasks.workunit.client.0.smithi064.stdout:8/579: mknod d0/db/d37/d3a/cca 0 2023-12-16T03:16:05.405 INFO:tasks.workunit.client.0.smithi064.stdout:8/580: read - d0/d1d/d3c/d42/d93/fbb zero size 2023-12-16T03:16:05.405 INFO:tasks.workunit.client.0.smithi064.stdout:0/486: write d2/f7c [5171650,35569] 0 2023-12-16T03:16:05.409 INFO:tasks.workunit.client.0.smithi064.stdout:6/461: truncate d3/d8/d13/d46/d5e/f64 431586 0 2023-12-16T03:16:05.412 INFO:tasks.workunit.client.0.smithi064.stdout:9/460: dwrite d2/dc/d24/d39/d42/d57/f46 [0,4194304] 0 2023-12-16T03:16:05.416 INFO:tasks.workunit.client.1.smithi184.stdout:7/745: mkdir d0/d3/d2e/d79/d32/d39/d9c/dc2/ddd 0 2023-12-16T03:16:05.416 INFO:tasks.workunit.client.1.smithi184.stdout:0/852: dwrite dc/d22/d1d/d43/fc7 [0,4194304] 0 2023-12-16T03:16:05.418 INFO:tasks.workunit.client.1.smithi184.stdout:1/805: rmdir d3/d34/dbc/d3c/d41/d63/de1 39 2023-12-16T03:16:05.419 INFO:tasks.workunit.client.1.smithi184.stdout:1/806: chown d3/d34/dbc/d3c/f25 27162 1 2023-12-16T03:16:05.419 INFO:tasks.workunit.client.1.smithi184.stdout:1/807: fsync d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/fb2 0 2023-12-16T03:16:05.422 INFO:tasks.workunit.client.0.smithi064.stdout:3/606: mkdir db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/dc9 0 2023-12-16T03:16:05.422 INFO:tasks.workunit.client.0.smithi064.stdout:3/607: stat db/d12/d1a/c41 0 2023-12-16T03:16:05.423 INFO:tasks.workunit.client.0.smithi064.stdout:1/501: mkdir d3/d36/d44/d4d/da8 0 2023-12-16T03:16:05.423 INFO:tasks.workunit.client.0.smithi064.stdout:1/502: readlink d3/dd/d2a/l31 0 2023-12-16T03:16:05.423 INFO:tasks.workunit.client.0.smithi064.stdout:1/503: fsync d3/d36/d44/d4d/d58/d96/f99 0 2023-12-16T03:16:05.423 INFO:tasks.workunit.client.1.smithi184.stdout:2/721: dwrite d3/d13/d28/fd0 [0,4194304] 0 2023-12-16T03:16:05.424 INFO:tasks.workunit.client.1.smithi184.stdout:2/722: dread - d3/d29/d2f/fd8 zero size 2023-12-16T03:16:05.427 INFO:tasks.workunit.client.0.smithi064.stdout:0/487: creat d2/d5b/f9c x:0 0 0 2023-12-16T03:16:05.427 INFO:tasks.workunit.client.0.smithi064.stdout:4/536: dwrite d0/d42/d56/fa5 [0,4194304] 0 2023-12-16T03:16:05.427 INFO:tasks.workunit.client.0.smithi064.stdout:4/537: write d0/d1e/d36/f7e [978303,33382] 0 2023-12-16T03:16:05.427 INFO:tasks.workunit.client.0.smithi064.stdout:4/538: chown d0/d42/ca8 2 1 2023-12-16T03:16:05.428 INFO:tasks.workunit.client.1.smithi184.stdout:8/883: dwrite d2/d12/d21/f53 [0,4194304] 0 2023-12-16T03:16:05.428 INFO:tasks.workunit.client.1.smithi184.stdout:3/962: dwrite d12/d18/d1f/d23/d2a/f38 [0,4194304] 0 2023-12-16T03:16:05.430 INFO:tasks.workunit.client.0.smithi064.stdout:6/462: unlink d3/d9/f20 0 2023-12-16T03:16:05.431 INFO:tasks.workunit.client.0.smithi064.stdout:6/463: write d3/d8/d13/d46/f77 [4085045,16957] 0 2023-12-16T03:16:05.431 INFO:tasks.workunit.client.0.smithi064.stdout:6/464: readlink d3/d8/l69 0 2023-12-16T03:16:05.431 INFO:tasks.workunit.client.0.smithi064.stdout:6/465: fsync d3/d8/d13/d58/f81 0 2023-12-16T03:16:05.433 INFO:tasks.workunit.client.0.smithi064.stdout:9/461: mkdir d2/d2d/d6c/d83/d93 0 2023-12-16T03:16:05.434 INFO:tasks.workunit.client.1.smithi184.stdout:2/723: symlink d3/d9/d19/lef 0 2023-12-16T03:16:05.435 INFO:tasks.workunit.client.0.smithi064.stdout:9/462: read f1 [580134,130736] 0 2023-12-16T03:16:05.436 INFO:tasks.workunit.client.1.smithi184.stdout:7/746: dwrite d0/d3/d2e/d79/d36/f4e [0,4194304] 0 2023-12-16T03:16:05.437 INFO:tasks.workunit.client.0.smithi064.stdout:1/504: creat d3/dd/d23/d60/fa9 x:0 0 0 2023-12-16T03:16:05.437 INFO:tasks.workunit.client.0.smithi064.stdout:1/505: chown d3/d22/d57/c5b 67834103 1 2023-12-16T03:16:05.437 INFO:tasks.workunit.client.0.smithi064.stdout:1/506: fdatasync d3/dd/d23/d4f/f8d 0 2023-12-16T03:16:05.437 INFO:tasks.workunit.client.0.smithi064.stdout:1/507: fsync d3/d36/d44/d4d/d58/d96/f98 0 2023-12-16T03:16:05.439 INFO:tasks.workunit.client.0.smithi064.stdout:6/466: write d3/fd [2715580,66204] 0 2023-12-16T03:16:05.440 INFO:tasks.workunit.client.0.smithi064.stdout:5/456: rename d0/de/d23/l4b to d0/la0 0 2023-12-16T03:16:05.442 INFO:tasks.workunit.client.1.smithi184.stdout:8/884: rename d2/d4/d10/d11/d72/lc9 to d2/d12/d21/d2d/l122 0 2023-12-16T03:16:05.443 INFO:tasks.workunit.client.0.smithi064.stdout:0/488: creat d2/d7/d10/d21/d7a/f9d x:0 0 0 2023-12-16T03:16:05.445 INFO:tasks.workunit.client.1.smithi184.stdout:3/963: getdents d12/d18/d1f/d23/d2a/d42/d52/d76/da5 0 2023-12-16T03:16:05.445 INFO:tasks.workunit.client.0.smithi064.stdout:3/608: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f66 [0,4194304] 0 2023-12-16T03:16:05.445 INFO:tasks.workunit.client.0.smithi064.stdout:3/609: readlink db/d12/d1a/d31/l70 0 2023-12-16T03:16:05.446 INFO:tasks.workunit.client.1.smithi184.stdout:3/964: read d12/d18/d1f/d23/d2a/d42/d52/d76/d80/fde [564488,34158] 0 2023-12-16T03:16:05.446 INFO:tasks.workunit.client.1.smithi184.stdout:7/747: dread d0/d3/d4/f2c [0,4194304] 0 2023-12-16T03:16:05.450 INFO:tasks.workunit.client.1.smithi184.stdout:7/748: rename d0/d3/d2e/d79/d32/d8a/f8e to d0/d3/d2e/d79/d1e/fde 0 2023-12-16T03:16:05.450 INFO:tasks.workunit.client.1.smithi184.stdout:7/749: dread - d0/d3/d2e/d79/d36/d3f/fcf zero size 2023-12-16T03:16:05.451 INFO:tasks.workunit.client.0.smithi064.stdout:4/539: creat d0/d42/d66/d33/fab x:0 0 0 2023-12-16T03:16:05.451 INFO:tasks.workunit.client.0.smithi064.stdout:4/540: fsync d0/d1e/f60 0 2023-12-16T03:16:05.452 INFO:tasks.workunit.client.1.smithi184.stdout:8/885: dread d2/d6a/da4/fc4 [0,4194304] 0 2023-12-16T03:16:05.454 INFO:tasks.workunit.client.1.smithi184.stdout:2/724: dwrite d3/d29/d4d/d5b/da6/fe0 [0,4194304] 0 2023-12-16T03:16:05.454 INFO:tasks.workunit.client.1.smithi184.stdout:7/750: unlink d0/d6b/d94/dbe/l4a 0 2023-12-16T03:16:05.454 INFO:tasks.workunit.client.1.smithi184.stdout:7/751: chown d0/d3/d2e/d79/dd/d27/l55 14926613 1 2023-12-16T03:16:05.455 INFO:tasks.workunit.client.1.smithi184.stdout:7/752: stat d0/d3/d2e/d79/d32/d39 0 2023-12-16T03:16:05.455 INFO:tasks.workunit.client.1.smithi184.stdout:7/753: chown d0/d3/d2e/d79/d32/d8a/lc3 2 1 2023-12-16T03:16:05.457 INFO:tasks.workunit.client.1.smithi184.stdout:3/965: dread d12/d37/fd1 [0,4194304] 0 2023-12-16T03:16:05.457 INFO:tasks.workunit.client.1.smithi184.stdout:8/886: symlink d2/d12/d21/d2d/d31/d34/d96/dca/l123 0 2023-12-16T03:16:05.458 INFO:tasks.workunit.client.1.smithi184.stdout:3/966: write d12/d86/de4/d99/d117/db4/f111 [3194101,34530] 0 2023-12-16T03:16:05.458 INFO:tasks.workunit.client.0.smithi064.stdout:1/508: mkdir d3/dd/d11/d3b/daa 0 2023-12-16T03:16:05.459 INFO:tasks.workunit.client.1.smithi184.stdout:3/967: read d12/d18/d1f/d23/d51/ffd [3973901,41108] 0 2023-12-16T03:16:05.459 INFO:tasks.workunit.client.1.smithi184.stdout:3/968: readlink d12/d1e/d89/le2 0 2023-12-16T03:16:05.462 INFO:tasks.workunit.client.0.smithi064.stdout:9/463: rmdir d2/dc/d24 39 2023-12-16T03:16:05.462 INFO:tasks.workunit.client.0.smithi064.stdout:9/464: chown d2/dc/d24/d39/d5e/d6f/l91 91014 1 2023-12-16T03:16:05.462 INFO:tasks.workunit.client.0.smithi064.stdout:9/465: fsync d2/dc/d24/d39/d5e/d6f/f84 0 2023-12-16T03:16:05.462 INFO:tasks.workunit.client.0.smithi064.stdout:9/466: dread - d2/dc/d24/d39/d42/f48 zero size 2023-12-16T03:16:05.462 INFO:tasks.workunit.client.0.smithi064.stdout:9/467: write d2/dc/f11 [3956892,65174] 0 2023-12-16T03:16:05.463 INFO:tasks.workunit.client.0.smithi064.stdout:6/467: creat d3/d8/d1f/d26/f83 x:0 0 0 2023-12-16T03:16:05.465 INFO:tasks.workunit.client.0.smithi064.stdout:7/517: rename d7/d3e/d42/d43/l88 to d7/d3e/d42/d48/d51/la4 0 2023-12-16T03:16:05.466 INFO:tasks.workunit.client.0.smithi064.stdout:7/518: write d7/f53 [31447,5744] 0 2023-12-16T03:16:05.468 INFO:tasks.workunit.client.0.smithi064.stdout:5/457: mknod d0/d19/d48/d8f/d3e/d35/d5d/ca1 0 2023-12-16T03:16:05.468 INFO:tasks.workunit.client.0.smithi064.stdout:5/458: fdatasync d0/d14/d20/d37/d70/f81 0 2023-12-16T03:16:05.469 INFO:tasks.workunit.client.1.smithi184.stdout:2/725: unlink d3/d13/d28/l7a 0 2023-12-16T03:16:05.471 INFO:tasks.workunit.client.0.smithi064.stdout:0/489: getdents d2/d29/d66 0 2023-12-16T03:16:05.473 INFO:tasks.workunit.client.1.smithi184.stdout:7/754: rename d0/fca to d0/d3/d2e/d79/d1e/fdf 0 2023-12-16T03:16:05.474 INFO:tasks.workunit.client.0.smithi064.stdout:3/610: symlink db/d12/d1a/d2c/lca 0 2023-12-16T03:16:05.474 INFO:tasks.workunit.client.0.smithi064.stdout:3/611: fsync db/d12/d1a/d2c/f5b 0 2023-12-16T03:16:05.474 INFO:tasks.workunit.client.0.smithi064.stdout:3/612: chown db/d4f/daa 2050201 1 2023-12-16T03:16:05.476 INFO:tasks.workunit.client.1.smithi184.stdout:3/969: creat d12/d18/d1f/d23/d2a/d42/d52/f167 x:0 0 0 2023-12-16T03:16:05.476 INFO:tasks.workunit.client.1.smithi184.stdout:3/970: stat d12/d18/f74 0 2023-12-16T03:16:05.476 INFO:tasks.workunit.client.1.smithi184.stdout:3/971: chown d12/d18/d1f/d23/d51/dd7/de3/l123 63 1 2023-12-16T03:16:05.476 INFO:tasks.workunit.client.0.smithi064.stdout:4/541: symlink d0/d1e/lac 0 2023-12-16T03:16:05.477 INFO:tasks.workunit.client.1.smithi184.stdout:2/726: mknod d3/d13/d28/d83/dda/cf0 0 2023-12-16T03:16:05.477 INFO:tasks.workunit.client.1.smithi184.stdout:2/727: dread - d3/d29/d2f/d46/fba zero size 2023-12-16T03:16:05.480 INFO:tasks.workunit.client.1.smithi184.stdout:8/887: rename d2/d4/da6/fe3 to d2/d4/d10/d2a/f124 0 2023-12-16T03:16:05.481 INFO:tasks.workunit.client.1.smithi184.stdout:3/972: mkdir d12/d1e/d89/dc2/d168 0 2023-12-16T03:16:05.482 INFO:tasks.workunit.client.0.smithi064.stdout:7/519: dwrite d7/d3e/d42/d48/d51/d7c/d52/f99 [0,4194304] 0 2023-12-16T03:16:05.488 INFO:tasks.workunit.client.1.smithi184.stdout:7/755: rename d0/d3/d2e/d79/dd/d27/fd1 to d0/d3/d2e/d79/d36/d84/dd2/fe0 0 2023-12-16T03:16:05.488 INFO:tasks.workunit.client.1.smithi184.stdout:7/756: chown d0/d6b/d69/fad 32687 1 2023-12-16T03:16:05.488 INFO:tasks.workunit.client.1.smithi184.stdout:7/757: fsync d0/d3/f64 0 2023-12-16T03:16:05.488 INFO:tasks.workunit.client.1.smithi184.stdout:2/728: dread d3/d29/d61/f68 [0,4194304] 0 2023-12-16T03:16:05.491 INFO:tasks.workunit.client.1.smithi184.stdout:2/729: dread d3/d13/d6e/fd5 [0,4194304] 0 2023-12-16T03:16:05.491 INFO:tasks.workunit.client.1.smithi184.stdout:8/888: mknod d2/d4/d10/d11/d72/dc2/c125 0 2023-12-16T03:16:05.494 INFO:tasks.workunit.client.1.smithi184.stdout:7/758: rename d0/d6b/d69/c9d to d0/d3/d2e/d79/d32/d39/d9c/ce1 0 2023-12-16T03:16:05.495 INFO:tasks.workunit.client.1.smithi184.stdout:7/759: read d0/d3/f81 [292705,118749] 0 2023-12-16T03:16:05.496 INFO:tasks.workunit.client.1.smithi184.stdout:8/889: symlink d2/d12/db4/l126 0 2023-12-16T03:16:05.496 INFO:tasks.workunit.client.1.smithi184.stdout:5/636: sync 2023-12-16T03:16:05.497 INFO:tasks.workunit.client.0.smithi064.stdout:9/468: mkdir d2/dc/d24/d39/d42/d94 0 2023-12-16T03:16:05.499 INFO:tasks.workunit.client.1.smithi184.stdout:7/760: symlink d0/d3/d2e/d79/d36/d84/dd2/le2 0 2023-12-16T03:16:05.500 INFO:tasks.workunit.client.0.smithi064.stdout:6/468: mknod d3/d8/c84 0 2023-12-16T03:16:05.500 INFO:tasks.workunit.client.0.smithi064.stdout:6/469: dread - d3/d8/d1f/d26/f83 zero size 2023-12-16T03:16:05.500 INFO:tasks.workunit.client.1.smithi184.stdout:4/805: sync 2023-12-16T03:16:05.501 INFO:tasks.workunit.client.1.smithi184.stdout:8/890: mknod d2/d4/d10/d99/c127 0 2023-12-16T03:16:05.503 INFO:tasks.workunit.client.0.smithi064.stdout:8/581: rename d0/d1d/d73/lb0 to d0/db/d37/d3a/dab/lcb 0 2023-12-16T03:16:05.504 INFO:tasks.workunit.client.1.smithi184.stdout:5/637: symlink d1/d3/d9/de/d15/d19/d53/ld0 0 2023-12-16T03:16:05.508 INFO:tasks.workunit.client.0.smithi064.stdout:5/459: rmdir d0/d7/d34 39 2023-12-16T03:16:05.509 INFO:tasks.workunit.client.1.smithi184.stdout:7/761: creat d0/d3/d2e/d79/d36/d3f/fe3 x:0 0 0 2023-12-16T03:16:05.509 INFO:tasks.workunit.client.1.smithi184.stdout:7/762: dread - d0/d3/d2e/d79/d1e/fba zero size 2023-12-16T03:16:05.513 INFO:tasks.workunit.client.1.smithi184.stdout:3/973: dwrite d12/d18/d1f/d23/d2a/f38 [0,4194304] 0 2023-12-16T03:16:05.513 INFO:tasks.workunit.client.1.smithi184.stdout:3/974: fdatasync d12/d18/d84/f133 0 2023-12-16T03:16:05.513 INFO:tasks.workunit.client.1.smithi184.stdout:2/730: dwrite d3/d9/d19/d87/f67 [0,4194304] 0 2023-12-16T03:16:05.513 INFO:tasks.workunit.client.1.smithi184.stdout:4/806: unlink d1/d29/d34/d5c/d76/d3b/f3f 0 2023-12-16T03:16:05.513 INFO:tasks.workunit.client.1.smithi184.stdout:4/807: fsync d1/d11/d5a/d63/d103/d5e/d6a/f97 0 2023-12-16T03:16:05.514 INFO:tasks.workunit.client.0.smithi064.stdout:3/613: symlink db/d12/d1a/d2c/db5/lcb 0 2023-12-16T03:16:05.514 INFO:tasks.workunit.client.0.smithi064.stdout:4/542: creat d0/d42/d66/d33/fad x:0 0 0 2023-12-16T03:16:05.514 INFO:tasks.workunit.client.1.smithi184.stdout:8/891: rmdir d2/d4/d10/d11/d77 39 2023-12-16T03:16:05.514 INFO:tasks.workunit.client.1.smithi184.stdout:8/892: truncate d2/d12/d21/d8a/dda/f98 2340131 0 2023-12-16T03:16:05.515 INFO:tasks.workunit.client.0.smithi064.stdout:9/469: dread d2/dc/d24/d39/d42/d57/f46 [0,4194304] 0 2023-12-16T03:16:05.516 INFO:tasks.workunit.client.0.smithi064.stdout:1/509: mkdir d3/d22/dab 0 2023-12-16T03:16:05.516 INFO:tasks.workunit.client.0.smithi064.stdout:1/510: stat d3/dd/d11/l93 0 2023-12-16T03:16:05.517 INFO:tasks.workunit.client.1.smithi184.stdout:5/638: rename d1/d3/d9/de/d15/l21 to d1/d3/d9/d49/ld1 0 2023-12-16T03:16:05.518 INFO:tasks.workunit.client.1.smithi184.stdout:5/639: fdatasync d1/d3/d9/de/d15/d19/d5f/f41 0 2023-12-16T03:16:05.523 INFO:tasks.workunit.client.1.smithi184.stdout:7/763: getdents d0/d3/d2e/d79/dd/d27 0 2023-12-16T03:16:05.523 INFO:tasks.workunit.client.1.smithi184.stdout:7/764: fdatasync d0/d3/d2e/d79/d1e/fba 0 2023-12-16T03:16:05.525 INFO:tasks.workunit.client.1.smithi184.stdout:2/731: dwrite d3/d29/d61/d6d/f90 [0,4194304] 0 2023-12-16T03:16:05.525 INFO:tasks.workunit.client.1.smithi184.stdout:2/732: chown d3/d13/ce1 227010530 1 2023-12-16T03:16:05.526 INFO:tasks.workunit.client.0.smithi064.stdout:2/415: sync 2023-12-16T03:16:05.526 INFO:tasks.workunit.client.0.smithi064.stdout:2/416: read - d1/d27/d2e/f74 zero size 2023-12-16T03:16:05.528 INFO:tasks.workunit.client.0.smithi064.stdout:0/490: rename d2/d7/d10/d21/d31/f59 to d2/d5b/d8b/f9e 0 2023-12-16T03:16:05.530 INFO:tasks.workunit.client.1.smithi184.stdout:3/975: creat d12/d18/db7/f169 x:0 0 0 2023-12-16T03:16:05.532 INFO:tasks.workunit.client.0.smithi064.stdout:8/582: mkdir d0/d1d/d24/d2f/d50/d70/dcc 0 2023-12-16T03:16:05.532 INFO:tasks.workunit.client.0.smithi064.stdout:8/583: truncate d0/db/d37/f61 4340302 0 2023-12-16T03:16:05.534 INFO:tasks.workunit.client.0.smithi064.stdout:6/470: rmdir d3/d8/d1f 39 2023-12-16T03:16:05.536 INFO:tasks.workunit.client.0.smithi064.stdout:5/460: mkdir d0/d14/d20/d37/d70/da2 0 2023-12-16T03:16:05.538 INFO:tasks.workunit.client.1.smithi184.stdout:4/808: rmdir d1/d11/d5a/d63/d72 39 2023-12-16T03:16:05.538 INFO:tasks.workunit.client.1.smithi184.stdout:4/809: getdents d1/d12 0 2023-12-16T03:16:05.539 INFO:tasks.workunit.client.0.smithi064.stdout:4/543: link d0/d42/d4c/d70/laa d0/d42/d4c/d70/d8c/lae 0 2023-12-16T03:16:05.540 INFO:tasks.workunit.client.1.smithi184.stdout:8/893: symlink d2/d37/d7c/l128 0 2023-12-16T03:16:05.542 INFO:tasks.workunit.client.0.smithi064.stdout:9/470: link d2/d2d/d3b/d3c/d4b/f4c d2/d2d/d6c/f95 0 2023-12-16T03:16:05.542 INFO:tasks.workunit.client.0.smithi064.stdout:9/471: chown d2/dc/l10 294810763 1 2023-12-16T03:16:05.542 INFO:tasks.workunit.client.0.smithi064.stdout:9/472: write d2/dc/d24/d39/d77/f88 [359774,34723] 0 2023-12-16T03:16:05.544 INFO:tasks.workunit.client.0.smithi064.stdout:1/511: truncate d3/f7b 4017281 0 2023-12-16T03:16:05.544 INFO:tasks.workunit.client.1.smithi184.stdout:5/640: read d1/d3/d9/de/d15/f1e [84189,38674] 0 2023-12-16T03:16:05.546 INFO:tasks.workunit.client.1.smithi184.stdout:7/765: rmdir d0/d3/d2e/d79/d32/d39/d9c 39 2023-12-16T03:16:05.546 INFO:tasks.workunit.client.1.smithi184.stdout:7/766: chown d0/d3/f64 724 1 2023-12-16T03:16:05.546 INFO:tasks.workunit.client.1.smithi184.stdout:7/767: chown d0/d3/d2e/d79/d32/fd4 20569 1 2023-12-16T03:16:05.547 INFO:tasks.workunit.client.1.smithi184.stdout:7/768: chown d0/d3/d2e/d79/d32/d39/c56 193041 1 2023-12-16T03:16:05.547 INFO:tasks.workunit.client.0.smithi064.stdout:1/512: dread d3/dd/d23/d4f/f8d [0,4194304] 0 2023-12-16T03:16:05.548 INFO:tasks.workunit.client.0.smithi064.stdout:4/544: dread d0/d42/d66/f5e [0,4194304] 0 2023-12-16T03:16:05.548 INFO:tasks.workunit.client.0.smithi064.stdout:7/520: rename d7/d3e/d42/d43/c96 to d7/d3e/ca5 0 2023-12-16T03:16:05.549 INFO:tasks.workunit.client.1.smithi184.stdout:2/733: mknod d3/d13/d28/dac/daf/dc8/cf1 0 2023-12-16T03:16:05.549 INFO:tasks.workunit.client.1.smithi184.stdout:2/734: fdatasync d3/d29/d61/fe7 0 2023-12-16T03:16:05.550 INFO:tasks.workunit.client.0.smithi064.stdout:0/491: getdents d2/d7/d10/d85/d88 0 2023-12-16T03:16:05.555 INFO:tasks.workunit.client.0.smithi064.stdout:6/471: creat d3/d8/da/f85 x:0 0 0 2023-12-16T03:16:05.556 INFO:tasks.workunit.client.1.smithi184.stdout:8/894: dwrite d2/d37/d7c/dd7/ff8 [0,4194304] 0 2023-12-16T03:16:05.558 INFO:tasks.workunit.client.0.smithi064.stdout:5/461: mknod d0/d14/ca3 0 2023-12-16T03:16:05.559 INFO:tasks.workunit.client.1.smithi184.stdout:3/976: mkdir d12/d18/d1f/d23/d166/d16a 0 2023-12-16T03:16:05.559 INFO:tasks.workunit.client.1.smithi184.stdout:8/895: dread d2/d12/d21/d8a/dda/f98 [0,4194304] 0 2023-12-16T03:16:05.560 INFO:tasks.workunit.client.1.smithi184.stdout:3/977: chown d12/d37/f6d 53 1 2023-12-16T03:16:05.562 INFO:tasks.workunit.client.0.smithi064.stdout:3/614: dread db/d12/d4e/d56/f7a [0,4194304] 0 2023-12-16T03:16:05.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/810: mknod d1/d11/d5a/d63/c116 0 2023-12-16T03:16:05.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/811: dread - d1/d11/d5a/d63/d103/d45/dcf/de6/d107/f114 zero size 2023-12-16T03:16:05.563 INFO:tasks.workunit.client.0.smithi064.stdout:8/584: rmdir d0/d1d/d24 39 2023-12-16T03:16:05.564 INFO:tasks.workunit.client.0.smithi064.stdout:9/473: creat d2/d2d/d6c/d83/f96 x:0 0 0 2023-12-16T03:16:05.565 INFO:tasks.workunit.client.0.smithi064.stdout:9/474: write d2/dc/d24/d39/d5e/f73 [927043,91274] 0 2023-12-16T03:16:05.567 INFO:tasks.workunit.client.1.smithi184.stdout:6/939: sync 2023-12-16T03:16:05.567 INFO:tasks.workunit.client.1.smithi184.stdout:6/940: truncate d0/d5/d22/d25/d47/f99 636010 0 2023-12-16T03:16:05.568 INFO:tasks.workunit.client.0.smithi064.stdout:4/545: rename d0/d42/d66/f5e to d0/d42/d66/faf 0 2023-12-16T03:16:05.568 INFO:tasks.workunit.client.0.smithi064.stdout:4/546: read - d0/d1e/f69 zero size 2023-12-16T03:16:05.568 INFO:tasks.workunit.client.0.smithi064.stdout:4/547: write d0/d42/d4c/d70/f7d [684568,91849] 0 2023-12-16T03:16:05.568 INFO:tasks.workunit.client.1.smithi184.stdout:5/641: mkdir d1/d3/d9/de/d15/d27/dd2 0 2023-12-16T03:16:05.568 INFO:tasks.workunit.client.1.smithi184.stdout:5/642: readlink d1/d3/d9/de/d30/l92 0 2023-12-16T03:16:05.570 INFO:tasks.workunit.client.1.smithi184.stdout:4/812: dread d1/d11/d1b/f87 [0,4194304] 0 2023-12-16T03:16:05.570 INFO:tasks.workunit.client.1.smithi184.stdout:4/813: stat d1/d11/d5a/d63/l86 0 2023-12-16T03:16:05.570 INFO:tasks.workunit.client.0.smithi064.stdout:2/417: rename d1/f1d to d1/d76/d57/f80 0 2023-12-16T03:16:05.571 INFO:tasks.workunit.client.0.smithi064.stdout:7/521: dwrite d7/d3e/d42/d43/f5f [0,4194304] 0 2023-12-16T03:16:05.571 INFO:tasks.workunit.client.0.smithi064.stdout:7/522: stat d7/d3e/d42/f73 0 2023-12-16T03:16:05.571 INFO:tasks.workunit.client.1.smithi184.stdout:7/769: mkdir d0/d6b/d69/db5/de4 0 2023-12-16T03:16:05.572 INFO:tasks.workunit.client.0.smithi064.stdout:6/472: mkdir d3/d8/d1f/d26/d47/d4a/d67/d86 0 2023-12-16T03:16:05.573 INFO:tasks.workunit.client.1.smithi184.stdout:2/735: creat d3/d29/d2f/d46/d77/ff2 x:0 0 0 2023-12-16T03:16:05.573 INFO:tasks.workunit.client.0.smithi064.stdout:5/462: symlink d0/d50/la4 0 2023-12-16T03:16:05.574 INFO:tasks.workunit.client.0.smithi064.stdout:3/615: mknod db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/da4/ccc 0 2023-12-16T03:16:05.574 INFO:tasks.workunit.client.0.smithi064.stdout:3/616: write db/d4f/faf [5735220,112506] 0 2023-12-16T03:16:05.575 INFO:tasks.workunit.client.1.smithi184.stdout:3/978: creat d12/d18/d1f/d23/d166/f16b x:0 0 0 2023-12-16T03:16:05.575 INFO:tasks.workunit.client.1.smithi184.stdout:3/979: write d12/d18/d1f/d23/d51/f5a [522878,4315] 0 2023-12-16T03:16:05.575 INFO:tasks.workunit.client.1.smithi184.stdout:3/980: write d12/d18/d1f/d23/d2a/dfc/f14d [745589,112595] 0 2023-12-16T03:16:05.576 INFO:tasks.workunit.client.0.smithi064.stdout:9/475: mknod d2/d7e/c97 0 2023-12-16T03:16:05.577 INFO:tasks.workunit.client.1.smithi184.stdout:8/896: dread d2/d4/d10/d11/d77/f82 [0,4194304] 0 2023-12-16T03:16:05.578 INFO:tasks.workunit.client.0.smithi064.stdout:4/548: unlink d0/cc 0 2023-12-16T03:16:05.579 INFO:tasks.workunit.client.0.smithi064.stdout:8/585: dwrite d0/db/d12/d44/d68/fc6 [0,4194304] 0 2023-12-16T03:16:05.581 INFO:tasks.workunit.client.1.smithi184.stdout:7/770: dread d0/d3/d2e/d79/d32/d39/f3e [0,4194304] 0 2023-12-16T03:16:05.582 INFO:tasks.workunit.client.0.smithi064.stdout:1/513: rename d3/d36/d44/d4d/d58/l89 to d3/d36/d44/d4d/da8/lac 0 2023-12-16T03:16:05.586 INFO:tasks.workunit.client.1.smithi184.stdout:5/643: symlink d1/d2a/d31/d58/daf/ld3 0 2023-12-16T03:16:05.587 INFO:tasks.workunit.client.0.smithi064.stdout:2/418: mknod d1/d15/d1b/d49/d4e/c81 0 2023-12-16T03:16:05.590 INFO:tasks.workunit.client.0.smithi064.stdout:9/476: dread d2/d2d/d3b/d3c/f20 [0,4194304] 0 2023-12-16T03:16:05.590 INFO:tasks.workunit.client.0.smithi064.stdout:9/477: chown d2/d2d/d3b/d3c/d34/f37 3 1 2023-12-16T03:16:05.594 INFO:tasks.workunit.client.1.smithi184.stdout:3/981: dwrite d12/d18/da1/f140 [4194304,4194304] 0 2023-12-16T03:16:05.596 INFO:tasks.workunit.client.1.smithi184.stdout:3/982: write d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f60 [2311154,72113] 0 2023-12-16T03:16:05.596 INFO:tasks.workunit.client.1.smithi184.stdout:3/983: stat d12/d1e/de8/ld3 0 2023-12-16T03:16:05.596 INFO:tasks.workunit.client.1.smithi184.stdout:3/984: chown d12/d37/f14a 0 1 2023-12-16T03:16:05.596 INFO:tasks.workunit.client.1.smithi184.stdout:3/985: truncate d12/d18/d1f/d23/d2a/f2f 1054182 0 2023-12-16T03:16:05.597 INFO:tasks.workunit.client.1.smithi184.stdout:3/986: fsync d12/d18/d1f/d23/d51/f5a 0 2023-12-16T03:16:05.625 INFO:tasks.workunit.client.1.smithi184.stdout:4/814: rename d1/d12/d13/f94 to d1/d29/d34/f117 0 2023-12-16T03:16:05.625 INFO:tasks.workunit.client.0.smithi064.stdout:7/523: creat d7/d26/d95/fa6 x:0 0 0 2023-12-16T03:16:05.628 INFO:tasks.workunit.client.1.smithi184.stdout:2/736: symlink d3/d13/ddf/lf3 0 2023-12-16T03:16:05.628 INFO:tasks.workunit.client.1.smithi184.stdout:2/737: truncate d3/d29/d2f/f45 1528798 0 2023-12-16T03:16:05.629 INFO:tasks.workunit.client.0.smithi064.stdout:6/473: creat d3/d8/d13/d46/f87 x:0 0 0 2023-12-16T03:16:05.630 INFO:tasks.workunit.client.1.smithi184.stdout:8/897: unlink d2/d12/d21/d8a/dda/d73/fb3 0 2023-12-16T03:16:05.630 INFO:tasks.workunit.client.1.smithi184.stdout:8/898: truncate d2/d12/d21/d2d/d31/f8f 24401 0 2023-12-16T03:16:05.631 INFO:tasks.workunit.client.0.smithi064.stdout:5/463: rmdir d0/d19/d48 39 2023-12-16T03:16:05.632 INFO:tasks.workunit.client.0.smithi064.stdout:5/464: chown d0/d7/d34/f83 48 1 2023-12-16T03:16:05.636 INFO:tasks.workunit.client.1.smithi184.stdout:7/771: link d0/d3/d4/f5e d0/d3/d2e/d79/d32/d39/d8f/fe5 0 2023-12-16T03:16:05.636 INFO:tasks.workunit.client.1.smithi184.stdout:7/772: readlink d0/d3/d2e/d79/d32/d39/d8f/lbc 0 2023-12-16T03:16:05.637 INFO:tasks.workunit.client.0.smithi064.stdout:3/617: mkdir db/d12/d1a/d2c/d34/dcd 0 2023-12-16T03:16:05.637 INFO:tasks.workunit.client.0.smithi064.stdout:3/618: chown db/d12/d1a/d2c/d34/d4c/d6a/fc7 7053 1 2023-12-16T03:16:05.638 INFO:tasks.workunit.client.1.smithi184.stdout:0/853: sync 2023-12-16T03:16:05.638 INFO:tasks.workunit.client.1.smithi184.stdout:1/808: sync 2023-12-16T03:16:05.639 INFO:tasks.workunit.client.1.smithi184.stdout:5/644: getdents d1/d3/d9/d2e 0 2023-12-16T03:16:05.640 INFO:tasks.workunit.client.1.smithi184.stdout:6/941: write d0/d5/d22/d25/dbf/dbe/de1/f107 [6175557,111198] 0 2023-12-16T03:16:05.642 INFO:tasks.workunit.client.1.smithi184.stdout:0/854: dread dc/d10/d1c/f2f [0,4194304] 0 2023-12-16T03:16:05.647 INFO:tasks.workunit.client.0.smithi064.stdout:0/492: rename d2/d7/d10/f7e to d2/d29/f9f 0 2023-12-16T03:16:05.649 INFO:tasks.workunit.client.0.smithi064.stdout:1/514: mkdir d3/d36/d44/d4d/dad 0 2023-12-16T03:16:05.654 INFO:tasks.workunit.client.0.smithi064.stdout:2/419: mknod d1/d15/d1b/c82 0 2023-12-16T03:16:05.657 INFO:tasks.workunit.client.1.smithi184.stdout:4/815: creat d1/d12/db3/db8/f118 x:0 0 0 2023-12-16T03:16:05.658 INFO:tasks.workunit.client.1.smithi184.stdout:4/816: chown d1/d11/d5a/d63/d72/d98 110032 1 2023-12-16T03:16:05.658 INFO:tasks.workunit.client.0.smithi064.stdout:9/478: mkdir d2/d2d/d6b/d8b/d98 0 2023-12-16T03:16:05.659 INFO:tasks.workunit.client.1.smithi184.stdout:2/738: rmdir d3/d9/d19/d82 39 2023-12-16T03:16:05.659 INFO:tasks.workunit.client.0.smithi064.stdout:6/474: symlink d3/l88 0 2023-12-16T03:16:05.660 INFO:tasks.workunit.client.1.smithi184.stdout:8/899: mkdir d2/d37/d7c/ddc/de6/d129 0 2023-12-16T03:16:05.661 INFO:tasks.workunit.client.0.smithi064.stdout:3/619: link ca db/d12/d1a/d2c/d34/d4c/d6a/d93/cce 0 2023-12-16T03:16:05.663 INFO:tasks.workunit.client.0.smithi064.stdout:5/465: dwrite d0/d50/d39/f7c [0,4194304] 0 2023-12-16T03:16:05.664 INFO:tasks.workunit.client.1.smithi184.stdout:7/773: mknod d0/ce6 0 2023-12-16T03:16:05.666 INFO:tasks.workunit.client.0.smithi064.stdout:4/549: rename d0/d42/d4c/d70/f91 to d0/d42/d56/fb0 0 2023-12-16T03:16:05.666 INFO:tasks.workunit.client.0.smithi064.stdout:4/550: chown d0/l6 349554029 1 2023-12-16T03:16:05.666 INFO:tasks.workunit.client.0.smithi064.stdout:4/551: stat d0/f2 0 2023-12-16T03:16:05.666 INFO:tasks.workunit.client.0.smithi064.stdout:4/552: write d0/f5 [4833446,18884] 0 2023-12-16T03:16:05.667 INFO:tasks.workunit.client.1.smithi184.stdout:2/739: dread d3/d29/d2f/d46/d77/f7f [0,4194304] 0 2023-12-16T03:16:05.667 INFO:tasks.workunit.client.1.smithi184.stdout:2/740: fsync d3/d9/d19/d82/fa8 0 2023-12-16T03:16:05.667 INFO:tasks.workunit.client.1.smithi184.stdout:2/741: stat d3/d29/d4d/d5b/f89 0 2023-12-16T03:16:05.667 INFO:tasks.workunit.client.1.smithi184.stdout:2/742: write d3/d29/d2f/f8b [892385,34985] 0 2023-12-16T03:16:05.667 INFO:tasks.workunit.client.1.smithi184.stdout:7/774: write d0/d3/d2e/d79/d1e/f20 [6040618,21819] 0 2023-12-16T03:16:05.667 INFO:tasks.workunit.client.1.smithi184.stdout:1/809: link d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/ce5 d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d/c118 0 2023-12-16T03:16:05.668 INFO:tasks.workunit.client.0.smithi064.stdout:0/493: mkdir d2/d7/d10/d85/d88/da0 0 2023-12-16T03:16:05.670 INFO:tasks.workunit.client.1.smithi184.stdout:5/645: truncate d1/d3/d9/d49/d74/f75 461692 0 2023-12-16T03:16:05.670 INFO:tasks.workunit.client.1.smithi184.stdout:5/646: read - d1/d3/d9/de/d15/d90/fcf zero size 2023-12-16T03:16:05.670 INFO:tasks.workunit.client.1.smithi184.stdout:5/647: write d1/d3/d9/de/d15/d19/f1d [4499092,44774] 0 2023-12-16T03:16:05.671 INFO:tasks.workunit.client.0.smithi064.stdout:1/515: creat d3/d36/d44/d4d/fae x:0 0 0 2023-12-16T03:16:05.671 INFO:tasks.workunit.client.0.smithi064.stdout:1/516: chown d3/dd/d11/d3b/f5e 476327304 1 2023-12-16T03:16:05.673 INFO:tasks.workunit.client.1.smithi184.stdout:6/942: symlink d0/d5/d22/d25/d3f/d6f/da8/l131 0 2023-12-16T03:16:05.675 INFO:tasks.workunit.client.0.smithi064.stdout:2/420: symlink d1/d15/d7d/l83 0 2023-12-16T03:16:05.675 INFO:tasks.workunit.client.0.smithi064.stdout:2/421: stat d1/d15/d67 0 2023-12-16T03:16:05.675 INFO:tasks.workunit.client.0.smithi064.stdout:2/422: chown d1/d76/d57/l6e 47 1 2023-12-16T03:16:05.677 INFO:tasks.workunit.client.1.smithi184.stdout:0/855: mknod dc/d22/d1d/d2c/c124 0 2023-12-16T03:16:05.681 INFO:tasks.workunit.client.1.smithi184.stdout:4/817: truncate d1/d11/d5a/d63/d103/d5e/fa8 2875937 0 2023-12-16T03:16:05.682 INFO:tasks.workunit.client.0.smithi064.stdout:9/479: creat d2/d2d/d3b/d3c/d34/f99 x:0 0 0 2023-12-16T03:16:05.682 INFO:tasks.workunit.client.0.smithi064.stdout:6/475: fdatasync d3/d8/da/f37 0 2023-12-16T03:16:05.684 INFO:tasks.workunit.client.0.smithi064.stdout:4/553: dread d0/d42/d66/f30 [0,4194304] 0 2023-12-16T03:16:05.684 INFO:tasks.workunit.client.1.smithi184.stdout:8/900: symlink d2/d12/d21/d8a/dda/l12a 0 2023-12-16T03:16:05.685 INFO:tasks.workunit.client.0.smithi064.stdout:3/620: mkdir db/d4f/da9/dbf/dcf 0 2023-12-16T03:16:05.686 INFO:tasks.workunit.client.0.smithi064.stdout:6/476: dread d3/d8/d13/f24 [0,4194304] 0 2023-12-16T03:16:05.687 INFO:tasks.workunit.client.1.smithi184.stdout:2/743: dread d3/d9/f27 [0,4194304] 0 2023-12-16T03:16:05.688 INFO:tasks.workunit.client.1.smithi184.stdout:2/744: chown d3 11184936 1 2023-12-16T03:16:05.689 INFO:tasks.workunit.client.1.smithi184.stdout:1/810: dwrite d3/d34/dbc/d3c/f7c [0,4194304] 0 2023-12-16T03:16:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:05 smithi064 ceph-mon[111958]: pgmap v197: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 172 MiB/s rd, 367 MiB/s wr, 577 op/s 2023-12-16T03:16:05.693 INFO:tasks.workunit.client.1.smithi184.stdout:7/775: link d0/d6b/d69/fa4 d0/d3/d2e/d79/d32/d39/d9c/fe7 0 2023-12-16T03:16:05.694 INFO:tasks.workunit.client.1.smithi184.stdout:5/648: rename d1/d3/d2f/dc1 to d1/d3/d9/de/d30/d80/dd4 0 2023-12-16T03:16:05.694 INFO:tasks.workunit.client.1.smithi184.stdout:5/649: chown d1/d3/d9/de/d15/d90/fa3 141623255 1 2023-12-16T03:16:05.694 INFO:tasks.workunit.client.1.smithi184.stdout:3/987: sync 2023-12-16T03:16:05.695 INFO:tasks.workunit.client.1.smithi184.stdout:3/988: fsync d12/d1e/f2d 0 2023-12-16T03:16:05.695 INFO:tasks.workunit.client.1.smithi184.stdout:4/818: dread d1/d11/d1b/d1e/f5d [0,4194304] 0 2023-12-16T03:16:05.695 INFO:tasks.workunit.client.1.smithi184.stdout:4/819: write d1/d11/d5a/d63/d103/d5e/fba [1658600,21386] 0 2023-12-16T03:16:05.696 INFO:tasks.workunit.client.0.smithi064.stdout:5/466: mkdir d0/d50/d39/da5 0 2023-12-16T03:16:05.697 INFO:tasks.workunit.client.1.smithi184.stdout:6/943: creat d0/d5/d12/d1b/d33/d3d/d96/f132 x:0 0 0 2023-12-16T03:16:05.697 INFO:tasks.workunit.client.1.smithi184.stdout:6/944: chown d0/d5/d12/d1b/d33/d3d/l103 0 1 2023-12-16T03:16:05.699 INFO:tasks.workunit.client.0.smithi064.stdout:7/524: rename d7/d3e/d42/d48/d51/d7c/c8e to d7/d26/d30/ca7 0 2023-12-16T03:16:05.699 INFO:tasks.workunit.client.0.smithi064.stdout:7/525: chown d7/d3e/d42/d48/d51/d7c/l65 55 1 2023-12-16T03:16:05.700 INFO:tasks.workunit.client.0.smithi064.stdout:7/526: read - d7/d3e/d42/d89/f7a zero size 2023-12-16T03:16:05.700 INFO:tasks.workunit.client.0.smithi064.stdout:7/527: chown d7/d3e/d42/d43/f5f 14967 1 2023-12-16T03:16:05.700 INFO:tasks.workunit.client.0.smithi064.stdout:7/528: fdatasync d7/d3e/d42/d48/d51/d7c/f94 0 2023-12-16T03:16:05.700 INFO:tasks.workunit.client.1.smithi184.stdout:0/856: symlink dc/d22/d1a/l125 0 2023-12-16T03:16:05.700 INFO:tasks.workunit.client.1.smithi184.stdout:0/857: write dc/d10/d1c/fe6 [709955,3338] 0 2023-12-16T03:16:05.701 INFO:tasks.workunit.client.1.smithi184.stdout:1/811: dread d3/d34/dbc/d3c/d41/d77/fba [0,4194304] 0 2023-12-16T03:16:05.701 INFO:tasks.workunit.client.1.smithi184.stdout:1/812: fsync d3/d34/dbc/d36/f9b 0 2023-12-16T03:16:05.703 INFO:tasks.workunit.client.0.smithi064.stdout:4/554: mknod d0/d42/d4c/cb1 0 2023-12-16T03:16:05.704 INFO:tasks.workunit.client.1.smithi184.stdout:2/745: symlink d3/d29/d4d/d5b/da6/lf4 0 2023-12-16T03:16:05.704 INFO:tasks.workunit.client.1.smithi184.stdout:2/746: chown d3/d29/d2f/d2e/dcb 3 1 2023-12-16T03:16:05.704 INFO:tasks.workunit.client.0.smithi064.stdout:3/621: creat db/d12/d1a/d2c/d34/d4c/d6a/da7/fd0 x:0 0 0 2023-12-16T03:16:05.706 INFO:tasks.workunit.client.0.smithi064.stdout:6/477: getdents d3/d8/d1f/d26/d47/d4a/d67/d73 0 2023-12-16T03:16:05.707 INFO:tasks.workunit.client.1.smithi184.stdout:5/650: write d1/d3/d9/de/d15/d19/d53/f8c [935638,114754] 0 2023-12-16T03:16:05.707 INFO:tasks.workunit.client.1.smithi184.stdout:5/651: stat d1/d3/d9/de/d15/d19/d5f/d45/c7d 0 2023-12-16T03:16:05.707 INFO:tasks.workunit.client.0.smithi064.stdout:5/467: symlink d0/d50/d99/la6 0 2023-12-16T03:16:05.707 INFO:tasks.workunit.client.0.smithi064.stdout:5/468: chown d0/d19/d48/f69 60983 1 2023-12-16T03:16:05.708 INFO:tasks.workunit.client.0.smithi064.stdout:9/480: rename d2/d2d/d6b to d2/dc/d24/d39/d42/d9a 0 2023-12-16T03:16:05.710 INFO:tasks.workunit.client.0.smithi064.stdout:4/555: write d0/da/f6d [388103,10675] 0 2023-12-16T03:16:05.710 INFO:tasks.workunit.client.0.smithi064.stdout:9/481: write d2/dc/f15 [496776,10587] 0 2023-12-16T03:16:05.710 INFO:tasks.workunit.client.1.smithi184.stdout:7/776: rename d0/d3/f7 to d0/d3/d2e/d79/d32/d39/fe8 0 2023-12-16T03:16:05.711 INFO:tasks.workunit.client.0.smithi064.stdout:7/529: creat d7/d3e/d42/d48/d51/d7c/d52/fa8 x:0 0 0 2023-12-16T03:16:05.713 INFO:tasks.workunit.client.1.smithi184.stdout:3/989: creat d12/d18/d1f/d23/d166/f16c x:0 0 0 2023-12-16T03:16:05.714 INFO:tasks.workunit.client.0.smithi064.stdout:3/622: mkdir db/d4f/d51/dd1 0 2023-12-16T03:16:05.717 INFO:tasks.workunit.client.0.smithi064.stdout:3/623: write db/d12/d1a/d2c/d34/f8b [578121,79302] 0 2023-12-16T03:16:05.718 INFO:tasks.workunit.client.1.smithi184.stdout:4/820: creat d1/d29/d34/f119 x:0 0 0 2023-12-16T03:16:05.718 INFO:tasks.workunit.client.1.smithi184.stdout:4/821: fdatasync d1/d12/db3/db8/dd0/fe4 0 2023-12-16T03:16:05.719 INFO:tasks.workunit.client.0.smithi064.stdout:1/517: dwrite d3/d36/d44/d4d/d58/f6e [0,4194304] 0 2023-12-16T03:16:05.723 INFO:tasks.workunit.client.0.smithi064.stdout:4/556: link d0/da/ca2 d0/d12/cb2 0 2023-12-16T03:16:05.723 INFO:tasks.workunit.client.0.smithi064.stdout:4/557: chown d0/c7 5 1 2023-12-16T03:16:05.726 INFO:tasks.workunit.client.1.smithi184.stdout:6/945: symlink d0/d5/d12/d1b/d33/d3d/da2/l133 0 2023-12-16T03:16:05.726 INFO:tasks.workunit.client.1.smithi184.stdout:0/858: link dc/d22/d1d/d43/d5a/d60/le1 dc/d22/d1d/d43/d5a/d60/l126 0 2023-12-16T03:16:05.726 INFO:tasks.workunit.client.1.smithi184.stdout:8/901: dwrite d2/d37/f4c [8388608,4194304] 0 2023-12-16T03:16:05.729 INFO:tasks.workunit.client.0.smithi064.stdout:2/423: dwrite d1/d15/d1b/d61/d63/f6d [0,4194304] 0 2023-12-16T03:16:05.729 INFO:tasks.workunit.client.0.smithi064.stdout:3/624: truncate db/d4f/faf 2806650 0 2023-12-16T03:16:05.729 INFO:tasks.workunit.client.1.smithi184.stdout:1/813: mknod d3/d34/dbc/d36/d9f/c119 0 2023-12-16T03:16:05.730 INFO:tasks.workunit.client.1.smithi184.stdout:1/814: fsync d3/d34/dbc/d38/f73 0 2023-12-16T03:16:05.730 INFO:tasks.workunit.client.1.smithi184.stdout:2/747: stat d3/c41 0 2023-12-16T03:16:05.730 INFO:tasks.workunit.client.1.smithi184.stdout:2/748: readlink d3/d13/d28/d83/la2 0 2023-12-16T03:16:05.730 INFO:tasks.workunit.client.1.smithi184.stdout:2/749: chown d3/d29/d2f/le2 4984325 1 2023-12-16T03:16:05.733 INFO:tasks.workunit.client.0.smithi064.stdout:2/424: getdents d1/d15/d7d 0 2023-12-16T03:16:05.734 INFO:tasks.workunit.client.0.smithi064.stdout:7/530: write d7/d26/d30/f33 [1465106,116894] 0 2023-12-16T03:16:05.736 INFO:tasks.workunit.client.0.smithi064.stdout:3/625: mkdir db/d4f/d51/dd2 0 2023-12-16T03:16:05.736 INFO:tasks.workunit.client.0.smithi064.stdout:3/626: truncate db/d12/d4e/f73 653808 0 2023-12-16T03:16:05.736 INFO:tasks.workunit.client.0.smithi064.stdout:3/627: getdents db/d12/d1a/d2c/d34/dcd 0 2023-12-16T03:16:05.737 INFO:tasks.workunit.client.1.smithi184.stdout:5/652: mknod d1/d3/d9/de/cd5 0 2023-12-16T03:16:05.737 INFO:tasks.workunit.client.1.smithi184.stdout:7/777: symlink d0/d3/d2e/d79/d36/d3f/le9 0 2023-12-16T03:16:05.738 INFO:tasks.workunit.client.1.smithi184.stdout:8/902: write d2/d4/d10/d11/f15 [5536045,83951] 0 2023-12-16T03:16:05.738 INFO:tasks.workunit.client.1.smithi184.stdout:4/822: rename d1/d11/d5a/d63/d72/lbc to d1/d12/d13/l11a 0 2023-12-16T03:16:05.738 INFO:tasks.workunit.client.1.smithi184.stdout:4/823: truncate d1/d11/d5a/d63/d103/d5e/fd9 1288 0 2023-12-16T03:16:05.739 INFO:tasks.workunit.client.1.smithi184.stdout:8/903: write d2/fe2 [900795,79006] 0 2023-12-16T03:16:05.740 INFO:tasks.workunit.client.0.smithi064.stdout:2/425: getdents d1/d15/d1b/d49 0 2023-12-16T03:16:05.740 INFO:tasks.workunit.client.0.smithi064.stdout:2/426: stat d1/d15/d1b/d49 0 2023-12-16T03:16:05.743 INFO:tasks.workunit.client.1.smithi184.stdout:6/946: rmdir d0/d5/d42 39 2023-12-16T03:16:05.745 INFO:tasks.workunit.client.0.smithi064.stdout:7/531: symlink d7/la9 0 2023-12-16T03:16:05.745 INFO:tasks.workunit.client.0.smithi064.stdout:7/532: chown d7/d26/l61 124511168 1 2023-12-16T03:16:05.745 INFO:tasks.workunit.client.0.smithi064.stdout:7/533: chown d7/d3e/d42/d48/c5c 394293 1 2023-12-16T03:16:05.745 INFO:tasks.workunit.client.0.smithi064.stdout:7/534: fsync d7/d3e/d42/d43/f90 0 2023-12-16T03:16:05.745 INFO:tasks.workunit.client.0.smithi064.stdout:7/535: chown d7/d3e/d42/d89/d74/f81 21 1 2023-12-16T03:16:05.745 INFO:tasks.workunit.client.0.smithi064.stdout:7/536: chown d7/d26/d95 41 1 2023-12-16T03:16:05.746 INFO:tasks.workunit.client.1.smithi184.stdout:0/859: creat dc/d22/f127 x:0 0 0 2023-12-16T03:16:05.746 INFO:tasks.workunit.client.0.smithi064.stdout:3/628: mkdir db/d4f/d51/dd1/dd3 0 2023-12-16T03:16:05.746 INFO:tasks.workunit.client.0.smithi064.stdout:3/629: write db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f78 [1435040,20991] 0 2023-12-16T03:16:05.749 INFO:tasks.workunit.client.0.smithi064.stdout:2/427: creat d1/d27/f84 x:0 0 0 2023-12-16T03:16:05.750 INFO:tasks.workunit.client.1.smithi184.stdout:1/815: creat d3/d34/dbc/d3c/d41/d63/de1/f11a x:0 0 0 2023-12-16T03:16:05.754 INFO:tasks.workunit.client.1.smithi184.stdout:2/750: creat d3/d29/d4d/ff5 x:0 0 0 2023-12-16T03:16:05.754 INFO:tasks.workunit.client.1.smithi184.stdout:5/653: creat d1/d3/d9/de/d15/db9/fd6 x:0 0 0 2023-12-16T03:16:05.756 INFO:tasks.workunit.client.0.smithi064.stdout:3/630: rename db/d12/d1a/d2c/l7c to db/d4f/d51/dd1/dd3/ld4 0 2023-12-16T03:16:05.756 INFO:tasks.workunit.client.1.smithi184.stdout:7/778: dread d0/d3/f64 [0,4194304] 0 2023-12-16T03:16:05.756 INFO:tasks.workunit.client.1.smithi184.stdout:7/779: write d0/d3/d2e/d79/dd/fc6 [420878,32825] 0 2023-12-16T03:16:05.756 INFO:tasks.workunit.client.1.smithi184.stdout:7/780: chown d0/d3/d2e/d79/d1e/l5a 3779442 1 2023-12-16T03:16:05.757 INFO:tasks.workunit.client.1.smithi184.stdout:4/824: mknod d1/d29/d34/d5c/d76/d33/c11b 0 2023-12-16T03:16:05.757 INFO:tasks.workunit.client.1.smithi184.stdout:4/825: readlink d1/d29/d34/d5c/d76/d42/l64 0 2023-12-16T03:16:05.757 INFO:tasks.workunit.client.1.smithi184.stdout:4/826: dread - d1/d12/db3/f106 zero size 2023-12-16T03:16:05.757 INFO:tasks.workunit.client.1.smithi184.stdout:2/751: dread d3/d13/d6e/fd5 [0,4194304] 0 2023-12-16T03:16:05.757 INFO:tasks.workunit.client.1.smithi184.stdout:2/752: chown d3/d13/c44 9337 1 2023-12-16T03:16:05.757 INFO:tasks.workunit.client.0.smithi064.stdout:6/478: dwrite d3/d8/d13/f7b [0,4194304] 0 2023-12-16T03:16:05.758 INFO:tasks.workunit.client.1.smithi184.stdout:8/904: creat d2/d4/d10/f12b x:0 0 0 2023-12-16T03:16:05.758 INFO:tasks.workunit.client.1.smithi184.stdout:8/905: write d2/d4/d10/d7a/ff7 [578830,113404] 0 2023-12-16T03:16:05.758 INFO:tasks.workunit.client.1.smithi184.stdout:8/906: chown d2/d12/d21/d2d/d31/d34/d96 1 1 2023-12-16T03:16:05.758 INFO:tasks.workunit.client.1.smithi184.stdout:8/907: write d2/d12/d21/d8a/dda/d73/fe7 [1468130,40582] 0 2023-12-16T03:16:05.758 INFO:tasks.workunit.client.1.smithi184.stdout:0/860: creat dc/d22/d1d/d35/f128 x:0 0 0 2023-12-16T03:16:05.759 INFO:tasks.workunit.client.1.smithi184.stdout:0/861: dread - dc/d22/d1d/d35/f128 zero size 2023-12-16T03:16:05.759 INFO:tasks.workunit.client.1.smithi184.stdout:0/862: truncate dc/d22/d1d/d35/f101 671676 0 2023-12-16T03:16:05.759 INFO:tasks.workunit.client.0.smithi064.stdout:3/631: getdents db/d4f/da9/dbf 0 2023-12-16T03:16:05.759 INFO:tasks.workunit.client.1.smithi184.stdout:1/816: dread d3/d34/dbc/d3c/d41/d63/f9a [0,4194304] 0 2023-12-16T03:16:05.762 INFO:tasks.workunit.client.0.smithi064.stdout:3/632: mknod db/d12/d1a/cd5 0 2023-12-16T03:16:05.763 INFO:tasks.workunit.client.0.smithi064.stdout:3/633: symlink db/d4f/d51/dd2/ld6 0 2023-12-16T03:16:05.763 INFO:tasks.workunit.client.0.smithi064.stdout:3/634: dread - db/d12/d1a/d2c/d34/d4c/d6a/f6c zero size 2023-12-16T03:16:05.763 INFO:tasks.workunit.client.0.smithi064.stdout:3/635: write db/d4f/fc1 [1150460,30873] 0 2023-12-16T03:16:05.764 INFO:tasks.workunit.client.0.smithi064.stdout:3/636: symlink db/d12/d4e/da3/ld7 0 2023-12-16T03:16:05.764 INFO:tasks.workunit.client.0.smithi064.stdout:3/637: write db/f67 [4574983,45606] 0 2023-12-16T03:16:05.766 INFO:tasks.workunit.client.1.smithi184.stdout:2/753: rmdir d3/d29/d2f/d46 39 2023-12-16T03:16:05.769 INFO:tasks.workunit.client.1.smithi184.stdout:3/990: dwrite d12/d86/de4/d99/f15f [0,4194304] 0 2023-12-16T03:16:05.772 INFO:tasks.workunit.client.0.smithi064.stdout:5/469: dwrite d0/d50/f30 [0,4194304] 0 2023-12-16T03:16:05.775 INFO:tasks.workunit.client.1.smithi184.stdout:1/817: mkdir d3/d13/d10b/d11b 0 2023-12-16T03:16:05.776 INFO:tasks.workunit.client.1.smithi184.stdout:5/654: rename d1/d2a/d31/d28/d72/l99 to d1/d3/d9/de/d15/ld7 0 2023-12-16T03:16:05.776 INFO:tasks.workunit.client.1.smithi184.stdout:2/754: rmdir d3/d9 39 2023-12-16T03:16:05.776 INFO:tasks.workunit.client.1.smithi184.stdout:1/818: stat d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/c100 0 2023-12-16T03:16:05.778 INFO:tasks.workunit.client.1.smithi184.stdout:7/781: dread d0/d3/d2e/d79/d32/fb9 [0,4194304] 0 2023-12-16T03:16:05.778 INFO:tasks.workunit.client.1.smithi184.stdout:2/755: mknod d3/d13/cf6 0 2023-12-16T03:16:05.780 INFO:tasks.workunit.client.1.smithi184.stdout:1/819: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/dfd/f11c x:0 0 0 2023-12-16T03:16:05.782 INFO:tasks.workunit.client.1.smithi184.stdout:5/655: read d1/d3/d9/d49/f95 [1580266,119178] 0 2023-12-16T03:16:05.785 INFO:tasks.workunit.client.1.smithi184.stdout:1/820: unlink d3/d34/dbc/d3c/d41/d46/ff0 0 2023-12-16T03:16:05.785 INFO:tasks.workunit.client.1.smithi184.stdout:1/821: dread - d3/d34/dbc/d3c/d41/d77/fff zero size 2023-12-16T03:16:05.787 INFO:tasks.workunit.client.1.smithi184.stdout:3/991: dread d12/d18/d1f/d23/d2a/d42/d52/d76/d80/f3c [0,4194304] 0 2023-12-16T03:16:05.787 INFO:tasks.workunit.client.1.smithi184.stdout:1/822: link d3/d13/f5f d3/d34/dbc/d3c/d41/d63/de1/f11d 0 2023-12-16T03:16:05.788 INFO:tasks.workunit.client.0.smithi064.stdout:9/482: dwrite d2/dc/f1f [4194304,4194304] 0 2023-12-16T03:16:05.788 INFO:tasks.workunit.client.0.smithi064.stdout:9/483: stat d2/d2d/d36/c41 0 2023-12-16T03:16:05.789 INFO:tasks.workunit.client.0.smithi064.stdout:6/479: dread d3/d8/da/f23 [4194304,4194304] 0 2023-12-16T03:16:05.790 INFO:tasks.workunit.client.0.smithi064.stdout:1/518: dwrite d3/dd/d11/d3b/f3e [0,4194304] 0 2023-12-16T03:16:05.790 INFO:tasks.workunit.client.0.smithi064.stdout:5/470: dread d0/d50/d39/f3a [0,4194304] 0 2023-12-16T03:16:05.790 INFO:tasks.workunit.client.0.smithi064.stdout:5/471: getdents d0/de/d23/d91 0 2023-12-16T03:16:05.791 INFO:tasks.workunit.client.1.smithi184.stdout:7/782: write d0/d3/d2e/d79/d1e/faf [1289004,41817] 0 2023-12-16T03:16:05.791 INFO:tasks.workunit.client.1.smithi184.stdout:7/783: fdatasync d0/d3/d2e/d79/d36/d84/f9b 0 2023-12-16T03:16:05.791 INFO:tasks.workunit.client.1.smithi184.stdout:7/784: truncate d0/d3/d2e/d79/dd/d75/fda 121214 0 2023-12-16T03:16:05.791 INFO:tasks.workunit.client.1.smithi184.stdout:2/756: dread d3/d13/d28/dac/fe5 [0,4194304] 0 2023-12-16T03:16:05.792 INFO:tasks.workunit.client.1.smithi184.stdout:3/992: getdents d12/d18/d1f/d23/d2a/d42/d52/d76 0 2023-12-16T03:16:05.793 INFO:tasks.workunit.client.1.smithi184.stdout:3/993: stat d12/d18/d1f/d23/d2a/d42/d52/d76/d80/d8b/lf0 0 2023-12-16T03:16:05.794 INFO:tasks.workunit.client.1.smithi184.stdout:1/823: rename d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/ce5 to d3/d34/dbc/d3c/d41/d77/c11e 0 2023-12-16T03:16:05.794 INFO:tasks.workunit.client.1.smithi184.stdout:1/824: dread - d3/d34/dbc/d3c/d24/d8e/fb0 zero size 2023-12-16T03:16:05.794 INFO:tasks.workunit.client.1.smithi184.stdout:1/825: write d3/d34/dbc/d3c/d41/d63/de1/f11a [443083,2675] 0 2023-12-16T03:16:05.794 INFO:tasks.workunit.client.1.smithi184.stdout:1/826: readlink d3/d34/dbc/d38/l5a 0 2023-12-16T03:16:05.797 INFO:tasks.workunit.client.0.smithi064.stdout:6/480: write d3/d8/d13/f7b [380185,84881] 0 2023-12-16T03:16:05.799 INFO:tasks.workunit.client.0.smithi064.stdout:5/472: dread d0/d7/d34/f56 [0,4194304] 0 2023-12-16T03:16:05.799 INFO:tasks.workunit.client.0.smithi064.stdout:6/481: creat d3/d9/f89 x:0 0 0 2023-12-16T03:16:05.800 INFO:tasks.workunit.client.0.smithi064.stdout:6/482: stat d3/d8 0 2023-12-16T03:16:05.800 INFO:tasks.workunit.client.0.smithi064.stdout:6/483: write d3/d8/d1f/f56 [545867,21327] 0 2023-12-16T03:16:05.800 INFO:tasks.workunit.client.0.smithi064.stdout:4/558: dwrite d0/d42/d66/d33/f81 [0,4194304] 0 2023-12-16T03:16:05.801 INFO:tasks.workunit.client.1.smithi184.stdout:3/994: creat d12/d18/d1f/d23/f16d x:0 0 0 2023-12-16T03:16:05.802 INFO:tasks.workunit.client.1.smithi184.stdout:7/785: symlink d0/d3/lea 0 2023-12-16T03:16:05.803 INFO:tasks.workunit.client.0.smithi064.stdout:9/484: write d2/f33 [1241710,94560] 0 2023-12-16T03:16:05.804 INFO:tasks.workunit.client.1.smithi184.stdout:2/757: rename d3/ced to d3/d13/ddf/cf7 0 2023-12-16T03:16:05.804 INFO:tasks.workunit.client.1.smithi184.stdout:2/758: chown d3/d29/d2f/d2e/f1a 0 1 2023-12-16T03:16:05.804 INFO:tasks.workunit.client.1.smithi184.stdout:2/759: truncate d3/d29/d4d/d5b/fe9 894270 0 2023-12-16T03:16:05.805 INFO:tasks.workunit.client.0.smithi064.stdout:6/484: creat d3/d8/d1f/d26/d47/d4a/d67/d86/f8a x:0 0 0 2023-12-16T03:16:05.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:05 smithi184 ceph-mon[121180]: pgmap v197: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 172 MiB/s rd, 367 MiB/s wr, 577 op/s 2023-12-16T03:16:05.811 INFO:tasks.workunit.client.1.smithi184.stdout:7/786: mkdir d0/deb 0 2023-12-16T03:16:05.811 INFO:tasks.workunit.client.1.smithi184.stdout:7/787: fdatasync d0/d6b/fae 0 2023-12-16T03:16:05.811 INFO:tasks.workunit.client.1.smithi184.stdout:2/760: creat d3/d29/d2f/d46/ff8 x:0 0 0 2023-12-16T03:16:05.815 INFO:tasks.workunit.client.1.smithi184.stdout:7/788: creat d0/d3/d2e/d79/d32/d39/d8f/dab/dc9/fec x:0 0 0 2023-12-16T03:16:05.815 INFO:tasks.workunit.client.0.smithi064.stdout:9/485: dread d2/dc/f32 [0,4194304] 0 2023-12-16T03:16:05.815 INFO:tasks.workunit.client.0.smithi064.stdout:7/537: dwrite d7/d3e/f47 [0,4194304] 0 2023-12-16T03:16:05.816 INFO:tasks.workunit.client.0.smithi064.stdout:2/428: dwrite d1/d15/f1f [0,4194304] 0 2023-12-16T03:16:05.817 INFO:tasks.workunit.client.0.smithi064.stdout:5/473: dread d0/d7/d97/f9b [0,4194304] 0 2023-12-16T03:16:05.818 INFO:tasks.workunit.client.0.smithi064.stdout:5/474: chown d0/d7/f1e 342711 1 2023-12-16T03:16:05.819 INFO:tasks.workunit.client.0.smithi064.stdout:6/485: link d3/c35 d3/d44/c8b 0 2023-12-16T03:16:05.820 INFO:tasks.workunit.client.0.smithi064.stdout:7/538: dread - d7/d3e/d42/f72 zero size 2023-12-16T03:16:05.820 INFO:tasks.workunit.client.0.smithi064.stdout:7/539: fsync d7/d26/d95/fa6 0 2023-12-16T03:16:05.821 INFO:tasks.workunit.client.0.smithi064.stdout:7/540: readlink d7/d26/l9f 0 2023-12-16T03:16:05.822 INFO:tasks.workunit.client.0.smithi064.stdout:5/475: read d0/de/ff [2045114,73578] 0 2023-12-16T03:16:05.822 INFO:tasks.workunit.client.0.smithi064.stdout:5/476: dread - d0/d14/d20/d37/d70/d71/d80/f98 zero size 2023-12-16T03:16:05.822 INFO:tasks.workunit.client.0.smithi064.stdout:5/477: write d0/d14/d20/d37/d70/d71/f72 [918099,63185] 0 2023-12-16T03:16:05.822 INFO:tasks.workunit.client.1.smithi184.stdout:7/789: creat d0/d6b/d94/dbe/fed x:0 0 0 2023-12-16T03:16:05.824 INFO:tasks.workunit.client.0.smithi064.stdout:9/486: mknod d2/d2d/d6c/d83/c9b 0 2023-12-16T03:16:05.824 INFO:tasks.workunit.client.0.smithi064.stdout:9/487: write d2/d2d/d3b/d3c/d34/f37 [789406,84795] 0 2023-12-16T03:16:05.824 INFO:tasks.workunit.client.1.smithi184.stdout:6/947: dwrite d0/d5/d22/d37/d45/fc4 [0,4194304] 0 2023-12-16T03:16:05.824 INFO:tasks.workunit.client.1.smithi184.stdout:6/948: dread - d0/d5/d22/d25/d47/f104 zero size 2023-12-16T03:16:05.825 INFO:tasks.workunit.client.0.smithi064.stdout:6/486: write d3/d8/f4c [4051126,36828] 0 2023-12-16T03:16:05.825 INFO:tasks.workunit.client.0.smithi064.stdout:2/429: truncate d1/d15/f1a 2929859 0 2023-12-16T03:16:05.827 INFO:tasks.workunit.client.1.smithi184.stdout:7/790: write d0/d3/d2e/d79/d34/fd5 [5445138,38389] 0 2023-12-16T03:16:05.836 INFO:tasks.workunit.client.1.smithi184.stdout:6/949: creat d0/d5/d22/d25/d47/f134 x:0 0 0 2023-12-16T03:16:05.836 INFO:tasks.workunit.client.1.smithi184.stdout:1/827: dwrite d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fde [0,4194304] 0 2023-12-16T03:16:05.836 INFO:tasks.workunit.client.0.smithi064.stdout:1/519: dwrite d3/f26 [0,4194304] 0 2023-12-16T03:16:05.836 INFO:tasks.workunit.client.0.smithi064.stdout:1/520: dread - d3/d36/d44/d4d/d58/d96/f98 zero size 2023-12-16T03:16:05.836 INFO:tasks.workunit.client.0.smithi064.stdout:1/521: write d3/d36/d44/d4d/f3f [4813238,114476] 0 2023-12-16T03:16:05.839 INFO:tasks.workunit.client.0.smithi064.stdout:7/541: creat d7/d3e/d42/faa x:0 0 0 2023-12-16T03:16:05.841 INFO:tasks.workunit.client.1.smithi184.stdout:7/791: dread d0/d6b/fae [0,4194304] 0 2023-12-16T03:16:05.842 INFO:tasks.workunit.client.0.smithi064.stdout:7/542: write d7/d3e/d42/f44 [1299215,76983] 0 2023-12-16T03:16:05.842 INFO:tasks.workunit.client.0.smithi064.stdout:3/638: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/fd0 [0,4194304] 0 2023-12-16T03:16:05.843 INFO:tasks.workunit.client.0.smithi064.stdout:3/639: read - db/d12/d21/f65 zero size 2023-12-16T03:16:05.845 INFO:tasks.workunit.client.0.smithi064.stdout:5/478: rename d0/d19/d73/d87 to d0/de/d23/d67/da7 0 2023-12-16T03:16:05.847 INFO:tasks.workunit.client.0.smithi064.stdout:6/487: unlink d3/d8/d13/d46/d5e/f64 0 2023-12-16T03:16:05.847 INFO:tasks.workunit.client.0.smithi064.stdout:6/488: write d3/d8/d13/d46/f87 [236586,102905] 0 2023-12-16T03:16:05.847 INFO:tasks.workunit.client.0.smithi064.stdout:6/489: chown d3/d8/da/f23 335 1 2023-12-16T03:16:05.848 INFO:tasks.workunit.client.1.smithi184.stdout:6/950: dread d0/d5/d12/d1b/d33/f58 [0,4194304] 0 2023-12-16T03:16:05.848 INFO:tasks.workunit.client.1.smithi184.stdout:6/951: chown d0/d5/d22/f49 1760 1 2023-12-16T03:16:05.848 INFO:tasks.workunit.client.1.smithi184.stdout:0/863: dwrite dc/d22/d1d/d43/fc4 [4194304,4194304] 0 2023-12-16T03:16:05.848 INFO:tasks.workunit.client.1.smithi184.stdout:4/827: dwrite d1/d29/d34/f3d [4194304,4194304] 0 2023-12-16T03:16:05.848 INFO:tasks.workunit.client.1.smithi184.stdout:8/908: dwrite d2/d6a/da4/f8e [0,4194304] 0 2023-12-16T03:16:05.849 INFO:tasks.workunit.client.0.smithi064.stdout:6/490: write d3/d9/f18 [2625043,121665] 0 2023-12-16T03:16:05.849 INFO:tasks.workunit.client.0.smithi064.stdout:4/559: dwrite d0/d42/d66/d33/fab [0,4194304] 0 2023-12-16T03:16:05.849 INFO:tasks.workunit.client.0.smithi064.stdout:4/560: readlink d0/d42/l4b 0 2023-12-16T03:16:05.849 INFO:tasks.workunit.client.0.smithi064.stdout:2/430: rmdir d1/d15/d58 39 2023-12-16T03:16:05.851 INFO:tasks.workunit.client.1.smithi184.stdout:1/828: rename d3/d34/dbc/d3c/d41/l7d to d3/d34/dbc/d3c/d24/d8e/l11f 0 2023-12-16T03:16:05.852 INFO:tasks.workunit.client.1.smithi184.stdout:2/761: dwrite d3/d29/d61/fe7 [0,4194304] 0 2023-12-16T03:16:05.855 INFO:tasks.workunit.client.0.smithi064.stdout:9/488: dwrite d2/dc/d24/d39/f61 [0,4194304] 0 2023-12-16T03:16:05.855 INFO:tasks.workunit.client.0.smithi064.stdout:9/489: fsync d2/d7e/f8d 0 2023-12-16T03:16:05.856 INFO:tasks.workunit.client.0.smithi064.stdout:1/522: mkdir d3/dd/d23/d4f/daf 0 2023-12-16T03:16:05.856 INFO:tasks.workunit.client.0.smithi064.stdout:1/523: fsync d3/dd/d23/d60/fa9 0 2023-12-16T03:16:05.856 INFO:tasks.workunit.client.0.smithi064.stdout:1/524: truncate d3/d36/d44/d4d/d58/d96/f99 571302 0 2023-12-16T03:16:05.857 INFO:tasks.workunit.client.1.smithi184.stdout:7/792: mkdir d0/d6b/dee 0 2023-12-16T03:16:05.863 INFO:tasks.workunit.client.1.smithi184.stdout:5/656: dread d1/d3/d9/f40 [0,4194304] 0 2023-12-16T03:16:05.863 INFO:tasks.workunit.client.1.smithi184.stdout:6/952: creat d0/d5/d26/f135 x:0 0 0 2023-12-16T03:16:05.863 INFO:tasks.workunit.client.1.smithi184.stdout:6/953: fsync d0/fc6 0 2023-12-16T03:16:05.864 INFO:tasks.workunit.client.0.smithi064.stdout:3/640: creat db/d4f/d51/db3/fd8 x:0 0 0 2023-12-16T03:16:05.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/657: write d1/d3/d9/de/d15/d19/d48/f85 [1803439,95373] 0 2023-12-16T03:16:05.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/658: readlink d1/d3/d9/d2e/l4a 0 2023-12-16T03:16:05.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/659: write d1/d3/d9/de/d15/f8d [553492,42125] 0 2023-12-16T03:16:05.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/660: chown d1/d3/d9/de/cd5 247 1 2023-12-16T03:16:05.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/661: fdatasync d1/d3/fb2 0 2023-12-16T03:16:05.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/662: write d1/d3/d9/de/d30/fab [1044074,1742] 0 2023-12-16T03:16:05.869 INFO:tasks.workunit.client.0.smithi064.stdout:7/543: rename d7/d3e/d42/d89/f76 to d7/d26/d30/fab 0 2023-12-16T03:16:05.869 INFO:tasks.workunit.client.0.smithi064.stdout:7/544: chown d7/d3e/d42/d48/d51/d7c/c6a 1 1 2023-12-16T03:16:05.870 INFO:tasks.workunit.client.1.smithi184.stdout:0/864: creat dc/d22/d45/daf/f129 x:0 0 0 2023-12-16T03:16:05.871 INFO:tasks.workunit.client.0.smithi064.stdout:2/431: dwrite d1/d15/d23/f7a [0,4194304] 0 2023-12-16T03:16:05.871 INFO:tasks.workunit.client.0.smithi064.stdout:2/432: chown d1/d15/f75 67 1 2023-12-16T03:16:05.872 INFO:tasks.workunit.client.0.smithi064.stdout:5/479: creat d0/d14/d20/d37/d70/da2/fa8 x:0 0 0 2023-12-16T03:16:05.873 INFO:tasks.workunit.client.1.smithi184.stdout:4/828: creat d1/d29/d34/f11c x:0 0 0 2023-12-16T03:16:05.876 INFO:tasks.workunit.client.1.smithi184.stdout:8/909: truncate d2/d4/d10/d7a/d83/d8b/fab 2976469 0 2023-12-16T03:16:05.881 INFO:tasks.workunit.client.0.smithi064.stdout:2/433: dread d1/f6 [0,4194304] 0 2023-12-16T03:16:05.881 INFO:tasks.workunit.client.0.smithi064.stdout:2/434: chown d1 398061875 1 2023-12-16T03:16:05.885 INFO:tasks.workunit.client.1.smithi184.stdout:1/829: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/f120 x:0 0 0 2023-12-16T03:16:05.888 INFO:tasks.workunit.client.1.smithi184.stdout:1/830: read d3/d34/dbc/d3c/d41/d46/d4a/f50 [177853,67165] 0 2023-12-16T03:16:05.888 INFO:tasks.workunit.client.1.smithi184.stdout:1/831: truncate d3/d34/dbc/d3c/f117 317400 0 2023-12-16T03:16:05.888 INFO:tasks.workunit.client.0.smithi064.stdout:6/491: creat d3/d44/f8c x:0 0 0 2023-12-16T03:16:05.890 INFO:tasks.workunit.client.1.smithi184.stdout:2/762: creat d3/d13/d28/d83/dda/ff9 x:0 0 0 2023-12-16T03:16:05.891 INFO:tasks.workunit.client.0.smithi064.stdout:6/492: write d3/d8/da/f23 [6342726,91572] 0 2023-12-16T03:16:05.891 INFO:tasks.workunit.client.0.smithi064.stdout:6/493: chown d3/c27 1054146187 1 2023-12-16T03:16:05.891 INFO:tasks.workunit.client.1.smithi184.stdout:4/829: dread d1/d11/d5a/fa3 [0,4194304] 0 2023-12-16T03:16:05.891 INFO:tasks.workunit.client.1.smithi184.stdout:2/763: write d3/d9/d19/f37 [2444203,23640] 0 2023-12-16T03:16:05.892 INFO:tasks.workunit.client.1.smithi184.stdout:2/764: write d3/d29/d2f/d2e/f1a [2805032,113855] 0 2023-12-16T03:16:05.894 INFO:tasks.workunit.client.1.smithi184.stdout:4/830: dread d1/d11/d5a/fa3 [0,4194304] 0 2023-12-16T03:16:05.898 INFO:tasks.workunit.client.0.smithi064.stdout:7/545: dwrite d7/d3e/d42/d48/d51/f8d [0,4194304] 0 2023-12-16T03:16:05.900 INFO:tasks.workunit.client.0.smithi064.stdout:9/490: creat d2/dc/d24/d39/d77/f9c x:0 0 0 2023-12-16T03:16:05.900 INFO:tasks.workunit.client.0.smithi064.stdout:9/491: read - d2/dc/d24/d39/d5e/d6f/f7a zero size 2023-12-16T03:16:05.902 INFO:tasks.workunit.client.0.smithi064.stdout:1/525: mknod d3/dd/d23/d60/cb0 0 2023-12-16T03:16:05.904 INFO:tasks.workunit.client.0.smithi064.stdout:1/526: write d3/dd/d11/d3b/f5e [6715010,27117] 0 2023-12-16T03:16:05.907 INFO:tasks.workunit.client.0.smithi064.stdout:3/641: symlink db/d12/d1a/d2c/d34/d4c/d6a/ld9 0 2023-12-16T03:16:05.909 INFO:tasks.workunit.client.0.smithi064.stdout:4/561: rename d0/d1e/f89 to d0/da/da6/fb3 0 2023-12-16T03:16:05.917 INFO:tasks.workunit.client.0.smithi064.stdout:2/435: mknod d1/d15/d1b/d61/c85 0 2023-12-16T03:16:05.919 INFO:tasks.workunit.client.1.smithi184.stdout:7/793: link d0/d3/d2e/d79/dd/d27/c29 d0/d3/d2e/d3b/ddc/cef 0 2023-12-16T03:16:05.920 INFO:tasks.workunit.client.0.smithi064.stdout:6/494: symlink d3/d8/d13/d58/d65/l8d 0 2023-12-16T03:16:05.920 INFO:tasks.workunit.client.0.smithi064.stdout:6/495: fdatasync d3/f61 0 2023-12-16T03:16:05.921 INFO:tasks.workunit.client.1.smithi184.stdout:6/954: mknod d0/d5/d22/d25/c136 0 2023-12-16T03:16:05.922 INFO:tasks.workunit.client.1.smithi184.stdout:5/663: creat d1/d3/dc6/fd8 x:0 0 0 2023-12-16T03:16:05.924 INFO:tasks.workunit.client.0.smithi064.stdout:3/642: link f6 db/d12/d1a/d2c/d34/d4c/d6a/da7/fda 0 2023-12-16T03:16:05.927 INFO:tasks.workunit.client.0.smithi064.stdout:5/480: rename d0/de/d23/l58 to d0/d50/d39/la9 0 2023-12-16T03:16:05.927 INFO:tasks.workunit.client.0.smithi064.stdout:5/481: write d0/de/f36 [1547599,129311] 0 2023-12-16T03:16:05.927 INFO:tasks.workunit.client.1.smithi184.stdout:0/865: mkdir dc/d22/d53/ded/d11b/d12a 0 2023-12-16T03:16:05.928 INFO:tasks.workunit.client.1.smithi184.stdout:8/910: truncate d2/d6a/da4/f7d 1665982 0 2023-12-16T03:16:05.928 INFO:tasks.workunit.client.1.smithi184.stdout:8/911: truncate d2/d12/ff4 538173 0 2023-12-16T03:16:05.928 INFO:tasks.workunit.client.0.smithi064.stdout:9/492: dwrite d2/f2e [4194304,4194304] 0 2023-12-16T03:16:05.928 INFO:tasks.workunit.client.0.smithi064.stdout:7/546: dwrite d7/d3e/d42/d43/f90 [0,4194304] 0 2023-12-16T03:16:05.929 INFO:tasks.workunit.client.0.smithi064.stdout:2/436: symlink d1/d15/d1b/d61/d63/l86 0 2023-12-16T03:16:05.932 INFO:tasks.workunit.client.0.smithi064.stdout:8/586: sync 2023-12-16T03:16:05.932 INFO:tasks.workunit.client.0.smithi064.stdout:8/587: chown d0/d1d/d24/fc3 4800900 1 2023-12-16T03:16:05.932 INFO:tasks.workunit.client.0.smithi064.stdout:8/588: fdatasync d0/d1d/d3c/f8e 0 2023-12-16T03:16:05.934 INFO:tasks.workunit.client.0.smithi064.stdout:4/562: dwrite d0/da/f6f [0,4194304] 0 2023-12-16T03:16:05.937 INFO:tasks.workunit.client.0.smithi064.stdout:6/496: unlink d3/d44/c6f 0 2023-12-16T03:16:05.938 INFO:tasks.workunit.client.1.smithi184.stdout:7/794: dread d0/d3/d2e/d79/d1e/fdf [0,4194304] 0 2023-12-16T03:16:05.942 INFO:tasks.workunit.client.0.smithi064.stdout:3/643: truncate db/d12/f58 3109035 0 2023-12-16T03:16:05.943 INFO:tasks.workunit.client.1.smithi184.stdout:5/664: dread d1/d3/d2f/f3d [0,4194304] 0 2023-12-16T03:16:05.943 INFO:tasks.workunit.client.1.smithi184.stdout:6/955: dwrite d0/d5/f24 [0,4194304] 0 2023-12-16T03:16:05.943 INFO:tasks.workunit.client.1.smithi184.stdout:1/832: rename d3/d34/dbc/d3c/d41/d46/d4a/d6a/d6d to d3/d13/d121 0 2023-12-16T03:16:05.943 INFO:tasks.workunit.client.0.smithi064.stdout:5/482: dread d0/d7/f1e [0,4194304] 0 2023-12-16T03:16:05.943 INFO:tasks.workunit.client.0.smithi064.stdout:5/483: write d0/d14/d20/d37/d70/d71/d80/f98 [916815,54009] 0 2023-12-16T03:16:05.944 INFO:tasks.workunit.client.0.smithi064.stdout:8/589: dread d0/da/d3e/f53 [0,4194304] 0 2023-12-16T03:16:05.944 INFO:tasks.workunit.client.0.smithi064.stdout:8/590: readlink d0/d1d/d24/d9c/lb2 0 2023-12-16T03:16:05.945 INFO:tasks.workunit.client.0.smithi064.stdout:8/591: chown d0/db/d37/d3a/d95 600164 1 2023-12-16T03:16:05.945 INFO:tasks.workunit.client.0.smithi064.stdout:1/527: rename d3/dd/d11/d2f/d90 to d3/d22/d57/db1 0 2023-12-16T03:16:05.947 INFO:tasks.workunit.client.0.smithi064.stdout:8/592: read d0/db/f4f [23102,21658] 0 2023-12-16T03:16:05.947 INFO:tasks.workunit.client.0.smithi064.stdout:3/644: write db/d12/d1a/d2c/d34/f3d [1198378,95439] 0 2023-12-16T03:16:05.947 INFO:tasks.workunit.client.0.smithi064.stdout:8/593: chown d0/d1d/d3c/f8e 28306907 1 2023-12-16T03:16:05.947 INFO:tasks.workunit.client.0.smithi064.stdout:8/594: fdatasync d0/db/f76 0 2023-12-16T03:16:05.947 INFO:tasks.workunit.client.0.smithi064.stdout:8/595: stat d0/db/d12/f82 0 2023-12-16T03:16:05.947 INFO:tasks.workunit.client.0.smithi064.stdout:0/494: sync 2023-12-16T03:16:05.947 INFO:tasks.workunit.client.1.smithi184.stdout:2/765: rmdir d3/d13/d28/d83/dda 39 2023-12-16T03:16:05.951 INFO:tasks.workunit.client.0.smithi064.stdout:9/493: mknod d2/d2d/d3b/d3c/d34/c9d 0 2023-12-16T03:16:05.955 INFO:tasks.workunit.client.1.smithi184.stdout:2/766: dread d3/f3c [0,4194304] 0 2023-12-16T03:16:05.955 INFO:tasks.workunit.client.1.smithi184.stdout:2/767: readlink d3/d9/l73 0 2023-12-16T03:16:05.958 INFO:tasks.workunit.client.0.smithi064.stdout:7/547: mkdir d7/d3e/dac 0 2023-12-16T03:16:05.961 INFO:tasks.workunit.client.1.smithi184.stdout:0/866: symlink dc/d10/d1c/dfe/l12b 0 2023-12-16T03:16:05.961 INFO:tasks.workunit.client.1.smithi184.stdout:0/867: chown dc/d10/d2d/d5f/d7a/f9f 6870 1 2023-12-16T03:16:05.964 INFO:tasks.workunit.client.0.smithi064.stdout:1/528: dread d3/dd/d11/f80 [0,4194304] 0 2023-12-16T03:16:05.964 INFO:tasks.workunit.client.0.smithi064.stdout:1/529: readlink d3/dd/d11/l93 0 2023-12-16T03:16:05.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/912: mknod d2/d12/d21/c12c 0 2023-12-16T03:16:05.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/913: chown d2/d12/d21/d8a/dda/l12a 1057 1 2023-12-16T03:16:05.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/914: truncate d2/d6a/da4/fc4 1455279 0 2023-12-16T03:16:05.965 INFO:tasks.workunit.client.0.smithi064.stdout:4/563: mknod d0/d42/d4c/d70/d85/cb4 0 2023-12-16T03:16:05.965 INFO:tasks.workunit.client.0.smithi064.stdout:4/564: stat d0/f2 0 2023-12-16T03:16:05.968 INFO:tasks.workunit.client.1.smithi184.stdout:1/833: mknod d3/d13/d121/d99/c122 0 2023-12-16T03:16:05.969 INFO:tasks.workunit.client.1.smithi184.stdout:2/768: symlink d3/d29/d61/d6d/lfa 0 2023-12-16T03:16:05.969 INFO:tasks.workunit.client.1.smithi184.stdout:2/769: write d3/d29/d4d/d5b/fe9 [914032,130779] 0 2023-12-16T03:16:05.970 INFO:tasks.workunit.client.0.smithi064.stdout:5/484: mkdir d0/d50/d39/daa 0 2023-12-16T03:16:05.973 INFO:tasks.workunit.client.1.smithi184.stdout:0/868: creat dc/d22/d1d/d43/d5a/f12c x:0 0 0 2023-12-16T03:16:05.975 INFO:tasks.workunit.client.0.smithi064.stdout:3/645: creat db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/dc9/fdb x:0 0 0 2023-12-16T03:16:05.978 INFO:tasks.workunit.client.1.smithi184.stdout:8/915: dread d2/d6a/da4/fa7 [0,4194304] 0 2023-12-16T03:16:05.978 INFO:tasks.workunit.client.1.smithi184.stdout:8/916: dread - d2/d4/d10/d2a/f103 zero size 2023-12-16T03:16:05.980 INFO:tasks.workunit.client.1.smithi184.stdout:1/834: rename d3/d34/dbc/la0 to d3/d34/dbc/d3c/d24/l123 0 2023-12-16T03:16:05.980 INFO:tasks.workunit.client.1.smithi184.stdout:1/835: chown d3/d34/dbc/d3c/d41/f62 5257 1 2023-12-16T03:16:05.981 INFO:tasks.workunit.client.0.smithi064.stdout:8/596: rename d0/l1 to d0/db/d5a/d97/d38/lcd 0 2023-12-16T03:16:05.982 INFO:tasks.workunit.client.1.smithi184.stdout:5/665: dwrite d1/f7e [0,4194304] 0 2023-12-16T03:16:05.983 INFO:tasks.workunit.client.1.smithi184.stdout:2/770: mknod d3/d9/d19/cfb 0 2023-12-16T03:16:05.983 INFO:tasks.workunit.client.1.smithi184.stdout:5/666: truncate d1/d3/d9/de/d15/f61 5044152 0 2023-12-16T03:16:05.983 INFO:tasks.workunit.client.0.smithi064.stdout:9/494: symlink d2/d2d/d6c/d83/l9e 0 2023-12-16T03:16:05.984 INFO:tasks.workunit.client.0.smithi064.stdout:9/495: write d2/d2d/d3b/d3c/d4b/f4c [4471861,44404] 0 2023-12-16T03:16:05.984 INFO:tasks.workunit.client.0.smithi064.stdout:1/530: dread d3/d36/d9e/f85 [0,4194304] 0 2023-12-16T03:16:05.986 INFO:tasks.workunit.client.0.smithi064.stdout:1/531: write d3/d36/d9e/f4b [2407339,5022] 0 2023-12-16T03:16:05.986 INFO:tasks.workunit.client.0.smithi064.stdout:1/532: fsync d3/d36/d44/d4d/f4e 0 2023-12-16T03:16:05.986 INFO:tasks.workunit.client.1.smithi184.stdout:7/795: dwrite d0/d3/f64 [0,4194304] 0 2023-12-16T03:16:05.986 INFO:tasks.workunit.client.1.smithi184.stdout:6/956: dwrite d0/d5/d22/d25/d3f/d6f/ff4 [0,4194304] 0 2023-12-16T03:16:05.987 INFO:tasks.workunit.client.0.smithi064.stdout:0/495: dwrite d2/f8d [0,4194304] 0 2023-12-16T03:16:05.987 INFO:tasks.workunit.client.0.smithi064.stdout:5/485: dread d0/f3 [0,4194304] 0 2023-12-16T03:16:05.987 INFO:tasks.workunit.client.0.smithi064.stdout:5/486: dread - d0/d14/d20/d37/d70/d71/d5a/f8d zero size 2023-12-16T03:16:05.987 INFO:tasks.workunit.client.1.smithi184.stdout:0/869: truncate dc/d22/d53/f95 1488290 0 2023-12-16T03:16:05.990 INFO:tasks.workunit.client.0.smithi064.stdout:4/565: dwrite d0/d12/f79 [0,4194304] 0 2023-12-16T03:16:05.990 INFO:tasks.workunit.client.1.smithi184.stdout:8/917: mkdir d2/d37/d7c/ddc/de6/d12d 0 2023-12-16T03:16:05.990 INFO:tasks.workunit.client.1.smithi184.stdout:8/918: dread - d2/d4/d10/d11/d72/dc2/ff3 zero size 2023-12-16T03:16:05.995 INFO:tasks.workunit.client.1.smithi184.stdout:1/836: symlink d3/l124 0 2023-12-16T03:16:05.995 INFO:tasks.workunit.client.1.smithi184.stdout:1/837: chown d3/d13/d10b/d11b 43 1 2023-12-16T03:16:05.998 INFO:tasks.workunit.client.0.smithi064.stdout:7/548: rmdir d7/d3e/d42/d48/d51/da1 0 2023-12-16T03:16:05.998 INFO:tasks.workunit.client.0.smithi064.stdout:7/549: chown d7/d3e/d42/d48/c5c 18 1 2023-12-16T03:16:06.002 INFO:tasks.workunit.client.0.smithi064.stdout:6/497: truncate d3/d8/f4c 569815 0 2023-12-16T03:16:06.003 INFO:tasks.workunit.client.1.smithi184.stdout:1/838: dread d3/d34/dbc/d3c/d41/d77/fba [0,4194304] 0 2023-12-16T03:16:06.003 INFO:tasks.workunit.client.1.smithi184.stdout:1/839: fsync d3/d34/dbc/d3c/d24/f94 0 2023-12-16T03:16:06.005 INFO:tasks.workunit.client.1.smithi184.stdout:2/771: creat d3/d13/d28/d83/ffc x:0 0 0 2023-12-16T03:16:06.006 INFO:tasks.workunit.client.0.smithi064.stdout:3/646: creat db/d4f/d51/fdc x:0 0 0 2023-12-16T03:16:06.007 INFO:tasks.workunit.client.0.smithi064.stdout:3/647: fsync db/d12/d21/f65 0 2023-12-16T03:16:06.008 INFO:tasks.workunit.client.0.smithi064.stdout:8/597: creat d0/d1d/d24/d2f/d50/d70/dcc/fce x:0 0 0 2023-12-16T03:16:06.010 INFO:tasks.workunit.client.0.smithi064.stdout:9/496: link d2/d2d/d6c/d83/f96 d2/d2d/d3b/d3c/d34/f9f 0 2023-12-16T03:16:06.011 INFO:tasks.workunit.client.0.smithi064.stdout:9/497: chown d2/d2d/d3b/d3c/d34/l3a 29358 1 2023-12-16T03:16:06.011 INFO:tasks.workunit.client.1.smithi184.stdout:7/796: mknod d0/d3/d2e/d79/d32/d39/d8f/dab/dc9/cf0 0 2023-12-16T03:16:06.017 INFO:tasks.workunit.client.0.smithi064.stdout:0/496: creat d2/d8/fa1 x:0 0 0 2023-12-16T03:16:06.017 INFO:tasks.workunit.client.0.smithi064.stdout:0/497: chown d2/d8/da/df 205899309 1 2023-12-16T03:16:06.017 INFO:tasks.workunit.client.1.smithi184.stdout:0/870: truncate dc/d10/d2d/fd7 3163852 0 2023-12-16T03:16:06.018 INFO:tasks.workunit.client.1.smithi184.stdout:3/995: sync 2023-12-16T03:16:06.019 INFO:tasks.workunit.client.0.smithi064.stdout:5/487: rename d0/de/d23/f3f to d0/d19/d48/fab 0 2023-12-16T03:16:06.022 INFO:tasks.workunit.client.0.smithi064.stdout:7/550: link d7/c9e d7/d26/cad 0 2023-12-16T03:16:06.023 INFO:tasks.workunit.client.1.smithi184.stdout:6/957: dwrite d0/d5/d22/d37/d45/fc4 [4194304,4194304] 0 2023-12-16T03:16:06.023 INFO:tasks.workunit.client.0.smithi064.stdout:6/498: creat d3/d8/da/f8e x:0 0 0 2023-12-16T03:16:06.024 INFO:tasks.workunit.client.1.smithi184.stdout:8/919: dwrite d2/d12/d21/d8a/dda/d73/f111 [0,4194304] 0 2023-12-16T03:16:06.024 INFO:tasks.workunit.client.0.smithi064.stdout:1/533: dwrite d3/d36/d9e/f4b [0,4194304] 0 2023-12-16T03:16:06.024 INFO:tasks.workunit.client.1.smithi184.stdout:1/840: mknod d3/d34/dbc/d3c/c125 0 2023-12-16T03:16:06.025 INFO:tasks.workunit.client.0.smithi064.stdout:4/566: dwrite d0/d1e/f60 [0,4194304] 0 2023-12-16T03:16:06.026 INFO:tasks.workunit.client.1.smithi184.stdout:2/772: mkdir d3/d29/d2f/d46/dfd 0 2023-12-16T03:16:06.029 INFO:tasks.workunit.client.0.smithi064.stdout:3/648: rename db/d12/d1a/d2c/db5/lcb to db/d4f/da9/dbf/d75/ldd 0 2023-12-16T03:16:06.030 INFO:tasks.workunit.client.1.smithi184.stdout:7/797: creat d0/d3/d2e/d79/d32/ff1 x:0 0 0 2023-12-16T03:16:06.030 INFO:tasks.workunit.client.1.smithi184.stdout:7/798: truncate d0/d3/d4/f5e 4679008 0 2023-12-16T03:16:06.032 INFO:tasks.workunit.client.0.smithi064.stdout:7/551: creat d7/fae x:0 0 0 2023-12-16T03:16:06.033 INFO:tasks.workunit.client.1.smithi184.stdout:0/871: truncate dc/d22/d1d/d43/fc7 1268238 0 2023-12-16T03:16:06.034 INFO:tasks.workunit.client.0.smithi064.stdout:6/499: creat d3/d44/d7a/f8f x:0 0 0 2023-12-16T03:16:06.036 INFO:tasks.workunit.client.1.smithi184.stdout:3/996: mknod d12/d1e/de8/d48/d150/c16e 0 2023-12-16T03:16:06.037 INFO:tasks.workunit.client.1.smithi184.stdout:3/997: truncate d12/d18/f74 9023154 0 2023-12-16T03:16:06.040 INFO:tasks.workunit.client.1.smithi184.stdout:6/958: creat d0/d5/d22/d37/f137 x:0 0 0 2023-12-16T03:16:06.047 INFO:tasks.workunit.client.1.smithi184.stdout:0/872: dread dc/d22/d1d/d43/f55 [0,4194304] 0 2023-12-16T03:16:06.047 INFO:tasks.workunit.client.1.smithi184.stdout:8/920: rename d2/d37/d7c/ddc/de6/d129 to d2/d12/d12e 0 2023-12-16T03:16:06.048 INFO:tasks.workunit.client.0.smithi064.stdout:9/498: rename d2/dc/d24/d39/f3d to d2/dc/d24/d39/d77/fa0 0 2023-12-16T03:16:06.049 INFO:tasks.workunit.client.1.smithi184.stdout:7/799: mknod d0/d6b/d69/cf2 0 2023-12-16T03:16:06.050 INFO:tasks.workunit.client.0.smithi064.stdout:3/649: mkdir db/d4f/d51/dd1/dde 0 2023-12-16T03:16:06.052 INFO:tasks.workunit.client.1.smithi184.stdout:6/959: dread d0/d5/d22/f49 [0,4194304] 0 2023-12-16T03:16:06.053 INFO:tasks.workunit.client.1.smithi184.stdout:6/960: chown d0/d5/d22/d25/f5f 187625 1 2023-12-16T03:16:06.054 INFO:tasks.workunit.client.1.smithi184.stdout:0/873: dread dc/fe [0,4194304] 0 2023-12-16T03:16:06.055 INFO:tasks.workunit.client.1.smithi184.stdout:1/841: dwrite d3/d13/f92 [0,4194304] 0 2023-12-16T03:16:06.056 INFO:tasks.workunit.client.0.smithi064.stdout:0/498: dwrite d2/d8/f1b [4194304,4194304] 0 2023-12-16T03:16:06.056 INFO:tasks.workunit.client.0.smithi064.stdout:1/534: dwrite d3/dd/f3c [0,4194304] 0 2023-12-16T03:16:06.068 INFO:tasks.workunit.client.0.smithi064.stdout:0/499: dread d2/d7/d10/d21/d7a/f60 [0,4194304] 0 2023-12-16T03:16:06.068 INFO:tasks.workunit.client.0.smithi064.stdout:0/500: write d2/f32 [4730643,14380] 0 2023-12-16T03:16:06.070 INFO:tasks.workunit.client.0.smithi064.stdout:0/501: dread d2/d7/d10/f1a [0,4194304] 0 2023-12-16T03:16:06.157 INFO:tasks.workunit.client.1.smithi184.stdout:2/773: rename d3/d9/f85 to d3/d29/d4d/d5b/ffe 0 2023-12-16T03:16:06.158 INFO:tasks.workunit.client.1.smithi184.stdout:8/921: getdents d2/d4/d10/d7a 0 2023-12-16T03:16:06.164 INFO:tasks.workunit.client.1.smithi184.stdout:7/800: mknod d0/d6b/cf3 0 2023-12-16T03:16:06.164 INFO:tasks.workunit.client.1.smithi184.stdout:7/801: chown d0/d3/d2e/d79/d36/f4e 99483 1 2023-12-16T03:16:06.165 INFO:tasks.workunit.client.1.smithi184.stdout:7/802: read d0/d3/d2e/d79/dd/fc6 [235283,100712] 0 2023-12-16T03:16:06.165 INFO:tasks.workunit.client.1.smithi184.stdout:7/803: truncate d0/d3/d2e/d79/d32/d39/fb0 1164966 0 2023-12-16T03:16:06.167 INFO:tasks.workunit.client.0.smithi064.stdout:9/499: symlink d2/dc/d24/la1 0 2023-12-16T03:16:06.168 INFO:tasks.workunit.client.1.smithi184.stdout:6/961: creat d0/d5/d12/d1b/d33/d111/f138 x:0 0 0 2023-12-16T03:16:06.168 INFO:tasks.workunit.client.1.smithi184.stdout:6/962: chown d0/d5/d12/d1b/f51 28480 1 2023-12-16T03:16:06.170 INFO:tasks.workunit.client.0.smithi064.stdout:3/650: creat db/d12/d1a/d2c/d34/dcd/fdf x:0 0 0 2023-12-16T03:16:06.170 INFO:tasks.workunit.client.0.smithi064.stdout:3/651: chown db/d4f/da9/dbf/d75/d92 1 1 2023-12-16T03:16:06.170 INFO:tasks.workunit.client.0.smithi064.stdout:3/652: chown db/d12/d1a/d2c/d34 44 1 2023-12-16T03:16:06.170 INFO:tasks.workunit.client.0.smithi064.stdout:3/653: chown db/d12/d21/f49 74772 1 2023-12-16T03:16:06.170 INFO:tasks.workunit.client.0.smithi064.stdout:3/654: write db/d12/d1a/fb9 [998238,7479] 0 2023-12-16T03:16:06.170 INFO:tasks.workunit.client.0.smithi064.stdout:3/655: fsync db/d4f/f5d 0 2023-12-16T03:16:06.171 INFO:tasks.workunit.client.1.smithi184.stdout:8/922: dwrite d2/d4/d10/d75/fa5 [0,4194304] 0 2023-12-16T03:16:06.172 INFO:tasks.workunit.client.1.smithi184.stdout:0/874: creat dc/d22/d53/f12d x:0 0 0 2023-12-16T03:16:06.173 INFO:tasks.workunit.client.0.smithi064.stdout:1/535: mknod d3/dd/d23/d60/d9d/cb2 0 2023-12-16T03:16:06.182 INFO:tasks.workunit.client.0.smithi064.stdout:9/500: rmdir d2/dc/d24/d39/d42/d9a/d8b/d98 0 2023-12-16T03:16:06.183 INFO:tasks.workunit.client.1.smithi184.stdout:0/875: dread dc/d22/d48/f6d [0,4194304] 0 2023-12-16T03:16:06.184 INFO:tasks.workunit.client.1.smithi184.stdout:7/804: dwrite d0/d3/d2e/d79/dd/d75/fb3 [0,4194304] 0 2023-12-16T03:16:06.186 INFO:tasks.workunit.client.0.smithi064.stdout:3/656: truncate db/d12/d1a/f26 1141942 0 2023-12-16T03:16:06.190 INFO:tasks.workunit.client.0.smithi064.stdout:9/501: unlink d2/d2d/d3b/d3c/d4b/l62 0 2023-12-16T03:16:06.192 INFO:tasks.workunit.client.1.smithi184.stdout:3/998: rename d12/d86/de4/d110/l162 to d12/d18/d1f/d23/d2a/d4a/l16f 0 2023-12-16T03:16:06.195 INFO:tasks.workunit.client.0.smithi064.stdout:3/657: dread f6 [0,4194304] 0 2023-12-16T03:16:06.195 INFO:tasks.workunit.client.0.smithi064.stdout:3/658: fsync db/d12/d1a/d2c/d34/d4c/d6a/da7/f24 0 2023-12-16T03:16:06.196 INFO:tasks.workunit.client.1.smithi184.stdout:2/774: mknod d3/d13/d28/d83/dda/cff 0 2023-12-16T03:16:06.196 INFO:tasks.workunit.client.1.smithi184.stdout:6/963: creat d0/d5/d22/d25/d3f/d6f/da8/f139 x:0 0 0 2023-12-16T03:16:06.196 INFO:tasks.workunit.client.0.smithi064.stdout:9/502: dread d2/dc/d24/d39/d5e/d6f/f84 [0,4194304] 0 2023-12-16T03:16:06.196 INFO:tasks.workunit.client.0.smithi064.stdout:1/536: dwrite d3/d36/d9e/f85 [0,4194304] 0 2023-12-16T03:16:06.196 INFO:tasks.workunit.client.0.smithi064.stdout:1/537: dread - d3/d36/f83 zero size 2023-12-16T03:16:06.197 INFO:tasks.workunit.client.0.smithi064.stdout:3/659: write db/d12/d4e/fa5 [573803,24032] 0 2023-12-16T03:16:06.199 INFO:tasks.workunit.client.0.smithi064.stdout:6/500: rmdir d3 39 2023-12-16T03:16:06.200 INFO:tasks.workunit.client.0.smithi064.stdout:1/538: read d3/dd/d11/d3b/f3e [1176788,80345] 0 2023-12-16T03:16:06.200 INFO:tasks.workunit.client.0.smithi064.stdout:1/539: write d3/dd/d11/d3b/f69 [963435,81758] 0 2023-12-16T03:16:06.201 INFO:tasks.workunit.client.0.smithi064.stdout:1/540: chown d3/d36/d44/d4d/d58/c61 26740 1 2023-12-16T03:16:06.201 INFO:tasks.workunit.client.1.smithi184.stdout:4/831: sync 2023-12-16T03:16:06.201 INFO:tasks.workunit.client.0.smithi064.stdout:1/541: write d3/dd/f1a [1253869,118490] 0 2023-12-16T03:16:06.202 INFO:tasks.workunit.client.1.smithi184.stdout:0/876: dread dc/d22/d1d/d43/d5a/f89 [4194304,4194304] 0 2023-12-16T03:16:06.202 INFO:tasks.workunit.client.1.smithi184.stdout:8/923: unlink d2/d4/d10/d7a/ff7 0 2023-12-16T03:16:06.208 INFO:tasks.workunit.client.0.smithi064.stdout:6/501: symlink d3/d8/l90 0 2023-12-16T03:16:06.208 INFO:tasks.workunit.client.0.smithi064.stdout:3/660: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/fd0 [0,4194304] 0 2023-12-16T03:16:06.208 INFO:tasks.workunit.client.0.smithi064.stdout:3/661: chown db/d12 393 1 2023-12-16T03:16:06.209 INFO:tasks.workunit.client.1.smithi184.stdout:7/805: getdents d0/d3/d2e/d79/d32/d39/d9c 0 2023-12-16T03:16:06.212 INFO:tasks.workunit.client.1.smithi184.stdout:6/964: unlink d0/d5/d22/d37/l9d 0 2023-12-16T03:16:06.213 INFO:tasks.workunit.client.1.smithi184.stdout:2/775: dread d3/d9/faa [4194304,4194304] 0 2023-12-16T03:16:06.214 INFO:tasks.workunit.client.1.smithi184.stdout:2/776: chown d3/d9/d19/d87/lc3 374 1 2023-12-16T03:16:06.214 INFO:tasks.workunit.client.0.smithi064.stdout:1/542: creat d3/dd/d11/d2f/fb3 x:0 0 0 2023-12-16T03:16:06.216 INFO:tasks.workunit.client.0.smithi064.stdout:6/502: truncate d3/d44/f71 3704449 0 2023-12-16T03:16:06.216 INFO:tasks.workunit.client.1.smithi184.stdout:7/806: write d0/d3/d4/f2c [5177715,54488] 0 2023-12-16T03:16:06.217 INFO:tasks.workunit.client.1.smithi184.stdout:4/832: getdents d1/d12/db3/db8/dd0 0 2023-12-16T03:16:06.217 INFO:tasks.workunit.client.1.smithi184.stdout:4/833: fsync d1/f93 0 2023-12-16T03:16:06.217 INFO:tasks.workunit.client.0.smithi064.stdout:9/503: dwrite d2/dc/f32 [0,4194304] 0 2023-12-16T03:16:06.220 INFO:tasks.workunit.client.1.smithi184.stdout:0/877: mkdir dc/d22/d48/d12e 0 2023-12-16T03:16:06.221 INFO:tasks.workunit.client.0.smithi064.stdout:6/503: creat d3/d8/d1f/d26/d47/f91 x:0 0 0 2023-12-16T03:16:06.222 INFO:tasks.workunit.client.1.smithi184.stdout:8/924: unlink d2/d4/d10/l62 0 2023-12-16T03:16:06.223 INFO:tasks.workunit.client.0.smithi064.stdout:1/543: dread d3/f9c [0,4194304] 0 2023-12-16T03:16:06.223 INFO:tasks.workunit.client.0.smithi064.stdout:1/544: write d3/dd/d11/d2f/f5f [267453,12914] 0 2023-12-16T03:16:06.225 INFO:tasks.workunit.client.1.smithi184.stdout:6/965: creat d0/d5/d22/d25/f13a x:0 0 0 2023-12-16T03:16:06.229 INFO:tasks.workunit.client.1.smithi184.stdout:2/777: symlink d3/d29/d4d/d5b/l100 0 2023-12-16T03:16:06.230 INFO:tasks.workunit.client.0.smithi064.stdout:9/504: creat d2/d7e/fa2 x:0 0 0 2023-12-16T03:16:06.230 INFO:tasks.workunit.client.0.smithi064.stdout:9/505: chown d2/dc/d24/d39/d42/d94 983 1 2023-12-16T03:16:06.231 INFO:tasks.workunit.client.0.smithi064.stdout:6/504: mkdir d3/d80/d92 0 2023-12-16T03:16:06.232 INFO:tasks.workunit.client.0.smithi064.stdout:1/545: dread d3/dd/d11/f1f [0,4194304] 0 2023-12-16T03:16:06.232 INFO:tasks.workunit.client.0.smithi064.stdout:1/546: stat d3/dd/d11/fa5 0 2023-12-16T03:16:06.233 INFO:tasks.workunit.client.1.smithi184.stdout:7/807: creat d0/d3/d2e/d79/d32/d39/d8f/dab/ff4 x:0 0 0 2023-12-16T03:16:06.234 INFO:tasks.workunit.client.1.smithi184.stdout:0/878: getdents dc/d2a 0 2023-12-16T03:16:06.234 INFO:tasks.workunit.client.1.smithi184.stdout:0/879: fdatasync dc/d22/d1d/d43/f55 0 2023-12-16T03:16:06.236 INFO:tasks.workunit.client.1.smithi184.stdout:8/925: link d2/d4/d10/d11/d77/fcc d2/d4/d10/d7a/d83/d8b/de0/dfb/f12f 0 2023-12-16T03:16:06.236 INFO:tasks.workunit.client.1.smithi184.stdout:8/926: chown d2/d4/d10/d11/d72 6 1 2023-12-16T03:16:06.237 INFO:tasks.workunit.client.1.smithi184.stdout:6/966: getdents d0/d5/d42 0 2023-12-16T03:16:06.240 INFO:tasks.workunit.client.1.smithi184.stdout:2/778: mkdir d3/d9/d19/d101 0 2023-12-16T03:16:06.240 INFO:tasks.workunit.client.1.smithi184.stdout:5/667: sync 2023-12-16T03:16:06.240 INFO:tasks.workunit.client.1.smithi184.stdout:4/834: dwrite d1/d11/d5a/d63/d72/fd4 [0,4194304] 0 2023-12-16T03:16:06.242 INFO:tasks.workunit.client.1.smithi184.stdout:7/808: symlink d0/d3/d2e/d79/d36/lf5 0 2023-12-16T03:16:06.242 INFO:tasks.workunit.client.1.smithi184.stdout:7/809: dread - d0/d3/d2e/d79/d36/d84/dd2/fe0 zero size 2023-12-16T03:16:06.243 INFO:tasks.workunit.client.1.smithi184.stdout:6/967: creat d0/d5/d22/d25/dbf/d11b/f13b x:0 0 0 2023-12-16T03:16:06.244 INFO:tasks.workunit.client.0.smithi064.stdout:9/506: dread f1 [0,4194304] 0 2023-12-16T03:16:06.249 INFO:tasks.workunit.client.1.smithi184.stdout:5/668: creat d1/d3/fd9 x:0 0 0 2023-12-16T03:16:06.249 INFO:tasks.workunit.client.1.smithi184.stdout:7/810: creat d0/d3/d2e/d79/d32/d39/d9c/dc2/ddd/ff6 x:0 0 0 2023-12-16T03:16:06.249 INFO:tasks.workunit.client.0.smithi064.stdout:3/662: link db/d12/d1a/d2c/f5b db/d4f/d51/dd2/fe0 0 2023-12-16T03:16:06.250 INFO:tasks.workunit.client.0.smithi064.stdout:3/663: stat db/d12/d1a/d2c/d34/d4c/d6a/d93/lb0 0 2023-12-16T03:16:06.255 INFO:tasks.workunit.client.1.smithi184.stdout:6/968: getdents d0/d5/d22/d37/d4d/d9c 0 2023-12-16T03:16:06.258 INFO:tasks.workunit.client.0.smithi064.stdout:9/507: creat d2/d7e/fa3 x:0 0 0 2023-12-16T03:16:06.258 INFO:tasks.workunit.client.0.smithi064.stdout:3/664: unlink db/d12/l55 0 2023-12-16T03:16:06.262 INFO:tasks.workunit.client.0.smithi064.stdout:9/508: dread d2/dc/d24/d39/d5e/f73 [0,4194304] 0 2023-12-16T03:16:06.262 INFO:tasks.workunit.client.0.smithi064.stdout:9/509: dread - d2/dc/d24/d39/d42/d57/f8e zero size 2023-12-16T03:16:06.262 INFO:tasks.workunit.client.0.smithi064.stdout:9/510: chown d2/d2d/d6c/d83/d93 291178744 1 2023-12-16T03:16:06.263 INFO:tasks.workunit.client.1.smithi184.stdout:5/669: truncate d1/d3/fd 1275979 0 2023-12-16T03:16:06.263 INFO:tasks.workunit.client.1.smithi184.stdout:5/670: stat d1/d3/d9/de/d15/d19/f2c 0 2023-12-16T03:16:06.265 INFO:tasks.workunit.client.0.smithi064.stdout:3/665: link db/d12/d1a/d2c/c87 db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/ce1 0 2023-12-16T03:16:06.267 INFO:tasks.workunit.client.1.smithi184.stdout:7/811: mknod d0/d6b/d94/dbe/cf7 0 2023-12-16T03:16:06.267 INFO:tasks.workunit.client.1.smithi184.stdout:7/812: chown d0/d3/d2e/d79/dd/d27/ca8 134 1 2023-12-16T03:16:06.267 INFO:tasks.workunit.client.1.smithi184.stdout:7/813: chown d0/d3/d2e 4 1 2023-12-16T03:16:06.267 INFO:tasks.workunit.client.1.smithi184.stdout:6/969: dread d0/d36/d8a/fde [0,4194304] 0 2023-12-16T03:16:06.268 INFO:tasks.workunit.client.1.smithi184.stdout:6/970: write d0/d5/dd1/fe8 [860991,65385] 0 2023-12-16T03:16:06.269 INFO:tasks.workunit.client.0.smithi064.stdout:3/666: rename db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f43 to db/d12/fe2 0 2023-12-16T03:16:06.273 INFO:tasks.workunit.client.0.smithi064.stdout:3/667: rename db/d12/d4e/c91 to db/d4f/d51/dd1/dd3/ce3 0 2023-12-16T03:16:06.273 INFO:tasks.workunit.client.0.smithi064.stdout:3/668: truncate db/d12/d1a/f54 3378307 0 2023-12-16T03:16:06.273 INFO:tasks.workunit.client.0.smithi064.stdout:2/437: sync 2023-12-16T03:16:06.274 INFO:tasks.workunit.client.0.smithi064.stdout:3/669: write db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f78 [803386,82855] 0 2023-12-16T03:16:06.275 INFO:tasks.workunit.client.0.smithi064.stdout:2/438: getdents d1/d15/d1b/d61/d63 0 2023-12-16T03:16:06.275 INFO:tasks.workunit.client.0.smithi064.stdout:2/439: dread - d1/d15/d1b/d61/f77 zero size 2023-12-16T03:16:06.276 INFO:tasks.workunit.client.1.smithi184.stdout:0/880: dwrite dc/d22/d1a/f3e [0,4194304] 0 2023-12-16T03:16:06.276 INFO:tasks.workunit.client.0.smithi064.stdout:3/670: creat db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/da4/fe4 x:0 0 0 2023-12-16T03:16:06.277 INFO:tasks.workunit.client.0.smithi064.stdout:2/440: rmdir d1/d27/d2e/d68 39 2023-12-16T03:16:06.280 INFO:tasks.workunit.client.1.smithi184.stdout:5/671: symlink d1/d3/dc6/lda 0 2023-12-16T03:16:06.280 INFO:tasks.workunit.client.1.smithi184.stdout:6/971: symlink d0/d5/d12/de7/l13c 0 2023-12-16T03:16:06.280 INFO:tasks.workunit.client.1.smithi184.stdout:6/972: truncate d0/d36/fdd 70943 0 2023-12-16T03:16:06.280 INFO:tasks.workunit.client.1.smithi184.stdout:7/814: creat d0/d3/d4/ff8 x:0 0 0 2023-12-16T03:16:06.280 INFO:tasks.workunit.client.1.smithi184.stdout:7/815: fsync d0/d3/f11 0 2023-12-16T03:16:06.280 INFO:tasks.workunit.client.0.smithi064.stdout:2/441: link d1/d15/d58/c31 d1/d15/d1b/c87 0 2023-12-16T03:16:06.281 INFO:tasks.workunit.client.0.smithi064.stdout:2/442: read - d1/d27/d2e/d68/f64 zero size 2023-12-16T03:16:06.281 INFO:tasks.workunit.client.0.smithi064.stdout:2/443: write d1/d27/d2e/d69/f56 [1465967,127261] 0 2023-12-16T03:16:06.282 INFO:tasks.workunit.client.1.smithi184.stdout:0/881: unlink dc/d22/ff6 0 2023-12-16T03:16:06.284 INFO:tasks.workunit.client.0.smithi064.stdout:2/444: mknod d1/d15/d1b/c88 0 2023-12-16T03:16:06.287 INFO:tasks.workunit.client.1.smithi184.stdout:5/672: rmdir d1/d3/d9 39 2023-12-16T03:16:06.288 INFO:tasks.workunit.client.1.smithi184.stdout:5/673: chown d1/d3/d9/de/d15/d19/d5f/f41 211297 1 2023-12-16T03:16:06.288 INFO:tasks.workunit.client.1.smithi184.stdout:5/674: chown d1/d3/d9/de/da5 67103 1 2023-12-16T03:16:06.288 INFO:tasks.workunit.client.1.smithi184.stdout:6/973: symlink d0/d5/d22/d25/d47/d10e/l13d 0 2023-12-16T03:16:06.289 INFO:tasks.workunit.client.0.smithi064.stdout:1/547: dwrite d3/dd/d11/d3b/f3e [0,4194304] 0 2023-12-16T03:16:06.292 INFO:tasks.workunit.client.1.smithi184.stdout:8/927: dwrite d2/d4/d10/d11/d72/dc2/fc3 [0,4194304] 0 2023-12-16T03:16:06.292 INFO:tasks.workunit.client.1.smithi184.stdout:8/928: chown d2/d37/d7c/l128 1821526 1 2023-12-16T03:16:06.292 INFO:tasks.workunit.client.1.smithi184.stdout:4/835: dwrite d1/d29/d34/d5c/d76/f70 [0,4194304] 0 2023-12-16T03:16:06.296 INFO:tasks.workunit.client.1.smithi184.stdout:1/842: dwrite d3/d34/dbc/d3c/d41/d77/fa3 [0,4194304] 0 2023-12-16T03:16:06.297 INFO:tasks.workunit.client.0.smithi064.stdout:1/548: symlink d3/dd/d23/d60/lb4 0 2023-12-16T03:16:06.297 INFO:tasks.workunit.client.0.smithi064.stdout:1/549: write d3/f9c [2164562,45836] 0 2023-12-16T03:16:06.297 INFO:tasks.workunit.client.0.smithi064.stdout:1/550: chown d3/dd/d11 5759936 1 2023-12-16T03:16:06.297 INFO:tasks.workunit.client.0.smithi064.stdout:1/551: readlink d3/dd/d23/l40 0 2023-12-16T03:16:06.297 INFO:tasks.workunit.client.0.smithi064.stdout:1/552: chown d3/d36/d44/d4d 123802 1 2023-12-16T03:16:06.299 INFO:tasks.workunit.client.1.smithi184.stdout:6/974: mkdir d0/d5/d12/d1b/d33/d3d/d96/d13e 0 2023-12-16T03:16:06.304 INFO:tasks.workunit.client.1.smithi184.stdout:4/836: symlink d1/d12/db3/db8/dd0/l11d 0 2023-12-16T03:16:06.304 INFO:tasks.workunit.client.1.smithi184.stdout:4/837: write d1/d12/db3/f106 [204279,55529] 0 2023-12-16T03:16:06.307 INFO:tasks.workunit.client.1.smithi184.stdout:1/843: creat d3/d34/dbc/d3c/d41/d63/de1/f126 x:0 0 0 2023-12-16T03:16:06.307 INFO:tasks.workunit.client.1.smithi184.stdout:1/844: write d3/d34/dbc/d3c/f4f [5123583,33430] 0 2023-12-16T03:16:06.308 INFO:tasks.workunit.client.0.smithi064.stdout:1/553: dread d3/dd/d11/d38/f77 [0,4194304] 0 2023-12-16T03:16:06.309 INFO:tasks.workunit.client.1.smithi184.stdout:6/975: unlink d0/d5/d22/d25/d47/f104 0 2023-12-16T03:16:06.309 INFO:tasks.workunit.client.1.smithi184.stdout:2/779: dwrite d3/f6 [0,4194304] 0 2023-12-16T03:16:06.309 INFO:tasks.workunit.client.1.smithi184.stdout:2/780: write d3/d29/d2f/f8b [1032121,35839] 0 2023-12-16T03:16:06.310 INFO:tasks.workunit.client.0.smithi064.stdout:9/511: dwrite d2/d2d/d6c/f89 [0,4194304] 0 2023-12-16T03:16:06.311 INFO:tasks.workunit.client.1.smithi184.stdout:6/976: read d0/d5/d22/d25/d47/f73 [2335329,33056] 0 2023-12-16T03:16:06.311 INFO:tasks.workunit.client.1.smithi184.stdout:6/977: dread - d0/d5/d22/fd3 zero size 2023-12-16T03:16:06.311 INFO:tasks.workunit.client.1.smithi184.stdout:4/838: rename d1/d29/d34/d5c/d76/dc7 to d1/d12/db3/db8/d11e 0 2023-12-16T03:16:06.313 INFO:tasks.workunit.client.0.smithi064.stdout:1/554: write d3/dd/d11/d3b/f3e [630959,56975] 0 2023-12-16T03:16:06.315 INFO:tasks.workunit.client.0.smithi064.stdout:3/671: dwrite db/d12/d1a/d2c/d34/d4c/f9d [0,4194304] 0 2023-12-16T03:16:06.315 INFO:tasks.workunit.client.0.smithi064.stdout:3/672: fsync db/d12/d1a/f97 0 2023-12-16T03:16:06.316 INFO:tasks.workunit.client.1.smithi184.stdout:6/978: symlink d0/d5/d22/d34/dcc/l13f 0 2023-12-16T03:16:06.316 INFO:tasks.workunit.client.1.smithi184.stdout:5/675: dwrite d1/d3/d9/de/d15/d90/f9d [0,4194304] 0 2023-12-16T03:16:06.318 INFO:tasks.workunit.client.1.smithi184.stdout:0/882: dwrite dc/d22/d48/fc6 [0,4194304] 0 2023-12-16T03:16:06.319 INFO:tasks.workunit.client.1.smithi184.stdout:2/781: rename d3/d13/d28/dac/daf/dc8/cf1 to d3/d29/d2f/d46/dfd/c102 0 2023-12-16T03:16:06.323 INFO:tasks.workunit.client.1.smithi184.stdout:1/845: mkdir d3/d34/d76/d91/d127 0 2023-12-16T03:16:06.323 INFO:tasks.workunit.client.1.smithi184.stdout:7/816: rmdir d0/d6b 39 2023-12-16T03:16:06.323 INFO:tasks.workunit.client.1.smithi184.stdout:1/846: write d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/fcf [737031,82806] 0 2023-12-16T03:16:06.330 INFO:tasks.workunit.client.0.smithi064.stdout:6/505: dread d3/d44/f71 [0,4194304] 0 2023-12-16T03:16:06.332 INFO:tasks.workunit.client.1.smithi184.stdout:5/676: dread d1/d2a/d31/d58/daf/f8a [0,4194304] 0 2023-12-16T03:16:06.350 INFO:tasks.workunit.client.1.smithi184.stdout:0/883: dwrite dc/d22/d48/f6d [4194304,4194304] 0 2023-12-16T03:16:06.350 INFO:tasks.workunit.client.1.smithi184.stdout:0/884: fsync dc/d10/f25 0 2023-12-16T03:16:06.351 INFO:tasks.workunit.client.1.smithi184.stdout:0/885: fsync dc/d10/da7/dc0/ff9 0 2023-12-16T03:16:06.351 INFO:tasks.workunit.client.1.smithi184.stdout:0/886: fsync dc/d10/d2d/f41 0 2023-12-16T03:16:06.352 INFO:tasks.workunit.client.1.smithi184.stdout:7/817: dwrite d0/d3/d4/ff8 [0,4194304] 0 2023-12-16T03:16:06.352 INFO:tasks.workunit.client.0.smithi064.stdout:3/673: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f86 [0,4194304] 0 2023-12-16T03:16:06.374 INFO:tasks.workunit.client.1.smithi184.stdout:7/818: dwrite d0/d3/d2e/d79/d32/d39/d9c/fe7 [0,4194304] 0 2023-12-16T03:16:06.376 INFO:tasks.workunit.client.0.smithi064.stdout:9/512: mkdir d2/d2d/d6c/da4 0 2023-12-16T03:16:06.376 INFO:tasks.workunit.client.0.smithi064.stdout:9/513: chown d2/dc/d24/d39/d42/f51 7673 1 2023-12-16T03:16:06.376 INFO:tasks.workunit.client.0.smithi064.stdout:9/514: stat d2/d2d/d36 0 2023-12-16T03:16:06.384 INFO:tasks.workunit.client.0.smithi064.stdout:6/506: getdents d3/d8/d1f/d26/d47 0 2023-12-16T03:16:06.388 INFO:tasks.workunit.client.0.smithi064.stdout:3/674: mkdir db/d12/d1a/d2c/d34/d4c/de5 0 2023-12-16T03:16:06.394 INFO:tasks.workunit.client.0.smithi064.stdout:9/515: rename d2/dc/f6d to d2/d2d/d3b/d3c/d34/fa5 0 2023-12-16T03:16:06.398 INFO:tasks.workunit.client.0.smithi064.stdout:9/516: stat d2/c69 0 2023-12-16T03:16:06.399 INFO:tasks.workunit.client.0.smithi064.stdout:9/517: dread - d2/dc/d24/d39/d42/f48 zero size 2023-12-16T03:16:06.401 INFO:tasks.workunit.client.1.smithi184.stdout:4/839: rename d1/d11/d1b/d1e/f57 to d1/d12/db3/db8/f11f 0 2023-12-16T03:16:06.401 INFO:tasks.workunit.client.1.smithi184.stdout:4/840: chown d1/d12/d13/da1/fe2 8187 1 2023-12-16T03:16:06.401 INFO:tasks.workunit.client.1.smithi184.stdout:4/841: write d1/d29/d34/f119 [368835,127662] 0 2023-12-16T03:16:06.401 INFO:tasks.workunit.client.1.smithi184.stdout:4/842: readlink d1/d29/d34/d5c/d76/d42/lc4 0 2023-12-16T03:16:06.401 INFO:tasks.workunit.client.1.smithi184.stdout:4/843: dread - d1/d12/db3/ffe zero size 2023-12-16T03:16:06.401 INFO:tasks.workunit.client.1.smithi184.stdout:4/844: dread - d1/d12/db3/db8/d11e/f105 zero size 2023-12-16T03:16:06.404 INFO:tasks.workunit.client.1.smithi184.stdout:2/782: symlink d3/d9/d19/d87/l103 0 2023-12-16T03:16:06.405 INFO:tasks.workunit.client.0.smithi064.stdout:6/507: dwrite d3/d8/f4c [0,4194304] 0 2023-12-16T03:16:06.405 INFO:tasks.workunit.client.0.smithi064.stdout:6/508: stat d3/d8/d1f/c32 0 2023-12-16T03:16:06.407 INFO:tasks.workunit.client.0.smithi064.stdout:6/509: write d3/f5 [2273761,85780] 0 2023-12-16T03:16:06.407 INFO:tasks.workunit.client.0.smithi064.stdout:6/510: fsync d3/d8/d13/f7b 0 2023-12-16T03:16:06.409 INFO:tasks.workunit.client.1.smithi184.stdout:1/847: creat d3/d34/dbc/d36/f128 x:0 0 0 2023-12-16T03:16:06.411 INFO:tasks.workunit.client.1.smithi184.stdout:4/845: dread d1/d29/d34/d5c/d76/d3b/fa9 [0,4194304] 0 2023-12-16T03:16:06.411 INFO:tasks.workunit.client.0.smithi064.stdout:6/511: mknod d3/c93 0 2023-12-16T03:16:06.411 INFO:tasks.workunit.client.0.smithi064.stdout:6/512: write d3/d8/d13/d46/f87 [13759,49647] 0 2023-12-16T03:16:06.412 INFO:tasks.workunit.client.0.smithi064.stdout:6/513: getdents d3/d8/d1f/d26/d47 0 2023-12-16T03:16:06.412 INFO:tasks.workunit.client.1.smithi184.stdout:5/677: creat d1/d3/d9/de/d15/db9/fdb x:0 0 0 2023-12-16T03:16:06.414 INFO:tasks.workunit.client.0.smithi064.stdout:6/514: mknod d3/d8/c94 0 2023-12-16T03:16:06.417 INFO:tasks.workunit.client.0.smithi064.stdout:6/515: creat d3/d8/d13/d46/f95 x:0 0 0 2023-12-16T03:16:06.417 INFO:tasks.workunit.client.1.smithi184.stdout:1/848: dread d3/d34/dbc/d3c/d41/d63/f64 [0,4194304] 0 2023-12-16T03:16:06.418 INFO:tasks.workunit.client.0.smithi064.stdout:6/516: read d3/d9/f18 [976962,3236] 0 2023-12-16T03:16:06.419 INFO:tasks.workunit.client.1.smithi184.stdout:0/887: creat dc/d22/d1d/d2c/f12f x:0 0 0 2023-12-16T03:16:06.421 INFO:tasks.workunit.client.0.smithi064.stdout:6/517: symlink d3/d8/d1f/d26/d47/d4a/d67/d73/l96 0 2023-12-16T03:16:06.423 INFO:tasks.workunit.client.0.smithi064.stdout:9/518: unlink d2/dc/f1f 0 2023-12-16T03:16:06.424 INFO:tasks.workunit.client.0.smithi064.stdout:6/518: mknod d3/d8/d13/c97 0 2023-12-16T03:16:06.424 INFO:tasks.workunit.client.0.smithi064.stdout:6/519: fsync d3/d8/da/fe 0 2023-12-16T03:16:06.427 INFO:tasks.workunit.client.0.smithi064.stdout:9/519: rename d2/dc/d24/d39/d42/d57/l44 to d2/d2d/d6c/la6 0 2023-12-16T03:16:06.428 INFO:tasks.workunit.client.0.smithi064.stdout:3/675: rmdir db/d12/d1a 39 2023-12-16T03:16:06.428 INFO:tasks.workunit.client.0.smithi064.stdout:9/520: write f1 [2237242,74814] 0 2023-12-16T03:16:06.430 INFO:tasks.workunit.client.1.smithi184.stdout:7/819: mkdir d0/d3/d2e/d79/d36/d3f/df9 0 2023-12-16T03:16:06.431 INFO:tasks.workunit.client.0.smithi064.stdout:3/676: rmdir db/d4f/da9/dbf 39 2023-12-16T03:16:06.432 INFO:tasks.workunit.client.0.smithi064.stdout:3/677: write db/d4f/d51/dd2/fe0 [921406,118312] 0 2023-12-16T03:16:06.432 INFO:tasks.workunit.client.0.smithi064.stdout:3/678: fsync db/d12/d1a/d2c/d34/d4c/fbb 0 2023-12-16T03:16:06.432 INFO:tasks.workunit.client.0.smithi064.stdout:3/679: chown c8 44 1 2023-12-16T03:16:06.433 INFO:tasks.workunit.client.1.smithi184.stdout:6/979: mknod d0/d5/d12/c140 0 2023-12-16T03:16:06.433 INFO:tasks.workunit.client.1.smithi184.stdout:6/980: chown d0/d5/d12/d1b/c21 3963908 1 2023-12-16T03:16:06.434 INFO:tasks.workunit.client.0.smithi064.stdout:9/521: symlink d2/d7e/la7 0 2023-12-16T03:16:06.436 INFO:tasks.workunit.client.0.smithi064.stdout:8/598: sync 2023-12-16T03:16:06.437 INFO:tasks.workunit.client.0.smithi064.stdout:5/488: sync 2023-12-16T03:16:06.437 INFO:tasks.workunit.client.0.smithi064.stdout:0/502: sync 2023-12-16T03:16:06.437 INFO:tasks.workunit.client.0.smithi064.stdout:4/567: sync 2023-12-16T03:16:06.437 INFO:tasks.workunit.client.0.smithi064.stdout:7/552: sync 2023-12-16T03:16:06.437 INFO:tasks.workunit.client.1.smithi184.stdout:2/783: link d3/d29/d2f/d46/d77/ff2 d3/d13/d6e/f104 0 2023-12-16T03:16:06.437 INFO:tasks.workunit.client.1.smithi184.stdout:2/784: write d3/d13/d28/fbe [1311793,57524] 0 2023-12-16T03:16:06.438 INFO:tasks.workunit.client.1.smithi184.stdout:2/785: stat d3/d29/d2f 0 2023-12-16T03:16:06.438 INFO:tasks.workunit.client.0.smithi064.stdout:6/520: rename d3/d8/d13/d46/f95 to d3/d8/d13/d46/f98 0 2023-12-16T03:16:06.440 INFO:tasks.workunit.client.0.smithi064.stdout:3/680: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f66 [0,4194304] 0 2023-12-16T03:16:06.442 INFO:tasks.workunit.client.0.smithi064.stdout:9/522: unlink d2/c1e 0 2023-12-16T03:16:06.442 INFO:tasks.workunit.client.0.smithi064.stdout:4/568: write d0/d1e/d36/f46 [417112,39223] 0 2023-12-16T03:16:06.445 INFO:tasks.workunit.client.0.smithi064.stdout:5/489: rename d0/de to d0/d19/d48/d8f/dac 0 2023-12-16T03:16:06.448 INFO:tasks.workunit.client.0.smithi064.stdout:8/599: creat d0/d1d/d48/fcf x:0 0 0 2023-12-16T03:16:06.448 INFO:tasks.workunit.client.1.smithi184.stdout:3/999: sync 2023-12-16T03:16:06.450 INFO:tasks.workunit.client.0.smithi064.stdout:6/521: mkdir d3/d8/d1f/d26/d47/d4a/d67/d86/d99 0 2023-12-16T03:16:06.452 INFO:tasks.workunit.client.1.smithi184.stdout:4/846: getdents d1/d11 0 2023-12-16T03:16:06.454 INFO:tasks.workunit.client.0.smithi064.stdout:3/681: symlink db/d12/d1a/d2c/d34/d4c/de5/le6 0 2023-12-16T03:16:06.458 INFO:tasks.workunit.client.0.smithi064.stdout:4/569: dread d0/d1e/f37 [0,4194304] 0 2023-12-16T03:16:06.458 INFO:tasks.workunit.client.0.smithi064.stdout:4/570: chown d0/d42/d56 187 1 2023-12-16T03:16:06.458 INFO:tasks.workunit.client.0.smithi064.stdout:7/553: dread d7/d3e/d42/d43/f5f [0,4194304] 0 2023-12-16T03:16:06.458 INFO:tasks.workunit.client.1.smithi184.stdout:5/678: symlink d1/d3/d9/de/d15/db9/ldc 0 2023-12-16T03:16:06.459 INFO:tasks.workunit.client.1.smithi184.stdout:0/888: stat dc/d10/d2d/c31 0 2023-12-16T03:16:06.459 INFO:tasks.workunit.client.0.smithi064.stdout:6/522: creat d3/f9a x:0 0 0 2023-12-16T03:16:06.460 INFO:tasks.workunit.client.0.smithi064.stdout:6/523: getdents d3/d80/d92 0 2023-12-16T03:16:06.460 INFO:tasks.workunit.client.0.smithi064.stdout:4/571: read d0/da/f9f [856277,123346] 0 2023-12-16T03:16:06.461 INFO:tasks.workunit.client.1.smithi184.stdout:7/820: mknod d0/d3/d2e/da9/cfa 0 2023-12-16T03:16:06.461 INFO:tasks.workunit.client.0.smithi064.stdout:8/600: dread d0/db/f76 [0,4194304] 0 2023-12-16T03:16:06.461 INFO:tasks.workunit.client.0.smithi064.stdout:8/601: dread - d0/d1d/d48/fcf zero size 2023-12-16T03:16:06.462 INFO:tasks.workunit.client.0.smithi064.stdout:8/602: fdatasync d0/d1d/d24/d2f/d50/f78 0 2023-12-16T03:16:06.463 INFO:tasks.workunit.client.1.smithi184.stdout:5/679: read d1/d3/d9/de/f37 [3766887,112404] 0 2023-12-16T03:16:06.466 INFO:tasks.workunit.client.0.smithi064.stdout:6/524: rename d3/d8/d13/d58/d65/l8d to d3/d44/d7a/l9b 0 2023-12-16T03:16:06.466 INFO:tasks.workunit.client.0.smithi064.stdout:3/682: dread db/d4f/faf [0,4194304] 0 2023-12-16T03:16:06.466 INFO:tasks.workunit.client.0.smithi064.stdout:3/683: write db/d4f/d51/fdc [603529,86804] 0 2023-12-16T03:16:06.467 INFO:tasks.workunit.client.1.smithi184.stdout:6/981: dwrite d0/d5/f24 [0,4194304] 0 2023-12-16T03:16:06.467 INFO:tasks.workunit.client.1.smithi184.stdout:2/786: unlink d3/d9/d19/d87/lc3 0 2023-12-16T03:16:06.468 INFO:tasks.workunit.client.0.smithi064.stdout:7/554: write d7/d3e/f55 [479402,74851] 0 2023-12-16T03:16:06.468 INFO:tasks.workunit.client.0.smithi064.stdout:8/603: dread d0/d1d/d24/d2f/f64 [0,4194304] 0 2023-12-16T03:16:06.468 INFO:tasks.workunit.client.0.smithi064.stdout:8/604: readlink d0/d1d/d3c/lc2 0 2023-12-16T03:16:06.468 INFO:tasks.workunit.client.0.smithi064.stdout:4/572: creat d0/da/da6/fb5 x:0 0 0 2023-12-16T03:16:06.470 INFO:tasks.workunit.client.1.smithi184.stdout:4/847: link d1/d11/d5a/d63/d103/lff d1/d29/d34/d5c/d76/d33/d4a/l120 0 2023-12-16T03:16:06.470 INFO:tasks.workunit.client.0.smithi064.stdout:0/503: dwrite d2/d7/d10/f14 [0,4194304] 0 2023-12-16T03:16:06.470 INFO:tasks.workunit.client.0.smithi064.stdout:0/504: chown d2/l6c 610 1 2023-12-16T03:16:06.470 INFO:tasks.workunit.client.0.smithi064.stdout:5/490: dwrite d0/d7/d97/f9b [4194304,4194304] 0 2023-12-16T03:16:06.471 INFO:tasks.workunit.client.0.smithi064.stdout:6/525: creat d3/d8/d1f/d26/f9c x:0 0 0 2023-12-16T03:16:06.473 INFO:tasks.workunit.client.1.smithi184.stdout:1/849: rename d3/d34/dbc/d36/f128 to d3/d34/f129 0 2023-12-16T03:16:06.474 INFO:tasks.workunit.client.1.smithi184.stdout:1/850: fdatasync d3/d34/dbc/d3c/d24/d8e/f97 0 2023-12-16T03:16:06.476 INFO:tasks.workunit.client.1.smithi184.stdout:0/889: creat dc/d22/d1d/d35/df7/f130 x:0 0 0 2023-12-16T03:16:06.476 INFO:tasks.workunit.client.1.smithi184.stdout:0/890: write dc/d22/d48/f5b [8600881,92365] 0 2023-12-16T03:16:06.476 INFO:tasks.workunit.client.1.smithi184.stdout:0/891: dread - dc/d10/d2d/fbc zero size 2023-12-16T03:16:06.477 INFO:tasks.workunit.client.0.smithi064.stdout:7/555: symlink d7/d3e/d42/d48/d51/d7c/laf 0 2023-12-16T03:16:06.477 INFO:tasks.workunit.client.0.smithi064.stdout:7/556: chown l3 964777110 1 2023-12-16T03:16:06.479 INFO:tasks.workunit.client.0.smithi064.stdout:6/526: dread d3/d9/f45 [0,4194304] 0 2023-12-16T03:16:06.485 INFO:tasks.workunit.client.0.smithi064.stdout:7/557: read d7/d3e/d42/d89/d20/f21 [3328223,89466] 0 2023-12-16T03:16:06.486 INFO:tasks.workunit.client.0.smithi064.stdout:5/491: dread d0/f17 [0,4194304] 0 2023-12-16T03:16:06.490 INFO:tasks.workunit.client.0.smithi064.stdout:4/573: write d0/d42/d56/f7c [1023336,62671] 0 2023-12-16T03:16:06.490 INFO:tasks.workunit.client.0.smithi064.stdout:4/574: chown d0/d12/f35 28448 1 2023-12-16T03:16:06.495 INFO:tasks.workunit.client.0.smithi064.stdout:3/684: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/dc9/fdb [0,4194304] 0 2023-12-16T03:16:06.495 INFO:tasks.workunit.client.0.smithi064.stdout:4/575: dread d0/d1e/f37 [0,4194304] 0 2023-12-16T03:16:06.495 INFO:tasks.workunit.client.0.smithi064.stdout:3/685: write db/d12/d1a/d2c/d34/d4c/d6a/f6c [817444,2358] 0 2023-12-16T03:16:06.495 INFO:tasks.workunit.client.0.smithi064.stdout:3/686: write db/d12/d4e/d56/f7a [641325,77680] 0 2023-12-16T03:16:06.496 INFO:tasks.workunit.client.0.smithi064.stdout:0/505: write f1 [7582013,61122] 0 2023-12-16T03:16:06.496 INFO:tasks.workunit.client.0.smithi064.stdout:0/506: readlink d2/d8/da/l13 0 2023-12-16T03:16:06.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.496+0000 7f8da7110700 1 -- 172.21.15.64:0/3991555790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 msgr2=0x7f8da0107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:06.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.496+0000 7f8da7110700 1 --2- 172.21.15.64:0/3991555790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 0x7f8da0107020 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8d94004940 tx=0x7f8d94009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:06.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.496+0000 7f8da7110700 1 -- 172.21.15.64:0/3991555790 shutdown_connections 2023-12-16T03:16:06.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.496+0000 7f8da7110700 1 --2- 172.21.15.64:0/3991555790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da0107560 0x7f8da0109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:06.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.496+0000 7f8da7110700 1 --2- 172.21.15.64:0/3991555790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 0x7f8da0107020 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:06.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.496+0000 7f8da7110700 1 -- 172.21.15.64:0/3991555790 >> 172.21.15.64:0/3991555790 conn(0x7f8da0069b20 msgr2=0x7f8da006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:06.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.496+0000 7f8da7110700 1 -- 172.21.15.64:0/3991555790 shutdown_connections 2023-12-16T03:16:06.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.496+0000 7f8da7110700 1 -- 172.21.15.64:0/3991555790 wait complete. 2023-12-16T03:16:06.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.497+0000 7f8da7110700 1 Processor -- start 2023-12-16T03:16:06.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.497+0000 7f8da7110700 1 -- start start 2023-12-16T03:16:06.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da7110700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 0x7f8da0117ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:06.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da7110700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da0107560 0x7f8da0118420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:06.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da7110700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da0118a20 con 0x7f8da0104c40 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da7110700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da01192c0 con 0x7f8da0107560 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da4eac700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 0x7f8da0117ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8d9ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da0107560 0x7f8da0118420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da4eac700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 0x7f8da0117ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51300/0 (socket says 172.21.15.64:51300) 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da4eac700 1 -- 172.21.15.64:0/3115444387 learned_addr learned my addr 172.21.15.64:0/3115444387 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8d9ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da0107560 0x7f8da0118420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.64:52696/0 (socket says 172.21.15.64:52696) 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da4eac700 1 -- 172.21.15.64:0/3115444387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da0107560 msgr2=0x7f8da0118420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da4eac700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da0107560 0x7f8da0118420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.498+0000 7f8da4eac700 1 -- 172.21.15.64:0/3115444387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94005040 con 0x7f8da0104c40 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.499+0000 7f8da4eac700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 0x7f8da0117ee0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400b0d0 tx=0x7f8d94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.499+0000 7f8d9d7fa700 1 -- 172.21.15.64:0/3115444387 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d94021070 con 0x7f8da0104c40 2023-12-16T03:16:06.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.499+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da0119540 con 0x7f8da0104c40 2023-12-16T03:16:06.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.499+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da0119a20 con 0x7f8da0104c40 2023-12-16T03:16:06.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.500+0000 7f8d9d7fa700 1 -- 172.21.15.64:0/3115444387 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d9401c400 con 0x7f8da0104c40 2023-12-16T03:16:06.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.500+0000 7f8d9d7fa700 1 -- 172.21.15.64:0/3115444387 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d9400e070 con 0x7f8da0104c40 2023-12-16T03:16:06.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.501+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d840052e0 con 0x7f8da0104c40 2023-12-16T03:16:06.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.501+0000 7f8d9d7fa700 1 -- 172.21.15.64:0/3115444387 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8d94013a30 con 0x7f8da0104c40 2023-12-16T03:16:06.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.502+0000 7f8d9d7fa700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8d90068f50 0x7f8d9006b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:06.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.502+0000 7f8d9d7fa700 1 -- 172.21.15.64:0/3115444387 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8d94087f10 con 0x7f8da0104c40 2023-12-16T03:16:06.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.502+0000 7f8d9ffff700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8d90068f50 0x7f8d9006b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:06.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.503+0000 7f8d9ffff700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8d90068f50 0x7f8d9006b400 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009b80 tx=0x7f8d8c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:06.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.507+0000 7f8d9d7fa700 1 -- 172.21.15.64:0/3115444387 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8d94057e70 con 0x7f8da0104c40 2023-12-16T03:16:06.510 INFO:tasks.workunit.client.1.smithi184.stdout:1/851: dwrite d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fc3 [0,4194304] 0 2023-12-16T03:16:06.513 INFO:tasks.workunit.client.0.smithi064.stdout:8/605: dwrite d0/db/d12/d44/fc7 [0,4194304] 0 2023-12-16T03:16:06.570 INFO:tasks.workunit.client.1.smithi184.stdout:7/821: mkdir d0/d3/d2e/d79/dd/d75/dfb 0 2023-12-16T03:16:06.570 INFO:tasks.workunit.client.1.smithi184.stdout:7/822: chown d0/d3/d2e/d79/d32/d39/fb0 0 1 2023-12-16T03:16:06.570 INFO:tasks.workunit.client.1.smithi184.stdout:7/823: stat d0/d3/f1a 0 2023-12-16T03:16:06.571 INFO:tasks.workunit.client.1.smithi184.stdout:5/680: mkdir d1/d3/d9/de/d15/d27/ddd 0 2023-12-16T03:16:06.572 INFO:tasks.workunit.client.1.smithi184.stdout:5/681: fsync d1/d3/d9/d49/d74/fa6 0 2023-12-16T03:16:06.582 INFO:tasks.workunit.client.0.smithi064.stdout:9/523: rmdir d2 39 2023-12-16T03:16:06.587 INFO:tasks.workunit.client.1.smithi184.stdout:4/848: truncate d1/d11/d1b/f87 1583725 0 2023-12-16T03:16:06.588 INFO:tasks.workunit.client.1.smithi184.stdout:5/682: dwrite d1/d2a/fac [0,4194304] 0 2023-12-16T03:16:06.590 INFO:tasks.workunit.client.1.smithi184.stdout:8/929: sync 2023-12-16T03:16:06.593 INFO:tasks.workunit.client.1.smithi184.stdout:2/787: rename d3/d29/d2f/d46/d77/cca to d3/d29/d61/d6d/c105 0 2023-12-16T03:16:06.606 INFO:tasks.workunit.client.0.smithi064.stdout:6/527: mkdir d3/d8/d1f/d26/d47/d9d 0 2023-12-16T03:16:06.606 INFO:tasks.workunit.client.0.smithi064.stdout:6/528: write d3/d44/d7a/f8f [799709,67978] 0 2023-12-16T03:16:06.609 INFO:tasks.workunit.client.1.smithi184.stdout:1/852: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/f12a x:0 0 0 2023-12-16T03:16:06.610 INFO:tasks.workunit.client.1.smithi184.stdout:1/853: dread - d3/d34/d76/fc1 zero size 2023-12-16T03:16:06.612 INFO:tasks.workunit.client.1.smithi184.stdout:8/930: dwrite d2/d37/d7c/ddc/de6/deb/f10e [0,4194304] 0 2023-12-16T03:16:06.612 INFO:tasks.workunit.client.1.smithi184.stdout:8/931: fdatasync d2/d4/d10/d7a/d83/d8b/de0/dfb/f12f 0 2023-12-16T03:16:06.615 INFO:tasks.workunit.client.1.smithi184.stdout:7/824: mknod d0/d3/d2e/d79/d32/d39/d8f/dab/cfc 0 2023-12-16T03:16:06.619 INFO:tasks.workunit.client.1.smithi184.stdout:6/982: mknod d0/d36/d79/c141 0 2023-12-16T03:16:06.619 INFO:tasks.workunit.client.1.smithi184.stdout:6/983: write d0/d5/d22/d34/d53/fc1 [383037,3582] 0 2023-12-16T03:16:06.625 INFO:tasks.workunit.client.1.smithi184.stdout:4/849: mknod d1/d11/d5a/d63/d103/d45/dcf/c121 0 2023-12-16T03:16:06.633 INFO:tasks.workunit.client.0.smithi064.stdout:0/507: creat d2/d7/d10/d21/d31/fa2 x:0 0 0 2023-12-16T03:16:06.635 INFO:tasks.workunit.client.1.smithi184.stdout:4/850: dread d1/d12/db3/fb5 [0,4194304] 0 2023-12-16T03:16:06.638 INFO:tasks.workunit.client.1.smithi184.stdout:5/683: mkdir d1/d3/d9/de/d15/d19/d3a/dde 0 2023-12-16T03:16:06.644 INFO:tasks.workunit.client.1.smithi184.stdout:0/892: rename dc/d22/d48/f5b to dc/d2a/d113/f131 0 2023-12-16T03:16:06.644 INFO:tasks.workunit.client.1.smithi184.stdout:0/893: truncate dc/d22/f127 234747 0 2023-12-16T03:16:06.648 INFO:tasks.workunit.client.1.smithi184.stdout:2/788: symlink d3/d29/d2f/d46/d77/l106 0 2023-12-16T03:16:06.649 INFO:tasks.workunit.client.1.smithi184.stdout:4/851: dread d1/d29/d34/d5c/d76/d42/f92 [0,4194304] 0 2023-12-16T03:16:06.649 INFO:tasks.workunit.client.1.smithi184.stdout:4/852: truncate d1/d11/d5a/d63/f10b 932144 0 2023-12-16T03:16:06.650 INFO:tasks.workunit.client.0.smithi064.stdout:9/524: dread - d2/d2d/d36/f53 zero size 2023-12-16T03:16:06.650 INFO:tasks.workunit.client.0.smithi064.stdout:9/525: getdents d2/dc/d8a/d90 0 2023-12-16T03:16:06.650 INFO:tasks.workunit.client.0.smithi064.stdout:9/526: truncate d2/f85 1009422 0 2023-12-16T03:16:06.671 INFO:tasks.workunit.client.1.smithi184.stdout:5/684: link d1/d3/d9/de/d15/d19/d5f/d45/ca2 d1/d3/d9/de/d30/d80/cdf 0 2023-12-16T03:16:06.674 INFO:tasks.workunit.client.1.smithi184.stdout:0/894: mkdir dc/d22/d53/ded/d132 0 2023-12-16T03:16:06.676 INFO:tasks.workunit.client.1.smithi184.stdout:1/854: mknod d3/d13/d121/d99/c12b 0 2023-12-16T03:16:06.677 INFO:tasks.workunit.client.1.smithi184.stdout:4/853: creat d1/d29/f122 x:0 0 0 2023-12-16T03:16:06.680 INFO:tasks.workunit.client.1.smithi184.stdout:5/685: creat d1/d3/dc6/fe0 x:0 0 0 2023-12-16T03:16:06.680 INFO:tasks.workunit.client.1.smithi184.stdout:5/686: stat d1/d3/d9/de/d30/f4e 0 2023-12-16T03:16:06.683 INFO:tasks.workunit.client.1.smithi184.stdout:6/984: rename d0/d5/d22/d25/laf to d0/d36/d79/l142 0 2023-12-16T03:16:06.685 INFO:tasks.workunit.client.1.smithi184.stdout:0/895: mkdir dc/d22/d1d/d8e/d133 0 2023-12-16T03:16:06.687 INFO:tasks.workunit.client.1.smithi184.stdout:6/985: dread d0/d5/d22/d25/dbf/dbe/de1/f107 [4194304,4194304] 0 2023-12-16T03:16:06.689 INFO:tasks.workunit.client.1.smithi184.stdout:5/687: truncate d1/d2a/d31/f54 2557981 0 2023-12-16T03:16:06.690 INFO:tasks.workunit.client.1.smithi184.stdout:5/688: write d1/d3/d2f/f6d [409977,773] 0 2023-12-16T03:16:06.697 INFO:tasks.workunit.client.1.smithi184.stdout:1/855: dwrite d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fde [0,4194304] 0 2023-12-16T03:16:06.698 INFO:tasks.workunit.client.1.smithi184.stdout:7/825: symlink d0/d3/d2e/d79/d32/d39/lfd 0 2023-12-16T03:16:06.710 INFO:tasks.workunit.client.1.smithi184.stdout:1/856: creat d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/f12c x:0 0 0 2023-12-16T03:16:06.711 INFO:tasks.workunit.client.1.smithi184.stdout:1/857: write d3/d13/f90 [852415,5361] 0 2023-12-16T03:16:06.711 INFO:tasks.workunit.client.1.smithi184.stdout:1/858: fdatasync d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/fcf 0 2023-12-16T03:16:06.711 INFO:tasks.workunit.client.1.smithi184.stdout:1/859: read d3/d34/dbc/d3c/d41/f67 [862469,33922] 0 2023-12-16T03:16:06.712 INFO:tasks.workunit.client.1.smithi184.stdout:1/860: read d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fde [3092807,37586] 0 2023-12-16T03:16:06.713 INFO:tasks.workunit.client.1.smithi184.stdout:7/826: creat d0/d3/d2e/d79/d36/d3f/df9/ffe x:0 0 0 2023-12-16T03:16:06.713 INFO:tasks.workunit.client.1.smithi184.stdout:7/827: fsync d0/d6b/d69/f6e 0 2023-12-16T03:16:06.713 INFO:tasks.workunit.client.1.smithi184.stdout:1/861: read d3/d34/dbc/d36/f9b [3686750,20246] 0 2023-12-16T03:16:06.714 INFO:tasks.workunit.client.1.smithi184.stdout:7/828: write d0/d3/d2e/d79/d32/d39/f3e [3993746,103505] 0 2023-12-16T03:16:06.720 INFO:tasks.workunit.client.1.smithi184.stdout:1/862: unlink d3/d34/dbc/d3c/d41/d46/d4a/d6a/cc5 0 2023-12-16T03:16:06.723 INFO:tasks.workunit.client.1.smithi184.stdout:7/829: dread d0/d3/d2e/d79/d32/d39/f73 [0,4194304] 0 2023-12-16T03:16:06.723 INFO:tasks.workunit.client.1.smithi184.stdout:7/830: chown d0/d6b 75 1 2023-12-16T03:16:06.723 INFO:tasks.workunit.client.1.smithi184.stdout:1/863: write d3/d34/dbc/d3c/d41/d63/f64 [2121205,62764] 0 2023-12-16T03:16:06.725 INFO:tasks.workunit.client.1.smithi184.stdout:7/831: chown d0/d3/c17 115431810 1 2023-12-16T03:16:06.727 INFO:tasks.workunit.client.1.smithi184.stdout:1/864: stat d3/d34/d76/d91/le7 0 2023-12-16T03:16:06.746 INFO:tasks.workunit.client.0.smithi064.stdout:7/558: unlink d7/d3e/d42/d89/d20/f21 0 2023-12-16T03:16:06.747 INFO:tasks.workunit.client.0.smithi064.stdout:4/576: unlink d0/d1e/d36/f95 0 2023-12-16T03:16:06.748 INFO:tasks.workunit.client.1.smithi184.stdout:0/896: unlink dc/d10/da7/dc0/cdf 0 2023-12-16T03:16:06.749 INFO:tasks.workunit.client.1.smithi184.stdout:7/832: unlink d0/d3/d2e/d79/d36/cc7 0 2023-12-16T03:16:06.749 INFO:tasks.workunit.client.1.smithi184.stdout:7/833: chown d0/d3/d2e/d79/d32/d39/f70 387 1 2023-12-16T03:16:06.750 INFO:tasks.workunit.client.0.smithi064.stdout:7/559: truncate d7/f14 3327441 0 2023-12-16T03:16:06.750 INFO:tasks.workunit.client.0.smithi064.stdout:7/560: dread - d7/fae zero size 2023-12-16T03:16:06.750 INFO:tasks.workunit.client.0.smithi064.stdout:7/561: dread - d7/d3e/d42/d43/f7e zero size 2023-12-16T03:16:06.750 INFO:tasks.workunit.client.0.smithi064.stdout:7/562: write d7/d3e/f78 [1751699,22292] 0 2023-12-16T03:16:06.750 INFO:tasks.workunit.client.0.smithi064.stdout:7/563: chown d7/d3e/d42/d48/l58 10173 1 2023-12-16T03:16:06.751 INFO:tasks.workunit.client.1.smithi184.stdout:0/897: creat dc/d22/d1d/d8e/d133/f134 x:0 0 0 2023-12-16T03:16:06.754 INFO:tasks.workunit.client.0.smithi064.stdout:7/564: mkdir d7/d3e/d42/d89/d20/d6f/d93/db0 0 2023-12-16T03:16:06.757 INFO:tasks.workunit.client.0.smithi064.stdout:7/565: mkdir d7/d3e/d42/d89/d20/d37/db1 0 2023-12-16T03:16:06.761 INFO:tasks.workunit.client.1.smithi184.stdout:0/898: dread dc/d22/d1d/d8e/ff4 [4194304,4194304] 0 2023-12-16T03:16:06.761 INFO:tasks.workunit.client.1.smithi184.stdout:0/899: write dc/d22/d48/dfb/f116 [1208255,118045] 0 2023-12-16T03:16:06.761 INFO:tasks.workunit.client.1.smithi184.stdout:0/900: chown dc/d22/d53/f12d 10343921 1 2023-12-16T03:16:06.761 INFO:tasks.workunit.client.1.smithi184.stdout:0/901: truncate dc/dab/fcf 105039 0 2023-12-16T03:16:06.770 INFO:tasks.workunit.client.0.smithi064.stdout:2/445: sync 2023-12-16T03:16:06.770 INFO:tasks.workunit.client.0.smithi064.stdout:2/446: fdatasync d1/d27/d2e/d69/f5a 0 2023-12-16T03:16:06.772 INFO:tasks.workunit.client.0.smithi064.stdout:1/555: sync 2023-12-16T03:16:06.774 INFO:tasks.workunit.client.0.smithi064.stdout:8/606: mkdir d0/db/d12/d44/dd0 0 2023-12-16T03:16:06.774 INFO:tasks.workunit.client.0.smithi064.stdout:8/607: fsync d0/d1d/d48/fcf 0 2023-12-16T03:16:06.774 INFO:tasks.workunit.client.0.smithi064.stdout:7/566: dread d7/d3e/d42/d48/f5e [0,4194304] 0 2023-12-16T03:16:06.775 INFO:tasks.workunit.client.0.smithi064.stdout:7/567: mknod d7/d3e/d42/d89/d20/d37/db1/cb2 0 2023-12-16T03:16:06.782 INFO:tasks.workunit.client.0.smithi064.stdout:8/608: read d0/db/d12/f82 [1660061,84746] 0 2023-12-16T03:16:06.793 INFO:tasks.workunit.client.0.smithi064.stdout:7/568: dread d7/d3e/d42/d48/d51/d7c/d52/f99 [0,4194304] 0 2023-12-16T03:16:06.795 INFO:tasks.workunit.client.0.smithi064.stdout:7/569: creat d7/d3e/d42/d89/fb3 x:0 0 0 2023-12-16T03:16:06.802 INFO:tasks.workunit.client.0.smithi064.stdout:2/447: dwrite d1/d27/f84 [0,4194304] 0 2023-12-16T03:16:06.805 INFO:tasks.workunit.client.0.smithi064.stdout:2/448: rmdir d1/d76/d57 39 2023-12-16T03:16:06.805 INFO:tasks.workunit.client.0.smithi064.stdout:2/449: getdents d1/d15/d67 0 2023-12-16T03:16:06.806 INFO:tasks.workunit.client.0.smithi064.stdout:2/450: symlink d1/d15/d1b/l89 0 2023-12-16T03:16:06.807 INFO:tasks.workunit.client.0.smithi064.stdout:2/451: unlink d1/d15/d58/l5e 0 2023-12-16T03:16:06.807 INFO:tasks.workunit.client.0.smithi064.stdout:1/556: dwrite d3/dd/d11/d2f/f5f [0,4194304] 0 2023-12-16T03:16:06.808 INFO:tasks.workunit.client.0.smithi064.stdout:8/609: dwrite d0/f7 [0,4194304] 0 2023-12-16T03:16:06.811 INFO:tasks.workunit.client.0.smithi064.stdout:1/557: creat d3/d36/d44/d4d/dad/fb5 x:0 0 0 2023-12-16T03:16:06.811 INFO:tasks.workunit.client.0.smithi064.stdout:1/558: write d3/d36/d44/d4d/dad/fb5 [273313,80316] 0 2023-12-16T03:16:06.812 INFO:tasks.workunit.client.1.smithi184.stdout:2/789: rename d3/d29/d2f/d2e/fa to d3/d9/f107 0 2023-12-16T03:16:06.814 INFO:tasks.workunit.client.0.smithi064.stdout:1/559: dread d3/dd/d11/d2f/f64 [0,4194304] 0 2023-12-16T03:16:06.815 INFO:tasks.workunit.client.1.smithi184.stdout:4/854: rename d1/d29/d34/d5c/d76/l73 to d1/d12/db3/l123 0 2023-12-16T03:16:06.815 INFO:tasks.workunit.client.1.smithi184.stdout:4/855: write d1/d12/fdf [114573,97855] 0 2023-12-16T03:16:06.815 INFO:tasks.workunit.client.1.smithi184.stdout:4/856: write d1/d12/fcc [960463,42600] 0 2023-12-16T03:16:06.815 INFO:tasks.workunit.client.1.smithi184.stdout:4/857: chown d1/d11/d5a/l89 15 1 2023-12-16T03:16:06.816 INFO:tasks.workunit.client.1.smithi184.stdout:2/790: creat d3/d29/d2f/d46/dfd/f108 x:0 0 0 2023-12-16T03:16:06.816 INFO:tasks.workunit.client.1.smithi184.stdout:2/791: readlink d3/d13/d6e/lc4 0 2023-12-16T03:16:06.816 INFO:tasks.workunit.client.1.smithi184.stdout:2/792: chown d3/d9/d19/d87/l3d 462726 1 2023-12-16T03:16:06.816 INFO:tasks.workunit.client.0.smithi064.stdout:1/560: creat d3/dd/d11/d2f/fb6 x:0 0 0 2023-12-16T03:16:06.816 INFO:tasks.workunit.client.0.smithi064.stdout:1/561: chown d3/dd/d11/d6a/c8c 31958 1 2023-12-16T03:16:06.819 INFO:tasks.workunit.client.1.smithi184.stdout:0/902: rename dc/d22/d1d/d43/d5a/f89 to dc/d22/d53/f135 0 2023-12-16T03:16:06.820 INFO:tasks.workunit.client.0.smithi064.stdout:1/562: getdents d3/dd/d23/d4f 0 2023-12-16T03:16:06.822 INFO:tasks.workunit.client.1.smithi184.stdout:0/903: mkdir dc/d22/d1d/d8e/d118/d136 0 2023-12-16T03:16:06.823 INFO:tasks.workunit.client.0.smithi064.stdout:8/610: dwrite d0/db/d37/f9b [0,4194304] 0 2023-12-16T03:16:06.823 INFO:tasks.workunit.client.0.smithi064.stdout:1/563: mknod d3/dd/d11/d3b/cb7 0 2023-12-16T03:16:06.824 INFO:tasks.workunit.client.0.smithi064.stdout:1/564: write d3/d36/d9e/f53 [153502,46963] 0 2023-12-16T03:16:06.825 INFO:tasks.workunit.client.1.smithi184.stdout:4/858: rename d1/d12/db3/fb5 to d1/d29/d34/d5c/d76/d42/d90/f124 0 2023-12-16T03:16:06.825 INFO:tasks.workunit.client.1.smithi184.stdout:4/859: read d1/d11/d5a/d63/d103/d45/fb2 [994476,75229] 0 2023-12-16T03:16:06.829 INFO:tasks.workunit.client.0.smithi064.stdout:8/611: mknod d0/db/d12/d1c/cd1 0 2023-12-16T03:16:06.830 INFO:tasks.workunit.client.0.smithi064.stdout:8/612: chown d0/d1d/d24/d2f 937599 1 2023-12-16T03:16:06.831 INFO:tasks.workunit.client.1.smithi184.stdout:0/904: mknod dc/d22/d1d/d8e/c137 0 2023-12-16T03:16:06.831 INFO:tasks.workunit.client.1.smithi184.stdout:0/905: fsync dc/d10/d1c/f21 0 2023-12-16T03:16:06.831 INFO:tasks.workunit.client.0.smithi064.stdout:2/452: dread d1/d27/d2e/f34 [0,4194304] 0 2023-12-16T03:16:06.832 INFO:tasks.workunit.client.0.smithi064.stdout:1/565: truncate d3/d36/d44/d4d/f3f 259521 0 2023-12-16T03:16:06.832 INFO:tasks.workunit.client.0.smithi064.stdout:1/566: chown d3/d36/d44/d4d/l82 1546 1 2023-12-16T03:16:06.833 INFO:tasks.workunit.client.1.smithi184.stdout:2/793: dread d3/f65 [0,4194304] 0 2023-12-16T03:16:06.834 INFO:tasks.workunit.client.1.smithi184.stdout:4/860: dread d1/d29/d34/d5c/d76/f32 [0,4194304] 0 2023-12-16T03:16:06.834 INFO:tasks.workunit.client.1.smithi184.stdout:5/689: creat d1/d3/d9/de/d15/d19/d5f/fe1 x:0 0 0 2023-12-16T03:16:06.835 INFO:tasks.workunit.client.1.smithi184.stdout:5/690: read d1/d3/d9/de/d15/d19/d5f/f41 [886955,106131] 0 2023-12-16T03:16:06.838 INFO:tasks.workunit.client.1.smithi184.stdout:4/861: creat d1/d29/d37/d102/f125 x:0 0 0 2023-12-16T03:16:06.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.837+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 --> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d84000bf0 con 0x7f8d90068f50 2023-12-16T03:16:06.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.838+0000 7f8d9d7fa700 1 -- 172.21.15.64:0/3115444387 <== mgr.14208 v2:172.21.15.64:6800/2069535093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f8d84000bf0 con 0x7f8d90068f50 2023-12-16T03:16:06.841 INFO:tasks.workunit.client.0.smithi064.stdout:2/453: getdents d1 0 2023-12-16T03:16:06.842 INFO:tasks.workunit.client.0.smithi064.stdout:2/454: write d1/d15/d7d/f79 [973198,11724] 0 2023-12-16T03:16:06.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.840+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8d90068f50 msgr2=0x7f8d9006b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:06.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8d90068f50 0x7f8d9006b400 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009b80 tx=0x7f8d8c00b040 comp rx=0 tx=0).stop 2023-12-16T03:16:06.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 msgr2=0x7f8da0117ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:06.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 0x7f8da0117ee0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400b0d0 tx=0x7f8d94009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:06.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 shutdown_connections 2023-12-16T03:16:06.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f8d90068f50 0x7f8d9006b400 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:06.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8da0104c40 0x7f8da0117ee0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:06.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 --2- 172.21.15.64:0/3115444387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da0107560 0x7f8da0118420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:06.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 >> 172.21.15.64:0/3115444387 conn(0x7f8da0069b20 msgr2=0x7f8da006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:06.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 shutdown_connections 2023-12-16T03:16:06.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:06.841+0000 7f8da7110700 1 -- 172.21.15.64:0/3115444387 wait complete. 2023-12-16T03:16:06.844 INFO:tasks.workunit.client.1.smithi184.stdout:5/691: creat d1/d2a/d31/d58/daf/fe2 x:0 0 0 2023-12-16T03:16:06.845 INFO:tasks.workunit.client.0.smithi064.stdout:2/455: rmdir d1/d76/d57 39 2023-12-16T03:16:06.847 INFO:tasks.workunit.client.1.smithi184.stdout:5/692: mkdir d1/d2a/de3 0 2023-12-16T03:16:06.847 INFO:tasks.workunit.client.1.smithi184.stdout:5/693: dread - d1/d3/f5d zero size 2023-12-16T03:16:06.848 INFO:tasks.workunit.client.0.smithi064.stdout:2/456: symlink d1/d27/d2e/l8a 0 2023-12-16T03:16:06.850 INFO:tasks.workunit.client.1.smithi184.stdout:5/694: creat d1/d3/d9/d49/d74/fe4 x:0 0 0 2023-12-16T03:16:06.851 INFO:tasks.workunit.client.0.smithi064.stdout:2/457: creat d1/d15/d1b/d49/f8b x:0 0 0 2023-12-16T03:16:06.853 INFO:tasks.workunit.client.1.smithi184.stdout:5/695: symlink d1/d2a/de3/le5 0 2023-12-16T03:16:06.854 INFO:tasks.workunit.client.1.smithi184.stdout:5/696: write d1/d3/d9/de/d30/fab [300963,119030] 0 2023-12-16T03:16:06.854 INFO:tasks.workunit.client.0.smithi064.stdout:2/458: mknod d1/d15/d1b/d61/d63/c8c 0 2023-12-16T03:16:06.857 INFO:tasks.workunit.client.1.smithi184.stdout:4/862: dwrite d1/d11/d5a/d63/d103/d5e/d6a/f97 [0,4194304] 0 2023-12-16T03:16:06.857 INFO:tasks.workunit.client.0.smithi064.stdout:2/459: mknod d1/d15/d1b/c8d 0 2023-12-16T03:16:06.858 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:16:06.858 INFO:tasks.workunit.client.0.smithi064.stdout:8/613: dwrite d0/d1d/fc5 [0,4194304] 0 2023-12-16T03:16:06.859 INFO:tasks.workunit.client.1.smithi184.stdout:5/697: rmdir d1/d3/d9/de/d15/d19/d5f/d45 39 2023-12-16T03:16:06.860 INFO:tasks.workunit.client.1.smithi184.stdout:4/863: fsync d1/d12/fcc 0 2023-12-16T03:16:06.862 INFO:tasks.workunit.client.0.smithi064.stdout:2/460: symlink d1/d15/d1b/l8e 0 2023-12-16T03:16:06.867 INFO:tasks.workunit.client.1.smithi184.stdout:5/698: link d1/d2a/d31/d58/daf/f8a d1/d3/d9/de/d15/d19/d48/fe6 0 2023-12-16T03:16:06.868 INFO:tasks.workunit.client.0.smithi064.stdout:2/461: mkdir d1/d15/d67/d8f 0 2023-12-16T03:16:06.869 INFO:tasks.workunit.client.0.smithi064.stdout:2/462: dread - d1/d15/d67/f52 zero size 2023-12-16T03:16:06.869 INFO:tasks.workunit.client.1.smithi184.stdout:4/864: dread d1/d11/d1b/f79 [0,4194304] 0 2023-12-16T03:16:06.871 INFO:tasks.workunit.client.0.smithi064.stdout:8/614: dread d0/db/f4f [4194304,4194304] 0 2023-12-16T03:16:06.873 INFO:tasks.workunit.client.0.smithi064.stdout:2/463: symlink d1/d15/l90 0 2023-12-16T03:16:06.875 INFO:tasks.workunit.client.1.smithi184.stdout:4/865: mkdir d1/d29/d34/d5c/d76/d33/d126 0 2023-12-16T03:16:06.876 INFO:tasks.workunit.client.0.smithi064.stdout:8/615: creat d0/db/d5a/d97/d38/fd2 x:0 0 0 2023-12-16T03:16:06.878 INFO:tasks.workunit.client.1.smithi184.stdout:7/834: creat d0/fff x:0 0 0 2023-12-16T03:16:06.878 INFO:tasks.workunit.client.1.smithi184.stdout:7/835: read - d0/d3/d2e/d79/d32/d39/d9c/dc2/ddd/ff6 zero size 2023-12-16T03:16:06.885 INFO:tasks.workunit.client.1.smithi184.stdout:4/866: unlink d1/d12/db3/db8/dd2/ld5 0 2023-12-16T03:16:06.886 INFO:tasks.workunit.client.1.smithi184.stdout:7/836: symlink d0/d3/d2e/d79/dd/d75/l100 0 2023-12-16T03:16:06.887 INFO:tasks.workunit.client.1.smithi184.stdout:4/867: mkdir d1/d12/db3/db8/d127 0 2023-12-16T03:16:06.888 INFO:tasks.workunit.client.0.smithi064.stdout:2/464: unlink d1/f10 0 2023-12-16T03:16:06.890 INFO:tasks.workunit.client.1.smithi184.stdout:7/837: symlink d0/d3/d2e/d79/dd/d27/l101 0 2023-12-16T03:16:06.893 INFO:tasks.workunit.client.1.smithi184.stdout:4/868: mkdir d1/d11/d1b/d1e/d128 0 2023-12-16T03:16:06.895 INFO:tasks.workunit.client.0.smithi064.stdout:2/465: dread d1/d15/d23/d2d/f5c [0,4194304] 0 2023-12-16T03:16:06.895 INFO:tasks.workunit.client.0.smithi064.stdout:2/466: fdatasync d1/d27/d2e/f5b 0 2023-12-16T03:16:06.895 INFO:tasks.workunit.client.0.smithi064.stdout:9/527: rmdir d2/d2d/d3b 39 2023-12-16T03:16:06.897 INFO:tasks.workunit.client.0.smithi064.stdout:9/528: write d2/f2a [4922183,88126] 0 2023-12-16T03:16:06.899 INFO:tasks.workunit.client.0.smithi064.stdout:2/467: link d1/lb d1/d15/d67/d8f/l91 0 2023-12-16T03:16:06.901 INFO:tasks.workunit.client.1.smithi184.stdout:5/699: mkdir d1/d3/de7 0 2023-12-16T03:16:06.902 INFO:tasks.workunit.client.0.smithi064.stdout:2/468: write d1/d15/d1b/f4c [50507,60165] 0 2023-12-16T03:16:06.916 INFO:tasks.workunit.client.0.smithi064.stdout:5/492: rename d0/d50/d39/f3a to d0/d19/fad 0 2023-12-16T03:16:06.917 INFO:tasks.workunit.client.1.smithi184.stdout:5/700: dread d1/d2a/fac [0,4194304] 0 2023-12-16T03:16:06.917 INFO:tasks.workunit.client.1.smithi184.stdout:5/701: fsync d1/d3/d9/d49/d74/f75 0 2023-12-16T03:16:06.917 INFO:tasks.workunit.client.1.smithi184.stdout:5/702: write d1/d3/fb2 [5071126,111769] 0 2023-12-16T03:16:06.918 INFO:tasks.workunit.client.0.smithi064.stdout:3/687: rename db/d12/d4e/d56 to db/d12/d1a/d2c/d34/de7 0 2023-12-16T03:16:06.919 INFO:tasks.workunit.client.0.smithi064.stdout:5/493: rmdir d0/d19/d48/d8f 39 2023-12-16T03:16:06.920 INFO:tasks.workunit.client.0.smithi064.stdout:2/469: dwrite d1/f6 [0,4194304] 0 2023-12-16T03:16:06.921 INFO:tasks.workunit.client.1.smithi184.stdout:5/703: dread d1/d2a/d31/d58/daf/f8a [0,4194304] 0 2023-12-16T03:16:06.921 INFO:tasks.workunit.client.1.smithi184.stdout:7/838: dwrite d0/d3/d2e/d79/d36/d3f/fcf [0,4194304] 0 2023-12-16T03:16:06.923 INFO:tasks.workunit.client.0.smithi064.stdout:5/494: read d0/f5b [7640531,28849] 0 2023-12-16T03:16:06.925 INFO:tasks.workunit.client.0.smithi064.stdout:3/688: creat db/d12/d21/fe8 x:0 0 0 2023-12-16T03:16:06.931 INFO:tasks.workunit.client.0.smithi064.stdout:2/470: dread d1/d27/f44 [0,4194304] 0 2023-12-16T03:16:06.931 INFO:tasks.workunit.client.0.smithi064.stdout:2/471: dread - d1/d15/d7d/f6f zero size 2023-12-16T03:16:06.932 INFO:tasks.workunit.client.0.smithi064.stdout:0/508: rename d2/d8/da/df/c46 to d2/d7/d70/ca3 0 2023-12-16T03:16:06.932 INFO:tasks.workunit.client.0.smithi064.stdout:0/509: truncate d2/d8/da/df/f41 1308425 0 2023-12-16T03:16:06.934 INFO:tasks.workunit.client.0.smithi064.stdout:5/495: dread d0/f3 [0,4194304] 0 2023-12-16T03:16:06.935 INFO:tasks.workunit.client.0.smithi064.stdout:3/689: write db/d12/d1a/f26 [258770,66059] 0 2023-12-16T03:16:06.935 INFO:tasks.workunit.client.0.smithi064.stdout:3/690: read - db/d12/d21/fa2 zero size 2023-12-16T03:16:06.936 INFO:tasks.workunit.client.1.smithi184.stdout:7/839: creat d0/d3/d2e/d79/dd/f102 x:0 0 0 2023-12-16T03:16:06.936 INFO:tasks.workunit.client.1.smithi184.stdout:7/840: fdatasync d0/d3/d2e/d79/d34/fd5 0 2023-12-16T03:16:06.937 INFO:tasks.workunit.client.0.smithi064.stdout:7/570: rename d7/d3e/d42/d89/l1e to d7/d3e/dac/lb4 0 2023-12-16T03:16:06.940 INFO:tasks.workunit.client.0.smithi064.stdout:0/510: link d2/d7/d10/d21/d31/l94 d2/d29/d66/la4 0 2023-12-16T03:16:06.945 INFO:tasks.workunit.client.1.smithi184.stdout:7/841: mknod d0/d3/d2e/c103 0 2023-12-16T03:16:06.945 INFO:tasks.workunit.client.0.smithi064.stdout:5/496: symlink d0/d14/d20/d37/d70/d71/lae 0 2023-12-16T03:16:06.945 INFO:tasks.workunit.client.0.smithi064.stdout:5/497: fdatasync d0/d19/d48/d8f/d5e/f93 0 2023-12-16T03:16:06.945 INFO:tasks.workunit.client.0.smithi064.stdout:3/691: mknod db/d4f/da9/dbf/ce9 0 2023-12-16T03:16:06.947 INFO:tasks.workunit.client.0.smithi064.stdout:1/567: rename d3/d22/d57/c5b to d3/d36/d44/d4d/d58/cb8 0 2023-12-16T03:16:06.947 INFO:tasks.workunit.client.0.smithi064.stdout:1/568: readlink d3/d36/d9e/la0 0 2023-12-16T03:16:06.947 INFO:tasks.workunit.client.1.smithi184.stdout:5/704: dwrite d1/d2a/f13 [0,4194304] 0 2023-12-16T03:16:06.948 INFO:tasks.workunit.client.1.smithi184.stdout:0/906: mkdir dc/d22/d138 0 2023-12-16T03:16:06.949 INFO:tasks.workunit.client.0.smithi064.stdout:7/571: creat d7/d26/d30/fb5 x:0 0 0 2023-12-16T03:16:06.950 INFO:tasks.workunit.client.0.smithi064.stdout:1/569: dread d3/dd/d11/d38/f77 [0,4194304] 0 2023-12-16T03:16:06.950 INFO:tasks.workunit.client.0.smithi064.stdout:0/511: symlink d2/d29/d66/la5 0 2023-12-16T03:16:06.952 INFO:tasks.workunit.client.1.smithi184.stdout:1/865: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/f12d x:0 0 0 2023-12-16T03:16:06.952 INFO:tasks.workunit.client.1.smithi184.stdout:1/866: fsync d3/d34/dbc/d3c/d41/d63/de1/f11d 0 2023-12-16T03:16:06.952 INFO:tasks.workunit.client.1.smithi184.stdout:1/867: stat d3/d34/dbc/f44 0 2023-12-16T03:16:06.953 INFO:tasks.workunit.client.1.smithi184.stdout:5/705: creat d1/d2a/d31/d58/daf/fe8 x:0 0 0 2023-12-16T03:16:06.956 INFO:tasks.workunit.client.0.smithi064.stdout:2/472: dwrite d1/d76/d57/f80 [0,4194304] 0 2023-12-16T03:16:06.957 INFO:tasks.workunit.client.0.smithi064.stdout:8/616: rename d0/d1d/d24/d2f/d50/d70/dcc/fce to d0/db/d12/d44/d68/d6d/dbc/fd3 0 2023-12-16T03:16:06.958 INFO:tasks.workunit.client.0.smithi064.stdout:3/692: dread db/d12/d1a/d2c/d34/d4c/f7b [0,4194304] 0 2023-12-16T03:16:06.958 INFO:tasks.workunit.client.0.smithi064.stdout:3/693: chown db/d12/f58 7466 1 2023-12-16T03:16:06.958 INFO:tasks.workunit.client.1.smithi184.stdout:0/907: dread dc/d22/d1a/fb3 [0,4194304] 0 2023-12-16T03:16:06.959 INFO:tasks.workunit.client.0.smithi064.stdout:7/572: mkdir d7/d3e/d42/d89/d20/d37/db1/db6 0 2023-12-16T03:16:06.960 INFO:tasks.workunit.client.1.smithi184.stdout:0/908: dread dc/d10/d2d/ff1 [0,4194304] 0 2023-12-16T03:16:06.961 INFO:tasks.workunit.client.1.smithi184.stdout:5/706: creat d1/d2a/d31/d28/d72/fe9 x:0 0 0 2023-12-16T03:16:06.963 INFO:tasks.workunit.client.1.smithi184.stdout:0/909: dread dc/d22/d45/d66/d80/fe7 [0,4194304] 0 2023-12-16T03:16:06.963 INFO:tasks.workunit.client.1.smithi184.stdout:0/910: write dc/d22/d1d/d35/f101 [471980,36610] 0 2023-12-16T03:16:06.963 INFO:tasks.workunit.client.0.smithi064.stdout:1/570: creat d3/dd/fb9 x:0 0 0 2023-12-16T03:16:06.964 INFO:tasks.workunit.client.0.smithi064.stdout:0/512: symlink d2/d29/d66/d67/la6 0 2023-12-16T03:16:06.966 INFO:tasks.workunit.client.1.smithi184.stdout:5/707: unlink d1/d2a/l7a 0 2023-12-16T03:16:06.967 INFO:tasks.workunit.client.0.smithi064.stdout:2/473: link d1/d15/d23/d2d/l70 d1/d15/d67/l92 0 2023-12-16T03:16:06.968 INFO:tasks.workunit.client.1.smithi184.stdout:0/911: mknod dc/dab/c139 0 2023-12-16T03:16:06.970 INFO:tasks.workunit.client.0.smithi064.stdout:9/529: rename d2/dc/d8a/d90 to d2/dc/d24/d39/d42/d9a/d8b/da8 0 2023-12-16T03:16:06.970 INFO:tasks.workunit.client.0.smithi064.stdout:9/530: write d2/dc/d24/d39/d5e/f8f [961321,2132] 0 2023-12-16T03:16:06.970 INFO:tasks.workunit.client.0.smithi064.stdout:9/531: chown d2/d2d/d3b/d3c/d4b 1998753 1 2023-12-16T03:16:06.970 INFO:tasks.workunit.client.0.smithi064.stdout:9/532: dread - d2/d7e/f8d zero size 2023-12-16T03:16:06.970 INFO:tasks.workunit.client.0.smithi064.stdout:9/533: truncate d2/dc/d24/d39/d5e/f73 1102970 0 2023-12-16T03:16:06.972 INFO:tasks.workunit.client.0.smithi064.stdout:7/573: creat d7/d26/fb7 x:0 0 0 2023-12-16T03:16:06.972 INFO:tasks.workunit.client.0.smithi064.stdout:1/571: symlink d3/d36/d44/d4d/dad/lba 0 2023-12-16T03:16:06.973 INFO:tasks.workunit.client.0.smithi064.stdout:1/572: fdatasync d3/d36/d44/d4d/f4e 0 2023-12-16T03:16:06.973 INFO:tasks.workunit.client.0.smithi064.stdout:1/573: chown d3/d36/d44/d4d/fae 3878091 1 2023-12-16T03:16:06.973 INFO:tasks.workunit.client.1.smithi184.stdout:5/708: dread d1/d2a/d31/f54 [0,4194304] 0 2023-12-16T03:16:06.973 INFO:tasks.workunit.client.1.smithi184.stdout:5/709: fdatasync d1/d3/d9/f40 0 2023-12-16T03:16:06.974 INFO:tasks.workunit.client.0.smithi064.stdout:0/513: unlink d2/d8/da/d11/c69 0 2023-12-16T03:16:06.978 INFO:tasks.workunit.client.1.smithi184.stdout:1/868: dwrite d3/ff [0,4194304] 0 2023-12-16T03:16:06.978 INFO:tasks.workunit.client.1.smithi184.stdout:1/869: write d3/d34/f129 [439276,95442] 0 2023-12-16T03:16:06.978 INFO:tasks.workunit.client.0.smithi064.stdout:7/574: write d7/d3e/f55 [3387117,56823] 0 2023-12-16T03:16:06.980 INFO:tasks.workunit.client.0.smithi064.stdout:0/514: write d2/f8d [489817,98742] 0 2023-12-16T03:16:06.982 INFO:tasks.workunit.client.1.smithi184.stdout:2/794: rename d3/d9/f107 to d3/d13/f109 0 2023-12-16T03:16:06.983 INFO:tasks.workunit.client.1.smithi184.stdout:0/912: read dc/dab/fcf [1694,16766] 0 2023-12-16T03:16:06.983 INFO:tasks.workunit.client.1.smithi184.stdout:0/913: fdatasync dc/d22/d45/d66/fae 0 2023-12-16T03:16:06.983 INFO:tasks.workunit.client.1.smithi184.stdout:0/914: write dc/d22/d48/dfb/f116 [1862510,36944] 0 2023-12-16T03:16:06.987 INFO:tasks.workunit.client.0.smithi064.stdout:5/498: rename d0/f5 to d0/d19/d48/d8f/d5e/d84/faf 0 2023-12-16T03:16:06.992 INFO:tasks.workunit.client.0.smithi064.stdout:9/534: mkdir d2/dc/d24/da9 0 2023-12-16T03:16:06.995 INFO:tasks.workunit.client.1.smithi184.stdout:4/869: rename d1/d12/d13/cde to d1/d11/d1b/c129 0 2023-12-16T03:16:06.999 INFO:tasks.workunit.client.1.smithi184.stdout:7/842: rename d0/d6b/d94/dbe to d0/d3/d2e/d79/d32/d39/d8f/dab/d104 0 2023-12-16T03:16:07.001 INFO:tasks.workunit.client.0.smithi064.stdout:0/515: creat d2/d7/d70/fa7 x:0 0 0 2023-12-16T03:16:07.001 INFO:tasks.workunit.client.0.smithi064.stdout:0/516: chown d2/d29/d66 801 1 2023-12-16T03:16:07.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.003+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3761308921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd10 msgr2=0x7f2a880fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:07.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.003+0000 7f2a8f57d700 1 --2- 172.21.15.64:0/3761308921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd10 0x7f2a880fd160 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2a78004940 tx=0x7f2a78009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:07.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.003+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3761308921 shutdown_connections 2023-12-16T03:16:07.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.003+0000 7f2a8f57d700 1 --2- 172.21.15.64:0/3761308921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fcd10 0x7f2a880fd160 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:07.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.003+0000 7f2a8f57d700 1 --2- 172.21.15.64:0/3761308921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fbb00 0x7f2a880fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:07.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.003+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3761308921 >> 172.21.15.64:0/3761308921 conn(0x7f2a880f71c0 msgr2=0x7f2a880f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:07.006 INFO:tasks.workunit.client.0.smithi064.stdout:8/617: rename d0/db/d12/d44/l58 to d0/db/ld4 0 2023-12-16T03:16:07.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.003+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3761308921 shutdown_connections 2023-12-16T03:16:07.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.004+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3761308921 wait complete. 2023-12-16T03:16:07.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.005+0000 7f2a8f57d700 1 Processor -- start 2023-12-16T03:16:07.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.005+0000 7f2a8f57d700 1 -- start start 2023-12-16T03:16:07.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8f57d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fbb00 0x7f2a8810c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:07.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8f57d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fcd10 0x7f2a8810c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:07.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8f57d700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8810d040 con 0x7f2a880fbb00 2023-12-16T03:16:07.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8f57d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8810d880 con 0x7f2a880fcd10 2023-12-16T03:16:07.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8d319700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fbb00 0x7f2a8810c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:07.009 INFO:tasks.workunit.client.0.smithi064.stdout:7/575: dwrite d7/d3e/d42/f72 [0,4194304] 0 2023-12-16T03:16:07.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8d319700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fbb00 0x7f2a8810c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51316/0 (socket says 172.21.15.64:51316) 2023-12-16T03:16:07.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8d319700 1 -- 172.21.15.64:0/3995268381 learned_addr learned my addr 172.21.15.64:0/3995268381 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:07.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8cb18700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fcd10 0x7f2a8810c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:07.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8d319700 1 -- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fcd10 msgr2=0x7f2a8810c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:07.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8d319700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fcd10 0x7f2a8810c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:07.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8d319700 1 -- 172.21.15.64:0/3995268381 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a78005040 con 0x7f2a880fbb00 2023-12-16T03:16:07.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.006+0000 7f2a8cb18700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fcd10 0x7f2a8810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:16:07.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.007+0000 7f2a8d319700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fbb00 0x7f2a8810c470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400b790 tx=0x7f2a84009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:07.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.007+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a8400f6f0 con 0x7f2a880fbb00 2023-12-16T03:16:07.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.007+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a8400fd00 con 0x7f2a880fbb00 2023-12-16T03:16:07.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.007+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a840103a0 con 0x7f2a880fbb00 2023-12-16T03:16:07.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.007+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3995268381 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8810db60 con 0x7f2a880fbb00 2023-12-16T03:16:07.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.007+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3995268381 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8810e0a0 con 0x7f2a880fbb00 2023-12-16T03:16:07.011 INFO:tasks.workunit.client.0.smithi064.stdout:5/499: mknod d0/d14/d20/d37/d70/cb0 0 2023-12-16T03:16:07.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.008+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3995268381 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8804bb80 con 0x7f2a880fbb00 2023-12-16T03:16:07.012 INFO:tasks.workunit.client.1.smithi184.stdout:7/843: rename d0/d6b/d69/fad to d0/d3/d2e/d79/dd/d75/dfb/f105 0 2023-12-16T03:16:07.012 INFO:tasks.workunit.client.1.smithi184.stdout:7/844: fdatasync d0/d6b/d69/fd6 0 2023-12-16T03:16:07.012 INFO:tasks.workunit.client.1.smithi184.stdout:0/915: dwrite dc/d2a/ff2 [0,4194304] 0 2023-12-16T03:16:07.012 INFO:tasks.workunit.client.1.smithi184.stdout:0/916: write dc/d10/d2d/d5f/d7a/f9d [29937,72516] 0 2023-12-16T03:16:07.012 INFO:tasks.workunit.client.1.smithi184.stdout:0/917: fsync dc/d22/d1d/d43/d5a/f69 0 2023-12-16T03:16:07.012 INFO:tasks.workunit.client.1.smithi184.stdout:0/918: fsync dc/d22/d1d/d35/dd8/f115 0 2023-12-16T03:16:07.012 INFO:tasks.workunit.client.1.smithi184.stdout:0/919: dread - dc/d22/d1d/d8e/f120 zero size 2023-12-16T03:16:07.012 INFO:tasks.workunit.client.1.smithi184.stdout:2/795: dwrite d3/d29/f2d [0,4194304] 0 2023-12-16T03:16:07.012 INFO:tasks.workunit.client.1.smithi184.stdout:2/796: write d3/d29/d2f/fd8 [592597,25011] 0 2023-12-16T03:16:07.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.009+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2a8400f850 con 0x7f2a880fbb00 2023-12-16T03:16:07.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.010+0000 7f2a7dffb700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a7406d430 0x7f2a7406f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:07.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.010+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2a84086a20 con 0x7f2a880fbb00 2023-12-16T03:16:07.013 INFO:tasks.workunit.client.0.smithi064.stdout:9/535: creat d2/d2d/d6c/d83/faa x:0 0 0 2023-12-16T03:16:07.014 INFO:tasks.workunit.client.1.smithi184.stdout:7/845: dread d0/d6b/d69/fd6 [0,4194304] 0 2023-12-16T03:16:07.014 INFO:tasks.workunit.client.1.smithi184.stdout:7/846: chown d0/d3/d2e/d79/d32/d39/d9c/fe7 18689 1 2023-12-16T03:16:07.014 INFO:tasks.workunit.client.1.smithi184.stdout:7/847: write d0/d3/d2e/d79/d36/d84/fd0 [841353,2702] 0 2023-12-16T03:16:07.016 INFO:tasks.workunit.client.0.smithi064.stdout:0/517: getdents d2/d7/d10/d21/d7a 0 2023-12-16T03:16:07.019 INFO:tasks.workunit.client.0.smithi064.stdout:0/518: write d2/d7/d10/d21/f39 [1200861,116885] 0 2023-12-16T03:16:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.018+0000 7f2a8cb18700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a7406d430 0x7f2a7406f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.018+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2a84056a20 con 0x7f2a880fbb00 2023-12-16T03:16:07.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.018+0000 7f2a8cb18700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a7406d430 0x7f2a7406f8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a78004f90 tx=0x7f2a78009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:07.021 INFO:tasks.workunit.client.1.smithi184.stdout:0/920: unlink dc/d22/d1a/c73 0 2023-12-16T03:16:07.023 INFO:tasks.workunit.client.1.smithi184.stdout:4/870: dwrite d1/d12/d13/da1/fcd [0,4194304] 0 2023-12-16T03:16:07.024 INFO:tasks.workunit.client.1.smithi184.stdout:2/797: truncate d3/d9/d19/f4f 2763192 0 2023-12-16T03:16:07.024 INFO:tasks.workunit.client.1.smithi184.stdout:2/798: dread - d3/d13/d28/d83/dda/ff9 zero size 2023-12-16T03:16:07.030 INFO:tasks.workunit.client.0.smithi064.stdout:1/574: rename d3/d36/d9e/c8f to d3/dd/d23/cbb 0 2023-12-16T03:16:07.030 INFO:tasks.workunit.client.0.smithi064.stdout:7/576: symlink d7/lb8 0 2023-12-16T03:16:07.030 INFO:tasks.workunit.client.0.smithi064.stdout:7/577: chown d7/d3e/d42/d48/d51/d7c/laf 10 1 2023-12-16T03:16:07.030 INFO:tasks.workunit.client.0.smithi064.stdout:9/536: mkdir d2/dc/d24/d39/d42/dab 0 2023-12-16T03:16:07.033 INFO:tasks.workunit.client.0.smithi064.stdout:8/618: truncate d0/db/d37/f9b 3867339 0 2023-12-16T03:16:07.033 INFO:tasks.workunit.client.0.smithi064.stdout:8/619: readlink d0/db/d5a/d97/l4d 0 2023-12-16T03:16:07.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.034+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mgrmap(e 20) v1 ==== 45251+0+0 (secure 0 0 0) 0x7f2a84020d30 con 0x7f2a880fbb00 2023-12-16T03:16:07.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.034+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a7406d430 msgr2=0x7f2a7406f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:07.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:07.034+0000 7f2a7dffb700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a7406d430 0x7f2a7406f8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a78004f90 tx=0x7f2a78009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:07.041 INFO:tasks.workunit.client.0.smithi064.stdout:5/500: rename d0/d19/d48/c94 to d0/d19/d48/d8f/dac/cb1 0 2023-12-16T03:16:07.044 INFO:tasks.workunit.client.1.smithi184.stdout:7/848: creat d0/d3/d2e/d3b/ddc/f106 x:0 0 0 2023-12-16T03:16:07.046 INFO:tasks.workunit.client.0.smithi064.stdout:1/575: mknod d3/dd/d23/d4f/daf/cbc 0 2023-12-16T03:16:07.046 INFO:tasks.workunit.client.0.smithi064.stdout:1/576: dread - d3/d36/d44/d4d/f88 zero size 2023-12-16T03:16:07.046 INFO:tasks.workunit.client.0.smithi064.stdout:1/577: chown d3/d36/d44/d4d/f4e 196 1 2023-12-16T03:16:07.046 INFO:tasks.workunit.client.0.smithi064.stdout:1/578: stat d3/dd/f1a 0 2023-12-16T03:16:07.046 INFO:tasks.workunit.client.0.smithi064.stdout:1/579: stat d3/f7b 0 2023-12-16T03:16:07.047 INFO:tasks.workunit.client.1.smithi184.stdout:0/921: unlink dc/d22/d1d/d43/d5a/d60/lc8 0 2023-12-16T03:16:07.049 INFO:tasks.workunit.client.0.smithi064.stdout:7/578: creat d7/d26/d30/da3/fb9 x:0 0 0 2023-12-16T03:16:07.050 INFO:tasks.workunit.client.1.smithi184.stdout:4/871: symlink d1/d11/d5a/d63/d103/d45/l12a 0 2023-12-16T03:16:07.051 INFO:tasks.workunit.client.0.smithi064.stdout:9/537: mknod d2/dc/d24/da9/cac 0 2023-12-16T03:16:07.053 INFO:tasks.workunit.client.1.smithi184.stdout:2/799: mkdir d3/d13/ddf/d10a 0 2023-12-16T03:16:07.059 INFO:tasks.workunit.client.0.smithi064.stdout:0/519: rename d2/d7/d10/d21/f24 to d2/d7/d10/d21/d7a/fa8 0 2023-12-16T03:16:07.059 INFO:tasks.workunit.client.0.smithi064.stdout:0/520: chown d2/d7/d6b/f6e 99150 1 2023-12-16T03:16:07.059 INFO:tasks.workunit.client.1.smithi184.stdout:2/800: dread d3/d29/d61/d6d/f99 [0,4194304] 0 2023-12-16T03:16:07.062 INFO:tasks.workunit.client.1.smithi184.stdout:7/849: rename d0/d3/d2e/d79/d32/d8a to d0/d3/d2e/d79/d34/dc1/d107 0 2023-12-16T03:16:07.062 INFO:tasks.workunit.client.1.smithi184.stdout:7/850: chown d0/d3/d2e/d79/dd/d27/f76 3203 1 2023-12-16T03:16:07.064 INFO:tasks.workunit.client.0.smithi064.stdout:5/501: link d0/d50/d99/la6 d0/d19/d48/d8f/d3e/d35/d5d/lb2 0 2023-12-16T03:16:07.064 INFO:tasks.workunit.client.0.smithi064.stdout:5/502: truncate d0/d19/d48/d8f/d3e/d35/f8a 316142 0 2023-12-16T03:16:07.072 INFO:tasks.workunit.client.1.smithi184.stdout:0/922: mknod dc/d22/d1d/d35/dd8/c13a 0 2023-12-16T03:16:07.081 INFO:tasks.workunit.client.0.smithi064.stdout:0/521: dread d2/f5 [0,4194304] 0 2023-12-16T03:16:07.082 INFO:tasks.workunit.client.1.smithi184.stdout:4/872: creat d1/d11/d5a/d63/d72/d98/f12b x:0 0 0 2023-12-16T03:16:07.082 INFO:tasks.workunit.client.0.smithi064.stdout:1/580: rename d3/d36/d44/ca4 to d3/dd/d23/d60/cbd 0 2023-12-16T03:16:07.082 INFO:tasks.workunit.client.0.smithi064.stdout:1/581: stat d3/d22/d57/f5d 0 2023-12-16T03:16:07.082 INFO:tasks.workunit.client.0.smithi064.stdout:1/582: fsync d3/dd/d2a/f3d 0 2023-12-16T03:16:07.084 INFO:tasks.workunit.client.0.smithi064.stdout:9/538: dwrite d2/dc/f15 [0,4194304] 0 2023-12-16T03:16:07.085 INFO:tasks.workunit.client.0.smithi064.stdout:0/522: symlink d2/d7/d6b/la9 0 2023-12-16T03:16:07.085 INFO:tasks.workunit.client.0.smithi064.stdout:9/539: write d2/dc/f32 [3011556,64855] 0 2023-12-16T03:16:07.090 INFO:tasks.workunit.client.0.smithi064.stdout:4/577: sync 2023-12-16T03:16:07.090 INFO:tasks.workunit.client.0.smithi064.stdout:6/529: sync 2023-12-16T03:16:07.090 INFO:tasks.workunit.client.0.smithi064.stdout:4/578: dread - d0/d1e/f69 zero size 2023-12-16T03:16:07.091 INFO:tasks.workunit.client.0.smithi064.stdout:1/583: dread d3/d22/d57/f5d [0,4194304] 0 2023-12-16T03:16:07.093 INFO:tasks.workunit.client.1.smithi184.stdout:4/873: mknod d1/d11/d5a/d63/d103/d45/dcf/de6/d107/c12c 0 2023-12-16T03:16:07.093 INFO:tasks.workunit.client.1.smithi184.stdout:4/874: dread - d1/d12/fdd zero size 2023-12-16T03:16:07.093 INFO:tasks.workunit.client.1.smithi184.stdout:4/875: fdatasync d1/d29/d34/f11c 0 2023-12-16T03:16:07.094 INFO:tasks.workunit.client.0.smithi064.stdout:5/503: dwrite d0/d50/d39/f63 [0,4194304] 0 2023-12-16T03:16:07.094 INFO:tasks.workunit.client.0.smithi064.stdout:7/579: rmdir d7/d3e/d42/d43 39 2023-12-16T03:16:07.094 INFO:tasks.workunit.client.0.smithi064.stdout:7/580: write d7/d26/fb7 [518340,7503] 0 2023-12-16T03:16:07.094 INFO:tasks.workunit.client.0.smithi064.stdout:7/581: fdatasync d7/d3e/d42/d48/d51/f8d 0 2023-12-16T03:16:07.095 INFO:tasks.workunit.client.1.smithi184.stdout:7/851: dwrite d0/d3/f81 [0,4194304] 0 2023-12-16T03:16:07.095 INFO:tasks.workunit.client.1.smithi184.stdout:7/852: readlink d0/d3/d2e/d79/d32/l6f 0 2023-12-16T03:16:07.095 INFO:tasks.workunit.client.1.smithi184.stdout:7/853: getdents d0/dd3 0 2023-12-16T03:16:07.095 INFO:tasks.workunit.client.1.smithi184.stdout:7/854: chown d0/d3/d2e/d79/dd/d75/ca6 15 1 2023-12-16T03:16:07.095 INFO:tasks.workunit.client.1.smithi184.stdout:7/855: write d0/d3/d2e/d79/d1e/fba [78397,7395] 0 2023-12-16T03:16:07.096 INFO:tasks.workunit.client.0.smithi064.stdout:0/523: symlink d2/d8/da/d11/laa 0 2023-12-16T03:16:07.096 INFO:tasks.workunit.client.0.smithi064.stdout:0/524: read d2/f8d [3628949,30149] 0 2023-12-16T03:16:07.096 INFO:tasks.workunit.client.0.smithi064.stdout:0/525: chown d2/d8/da/df/f5c 57 1 2023-12-16T03:16:07.096 INFO:tasks.workunit.client.1.smithi184.stdout:4/876: mkdir d1/d11/d5a/d63/d103/d45/d12d 0 2023-12-16T03:16:07.101 INFO:tasks.workunit.client.0.smithi064.stdout:9/540: unlink d2/l2f 0 2023-12-16T03:16:07.103 INFO:tasks.workunit.client.1.smithi184.stdout:0/923: dwrite dc/d22/d45/d66/d80/f8a [4194304,4194304] 0 2023-12-16T03:16:07.103 INFO:tasks.workunit.client.1.smithi184.stdout:0/924: fsync dc/d10/d2d/fe5 0 2023-12-16T03:16:07.103 INFO:tasks.workunit.client.0.smithi064.stdout:6/530: mkdir d3/d9e 0 2023-12-16T03:16:07.103 INFO:tasks.workunit.client.0.smithi064.stdout:6/531: chown d3/d8/d1f/c5b 0 1 2023-12-16T03:16:07.104 INFO:tasks.workunit.client.0.smithi064.stdout:6/532: fdatasync d3/f61 0 2023-12-16T03:16:07.105 INFO:tasks.workunit.client.1.smithi184.stdout:7/856: mkdir d0/d3/d2e/d79/d36/d108 0 2023-12-16T03:16:07.107 INFO:tasks.workunit.client.0.smithi064.stdout:4/579: rename d0/d12/d48/l5b to d0/d42/d4c/lb6 0 2023-12-16T03:16:07.107 INFO:tasks.workunit.client.0.smithi064.stdout:4/580: write d0/d42/d4c/d70/f7d [1612904,53056] 0 2023-12-16T03:16:07.109 INFO:tasks.workunit.client.1.smithi184.stdout:4/877: unlink d1/d29/d34/d5c/d76/d3b/lf4 0 2023-12-16T03:16:07.110 INFO:tasks.workunit.client.0.smithi064.stdout:1/584: creat d3/d22/d57/db1/fbe x:0 0 0 2023-12-16T03:16:07.111 INFO:tasks.workunit.client.0.smithi064.stdout:3/694: rmdir db/d4f 39 2023-12-16T03:16:07.116 INFO:tasks.workunit.client.1.smithi184.stdout:0/925: truncate dc/d10/d1c/f49 6892275 0 2023-12-16T03:16:07.118 INFO:tasks.workunit.client.1.smithi184.stdout:7/857: truncate d0/d3/d2e/d79/d32/d39/f3e 3950269 0 2023-12-16T03:16:07.119 INFO:tasks.workunit.client.1.smithi184.stdout:4/878: creat d1/d29/d34/d5c/f12e x:0 0 0 2023-12-16T03:16:07.121 INFO:tasks.workunit.client.0.smithi064.stdout:5/504: creat d0/d14/d20/d37/d70/d71/fb3 x:0 0 0 2023-12-16T03:16:07.129 INFO:tasks.workunit.client.1.smithi184.stdout:7/858: dread d0/d6b/d69/fa4 [0,4194304] 0 2023-12-16T03:16:07.149 INFO:tasks.workunit.client.0.smithi064.stdout:5/505: dwrite d0/d7/f2e [0,4194304] 0 2023-12-16T03:16:07.149 INFO:tasks.workunit.client.0.smithi064.stdout:5/506: readlink d0/d50/d99/la6 0 2023-12-16T03:16:07.177 INFO:tasks.workunit.client.0.smithi064.stdout:7/582: creat d7/d3e/d42/d89/d20/d6f/d91/fba x:0 0 0 2023-12-16T03:16:07.178 INFO:tasks.workunit.client.1.smithi184.stdout:0/926: mkdir dc/d22/d53/ded/d132/d13b 0 2023-12-16T03:16:07.179 INFO:tasks.workunit.client.0.smithi064.stdout:0/526: mknod d2/d7/d10/d21/d7a/cab 0 2023-12-16T03:16:07.183 INFO:tasks.workunit.client.0.smithi064.stdout:9/541: rmdir d2/d2d/d6c/d83/d93 0 2023-12-16T03:16:07.185 INFO:tasks.workunit.client.0.smithi064.stdout:9/542: read d2/d2d/d3b/d3c/d4b/f58 [191396,80610] 0 2023-12-16T03:16:07.185 INFO:tasks.workunit.client.1.smithi184.stdout:7/859: mkdir d0/d3/d2e/d79/d36/d3f/df9/d109 0 2023-12-16T03:16:07.187 INFO:tasks.workunit.client.0.smithi064.stdout:6/533: unlink d3/d8/d13/d58/d65/f75 0 2023-12-16T03:16:07.187 INFO:tasks.workunit.client.0.smithi064.stdout:6/534: write d3/d8/da/f37 [603437,113794] 0 2023-12-16T03:16:07.187 INFO:tasks.workunit.client.1.smithi184.stdout:7/860: read d0/d3/d2e/d79/d36/d3f/fcf [2093796,21787] 0 2023-12-16T03:16:07.189 INFO:tasks.workunit.client.0.smithi064.stdout:4/581: mkdir d0/d1e/d36/db7 0 2023-12-16T03:16:07.190 INFO:tasks.workunit.client.0.smithi064.stdout:4/582: chown d0/da/l3d 2 1 2023-12-16T03:16:07.191 INFO:tasks.workunit.client.0.smithi064.stdout:2/474: getdents d1/d15/d67 0 2023-12-16T03:16:07.191 INFO:tasks.workunit.client.0.smithi064.stdout:6/535: fdatasync d3/d8/da/f37 0 2023-12-16T03:16:07.191 INFO:tasks.workunit.client.0.smithi064.stdout:6/536: dread - d3/d44/f8c zero size 2023-12-16T03:16:07.193 INFO:tasks.workunit.client.1.smithi184.stdout:0/927: creat dc/dab/f13c x:0 0 0 2023-12-16T03:16:07.194 INFO:tasks.workunit.client.0.smithi064.stdout:1/585: mkdir d3/dd/d11/dbf 0 2023-12-16T03:16:07.197 INFO:tasks.workunit.client.1.smithi184.stdout:7/861: dread d0/d3/d2e/d79/f2a [0,4194304] 0 2023-12-16T03:16:07.198 INFO:tasks.workunit.client.1.smithi184.stdout:7/862: write d0/d3/d2e/d79/d34/fb1 [27229,28418] 0 2023-12-16T03:16:07.206 INFO:tasks.workunit.client.1.smithi184.stdout:7/863: getdents d0/d3/d2e/d79/d32/d39/d9c/dc2 0 2023-12-16T03:16:07.206 INFO:tasks.workunit.client.1.smithi184.stdout:7/864: getdents d0/dd3 0 2023-12-16T03:16:07.207 INFO:tasks.workunit.client.1.smithi184.stdout:8/932: sync 2023-12-16T03:16:07.207 INFO:tasks.workunit.client.1.smithi184.stdout:6/986: sync 2023-12-16T03:16:07.208 INFO:tasks.workunit.client.0.smithi064.stdout:6/537: dread d3/f5 [0,4194304] 0 2023-12-16T03:16:07.209 INFO:tasks.workunit.client.0.smithi064.stdout:5/507: getdents d0/d50/d39 0 2023-12-16T03:16:07.210 INFO:tasks.workunit.client.1.smithi184.stdout:6/987: write d0/d5/d12/d1b/f130 [3413753,105215] 0 2023-12-16T03:16:07.213 INFO:tasks.workunit.client.1.smithi184.stdout:6/988: read d0/d5/d22/d37/d4d/d9c/ffa [773533,130269] 0 2023-12-16T03:16:07.214 INFO:tasks.workunit.client.1.smithi184.stdout:7/865: symlink d0/d3/d2e/d79/d32/d39/d8f/dab/l10a 0 2023-12-16T03:16:07.218 INFO:tasks.workunit.client.1.smithi184.stdout:8/933: symlink d2/d4/d10/d7a/d83/d8b/d115/l130 0 2023-12-16T03:16:07.220 INFO:tasks.workunit.client.0.smithi064.stdout:7/583: creat d7/d3e/dac/fbb x:0 0 0 2023-12-16T03:16:07.220 INFO:tasks.workunit.client.0.smithi064.stdout:7/584: chown d7/d3e/d42/d89/l23 174615752 1 2023-12-16T03:16:07.220 INFO:tasks.workunit.client.0.smithi064.stdout:7/585: dread - d7/d3e/d42/d89/d20/d37/f86 zero size 2023-12-16T03:16:07.224 INFO:tasks.workunit.client.0.smithi064.stdout:0/527: rename d2/d29/d66/la5 to d2/d7/d10/d21/lac 0 2023-12-16T03:16:07.226 INFO:tasks.workunit.client.1.smithi184.stdout:6/989: creat d0/d5/d12/df2/f143 x:0 0 0 2023-12-16T03:16:07.226 INFO:tasks.workunit.client.0.smithi064.stdout:1/586: dwrite d3/d22/f28 [0,4194304] 0 2023-12-16T03:16:07.228 INFO:tasks.workunit.client.0.smithi064.stdout:8/620: getdents d0/db 0 2023-12-16T03:16:07.228 INFO:tasks.workunit.client.0.smithi064.stdout:8/621: write d0/db/d12/d44/fc8 [254231,130656] 0 2023-12-16T03:16:07.228 INFO:tasks.workunit.client.0.smithi064.stdout:8/622: write d0/da/d3e/d46/d54/d7c/db7/faf [1022680,94449] 0 2023-12-16T03:16:07.229 INFO:tasks.workunit.client.1.smithi184.stdout:7/866: dread d0/f89 [0,4194304] 0 2023-12-16T03:16:07.229 INFO:tasks.workunit.client.1.smithi184.stdout:0/928: dwrite dc/d22/d1d/fe4 [0,4194304] 0 2023-12-16T03:16:07.229 INFO:tasks.workunit.client.1.smithi184.stdout:8/934: read d2/d4/d10/f14 [1604811,87580] 0 2023-12-16T03:16:07.231 INFO:tasks.workunit.client.0.smithi064.stdout:0/528: write d2/f5 [831123,29942] 0 2023-12-16T03:16:07.232 INFO:tasks.workunit.client.1.smithi184.stdout:7/867: write d0/d3/d2e/d79/d32/d39/f70 [2566834,115252] 0 2023-12-16T03:16:07.232 INFO:tasks.workunit.client.0.smithi064.stdout:4/583: creat d0/d42/d53/fb8 x:0 0 0 2023-12-16T03:16:07.233 INFO:tasks.workunit.client.1.smithi184.stdout:6/990: creat d0/d5/d12/d1b/d33/d111/f144 x:0 0 0 2023-12-16T03:16:07.233 INFO:tasks.workunit.client.1.smithi184.stdout:6/991: fsync d0/d5/d22/f3c 0 2023-12-16T03:16:07.233 INFO:tasks.workunit.client.1.smithi184.stdout:6/992: write d0/d5/d12/f1c [3819132,81270] 0 2023-12-16T03:16:07.238 INFO:tasks.workunit.client.0.smithi064.stdout:2/475: symlink d1/d27/d2e/l93 0 2023-12-16T03:16:07.238 INFO:tasks.workunit.client.0.smithi064.stdout:2/476: fdatasync d1/d15/d1b/d61/f77 0 2023-12-16T03:16:07.243 INFO:tasks.workunit.client.0.smithi064.stdout:6/538: dwrite d3/d8/d1f/d26/f3b [0,4194304] 0 2023-12-16T03:16:07.248 INFO:tasks.workunit.client.0.smithi064.stdout:5/508: dwrite d0/f6c [0,4194304] 0 2023-12-16T03:16:07.249 INFO:tasks.workunit.client.0.smithi064.stdout:7/586: link d7/d3e/d42/d89/d20/la0 d7/d3e/lbc 0 2023-12-16T03:16:07.251 INFO:tasks.workunit.client.0.smithi064.stdout:7/587: dread d7/d26/d30/f57 [0,4194304] 0 2023-12-16T03:16:07.260 INFO:tasks.workunit.client.0.smithi064.stdout:8/623: dwrite d0/da/f30 [0,4194304] 0 2023-12-16T03:16:07.261 INFO:tasks.workunit.client.1.smithi184.stdout:7/868: mknod d0/d3/d2e/d3b/ddc/c10b 0 2023-12-16T03:16:07.261 INFO:tasks.workunit.client.1.smithi184.stdout:7/869: truncate d0/d3/d2e/da9/fce 112279 0 2023-12-16T03:16:07.261 INFO:tasks.workunit.client.1.smithi184.stdout:7/870: readlink d0/d3/d2e/d79/d32/d39/d8f/dab/dc9/ld8 0 2023-12-16T03:16:07.261 INFO:tasks.workunit.client.1.smithi184.stdout:7/871: write d0/d3/d2e/d79/f9a [30086,53425] 0 2023-12-16T03:16:07.262 INFO:tasks.workunit.client.1.smithi184.stdout:7/872: chown d0/d3/d2e/d79/d36/f4e 21654858 1 2023-12-16T03:16:07.262 INFO:tasks.workunit.client.0.smithi064.stdout:2/477: dwrite d1/d15/f1a [0,4194304] 0 2023-12-16T03:16:07.263 INFO:tasks.workunit.client.1.smithi184.stdout:0/929: dwrite dc/d10/d2d/ff1 [0,4194304] 0 2023-12-16T03:16:07.264 INFO:tasks.workunit.client.1.smithi184.stdout:0/930: write dc/d22/d1d/d8e/ff4 [2299329,74918] 0 2023-12-16T03:16:07.264 INFO:tasks.workunit.client.1.smithi184.stdout:0/931: write dc/d22/d1d/d2c/fea [317823,110344] 0 2023-12-16T03:16:07.264 INFO:tasks.workunit.client.1.smithi184.stdout:0/932: fdatasync dc/d22/d45/d66/fae 0 2023-12-16T03:16:07.271 INFO:tasks.workunit.client.1.smithi184.stdout:8/935: mkdir d2/d12/d21/d2d/d31/d131 0 2023-12-16T03:16:07.273 INFO:tasks.workunit.client.1.smithi184.stdout:7/873: mknod d0/c10c 0 2023-12-16T03:16:07.274 INFO:tasks.workunit.client.0.smithi064.stdout:9/543: rename d2/dc/f32 to d2/dc/d24/d39/d77/d7d/fad 0 2023-12-16T03:16:07.277 INFO:tasks.workunit.client.0.smithi064.stdout:5/509: dwrite d0/d7/f1e [0,4194304] 0 2023-12-16T03:16:07.277 INFO:tasks.workunit.client.0.smithi064.stdout:7/588: dwrite d7/d3e/d42/d48/d51/d7c/d52/f99 [0,4194304] 0 2023-12-16T03:16:07.286 INFO:tasks.workunit.client.0.smithi064.stdout:1/587: unlink d3/dd/d11/d2f/l91 0 2023-12-16T03:16:07.292 INFO:tasks.workunit.client.0.smithi064.stdout:1/588: dread d3/dd/d11/f56 [0,4194304] 0 2023-12-16T03:16:07.293 INFO:tasks.workunit.client.0.smithi064.stdout:0/529: creat d2/d7/d10/d85/d88/da0/fad x:0 0 0 2023-12-16T03:16:07.295 INFO:tasks.workunit.client.0.smithi064.stdout:4/584: unlink d0/da/l58 0 2023-12-16T03:16:07.297 INFO:tasks.workunit.client.0.smithi064.stdout:6/539: symlink d3/d8/d1f/d26/d47/d4a/d67/d86/l9f 0 2023-12-16T03:16:07.298 INFO:tasks.workunit.client.0.smithi064.stdout:0/530: read d2/d7/f2b [370877,90228] 0 2023-12-16T03:16:07.300 INFO:tasks.workunit.client.0.smithi064.stdout:0/531: read d2/f8d [1587881,8653] 0 2023-12-16T03:16:07.300 INFO:tasks.workunit.client.0.smithi064.stdout:5/510: dwrite d0/d19/d48/d8f/d3e/d35/f54 [0,4194304] 0 2023-12-16T03:16:07.300 INFO:tasks.workunit.client.0.smithi064.stdout:7/589: dwrite d7/d3e/d42/d48/d51/f60 [4194304,4194304] 0 2023-12-16T03:16:07.301 INFO:tasks.workunit.client.1.smithi184.stdout:0/933: rmdir dc/d22/d1d/d2c/d75 39 2023-12-16T03:16:07.304 INFO:tasks.workunit.client.1.smithi184.stdout:6/993: symlink d0/d36/d79/l145 0 2023-12-16T03:16:07.307 INFO:tasks.workunit.client.0.smithi064.stdout:2/478: mkdir d1/d94 0 2023-12-16T03:16:07.308 INFO:tasks.workunit.client.0.smithi064.stdout:0/532: dread d2/d8/f1b [0,4194304] 0 2023-12-16T03:16:07.310 INFO:tasks.workunit.client.0.smithi064.stdout:8/624: rmdir d0/db/d37/d3a 39 2023-12-16T03:16:07.314 INFO:tasks.workunit.client.0.smithi064.stdout:9/544: rename d2/dc/l13 to d2/dc/d24/d39/d42/d57/lae 0 2023-12-16T03:16:07.317 INFO:tasks.workunit.client.1.smithi184.stdout:7/874: link d0/d3/d2e/d79/d34/fd5 d0/d3/d2e/d79/d36/d3f/df9/d109/f10d 0 2023-12-16T03:16:07.318 INFO:tasks.workunit.client.0.smithi064.stdout:8/625: dread d0/db/d12/d1c/f1f [0,4194304] 0 2023-12-16T03:16:07.322 INFO:tasks.workunit.client.0.smithi064.stdout:4/585: mknod d0/d42/d66/d5a/cb9 0 2023-12-16T03:16:07.322 INFO:tasks.workunit.client.0.smithi064.stdout:4/586: read - d0/da/f88 zero size 2023-12-16T03:16:07.322 INFO:tasks.workunit.client.0.smithi064.stdout:4/587: fdatasync d0/d42/f5c 0 2023-12-16T03:16:07.322 INFO:tasks.workunit.client.0.smithi064.stdout:4/588: chown d0/d1e/d36/c8b 2804 1 2023-12-16T03:16:07.322 INFO:tasks.workunit.client.0.smithi064.stdout:4/589: write d0/d1e/d36/f8f [1021477,88333] 0 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: pgmap v198: 65 pgs: 65 active+clean; 2.6 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 149 MiB/s rd, 319 MiB/s wr, 482 op/s 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: Standby manager daemon smithi184.urtxla restarted 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:07.324 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:07.325 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr fail", "who": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:16:07.325 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: osdmap e44: 6 total, 6 up, 6 in 2023-12-16T03:16:07.325 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "mgr fail", "who": "smithi064.ueciyw"}]': finished 2023-12-16T03:16:07.325 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: mgrmap e20: smithi184.urtxla(active, starting, since 0.00680969s) 2023-12-16T03:16:07.325 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:16:07.325 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:16:07.325 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.jaepzs"}]: dispatch 2023-12-16T03:16:07.325 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.edrjyd"}]: dispatch 2023-12-16T03:16:07.325 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.jfpiqk"}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.uqpwjn"}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mgr metadata", "who": "smithi184.urtxla", "id": "smithi184.urtxla"}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:16:07.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: Manager daemon smithi184.urtxla is now available 2023-12-16T03:16:07.327 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:07.327 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:07.327 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:07.327 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:07.328 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi184.urtxla/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:16:07.328 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:07 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi184.urtxla/trash_purge_schedule"}]: dispatch 2023-12-16T03:16:07.328 INFO:tasks.workunit.client.0.smithi064.stdout:6/540: rmdir d3/d8/d1f/d26/d47/d4a/d67/d73 39 2023-12-16T03:16:07.330 INFO:tasks.workunit.client.1.smithi184.stdout:8/936: dwrite d2/d12/d21/f6e [0,4194304] 0 2023-12-16T03:16:07.330 INFO:tasks.workunit.client.1.smithi184.stdout:0/934: rmdir dc/d22/d48/d12e 0 2023-12-16T03:16:07.331 INFO:tasks.workunit.client.0.smithi064.stdout:7/590: dread d7/d3e/f55 [0,4194304] 0 2023-12-16T03:16:07.331 INFO:tasks.workunit.client.0.smithi064.stdout:1/589: dwrite d3/d36/d44/d4d/d58/d96/f99 [0,4194304] 0 2023-12-16T03:16:07.334 INFO:tasks.workunit.client.1.smithi184.stdout:6/994: symlink d0/d5/d22/d34/dcc/l146 0 2023-12-16T03:16:07.336 INFO:tasks.workunit.client.0.smithi064.stdout:5/511: creat d0/d19/d48/d8f/dac/fb4 x:0 0 0 2023-12-16T03:16:07.337 INFO:tasks.workunit.client.1.smithi184.stdout:8/937: dread d2/d4/d10/f14 [0,4194304] 0 2023-12-16T03:16:07.337 INFO:tasks.workunit.client.0.smithi064.stdout:0/533: write d2/d8/da/f62 [3520286,52635] 0 2023-12-16T03:16:07.337 INFO:tasks.workunit.client.0.smithi064.stdout:0/534: truncate d2/d8/da/f9a 12730 0 2023-12-16T03:16:07.342 INFO:tasks.workunit.client.0.smithi064.stdout:2/479: creat d1/d27/d2e/f95 x:0 0 0 2023-12-16T03:16:07.342 INFO:tasks.workunit.client.0.smithi064.stdout:2/480: chown d1/d15/d1b/d61 3998561 1 2023-12-16T03:16:07.343 INFO:tasks.workunit.client.1.smithi184.stdout:0/935: getdents dc/d10/d2d/d5f/d7c 0 2023-12-16T03:16:07.345 INFO:tasks.workunit.client.0.smithi064.stdout:9/545: mkdir d2/d2d/daf 0 2023-12-16T03:16:07.345 INFO:tasks.workunit.client.0.smithi064.stdout:9/546: write d2/d2d/d6c/d83/f96 [842132,70413] 0 2023-12-16T03:16:07.345 INFO:tasks.workunit.client.0.smithi064.stdout:9/547: fsync d2/f2e 0 2023-12-16T03:16:07.346 INFO:tasks.workunit.client.1.smithi184.stdout:6/995: getdents d0/d5/d22/d25/dbf/d11b 0 2023-12-16T03:16:07.348 INFO:tasks.workunit.client.0.smithi064.stdout:8/626: symlink d0/db/ld5 0 2023-12-16T03:16:07.348 INFO:tasks.workunit.client.0.smithi064.stdout:8/627: readlink d0/db/d37/dbf/l80 0 2023-12-16T03:16:07.348 INFO:tasks.workunit.client.0.smithi064.stdout:8/628: fdatasync d0/db/d12/d1c/d59/d77/f94 0 2023-12-16T03:16:07.348 INFO:tasks.workunit.client.0.smithi064.stdout:8/629: write d0/d1d/d24/d2f/f39 [26932,106502] 0 2023-12-16T03:16:07.350 INFO:tasks.workunit.client.0.smithi064.stdout:4/590: mknod d0/d42/d66/d5a/cba 0 2023-12-16T03:16:07.350 INFO:tasks.workunit.client.0.smithi064.stdout:4/591: fsync d0/d42/d66/d33/fad 0 2023-12-16T03:16:07.350 INFO:tasks.workunit.client.0.smithi064.stdout:4/592: chown d0/d42/d4c/d70/d8c/f98 1 1 2023-12-16T03:16:07.353 INFO:tasks.workunit.client.1.smithi184.stdout:0/936: symlink dc/dc9/l13d 0 2023-12-16T03:16:07.353 INFO:tasks.workunit.client.0.smithi064.stdout:9/548: dread d2/d2d/d3b/d3c/f20 [0,4194304] 0 2023-12-16T03:16:07.356 INFO:tasks.workunit.client.1.smithi184.stdout:8/938: unlink d2/d12/d21/d8a/dda/l12a 0 2023-12-16T03:16:07.360 INFO:tasks.workunit.client.1.smithi184.stdout:0/937: truncate dc/d10/d2d/d5f/f11c 589188 0 2023-12-16T03:16:07.360 INFO:tasks.workunit.client.1.smithi184.stdout:0/938: chown dc/dc9/ce0 129621 1 2023-12-16T03:16:07.361 INFO:tasks.workunit.client.0.smithi064.stdout:1/590: rename d3/c33 to d3/d36/cc0 0 2023-12-16T03:16:07.363 INFO:tasks.workunit.client.0.smithi064.stdout:7/591: creat d7/d3e/d42/d48/d51/d7c/d52/fbd x:0 0 0 2023-12-16T03:16:07.363 INFO:tasks.workunit.client.0.smithi064.stdout:7/592: chown d7/d3e/d42/d48/d51/d7c/f77 643253 1 2023-12-16T03:16:07.366 INFO:tasks.workunit.client.1.smithi184.stdout:0/939: link dc/d22/d1d/d35/df7/f130 dc/d22/d1a/f13e 0 2023-12-16T03:16:07.370 INFO:tasks.workunit.client.0.smithi064.stdout:5/512: creat d0/d19/d48/d92/fb5 x:0 0 0 2023-12-16T03:16:07.374 INFO:tasks.workunit.client.0.smithi064.stdout:0/535: creat d2/d5b/fae x:0 0 0 2023-12-16T03:16:07.374 INFO:tasks.workunit.client.0.smithi064.stdout:0/536: truncate d2/d7/d6b/f6e 195106 0 2023-12-16T03:16:07.375 INFO:tasks.workunit.client.0.smithi064.stdout:2/481: symlink d1/d15/d1b/l96 0 2023-12-16T03:16:07.377 INFO:tasks.workunit.client.0.smithi064.stdout:8/630: symlink d0/d1d/d24/d2f/d50/ld6 0 2023-12-16T03:16:07.379 INFO:tasks.workunit.client.0.smithi064.stdout:4/593: mknod d0/da/da6/cbb 0 2023-12-16T03:16:07.382 INFO:tasks.workunit.client.1.smithi184.stdout:8/939: dwrite d2/d12/f5a [0,4194304] 0 2023-12-16T03:16:07.382 INFO:tasks.workunit.client.0.smithi064.stdout:9/549: link d2/d2d/d3b/d3c/d4b/f58 d2/d2d/daf/fb0 0 2023-12-16T03:16:07.382 INFO:tasks.workunit.client.0.smithi064.stdout:9/550: fdatasync d2/d2d/d36/f53 0 2023-12-16T03:16:07.382 INFO:tasks.workunit.client.0.smithi064.stdout:9/551: getdents d2/d2d/d6c/da4 0 2023-12-16T03:16:07.382 INFO:tasks.workunit.client.0.smithi064.stdout:4/594: write d0/d42/d66/f30 [3415639,12200] 0 2023-12-16T03:16:07.383 INFO:tasks.workunit.client.1.smithi184.stdout:0/940: dread dc/d22/d1d/d35/dc3/f67 [0,4194304] 0 2023-12-16T03:16:07.383 INFO:tasks.workunit.client.1.smithi184.stdout:0/941: stat dc/d10/d2d/f107 0 2023-12-16T03:16:07.384 INFO:tasks.workunit.client.0.smithi064.stdout:1/591: creat d3/d22/d57/db1/fc1 x:0 0 0 2023-12-16T03:16:07.384 INFO:tasks.workunit.client.0.smithi064.stdout:7/593: dwrite d7/d26/d30/f57 [0,4194304] 0 2023-12-16T03:16:07.386 INFO:tasks.workunit.client.1.smithi184.stdout:8/940: dread d2/d12/d21/d8a/dda/fa1 [0,4194304] 0 2023-12-16T03:16:07.391 INFO:tasks.workunit.client.1.smithi184.stdout:0/942: creat dc/d22/d45/d66/d80/f13f x:0 0 0 2023-12-16T03:16:07.392 INFO:tasks.workunit.client.1.smithi184.stdout:0/943: chown dc/d10/d2d/d5f/d7c/cd0 2 1 2023-12-16T03:16:07.392 INFO:tasks.workunit.client.1.smithi184.stdout:7/875: truncate d0/d3/d2e/d79/f9a 104438 0 2023-12-16T03:16:07.393 INFO:tasks.workunit.client.0.smithi064.stdout:2/482: symlink d1/d15/l97 0 2023-12-16T03:16:07.394 INFO:tasks.workunit.client.0.smithi064.stdout:2/483: chown d1/d15/d1b/l4d 21158984 1 2023-12-16T03:16:07.395 INFO:tasks.workunit.client.1.smithi184.stdout:8/941: mknod d2/d12/d21/d8a/dcd/c132 0 2023-12-16T03:16:07.396 INFO:tasks.workunit.client.0.smithi064.stdout:8/631: creat d0/da/d3e/d46/d8f/fd7 x:0 0 0 2023-12-16T03:16:07.397 INFO:tasks.workunit.client.1.smithi184.stdout:0/944: creat dc/d22/d45/d66/d80/f140 x:0 0 0 2023-12-16T03:16:07.397 INFO:tasks.workunit.client.1.smithi184.stdout:0/945: fdatasync dc/d10/f11 0 2023-12-16T03:16:07.400 INFO:tasks.workunit.client.1.smithi184.stdout:7/876: mkdir d0/d3/d2e/d3b/d10e 0 2023-12-16T03:16:07.400 INFO:tasks.workunit.client.0.smithi064.stdout:9/552: dwrite d2/f40 [0,4194304] 0 2023-12-16T03:16:07.400 INFO:tasks.workunit.client.0.smithi064.stdout:8/632: write d0/db/f66 [1280740,71720] 0 2023-12-16T03:16:07.401 INFO:tasks.workunit.client.0.smithi064.stdout:4/595: mknod d0/d1e/d36/db7/cbc 0 2023-12-16T03:16:07.403 INFO:tasks.workunit.client.1.smithi184.stdout:8/942: link d2/d4/d10/d75/dd6/c10b d2/d4/da6/c133 0 2023-12-16T03:16:07.403 INFO:tasks.workunit.client.0.smithi064.stdout:9/553: write d2/f33 [3798741,128986] 0 2023-12-16T03:16:07.404 INFO:tasks.workunit.client.0.smithi064.stdout:9/554: dread - d2/d7e/fa2 zero size 2023-12-16T03:16:07.404 INFO:tasks.workunit.client.0.smithi064.stdout:9/555: read - d2/d2d/d36/f60 zero size 2023-12-16T03:16:07.404 INFO:tasks.workunit.client.0.smithi064.stdout:9/556: fdatasync d2/dc/d24/d39/d42/d57/f46 0 2023-12-16T03:16:07.404 INFO:tasks.workunit.client.0.smithi064.stdout:1/592: creat d3/dd/d23/d60/fc2 x:0 0 0 2023-12-16T03:16:07.405 INFO:tasks.workunit.client.1.smithi184.stdout:0/946: creat dc/d22/d45/d66/f141 x:0 0 0 2023-12-16T03:16:07.409 INFO:tasks.workunit.client.1.smithi184.stdout:7/877: stat d0/d3/d2e/d79/d32/d39/dcb/lcc 0 2023-12-16T03:16:07.409 INFO:tasks.workunit.client.1.smithi184.stdout:7/878: chown d0/d3/d2e/d79/d32/d39/d9c/fe7 26496426 1 2023-12-16T03:16:07.414 INFO:tasks.workunit.client.1.smithi184.stdout:8/943: mkdir d2/d12/db4/d134 0 2023-12-16T03:16:07.414 INFO:tasks.workunit.client.1.smithi184.stdout:8/944: readlink d2/l11d 0 2023-12-16T03:16:07.414 INFO:tasks.workunit.client.1.smithi184.stdout:8/945: stat d2/f89 0 2023-12-16T03:16:07.414 INFO:tasks.workunit.client.1.smithi184.stdout:8/946: truncate d2/d4/d10/d11/d77/ff5 593755 0 2023-12-16T03:16:07.414 INFO:tasks.workunit.client.1.smithi184.stdout:5/710: sync 2023-12-16T03:16:07.414 INFO:tasks.workunit.client.1.smithi184.stdout:1/870: sync 2023-12-16T03:16:07.414 INFO:tasks.workunit.client.1.smithi184.stdout:5/711: dread - d1/d2a/d31/d28/f65 zero size 2023-12-16T03:16:07.421 INFO:tasks.workunit.client.1.smithi184.stdout:0/947: rename dc/d10/d2d/fbc to dc/d22/d53/ded/d132/f142 0 2023-12-16T03:16:07.424 INFO:tasks.workunit.client.1.smithi184.stdout:7/879: unlink d0/d3/d2e/d79/d32/d39/d8f/dab/dc9/ld8 0 2023-12-16T03:16:07.427 INFO:tasks.workunit.client.0.smithi064.stdout:7/594: mknod d7/d3e/d42/d89/d20/d6f/d93/cbe 0 2023-12-16T03:16:07.428 INFO:tasks.workunit.client.1.smithi184.stdout:8/947: dwrite d2/f89 [4194304,4194304] 0 2023-12-16T03:16:07.430 INFO:tasks.workunit.client.1.smithi184.stdout:1/871: mknod d3/d34/dbc/d3c/d41/d63/c12e 0 2023-12-16T03:16:07.434 INFO:tasks.workunit.client.0.smithi064.stdout:0/537: rename d2/d7/d70 to d2/d8/da/df/daf 0 2023-12-16T03:16:07.435 INFO:tasks.workunit.client.0.smithi064.stdout:0/538: write d2/d7/f2b [286725,19993] 0 2023-12-16T03:16:07.436 INFO:tasks.workunit.client.1.smithi184.stdout:5/712: stat d1/d3/d9/de/d15/d19/d3a/lc4 0 2023-12-16T03:16:07.436 INFO:tasks.workunit.client.1.smithi184.stdout:5/713: write d1/d3/d9/de/f37 [584124,1128] 0 2023-12-16T03:16:07.444 INFO:tasks.workunit.client.1.smithi184.stdout:0/948: unlink dc/d2a/c3a 0 2023-12-16T03:16:07.445 INFO:tasks.workunit.client.1.smithi184.stdout:0/949: readlink dc/d22/d1d/d35/dc3/la6 0 2023-12-16T03:16:07.445 INFO:tasks.workunit.client.1.smithi184.stdout:0/950: write dc/f19 [1498077,43659] 0 2023-12-16T03:16:07.448 INFO:tasks.workunit.client.1.smithi184.stdout:0/951: dread dc/d22/d53/f95 [0,4194304] 0 2023-12-16T03:16:07.448 INFO:tasks.workunit.client.1.smithi184.stdout:0/952: dread - dc/d22/d1d/d8e/f120 zero size 2023-12-16T03:16:07.448 INFO:tasks.workunit.client.1.smithi184.stdout:0/953: fsync dc/d22/d45/d66/d80/da3/dcb/fd6 0 2023-12-16T03:16:07.448 INFO:tasks.workunit.client.1.smithi184.stdout:0/954: chown dc/d22/d1d/d2c/d75/c114 518209 1 2023-12-16T03:16:07.448 INFO:tasks.workunit.client.1.smithi184.stdout:0/955: stat dc/d22/d1d/d2c/fea 0 2023-12-16T03:16:07.448 INFO:tasks.workunit.client.1.smithi184.stdout:0/956: truncate dc/d2a/f97 147137 0 2023-12-16T03:16:07.448 INFO:tasks.workunit.client.1.smithi184.stdout:0/957: write dc/d22/d45/d66/d80/da3/dcb/fd6 [5211669,36181] 0 2023-12-16T03:16:07.448 INFO:tasks.workunit.client.1.smithi184.stdout:7/880: getdents d0 0 2023-12-16T03:16:07.454 INFO:tasks.workunit.client.0.smithi064.stdout:8/633: symlink d0/d1d/d24/d2f/d50/d70/da4/ld8 0 2023-12-16T03:16:07.459 INFO:tasks.workunit.client.0.smithi064.stdout:8/634: dread d0/db/f4f [4194304,4194304] 0 2023-12-16T03:16:07.460 INFO:tasks.workunit.client.1.smithi184.stdout:8/948: creat d2/f135 x:0 0 0 2023-12-16T03:16:07.460 INFO:tasks.workunit.client.1.smithi184.stdout:1/872: creat d3/d13/d121/d99/db7/f12f x:0 0 0 2023-12-16T03:16:07.460 INFO:tasks.workunit.client.1.smithi184.stdout:1/873: write d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/f120 [223831,6467] 0 2023-12-16T03:16:07.463 INFO:tasks.workunit.client.0.smithi064.stdout:4/596: unlink d0/d42/d66/f30 0 2023-12-16T03:16:07.467 INFO:tasks.workunit.client.0.smithi064.stdout:9/557: mkdir d2/dc/d24/d39/d77/d7d/db1 0 2023-12-16T03:16:07.467 INFO:tasks.workunit.client.0.smithi064.stdout:9/558: stat d2/dc/d24/d39/d42/d9a 0 2023-12-16T03:16:07.468 INFO:tasks.workunit.client.1.smithi184.stdout:5/714: creat d1/d3/d9/de/d15/d19/d3a/fea x:0 0 0 2023-12-16T03:16:07.468 INFO:tasks.workunit.client.1.smithi184.stdout:5/715: chown d1/d3/d9/de/d15/db9/fbd 6745 1 2023-12-16T03:16:07.469 INFO:tasks.workunit.client.1.smithi184.stdout:5/716: write d1/d3/d9/de/d15/f52 [2011082,71282] 0 2023-12-16T03:16:07.470 INFO:tasks.workunit.client.0.smithi064.stdout:1/593: link d3/d36/d44/d4d/f88 d3/d22/dab/fc3 0 2023-12-16T03:16:07.473 INFO:tasks.workunit.client.0.smithi064.stdout:7/595: mkdir d7/d3e/d42/d89/d20/d37/db1/dbf 0 2023-12-16T03:16:07.474 INFO:tasks.workunit.client.0.smithi064.stdout:7/596: truncate d7/d3e/d42/f72 4403976 0 2023-12-16T03:16:07.484 INFO:tasks.workunit.client.0.smithi064.stdout:0/539: getdents d2/d8/da 0 2023-12-16T03:16:07.486 INFO:tasks.workunit.client.1.smithi184.stdout:0/958: symlink dc/d22/d45/d66/d80/da3/l143 0 2023-12-16T03:16:07.486 INFO:tasks.workunit.client.1.smithi184.stdout:7/881: mkdir d0/d3/d2e/d3b/ddc/d10f 0 2023-12-16T03:16:07.487 INFO:tasks.workunit.client.1.smithi184.stdout:7/882: dread - d0/d3/d2e/d79/d32/d39/d8f/dab/dc9/fec zero size 2023-12-16T03:16:07.489 INFO:tasks.workunit.client.0.smithi064.stdout:8/635: unlink d0/db/d12/d44/f4a 0 2023-12-16T03:16:07.490 INFO:tasks.workunit.client.0.smithi064.stdout:8/636: readlink d0/db/d5a/d97/l4d 0 2023-12-16T03:16:07.492 INFO:tasks.workunit.client.0.smithi064.stdout:4/597: symlink d0/d1e/d36/db7/lbd 0 2023-12-16T03:16:07.496 INFO:tasks.workunit.client.0.smithi064.stdout:7/597: dwrite d7/d26/d30/f33 [4194304,4194304] 0 2023-12-16T03:16:07.497 INFO:tasks.workunit.client.0.smithi064.stdout:9/559: mkdir d2/dc/d24/db2 0 2023-12-16T03:16:07.498 INFO:tasks.workunit.client.0.smithi064.stdout:1/594: dwrite d3/dd/d11/f80 [0,4194304] 0 2023-12-16T03:16:07.498 INFO:tasks.workunit.client.0.smithi064.stdout:1/595: fsync d3/dd/d11/d6a/f7a 0 2023-12-16T03:16:07.498 INFO:tasks.workunit.client.0.smithi064.stdout:1/596: chown d3/dd/d11/d6a 234 1 2023-12-16T03:16:07.498 INFO:tasks.workunit.client.0.smithi064.stdout:0/540: dread d2/f8d [0,4194304] 0 2023-12-16T03:16:07.500 INFO:tasks.workunit.client.1.smithi184.stdout:1/874: mknod d3/d34/dbc/d3c/d41/d77/c130 0 2023-12-16T03:16:07.505 INFO:tasks.workunit.client.1.smithi184.stdout:5/717: link d1/dbb/lc0 d1/d2a/de3/leb 0 2023-12-16T03:16:07.507 INFO:tasks.workunit.client.1.smithi184.stdout:0/959: mkdir dc/d10/d2d/d144 0 2023-12-16T03:16:07.507 INFO:tasks.workunit.client.1.smithi184.stdout:0/960: readlink dc/d22/d45/lb5 0 2023-12-16T03:16:07.508 INFO:tasks.workunit.client.0.smithi064.stdout:1/597: mkdir d3/d36/d44/d4d/da8/dc4 0 2023-12-16T03:16:07.510 INFO:tasks.workunit.client.1.smithi184.stdout:7/883: mkdir d0/d3/d2e/d79/d32/d39/d9c/dc2/ddd/d110 0 2023-12-16T03:16:07.512 INFO:tasks.workunit.client.1.smithi184.stdout:8/949: dread d2/d12/d21/d2d/d31/d34/d96/f100 [0,4194304] 0 2023-12-16T03:16:07.512 INFO:tasks.workunit.client.1.smithi184.stdout:8/950: chown d2/d4/d10/d11/d72/dc2/fcf 879 1 2023-12-16T03:16:07.515 INFO:tasks.workunit.client.1.smithi184.stdout:1/875: mkdir d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/d131 0 2023-12-16T03:16:07.515 INFO:tasks.workunit.client.1.smithi184.stdout:1/876: truncate d3/d34/dbc/d3c/d41/d77/fff 476433 0 2023-12-16T03:16:07.515 INFO:tasks.workunit.client.0.smithi064.stdout:9/560: link d2/dc/d24/d39/d77/d7d/fad d2/dc/d24/d39/d42/d94/fb3 0 2023-12-16T03:16:07.518 INFO:tasks.workunit.client.1.smithi184.stdout:5/718: mknod d1/d3/d9/de/d30/cec 0 2023-12-16T03:16:07.519 INFO:tasks.workunit.client.0.smithi064.stdout:0/541: dwrite d2/d5b/f9c [0,4194304] 0 2023-12-16T03:16:07.520 INFO:tasks.workunit.client.0.smithi064.stdout:1/598: truncate d3/d36/d9e/f85 2250159 0 2023-12-16T03:16:07.521 INFO:tasks.workunit.client.1.smithi184.stdout:0/961: readlink dc/l71 0 2023-12-16T03:16:07.525 INFO:tasks.workunit.client.0.smithi064.stdout:8/637: rename d0/da/d3e/d46/d54/d7c/db7/d7e to d0/d1d/d73/dd9 0 2023-12-16T03:16:07.525 INFO:tasks.workunit.client.0.smithi064.stdout:8/638: chown d0/db/l2b 67 1 2023-12-16T03:16:07.525 INFO:tasks.workunit.client.0.smithi064.stdout:8/639: truncate d0/db/d5a/d97/d38/fd2 104435 0 2023-12-16T03:16:07.525 INFO:tasks.workunit.client.0.smithi064.stdout:8/640: chown d0/da/d3e/f98 0 1 2023-12-16T03:16:07.527 INFO:tasks.workunit.client.0.smithi064.stdout:9/561: rmdir d2/dc/d24/d39/d42/dab 0 2023-12-16T03:16:07.529 INFO:tasks.workunit.client.1.smithi184.stdout:7/884: mknod d0/d3/d2e/d3b/ddc/d10f/c111 0 2023-12-16T03:16:07.529 INFO:tasks.workunit.client.0.smithi064.stdout:9/562: dread d2/dc/d24/d39/d42/f59 [0,4194304] 0 2023-12-16T03:16:07.530 INFO:tasks.workunit.client.0.smithi064.stdout:9/563: stat d2/d2d/d6c/d83 0 2023-12-16T03:16:07.530 INFO:tasks.workunit.client.0.smithi064.stdout:9/564: fsync d2/f33 0 2023-12-16T03:16:07.532 INFO:tasks.workunit.client.1.smithi184.stdout:1/877: mknod d3/d34/dbc/d3c/d41/d77/c132 0 2023-12-16T03:16:07.536 INFO:tasks.workunit.client.1.smithi184.stdout:5/719: creat d1/dbb/fed x:0 0 0 2023-12-16T03:16:07.538 INFO:tasks.workunit.client.1.smithi184.stdout:0/962: rename dc/d22/d45/d66/ffa to dc/d22/d45/d66/d80/da3/d109/f145 0 2023-12-16T03:16:07.540 INFO:tasks.workunit.client.1.smithi184.stdout:0/963: write dc/d10/d2d/ff1 [258850,82677] 0 2023-12-16T03:16:07.540 INFO:tasks.workunit.client.1.smithi184.stdout:0/964: write dc/d22/d1d/d8e/f10b [3816497,34052] 0 2023-12-16T03:16:07.548 INFO:tasks.workunit.client.1.smithi184.stdout:0/965: dread dc/f68 [0,4194304] 0 2023-12-16T03:16:07.548 INFO:tasks.workunit.client.1.smithi184.stdout:0/966: chown dc/d22/d1d/d2c/fb9 12580 1 2023-12-16T03:16:07.548 INFO:tasks.workunit.client.1.smithi184.stdout:0/967: readlink dc/d22/d1d/ld1 0 2023-12-16T03:16:07.549 INFO:tasks.workunit.client.1.smithi184.stdout:4/879: sync 2023-12-16T03:16:07.549 INFO:tasks.workunit.client.1.smithi184.stdout:2/801: sync 2023-12-16T03:16:07.549 INFO:tasks.workunit.client.1.smithi184.stdout:4/880: write d1/d12/db3/db8/f118 [273124,61131] 0 2023-12-16T03:16:07.549 INFO:tasks.workunit.client.1.smithi184.stdout:4/881: write d1/d11/d5a/f10f [468636,105624] 0 2023-12-16T03:16:07.553 INFO:tasks.workunit.client.1.smithi184.stdout:1/878: truncate d3/d34/dbc/d3c/f25 4250425 0 2023-12-16T03:16:07.558 INFO:tasks.workunit.client.1.smithi184.stdout:0/968: truncate dc/d10/d1c/f49 3458954 0 2023-12-16T03:16:07.558 INFO:tasks.workunit.client.1.smithi184.stdout:0/969: write dc/d22/d53/ded/d132/f142 [21554,10607] 0 2023-12-16T03:16:07.558 INFO:tasks.workunit.client.1.smithi184.stdout:1/879: write d3/d34/dbc/f58 [6123,105835] 0 2023-12-16T03:16:07.559 INFO:tasks.workunit.client.1.smithi184.stdout:5/720: dwrite d1/d2a/d31/d28/d72/fe9 [0,4194304] 0 2023-12-16T03:16:07.562 INFO:tasks.workunit.client.1.smithi184.stdout:7/885: rename d0/d3/d2e/d79/d32/d39/d8f/dab/d104/c91 to d0/d6b/dee/c112 0 2023-12-16T03:16:07.566 INFO:tasks.workunit.client.1.smithi184.stdout:2/802: unlink d3/d9/f27 0 2023-12-16T03:16:07.568 INFO:tasks.workunit.client.1.smithi184.stdout:2/803: dread d3/d29/d2f/f54 [0,4194304] 0 2023-12-16T03:16:07.569 INFO:tasks.workunit.client.1.smithi184.stdout:4/882: mkdir d1/d29/d34/d5c/d76/d3b/d12f 0 2023-12-16T03:16:07.573 INFO:tasks.workunit.client.0.smithi064.stdout:1/599: mkdir d3/d36/d44/d4d/dad/dc5 0 2023-12-16T03:16:07.573 INFO:tasks.workunit.client.0.smithi064.stdout:1/600: chown d3/dd/d11/d6a 1136185 1 2023-12-16T03:16:07.576 INFO:tasks.workunit.client.0.smithi064.stdout:7/598: rename d7/d3e/d42/d43/l9a to d7/d26/d30/lc0 0 2023-12-16T03:16:07.579 INFO:tasks.workunit.client.0.smithi064.stdout:8/641: mkdir d0/db/d5a/d97/d38/dda 0 2023-12-16T03:16:07.584 INFO:tasks.workunit.client.1.smithi184.stdout:0/970: unlink dc/d22/d53/f135 0 2023-12-16T03:16:07.588 INFO:tasks.workunit.client.0.smithi064.stdout:1/601: dwrite d3/dd/d11/d3b/f5e [8388608,4194304] 0 2023-12-16T03:16:07.588 INFO:tasks.workunit.client.0.smithi064.stdout:1/602: chown d3/d36/d9e 209 1 2023-12-16T03:16:07.588 INFO:tasks.workunit.client.0.smithi064.stdout:1/603: chown f2 7028768 1 2023-12-16T03:16:07.590 INFO:tasks.workunit.client.0.smithi064.stdout:0/542: mkdir d2/d8/da/df/db0 0 2023-12-16T03:16:07.590 INFO:tasks.workunit.client.0.smithi064.stdout:0/543: stat d2/d5b/fae 0 2023-12-16T03:16:07.590 INFO:tasks.workunit.client.0.smithi064.stdout:0/544: write d2/f27 [1365789,58003] 0 2023-12-16T03:16:07.590 INFO:tasks.workunit.client.0.smithi064.stdout:0/545: stat d2/d7/d10/d85/c95 0 2023-12-16T03:16:07.590 INFO:tasks.workunit.client.0.smithi064.stdout:0/546: write d2/f3e [2776328,87672] 0 2023-12-16T03:16:07.591 INFO:tasks.workunit.client.0.smithi064.stdout:0/547: write d2/d8/da/f9a [287534,99756] 0 2023-12-16T03:16:07.592 INFO:tasks.workunit.client.0.smithi064.stdout:7/599: creat d7/d3e/fc1 x:0 0 0 2023-12-16T03:16:07.592 INFO:tasks.workunit.client.0.smithi064.stdout:0/548: write d2/d5b/f9c [1282978,53600] 0 2023-12-16T03:16:07.595 INFO:tasks.workunit.client.0.smithi064.stdout:8/642: link d0/db/l2b d0/db/d37/d3a/d6f/ldb 0 2023-12-16T03:16:07.598 INFO:tasks.workunit.client.1.smithi184.stdout:5/721: creat d1/d3/d9/de/d30/d68/fee x:0 0 0 2023-12-16T03:16:07.598 INFO:tasks.workunit.client.1.smithi184.stdout:5/722: truncate d1/d3/d9/de/d30/f4e 5188367 0 2023-12-16T03:16:07.599 INFO:tasks.workunit.client.0.smithi064.stdout:9/565: mkdir d2/d2d/d36/db4 0 2023-12-16T03:16:07.600 INFO:tasks.workunit.client.1.smithi184.stdout:7/886: mknod d0/dd3/c113 0 2023-12-16T03:16:07.601 INFO:tasks.workunit.client.0.smithi064.stdout:1/604: creat d3/d36/d44/d4d/fc6 x:0 0 0 2023-12-16T03:16:07.603 INFO:tasks.workunit.client.1.smithi184.stdout:2/804: unlink d3/d29/d4d/d5b/da6/lf4 0 2023-12-16T03:16:07.604 INFO:tasks.workunit.client.0.smithi064.stdout:1/605: dread d3/dd/d11/d3b/f69 [0,4194304] 0 2023-12-16T03:16:07.612 INFO:tasks.workunit.client.1.smithi184.stdout:0/971: link dc/d22/d53/ded/d11b/l11e dc/d22/d1d/d8e/d118/l146 0 2023-12-16T03:16:07.612 INFO:tasks.workunit.client.1.smithi184.stdout:0/972: chown dc/d22/d45/d66/c81 12839 1 2023-12-16T03:16:07.612 INFO:tasks.workunit.client.1.smithi184.stdout:0/973: chown dc/d22/d1d/d8e/d133 510607 1 2023-12-16T03:16:07.612 INFO:tasks.workunit.client.1.smithi184.stdout:0/974: write dc/d10/d2d/d5f/d7c/f106 [583792,99543] 0 2023-12-16T03:16:07.614 INFO:tasks.workunit.client.1.smithi184.stdout:1/880: dread d3/d34/dbc/d3c/f117 [0,4194304] 0 2023-12-16T03:16:07.614 INFO:tasks.workunit.client.0.smithi064.stdout:0/549: dwrite d2/d8/f1b [4194304,4194304] 0 2023-12-16T03:16:07.614 INFO:tasks.workunit.client.0.smithi064.stdout:0/550: fsync d2/d8/da/df/f37 0 2023-12-16T03:16:07.616 INFO:tasks.workunit.client.1.smithi184.stdout:1/881: write d3/d34/dbc/d38/d52/f6c [2142311,6644] 0 2023-12-16T03:16:07.618 INFO:tasks.workunit.client.0.smithi064.stdout:9/566: creat d2/dc/d24/d39/d42/d57/fb5 x:0 0 0 2023-12-16T03:16:07.623 INFO:tasks.workunit.client.0.smithi064.stdout:1/606: mknod d3/d36/d44/d4d/d58/cc7 0 2023-12-16T03:16:07.623 INFO:tasks.workunit.client.0.smithi064.stdout:1/607: fsync d3/dd/d11/d2f/fb3 0 2023-12-16T03:16:07.630 INFO:tasks.workunit.client.0.smithi064.stdout:9/567: creat d2/d2d/fb6 x:0 0 0 2023-12-16T03:16:07.630 INFO:tasks.workunit.client.0.smithi064.stdout:9/568: write d2/dc/d24/d39/d5e/d6f/f70 [230978,114955] 0 2023-12-16T03:16:07.631 INFO:tasks.workunit.client.1.smithi184.stdout:5/723: mkdir d1/dbb/def 0 2023-12-16T03:16:07.631 INFO:tasks.workunit.client.1.smithi184.stdout:2/805: creat d3/d29/d2f/d2e/dcb/f10b x:0 0 0 2023-12-16T03:16:07.631 INFO:tasks.workunit.client.1.smithi184.stdout:7/887: symlink d0/dd3/l114 0 2023-12-16T03:16:07.632 INFO:tasks.workunit.client.0.smithi064.stdout:1/608: creat d3/d36/d44/d4d/dad/dc5/fc8 x:0 0 0 2023-12-16T03:16:07.632 INFO:tasks.workunit.client.0.smithi064.stdout:1/609: fsync d3/dd/d23/d4f/f8d 0 2023-12-16T03:16:07.638 INFO:tasks.workunit.client.0.smithi064.stdout:1/610: creat d3/dd/d11/fc9 x:0 0 0 2023-12-16T03:16:07.640 INFO:tasks.workunit.client.1.smithi184.stdout:2/806: dread d3/d29/d2f/d46/d77/f80 [0,4194304] 0 2023-12-16T03:16:07.644 INFO:tasks.workunit.client.1.smithi184.stdout:0/975: creat dc/d22/d1d/d8e/d118/f147 x:0 0 0 2023-12-16T03:16:07.648 INFO:tasks.workunit.client.1.smithi184.stdout:5/724: mkdir d1/d3/d9/de/d15/d27/dd2/df0 0 2023-12-16T03:16:07.650 INFO:tasks.workunit.client.1.smithi184.stdout:0/976: mknod dc/d22/d45/daf/c148 0 2023-12-16T03:16:07.651 INFO:tasks.workunit.client.1.smithi184.stdout:4/883: write d1/d29/f95 [206077,50464] 0 2023-12-16T03:16:07.654 INFO:tasks.workunit.client.1.smithi184.stdout:0/977: creat dc/d22/d1d/d35/df7/f149 x:0 0 0 2023-12-16T03:16:07.654 INFO:tasks.workunit.client.1.smithi184.stdout:0/978: dread - dc/d22/d1d/d35/f128 zero size 2023-12-16T03:16:07.655 INFO:tasks.workunit.client.1.smithi184.stdout:0/979: chown dc/f7b 1925911 1 2023-12-16T03:16:07.655 INFO:tasks.workunit.client.1.smithi184.stdout:0/980: chown dc/d22/d45/d66/c92 15063 1 2023-12-16T03:16:07.655 INFO:tasks.workunit.client.1.smithi184.stdout:0/981: truncate dc/d10/d2d/d5f/fc2 1548649 0 2023-12-16T03:16:07.655 INFO:tasks.workunit.client.1.smithi184.stdout:0/982: chown dc/d10/d2d/c61 3442 1 2023-12-16T03:16:07.655 INFO:tasks.workunit.client.1.smithi184.stdout:0/983: stat dc/d10/d2d/d5f/ff8 0 2023-12-16T03:16:07.655 INFO:tasks.workunit.client.1.smithi184.stdout:0/984: write dc/d10/d2d/f103 [405553,56411] 0 2023-12-16T03:16:07.655 INFO:tasks.workunit.client.1.smithi184.stdout:0/985: read - dc/d22/d1d/d8e/f120 zero size 2023-12-16T03:16:07.656 INFO:tasks.workunit.client.1.smithi184.stdout:5/725: mknod d1/d2a/cf1 0 2023-12-16T03:16:07.656 INFO:tasks.workunit.client.1.smithi184.stdout:4/884: write d1/d11/fdc [2457784,97619] 0 2023-12-16T03:16:07.656 INFO:tasks.workunit.client.1.smithi184.stdout:0/986: write dc/d22/d1d/d35/dc3/d7f/d119/f11a [2928476,24467] 0 2023-12-16T03:16:07.657 INFO:tasks.workunit.client.1.smithi184.stdout:2/807: dwrite d3/d29/d2f/d2e/dcb/f10b [0,4194304] 0 2023-12-16T03:16:07.657 INFO:tasks.workunit.client.1.smithi184.stdout:5/726: creat d1/d2a/d31/d58/daf/ff2 x:0 0 0 2023-12-16T03:16:07.657 INFO:tasks.workunit.client.1.smithi184.stdout:5/727: stat d1/d3/d9/de/d15/d19/d3a/f4b 0 2023-12-16T03:16:07.657 INFO:tasks.workunit.client.1.smithi184.stdout:5/728: chown d1/d2a/d31/d28/d72/lb6 31177 1 2023-12-16T03:16:07.658 INFO:tasks.workunit.client.0.smithi064.stdout:0/551: write d2/d8/da/df/f41 [1816511,86063] 0 2023-12-16T03:16:07.658 INFO:tasks.workunit.client.0.smithi064.stdout:0/552: stat d2/f8d 0 2023-12-16T03:16:07.659 INFO:tasks.workunit.client.0.smithi064.stdout:0/553: read d2/d7/d10/d21/d31/f87 [194646,21465] 0 2023-12-16T03:16:07.659 INFO:tasks.workunit.client.0.smithi064.stdout:0/554: write d2/d7/d6b/f6e [625263,94724] 0 2023-12-16T03:16:07.661 INFO:tasks.workunit.client.1.smithi184.stdout:0/987: symlink dc/d22/d138/l14a 0 2023-12-16T03:16:07.662 INFO:tasks.workunit.client.0.smithi064.stdout:9/569: dread d2/dc/d24/d39/d42/d94/fb3 [0,4194304] 0 2023-12-16T03:16:07.664 INFO:tasks.workunit.client.0.smithi064.stdout:0/555: truncate d2/d8/da/df/f72 71771 0 2023-12-16T03:16:07.666 INFO:tasks.workunit.client.1.smithi184.stdout:2/808: rmdir d3/d29/d61/d6d/dd6 39 2023-12-16T03:16:07.666 INFO:tasks.workunit.client.1.smithi184.stdout:2/809: write d3/d13/feb [799658,128983] 0 2023-12-16T03:16:07.666 INFO:tasks.workunit.client.0.smithi064.stdout:1/611: write d3/dd/d11/d2f/f5f [441012,88077] 0 2023-12-16T03:16:07.668 INFO:tasks.workunit.client.1.smithi184.stdout:5/729: mknod d1/d3/d9/de/d30/cf3 0 2023-12-16T03:16:07.672 INFO:tasks.workunit.client.0.smithi064.stdout:0/556: mkdir d2/d29/db1 0 2023-12-16T03:16:07.674 INFO:tasks.workunit.client.0.smithi064.stdout:1/612: getdents d3/d36/d44/d4d/da8 0 2023-12-16T03:16:07.674 INFO:tasks.workunit.client.0.smithi064.stdout:1/613: stat d3/d36/d9e/l71 0 2023-12-16T03:16:07.674 INFO:tasks.workunit.client.1.smithi184.stdout:0/988: symlink dc/d22/d1d/d35/dd8/l14b 0 2023-12-16T03:16:07.674 INFO:tasks.workunit.client.1.smithi184.stdout:0/989: read - dc/d22/d45/d66/d80/f13f zero size 2023-12-16T03:16:07.675 INFO:tasks.workunit.client.1.smithi184.stdout:6/996: sync 2023-12-16T03:16:07.675 INFO:tasks.workunit.client.1.smithi184.stdout:6/997: dread - d0/d5/d22/d25/d3f/d6f/da8/f139 zero size 2023-12-16T03:16:07.675 INFO:tasks.workunit.client.1.smithi184.stdout:7/888: dwrite d0/d3/d2e/d79/d36/d3f/f4f [0,4194304] 0 2023-12-16T03:16:07.675 INFO:tasks.workunit.client.1.smithi184.stdout:7/889: fsync d0/d3/d2e/d79/d36/d3f/f83 0 2023-12-16T03:16:07.676 INFO:tasks.workunit.client.1.smithi184.stdout:2/810: creat d3/d13/ddf/d10a/f10c x:0 0 0 2023-12-16T03:16:07.678 INFO:tasks.workunit.client.0.smithi064.stdout:0/557: mkdir d2/d29/db1/db2 0 2023-12-16T03:16:07.678 INFO:tasks.workunit.client.0.smithi064.stdout:0/558: write d2/d8/da/d11/f56 [992270,7682] 0 2023-12-16T03:16:07.680 INFO:tasks.workunit.client.1.smithi184.stdout:4/885: dwrite d1/d29/d34/d5c/d76/d3b/f53 [0,4194304] 0 2023-12-16T03:16:07.680 INFO:tasks.workunit.client.1.smithi184.stdout:4/886: chown d1/d29/d34/d5c/d76 1753162898 1 2023-12-16T03:16:07.680 INFO:tasks.workunit.client.1.smithi184.stdout:5/730: truncate d1/d3/d9/de/d15/d19/f2c 3983726 0 2023-12-16T03:16:07.681 INFO:tasks.workunit.client.0.smithi064.stdout:1/614: mkdir d3/dd/d23/d4f/daf/dca 0 2023-12-16T03:16:07.682 INFO:tasks.workunit.client.0.smithi064.stdout:0/559: dread d2/d29/f2f [0,4194304] 0 2023-12-16T03:16:07.682 INFO:tasks.workunit.client.0.smithi064.stdout:0/560: stat d2/d7/d10/d21/d7a/f9d 0 2023-12-16T03:16:07.682 INFO:tasks.workunit.client.0.smithi064.stdout:0/561: stat d2/d7/d10/d85/d88/d92 0 2023-12-16T03:16:07.682 INFO:tasks.workunit.client.1.smithi184.stdout:2/811: dread d3/d13/d28/f69 [0,4194304] 0 2023-12-16T03:16:07.685 INFO:tasks.workunit.client.0.smithi064.stdout:9/570: dwrite d2/dc/d24/d39/d5e/f8f [0,4194304] 0 2023-12-16T03:16:07.686 INFO:tasks.workunit.client.1.smithi184.stdout:0/990: unlink dc/d22/d53/ded/d132/f142 0 2023-12-16T03:16:07.687 INFO:tasks.workunit.client.1.smithi184.stdout:0/991: chown dc/d22/d45/d66/f72 86 1 2023-12-16T03:16:07.688 INFO:tasks.workunit.client.0.smithi064.stdout:1/615: rename d3/d36/d97 to d3/dd/d23/dcb 0 2023-12-16T03:16:07.691 INFO:tasks.workunit.client.0.smithi064.stdout:0/562: symlink d2/d7/d10/d21/d7a/lb3 0 2023-12-16T03:16:07.692 INFO:tasks.workunit.client.1.smithi184.stdout:7/890: creat d0/d3/d2e/d79/d36/d3f/f115 x:0 0 0 2023-12-16T03:16:07.697 INFO:tasks.workunit.client.0.smithi064.stdout:9/571: link d2/dc/c19 d2/dc/d24/cb7 0 2023-12-16T03:16:07.697 INFO:tasks.workunit.client.0.smithi064.stdout:9/572: write d2/d2d/d3b/f49 [253246,25743] 0 2023-12-16T03:16:07.700 INFO:tasks.workunit.client.0.smithi064.stdout:1/616: getdents d3/dd/d11/d6a 0 2023-12-16T03:16:07.703 INFO:tasks.workunit.client.0.smithi064.stdout:9/573: symlink d2/d2d/d6c/da4/lb8 0 2023-12-16T03:16:07.703 INFO:tasks.workunit.client.0.smithi064.stdout:9/574: dread - d2/d2d/d6c/d83/faa zero size 2023-12-16T03:16:07.704 INFO:tasks.workunit.client.0.smithi064.stdout:1/617: truncate d3/dd/d11/f34 1504890 0 2023-12-16T03:16:07.705 INFO:tasks.workunit.client.1.smithi184.stdout:5/731: symlink d1/d2a/lf4 0 2023-12-16T03:16:07.705 INFO:tasks.workunit.client.1.smithi184.stdout:0/992: dread dc/d22/d1d/d8e/ff4 [0,4194304] 0 2023-12-16T03:16:07.705 INFO:tasks.workunit.client.1.smithi184.stdout:7/891: dread d0/d3/d2e/d79/d36/d3f/fcf [0,4194304] 0 2023-12-16T03:16:07.707 INFO:tasks.workunit.client.1.smithi184.stdout:7/892: write d0/d3/d2e/d79/d36/f66 [275228,84302] 0 2023-12-16T03:16:07.707 INFO:tasks.workunit.client.0.smithi064.stdout:0/563: link d2/d7/d10/f14 d2/d8/da/df/fb4 0 2023-12-16T03:16:07.709 INFO:tasks.workunit.client.0.smithi064.stdout:9/575: mkdir d2/dc/d24/d39/d77/d7d/db9 0 2023-12-16T03:16:07.710 INFO:tasks.workunit.client.0.smithi064.stdout:1/618: mkdir d3/d36/d44/d4d/dcc 0 2023-12-16T03:16:07.711 INFO:tasks.workunit.client.0.smithi064.stdout:1/619: chown d3/d36/d9e/f4b 481001 1 2023-12-16T03:16:07.711 INFO:tasks.workunit.client.0.smithi064.stdout:0/564: unlink d2/d7/d6b/l96 0 2023-12-16T03:16:07.712 INFO:tasks.workunit.client.0.smithi064.stdout:0/565: mkdir d2/d29/d66/d67/db5 0 2023-12-16T03:16:07.714 INFO:tasks.workunit.client.0.smithi064.stdout:3/695: sync 2023-12-16T03:16:07.714 INFO:tasks.workunit.client.0.smithi064.stdout:3/696: readlink db/d12/d1a/d2c/d34/d4c/l52 0 2023-12-16T03:16:07.717 INFO:tasks.workunit.client.0.smithi064.stdout:3/697: write db/d12/d1a/d2c/d34/d4c/d6a/da7/f25 [5091084,44055] 0 2023-12-16T03:16:07.719 INFO:tasks.workunit.client.0.smithi064.stdout:9/576: write d2/dc/d24/d39/d77/d7d/fad [1563551,22160] 0 2023-12-16T03:16:07.719 INFO:tasks.workunit.client.0.smithi064.stdout:9/577: chown d2/c69 456533 1 2023-12-16T03:16:07.722 INFO:tasks.workunit.client.0.smithi064.stdout:1/620: dread d3/dd/d23/d60/f8b [0,4194304] 0 2023-12-16T03:16:07.722 INFO:tasks.workunit.client.0.smithi064.stdout:1/621: readlink d3/d36/d9e/la2 0 2023-12-16T03:16:07.722 INFO:tasks.workunit.client.0.smithi064.stdout:1/622: write d3/dd/f59 [683798,66884] 0 2023-12-16T03:16:07.722 INFO:tasks.workunit.client.0.smithi064.stdout:1/623: write d3/d36/d44/d4d/d58/d96/f99 [4900229,86632] 0 2023-12-16T03:16:07.723 INFO:tasks.workunit.client.0.smithi064.stdout:9/578: creat d2/d2d/d3b/d3c/fba x:0 0 0 2023-12-16T03:16:07.728 INFO:tasks.workunit.client.1.smithi184.stdout:7/893: dread d0/f77 [0,4194304] 0 2023-12-16T03:16:07.729 INFO:tasks.workunit.client.0.smithi064.stdout:1/624: write d3/f9c [1934177,57621] 0 2023-12-16T03:16:07.729 INFO:tasks.workunit.client.1.smithi184.stdout:6/998: dwrite d0/d5/d12/d1b/f130 [0,4194304] 0 2023-12-16T03:16:07.730 INFO:tasks.workunit.client.0.smithi064.stdout:1/625: creat d3/d36/d44/d4d/dcc/fcd x:0 0 0 2023-12-16T03:16:07.733 INFO:tasks.workunit.client.1.smithi184.stdout:4/887: dwrite d1/d11/d5a/f60 [0,4194304] 0 2023-12-16T03:16:07.733 INFO:tasks.workunit.client.0.smithi064.stdout:1/626: mkdir d3/d36/d44/d4d/da8/dce 0 2023-12-16T03:16:07.737 INFO:tasks.workunit.client.1.smithi184.stdout:6/999: truncate d0/d5/d22/d25/d3f/f78 5034809 0 2023-12-16T03:16:07.749 INFO:tasks.workunit.client.1.smithi184.stdout:5/732: dwrite d1/d3/d9/de/d15/d19/d48/fa1 [0,4194304] 0 2023-12-16T03:16:07.750 INFO:tasks.workunit.client.1.smithi184.stdout:4/888: dread d1/d11/d1b/d1e/f5d [0,4194304] 0 2023-12-16T03:16:07.753 INFO:tasks.workunit.client.1.smithi184.stdout:4/889: link d1/d29/d34/l91 d1/d11/d5a/d63/d103/d5e/d6a/l130 0 2023-12-16T03:16:07.755 INFO:tasks.workunit.client.1.smithi184.stdout:4/890: truncate d1/d12/db3/db8/dd0/ff9 7319500 0 2023-12-16T03:16:07.758 INFO:tasks.workunit.client.1.smithi184.stdout:4/891: link d1/d29/d34/d5c/d76/f69 d1/d12/f131 0 2023-12-16T03:16:07.758 INFO:tasks.workunit.client.1.smithi184.stdout:2/812: dwrite d3/d9/d19/f37 [4194304,4194304] 0 2023-12-16T03:16:07.760 INFO:tasks.workunit.client.1.smithi184.stdout:4/892: symlink d1/d11/d5a/d63/l132 0 2023-12-16T03:16:07.767 INFO:tasks.workunit.client.1.smithi184.stdout:5/733: dread d1/d3/fa [0,4194304] 0 2023-12-16T03:16:07.767 INFO:tasks.workunit.client.1.smithi184.stdout:2/813: creat d3/ddb/f10d x:0 0 0 2023-12-16T03:16:07.767 INFO:tasks.workunit.client.1.smithi184.stdout:2/814: chown d3/d13/d28/dac/fb1 0 1 2023-12-16T03:16:07.769 INFO:tasks.workunit.client.1.smithi184.stdout:5/734: getdents d1 0 2023-12-16T03:16:07.769 INFO:tasks.workunit.client.1.smithi184.stdout:5/735: fsync d1/f7e 0 2023-12-16T03:16:07.769 INFO:tasks.workunit.client.1.smithi184.stdout:5/736: fdatasync d1/d3/d9/d2e/f67 0 2023-12-16T03:16:07.769 INFO:tasks.workunit.client.1.smithi184.stdout:5/737: fsync d1/d3/d9/de/d15/d19/d3a/f4b 0 2023-12-16T03:16:07.771 INFO:tasks.workunit.client.1.smithi184.stdout:2/815: mkdir d3/d13/d10e 0 2023-12-16T03:16:07.773 INFO:tasks.workunit.client.0.smithi064.stdout:0/566: dwrite d2/d8/da/df/f37 [4194304,4194304] 0 2023-12-16T03:16:07.774 INFO:tasks.workunit.client.1.smithi184.stdout:0/993: dwrite dc/d22/d45/d66/d80/da3/dcb/fd6 [0,4194304] 0 2023-12-16T03:16:07.774 INFO:tasks.workunit.client.1.smithi184.stdout:5/738: rename d1/d3/d9/d49/d74/fe4 to d1/d3/ff5 0 2023-12-16T03:16:07.774 INFO:tasks.workunit.client.1.smithi184.stdout:2/816: symlink d3/d13/d28/d83/dda/l10f 0 2023-12-16T03:16:07.777 INFO:tasks.workunit.client.0.smithi064.stdout:0/567: dread d2/d7/d10/f52 [0,4194304] 0 2023-12-16T03:16:07.777 INFO:tasks.workunit.client.0.smithi064.stdout:0/568: stat d2/d8/da/d11/d64/c8a 0 2023-12-16T03:16:07.777 INFO:tasks.workunit.client.0.smithi064.stdout:0/569: chown d2/d7/d10/d21/d7a/f9d 291 1 2023-12-16T03:16:07.777 INFO:tasks.workunit.client.0.smithi064.stdout:0/570: dread - d2/d29/d66/d67/f68 zero size 2023-12-16T03:16:07.779 INFO:tasks.workunit.client.0.smithi064.stdout:3/698: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f78 [0,4194304] 0 2023-12-16T03:16:07.780 INFO:tasks.workunit.client.1.smithi184.stdout:5/739: write d1/d3/fb2 [3074743,130613] 0 2023-12-16T03:16:07.785 INFO:tasks.workunit.client.1.smithi184.stdout:7/894: dwrite d0/d3/d2e/d79/d32/d39/f73 [0,4194304] 0 2023-12-16T03:16:07.786 INFO:tasks.workunit.client.0.smithi064.stdout:1/627: dwrite d3/dd/d11/d3b/f5e [0,4194304] 0 2023-12-16T03:16:07.786 INFO:tasks.workunit.client.0.smithi064.stdout:1/628: write d3/dd/f1a [1657099,22013] 0 2023-12-16T03:16:07.786 INFO:tasks.workunit.client.0.smithi064.stdout:1/629: chown d3/dd/c14 401151 1 2023-12-16T03:16:07.786 INFO:tasks.workunit.client.1.smithi184.stdout:4/893: dwrite d1/d29/d34/d5c/d76/f32 [4194304,4194304] 0 2023-12-16T03:16:07.787 INFO:tasks.workunit.client.1.smithi184.stdout:4/894: chown d1/d11/d1b/f87 286 1 2023-12-16T03:16:07.787 INFO:tasks.workunit.client.1.smithi184.stdout:4/895: truncate d1/d12/d13/da1/fb6 609502 0 2023-12-16T03:16:07.801 INFO:tasks.workunit.client.0.smithi064.stdout:3/699: dread db/d12/d1a/d2c/d34/d4c/d6a/f81 [0,4194304] 0 2023-12-16T03:16:07.801 INFO:tasks.workunit.client.1.smithi184.stdout:2/817: creat d3/d29/d8a/f110 x:0 0 0 2023-12-16T03:16:07.802 INFO:tasks.workunit.client.1.smithi184.stdout:2/818: chown d3/cdc 190566278 1 2023-12-16T03:16:07.809 INFO:tasks.workunit.client.1.smithi184.stdout:5/740: rename d1/d3/d9/de/d15/d19/d48/f85 to d1/d3/d9/de/d15/d19/d5f/ff6 0 2023-12-16T03:16:07.809 INFO:tasks.workunit.client.1.smithi184.stdout:5/741: fsync d1/d3/d2f/f3d 0 2023-12-16T03:16:07.809 INFO:tasks.workunit.client.1.smithi184.stdout:5/742: dread - d1/d3/d9/de/d15/db9/fbd zero size 2023-12-16T03:16:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: pgmap v198: 65 pgs: 65 active+clean; 2.6 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 149 MiB/s rd, 319 MiB/s wr, 482 op/s 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: Standby manager daemon smithi184.urtxla restarted 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:07.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr fail", "who": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: osdmap e44: 6 total, 6 up, 6 in 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14208 172.21.15.64:0/2039341651' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "mgr fail", "who": "smithi064.ueciyw"}]': finished 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: mgrmap e20: smithi184.urtxla(active, starting, since 0.00680969s) 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.jaepzs"}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.edrjyd"}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.jfpiqk"}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.uqpwjn"}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mgr metadata", "who": "smithi184.urtxla", "id": "smithi184.urtxla"}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:16:07.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: Manager daemon smithi184.urtxla is now available 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi184.urtxla/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:16:07.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:07 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi184.urtxla/trash_purge_schedule"}]: dispatch 2023-12-16T03:16:07.814 INFO:tasks.workunit.client.0.smithi064.stdout:1/630: dwrite d3/d22/f68 [0,4194304] 0 2023-12-16T03:16:07.815 INFO:tasks.workunit.client.1.smithi184.stdout:4/896: mknod d1/d11/c133 0 2023-12-16T03:16:07.815 INFO:tasks.workunit.client.1.smithi184.stdout:5/743: dread d1/d2a/fac [0,4194304] 0 2023-12-16T03:16:07.815 INFO:tasks.workunit.client.1.smithi184.stdout:5/744: write d1/d2a/d31/d28/f65 [691203,115419] 0 2023-12-16T03:16:07.815 INFO:tasks.workunit.client.1.smithi184.stdout:5/745: truncate d1/d3/d9/de/d15/db9/fdb 532694 0 2023-12-16T03:16:07.815 INFO:tasks.workunit.client.1.smithi184.stdout:4/897: read d1/d29/d34/d5c/d76/d33/f81 [619076,21832] 0 2023-12-16T03:16:07.816 INFO:tasks.workunit.client.1.smithi184.stdout:2/819: mknod d3/d29/d2f/d46/dfd/c111 0 2023-12-16T03:16:07.818 INFO:tasks.workunit.client.1.smithi184.stdout:0/994: dwrite dc/d22/d1a/f6f [0,4194304] 0 2023-12-16T03:16:07.820 INFO:tasks.workunit.client.1.smithi184.stdout:0/995: write dc/d22/d1d/d35/f38 [272389,67612] 0 2023-12-16T03:16:07.823 INFO:tasks.workunit.client.0.smithi064.stdout:0/571: creat d2/d8/da/fb6 x:0 0 0 2023-12-16T03:16:07.829 INFO:tasks.workunit.client.1.smithi184.stdout:7/895: rename d0/d6b/l58 to d0/d3/d2e/d79/d36/d3f/df9/l116 0 2023-12-16T03:16:07.830 INFO:tasks.workunit.client.1.smithi184.stdout:5/746: link d1/d3/d9/de/d15/d27/f81 d1/d3/d9/de/d15/db9/ff7 0 2023-12-16T03:16:07.830 INFO:tasks.workunit.client.1.smithi184.stdout:4/898: unlink d1/d11/d5a/d63/d103/d5e/lc0 0 2023-12-16T03:16:07.830 INFO:tasks.workunit.client.1.smithi184.stdout:5/747: chown d1/d2a/d31/l2b 2777 1 2023-12-16T03:16:07.830 INFO:tasks.workunit.client.1.smithi184.stdout:4/899: fsync d1/d12/db3/db8/dd2/fe9 0 2023-12-16T03:16:07.831 INFO:tasks.workunit.client.1.smithi184.stdout:2/820: symlink d3/d13/ddf/l112 0 2023-12-16T03:16:07.831 INFO:tasks.workunit.client.1.smithi184.stdout:2/821: fsync d3/d29/d61/f88 0 2023-12-16T03:16:07.834 INFO:tasks.workunit.client.0.smithi064.stdout:1/631: symlink d3/d36/d44/lcf 0 2023-12-16T03:16:07.835 INFO:tasks.workunit.client.1.smithi184.stdout:5/748: read d1/d3/d9/de/d15/d19/d53/f8c [3340935,78406] 0 2023-12-16T03:16:07.835 INFO:tasks.workunit.client.1.smithi184.stdout:5/749: write d1/d3/d9/de/d30/fab [1033232,37103] 0 2023-12-16T03:16:07.843 INFO:tasks.workunit.client.0.smithi064.stdout:0/572: creat d2/d7/d10/d85/d88/d92/fb7 x:0 0 0 2023-12-16T03:16:07.846 INFO:tasks.workunit.client.0.smithi064.stdout:3/700: rename db/d12/d1a/f26 to db/d12/d4e/fea 0 2023-12-16T03:16:07.849 INFO:tasks.workunit.client.1.smithi184.stdout:7/896: dwrite d0/d3/d2e/d79/d32/d39/fe8 [0,4194304] 0 2023-12-16T03:16:07.849 INFO:tasks.workunit.client.1.smithi184.stdout:0/996: mkdir dc/d22/d1d/d8e/d133/d14c 0 2023-12-16T03:16:07.850 INFO:tasks.workunit.client.0.smithi064.stdout:0/573: symlink d2/d29/d66/d67/db5/lb8 0 2023-12-16T03:16:07.853 INFO:tasks.workunit.client.0.smithi064.stdout:1/632: rename d3/dd/fb9 to d3/d36/d44/d4d/dad/dc5/fd0 0 2023-12-16T03:16:07.853 INFO:tasks.workunit.client.0.smithi064.stdout:1/633: chown d3/d36/d9e/f4b 0 1 2023-12-16T03:16:07.854 INFO:tasks.workunit.client.1.smithi184.stdout:4/900: getdents d1/d29/d34/d5c/d76/d33 0 2023-12-16T03:16:07.855 INFO:tasks.workunit.client.1.smithi184.stdout:2/822: truncate d3/d9/f3b 172385 0 2023-12-16T03:16:07.857 INFO:tasks.workunit.client.0.smithi064.stdout:0/574: mkdir d2/d29/d66/db9 0 2023-12-16T03:16:07.858 INFO:tasks.workunit.client.0.smithi064.stdout:3/701: dread db/d12/f3b [0,4194304] 0 2023-12-16T03:16:07.858 INFO:tasks.workunit.client.0.smithi064.stdout:1/634: symlink d3/dd/d23/d60/ld1 0 2023-12-16T03:16:07.860 INFO:tasks.workunit.client.1.smithi184.stdout:5/750: rename d1/d3/d9/l5e to d1/d3/d9/d49/d74/lf8 0 2023-12-16T03:16:07.863 INFO:tasks.workunit.client.0.smithi064.stdout:0/575: rename d2/d7/d10/c38 to d2/d7/d6b/cba 0 2023-12-16T03:16:07.863 INFO:tasks.workunit.client.0.smithi064.stdout:0/576: chown d2/d29/db1/db2 650427769 1 2023-12-16T03:16:07.864 INFO:tasks.workunit.client.1.smithi184.stdout:7/897: stat d0/d3/d2e/d79/dd/d27 0 2023-12-16T03:16:07.864 INFO:tasks.workunit.client.1.smithi184.stdout:7/898: chown d0/d3/d2e/d79/d32/l4b 79784 1 2023-12-16T03:16:07.865 INFO:tasks.workunit.client.1.smithi184.stdout:7/899: dread - d0/d3/d2e/d79/d36/d3f/df9/ffe zero size 2023-12-16T03:16:07.865 INFO:tasks.workunit.client.1.smithi184.stdout:7/900: stat d0/d3/d2e/d79/dd/f46 0 2023-12-16T03:16:07.868 INFO:tasks.workunit.client.1.smithi184.stdout:0/997: mkdir dc/d22/d1d/d8e/d118/d136/d14d 0 2023-12-16T03:16:07.868 INFO:tasks.workunit.client.1.smithi184.stdout:0/998: truncate dc/d22/d53/f12d 129054 0 2023-12-16T03:16:07.869 INFO:tasks.workunit.client.0.smithi064.stdout:0/577: rmdir d2/d7/d10/d21/d7a 39 2023-12-16T03:16:07.871 INFO:tasks.workunit.client.1.smithi184.stdout:4/901: creat d1/d29/d34/d5c/f134 x:0 0 0 2023-12-16T03:16:07.872 INFO:tasks.workunit.client.1.smithi184.stdout:0/999: write dc/d10/d2d/f41 [2441580,111239] 0 2023-12-16T03:16:07.875 INFO:tasks.workunit.client.1.smithi184.stdout:7/901: rename d0/d3/d2e/d79/d36/d3f/f92 to d0/d3/d2e/d79/d32/d39/d9c/f117 0 2023-12-16T03:16:07.875 INFO:tasks.workunit.client.1.smithi184.stdout:7/902: write d0/d3/d2e/d79/d36/d3f/f83 [222881,89162] 0 2023-12-16T03:16:07.877 INFO:tasks.workunit.client.0.smithi064.stdout:0/578: symlink d2/d8/da/df/lbb 0 2023-12-16T03:16:07.877 INFO:tasks.workunit.client.0.smithi064.stdout:0/579: write d2/f7c [9365642,70482] 0 2023-12-16T03:16:07.879 INFO:tasks.workunit.client.1.smithi184.stdout:4/902: creat d1/d11/d5a/d63/d103/d45/dcf/dea/f135 x:0 0 0 2023-12-16T03:16:07.880 INFO:tasks.workunit.client.0.smithi064.stdout:0/580: mkdir d2/d8/da/dbc 0 2023-12-16T03:16:07.881 INFO:tasks.workunit.client.0.smithi064.stdout:0/581: chown d2/d7/f23 109 1 2023-12-16T03:16:07.881 INFO:tasks.workunit.client.0.smithi064.stdout:0/582: dread - d2/d7/f63 zero size 2023-12-16T03:16:07.881 INFO:tasks.workunit.client.1.smithi184.stdout:7/903: dread d0/d3/d2e/d79/d36/f66 [0,4194304] 0 2023-12-16T03:16:07.884 INFO:tasks.workunit.client.1.smithi184.stdout:4/903: rename d1/d29/d34/d5c/d76/d33/d4a/l50 to d1/d11/d5a/d63/d103/l136 0 2023-12-16T03:16:07.886 INFO:tasks.workunit.client.0.smithi064.stdout:0/583: getdents d2/d8/da/d11 0 2023-12-16T03:16:07.890 INFO:tasks.workunit.client.1.smithi184.stdout:7/904: unlink d0/d3/f64 0 2023-12-16T03:16:07.890 INFO:tasks.workunit.client.1.smithi184.stdout:2/823: dwrite d3/d13/d6e/fd5 [0,4194304] 0 2023-12-16T03:16:07.891 INFO:tasks.workunit.client.0.smithi064.stdout:0/584: unlink d2/d29/l90 0 2023-12-16T03:16:07.892 INFO:tasks.workunit.client.0.smithi064.stdout:3/702: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/dc9/fdb [4194304,4194304] 0 2023-12-16T03:16:07.892 INFO:tasks.workunit.client.0.smithi064.stdout:3/703: readlink db/d12/d1a/d2c/d34/d4c/de5/le6 0 2023-12-16T03:16:07.893 INFO:tasks.workunit.client.1.smithi184.stdout:7/905: readlink d0/d3/d2e/d79/d34/dc1/d107/lc3 0 2023-12-16T03:16:07.895 INFO:tasks.workunit.client.0.smithi064.stdout:0/585: mkdir d2/d8/da/df/daf/dbd 0 2023-12-16T03:16:07.896 INFO:tasks.workunit.client.0.smithi064.stdout:3/704: dread db/d12/d1a/d2c/d34/f8b [0,4194304] 0 2023-12-16T03:16:07.898 INFO:tasks.workunit.client.1.smithi184.stdout:8/951: sync 2023-12-16T03:16:07.898 INFO:tasks.workunit.client.1.smithi184.stdout:1/882: sync 2023-12-16T03:16:07.899 INFO:tasks.workunit.client.0.smithi064.stdout:0/586: mknod d2/d7/d10/d85/d88/da0/cbe 0 2023-12-16T03:16:07.899 INFO:tasks.workunit.client.1.smithi184.stdout:7/906: rmdir d0/d3/d2e/d79/dd/d27 39 2023-12-16T03:16:07.901 INFO:tasks.workunit.client.0.smithi064.stdout:3/705: creat db/d4f/d51/dd1/dde/feb x:0 0 0 2023-12-16T03:16:07.902 INFO:tasks.workunit.client.0.smithi064.stdout:0/587: creat d2/d29/d66/db9/fbf x:0 0 0 2023-12-16T03:16:07.902 INFO:tasks.workunit.client.0.smithi064.stdout:0/588: chown d2/d7/d10/f14 40087145 1 2023-12-16T03:16:07.902 INFO:tasks.workunit.client.0.smithi064.stdout:0/589: write d2/d29/f2f [957753,94351] 0 2023-12-16T03:16:07.903 INFO:tasks.workunit.client.1.smithi184.stdout:1/883: getdents d3/d34/dbc/d3c/d24/d8e 0 2023-12-16T03:16:07.905 INFO:tasks.workunit.client.1.smithi184.stdout:8/952: creat d2/d12/db4/d134/f136 x:0 0 0 2023-12-16T03:16:07.906 INFO:tasks.workunit.client.0.smithi064.stdout:3/706: mknod db/d12/d1a/d2c/d34/dcd/cec 0 2023-12-16T03:16:07.906 INFO:tasks.workunit.client.0.smithi064.stdout:3/707: write db/d12/d1a/d2c/f5b [1951553,120020] 0 2023-12-16T03:16:07.906 INFO:tasks.workunit.client.1.smithi184.stdout:7/907: mknod d0/d3/d2e/d79/d36/d84/dd2/c118 0 2023-12-16T03:16:07.907 INFO:tasks.workunit.client.0.smithi064.stdout:1/635: rmdir d3/d36/d44/d4d/dad/dc5 39 2023-12-16T03:16:07.908 INFO:tasks.workunit.client.1.smithi184.stdout:4/904: dwrite d1/d29/d34/f11c [0,4194304] 0 2023-12-16T03:16:07.909 INFO:tasks.workunit.client.0.smithi064.stdout:0/590: creat d2/d7/d10/d21/fc0 x:0 0 0 2023-12-16T03:16:07.909 INFO:tasks.workunit.client.0.smithi064.stdout:0/591: readlink d2/l6c 0 2023-12-16T03:16:07.920 INFO:tasks.workunit.client.0.smithi064.stdout:1/636: rmdir d3/dd/d11/d3b/daa 0 2023-12-16T03:16:07.922 INFO:tasks.workunit.client.1.smithi184.stdout:7/908: mkdir d0/d3/d2e/d79/d32/d39/d8f/dab/d119 0 2023-12-16T03:16:07.925 INFO:tasks.workunit.client.1.smithi184.stdout:4/905: mkdir d1/d29/d34/d5c/d76/d3b/d137 0 2023-12-16T03:16:07.926 INFO:tasks.workunit.client.0.smithi064.stdout:1/637: read d3/d36/d44/d4d/f4e [3561883,73686] 0 2023-12-16T03:16:07.928 INFO:tasks.workunit.client.1.smithi184.stdout:4/906: symlink d1/d29/d34/d5c/d76/d33/d126/l138 0 2023-12-16T03:16:07.931 INFO:tasks.workunit.client.1.smithi184.stdout:4/907: creat d1/d11/d1b/d1e/f139 x:0 0 0 2023-12-16T03:16:07.937 INFO:tasks.workunit.client.0.smithi064.stdout:1/638: write d3/d36/d44/d4d/f4e [1343835,5709] 0 2023-12-16T03:16:07.937 INFO:tasks.workunit.client.0.smithi064.stdout:1/639: chown d3/dd/d23/d60/f8b 24146391 1 2023-12-16T03:16:07.937 INFO:tasks.workunit.client.1.smithi184.stdout:4/908: dread d1/d12/db3/db8/dd2/fee [0,4194304] 0 2023-12-16T03:16:07.938 INFO:tasks.workunit.client.1.smithi184.stdout:4/909: creat d1/d11/d1b/d1e/d128/f13a x:0 0 0 2023-12-16T03:16:07.955 INFO:tasks.workunit.client.0.smithi064.stdout:1/640: dread d3/dd/d11/f80 [0,4194304] 0 2023-12-16T03:16:07.955 INFO:tasks.workunit.client.0.smithi064.stdout:1/641: dread - d3/d36/d44/d4d/d58/fa7 zero size 2023-12-16T03:16:07.955 INFO:tasks.workunit.client.0.smithi064.stdout:1/642: truncate d3/dd/f1a 5569669 0 2023-12-16T03:16:07.956 INFO:tasks.workunit.client.0.smithi064.stdout:1/643: symlink d3/dd/d11/d38/ld2 0 2023-12-16T03:16:07.956 INFO:tasks.workunit.client.0.smithi064.stdout:1/644: fsync d3/d36/f83 0 2023-12-16T03:16:07.956 INFO:tasks.workunit.client.0.smithi064.stdout:1/645: getdents d3/d22 0 2023-12-16T03:16:07.957 INFO:tasks.workunit.client.0.smithi064.stdout:1/646: dread - d3/d22/d57/db1/fc1 zero size 2023-12-16T03:16:07.957 INFO:tasks.workunit.client.0.smithi064.stdout:1/647: fdatasync d3/d36/d44/d4d/fc6 0 2023-12-16T03:16:07.957 INFO:tasks.workunit.client.0.smithi064.stdout:1/648: dread - d3/dd/d11/d6a/f7a zero size 2023-12-16T03:16:07.957 INFO:tasks.workunit.client.0.smithi064.stdout:1/649: fdatasync d3/f7b 0 2023-12-16T03:16:07.962 INFO:tasks.workunit.client.0.smithi064.stdout:3/708: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/fa1 [0,4194304] 0 2023-12-16T03:16:07.963 INFO:tasks.workunit.client.0.smithi064.stdout:0/592: dwrite d2/d7/d10/d21/d31/f35 [0,4194304] 0 2023-12-16T03:16:07.963 INFO:tasks.workunit.client.0.smithi064.stdout:0/593: chown d2/d7/c28 12 1 2023-12-16T03:16:07.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/953: dwrite d2/d4/d10/d99/fbe [0,4194304] 0 2023-12-16T03:16:07.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/954: truncate d2/d12/db4/d134/f136 672160 0 2023-12-16T03:16:07.964 INFO:tasks.workunit.client.0.smithi064.stdout:3/709: dread db/d12/d4e/f73 [0,4194304] 0 2023-12-16T03:16:07.965 INFO:tasks.workunit.client.1.smithi184.stdout:7/909: dwrite d0/d6b/d69/f6e [0,4194304] 0 2023-12-16T03:16:07.971 INFO:tasks.workunit.client.1.smithi184.stdout:8/955: unlink d2/d12/d21/d8a/dcd/c132 0 2023-12-16T03:16:07.972 INFO:tasks.workunit.client.1.smithi184.stdout:8/956: rename d2/d12/d21 to d2/d12/d21/d2d/d31/d34/d96/d137 22 2023-12-16T03:16:07.975 INFO:tasks.workunit.client.1.smithi184.stdout:7/910: rmdir d0/d3/d2e/d79/d36/d3f/df9 39 2023-12-16T03:16:07.975 INFO:tasks.workunit.client.1.smithi184.stdout:7/911: stat d0/d3/d2e/d79/dd/d27 0 2023-12-16T03:16:07.977 INFO:tasks.workunit.client.0.smithi064.stdout:0/594: rename d2/d8/fa1 to d2/d7/d10/fc1 0 2023-12-16T03:16:07.977 INFO:tasks.workunit.client.0.smithi064.stdout:1/650: dwrite d3/dd/d23/d60/fc2 [0,4194304] 0 2023-12-16T03:16:07.979 INFO:tasks.workunit.client.0.smithi064.stdout:3/710: link db/d12/d1a/d2c/d34/d4c/d6a/f94 db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/dc9/fed 0 2023-12-16T03:16:07.980 INFO:tasks.workunit.client.0.smithi064.stdout:0/595: creat d2/d5b/fc2 x:0 0 0 2023-12-16T03:16:07.980 INFO:tasks.workunit.client.0.smithi064.stdout:0/596: dread - d2/d29/d66/d67/f7b zero size 2023-12-16T03:16:07.980 INFO:tasks.workunit.client.0.smithi064.stdout:0/597: readlink d2/d8/da/df/l18 0 2023-12-16T03:16:07.981 INFO:tasks.workunit.client.0.smithi064.stdout:3/711: dread db/d4f/da9/dbf/d75/f8a [0,4194304] 0 2023-12-16T03:16:07.981 INFO:tasks.workunit.client.0.smithi064.stdout:3/712: fdatasync db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f86 0 2023-12-16T03:16:07.982 INFO:tasks.workunit.client.0.smithi064.stdout:1/651: creat d3/d36/d44/d4d/da8/fd3 x:0 0 0 2023-12-16T03:16:07.982 INFO:tasks.workunit.client.0.smithi064.stdout:1/652: write d3/d36/d44/d4d/dcc/fcd [550215,96942] 0 2023-12-16T03:16:07.984 INFO:tasks.workunit.client.0.smithi064.stdout:0/598: creat d2/d8/da/fc3 x:0 0 0 2023-12-16T03:16:07.984 INFO:tasks.workunit.client.0.smithi064.stdout:0/599: stat d2/d8/f45 0 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:5/513: sync 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:4/598: sync 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:6/541: sync 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:5/514: dread - d0/d7/d34/f7b zero size 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:5/515: dread - d0/d19/d48/f69 zero size 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:2/484: sync 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:5/516: fdatasync d0/d14/d4e/f53 0 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:2/485: chown d1/d15/d7d/l83 12821 1 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:2/486: fdatasync d1/d15/d7d/f6f 0 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:0/600: read d2/d8/f1c [1776010,60373] 0 2023-12-16T03:16:07.986 INFO:tasks.workunit.client.0.smithi064.stdout:0/601: fdatasync d2/f5 0 2023-12-16T03:16:07.987 INFO:tasks.workunit.client.0.smithi064.stdout:3/713: mknod db/d4f/da9/dbf/d75/d92/cee 0 2023-12-16T03:16:07.989 INFO:tasks.workunit.client.0.smithi064.stdout:1/653: creat d3/dd/d23/fd4 x:0 0 0 2023-12-16T03:16:07.989 INFO:tasks.workunit.client.0.smithi064.stdout:1/654: dread - d3/dd/d11/fc9 zero size 2023-12-16T03:16:07.990 INFO:tasks.workunit.client.1.smithi184.stdout:2/824: dwrite d3/d29/d4d/d5b/f89 [0,4194304] 0 2023-12-16T03:16:07.991 INFO:tasks.workunit.client.0.smithi064.stdout:6/542: link d3/d8/d13/d46/f87 d3/d8/d13/fa0 0 2023-12-16T03:16:07.993 INFO:tasks.workunit.client.0.smithi064.stdout:4/599: mkdir d0/d42/d4c/d70/dbe 0 2023-12-16T03:16:07.998 INFO:tasks.workunit.client.0.smithi064.stdout:2/487: creat d1/d15/d23/d2d/f98 x:0 0 0 2023-12-16T03:16:07.998 INFO:tasks.workunit.client.0.smithi064.stdout:2/488: fsync d1/d27/d2e/d68/f3f 0 2023-12-16T03:16:08.000 INFO:tasks.workunit.client.0.smithi064.stdout:0/602: mkdir d2/d7/d10/dc4 0 2023-12-16T03:16:08.000 INFO:tasks.workunit.client.0.smithi064.stdout:0/603: fsync d2/d29/f9f 0 2023-12-16T03:16:08.002 INFO:tasks.workunit.client.1.smithi184.stdout:2/825: creat d3/d9/d19/f113 x:0 0 0 2023-12-16T03:16:08.005 INFO:tasks.workunit.client.0.smithi064.stdout:3/714: link db/d12/d1a/d31/cba db/d4f/d51/cef 0 2023-12-16T03:16:08.007 INFO:tasks.workunit.client.0.smithi064.stdout:1/655: creat d3/d22/fd5 x:0 0 0 2023-12-16T03:16:08.007 INFO:tasks.workunit.client.0.smithi064.stdout:1/656: getdents d3/dd/d23/d4f 0 2023-12-16T03:16:08.011 INFO:tasks.workunit.client.0.smithi064.stdout:4/600: link d0/da/f88 d0/d42/d4c/d70/fbf 0 2023-12-16T03:16:08.013 INFO:tasks.workunit.client.0.smithi064.stdout:0/604: link d2/l6 d2/d29/lc5 0 2023-12-16T03:16:08.014 INFO:tasks.workunit.client.0.smithi064.stdout:3/715: creat db/d4f/d51/dd1/dde/ff0 x:0 0 0 2023-12-16T03:16:08.014 INFO:tasks.workunit.client.0.smithi064.stdout:3/716: readlink db/d12/d4e/l35 0 2023-12-16T03:16:08.015 INFO:tasks.workunit.client.0.smithi064.stdout:1/657: mknod d3/dd/d23/d4f/cd6 0 2023-12-16T03:16:08.015 INFO:tasks.workunit.client.0.smithi064.stdout:1/658: chown d3/c52 9706363 1 2023-12-16T03:16:08.015 INFO:tasks.workunit.client.0.smithi064.stdout:1/659: fdatasync d3/dd/d11/d6a/f75 0 2023-12-16T03:16:08.015 INFO:tasks.workunit.client.0.smithi064.stdout:1/660: read - d3/d36/d44/d4d/dad/dc5/fd0 zero size 2023-12-16T03:16:08.017 INFO:tasks.workunit.client.0.smithi064.stdout:4/601: symlink d0/d1e/lc0 0 2023-12-16T03:16:08.017 INFO:tasks.workunit.client.0.smithi064.stdout:9/579: sync 2023-12-16T03:16:08.017 INFO:tasks.workunit.client.0.smithi064.stdout:8/643: sync 2023-12-16T03:16:08.017 INFO:tasks.workunit.client.0.smithi064.stdout:7/600: sync 2023-12-16T03:16:08.018 INFO:tasks.workunit.client.0.smithi064.stdout:8/644: creat d0/d1d/d73/fdc x:0 0 0 2023-12-16T03:16:08.018 INFO:tasks.workunit.client.0.smithi064.stdout:8/645: chown d0/db/d37/d3a/cca 3 1 2023-12-16T03:16:08.020 INFO:tasks.workunit.client.0.smithi064.stdout:7/601: rename d7/d3e/dac to d7/d26/dc2 0 2023-12-16T03:16:08.023 INFO:tasks.workunit.client.0.smithi064.stdout:7/602: getdents d7/d3e/d42/d48/d51/d7c 0 2023-12-16T03:16:08.026 INFO:tasks.workunit.client.0.smithi064.stdout:8/646: rename d0/db/d12/d1c/d59/d77/fb3 to d0/d1d/d3c/d42/fdd 0 2023-12-16T03:16:08.027 INFO:tasks.workunit.client.0.smithi064.stdout:8/647: chown d0/d1d/fc5 8036 1 2023-12-16T03:16:08.027 INFO:tasks.workunit.client.0.smithi064.stdout:8/648: write d0/db/d12/d1c/f35 [948153,30705] 0 2023-12-16T03:16:08.027 INFO:tasks.workunit.client.0.smithi064.stdout:8/649: chown d0/d1d/d3c/d42/f5d 315129 1 2023-12-16T03:16:08.027 INFO:tasks.workunit.client.0.smithi064.stdout:9/580: rmdir d2/dc/d67 0 2023-12-16T03:16:08.028 INFO:tasks.workunit.client.0.smithi064.stdout:7/603: rmdir d7/d26/d95 39 2023-12-16T03:16:08.030 INFO:tasks.workunit.client.0.smithi064.stdout:9/581: truncate d2/dc/d24/d39/d77/d7d/fad 251480 0 2023-12-16T03:16:08.032 INFO:tasks.workunit.client.0.smithi064.stdout:9/582: truncate d2/d2d/d6c/f95 4264974 0 2023-12-16T03:16:08.032 INFO:tasks.workunit.client.0.smithi064.stdout:7/604: write d7/f14 [1360746,13554] 0 2023-12-16T03:16:08.032 INFO:tasks.workunit.client.0.smithi064.stdout:9/583: symlink d2/d2d/d6c/da4/lbb 0 2023-12-16T03:16:08.034 INFO:tasks.workunit.client.0.smithi064.stdout:3/717: dread db/fd [0,4194304] 0 2023-12-16T03:16:08.034 INFO:tasks.workunit.client.0.smithi064.stdout:3/718: stat db/d12/d1a/d2c/d34/d4c/d6a/da7/f7f 0 2023-12-16T03:16:08.036 INFO:tasks.workunit.client.0.smithi064.stdout:8/650: write d0/db/d12/d44/fc7 [1842495,111390] 0 2023-12-16T03:16:08.036 INFO:tasks.workunit.client.0.smithi064.stdout:7/605: mkdir d7/d26/d30/da3/dc3 0 2023-12-16T03:16:08.036 INFO:tasks.workunit.client.0.smithi064.stdout:0/605: dread d2/d8/da/df/fb4 [0,4194304] 0 2023-12-16T03:16:08.037 INFO:tasks.workunit.client.0.smithi064.stdout:1/661: read d3/dd/d23/d60/fc2 [433767,89467] 0 2023-12-16T03:16:08.040 INFO:tasks.workunit.client.0.smithi064.stdout:8/651: rename d0/db/d12/l52 to d0/d1d/lde 0 2023-12-16T03:16:08.041 INFO:tasks.workunit.client.0.smithi064.stdout:7/606: creat d7/d3e/d42/d89/fc4 x:0 0 0 2023-12-16T03:16:08.043 INFO:tasks.workunit.client.0.smithi064.stdout:1/662: creat d3/dd/d11/d38/fd7 x:0 0 0 2023-12-16T03:16:08.045 INFO:tasks.workunit.client.0.smithi064.stdout:8/652: mkdir d0/d1d/d24/d2f/d50/d70/dcc/ddf 0 2023-12-16T03:16:08.045 INFO:tasks.workunit.client.0.smithi064.stdout:8/653: dread - d0/fb6 zero size 2023-12-16T03:16:08.045 INFO:tasks.workunit.client.0.smithi064.stdout:7/607: mknod d7/d3e/d42/d89/d20/d6f/cc5 0 2023-12-16T03:16:08.046 INFO:tasks.workunit.client.0.smithi064.stdout:7/608: stat d7/fae 0 2023-12-16T03:16:08.048 INFO:tasks.workunit.client.0.smithi064.stdout:8/654: creat d0/d1d/d3c/d42/d93/fe0 x:0 0 0 2023-12-16T03:16:08.051 INFO:tasks.workunit.client.0.smithi064.stdout:7/609: link d7/c15 d7/d3e/d42/d48/d51/cc6 0 2023-12-16T03:16:08.051 INFO:tasks.workunit.client.0.smithi064.stdout:9/584: dread d2/dc/d24/f63 [0,4194304] 0 2023-12-16T03:16:08.053 INFO:tasks.workunit.client.0.smithi064.stdout:8/655: creat d0/db/d37/d3a/d95/fe1 x:0 0 0 2023-12-16T03:16:08.055 INFO:tasks.workunit.client.0.smithi064.stdout:9/585: mknod d2/dc/d24/d39/d5e/cbc 0 2023-12-16T03:16:08.057 INFO:tasks.workunit.client.0.smithi064.stdout:9/586: symlink d2/dc/d24/d39/d77/lbd 0 2023-12-16T03:16:08.058 INFO:tasks.workunit.client.0.smithi064.stdout:9/587: mknod d2/dc/d24/d39/cbe 0 2023-12-16T03:16:08.059 INFO:tasks.workunit.client.0.smithi064.stdout:9/588: creat d2/d2d/d36/db4/fbf x:0 0 0 2023-12-16T03:16:08.060 INFO:tasks.workunit.client.0.smithi064.stdout:9/589: fdatasync d2/d2d/f8c 0 2023-12-16T03:16:08.060 INFO:tasks.workunit.client.0.smithi064.stdout:9/590: truncate d2/d2d/d3b/d3c/fba 3684 0 2023-12-16T03:16:08.066 INFO:tasks.workunit.client.0.smithi064.stdout:1/663: dread d3/d36/d44/d4d/d58/d96/f99 [0,4194304] 0 2023-12-16T03:16:08.071 INFO:tasks.workunit.client.0.smithi064.stdout:7/610: dwrite d7/d26/d30/fab [0,4194304] 0 2023-12-16T03:16:08.071 INFO:tasks.workunit.client.0.smithi064.stdout:7/611: dread - d7/d3e/d42/d89/d20/d6f/d91/fba zero size 2023-12-16T03:16:08.074 INFO:tasks.workunit.client.0.smithi064.stdout:7/612: creat d7/d3e/d42/d43/fc7 x:0 0 0 2023-12-16T03:16:08.074 INFO:tasks.workunit.client.0.smithi064.stdout:7/613: getdents d7/d26/d30/da3/dc3 0 2023-12-16T03:16:08.075 INFO:tasks.workunit.client.0.smithi064.stdout:7/614: chown d7/d3e/d42/d89/f7a 15943 1 2023-12-16T03:16:08.075 INFO:tasks.workunit.client.0.smithi064.stdout:7/615: fdatasync d7/d26/d30/da3/fb9 0 2023-12-16T03:16:08.076 INFO:tasks.workunit.client.0.smithi064.stdout:7/616: mkdir d7/d3e/d42/d43/dc8 0 2023-12-16T03:16:08.077 INFO:tasks.workunit.client.0.smithi064.stdout:5/517: dwrite d0/d14/d20/d37/d70/d71/fb3 [0,4194304] 0 2023-12-16T03:16:08.077 INFO:tasks.workunit.client.0.smithi064.stdout:6/543: dwrite d3/d9/f68 [0,4194304] 0 2023-12-16T03:16:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.078+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 <== mon.0 v2:172.21.15.64:3300/0 8 ==== mgrmap(e 21) v1 ==== 45378+0+0 (secure 0 0 0) 0x7f2a840724f0 con 0x7f2a880fbb00 2023-12-16T03:16:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.079+0000 7f2a7dffb700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f2a74005cc0 0x7f2a74036ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.079+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 --> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a740384c0 con 0x7f2a74005cc0 2023-12-16T03:16:08.084 INFO:tasks.workunit.client.0.smithi064.stdout:2/489: dwrite d1/d27/d2e/d69/f56 [0,4194304] 0 2023-12-16T03:16:08.084 INFO:tasks.workunit.client.0.smithi064.stdout:2/490: write d1/d27/f4f [976629,17119] 0 2023-12-16T03:16:08.084 INFO:tasks.workunit.client.0.smithi064.stdout:5/518: symlink d0/d19/d48/d8f/dac/d23/d91/lb6 0 2023-12-16T03:16:08.084 INFO:tasks.workunit.client.0.smithi064.stdout:5/519: chown d0/d14/d20/d37/f51 0 1 2023-12-16T03:16:08.085 INFO:tasks.workunit.client.0.smithi064.stdout:6/544: creat d3/d8/d13/d58/fa1 x:0 0 0 2023-12-16T03:16:08.086 INFO:tasks.workunit.client.0.smithi064.stdout:7/617: dread d7/d3e/d42/d43/f90 [0,4194304] 0 2023-12-16T03:16:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.086+0000 7f2a8cb18700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f2a74005cc0 0x7f2a74036ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:08.090 INFO:tasks.workunit.client.0.smithi064.stdout:5/520: creat d0/d14/d20/fb7 x:0 0 0 2023-12-16T03:16:08.092 INFO:tasks.workunit.client.0.smithi064.stdout:7/618: creat d7/d3e/d42/d89/fc9 x:0 0 0 2023-12-16T03:16:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.089+0000 7f2a8cb18700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f2a74005cc0 0x7f2a74036ae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2a78004f90 tx=0x7f2a78009e30 comp rx=0 tx=0).ready entity=mgr.14582 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:08.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.091+0000 7f2a7dffb700 1 -- 172.21.15.64:0/3995268381 <== mgr.14582 v2:172.21.15.184:6828/2992718398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2a740384c0 con 0x7f2a74005cc0 2023-12-16T03:16:08.095 INFO:tasks.workunit.client.0.smithi064.stdout:5/521: mkdir d0/d50/d39/da5/db8 0 2023-12-16T03:16:08.095 INFO:tasks.workunit.client.0.smithi064.stdout:5/522: readlink d0/d19/l75 0 2023-12-16T03:16:08.096 INFO:tasks.workunit.client.0.smithi064.stdout:6/545: mknod d3/d8/da/ca2 0 2023-12-16T03:16:08.097 INFO:tasks.workunit.client.1.smithi184.stdout:2/826: getdents d3/d9/d19 0 2023-12-16T03:16:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.093+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f2a74005cc0 msgr2=0x7f2a74036ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.093+0000 7f2a8f57d700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f2a74005cc0 0x7f2a74036ae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2a78004f90 tx=0x7f2a78009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.093+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fbb00 msgr2=0x7f2a8810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.093+0000 7f2a8f57d700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fbb00 0x7f2a8810c470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400b790 tx=0x7f2a84009220 comp rx=0 tx=0).stop 2023-12-16T03:16:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.094+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3995268381 shutdown_connections 2023-12-16T03:16:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.094+0000 7f2a8f57d700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f2a74005cc0 0x7f2a74036ae0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.094+0000 7f2a8f57d700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:6800/2069535093,v1:172.21.15.64:6801/2069535093] conn(0x7f2a7406d430 0x7f2a7406f8e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.094+0000 7f2a8f57d700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a880fbb00 0x7f2a8810c470 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.094+0000 7f2a8f57d700 1 --2- 172.21.15.64:0/3995268381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a880fcd10 0x7f2a8810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.094+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3995268381 >> 172.21.15.64:0/3995268381 conn(0x7f2a880f71c0 msgr2=0x7f2a880fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.095+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3995268381 shutdown_connections 2023-12-16T03:16:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.095+0000 7f2a8f57d700 1 -- 172.21.15.64:0/3995268381 wait complete. 2023-12-16T03:16:08.101 INFO:tasks.workunit.client.0.smithi064.stdout:7/619: mkdir d7/d26/d95/dca 0 2023-12-16T03:16:08.101 INFO:tasks.workunit.client.0.smithi064.stdout:3/719: dwrite db/d4f/f6b [0,4194304] 0 2023-12-16T03:16:08.101 INFO:tasks.workunit.client.0.smithi064.stdout:4/602: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:16:08.101 INFO:tasks.workunit.client.0.smithi064.stdout:5/523: write d0/d19/d48/d92/f9e [1246111,30559] 0 2023-12-16T03:16:08.101 INFO:tasks.workunit.client.0.smithi064.stdout:5/524: chown d0/d19/d48/d8f/c6f 8376 1 2023-12-16T03:16:08.102 INFO:tasks.workunit.client.1.smithi184.stdout:2/827: symlink d3/d29/d2f/d46/d77/l114 0 2023-12-16T03:16:08.103 INFO:tasks.workunit.client.0.smithi064.stdout:6/546: symlink d3/d9/la3 0 2023-12-16T03:16:08.103 INFO:tasks.workunit.client.0.smithi064.stdout:6/547: chown d3/d8/da/ca2 26411 1 2023-12-16T03:16:08.103 INFO:tasks.workunit.client.0.smithi064.stdout:7/620: truncate d7/d26/d30/f57 2349957 0 2023-12-16T03:16:08.106 INFO:tasks.workunit.client.1.smithi184.stdout:2/828: mknod d3/d13/d28/dac/daf/dc8/c115 0 2023-12-16T03:16:08.108 INFO:tasks.workunit.client.0.smithi064.stdout:3/720: rename db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f8e to db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/ff1 0 2023-12-16T03:16:08.109 INFO:tasks.workunit.client.0.smithi064.stdout:4/603: rename d0/d42/d66/d33/c68 to d0/d42/d66/d33/cc1 0 2023-12-16T03:16:08.109 INFO:tasks.workunit.client.0.smithi064.stdout:4/604: dread - d0/d1e/d36/fa3 zero size 2023-12-16T03:16:08.109 INFO:tasks.workunit.client.0.smithi064.stdout:4/605: truncate d0/d1e/f69 631690 0 2023-12-16T03:16:08.109 INFO:tasks.workunit.client.0.smithi064.stdout:4/606: chown d0/d42/d66/d5a/c97 0 1 2023-12-16T03:16:08.111 INFO:tasks.workunit.client.0.smithi064.stdout:5/525: mknod d0/d19/d48/d8f/dac/cb9 0 2023-12-16T03:16:08.113 INFO:tasks.workunit.client.0.smithi064.stdout:6/548: creat d3/d8/fa4 x:0 0 0 2023-12-16T03:16:08.113 INFO:tasks.workunit.client.1.smithi184.stdout:2/829: write d3/d9/d19/fa7 [447740,27328] 0 2023-12-16T03:16:08.114 INFO:tasks.workunit.client.0.smithi064.stdout:3/721: mknod db/cf2 0 2023-12-16T03:16:08.114 INFO:tasks.workunit.client.0.smithi064.stdout:3/722: chown db/d12/d21/fe8 0 1 2023-12-16T03:16:08.115 INFO:tasks.workunit.client.0.smithi064.stdout:4/607: creat d0/fc2 x:0 0 0 2023-12-16T03:16:08.117 INFO:tasks.workunit.client.0.smithi064.stdout:0/606: dwrite d2/d8/da/df/f4d [0,4194304] 0 2023-12-16T03:16:08.118 INFO:tasks.workunit.client.0.smithi064.stdout:0/607: dread - d2/d7/d10/d85/d88/d92/fb7 zero size 2023-12-16T03:16:08.118 INFO:tasks.workunit.client.1.smithi184.stdout:2/830: unlink d3/d9/d19/cc7 0 2023-12-16T03:16:08.120 INFO:tasks.workunit.client.0.smithi064.stdout:1/664: dwrite d3/dd/d23/d60/fa9 [0,4194304] 0 2023-12-16T03:16:08.121 INFO:tasks.workunit.client.0.smithi064.stdout:8/656: dwrite d0/da/d3e/d46/d54/d7c/db7/faf [0,4194304] 0 2023-12-16T03:16:08.122 INFO:tasks.workunit.client.0.smithi064.stdout:6/549: write d3/d8/d13/d46/f87 [105350,21386] 0 2023-12-16T03:16:08.125 INFO:tasks.workunit.client.0.smithi064.stdout:3/723: unlink db/d4f/d51/db3/fd8 0 2023-12-16T03:16:08.127 INFO:tasks.workunit.client.0.smithi064.stdout:4/608: creat d0/d42/d4c/d70/d8c/fc3 x:0 0 0 2023-12-16T03:16:08.127 INFO:tasks.workunit.client.0.smithi064.stdout:4/609: stat d0/d42/d56 0 2023-12-16T03:16:08.129 INFO:tasks.workunit.client.1.smithi184.stdout:2/831: mknod d3/d13/d28/dac/daf/c116 0 2023-12-16T03:16:08.135 INFO:tasks.workunit.client.1.smithi184.stdout:2/832: unlink d3/d9/d19/d87/f67 0 2023-12-16T03:16:08.138 INFO:tasks.workunit.client.0.smithi064.stdout:2/491: dwrite d1/d27/d2e/d69/f78 [0,4194304] 0 2023-12-16T03:16:08.138 INFO:tasks.workunit.client.0.smithi064.stdout:2/492: write d1/d27/f84 [4701858,50976] 0 2023-12-16T03:16:08.138 INFO:tasks.workunit.client.0.smithi064.stdout:2/493: write d1/d15/d23/d2d/f3c [510829,64608] 0 2023-12-16T03:16:08.139 INFO:tasks.workunit.client.0.smithi064.stdout:1/665: creat d3/d22/fd8 x:0 0 0 2023-12-16T03:16:08.139 INFO:tasks.workunit.client.0.smithi064.stdout:1/666: chown d3/dd/d11 1916468319 1 2023-12-16T03:16:08.141 INFO:tasks.workunit.client.0.smithi064.stdout:7/621: dwrite d7/d3e/d42/d48/f5e [0,4194304] 0 2023-12-16T03:16:08.141 INFO:tasks.workunit.client.0.smithi064.stdout:7/622: truncate d7/d3e/d42/d48/f5b 4826011 0 2023-12-16T03:16:08.142 INFO:tasks.workunit.client.0.smithi064.stdout:8/657: creat d0/d1d/d3c/fe2 x:0 0 0 2023-12-16T03:16:08.149 INFO:tasks.workunit.client.0.smithi064.stdout:7/623: dread d7/d3e/d42/d89/d20/f3a [0,4194304] 0 2023-12-16T03:16:08.150 INFO:tasks.workunit.client.0.smithi064.stdout:2/494: mknod d1/d15/d7d/c99 0 2023-12-16T03:16:08.150 INFO:tasks.workunit.client.0.smithi064.stdout:2/495: fsync d1/d15/d23/f51 0 2023-12-16T03:16:08.151 INFO:tasks.workunit.client.0.smithi064.stdout:1/667: creat d3/d22/fd9 x:0 0 0 2023-12-16T03:16:08.153 INFO:tasks.workunit.client.1.smithi184.stdout:2/833: dread d3/d9/d19/f7d [0,4194304] 0 2023-12-16T03:16:08.153 INFO:tasks.workunit.client.1.smithi184.stdout:2/834: chown d3/d29/d4d/d5b 1570 1 2023-12-16T03:16:08.154 INFO:tasks.workunit.client.0.smithi064.stdout:7/624: mknod d7/d26/d95/ccb 0 2023-12-16T03:16:08.154 INFO:tasks.workunit.client.0.smithi064.stdout:7/625: write d7/d26/dc2/fbb [909332,42403] 0 2023-12-16T03:16:08.156 INFO:tasks.workunit.client.0.smithi064.stdout:1/668: mknod d3/d22/dab/cda 0 2023-12-16T03:16:08.159 INFO:tasks.workunit.client.1.smithi184.stdout:2/835: creat d3/d13/d28/f117 x:0 0 0 2023-12-16T03:16:08.161 INFO:tasks.workunit.client.1.smithi184.stdout:1/884: sync 2023-12-16T03:16:08.161 INFO:tasks.workunit.client.1.smithi184.stdout:5/751: sync 2023-12-16T03:16:08.161 INFO:tasks.workunit.client.1.smithi184.stdout:5/752: fdatasync d1/d2a/d31/f54 0 2023-12-16T03:16:08.162 INFO:tasks.workunit.client.0.smithi064.stdout:1/669: unlink d3/d22/d57/c7e 0 2023-12-16T03:16:08.169 INFO:tasks.workunit.client.1.smithi184.stdout:1/885: symlink d3/d13/d10b/l133 0 2023-12-16T03:16:08.170 INFO:tasks.workunit.client.1.smithi184.stdout:5/753: symlink d1/d2a/d31/d58/daf/lf9 0 2023-12-16T03:16:08.175 INFO:tasks.workunit.client.1.smithi184.stdout:5/754: read d1/d3/d9/de/d15/d19/d48/fc8 [9263,111734] 0 2023-12-16T03:16:08.177 INFO:tasks.workunit.client.0.smithi064.stdout:2/496: dread d1/d15/f28 [0,4194304] 0 2023-12-16T03:16:08.179 INFO:tasks.workunit.client.1.smithi184.stdout:5/755: dread d1/d3/f62 [0,4194304] 0 2023-12-16T03:16:08.180 INFO:tasks.workunit.client.0.smithi064.stdout:2/497: rename d1/d15/d23/d2d/f5c to d1/d15/d67/d8f/f9a 0 2023-12-16T03:16:08.182 INFO:tasks.workunit.client.1.smithi184.stdout:5/756: symlink d1/d3/d9/de/d15/d19/d3a/dde/lfa 0 2023-12-16T03:16:08.191 INFO:tasks.workunit.client.0.smithi064.stdout:2/498: dread d1/d76/d57/f80 [0,4194304] 0 2023-12-16T03:16:08.206 INFO:tasks.workunit.client.0.smithi064.stdout:5/526: dwrite d0/d19/d48/d8f/d5e/d84/faf [4194304,4194304] 0 2023-12-16T03:16:08.206 INFO:tasks.workunit.client.0.smithi064.stdout:5/527: chown d0/d50/d39/f7c 3 1 2023-12-16T03:16:08.208 INFO:tasks.workunit.client.0.smithi064.stdout:5/528: creat d0/d7/d8b/fba x:0 0 0 2023-12-16T03:16:08.216 INFO:tasks.workunit.client.0.smithi064.stdout:2/499: write d1/d27/d2e/d68/f3f [231130,130299] 0 2023-12-16T03:16:08.216 INFO:tasks.workunit.client.0.smithi064.stdout:5/529: dread d0/d19/fad [0,4194304] 0 2023-12-16T03:16:08.221 INFO:tasks.workunit.client.0.smithi064.stdout:2/500: write d1/d27/d2e/d69/f78 [1519272,86615] 0 2023-12-16T03:16:08.224 INFO:tasks.workunit.client.0.smithi064.stdout:2/501: creat d1/d15/d23/d2d/f9b x:0 0 0 2023-12-16T03:16:08.224 INFO:tasks.workunit.client.0.smithi064.stdout:2/502: readlink d1/d15/d1b/l36 0 2023-12-16T03:16:08.225 INFO:tasks.workunit.client.0.smithi064.stdout:2/503: dread d1/d27/f44 [0,4194304] 0 2023-12-16T03:16:08.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.244+0000 7f79ebe8e700 1 -- 172.21.15.64:0/1599013180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fbaf0 msgr2=0x7f79e40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:08.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.244+0000 7f79ebe8e700 1 --2- 172.21.15.64:0/1599013180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fbaf0 0x7f79e40fbf00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f79e0004940 tx=0x7f79e0009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:08.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.244+0000 7f79ebe8e700 1 -- 172.21.15.64:0/1599013180 shutdown_connections 2023-12-16T03:16:08.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.244+0000 7f79ebe8e700 1 --2- 172.21.15.64:0/1599013180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e40fcd00 0x7f79e40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.244+0000 7f79ebe8e700 1 --2- 172.21.15.64:0/1599013180 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fbaf0 0x7f79e40fbf00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.244+0000 7f79ebe8e700 1 -- 172.21.15.64:0/1599013180 >> 172.21.15.64:0/1599013180 conn(0x7f79e40f7190 msgr2=0x7f79e40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:08.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.244+0000 7f79ebe8e700 1 -- 172.21.15.64:0/1599013180 shutdown_connections 2023-12-16T03:16:08.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.244+0000 7f79ebe8e700 1 -- 172.21.15.64:0/1599013180 wait complete. 2023-12-16T03:16:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79ebe8e700 1 Processor -- start 2023-12-16T03:16:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79ebe8e700 1 -- start start 2023-12-16T03:16:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79ebe8e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e40fbaf0 0x7f79e40ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79ebe8e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fcd00 0x7f79e40fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79ebe8e700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40fe640 con 0x7f79e40fcd00 2023-12-16T03:16:08.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79ebe8e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40fe7b0 con 0x7f79e40fbaf0 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79e9429700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fcd00 0x7f79e40fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79e9c2a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e40fbaf0 0x7f79e40ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79e9429700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fcd00 0x7f79e40fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51368/0 (socket says 172.21.15.64:51368) 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79e9429700 1 -- 172.21.15.64:0/3868023282 learned_addr learned my addr 172.21.15.64:0/3868023282 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79e9429700 1 -- 172.21.15.64:0/3868023282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e40fbaf0 msgr2=0x7f79e40ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79e9429700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e40fbaf0 0x7f79e40ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.245+0000 7f79e9429700 1 -- 172.21.15.64:0/3868023282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0005040 con 0x7f79e40fcd00 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.246+0000 7f79e9429700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fcd00 0x7f79e40fe040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f79d400eb40 tx=0x7f79d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.246+0000 7f79da7fc700 1 -- 172.21.15.64:0/3868023282 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d4007cc0 con 0x7f79e40fcd00 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.246+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e40fea30 con 0x7f79e40fcd00 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.246+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e4115520 con 0x7f79e40fcd00 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.246+0000 7f79da7fc700 1 -- 172.21.15.64:0/3868023282 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f79d400f040 con 0x7f79e40fcd00 2023-12-16T03:16:08.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.246+0000 7f79da7fc700 1 -- 172.21.15.64:0/3868023282 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d400c990 con 0x7f79e40fcd00 2023-12-16T03:16:08.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.247+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e404bb80 con 0x7f79e40fcd00 2023-12-16T03:16:08.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.247+0000 7f79da7fc700 1 -- 172.21.15.64:0/3868023282 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 21) v1 ==== 45378+0+0 (secure 0 0 0) 0x7f79d400cc00 con 0x7f79e40fcd00 2023-12-16T03:16:08.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.247+0000 7f79da7fc700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f79d0038350 0x7f79d003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:08.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.247+0000 7f79da7fc700 1 -- 172.21.15.64:0/3868023282 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f79d404b6a0 con 0x7f79e40fcd00 2023-12-16T03:16:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.247+0000 7f79e9c2a700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f79d0038350 0x7f79d003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:08.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.248+0000 7f79e9c2a700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f79d0038350 0x7f79d003a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f79e0013680 tx=0x7f79e0009e30 comp rx=0 tx=0).ready entity=mgr.14582 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:08.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.253+0000 7f79da7fc700 1 -- 172.21.15.64:0/3868023282 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f79d4009450 con 0x7f79e40fcd00 2023-12-16T03:16:08.257 INFO:tasks.workunit.client.0.smithi064.stdout:0/608: dwrite d2/d5b/f9c [0,4194304] 0 2023-12-16T03:16:08.258 INFO:tasks.workunit.client.0.smithi064.stdout:6/550: dwrite d3/d8/fa4 [0,4194304] 0 2023-12-16T03:16:08.265 INFO:tasks.workunit.client.1.smithi184.stdout:4/910: sync 2023-12-16T03:16:08.265 INFO:tasks.workunit.client.1.smithi184.stdout:8/957: sync 2023-12-16T03:16:08.265 INFO:tasks.workunit.client.1.smithi184.stdout:7/912: sync 2023-12-16T03:16:08.265 INFO:tasks.workunit.client.1.smithi184.stdout:7/913: chown d0/l7a 27203054 1 2023-12-16T03:16:08.265 INFO:tasks.workunit.client.0.smithi064.stdout:3/724: dwrite db/d4f/fb1 [0,4194304] 0 2023-12-16T03:16:08.265 INFO:tasks.workunit.client.0.smithi064.stdout:3/725: dread - db/d12/d1a/d2c/d34/d4c/d6a/fc7 zero size 2023-12-16T03:16:08.267 INFO:tasks.workunit.client.0.smithi064.stdout:4/610: dwrite d0/d1e/d36/f46 [0,4194304] 0 2023-12-16T03:16:08.267 INFO:tasks.workunit.client.0.smithi064.stdout:4/611: readlink d0/l6 0 2023-12-16T03:16:08.268 INFO:tasks.workunit.client.0.smithi064.stdout:8/658: dwrite d0/db/f4f [0,4194304] 0 2023-12-16T03:16:08.268 INFO:tasks.workunit.client.0.smithi064.stdout:8/659: fdatasync d0/db/d12/d1c/f72 0 2023-12-16T03:16:08.268 INFO:tasks.workunit.client.0.smithi064.stdout:5/530: dwrite d0/d19/fad [0,4194304] 0 2023-12-16T03:16:08.268 INFO:tasks.workunit.client.1.smithi184.stdout:2/836: dwrite d3/d13/f109 [0,4194304] 0 2023-12-16T03:16:08.268 INFO:tasks.workunit.client.1.smithi184.stdout:1/886: dwrite d3/d34/dbc/d3c/d41/d77/ff3 [0,4194304] 0 2023-12-16T03:16:08.268 INFO:tasks.workunit.client.1.smithi184.stdout:1/887: readlink d3/d34/d76/l98 0 2023-12-16T03:16:08.269 INFO:tasks.workunit.client.0.smithi064.stdout:7/626: dwrite d7/d3e/d42/f73 [0,4194304] 0 2023-12-16T03:16:08.269 INFO:tasks.workunit.client.0.smithi064.stdout:2/504: dwrite d1/d76/d57/f80 [0,4194304] 0 2023-12-16T03:16:08.270 INFO:tasks.workunit.client.1.smithi184.stdout:4/911: rename d1/d12/db3/db8/f11f to d1/d12/d13/d40/f13b 0 2023-12-16T03:16:08.272 INFO:tasks.workunit.client.0.smithi064.stdout:3/726: write db/d12/d1a/d2c/d34/d4c/d6a/da7/f99 [3393960,8627] 0 2023-12-16T03:16:08.272 INFO:tasks.workunit.client.0.smithi064.stdout:3/727: write db/d12/d1a/f97 [83978,39451] 0 2023-12-16T03:16:08.275 INFO:tasks.workunit.client.1.smithi184.stdout:2/837: creat d3/d13/d28/d83/f118 x:0 0 0 2023-12-16T03:16:08.282 INFO:tasks.workunit.client.0.smithi064.stdout:0/609: dwrite d2/d8/da/df/f80 [0,4194304] 0 2023-12-16T03:16:08.286 INFO:tasks.workunit.client.1.smithi184.stdout:1/888: creat d3/d13/d121/f134 x:0 0 0 2023-12-16T03:16:08.288 INFO:tasks.workunit.client.0.smithi064.stdout:4/612: symlink d0/d42/d4c/d70/dbe/lc4 0 2023-12-16T03:16:08.288 INFO:tasks.workunit.client.0.smithi064.stdout:4/613: truncate d0/d42/d66/d33/fad 944193 0 2023-12-16T03:16:08.290 INFO:tasks.workunit.client.0.smithi064.stdout:6/551: dwrite d3/d8/d13/fa0 [0,4194304] 0 2023-12-16T03:16:08.290 INFO:tasks.workunit.client.0.smithi064.stdout:6/552: chown d3/d8/d1f/d26/d47/d4a 21 1 2023-12-16T03:16:08.292 INFO:tasks.workunit.client.0.smithi064.stdout:6/553: write d3/d8/f4c [3339072,48509] 0 2023-12-16T03:16:08.292 INFO:tasks.workunit.client.0.smithi064.stdout:6/554: truncate d3/d8/d1f/f56 1116682 0 2023-12-16T03:16:08.292 INFO:tasks.workunit.client.1.smithi184.stdout:8/958: dwrite d2/d37/d7c/dd7/f112 [0,4194304] 0 2023-12-16T03:16:08.298 INFO:tasks.workunit.client.1.smithi184.stdout:7/914: rename d0/d3/d2e to d0/dd3/d11a 0 2023-12-16T03:16:08.300 INFO:tasks.workunit.client.0.smithi064.stdout:8/660: creat d0/d1d/d24/d2f/d50/fe3 x:0 0 0 2023-12-16T03:16:08.302 INFO:tasks.workunit.client.1.smithi184.stdout:4/912: mkdir d1/d11/d5a/d63/d103/d45/dcf/dea/d13c 0 2023-12-16T03:16:08.302 INFO:tasks.workunit.client.1.smithi184.stdout:4/913: write d1/d12/db3/f106 [1079542,112300] 0 2023-12-16T03:16:08.303 INFO:tasks.workunit.client.0.smithi064.stdout:8/661: read d0/db/d5a/d97/f6e [42086,128826] 0 2023-12-16T03:16:08.303 INFO:tasks.workunit.client.0.smithi064.stdout:8/662: chown d0/db/d37/f74 19475 1 2023-12-16T03:16:08.308 INFO:tasks.workunit.client.0.smithi064.stdout:5/531: symlink d0/d19/d48/d8f/d3e/d35/d5d/d9a/lbb 0 2023-12-16T03:16:08.308 INFO:tasks.workunit.client.0.smithi064.stdout:5/532: chown d0/d14/d20/d37/d70/d71/d5a/l6d 207139 1 2023-12-16T03:16:08.310 INFO:tasks.workunit.client.1.smithi184.stdout:2/838: symlink d3/d29/d4d/l119 0 2023-12-16T03:16:08.311 INFO:tasks.workunit.client.1.smithi184.stdout:2/839: read - d3/d9/d19/d82/fa8 zero size 2023-12-16T03:16:08.311 INFO:tasks.workunit.client.1.smithi184.stdout:2/840: chown d3/d9/d19/d82/fa8 6736 1 2023-12-16T03:16:08.311 INFO:tasks.workunit.client.1.smithi184.stdout:2/841: readlink d3/d29/d2f/d46/d77/l106 0 2023-12-16T03:16:08.311 INFO:tasks.workunit.client.1.smithi184.stdout:4/914: write d1/d12/f131 [71593,25567] 0 2023-12-16T03:16:08.311 INFO:tasks.workunit.client.1.smithi184.stdout:4/915: chown d1/f51 164526793 1 2023-12-16T03:16:08.311 INFO:tasks.workunit.client.1.smithi184.stdout:4/916: dread - d1/d12/db3/db8/d11e/f105 zero size 2023-12-16T03:16:08.311 INFO:tasks.workunit.client.1.smithi184.stdout:4/917: chown d1/d11/d5a/d63/d103/d45/dcf/de6/d107/f114 414102 1 2023-12-16T03:16:08.313 INFO:tasks.workunit.client.1.smithi184.stdout:1/889: creat d3/d34/dbc/f135 x:0 0 0 2023-12-16T03:16:08.313 INFO:tasks.workunit.client.1.smithi184.stdout:1/890: chown d3/d34/dbc/d38 8697094 1 2023-12-16T03:16:08.314 INFO:tasks.workunit.client.0.smithi064.stdout:7/627: symlink d7/d3e/d42/d48/d51/lcc 0 2023-12-16T03:16:08.323 INFO:tasks.workunit.client.1.smithi184.stdout:8/959: rmdir d2/d4/d10/d75 39 2023-12-16T03:16:08.327 INFO:tasks.workunit.client.0.smithi064.stdout:3/728: creat db/d4f/d51/dd1/dd3/ff3 x:0 0 0 2023-12-16T03:16:08.329 INFO:tasks.workunit.client.1.smithi184.stdout:7/915: creat d0/dd3/d11a/d79/d32/d39/f11b x:0 0 0 2023-12-16T03:16:08.329 INFO:tasks.workunit.client.1.smithi184.stdout:7/916: read d0/dd3/d11a/d79/d36/d3f/fdb [1064060,54417] 0 2023-12-16T03:16:08.330 INFO:tasks.workunit.client.1.smithi184.stdout:7/917: truncate d0/dd3/d11a/d79/d32/ff1 87573 0 2023-12-16T03:16:08.334 INFO:tasks.workunit.client.1.smithi184.stdout:2/842: rename d3/d9/d19/d87/l3d to d3/d13/ddf/l11a 0 2023-12-16T03:16:08.334 INFO:tasks.workunit.client.1.smithi184.stdout:2/843: readlink d3/d9/lbb 0 2023-12-16T03:16:08.335 INFO:tasks.workunit.client.1.smithi184.stdout:1/891: dwrite d3/d34/dbc/d3c/f117 [0,4194304] 0 2023-12-16T03:16:08.335 INFO:tasks.workunit.client.1.smithi184.stdout:1/892: chown d3/d34/f129 54 1 2023-12-16T03:16:08.336 INFO:tasks.workunit.client.1.smithi184.stdout:1/893: dread - d3/d34/dbc/f135 zero size 2023-12-16T03:16:08.336 INFO:tasks.workunit.client.1.smithi184.stdout:4/918: mkdir d1/d29/d34/d5c/d76/d3b/d13d 0 2023-12-16T03:16:08.337 INFO:tasks.workunit.client.0.smithi064.stdout:2/505: rename d1/d27/d2e to d1/d15/d1b/d9c 0 2023-12-16T03:16:08.346 INFO:tasks.workunit.client.1.smithi184.stdout:7/918: mknod d0/dd3/d11a/d79/d32/d39/c11c 0 2023-12-16T03:16:08.351 INFO:tasks.workunit.client.1.smithi184.stdout:8/960: rename d2/d6a/da4/f7d to d2/d12/d12e/f138 0 2023-12-16T03:16:08.353 INFO:tasks.workunit.client.0.smithi064.stdout:2/506: dwrite d1/d15/d1b/d61/f77 [0,4194304] 0 2023-12-16T03:16:08.355 INFO:tasks.workunit.client.1.smithi184.stdout:2/844: rmdir d3/d29/d2f/d46/dfd 39 2023-12-16T03:16:08.363 INFO:tasks.workunit.client.1.smithi184.stdout:1/894: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/f136 x:0 0 0 2023-12-16T03:16:08.368 INFO:tasks.workunit.client.1.smithi184.stdout:8/961: dwrite d2/d12/d21/d2d/d31/f68 [0,4194304] 0 2023-12-16T03:16:08.369 INFO:tasks.workunit.client.1.smithi184.stdout:4/919: link d1/d29/d34/d5c/d76/d33/le1 d1/d12/db3/db8/dd0/l13e 0 2023-12-16T03:16:08.369 INFO:tasks.workunit.client.1.smithi184.stdout:7/919: link d0/dd3/d11a/d79/d34/dc1/d107/lc3 d0/deb/l11d 0 2023-12-16T03:16:08.374 INFO:tasks.workunit.client.1.smithi184.stdout:2/845: mknod d3/d13/d28/dac/c11b 0 2023-12-16T03:16:08.374 INFO:tasks.workunit.client.0.smithi064.stdout:0/610: symlink d2/d7/d10/d21/lc6 0 2023-12-16T03:16:08.374 INFO:tasks.workunit.client.0.smithi064.stdout:0/611: chown d2/d8/da/df/f72 7671 1 2023-12-16T03:16:08.379 INFO:tasks.workunit.client.1.smithi184.stdout:1/895: link d3/d34/dbc/d3c/d41/d63/de1/lf6 d3/d13/d10b/l137 0 2023-12-16T03:16:08.382 INFO:tasks.workunit.client.0.smithi064.stdout:4/614: creat d0/d42/d4c/d70/d8c/fc5 x:0 0 0 2023-12-16T03:16:08.383 INFO:tasks.workunit.client.1.smithi184.stdout:4/920: stat d1/d29/d34/d5c/d76/d3b/l10a 0 2023-12-16T03:16:08.386 INFO:tasks.workunit.client.1.smithi184.stdout:5/757: sync 2023-12-16T03:16:08.387 INFO:tasks.workunit.client.1.smithi184.stdout:2/846: rename d3/d9/c8d to d3/d29/c11c 0 2023-12-16T03:16:08.387 INFO:tasks.workunit.client.1.smithi184.stdout:2/847: write d3/d13/d28/dac/daf/dc8/fe6 [140586,82496] 0 2023-12-16T03:16:08.387 INFO:tasks.workunit.client.1.smithi184.stdout:2/848: write d3/d9/d19/f26 [4460854,18857] 0 2023-12-16T03:16:08.388 INFO:tasks.workunit.client.1.smithi184.stdout:8/962: dwrite d2/d4/d10/d11/d77/ff5 [0,4194304] 0 2023-12-16T03:16:08.388 INFO:tasks.workunit.client.0.smithi064.stdout:6/555: getdents d3/d8/d13/d46 0 2023-12-16T03:16:08.390 INFO:tasks.workunit.client.1.smithi184.stdout:1/896: mkdir d3/d34/d76/d91/d127/d138 0 2023-12-16T03:16:08.390 INFO:tasks.workunit.client.1.smithi184.stdout:1/897: getdents d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/d131 0 2023-12-16T03:16:08.390 INFO:tasks.workunit.client.1.smithi184.stdout:1/898: truncate d3/d34/dbc/d38/d52/ff1 498919 0 2023-12-16T03:16:08.394 INFO:tasks.workunit.client.0.smithi064.stdout:8/663: rmdir d0/da/d3e/d46/d54/d7c/da8 0 2023-12-16T03:16:08.396 INFO:tasks.workunit.client.1.smithi184.stdout:4/921: mknod d1/d29/d37/d102/c13f 0 2023-12-16T03:16:08.400 INFO:tasks.workunit.client.1.smithi184.stdout:7/920: dread d0/dd3/d11a/da9/fce [0,4194304] 0 2023-12-16T03:16:08.400 INFO:tasks.workunit.client.1.smithi184.stdout:4/922: read d1/d12/d13/da1/fcd [1482475,2690] 0 2023-12-16T03:16:08.400 INFO:tasks.workunit.client.1.smithi184.stdout:4/923: readlink d1/d11/d5a/d63/l109 0 2023-12-16T03:16:08.400 INFO:tasks.workunit.client.1.smithi184.stdout:4/924: read - d1/d12/d13/d40/fd3 zero size 2023-12-16T03:16:08.401 INFO:tasks.workunit.client.0.smithi064.stdout:5/533: creat d0/d14/d20/d37/d70/da2/fbc x:0 0 0 2023-12-16T03:16:08.401 INFO:tasks.workunit.client.0.smithi064.stdout:5/534: readlink d0/d19/d48/d8f/dac/l10 0 2023-12-16T03:16:08.402 INFO:tasks.workunit.client.1.smithi184.stdout:5/758: rename d1/d3/d9/de/d15/d19/d5f/l6e to d1/d3/de7/lfb 0 2023-12-16T03:16:08.405 INFO:tasks.workunit.client.0.smithi064.stdout:7/628: mknod d7/d3e/d42/d89/d20/d37/db1/db6/ccd 0 2023-12-16T03:16:08.405 INFO:tasks.workunit.client.0.smithi064.stdout:7/629: fdatasync d7/d3e/d42/d43/fc7 0 2023-12-16T03:16:08.405 INFO:tasks.workunit.client.0.smithi064.stdout:7/630: truncate d7/d3e/d42/d43/fc7 421169 0 2023-12-16T03:16:08.405 INFO:tasks.workunit.client.0.smithi064.stdout:7/631: chown d7/d3e/d42/d89/d20/d6f/d93 4300 1 2023-12-16T03:16:08.405 INFO:tasks.workunit.client.0.smithi064.stdout:7/632: dread - d7/d26/f79 zero size 2023-12-16T03:16:08.405 INFO:tasks.workunit.client.0.smithi064.stdout:7/633: truncate d7/d3e/d42/faa 377084 0 2023-12-16T03:16:08.407 INFO:tasks.workunit.client.1.smithi184.stdout:2/849: creat d3/d29/d8a/f11d x:0 0 0 2023-12-16T03:16:08.409 INFO:tasks.workunit.client.0.smithi064.stdout:3/729: symlink db/d12/d1a/d2c/d34/d4c/lf4 0 2023-12-16T03:16:08.416 INFO:tasks.workunit.client.0.smithi064.stdout:9/591: truncate d2/d2d/f8c 184150 0 2023-12-16T03:16:08.416 INFO:tasks.workunit.client.1.smithi184.stdout:8/963: readlink d2/d4/lb 0 2023-12-16T03:16:08.416 INFO:tasks.workunit.client.1.smithi184.stdout:1/899: dwrite d3/d34/dbc/d3c/d41/d63/fa9 [0,4194304] 0 2023-12-16T03:16:08.419 INFO:tasks.workunit.client.0.smithi064.stdout:2/507: creat d1/d15/d67/d8f/f9d x:0 0 0 2023-12-16T03:16:08.422 INFO:tasks.workunit.client.1.smithi184.stdout:7/921: mkdir d0/dd3/d11e 0 2023-12-16T03:16:08.422 INFO:tasks.workunit.client.1.smithi184.stdout:4/925: link d1/d29/f95 d1/d29/f140 0 2023-12-16T03:16:08.424 INFO:tasks.workunit.client.1.smithi184.stdout:8/964: dread d2/d4/d10/d11/d72/dc2/fcf [0,4194304] 0 2023-12-16T03:16:08.424 INFO:tasks.workunit.client.1.smithi184.stdout:8/965: stat d2/d12/d21/d8a/dcd/d110 0 2023-12-16T03:16:08.425 INFO:tasks.workunit.client.0.smithi064.stdout:9/592: dread d2/dc/f15 [0,4194304] 0 2023-12-16T03:16:08.426 INFO:tasks.workunit.client.1.smithi184.stdout:2/850: rmdir d3/d13/ddf/d10a 39 2023-12-16T03:16:08.426 INFO:tasks.workunit.client.1.smithi184.stdout:2/851: chown d3/f50 11 1 2023-12-16T03:16:08.426 INFO:tasks.workunit.client.1.smithi184.stdout:2/852: chown d3/d9/d19/c3f 3447521 1 2023-12-16T03:16:08.426 INFO:tasks.workunit.client.1.smithi184.stdout:2/853: fsync d3/d13/fd9 0 2023-12-16T03:16:08.426 INFO:tasks.workunit.client.1.smithi184.stdout:2/854: fdatasync d3/d9/f3b 0 2023-12-16T03:16:08.427 INFO:tasks.workunit.client.0.smithi064.stdout:0/612: mknod d2/d29/cc7 0 2023-12-16T03:16:08.429 INFO:tasks.workunit.client.0.smithi064.stdout:4/615: getdents d0/d1e/d36/db7 0 2023-12-16T03:16:08.433 INFO:tasks.workunit.client.1.smithi184.stdout:4/926: dread d1/f28 [4194304,4194304] 0 2023-12-16T03:16:08.433 INFO:tasks.workunit.client.0.smithi064.stdout:6/556: truncate d3/d8/d1f/f5a 3254762 0 2023-12-16T03:16:08.434 INFO:tasks.workunit.client.0.smithi064.stdout:7/634: dwrite d7/d26/d30/da3/fb9 [0,4194304] 0 2023-12-16T03:16:08.434 INFO:tasks.workunit.client.0.smithi064.stdout:7/635: fdatasync d7/d3e/d42/d48/d51/f8d 0 2023-12-16T03:16:08.439 INFO:tasks.workunit.client.0.smithi064.stdout:9/593: dread d2/dc/d24/d39/d5e/f8f [0,4194304] 0 2023-12-16T03:16:08.440 INFO:tasks.workunit.client.0.smithi064.stdout:8/664: rmdir d0/db/d5a/d97/d38 39 2023-12-16T03:16:08.441 INFO:tasks.workunit.client.0.smithi064.stdout:8/665: read d0/db/d37/d3a/f57 [612696,7901] 0 2023-12-16T03:16:08.443 INFO:tasks.workunit.client.0.smithi064.stdout:5/535: truncate d0/d19/d48/d92/f9e 791300 0 2023-12-16T03:16:08.443 INFO:tasks.workunit.client.0.smithi064.stdout:4/616: dread d0/d42/d56/fa5 [0,4194304] 0 2023-12-16T03:16:08.443 INFO:tasks.workunit.client.0.smithi064.stdout:5/536: stat d0/d50/la4 0 2023-12-16T03:16:08.447 INFO:tasks.workunit.client.0.smithi064.stdout:3/730: rename db/fd to db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/ff5 0 2023-12-16T03:16:08.447 INFO:tasks.workunit.client.0.smithi064.stdout:3/731: fdatasync db/d4f/d51/dd2/fe0 0 2023-12-16T03:16:08.447 INFO:tasks.workunit.client.1.smithi184.stdout:2/855: dwrite d3/d13/d28/f74 [0,4194304] 0 2023-12-16T03:16:08.448 INFO:tasks.workunit.client.1.smithi184.stdout:1/900: truncate d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fde 1400847 0 2023-12-16T03:16:08.451 INFO:tasks.workunit.client.1.smithi184.stdout:7/922: creat d0/f11f x:0 0 0 2023-12-16T03:16:08.451 INFO:tasks.workunit.client.1.smithi184.stdout:7/923: write d0/dd3/d11a/d79/d32/d39/d8f/dab/d104/fed [100445,45594] 0 2023-12-16T03:16:08.453 INFO:tasks.workunit.client.0.smithi064.stdout:0/613: mkdir d2/d29/dc8 0 2023-12-16T03:16:08.453 INFO:tasks.workunit.client.0.smithi064.stdout:0/614: fsync d2/f16 0 2023-12-16T03:16:08.454 INFO:tasks.workunit.client.1.smithi184.stdout:8/966: creat d2/d12/d21/d2d/d31/d131/f139 x:0 0 0 2023-12-16T03:16:08.455 INFO:tasks.workunit.client.0.smithi064.stdout:6/557: creat d3/d8/d1f/d26/d47/d9d/fa5 x:0 0 0 2023-12-16T03:16:08.455 INFO:tasks.workunit.client.0.smithi064.stdout:6/558: chown d3/d9e 1119204520 1 2023-12-16T03:16:08.461 INFO:tasks.workunit.client.1.smithi184.stdout:4/927: symlink d1/d11/l141 0 2023-12-16T03:16:08.461 INFO:tasks.workunit.client.1.smithi184.stdout:4/928: fdatasync d1/d12/d13/da1/fb6 0 2023-12-16T03:16:08.461 INFO:tasks.workunit.client.0.smithi064.stdout:1/670: sync 2023-12-16T03:16:08.462 INFO:tasks.workunit.client.0.smithi064.stdout:1/671: write d3/d36/d9e/f4b [4473046,56444] 0 2023-12-16T03:16:08.463 INFO:tasks.workunit.client.0.smithi064.stdout:7/636: creat d7/d3e/d42/d48/fce x:0 0 0 2023-12-16T03:16:08.466 INFO:tasks.workunit.client.0.smithi064.stdout:9/594: symlink d2/dc/d24/da9/lc0 0 2023-12-16T03:16:08.470 INFO:tasks.workunit.client.0.smithi064.stdout:8/666: creat d0/fe4 x:0 0 0 2023-12-16T03:16:08.470 INFO:tasks.workunit.client.0.smithi064.stdout:8/667: chown d0/db/d5a/d97/d38/lcd 17062 1 2023-12-16T03:16:08.470 INFO:tasks.workunit.client.1.smithi184.stdout:2/856: truncate d3/d29/d2f/d2e/f5d 3105822 0 2023-12-16T03:16:08.471 INFO:tasks.workunit.client.1.smithi184.stdout:1/901: creat d3/d13/d2c/f139 x:0 0 0 2023-12-16T03:16:08.471 INFO:tasks.workunit.client.1.smithi184.stdout:1/902: dread - d3/d34/dbc/d3c/d41/d46/d4a/de2/f10a zero size 2023-12-16T03:16:08.471 INFO:tasks.workunit.client.1.smithi184.stdout:1/903: fsync d3/d34/dbc/d3c/d41/d46/d4a/fad 0 2023-12-16T03:16:08.473 INFO:tasks.workunit.client.0.smithi064.stdout:5/537: getdents d0/d19/d48/d92 0 2023-12-16T03:16:08.474 INFO:tasks.workunit.client.0.smithi064.stdout:5/538: readlink d0/d14/d20/d37/l7e 0 2023-12-16T03:16:08.477 INFO:tasks.workunit.client.1.smithi184.stdout:7/924: creat d0/dd3/d11a/d79/d32/d39/d9c/dc2/f120 x:0 0 0 2023-12-16T03:16:08.479 INFO:tasks.workunit.client.0.smithi064.stdout:5/539: read d0/d50/d39/f63 [2388971,88516] 0 2023-12-16T03:16:08.479 INFO:tasks.workunit.client.0.smithi064.stdout:5/540: fdatasync d0/d19/d48/d8f/dac/ff 0 2023-12-16T03:16:08.480 INFO:tasks.workunit.client.0.smithi064.stdout:4/617: link d0/d42/d66/l49 d0/d42/d66/d5a/d75/lc6 0 2023-12-16T03:16:08.481 INFO:tasks.workunit.client.0.smithi064.stdout:4/618: write d0/d1e/d36/fa3 [185763,23243] 0 2023-12-16T03:16:08.483 INFO:tasks.workunit.client.0.smithi064.stdout:2/508: rename d1/d15/l97 to d1/d15/d1b/d9c/l9e 0 2023-12-16T03:16:08.483 INFO:tasks.workunit.client.0.smithi064.stdout:6/559: rename d3/d8/d1f to d3/d8/d1f/da6 22 2023-12-16T03:16:08.483 INFO:tasks.workunit.client.0.smithi064.stdout:6/560: fsync d3/d8/d13/d46/f98 0 2023-12-16T03:16:08.483 INFO:tasks.workunit.client.0.smithi064.stdout:6/561: write d3/d9/f18 [5092046,60747] 0 2023-12-16T03:16:08.487 INFO:tasks.workunit.client.1.smithi184.stdout:8/967: dwrite d2/d4/d10/d11/f1d [0,4194304] 0 2023-12-16T03:16:08.488 INFO:tasks.workunit.client.0.smithi064.stdout:6/562: write d3/d8/da/f23 [8276327,108307] 0 2023-12-16T03:16:08.488 INFO:tasks.workunit.client.1.smithi184.stdout:4/929: mkdir d1/d11/d1b/d1e/d128/d142 0 2023-12-16T03:16:08.488 INFO:tasks.workunit.client.0.smithi064.stdout:0/615: getdents d2/d5b/d8b 0 2023-12-16T03:16:08.489 INFO:tasks.workunit.client.0.smithi064.stdout:0/616: chown d2/d8/da/d11/d64/c71 128252 1 2023-12-16T03:16:08.490 INFO:tasks.workunit.client.1.smithi184.stdout:2/857: creat d3/d13/d28/d83/dda/f11e x:0 0 0 2023-12-16T03:16:08.492 INFO:tasks.workunit.client.1.smithi184.stdout:1/904: dread d3/d34/dbc/d3c/d41/d46/f8c [0,4194304] 0 2023-12-16T03:16:08.493 INFO:tasks.workunit.client.0.smithi064.stdout:8/668: rmdir d0/db/d37/d3a/d6f 39 2023-12-16T03:16:08.496 INFO:tasks.workunit.client.1.smithi184.stdout:8/968: rename d2/d4/d10/d11/f1d to d2/d4/d10/d7a/d83/f13a 0 2023-12-16T03:16:08.497 INFO:tasks.workunit.client.0.smithi064.stdout:5/541: creat d0/d19/d48/d8f/d3e/d35/d5d/fbd x:0 0 0 2023-12-16T03:16:08.499 INFO:tasks.workunit.client.0.smithi064.stdout:1/672: dwrite d3/d22/d57/db1/fc1 [0,4194304] 0 2023-12-16T03:16:08.500 INFO:tasks.workunit.client.0.smithi064.stdout:4/619: getdents d0/d1e/d36 0 2023-12-16T03:16:08.501 INFO:tasks.workunit.client.1.smithi184.stdout:2/858: symlink d3/d9/d19/d82/l11f 0 2023-12-16T03:16:08.505 INFO:tasks.workunit.client.1.smithi184.stdout:8/969: rename d2/d12/d21/d2d/d31/f63 to d2/d37/d7c/dd7/f13b 0 2023-12-16T03:16:08.506 INFO:tasks.workunit.client.1.smithi184.stdout:8/970: truncate d2/d37/f102 1407371 0 2023-12-16T03:16:08.506 INFO:tasks.workunit.client.0.smithi064.stdout:2/509: rename d1/d27/l40 to d1/d15/d67/l9f 0 2023-12-16T03:16:08.507 INFO:tasks.workunit.client.1.smithi184.stdout:2/859: symlink d3/d9/d19/l120 0 2023-12-16T03:16:08.508 INFO:tasks.workunit.client.1.smithi184.stdout:7/925: dwrite d0/d3/d4/ff8 [4194304,4194304] 0 2023-12-16T03:16:08.510 INFO:tasks.workunit.client.0.smithi064.stdout:3/732: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/fb7 [0,4194304] 0 2023-12-16T03:16:08.510 INFO:tasks.workunit.client.0.smithi064.stdout:3/733: fsync db/d12/d1a/d2c/d34/d4c/f7b 0 2023-12-16T03:16:08.513 INFO:tasks.workunit.client.1.smithi184.stdout:8/971: write d2/d12/d21/d8a/dda/d73/f111 [502540,84811] 0 2023-12-16T03:16:08.515 INFO:tasks.workunit.client.0.smithi064.stdout:0/617: mknod d2/d8/da/df/db0/cc9 0 2023-12-16T03:16:08.518 INFO:tasks.workunit.client.1.smithi184.stdout:2/860: getdents d3/d9 0 2023-12-16T03:16:08.518 INFO:tasks.workunit.client.1.smithi184.stdout:2/861: write d3/d13/d28/d83/fb9 [4248309,32569] 0 2023-12-16T03:16:08.519 INFO:tasks.workunit.client.1.smithi184.stdout:4/930: dwrite d1/d29/d34/d5c/f100 [0,4194304] 0 2023-12-16T03:16:08.520 INFO:tasks.workunit.client.1.smithi184.stdout:7/926: creat d0/dd3/d11a/d79/d32/d39/d9c/dc2/f121 x:0 0 0 2023-12-16T03:16:08.521 INFO:tasks.workunit.client.1.smithi184.stdout:4/931: read d1/d29/f2e [34429,129717] 0 2023-12-16T03:16:08.521 INFO:tasks.workunit.client.1.smithi184.stdout:4/932: chown d1/d12/db3/db8/dd2 164602 1 2023-12-16T03:16:08.523 INFO:tasks.workunit.client.0.smithi064.stdout:7/637: rename d7/d3e/c7f to d7/d26/d30/da3/dc3/ccf 0 2023-12-16T03:16:08.523 INFO:tasks.workunit.client.1.smithi184.stdout:2/862: read d3/f50 [2878150,88491] 0 2023-12-16T03:16:08.525 INFO:tasks.workunit.client.0.smithi064.stdout:5/542: dread d0/d14/d20/f38 [0,4194304] 0 2023-12-16T03:16:08.525 INFO:tasks.workunit.client.0.smithi064.stdout:1/673: dread d3/dd/d11/d3b/f69 [0,4194304] 0 2023-12-16T03:16:08.525 INFO:tasks.workunit.client.0.smithi064.stdout:1/674: fsync d3/d36/d44/d4d/da8/fd3 0 2023-12-16T03:16:08.525 INFO:tasks.workunit.client.0.smithi064.stdout:1/675: fdatasync d3/d36/d44/d4d/d58/f6e 0 2023-12-16T03:16:08.525 INFO:tasks.workunit.client.0.smithi064.stdout:3/734: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/fb7 [0,4194304] 0 2023-12-16T03:16:08.527 INFO:tasks.workunit.client.1.smithi184.stdout:8/972: mkdir d2/d6a/d13c 0 2023-12-16T03:16:08.530 INFO:tasks.workunit.client.0.smithi064.stdout:0/618: unlink d2/d7/d6b/f6e 0 2023-12-16T03:16:08.534 INFO:tasks.workunit.client.0.smithi064.stdout:9/595: rename d2/l1b to d2/d2d/d36/db4/lc1 0 2023-12-16T03:16:08.535 INFO:tasks.workunit.client.0.smithi064.stdout:7/638: rmdir d7/d3e/d42/d89/d20/d37/db1 39 2023-12-16T03:16:08.538 INFO:tasks.workunit.client.1.smithi184.stdout:7/927: getdents d0/dd3/d11a/da9 0 2023-12-16T03:16:08.538 INFO:tasks.workunit.client.1.smithi184.stdout:8/973: getdents d2/d4 0 2023-12-16T03:16:08.539 INFO:tasks.workunit.client.0.smithi064.stdout:3/735: creat db/d4f/d51/ff6 x:0 0 0 2023-12-16T03:16:08.541 INFO:tasks.workunit.client.1.smithi184.stdout:7/928: write d0/dd3/d11a/d79/f4d [615675,110812] 0 2023-12-16T03:16:08.541 INFO:tasks.workunit.client.0.smithi064.stdout:9/596: link d2/d2d/daf/fb0 d2/d2d/d3b/fc2 0 2023-12-16T03:16:08.542 INFO:tasks.workunit.client.1.smithi184.stdout:8/974: read d2/d12/d21/f6e [477,127731] 0 2023-12-16T03:16:08.543 INFO:tasks.workunit.client.0.smithi064.stdout:6/563: rename d3/d8/l69 to d3/d44/d7a/la7 0 2023-12-16T03:16:08.545 INFO:tasks.workunit.client.0.smithi064.stdout:1/676: read d3/dd/d23/f7c [501565,50210] 0 2023-12-16T03:16:08.545 INFO:tasks.workunit.client.0.smithi064.stdout:1/677: stat d3/dd/d23/d86/ca3 0 2023-12-16T03:16:08.548 INFO:tasks.workunit.client.0.smithi064.stdout:3/736: truncate db/d12/d1a/f28 935926 0 2023-12-16T03:16:08.549 INFO:tasks.workunit.client.0.smithi064.stdout:6/564: mkdir d3/d8/d13/d46/d5e/da8 0 2023-12-16T03:16:08.549 INFO:tasks.workunit.client.0.smithi064.stdout:6/565: chown d3/d9/l6a 0 1 2023-12-16T03:16:08.550 INFO:tasks.workunit.client.1.smithi184.stdout:7/929: readlink d0/dd3/d11a/d79/l16 0 2023-12-16T03:16:08.550 INFO:tasks.workunit.client.1.smithi184.stdout:8/975: symlink d2/d12/d21/d2d/l13d 0 2023-12-16T03:16:08.550 INFO:tasks.workunit.client.0.smithi064.stdout:1/678: symlink d3/d36/d44/d4d/da8/dce/ldb 0 2023-12-16T03:16:08.551 INFO:tasks.workunit.client.0.smithi064.stdout:6/566: creat d3/d44/fa9 x:0 0 0 2023-12-16T03:16:08.553 INFO:tasks.workunit.client.1.smithi184.stdout:7/930: dread d0/dd3/d11a/d79/d36/f66 [0,4194304] 0 2023-12-16T03:16:08.554 INFO:tasks.workunit.client.1.smithi184.stdout:7/931: dread - d0/dd3/d11a/d79/d36/d3f/fe3 zero size 2023-12-16T03:16:08.554 INFO:tasks.workunit.client.0.smithi064.stdout:1/679: dread d3/dd/f42 [0,4194304] 0 2023-12-16T03:16:08.554 INFO:tasks.workunit.client.1.smithi184.stdout:8/976: write d2/d12/d21/f8c [1829506,53902] 0 2023-12-16T03:16:08.555 INFO:tasks.workunit.client.1.smithi184.stdout:8/977: read d2/d12/d21/d8a/fb2 [15620,30193] 0 2023-12-16T03:16:08.555 INFO:tasks.workunit.client.1.smithi184.stdout:7/932: mkdir d0/d6b/d69/d122 0 2023-12-16T03:16:08.556 INFO:tasks.workunit.client.0.smithi064.stdout:7/639: rmdir d7/d3e/d42/d48 39 2023-12-16T03:16:08.557 INFO:tasks.workunit.client.1.smithi184.stdout:1/905: dwrite d3/d13/d121/f134 [0,4194304] 0 2023-12-16T03:16:08.560 INFO:tasks.workunit.client.1.smithi184.stdout:8/978: link d2/d4/l5 d2/d37/d7c/ddc/de6/d12d/l13e 0 2023-12-16T03:16:08.560 INFO:tasks.workunit.client.0.smithi064.stdout:7/640: rmdir d7/d3e/d42/d89/d20/d6f/d93 39 2023-12-16T03:16:08.565 INFO:tasks.workunit.client.0.smithi064.stdout:8/669: dwrite d0/da/d3e/d46/d54/d7c/db7/faf [0,4194304] 0 2023-12-16T03:16:08.565 INFO:tasks.workunit.client.0.smithi064.stdout:8/670: readlink d0/ld 0 2023-12-16T03:16:08.572 INFO:tasks.workunit.client.0.smithi064.stdout:5/543: dwrite d0/d19/d48/d8f/d5e/f93 [0,4194304] 0 2023-12-16T03:16:08.572 INFO:tasks.workunit.client.0.smithi064.stdout:5/544: write d0/d7/d34/f83 [1045444,116869] 0 2023-12-16T03:16:08.573 INFO:tasks.workunit.client.0.smithi064.stdout:9/597: dwrite d2/dc/d24/d39/d5e/d6f/f7a [0,4194304] 0 2023-12-16T03:16:08.573 INFO:tasks.workunit.client.1.smithi184.stdout:2/863: dwrite d3/d29/d2f/d2e/dcb/f10b [0,4194304] 0 2023-12-16T03:16:08.573 INFO:tasks.workunit.client.1.smithi184.stdout:4/933: dwrite d1/d12/fcc [0,4194304] 0 2023-12-16T03:16:08.574 INFO:tasks.workunit.client.0.smithi064.stdout:0/619: dwrite d2/d29/f9f [0,4194304] 0 2023-12-16T03:16:08.576 INFO:tasks.workunit.client.0.smithi064.stdout:4/620: dwrite d0/d42/d53/fb8 [0,4194304] 0 2023-12-16T03:16:08.576 INFO:tasks.workunit.client.0.smithi064.stdout:4/621: stat d0/d42/d66/d33 0 2023-12-16T03:16:08.576 INFO:tasks.workunit.client.0.smithi064.stdout:2/510: dwrite d1/d15/d1b/d9c/d69/f78 [4194304,4194304] 0 2023-12-16T03:16:08.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.575+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 --> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f79e4065a80 con 0x7f79d0038350 2023-12-16T03:16:08.589 INFO:tasks.workunit.client.0.smithi064.stdout:7/641: dwrite d7/d3e/d42/d89/d20/d37/f69 [0,4194304] 0 2023-12-16T03:16:08.589 INFO:tasks.workunit.client.0.smithi064.stdout:7/642: chown d7/d26/d30/ca7 3 1 2023-12-16T03:16:08.589 INFO:tasks.workunit.client.1.smithi184.stdout:8/979: dwrite d2/d37/d7c/fc0 [0,4194304] 0 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.588+0000 7f79da7fc700 1 -- 172.21.15.64:0/3868023282 <== mgr.14582 v2:172.21.15.184:6828/2992718398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f79e4065a80 con 0x7f79d0038350 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (5m) 115s ago 6m 29.3M - 0.25.0 c8568f914cd2 14aee4a706e2 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (6m) 115s ago 6m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (5m) 7s ago 5m 7482k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (5m) 115s ago 5m 88.2M - 9.4.7 954c08fa6188 697184eb15a8 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (2m) 115s ago 2m 12.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (2m) 115s ago 2m 16.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (2m) 7s ago 2m 1668M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (2m) 7s ago 2m 13.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:16:08.591 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:9283 running (7m) 115s ago 7m 496M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f40249c90cfb 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283 running (13s) 7s ago 5m 63.7M - 19.0.0-191-g6d933094 a29c258b5d6f 5067afd9ddca 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (7m) 115s ago 7m 75.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (5m) 7s ago 5m 55.2M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (6m) 115s ago 6m 16.1M - 1.5.0 0da6a335fe13 c8706c3a2b59 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (5m) 7s ago 5m 18.6M - 1.5.0 0da6a335fe13 67ad2f701450 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (4m) 115s ago 4m 58.6M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (4m) 115s ago 4m 59.5M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (4m) 115s ago 4m 57.0M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (3m) 7s ago 3m 507M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (3m) 7s ago 3m 415M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (3m) 7s ago 3m 481M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:16:08.592 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (4m) 115s ago 5m 46.5M - 2.43.0 a07b618ecd1d 91a18452d564 2023-12-16T03:16:08.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.590+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f79d0038350 msgr2=0x7f79d003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:08.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.590+0000 7f79ebe8e700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f79d0038350 0x7f79d003a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f79e0013680 tx=0x7f79e0009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:08.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.590+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fcd00 msgr2=0x7f79e40fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:08.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.590+0000 7f79ebe8e700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fcd00 0x7f79e40fe040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f79d400eb40 tx=0x7f79d400b040 comp rx=0 tx=0).stop 2023-12-16T03:16:08.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.591+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 shutdown_connections 2023-12-16T03:16:08.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.591+0000 7f79ebe8e700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f79d0038350 0x7f79d003a800 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.591+0000 7f79ebe8e700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e40fbaf0 0x7f79e40ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.591+0000 7f79ebe8e700 1 --2- 172.21.15.64:0/3868023282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40fcd00 0x7f79e40fe040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.591+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 >> 172.21.15.64:0/3868023282 conn(0x7f79e40f7190 msgr2=0x7f79e4065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:08.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.591+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 shutdown_connections 2023-12-16T03:16:08.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.591+0000 7f79ebe8e700 1 -- 172.21.15.64:0/3868023282 wait complete. 2023-12-16T03:16:08.606 INFO:tasks.workunit.client.1.smithi184.stdout:4/934: dwrite d1/d12/d13/da1/fe2 [0,4194304] 0 2023-12-16T03:16:08.606 INFO:tasks.workunit.client.0.smithi064.stdout:4/622: dwrite d0/da/f6d [0,4194304] 0 2023-12-16T03:16:08.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.695+0000 7fe65ddb9700 1 -- 172.21.15.64:0/768316678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 msgr2=0x7fe658070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:08.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.695+0000 7fe65ddb9700 1 --2- 172.21.15.64:0/768316678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 0x7fe658070980 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe64c004940 tx=0x7fe64c009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:08.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.696+0000 7fe65ddb9700 1 -- 172.21.15.64:0/768316678 shutdown_connections 2023-12-16T03:16:08.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.696+0000 7fe65ddb9700 1 --2- 172.21.15.64:0/768316678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 0x7fe658070980 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.696+0000 7fe65ddb9700 1 --2- 172.21.15.64:0/768316678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe658071b60 0x7fe65806ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.696+0000 7fe65ddb9700 1 -- 172.21.15.64:0/768316678 >> 172.21.15.64:0/768316678 conn(0x7fe6580f82d0 msgr2=0x7fe6580fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:08.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.696+0000 7fe65ddb9700 1 -- 172.21.15.64:0/768316678 shutdown_connections 2023-12-16T03:16:08.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.696+0000 7fe65ddb9700 1 -- 172.21.15.64:0/768316678 wait complete. 2023-12-16T03:16:08.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.696+0000 7fe65ddb9700 1 Processor -- start 2023-12-16T03:16:08.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.696+0000 7fe65ddb9700 1 -- start start 2023-12-16T03:16:08.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe65ddb9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 0x7fe65810f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:08.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe65ddb9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe658071b60 0x7fe65810fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:08.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe65ddb9700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6581102d0 con 0x7fe658070510 2023-12-16T03:16:08.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe65ddb9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe658110b70 con 0x7fe658071b60 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe6577fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 0x7fe65810f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe6577fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 0x7fe65810f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51380/0 (socket says 172.21.15.64:51380) 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe6577fe700 1 -- 172.21.15.64:0/3160997960 learned_addr learned my addr 172.21.15.64:0/3160997960 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe656ffd700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe658071b60 0x7fe65810fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe6577fe700 1 -- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe658071b60 msgr2=0x7fe65810fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe6577fe700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe658071b60 0x7fe65810fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe6577fe700 1 -- 172.21.15.64:0/3160997960 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c005040 con 0x7fe658070510 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe6577fe700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 0x7fe65810f790 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe64800eb40 tx=0x7fe64800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe63ffff700 1 -- 172.21.15.64:0/3160997960 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe648007cc0 con 0x7fe658070510 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.697+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe658110df0 con 0x7fe658070510 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.698+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe658111330 con 0x7fe658070510 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.698+0000 7fe63ffff700 1 -- 172.21.15.64:0/3160997960 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe64800f040 con 0x7fe658070510 2023-12-16T03:16:08.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.698+0000 7fe63ffff700 1 -- 172.21.15.64:0/3160997960 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe64800c990 con 0x7fe658070510 2023-12-16T03:16:08.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.698+0000 7fe63ffff700 1 -- 172.21.15.64:0/3160997960 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 21) v1 ==== 45378+0+0 (secure 0 0 0) 0x7fe64800cc00 con 0x7fe658070510 2023-12-16T03:16:08.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.699+0000 7fe63ffff700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fe640038350 0x7fe64003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:08.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.699+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6440052e0 con 0x7fe658070510 2023-12-16T03:16:08.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.699+0000 7fe63ffff700 1 -- 172.21.15.64:0/3160997960 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe64804c5b0 con 0x7fe658070510 2023-12-16T03:16:08.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.699+0000 7fe656ffd700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fe640038350 0x7fe64003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:08.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.699+0000 7fe656ffd700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fe640038350 0x7fe64003a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe64c000c00 tx=0x7fe64c009e30 comp rx=0 tx=0).ready entity=mgr.14582 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:08.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:08.708+0000 7fe63ffff700 1 -- 172.21.15.64:0/3160997960 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe64801b2c0 con 0x7fe658070510 2023-12-16T03:16:08.730 INFO:tasks.workunit.client.0.smithi064.stdout:6/567: symlink d3/d8/d1f/d26/laa 0 2023-12-16T03:16:08.730 INFO:tasks.workunit.client.0.smithi064.stdout:6/568: dread - d3/f9a zero size 2023-12-16T03:16:08.741 INFO:tasks.workunit.client.0.smithi064.stdout:6/569: dread d3/d8/da/f23 [0,4194304] 0 2023-12-16T03:16:08.744 INFO:tasks.workunit.client.0.smithi064.stdout:5/545: rmdir d0/d14/d20/d37/d70/d71 39 2023-12-16T03:16:08.744 INFO:tasks.workunit.client.0.smithi064.stdout:5/546: fsync d0/d19/d48/d8f/d3e/d35/f8a 0 2023-12-16T03:16:08.744 INFO:tasks.workunit.client.0.smithi064.stdout:5/547: fdatasync d0/d7/d34/f5c 0 2023-12-16T03:16:08.746 INFO:tasks.workunit.client.1.smithi184.stdout:1/906: unlink d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/c100 0 2023-12-16T03:16:08.750 INFO:tasks.workunit.client.1.smithi184.stdout:2/864: mknod d3/d29/d4d/c121 0 2023-12-16T03:16:08.751 INFO:tasks.workunit.client.0.smithi064.stdout:9/598: mkdir d2/dc/d24/db2/dc3 0 2023-12-16T03:16:08.760 INFO:tasks.workunit.client.0.smithi064.stdout:5/548: dread d0/d14/d20/d37/d70/f81 [0,4194304] 0 2023-12-16T03:16:08.763 INFO:tasks.workunit.client.1.smithi184.stdout:8/980: getdents d2/d12/db4 0 2023-12-16T03:16:08.763 INFO:tasks.workunit.client.1.smithi184.stdout:8/981: chown d2/d12/d21/d2d/d31/d34/d96/dca/de8 244057270 1 2023-12-16T03:16:08.767 INFO:tasks.workunit.client.0.smithi064.stdout:0/620: creat d2/d7/d10/d21/d31/fca x:0 0 0 2023-12-16T03:16:08.773 INFO:tasks.workunit.client.1.smithi184.stdout:4/935: symlink d1/d12/d13/da1/l143 0 2023-12-16T03:16:08.773 INFO:tasks.workunit.client.1.smithi184.stdout:4/936: truncate d1/d11/d1b/d1e/f5d 4261790 0 2023-12-16T03:16:08.773 INFO:tasks.workunit.client.0.smithi064.stdout:3/737: dread db/d12/d1a/f28 [0,4194304] 0 2023-12-16T03:16:08.777 INFO:tasks.workunit.client.1.smithi184.stdout:1/907: symlink d3/d34/dbc/d3c/d41/d63/de1/l13a 0 2023-12-16T03:16:08.779 INFO:tasks.workunit.client.1.smithi184.stdout:2/865: unlink d3/d13/d28/d83/dda/ff9 0 2023-12-16T03:16:08.780 INFO:tasks.workunit.client.0.smithi064.stdout:5/549: dwrite d0/f6c [0,4194304] 0 2023-12-16T03:16:08.781 INFO:tasks.workunit.client.1.smithi184.stdout:8/982: mkdir d2/d4/d10/d11/d77/d13f 0 2023-12-16T03:16:08.781 INFO:tasks.workunit.client.1.smithi184.stdout:8/983: write d2/d12/d21/d8a/dda/f98 [2034584,6426] 0 2023-12-16T03:16:08.783 INFO:tasks.workunit.client.1.smithi184.stdout:4/937: mkdir d1/d11/d5a/d63/d103/d45/dcf/de6/d144 0 2023-12-16T03:16:08.787 INFO:tasks.workunit.client.1.smithi184.stdout:1/908: rename d3/d34/dbc/d3c/d24/cb6 to d3/d13/d121/d99/c13b 0 2023-12-16T03:16:08.788 INFO:tasks.workunit.client.1.smithi184.stdout:5/759: sync 2023-12-16T03:16:08.788 INFO:tasks.workunit.client.0.smithi064.stdout:5/550: dread d0/d19/d48/d8f/d5e/d84/faf [4194304,4194304] 0 2023-12-16T03:16:08.790 INFO:tasks.workunit.client.1.smithi184.stdout:2/866: stat d3/c79 0 2023-12-16T03:16:08.794 INFO:tasks.workunit.client.0.smithi064.stdout:7/643: symlink d7/d3e/d42/d89/d20/ld0 0 2023-12-16T03:16:08.795 INFO:tasks.workunit.client.1.smithi184.stdout:8/984: truncate d2/d12/d21/d2d/d31/d34/f67 1804014 0 2023-12-16T03:16:08.801 INFO:tasks.workunit.client.1.smithi184.stdout:8/985: dread d2/d12/d21/d8a/fb2 [0,4194304] 0 2023-12-16T03:16:08.806 INFO:tasks.workunit.client.1.smithi184.stdout:1/909: rmdir d3/d34/d76/d91/d127/d138 0 2023-12-16T03:16:08.807 INFO:tasks.workunit.client.0.smithi064.stdout:8/671: dread d0/d1d/d73/fc4 [0,4194304] 0 2023-12-16T03:16:08.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:08 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:08.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:08 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:08.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:08 smithi184 ceph-mon[121180]: Deploying cephadm binary to smithi184 2023-12-16T03:16:08.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:08 smithi184 ceph-mon[121180]: Deploying cephadm binary to smithi064 2023-12-16T03:16:08.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:08 smithi184 ceph-mon[121180]: mgrmap e21: smithi184.urtxla(active, since 1.05114s) 2023-12-16T03:16:08.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:08 smithi184 ceph-mon[121180]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:08.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:08 smithi184 ceph-mon[121180]: pgmap v3: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2023-12-16T03:16:08.811 INFO:tasks.workunit.client.0.smithi064.stdout:6/570: truncate d3/f5 1706239 0 2023-12-16T03:16:08.812 INFO:tasks.workunit.client.1.smithi184.stdout:5/760: unlink d1/d2a/d31/d28/c93 0 2023-12-16T03:16:08.814 INFO:tasks.workunit.client.1.smithi184.stdout:2/867: dwrite d3/d9/d19/f37 [0,4194304] 0 2023-12-16T03:16:08.815 INFO:tasks.workunit.client.0.smithi064.stdout:2/511: rename d1/d15/d67 to d1/d15/d1b/d49/da0 0 2023-12-16T03:16:08.817 INFO:tasks.workunit.client.0.smithi064.stdout:9/599: creat d2/d7e/fc4 x:0 0 0 2023-12-16T03:16:08.820 INFO:tasks.workunit.client.1.smithi184.stdout:7/933: sync 2023-12-16T03:16:08.822 INFO:tasks.workunit.client.0.smithi064.stdout:5/551: creat d0/d7/d8b/fbe x:0 0 0 2023-12-16T03:16:08.822 INFO:tasks.workunit.client.1.smithi184.stdout:8/986: mknod d2/d4/c140 0 2023-12-16T03:16:08.823 INFO:tasks.workunit.client.0.smithi064.stdout:8/672: mkdir d0/d1d/d24/d9c/de5 0 2023-12-16T03:16:08.824 INFO:tasks.workunit.client.0.smithi064.stdout:7/644: dwrite d7/d3e/d42/d89/d20/d37/f69 [0,4194304] 0 2023-12-16T03:16:08.825 INFO:tasks.workunit.client.1.smithi184.stdout:1/910: mkdir d3/d34/dbc/d3c/d41/d46/d13c 0 2023-12-16T03:16:08.826 INFO:tasks.workunit.client.0.smithi064.stdout:4/623: dread d0/d42/d66/d33/fad [0,4194304] 0 2023-12-16T03:16:08.828 INFO:tasks.workunit.client.1.smithi184.stdout:5/761: symlink d1/d3/d9/de/d15/d90/lfc 0 2023-12-16T03:16:08.829 INFO:tasks.workunit.client.0.smithi064.stdout:2/512: dwrite d1/d15/d23/d2d/f3c [0,4194304] 0 2023-12-16T03:16:08.829 INFO:tasks.workunit.client.0.smithi064.stdout:2/513: truncate d1/d27/f4f 1405807 0 2023-12-16T03:16:08.829 INFO:tasks.workunit.client.0.smithi064.stdout:2/514: fdatasync d1/d15/d1b/d49/f8b 0 2023-12-16T03:16:08.831 INFO:tasks.workunit.client.1.smithi184.stdout:8/987: dread d2/d37/db8/fe9 [0,4194304] 0 2023-12-16T03:16:08.831 INFO:tasks.workunit.client.0.smithi064.stdout:6/571: unlink d3/d8/c84 0 2023-12-16T03:16:08.831 INFO:tasks.workunit.client.0.smithi064.stdout:6/572: chown d3/d44/d7a/la7 146 1 2023-12-16T03:16:08.831 INFO:tasks.workunit.client.0.smithi064.stdout:6/573: chown d3/d9 25091 1 2023-12-16T03:16:08.836 INFO:tasks.workunit.client.1.smithi184.stdout:2/868: truncate d3/d13/d6e/fd5 321407 0 2023-12-16T03:16:08.838 INFO:tasks.workunit.client.1.smithi184.stdout:2/869: write d3/d9/d19/fa7 [921426,44499] 0 2023-12-16T03:16:08.839 INFO:tasks.workunit.client.1.smithi184.stdout:7/934: mknod d0/dd3/d11a/d3b/c123 0 2023-12-16T03:16:08.844 INFO:tasks.workunit.client.1.smithi184.stdout:1/911: symlink d3/d13/d121/d99/db7/l13d 0 2023-12-16T03:16:08.846 INFO:tasks.workunit.client.0.smithi064.stdout:2/515: dwrite d1/d15/d1b/d49/f8b [0,4194304] 0 2023-12-16T03:16:08.847 INFO:tasks.workunit.client.1.smithi184.stdout:1/912: write d3/d34/dbc/d3c/d41/f8a [2703243,4201] 0 2023-12-16T03:16:08.848 INFO:tasks.workunit.client.1.smithi184.stdout:5/762: unlink d1/d3/d9/de/d15/d19/d3a/cb7 0 2023-12-16T03:16:08.853 INFO:tasks.workunit.client.1.smithi184.stdout:8/988: rmdir d2/d4/d10/d11/d72 39 2023-12-16T03:16:08.853 INFO:tasks.workunit.client.1.smithi184.stdout:8/989: fsync d2/fc 0 2023-12-16T03:16:08.854 INFO:tasks.workunit.client.0.smithi064.stdout:0/621: rename d2/d8/da/df/daf/ca3 to d2/d7/d10/d85/d88/ccb 0 2023-12-16T03:16:08.856 INFO:tasks.workunit.client.1.smithi184.stdout:2/870: rename d3/d29/d2f/d46/c92 to d3/d29/d2f/d46/c122 0 2023-12-16T03:16:08.857 INFO:tasks.workunit.client.0.smithi064.stdout:9/600: truncate d2/f2e 5151046 0 2023-12-16T03:16:08.860 INFO:tasks.workunit.client.1.smithi184.stdout:7/935: rename d0/dd3/d11a/d79/d36/d3f/fdb to d0/dd3/d11a/d79/d34/dc1/d107/f124 0 2023-12-16T03:16:08.861 INFO:tasks.workunit.client.0.smithi064.stdout:5/552: creat d0/d50/d39/fbf x:0 0 0 2023-12-16T03:16:08.862 INFO:tasks.workunit.client.0.smithi064.stdout:5/553: fsync d0/d19/d48/d8f/d3e/d35/f54 0 2023-12-16T03:16:08.865 INFO:tasks.workunit.client.0.smithi064.stdout:8/673: symlink d0/da/d3e/d46/d54/d7c/d85/le6 0 2023-12-16T03:16:08.865 INFO:tasks.workunit.client.0.smithi064.stdout:8/674: fsync d0/da/d3e/f53 0 2023-12-16T03:16:08.865 INFO:tasks.workunit.client.0.smithi064.stdout:8/675: write d0/db/d12/d44/d68/fc6 [95690,813] 0 2023-12-16T03:16:08.866 INFO:tasks.workunit.client.0.smithi064.stdout:8/676: read d0/db/d37/d3a/f57 [1239232,26581] 0 2023-12-16T03:16:08.867 INFO:tasks.workunit.client.1.smithi184.stdout:5/763: dwrite d1/d3/d9/de/f37 [0,4194304] 0 2023-12-16T03:16:08.869 INFO:tasks.workunit.client.1.smithi184.stdout:8/990: symlink d2/d12/d21/d2d/l141 0 2023-12-16T03:16:08.871 INFO:tasks.workunit.client.0.smithi064.stdout:7/645: creat d7/d26/dc2/fd1 x:0 0 0 2023-12-16T03:16:08.871 INFO:tasks.workunit.client.0.smithi064.stdout:7/646: write d7/d3e/d42/d48/fce [401903,115513] 0 2023-12-16T03:16:08.871 INFO:tasks.workunit.client.0.smithi064.stdout:7/647: dread - d7/d3e/d42/d43/f7e zero size 2023-12-16T03:16:08.871 INFO:tasks.workunit.client.0.smithi064.stdout:7/648: chown d7/d3e/d42/d89/d20/d6f/d93/db0 25 1 2023-12-16T03:16:08.873 INFO:tasks.workunit.client.1.smithi184.stdout:2/871: mkdir d3/d29/d4d/d123 0 2023-12-16T03:16:08.876 INFO:tasks.workunit.client.0.smithi064.stdout:9/601: dwrite d2/dc/f11 [0,4194304] 0 2023-12-16T03:16:08.877 INFO:tasks.workunit.client.0.smithi064.stdout:4/624: getdents d0/d42/d66/d33 0 2023-12-16T03:16:08.877 INFO:tasks.workunit.client.1.smithi184.stdout:7/936: creat d0/dd3/d11a/d79/d32/d39/d9c/dc2/ddd/d110/f125 x:0 0 0 2023-12-16T03:16:08.879 INFO:tasks.workunit.client.1.smithi184.stdout:5/764: dread d1/f66 [0,4194304] 0 2023-12-16T03:16:08.880 INFO:tasks.workunit.client.1.smithi184.stdout:1/913: mknod d3/d34/d76/d91/c13e 0 2023-12-16T03:16:08.880 INFO:tasks.workunit.client.1.smithi184.stdout:1/914: dread - d3/d13/d2c/f139 zero size 2023-12-16T03:16:08.881 INFO:tasks.workunit.client.0.smithi064.stdout:4/625: write d0/da/f9f [3894056,60813] 0 2023-12-16T03:16:08.887 INFO:tasks.workunit.client.1.smithi184.stdout:8/991: dwrite d2/d4/d10/d7a/d83/d8b/de0/dfb/f12f [0,4194304] 0 2023-12-16T03:16:08.889 INFO:tasks.workunit.client.0.smithi064.stdout:6/574: mknod d3/d8/d13/d58/d65/d6e/cab 0 2023-12-16T03:16:08.889 INFO:tasks.workunit.client.1.smithi184.stdout:2/872: rename d3/d29/d2f/lea to d3/d29/l124 0 2023-12-16T03:16:08.892 INFO:tasks.workunit.client.1.smithi184.stdout:5/765: dread d1/d3/d2f/f3d [0,4194304] 0 2023-12-16T03:16:08.894 INFO:tasks.workunit.client.0.smithi064.stdout:2/516: rmdir d1/d15/d1b/d61/d63 39 2023-12-16T03:16:08.896 INFO:tasks.workunit.client.1.smithi184.stdout:1/915: creat d3/d34/d76/d91/f13f x:0 0 0 2023-12-16T03:16:08.898 INFO:tasks.workunit.client.0.smithi064.stdout:3/738: rename db/d12/d1a/d2c/db5/dc5 to db/d12/d1a/d31/df7 0 2023-12-16T03:16:08.898 INFO:tasks.workunit.client.0.smithi064.stdout:3/739: chown db/d4f/da9/dbf/d75/d92 11464486 1 2023-12-16T03:16:08.900 INFO:tasks.workunit.client.0.smithi064.stdout:0/622: rmdir d2/d7/d10/d85 39 2023-12-16T03:16:08.907 INFO:tasks.workunit.client.1.smithi184.stdout:8/992: rename d2/f135 to d2/d37/d117/f142 0 2023-12-16T03:16:08.908 INFO:tasks.workunit.client.1.smithi184.stdout:2/873: dread d3/d29/d4d/d5b/da6/fe0 [0,4194304] 0 2023-12-16T03:16:08.908 INFO:tasks.workunit.client.1.smithi184.stdout:2/874: truncate d3/d13/ddf/d10a/f10c 836531 0 2023-12-16T03:16:08.910 INFO:tasks.workunit.client.0.smithi064.stdout:4/626: dwrite d0/d42/d53/f1d [4194304,4194304] 0 2023-12-16T03:16:08.911 INFO:tasks.workunit.client.0.smithi064.stdout:8/677: symlink d0/d1d/d48/le7 0 2023-12-16T03:16:08.912 INFO:tasks.workunit.client.0.smithi064.stdout:7/649: getdents d7/d3e/d42/d89/d20/d37/db1/db6 0 2023-12-16T03:16:08.915 INFO:tasks.workunit.client.0.smithi064.stdout:9/602: getdents d2/dc/d24/d39/d42/d57 0 2023-12-16T03:16:08.916 INFO:tasks.workunit.client.1.smithi184.stdout:8/993: dread d2/d4/d10/d11/d77/ff5 [0,4194304] 0 2023-12-16T03:16:08.920 INFO:tasks.workunit.client.1.smithi184.stdout:5/766: symlink d1/d3/d9/de/lfd 0 2023-12-16T03:16:08.920 INFO:tasks.workunit.client.1.smithi184.stdout:5/767: truncate d1/d3/d9/de/d15/d19/d3a/fea 257586 0 2023-12-16T03:16:08.921 INFO:tasks.workunit.client.0.smithi064.stdout:3/740: dwrite db/d12/d21/f30 [0,4194304] 0 2023-12-16T03:16:08.923 INFO:tasks.workunit.client.1.smithi184.stdout:7/937: mknod d0/d3/c126 0 2023-12-16T03:16:08.929 INFO:tasks.workunit.client.1.smithi184.stdout:1/916: rename d3/d34/dbc/d3c/d41/d46/d4a/cdd to d3/d34/dbc/d3c/d41/c140 0 2023-12-16T03:16:08.929 INFO:tasks.workunit.client.1.smithi184.stdout:1/917: dread - d3/d34/dbc/d36/d9f/fea zero size 2023-12-16T03:16:08.930 INFO:tasks.workunit.client.0.smithi064.stdout:6/575: rename d3/d8/d13/d58/c6d to d3/d8/d13/d58/cac 0 2023-12-16T03:16:08.933 INFO:tasks.workunit.client.1.smithi184.stdout:8/994: mknod d2/d4/d10/d11/d119/c143 0 2023-12-16T03:16:08.934 INFO:tasks.workunit.client.0.smithi064.stdout:2/517: creat d1/d15/d23/d2d/fa1 x:0 0 0 2023-12-16T03:16:08.935 INFO:tasks.workunit.client.1.smithi184.stdout:1/918: dread d3/d34/dbc/d3c/d41/d46/f8c [0,4194304] 0 2023-12-16T03:16:08.939 INFO:tasks.workunit.client.1.smithi184.stdout:2/875: rename d3/d13/d28/dac/daf/dc8/fe6 to d3/d13/f125 0 2023-12-16T03:16:08.942 INFO:tasks.workunit.client.0.smithi064.stdout:5/554: rename d0/d19/d48/d8f/dac/d23/d67/d95 to d0/d7/d8b/dc0 0 2023-12-16T03:16:08.945 INFO:tasks.workunit.client.1.smithi184.stdout:8/995: mknod d2/c144 0 2023-12-16T03:16:08.946 INFO:tasks.workunit.client.0.smithi064.stdout:4/627: rmdir d0/d42/d66/d33 39 2023-12-16T03:16:08.946 INFO:tasks.workunit.client.0.smithi064.stdout:4/628: fsync d0/d1e/d36/f7e 0 2023-12-16T03:16:08.946 INFO:tasks.workunit.client.0.smithi064.stdout:4/629: write d0/da/f9f [4395149,76582] 0 2023-12-16T03:16:08.948 INFO:tasks.workunit.client.1.smithi184.stdout:1/919: truncate d3/d34/dbc/d3c/d41/d77/ff3 3925199 0 2023-12-16T03:16:08.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:08 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:08.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:08 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:08.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:08 smithi064 ceph-mon[111958]: Deploying cephadm binary to smithi184 2023-12-16T03:16:08.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:08 smithi064 ceph-mon[111958]: Deploying cephadm binary to smithi064 2023-12-16T03:16:08.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:08 smithi064 ceph-mon[111958]: mgrmap e21: smithi184.urtxla(active, since 1.05114s) 2023-12-16T03:16:08.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:08 smithi064 ceph-mon[111958]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:08.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:08 smithi064 ceph-mon[111958]: pgmap v3: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2023-12-16T03:16:08.951 INFO:tasks.workunit.client.0.smithi064.stdout:8/678: truncate d0/da/f65 1932430 0 2023-12-16T03:16:08.953 INFO:tasks.workunit.client.1.smithi184.stdout:7/938: creat d0/dd3/d11a/d79/d1e/f127 x:0 0 0 2023-12-16T03:16:08.953 INFO:tasks.workunit.client.1.smithi184.stdout:7/939: chown d0/dd3/d11a/d3b/d10e 16652358 1 2023-12-16T03:16:08.953 INFO:tasks.workunit.client.1.smithi184.stdout:7/940: write d0/dd3/d11a/d79/d1e/fde [524535,75032] 0 2023-12-16T03:16:08.953 INFO:tasks.workunit.client.1.smithi184.stdout:7/941: write d0/dd3/d11a/d79/d36/d3f/df9/ffe [479601,6228] 0 2023-12-16T03:16:08.954 INFO:tasks.workunit.client.0.smithi064.stdout:7/650: unlink d7/d3e/d42/d48/d51/d7c/l84 0 2023-12-16T03:16:08.958 INFO:tasks.workunit.client.1.smithi184.stdout:5/768: rename d1/d3/d9/de/d15/d19/d53/f8c to d1/d3/d9/de/da5/ffe 0 2023-12-16T03:16:08.961 INFO:tasks.workunit.client.0.smithi064.stdout:9/603: creat d2/d2d/daf/fc5 x:0 0 0 2023-12-16T03:16:08.961 INFO:tasks.workunit.client.1.smithi184.stdout:5/769: read d1/f1a [788759,58997] 0 2023-12-16T03:16:08.961 INFO:tasks.workunit.client.1.smithi184.stdout:5/770: chown d1/d3/d2f/f3b 1869372546 1 2023-12-16T03:16:08.961 INFO:tasks.workunit.client.1.smithi184.stdout:5/771: write d1/d3/d2f/db5/fba [829135,46296] 0 2023-12-16T03:16:08.962 INFO:tasks.workunit.client.1.smithi184.stdout:2/876: dwrite d3/d13/ddf/d10a/f10c [0,4194304] 0 2023-12-16T03:16:08.963 INFO:tasks.workunit.client.1.smithi184.stdout:1/920: mkdir d3/d13/d121/dc7/d141 0 2023-12-16T03:16:08.965 INFO:tasks.workunit.client.0.smithi064.stdout:3/741: mknod db/d12/d1a/d2c/d34/dcd/cf8 0 2023-12-16T03:16:08.965 INFO:tasks.workunit.client.0.smithi064.stdout:5/555: dread d0/d19/d48/d8f/dac/ff [0,4194304] 0 2023-12-16T03:16:08.968 INFO:tasks.workunit.client.1.smithi184.stdout:7/942: mknod d0/dd3/d11a/d79/d36/d108/c128 0 2023-12-16T03:16:08.968 INFO:tasks.workunit.client.1.smithi184.stdout:7/943: chown d0/dd3/d11a/d79/d32/d39/d8f/lbc 139 1 2023-12-16T03:16:08.969 INFO:tasks.workunit.client.0.smithi064.stdout:5/556: write d0/d14/d20/d37/d3c/f52 [3994244,8063] 0 2023-12-16T03:16:08.971 INFO:tasks.workunit.client.1.smithi184.stdout:8/996: rename d2/d12/d21/d2d/d31/d34/d96/dca/d10d/c11a to d2/d37/d7c/dd7/c145 0 2023-12-16T03:16:08.972 INFO:tasks.workunit.client.1.smithi184.stdout:5/772: mkdir d1/d3/d9/de/d30/d68/dff 0 2023-12-16T03:16:08.974 INFO:tasks.workunit.client.0.smithi064.stdout:5/557: read d0/d50/d39/f63 [802183,57708] 0 2023-12-16T03:16:08.985 INFO:tasks.workunit.client.1.smithi184.stdout:1/921: symlink d3/d34/dbc/l142 0 2023-12-16T03:16:08.986 INFO:tasks.workunit.client.0.smithi064.stdout:0/623: rename d2/d29/d66/d67 to d2/d7/d10/dc4/dcc 0 2023-12-16T03:16:08.988 INFO:tasks.workunit.client.0.smithi064.stdout:4/630: truncate d0/d42/d4c/d70/d8c/f98 8045228 0 2023-12-16T03:16:08.988 INFO:tasks.workunit.client.0.smithi064.stdout:4/631: write d0/da/da6/fb3 [130640,9805] 0 2023-12-16T03:16:08.988 INFO:tasks.workunit.client.0.smithi064.stdout:4/632: fsync d0/d42/d53/fb8 0 2023-12-16T03:16:08.988 INFO:tasks.workunit.client.0.smithi064.stdout:6/576: getdents d3/d8/d13/d58/d65/d6e 0 2023-12-16T03:16:08.989 INFO:tasks.workunit.client.1.smithi184.stdout:7/944: creat d0/dd3/d11a/da9/f129 x:0 0 0 2023-12-16T03:16:08.990 INFO:tasks.workunit.client.1.smithi184.stdout:2/877: dwrite d3/d29/d2f/d46/d77/ff2 [0,4194304] 0 2023-12-16T03:16:08.992 INFO:tasks.workunit.client.0.smithi064.stdout:0/624: write d2/d7/f23 [2373099,92543] 0 2023-12-16T03:16:08.993 INFO:tasks.workunit.client.0.smithi064.stdout:5/558: dread d0/d14/d20/d37/d3c/f6b [0,4194304] 0 2023-12-16T03:16:08.994 INFO:tasks.workunit.client.1.smithi184.stdout:1/922: rename d3/d34/dbc/d3c/d41/d63/c6b to d3/d34/dbc/d3c/d41/d63/de1/c143 0 2023-12-16T03:16:08.996 INFO:tasks.workunit.client.0.smithi064.stdout:7/651: mkdir d7/d26/d95/dca/dd2 0 2023-12-16T03:16:08.996 INFO:tasks.workunit.client.0.smithi064.stdout:9/604: dwrite d2/f40 [0,4194304] 0 2023-12-16T03:16:08.996 INFO:tasks.workunit.client.0.smithi064.stdout:7/652: write d7/d3e/d42/d48/f49 [660027,116512] 0 2023-12-16T03:16:08.997 INFO:tasks.workunit.client.1.smithi184.stdout:5/773: dwrite d1/d3/d9/de/d15/db9/fdb [0,4194304] 0 2023-12-16T03:16:08.997 INFO:tasks.workunit.client.0.smithi064.stdout:3/742: dwrite db/d4f/fc1 [0,4194304] 0 2023-12-16T03:16:08.997 INFO:tasks.workunit.client.0.smithi064.stdout:3/743: dread - db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/da4/fe4 zero size 2023-12-16T03:16:08.999 INFO:tasks.workunit.client.1.smithi184.stdout:2/878: unlink d3/d29/d4d/d5b/da6/fe0 0 2023-12-16T03:16:09.001 INFO:tasks.workunit.client.0.smithi064.stdout:2/518: rename d1/d94 to d1/d15/d1b/d61/d63/da2 0 2023-12-16T03:16:09.002 INFO:tasks.workunit.client.0.smithi064.stdout:2/519: write d1/d15/f75 [725707,44883] 0 2023-12-16T03:16:09.004 INFO:tasks.workunit.client.0.smithi064.stdout:9/605: write d2/d2d/daf/fb0 [238877,81695] 0 2023-12-16T03:16:09.005 INFO:tasks.workunit.client.1.smithi184.stdout:7/945: rename d0/dd3/d11a/d3b/c98 to d0/dd3/d11a/d79/d36/d84/dd2/c12a 0 2023-12-16T03:16:09.007 INFO:tasks.workunit.client.1.smithi184.stdout:1/923: symlink d3/d13/d10b/l144 0 2023-12-16T03:16:09.009 INFO:tasks.workunit.client.0.smithi064.stdout:4/633: mkdir d0/d42/d4c/d70/d8c/dc7 0 2023-12-16T03:16:09.009 INFO:tasks.workunit.client.0.smithi064.stdout:4/634: chown d0/d42/d66/d5a 311220196 1 2023-12-16T03:16:09.011 INFO:tasks.workunit.client.0.smithi064.stdout:4/635: write d0/d12/f79 [2617151,81109] 0 2023-12-16T03:16:09.012 INFO:tasks.workunit.client.0.smithi064.stdout:6/577: getdents d3/d8/d1f/d26/d47 0 2023-12-16T03:16:09.014 INFO:tasks.workunit.client.0.smithi064.stdout:5/559: mkdir d0/d7/d97/dc1 0 2023-12-16T03:16:09.018 INFO:tasks.workunit.client.1.smithi184.stdout:5/774: symlink d1/d3/d9/de/l100 0 2023-12-16T03:16:09.022 INFO:tasks.workunit.client.0.smithi064.stdout:2/520: dwrite d1/d15/d58/f46 [0,4194304] 0 2023-12-16T03:16:09.022 INFO:tasks.workunit.client.1.smithi184.stdout:2/879: creat d3/d13/ddf/f126 x:0 0 0 2023-12-16T03:16:09.025 INFO:tasks.workunit.client.1.smithi184.stdout:7/946: symlink d0/dd3/d11a/d79/d36/d84/dd2/l12b 0 2023-12-16T03:16:09.025 INFO:tasks.workunit.client.1.smithi184.stdout:7/947: chown d0/ce6 1792155407 1 2023-12-16T03:16:09.025 INFO:tasks.workunit.client.0.smithi064.stdout:7/653: symlink d7/d3e/d42/d48/d51/ld3 0 2023-12-16T03:16:09.026 INFO:tasks.workunit.client.0.smithi064.stdout:7/654: chown d7/d3e/d42/d89/d20/d37/db1/db6 2002791560 1 2023-12-16T03:16:09.026 INFO:tasks.workunit.client.0.smithi064.stdout:7/655: fdatasync d7/d3e/d42/d89/d74/f98 0 2023-12-16T03:16:09.029 INFO:tasks.workunit.client.1.smithi184.stdout:2/880: write d3/d29/d61/d6d/f90 [1585844,7573] 0 2023-12-16T03:16:09.029 INFO:tasks.workunit.client.1.smithi184.stdout:2/881: readlink d3/d29/d2f/d46/d77/l114 0 2023-12-16T03:16:09.029 INFO:tasks.workunit.client.1.smithi184.stdout:2/882: write d3/d29/d61/d6d/f99 [6035917,10119] 0 2023-12-16T03:16:09.030 INFO:tasks.workunit.client.1.smithi184.stdout:4/938: sync 2023-12-16T03:16:09.032 INFO:tasks.workunit.client.1.smithi184.stdout:1/924: dwrite d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/f116 [0,4194304] 0 2023-12-16T03:16:09.032 INFO:tasks.workunit.client.1.smithi184.stdout:1/925: fsync d3/d13/d2c/f81 0 2023-12-16T03:16:09.033 INFO:tasks.workunit.client.1.smithi184.stdout:7/948: symlink d0/d6b/dee/l12c 0 2023-12-16T03:16:09.035 INFO:tasks.workunit.client.0.smithi064.stdout:3/744: rename db/d12/fe2 to db/d12/ff9 0 2023-12-16T03:16:09.035 INFO:tasks.workunit.client.0.smithi064.stdout:3/745: chown db/d4f/daa/cc8 0 1 2023-12-16T03:16:09.038 INFO:tasks.workunit.client.1.smithi184.stdout:2/883: getdents d3/ddb 0 2023-12-16T03:16:09.038 INFO:tasks.workunit.client.1.smithi184.stdout:2/884: truncate d3/ddb/f10d 840966 0 2023-12-16T03:16:09.043 INFO:tasks.workunit.client.0.smithi064.stdout:0/625: rename d2/d8/da/d11/laa to d2/d7/d10/d85/lcd 0 2023-12-16T03:16:09.045 INFO:tasks.workunit.client.1.smithi184.stdout:5/775: dwrite d1/f66 [0,4194304] 0 2023-12-16T03:16:09.045 INFO:tasks.workunit.client.1.smithi184.stdout:5/776: dread - d1/d3/d9/de/d15/d19/d5f/d45/f9f zero size 2023-12-16T03:16:09.046 INFO:tasks.workunit.client.1.smithi184.stdout:5/777: truncate d1/d3/d9/de/d30/fb1 467487 0 2023-12-16T03:16:09.046 INFO:tasks.workunit.client.1.smithi184.stdout:2/885: write d3/d13/fd9 [89488,94152] 0 2023-12-16T03:16:09.046 INFO:tasks.workunit.client.0.smithi064.stdout:5/560: dwrite d0/d19/d48/d8f/dac/d23/f89 [0,4194304] 0 2023-12-16T03:16:09.046 INFO:tasks.workunit.client.1.smithi184.stdout:4/939: symlink d1/d11/d5a/d63/d103/d45/dcf/l145 0 2023-12-16T03:16:09.049 INFO:tasks.workunit.client.0.smithi064.stdout:9/606: symlink d2/dc/d8a/lc6 0 2023-12-16T03:16:09.055 INFO:tasks.workunit.client.1.smithi184.stdout:1/926: unlink d3/d34/dbc/d3c/l80 0 2023-12-16T03:16:09.055 INFO:tasks.workunit.client.1.smithi184.stdout:1/927: dread - d3/d34/d76/d91/f13f zero size 2023-12-16T03:16:09.062 INFO:tasks.workunit.client.0.smithi064.stdout:4/636: creat d0/d12/fc8 x:0 0 0 2023-12-16T03:16:09.063 INFO:tasks.workunit.client.1.smithi184.stdout:2/886: dread d3/d9/d19/fa7 [0,4194304] 0 2023-12-16T03:16:09.063 INFO:tasks.workunit.client.1.smithi184.stdout:2/887: fsync d3/d29/d2f/d2e/f35 0 2023-12-16T03:16:09.065 INFO:tasks.workunit.client.0.smithi064.stdout:6/578: creat d3/d8/d1f/d26/d47/d4a/d67/d73/fad x:0 0 0 2023-12-16T03:16:09.067 INFO:tasks.workunit.client.0.smithi064.stdout:4/637: write d0/f2 [3753594,31249] 0 2023-12-16T03:16:09.067 INFO:tasks.workunit.client.1.smithi184.stdout:7/949: getdents d0 0 2023-12-16T03:16:09.073 INFO:tasks.workunit.client.0.smithi064.stdout:9/607: dwrite d2/dc/d24/f63 [0,4194304] 0 2023-12-16T03:16:09.075 INFO:tasks.workunit.client.0.smithi064.stdout:8/679: dwrite d0/da/f65 [0,4194304] 0 2023-12-16T03:16:09.075 INFO:tasks.workunit.client.0.smithi064.stdout:8/680: chown d0/db/d37/d3a/dab/lcb 15162036 1 2023-12-16T03:16:09.075 INFO:tasks.workunit.client.0.smithi064.stdout:8/681: stat d0/da/d3e/d46/f7b 0 2023-12-16T03:16:09.076 INFO:tasks.workunit.client.1.smithi184.stdout:5/778: creat d1/d3/d9/de/da5/f101 x:0 0 0 2023-12-16T03:16:09.078 INFO:tasks.workunit.client.1.smithi184.stdout:7/950: dread d0/dd3/d11a/d79/d36/d3f/fcf [0,4194304] 0 2023-12-16T03:16:09.078 INFO:tasks.workunit.client.1.smithi184.stdout:7/951: chown d0/dd3/d11a/d79/dd/d75/l100 53 1 2023-12-16T03:16:09.078 INFO:tasks.workunit.client.1.smithi184.stdout:7/952: truncate d0/dd3/d11a/d79/dd/d27/f76 4308487 0 2023-12-16T03:16:09.078 INFO:tasks.workunit.client.1.smithi184.stdout:4/940: symlink d1/d11/d5a/d63/d103/d45/dcf/dea/d13c/l146 0 2023-12-16T03:16:09.081 INFO:tasks.workunit.client.0.smithi064.stdout:8/682: write d0/da/d3e/d46/d54/d7c/db7/faf [2286665,67102] 0 2023-12-16T03:16:09.081 INFO:tasks.workunit.client.0.smithi064.stdout:8/683: readlink d0/db/l2b 0 2023-12-16T03:16:09.081 INFO:tasks.workunit.client.0.smithi064.stdout:7/656: mknod d7/d3e/d42/d43/dc8/cd4 0 2023-12-16T03:16:09.083 INFO:tasks.workunit.client.1.smithi184.stdout:2/888: truncate d3/f14 976671 0 2023-12-16T03:16:09.083 INFO:tasks.workunit.client.1.smithi184.stdout:2/889: write d3/d13/d28/fd0 [4520908,93372] 0 2023-12-16T03:16:09.084 INFO:tasks.workunit.client.1.smithi184.stdout:1/928: dwrite d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fed [0,4194304] 0 2023-12-16T03:16:09.084 INFO:tasks.workunit.client.1.smithi184.stdout:1/929: chown d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6 801313 1 2023-12-16T03:16:09.084 INFO:tasks.workunit.client.1.smithi184.stdout:1/930: truncate d3/d34/dbc/d3c/f10f 911611 0 2023-12-16T03:16:09.087 INFO:tasks.workunit.client.0.smithi064.stdout:1/680: sync 2023-12-16T03:16:09.087 INFO:tasks.workunit.client.0.smithi064.stdout:1/681: fdatasync d3/d36/d44/d4d/dad/fb5 0 2023-12-16T03:16:09.087 INFO:tasks.workunit.client.0.smithi064.stdout:1/682: stat d3/d36/d9e/la2 0 2023-12-16T03:16:09.087 INFO:tasks.workunit.client.0.smithi064.stdout:1/683: chown d3/dd/d11/d2f 12 1 2023-12-16T03:16:09.087 INFO:tasks.workunit.client.1.smithi184.stdout:1/931: write d3/d34/dbc/d3c/f33 [620497,118477] 0 2023-12-16T03:16:09.088 INFO:tasks.workunit.client.0.smithi064.stdout:4/638: dwrite d0/da/da6/fb5 [0,4194304] 0 2023-12-16T03:16:09.088 INFO:tasks.workunit.client.1.smithi184.stdout:5/779: mknod d1/d3/d9/de/d15/d19/d5f/c102 0 2023-12-16T03:16:09.091 INFO:tasks.workunit.client.0.smithi064.stdout:0/626: rename d2/d8/da/d11/c61 to d2/d29/d66/cce 0 2023-12-16T03:16:09.093 INFO:tasks.workunit.client.0.smithi064.stdout:0/627: dread d2/d8/f40 [0,4194304] 0 2023-12-16T03:16:09.095 INFO:tasks.workunit.client.1.smithi184.stdout:7/953: mknod d0/dd3/d11a/d79/dd/d75/dfb/c12d 0 2023-12-16T03:16:09.095 INFO:tasks.workunit.client.1.smithi184.stdout:7/954: write d0/dd3/d11a/d79/d32/d35/fa5 [121871,34199] 0 2023-12-16T03:16:09.096 INFO:tasks.workunit.client.1.smithi184.stdout:8/997: write d2/d37/f102 [201393,16449] 0 2023-12-16T03:16:09.102 INFO:tasks.workunit.client.0.smithi064.stdout:1/684: dread d3/dd/d11/d3b/f3e [0,4194304] 0 2023-12-16T03:16:09.105 INFO:tasks.workunit.client.1.smithi184.stdout:2/890: rmdir d3/d29 39 2023-12-16T03:16:09.110 INFO:tasks.workunit.client.1.smithi184.stdout:1/932: dwrite d3/d34/d76/f85 [0,4194304] 0 2023-12-16T03:16:09.111 INFO:tasks.workunit.client.1.smithi184.stdout:5/780: dwrite d1/d2a/d31/d58/daf/f8a [0,4194304] 0 2023-12-16T03:16:09.111 INFO:tasks.workunit.client.1.smithi184.stdout:5/781: dread - d1/d2a/d31/d58/daf/fe8 zero size 2023-12-16T03:16:09.111 INFO:tasks.workunit.client.0.smithi064.stdout:9/608: creat d2/d2d/d3b/d3c/d4b/fc7 x:0 0 0 2023-12-16T03:16:09.112 INFO:tasks.workunit.client.0.smithi064.stdout:9/609: write d2/d2d/d6c/d83/f96 [417923,122264] 0 2023-12-16T03:16:09.112 INFO:tasks.workunit.client.0.smithi064.stdout:9/610: write d2/dc/d24/d39/d5e/d6f/f70 [858356,59289] 0 2023-12-16T03:16:09.114 INFO:tasks.workunit.client.1.smithi184.stdout:5/782: read d1/f66 [2756429,107270] 0 2023-12-16T03:16:09.118 INFO:tasks.workunit.client.0.smithi064.stdout:8/684: truncate d0/f2 478377 0 2023-12-16T03:16:09.124 INFO:tasks.workunit.client.0.smithi064.stdout:1/685: dwrite d3/dd/d11/d2f/f4c [0,4194304] 0 2023-12-16T03:16:09.124 INFO:tasks.workunit.client.0.smithi064.stdout:1/686: fsync d3/dd/d23/d4f/f9a 0 2023-12-16T03:16:09.128 INFO:tasks.workunit.client.0.smithi064.stdout:4/639: symlink d0/d42/d4c/lc9 0 2023-12-16T03:16:09.132 INFO:tasks.workunit.client.1.smithi184.stdout:7/955: creat d0/dd3/d11a/d79/d34/f12e x:0 0 0 2023-12-16T03:16:09.136 INFO:tasks.workunit.client.0.smithi064.stdout:6/579: rmdir d3/d8 39 2023-12-16T03:16:09.136 INFO:tasks.workunit.client.0.smithi064.stdout:4/640: dread d0/d42/d66/d33/fab [0,4194304] 0 2023-12-16T03:16:09.136 INFO:tasks.workunit.client.0.smithi064.stdout:6/580: read d3/d8/d1f/f5a [2149680,16307] 0 2023-12-16T03:16:09.141 INFO:tasks.workunit.client.0.smithi064.stdout:9/611: mkdir d2/d2d/d6c/dc8 0 2023-12-16T03:16:09.141 INFO:tasks.workunit.client.0.smithi064.stdout:9/612: write d2/d2d/d3b/d3c/d34/f75 [161728,66573] 0 2023-12-16T03:16:09.147 INFO:tasks.workunit.client.0.smithi064.stdout:8/685: link d0/db/d37/f61 d0/d1d/d24/d2f/d50/d70/dcc/fe8 0 2023-12-16T03:16:09.152 INFO:tasks.workunit.client.0.smithi064.stdout:4/641: dwrite d0/d42/f63 [0,4194304] 0 2023-12-16T03:16:09.153 INFO:tasks.workunit.client.0.smithi064.stdout:1/687: truncate d3/d36/f65 242168 0 2023-12-16T03:16:09.155 INFO:tasks.workunit.client.0.smithi064.stdout:5/561: rename d0/d19/f27 to d0/d7/fc2 0 2023-12-16T03:16:09.157 INFO:tasks.workunit.client.0.smithi064.stdout:6/581: creat d3/d8/d13/d46/d5e/da8/fae x:0 0 0 2023-12-16T03:16:09.158 INFO:tasks.workunit.client.1.smithi184.stdout:2/891: rename d3/d9/d19/lde to d3/d13/ddf/d10a/l127 0 2023-12-16T03:16:09.160 INFO:tasks.workunit.client.0.smithi064.stdout:9/613: mknod d2/dc/d24/d39/d42/cc9 0 2023-12-16T03:16:09.160 INFO:tasks.workunit.client.0.smithi064.stdout:9/614: dread - d2/d7e/f8d zero size 2023-12-16T03:16:09.160 INFO:tasks.workunit.client.0.smithi064.stdout:4/642: write d0/d1e/d36/f46 [1339883,5263] 0 2023-12-16T03:16:09.163 INFO:tasks.workunit.client.0.smithi064.stdout:8/686: unlink d0/db/d12/d1c/d59/d77/f94 0 2023-12-16T03:16:09.168 INFO:tasks.workunit.client.1.smithi184.stdout:1/933: mknod d3/d13/d121/dc7/d141/c145 0 2023-12-16T03:16:09.168 INFO:tasks.workunit.client.1.smithi184.stdout:1/934: fsync d3/d34/dbc/d3c/d41/f62 0 2023-12-16T03:16:09.168 INFO:tasks.workunit.client.1.smithi184.stdout:1/935: readlink d3/d34/dbc/d3c/d24/l32 0 2023-12-16T03:16:09.171 INFO:tasks.workunit.client.1.smithi184.stdout:5/783: link d1/d2a/f13 d1/d3/d9/de/d15/d19/d3a/dde/f103 0 2023-12-16T03:16:09.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.170+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe644005da0 con 0x7fe658070510 2023-12-16T03:16:09.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.171+0000 7fe63ffff700 1 -- 172.21.15.64:0/3160997960 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fe648002bb0 con 0x7fe658070510 2023-12-16T03:16:09.175 INFO:tasks.workunit.client.0.smithi064.stdout:1/688: creat d3/d36/d44/d4d/da8/dce/fdc x:0 0 0 2023-12-16T03:16:09.175 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:16:09.175 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:16:09.175 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:16:09.175 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:16:09.176 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:16:09.177 INFO:tasks.workunit.client.0.smithi064.stdout:8/687: dread d0/d1d/d24/f36 [0,4194304] 0 2023-12-16T03:16:09.177 INFO:tasks.workunit.client.0.smithi064.stdout:8/688: chown d0/db/f4f 3 1 2023-12-16T03:16:09.177 INFO:tasks.workunit.client.1.smithi184.stdout:7/956: symlink d0/dd3/d11a/d3b/ddc/l12f 0 2023-12-16T03:16:09.178 INFO:tasks.workunit.client.0.smithi064.stdout:7/657: rename d7/d3e/d42/d89/d20/d37/db1/db6/ccd to d7/d26/d30/da3/cd5 0 2023-12-16T03:16:09.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.176+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fe640038350 msgr2=0x7fe64003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:09.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.176+0000 7fe65ddb9700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fe640038350 0x7fe64003a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe64c000c00 tx=0x7fe64c009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:09.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.176+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 msgr2=0x7fe65810f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:09.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.176+0000 7fe65ddb9700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 0x7fe65810f790 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe64800eb40 tx=0x7fe64800b040 comp rx=0 tx=0).stop 2023-12-16T03:16:09.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.176+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 shutdown_connections 2023-12-16T03:16:09.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.176+0000 7fe65ddb9700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fe640038350 0x7fe64003a800 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:09.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.176+0000 7fe65ddb9700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe658070510 0x7fe65810f790 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:09.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.176+0000 7fe65ddb9700 1 --2- 172.21.15.64:0/3160997960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe658071b60 0x7fe65810fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:09.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.176+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 >> 172.21.15.64:0/3160997960 conn(0x7fe6580f82d0 msgr2=0x7fe6580fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:09.179 INFO:tasks.workunit.client.1.smithi184.stdout:8/998: mkdir d2/d12/d21/d8a/d146 0 2023-12-16T03:16:09.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.177+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 shutdown_connections 2023-12-16T03:16:09.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.177+0000 7fe65ddb9700 1 -- 172.21.15.64:0/3160997960 wait complete. 2023-12-16T03:16:09.184 INFO:tasks.workunit.client.0.smithi064.stdout:9/615: mkdir d2/dc/d24/d39/d42/dca 0 2023-12-16T03:16:09.185 INFO:tasks.workunit.client.1.smithi184.stdout:5/784: dread d1/d2a/fac [0,4194304] 0 2023-12-16T03:16:09.185 INFO:tasks.workunit.client.1.smithi184.stdout:5/785: write d1/d3/d9/de/d15/d19/d5f/fe1 [779626,67154] 0 2023-12-16T03:16:09.185 INFO:tasks.workunit.client.1.smithi184.stdout:2/892: dwrite d3/d13/f9a [0,4194304] 0 2023-12-16T03:16:09.190 INFO:tasks.workunit.client.0.smithi064.stdout:9/616: dread d2/dc/f26 [0,4194304] 0 2023-12-16T03:16:09.190 INFO:tasks.workunit.client.0.smithi064.stdout:4/643: creat d0/d12/d48/d87/fca x:0 0 0 2023-12-16T03:16:09.191 INFO:tasks.workunit.client.1.smithi184.stdout:1/936: mknod d3/d34/dbc/d38/c146 0 2023-12-16T03:16:09.191 INFO:tasks.workunit.client.1.smithi184.stdout:1/937: dread d3/d34/f4e [0,4194304] 0 2023-12-16T03:16:09.191 INFO:tasks.workunit.client.1.smithi184.stdout:7/957: truncate d0/dd3/d11a/d79/d36/d3f/f6d 1774398 0 2023-12-16T03:16:09.194 INFO:tasks.workunit.client.1.smithi184.stdout:8/999: creat d2/d4/d10/d99/f147 x:0 0 0 2023-12-16T03:16:09.197 INFO:tasks.workunit.client.0.smithi064.stdout:1/689: mknod d3/dd/d23/d4f/cdd 0 2023-12-16T03:16:09.199 INFO:tasks.workunit.client.0.smithi064.stdout:4/644: dread d0/da/f16 [0,4194304] 0 2023-12-16T03:16:09.201 INFO:tasks.workunit.client.0.smithi064.stdout:0/628: rename d2/d7/d10/dc4/dcc/la6 to d2/d29/d66/d97/lcf 0 2023-12-16T03:16:09.201 INFO:tasks.workunit.client.0.smithi064.stdout:0/629: chown d2/d29/d66/d97 662804 1 2023-12-16T03:16:09.205 INFO:tasks.workunit.client.0.smithi064.stdout:7/658: unlink d7/d26/d95/fa6 0 2023-12-16T03:16:09.205 INFO:tasks.workunit.client.0.smithi064.stdout:7/659: chown d7/d26/d30/f39 30915124 1 2023-12-16T03:16:09.205 INFO:tasks.workunit.client.1.smithi184.stdout:1/938: dwrite d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/f12c [0,4194304] 0 2023-12-16T03:16:09.206 INFO:tasks.workunit.client.1.smithi184.stdout:1/939: fdatasync d3/d34/dbc/d38/faf 0 2023-12-16T03:16:09.206 INFO:tasks.workunit.client.1.smithi184.stdout:5/786: rmdir d1/d3/d9/de/d15/d19/d53 39 2023-12-16T03:16:09.207 INFO:tasks.workunit.client.0.smithi064.stdout:7/660: write d7/d26/d30/f57 [1183166,43622] 0 2023-12-16T03:16:09.207 INFO:tasks.workunit.client.1.smithi184.stdout:1/940: write f0 [2858265,124426] 0 2023-12-16T03:16:09.209 INFO:tasks.workunit.client.0.smithi064.stdout:5/562: link d0/d50/d39/f7c d0/fc3 0 2023-12-16T03:16:09.211 INFO:tasks.workunit.client.1.smithi184.stdout:2/893: symlink d3/d29/d2f/d46/l128 0 2023-12-16T03:16:09.212 INFO:tasks.workunit.client.1.smithi184.stdout:2/894: stat d3/d29/d2f/d46/l128 0 2023-12-16T03:16:09.214 INFO:tasks.workunit.client.0.smithi064.stdout:9/617: creat d2/dc/d24/d39/d42/d9a/d8b/fcb x:0 0 0 2023-12-16T03:16:09.217 INFO:tasks.workunit.client.1.smithi184.stdout:7/958: rename d0/dd3/d11a/d79/d1e/f127 to d0/dd3/d11a/d79/d36/d3f/df9/d109/f130 0 2023-12-16T03:16:09.220 INFO:tasks.workunit.client.0.smithi064.stdout:1/690: dwrite d3/d36/d44/d4d/d58/d96/f99 [0,4194304] 0 2023-12-16T03:16:09.220 INFO:tasks.workunit.client.0.smithi064.stdout:4/645: unlink d0/d42/d66/d5a/d75/c94 0 2023-12-16T03:16:09.224 INFO:tasks.workunit.client.0.smithi064.stdout:6/582: rename d3/d8/da/fe to d3/d44/faf 0 2023-12-16T03:16:09.227 INFO:tasks.workunit.client.0.smithi064.stdout:0/630: mkdir d2/d7/d10/dc4/dcc/dd0 0 2023-12-16T03:16:09.227 INFO:tasks.workunit.client.1.smithi184.stdout:2/895: dread d3/d29/d2f/d46/d77/ff2 [0,4194304] 0 2023-12-16T03:16:09.227 INFO:tasks.workunit.client.1.smithi184.stdout:2/896: fdatasync d3/d29/d61/f68 0 2023-12-16T03:16:09.228 INFO:tasks.workunit.client.1.smithi184.stdout:5/787: creat d1/d3/d9/de/d15/d90/f104 x:0 0 0 2023-12-16T03:16:09.228 INFO:tasks.workunit.client.1.smithi184.stdout:5/788: write d1/d3/d9/de/d15/d19/f9c [83495,76011] 0 2023-12-16T03:16:09.231 INFO:tasks.workunit.client.1.smithi184.stdout:1/941: creat d3/d34/dbc/d3c/d24/d8e/f147 x:0 0 0 2023-12-16T03:16:09.231 INFO:tasks.workunit.client.1.smithi184.stdout:1/942: fsync d3/d34/dbc/d3c/d41/d46/d4a/f50 0 2023-12-16T03:16:09.232 INFO:tasks.workunit.client.0.smithi064.stdout:7/661: mkdir d7/d3e/d42/d89/d20/d37/db1/db6/dd6 0 2023-12-16T03:16:09.232 INFO:tasks.workunit.client.0.smithi064.stdout:7/662: write d7/d3e/fc1 [573593,82583] 0 2023-12-16T03:16:09.232 INFO:tasks.workunit.client.0.smithi064.stdout:7/663: chown d7/d26/f79 6237 1 2023-12-16T03:16:09.235 INFO:tasks.workunit.client.1.smithi184.stdout:7/959: creat d0/dd3/d11a/d79/d32/d39/d8f/dab/d104/f131 x:0 0 0 2023-12-16T03:16:09.237 INFO:tasks.workunit.client.1.smithi184.stdout:2/897: rmdir d3/d13/d28/dac/daf 39 2023-12-16T03:16:09.238 INFO:tasks.workunit.client.0.smithi064.stdout:5/563: dwrite d0/d19/d48/fab [4194304,4194304] 0 2023-12-16T03:16:09.238 INFO:tasks.workunit.client.0.smithi064.stdout:1/691: creat d3/fde x:0 0 0 2023-12-16T03:16:09.239 INFO:tasks.workunit.client.0.smithi064.stdout:9/618: dwrite d2/d2d/daf/fb0 [0,4194304] 0 2023-12-16T03:16:09.239 INFO:tasks.workunit.client.1.smithi184.stdout:5/789: getdents d1/d3/d2f/db5 0 2023-12-16T03:16:09.242 INFO:tasks.workunit.client.0.smithi064.stdout:4/646: creat d0/d12/d48/fcb x:0 0 0 2023-12-16T03:16:09.242 INFO:tasks.workunit.client.1.smithi184.stdout:2/898: truncate d3/d29/d2f/d2e/f35 6105199 0 2023-12-16T03:16:09.252 INFO:tasks.workunit.client.1.smithi184.stdout:2/899: mknod d3/d29/d4d/d5b/da6/c129 0 2023-12-16T03:16:09.254 INFO:tasks.workunit.client.0.smithi064.stdout:0/631: creat d2/d7/d10/fd1 x:0 0 0 2023-12-16T03:16:09.254 INFO:tasks.workunit.client.0.smithi064.stdout:0/632: fsync d2/d7/d10/d21/d7a/fa8 0 2023-12-16T03:16:09.254 INFO:tasks.workunit.client.0.smithi064.stdout:0/633: read - d2/d7/d10/d21/fc0 zero size 2023-12-16T03:16:09.254 INFO:tasks.workunit.client.0.smithi064.stdout:0/634: fdatasync d2/f3e 0 2023-12-16T03:16:09.258 INFO:tasks.workunit.client.1.smithi184.stdout:1/943: dwrite d3/d34/dbc/f87 [0,4194304] 0 2023-12-16T03:16:09.259 INFO:tasks.workunit.client.0.smithi064.stdout:7/664: getdents d7/d3e/d42 0 2023-12-16T03:16:09.260 INFO:tasks.workunit.client.1.smithi184.stdout:5/790: dwrite d1/d3/fd [0,4194304] 0 2023-12-16T03:16:09.262 INFO:tasks.workunit.client.0.smithi064.stdout:6/583: rmdir d3/d8/da 39 2023-12-16T03:16:09.265 INFO:tasks.workunit.client.1.smithi184.stdout:2/900: mknod d3/d13/ddf/d10a/c12a 0 2023-12-16T03:16:09.267 INFO:tasks.workunit.client.0.smithi064.stdout:5/564: creat d0/d19/d48/d92/fc4 x:0 0 0 2023-12-16T03:16:09.271 INFO:tasks.workunit.client.0.smithi064.stdout:1/692: mknod d3/dd/d23/d60/cdf 0 2023-12-16T03:16:09.281 INFO:tasks.workunit.client.0.smithi064.stdout:1/693: write d3/dd/d23/d60/fa9 [1855924,82650] 0 2023-12-16T03:16:09.281 INFO:tasks.workunit.client.1.smithi184.stdout:5/791: dwrite d1/d3/d9/de/d15/d19/d48/fe6 [0,4194304] 0 2023-12-16T03:16:09.281 INFO:tasks.workunit.client.1.smithi184.stdout:5/792: write d1/d3/d9/de/d15/d19/d48/f98 [974181,75093] 0 2023-12-16T03:16:09.283 INFO:tasks.workunit.client.1.smithi184.stdout:1/944: getdents d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5 0 2023-12-16T03:16:09.284 INFO:tasks.workunit.client.1.smithi184.stdout:2/901: mknod d3/d29/d8a/c12b 0 2023-12-16T03:16:09.286 INFO:tasks.workunit.client.1.smithi184.stdout:4/941: sync 2023-12-16T03:16:09.292 INFO:tasks.workunit.client.0.smithi064.stdout:7/665: dwrite d7/d3e/d42/d48/d51/d7c/d52/fa8 [0,4194304] 0 2023-12-16T03:16:09.292 INFO:tasks.workunit.client.0.smithi064.stdout:7/666: chown d7/d26/d30/lc0 1 1 2023-12-16T03:16:09.292 INFO:tasks.workunit.client.1.smithi184.stdout:1/945: symlink d3/d34/dbc/d3c/d24/d8e/l148 0 2023-12-16T03:16:09.294 INFO:tasks.workunit.client.1.smithi184.stdout:5/793: dread d1/d3/d9/f50 [0,4194304] 0 2023-12-16T03:16:09.295 INFO:tasks.workunit.client.1.smithi184.stdout:2/902: creat d3/d9/d19/d82/f12c x:0 0 0 2023-12-16T03:16:09.297 INFO:tasks.workunit.client.1.smithi184.stdout:1/946: rmdir d3/d13/d121/dc7/d141 39 2023-12-16T03:16:09.297 INFO:tasks.workunit.client.1.smithi184.stdout:1/947: chown f0 282295385 1 2023-12-16T03:16:09.298 INFO:tasks.workunit.client.0.smithi064.stdout:1/694: dwrite d3/d22/f28 [0,4194304] 0 2023-12-16T03:16:09.298 INFO:tasks.workunit.client.1.smithi184.stdout:4/942: dread d1/d29/f2e [0,4194304] 0 2023-12-16T03:16:09.300 INFO:tasks.workunit.client.0.smithi064.stdout:9/619: symlink d2/dc/d24/d39/d42/d57/lcc 0 2023-12-16T03:16:09.300 INFO:tasks.workunit.client.0.smithi064.stdout:9/620: stat d2/d2d 0 2023-12-16T03:16:09.301 INFO:tasks.workunit.client.1.smithi184.stdout:1/948: truncate d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fde 535691 0 2023-12-16T03:16:09.301 INFO:tasks.workunit.client.1.smithi184.stdout:4/943: dread d1/d11/d5a/d63/d103/d45/fb2 [0,4194304] 0 2023-12-16T03:16:09.303 INFO:tasks.workunit.client.0.smithi064.stdout:4/647: rmdir d0/d42/d4c/d70 39 2023-12-16T03:16:09.303 INFO:tasks.workunit.client.1.smithi184.stdout:4/944: read d1/d29/d34/d5c/d76/d3b/fa9 [3813404,128564] 0 2023-12-16T03:16:09.304 INFO:tasks.workunit.client.1.smithi184.stdout:4/945: write d1/f51 [1281605,61735] 0 2023-12-16T03:16:09.304 INFO:tasks.workunit.client.1.smithi184.stdout:4/946: chown d1/d11/d1b/d1e/fc5 3414 1 2023-12-16T03:16:09.305 INFO:tasks.workunit.client.1.smithi184.stdout:5/794: dread d1/d2a/d31/d58/daf/f8a [0,4194304] 0 2023-12-16T03:16:09.305 INFO:tasks.workunit.client.1.smithi184.stdout:5/795: truncate d1/d3/d9/de/d15/db9/fd6 330700 0 2023-12-16T03:16:09.306 INFO:tasks.workunit.client.0.smithi064.stdout:0/635: getdents d2/d29/d66 0 2023-12-16T03:16:09.308 INFO:tasks.workunit.client.1.smithi184.stdout:4/947: rename d1/d29/f140 to d1/d11/d1b/d1e/f147 0 2023-12-16T03:16:09.310 INFO:tasks.workunit.client.0.smithi064.stdout:6/584: truncate d3/d9/f18 2219324 0 2023-12-16T03:16:09.311 INFO:tasks.workunit.client.1.smithi184.stdout:1/949: dread d3/d34/dbc/d3c/f10f [0,4194304] 0 2023-12-16T03:16:09.311 INFO:tasks.workunit.client.1.smithi184.stdout:1/950: chown d3/d13/d121/fb2 235835 1 2023-12-16T03:16:09.315 INFO:tasks.workunit.client.1.smithi184.stdout:5/796: rename d1/d3/d9/de/d30/d80 to d1/d3/d105 0 2023-12-16T03:16:09.315 INFO:tasks.workunit.client.1.smithi184.stdout:5/797: chown d1/d3/d9/de/d30/l46 251 1 2023-12-16T03:16:09.319 INFO:tasks.workunit.client.1.smithi184.stdout:4/948: mkdir d1/d29/d34/d5c/d76/d3b/d137/d148 0 2023-12-16T03:16:09.321 INFO:tasks.workunit.client.1.smithi184.stdout:2/903: dwrite d3/d13/feb [0,4194304] 0 2023-12-16T03:16:09.322 INFO:tasks.workunit.client.1.smithi184.stdout:5/798: mknod d1/d3/d105/dd4/c106 0 2023-12-16T03:16:09.322 INFO:tasks.workunit.client.1.smithi184.stdout:5/799: write d1/d3/d9/de/d30/f8b [932434,24454] 0 2023-12-16T03:16:09.322 INFO:tasks.workunit.client.1.smithi184.stdout:5/800: readlink d1/d3/d105/lbe 0 2023-12-16T03:16:09.323 INFO:tasks.workunit.client.0.smithi064.stdout:8/689: rename d0/db to d0/da/de9 0 2023-12-16T03:16:09.324 INFO:tasks.workunit.client.1.smithi184.stdout:2/904: dread d3/d13/d6e/f104 [0,4194304] 0 2023-12-16T03:16:09.324 INFO:tasks.workunit.client.1.smithi184.stdout:2/905: chown d3/d29/d2f/d46/d77/ff2 165 1 2023-12-16T03:16:09.325 INFO:tasks.workunit.client.0.smithi064.stdout:7/667: symlink d7/d26/d30/ld7 0 2023-12-16T03:16:09.325 INFO:tasks.workunit.client.0.smithi064.stdout:7/668: chown d7/d3e/d42/d89/d74/f98 83006 1 2023-12-16T03:16:09.327 INFO:tasks.workunit.client.0.smithi064.stdout:0/636: dread d2/d7/d10/d21/d31/f35 [0,4194304] 0 2023-12-16T03:16:09.327 INFO:tasks.workunit.client.0.smithi064.stdout:1/695: getdents d3 0 2023-12-16T03:16:09.333 INFO:tasks.workunit.client.1.smithi184.stdout:4/949: truncate d1/fd 1416612 0 2023-12-16T03:16:09.334 INFO:tasks.workunit.client.0.smithi064.stdout:9/621: creat d2/d7e/fcd x:0 0 0 2023-12-16T03:16:09.334 INFO:tasks.workunit.client.1.smithi184.stdout:1/951: dwrite d3/d34/dbc/f135 [0,4194304] 0 2023-12-16T03:16:09.335 INFO:tasks.workunit.client.0.smithi064.stdout:4/648: rmdir d0/d42/d4c/d70 39 2023-12-16T03:16:09.336 INFO:tasks.workunit.client.0.smithi064.stdout:7/669: write d7/f53 [261524,59423] 0 2023-12-16T03:16:09.336 INFO:tasks.workunit.client.0.smithi064.stdout:7/670: fdatasync d7/d3e/d42/d48/f5e 0 2023-12-16T03:16:09.336 INFO:tasks.workunit.client.0.smithi064.stdout:7/671: read - d7/d26/f79 zero size 2023-12-16T03:16:09.339 INFO:tasks.workunit.client.0.smithi064.stdout:6/585: unlink d3/d8/d1f/d26/d47/d9d/fa5 0 2023-12-16T03:16:09.342 INFO:tasks.workunit.client.0.smithi064.stdout:5/565: rename d0/d50/d39/da5 to d0/d50/d39/daa/dc5 0 2023-12-16T03:16:09.343 INFO:tasks.workunit.client.1.smithi184.stdout:1/952: dread d3/d34/dbc/d3c/d41/d77/fba [0,4194304] 0 2023-12-16T03:16:09.343 INFO:tasks.workunit.client.1.smithi184.stdout:1/953: write d3/d34/dbc/d3c/d41/d46/fc8 [1633500,48810] 0 2023-12-16T03:16:09.347 INFO:tasks.workunit.client.0.smithi064.stdout:9/622: mkdir d2/d2d/d3b/d3c/d34/dce 0 2023-12-16T03:16:09.348 INFO:tasks.workunit.client.0.smithi064.stdout:3/746: sync 2023-12-16T03:16:09.348 INFO:tasks.workunit.client.0.smithi064.stdout:2/521: sync 2023-12-16T03:16:09.348 INFO:tasks.workunit.client.0.smithi064.stdout:0/637: dwrite d2/d7/d10/d21/f39 [0,4194304] 0 2023-12-16T03:16:09.348 INFO:tasks.workunit.client.0.smithi064.stdout:8/690: dwrite d0/d1d/d3c/d42/d93/fa9 [0,4194304] 0 2023-12-16T03:16:09.348 INFO:tasks.workunit.client.0.smithi064.stdout:8/691: chown d0/da/f30 20272039 1 2023-12-16T03:16:09.348 INFO:tasks.workunit.client.0.smithi064.stdout:1/696: write d3/f26 [1679715,75585] 0 2023-12-16T03:16:09.348 INFO:tasks.workunit.client.0.smithi064.stdout:1/697: chown d3/dd/d23/d60/c9b 1791 1 2023-12-16T03:16:09.349 INFO:tasks.workunit.client.0.smithi064.stdout:1/698: read - d3/d36/d44/f8e zero size 2023-12-16T03:16:09.349 INFO:tasks.workunit.client.0.smithi064.stdout:1/699: write d3/d36/d44/f51 [1172167,70225] 0 2023-12-16T03:16:09.349 INFO:tasks.workunit.client.0.smithi064.stdout:1/700: truncate d3/d22/fd8 939805 0 2023-12-16T03:16:09.349 INFO:tasks.workunit.client.0.smithi064.stdout:1/701: write d3/d22/fd5 [915488,93567] 0 2023-12-16T03:16:09.353 INFO:tasks.workunit.client.0.smithi064.stdout:0/638: dread d2/d7/f2b [0,4194304] 0 2023-12-16T03:16:09.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.351+0000 7f877ec58700 1 -- 172.21.15.64:0/3748690219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 msgr2=0x7f8778107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:09.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.351+0000 7f877ec58700 1 --2- 172.21.15.64:0/3748690219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 0x7f8778107020 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8768004940 tx=0x7f8768009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:09.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.352+0000 7f877ec58700 1 -- 172.21.15.64:0/3748690219 shutdown_connections 2023-12-16T03:16:09.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.352+0000 7f877ec58700 1 --2- 172.21.15.64:0/3748690219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8778107560 0x7f8778109960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:09.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.352+0000 7f877ec58700 1 --2- 172.21.15.64:0/3748690219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 0x7f8778107020 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:09.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.352+0000 7f877ec58700 1 -- 172.21.15.64:0/3748690219 >> 172.21.15.64:0/3748690219 conn(0x7f8778069b20 msgr2=0x7f877806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:09.355 INFO:tasks.workunit.client.0.smithi064.stdout:4/649: unlink d0/d42/d4c/d70/d85/l92 0 2023-12-16T03:16:09.355 INFO:tasks.workunit.client.0.smithi064.stdout:4/650: fsync d0/d42/f72 0 2023-12-16T03:16:09.355 INFO:tasks.workunit.client.0.smithi064.stdout:7/672: creat d7/d3e/d42/d89/d74/d82/fd8 x:0 0 0 2023-12-16T03:16:09.355 INFO:tasks.workunit.client.0.smithi064.stdout:7/673: truncate d7/d3e/d42/d89/f6e 5092424 0 2023-12-16T03:16:09.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.353+0000 7f877ec58700 1 -- 172.21.15.64:0/3748690219 shutdown_connections 2023-12-16T03:16:09.359 INFO:tasks.workunit.client.0.smithi064.stdout:6/586: mkdir d3/d9/db0 0 2023-12-16T03:16:09.361 INFO:tasks.workunit.client.1.smithi184.stdout:5/801: mknod d1/d3/d2f/c107 0 2023-12-16T03:16:09.361 INFO:tasks.workunit.client.1.smithi184.stdout:2/906: unlink d3/d29/f78 0 2023-12-16T03:16:09.361 INFO:tasks.workunit.client.1.smithi184.stdout:2/907: chown d3/d29/d4d/l119 430446 1 2023-12-16T03:16:09.365 INFO:tasks.workunit.client.0.smithi064.stdout:9/623: rename d2/dc/d24/d39/f61 to d2/d2d/d3b/d3c/d34/fcf 0 2023-12-16T03:16:09.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.358+0000 7f877ec58700 1 -- 172.21.15.64:0/3748690219 wait complete. 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.359+0000 7f877ec58700 1 Processor -- start 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.359+0000 7f877ec58700 1 -- start start 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.359+0000 7f877ec58700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 0x7f8778113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.359+0000 7f877ec58700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8778107560 0x7f8778113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.359+0000 7f877ec58700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87781145e0 con 0x7f8778107560 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.359+0000 7f877ec58700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8778114e80 con 0x7f8778104c40 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.360+0000 7f877c9f4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 0x7f8778113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.360+0000 7f877c9f4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 0x7f8778113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.64:52782/0 (socket says 172.21.15.64:52782) 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.360+0000 7f877c9f4700 1 -- 172.21.15.64:0/3585440427 learned_addr learned my addr 172.21.15.64:0/3585440427 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.361+0000 7f877c9f4700 1 -- 172.21.15.64:0/3585440427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8778107560 msgr2=0x7f8778113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.361+0000 7f877c9f4700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8778107560 0x7f8778113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.361+0000 7f877c9f4700 1 -- 172.21.15.64:0/3585440427 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8768005040 con 0x7f8778104c40 2023-12-16T03:16:09.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.361+0000 7f877c9f4700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 0x7f8778113a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8768008f90 tx=0x7f8768009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:09.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.362+0000 7f87757fa700 1 -- 172.21.15.64:0/3585440427 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8768021070 con 0x7f8778104c40 2023-12-16T03:16:09.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.362+0000 7f87757fa700 1 -- 172.21.15.64:0/3585440427 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f876801c400 con 0x7f8778104c40 2023-12-16T03:16:09.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.362+0000 7f87757fa700 1 -- 172.21.15.64:0/3585440427 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f876800e030 con 0x7f8778104c40 2023-12-16T03:16:09.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.366+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8778115100 con 0x7f8778104c40 2023-12-16T03:16:09.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.366+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87781155c0 con 0x7f8778104c40 2023-12-16T03:16:09.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.368+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877806d790 con 0x7f8778104c40 2023-12-16T03:16:09.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.369+0000 7f87757fa700 1 -- 172.21.15.64:0/3585440427 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 21) v1 ==== 45378+0+0 (secure 0 0 0) 0x7f876801ca00 con 0x7f8778104c40 2023-12-16T03:16:09.373 INFO:tasks.workunit.client.0.smithi064.stdout:1/702: dread d3/dd/d11/d3b/f5e [0,4194304] 0 2023-12-16T03:16:09.373 INFO:tasks.workunit.client.0.smithi064.stdout:1/703: chown d3/dd/d23/d60/fa9 18213756 1 2023-12-16T03:16:09.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.369+0000 7f87757fa700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f8760038390 0x7f876003a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:09.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.369+0000 7f87757fa700 1 -- 172.21.15.64:0/3585440427 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f876804c900 con 0x7f8778104c40 2023-12-16T03:16:09.374 INFO:tasks.workunit.client.0.smithi064.stdout:3/747: mknod db/d4f/d51/dd1/cfa 0 2023-12-16T03:16:09.374 INFO:tasks.workunit.client.0.smithi064.stdout:3/748: readlink db/d12/d1a/l2a 0 2023-12-16T03:16:09.374 INFO:tasks.workunit.client.0.smithi064.stdout:3/749: write db/d12/d1a/f97 [417647,44923] 0 2023-12-16T03:16:09.374 INFO:tasks.workunit.client.0.smithi064.stdout:5/566: dwrite d0/d7/fc2 [0,4194304] 0 2023-12-16T03:16:09.374 INFO:tasks.workunit.client.0.smithi064.stdout:2/522: unlink d1/d15/d58/c31 0 2023-12-16T03:16:09.374 INFO:tasks.workunit.client.0.smithi064.stdout:2/523: dread - d1/d15/d1b/d61/f7f zero size 2023-12-16T03:16:09.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.372+0000 7f8777fff700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f8760038390 0x7f876003a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:09.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.373+0000 7f8777fff700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f8760038390 0x7f876003a840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f877806ea70 tx=0x7f876c00b040 comp rx=0 tx=0).ready entity=mgr.14582 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:09.376 INFO:tasks.workunit.client.0.smithi064.stdout:0/639: dread d2/d8/da/df/f37 [4194304,4194304] 0 2023-12-16T03:16:09.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.376+0000 7f87757fa700 1 -- 172.21.15.64:0/3585440427 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f876801c570 con 0x7f8778104c40 2023-12-16T03:16:09.381 INFO:tasks.workunit.client.0.smithi064.stdout:3/750: dread db/d4f/d51/fdc [0,4194304] 0 2023-12-16T03:16:09.389 INFO:tasks.workunit.client.1.smithi184.stdout:4/950: getdents d1/d29/d34/d5c/d76/d33/d4a 0 2023-12-16T03:16:09.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/954: mkdir d3/d34/dbc/d3c/d24/d8e/d149 0 2023-12-16T03:16:09.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/955: fsync d3/d34/dbc/d3c/d41/d46/d4a/fce 0 2023-12-16T03:16:09.391 INFO:tasks.workunit.client.0.smithi064.stdout:8/692: symlink d0/da/de9/d37/dbf/lea 0 2023-12-16T03:16:09.395 INFO:tasks.workunit.client.0.smithi064.stdout:7/674: dwrite d7/d3e/f55 [4194304,4194304] 0 2023-12-16T03:16:09.395 INFO:tasks.workunit.client.0.smithi064.stdout:7/675: stat d7/d3e/d42/d48/d51/lcc 0 2023-12-16T03:16:09.395 INFO:tasks.workunit.client.0.smithi064.stdout:9/624: creat d2/d2d/d36/db4/fd0 x:0 0 0 2023-12-16T03:16:09.396 INFO:tasks.workunit.client.1.smithi184.stdout:7/960: sync 2023-12-16T03:16:09.396 INFO:tasks.workunit.client.1.smithi184.stdout:2/908: dread d3/d29/d2f/d2e/f35 [0,4194304] 0 2023-12-16T03:16:09.396 INFO:tasks.workunit.client.1.smithi184.stdout:2/909: write d3/d13/ddf/d10a/f10c [4926598,74270] 0 2023-12-16T03:16:09.396 INFO:tasks.workunit.client.0.smithi064.stdout:4/651: dwrite d0/d42/d4c/d70/fbf [0,4194304] 0 2023-12-16T03:16:09.397 INFO:tasks.workunit.client.1.smithi184.stdout:1/956: rmdir d3/d34/dbc/d3c/d41/d63 39 2023-12-16T03:16:09.397 INFO:tasks.workunit.client.1.smithi184.stdout:4/951: rmdir d1/d12/db3/db8/dd0 39 2023-12-16T03:16:09.397 INFO:tasks.workunit.client.1.smithi184.stdout:4/952: read - d1/d29/d34/d5c/d76/d33/d4a/fbe zero size 2023-12-16T03:16:09.397 INFO:tasks.workunit.client.1.smithi184.stdout:4/953: fsync d1/d12/f3e 0 2023-12-16T03:16:09.401 INFO:tasks.workunit.client.0.smithi064.stdout:1/704: link d3/dd/d11/f34 d3/dd/d11/d3b/fe0 0 2023-12-16T03:16:09.401 INFO:tasks.workunit.client.0.smithi064.stdout:2/524: mknod d1/d27/ca3 0 2023-12-16T03:16:09.402 INFO:tasks.workunit.client.0.smithi064.stdout:2/525: readlink d1/d15/d1b/d49/da0/l92 0 2023-12-16T03:16:09.402 INFO:tasks.workunit.client.1.smithi184.stdout:5/802: rename d1/d3/d9/de/d15/c38 to d1/d3/d105/dd4/c108 0 2023-12-16T03:16:09.403 INFO:tasks.workunit.client.0.smithi064.stdout:8/693: getdents d0/da/de9/d5a/d97 0 2023-12-16T03:16:09.405 INFO:tasks.workunit.client.1.smithi184.stdout:1/957: write d3/d34/dbc/d3c/f7c [2059561,55955] 0 2023-12-16T03:16:09.405 INFO:tasks.workunit.client.1.smithi184.stdout:2/910: getdents d3/d29/d4d 0 2023-12-16T03:16:09.405 INFO:tasks.workunit.client.1.smithi184.stdout:7/961: dread d0/dd3/d11a/d79/d1e/faf [0,4194304] 0 2023-12-16T03:16:09.407 INFO:tasks.workunit.client.1.smithi184.stdout:1/958: read d3/d34/d76/f85 [3235533,4960] 0 2023-12-16T03:16:09.407 INFO:tasks.workunit.client.1.smithi184.stdout:1/959: fsync d3/d34/dbc/d38/fac 0 2023-12-16T03:16:09.409 INFO:tasks.workunit.client.0.smithi064.stdout:7/676: creat d7/d3e/d42/d89/d20/d37/db1/fd9 x:0 0 0 2023-12-16T03:16:09.410 INFO:tasks.workunit.client.1.smithi184.stdout:4/954: symlink d1/d11/l149 0 2023-12-16T03:16:09.413 INFO:tasks.workunit.client.1.smithi184.stdout:2/911: creat d3/d29/d4d/d5b/da6/f12d x:0 0 0 2023-12-16T03:16:09.413 INFO:tasks.workunit.client.1.smithi184.stdout:2/912: fsync d3/d29/d61/f68 0 2023-12-16T03:16:09.413 INFO:tasks.workunit.client.0.smithi064.stdout:6/587: dwrite d3/d9/f18 [0,4194304] 0 2023-12-16T03:16:09.415 INFO:tasks.workunit.client.0.smithi064.stdout:3/751: dwrite db/d12/d1a/f7d [0,4194304] 0 2023-12-16T03:16:09.415 INFO:tasks.workunit.client.0.smithi064.stdout:5/567: dwrite d0/d19/d48/d8f/d3e/d35/d5d/fbd [0,4194304] 0 2023-12-16T03:16:09.416 INFO:tasks.workunit.client.1.smithi184.stdout:5/803: dread d1/f29 [0,4194304] 0 2023-12-16T03:16:09.416 INFO:tasks.workunit.client.1.smithi184.stdout:5/804: readlink d1/d3/d9/de/d30/l43 0 2023-12-16T03:16:09.419 INFO:tasks.workunit.client.0.smithi064.stdout:4/652: truncate d0/d42/d53/fb8 1937217 0 2023-12-16T03:16:09.421 INFO:tasks.workunit.client.1.smithi184.stdout:7/962: rename d0/dd3/d11a/d79/dd/d27 to d0/dd3/d11a/d79/d32/d39/d9c/d132 0 2023-12-16T03:16:09.423 INFO:tasks.workunit.client.1.smithi184.stdout:1/960: dread d3/d34/dbc/d3c/d41/d46/f8c [0,4194304] 0 2023-12-16T03:16:09.423 INFO:tasks.workunit.client.1.smithi184.stdout:1/961: read - d3/d13/d2c/f139 zero size 2023-12-16T03:16:09.424 INFO:tasks.workunit.client.1.smithi184.stdout:4/955: link d1/d29/d34/d5c/d76/lfd d1/d12/db3/db8/d11e/l14a 0 2023-12-16T03:16:09.425 INFO:tasks.workunit.client.0.smithi064.stdout:1/705: creat d3/d36/d44/d4d/fe1 x:0 0 0 2023-12-16T03:16:09.425 INFO:tasks.workunit.client.0.smithi064.stdout:1/706: fdatasync d3/d22/d57/db1/fc1 0 2023-12-16T03:16:09.427 INFO:tasks.workunit.client.1.smithi184.stdout:4/956: write d1/f28 [2108529,117170] 0 2023-12-16T03:16:09.429 INFO:tasks.workunit.client.1.smithi184.stdout:4/957: write d1/d29/d34/d5c/d76/f69 [3164927,2148] 0 2023-12-16T03:16:09.431 INFO:tasks.workunit.client.1.smithi184.stdout:1/962: symlink d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/dfd/l14a 0 2023-12-16T03:16:09.432 INFO:tasks.workunit.client.0.smithi064.stdout:4/653: dread d0/d1e/d36/f8f [0,4194304] 0 2023-12-16T03:16:09.434 INFO:tasks.workunit.client.1.smithi184.stdout:7/963: dread d0/d3/d4/fc0 [0,4194304] 0 2023-12-16T03:16:09.434 INFO:tasks.workunit.client.0.smithi064.stdout:2/526: creat d1/d15/d1b/d61/d63/fa4 x:0 0 0 2023-12-16T03:16:09.440 INFO:tasks.workunit.client.0.smithi064.stdout:6/588: truncate d3/d9/f68 1115225 0 2023-12-16T03:16:09.443 INFO:tasks.workunit.client.0.smithi064.stdout:7/677: dwrite d7/d3e/f55 [8388608,4194304] 0 2023-12-16T03:16:09.443 INFO:tasks.workunit.client.0.smithi064.stdout:6/589: dread d3/f5 [0,4194304] 0 2023-12-16T03:16:09.443 INFO:tasks.workunit.client.0.smithi064.stdout:6/590: fdatasync d3/d8/da/f8e 0 2023-12-16T03:16:09.444 INFO:tasks.workunit.client.1.smithi184.stdout:5/805: dwrite d1/d3/d9/de/d15/db9/fd6 [0,4194304] 0 2023-12-16T03:16:09.444 INFO:tasks.workunit.client.0.smithi064.stdout:4/654: dread d0/da/f9f [0,4194304] 0 2023-12-16T03:16:09.444 INFO:tasks.workunit.client.0.smithi064.stdout:4/655: chown d0/d42/d4c/d70/f7d 321258340 1 2023-12-16T03:16:09.445 INFO:tasks.workunit.client.1.smithi184.stdout:7/964: write d0/f50 [3353692,93625] 0 2023-12-16T03:16:09.445 INFO:tasks.workunit.client.1.smithi184.stdout:7/965: dread - d0/f11f zero size 2023-12-16T03:16:09.445 INFO:tasks.workunit.client.1.smithi184.stdout:7/966: dread - d0/dd3/d11a/d79/dd/f102 zero size 2023-12-16T03:16:09.445 INFO:tasks.workunit.client.1.smithi184.stdout:7/967: readlink d0/dd3/d11a/d79/d36/lf5 0 2023-12-16T03:16:09.446 INFO:tasks.workunit.client.1.smithi184.stdout:7/968: fdatasync d0/d6b/d69/f6e 0 2023-12-16T03:16:09.446 INFO:tasks.workunit.client.1.smithi184.stdout:4/958: link d1/d11/d1b/d1e/f41 d1/d11/d5a/d63/d72/f14b 0 2023-12-16T03:16:09.452 INFO:tasks.workunit.client.1.smithi184.stdout:1/963: rename d3/d34/dbc/d3c/d24/d8e to d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/d109/d14b 0 2023-12-16T03:16:09.456 INFO:tasks.workunit.client.0.smithi064.stdout:3/752: symlink db/d12/d4e/da3/lfb 0 2023-12-16T03:16:09.457 INFO:tasks.workunit.client.0.smithi064.stdout:3/753: fdatasync db/d12/d1a/d2c/d34/d4c/d6a/da7/fd0 0 2023-12-16T03:16:09.457 INFO:tasks.workunit.client.0.smithi064.stdout:3/754: write f4 [5094434,96762] 0 2023-12-16T03:16:09.462 INFO:tasks.workunit.client.1.smithi184.stdout:5/806: rename d1/d3/de7 to d1/d3/d2f/d109 0 2023-12-16T03:16:09.462 INFO:tasks.workunit.client.1.smithi184.stdout:5/807: fsync d1/d2a/d31/d28/d72/fe9 0 2023-12-16T03:16:09.462 INFO:tasks.workunit.client.1.smithi184.stdout:5/808: truncate d1/d3/dc6/fe0 370277 0 2023-12-16T03:16:09.466 INFO:tasks.workunit.client.0.smithi064.stdout:5/568: creat d0/d14/d4e/fc6 x:0 0 0 2023-12-16T03:16:09.470 INFO:tasks.workunit.client.1.smithi184.stdout:1/964: dread d3/fa2 [0,4194304] 0 2023-12-16T03:16:09.472 INFO:tasks.workunit.client.0.smithi064.stdout:3/755: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f78 [0,4194304] 0 2023-12-16T03:16:09.472 INFO:tasks.workunit.client.0.smithi064.stdout:1/707: creat d3/d36/d9e/fe2 x:0 0 0 2023-12-16T03:16:09.473 INFO:tasks.workunit.client.1.smithi184.stdout:7/969: dwrite d0/dd3/d11a/d79/d36/d3f/f83 [0,4194304] 0 2023-12-16T03:16:09.477 INFO:tasks.workunit.client.0.smithi064.stdout:2/527: mkdir d1/d15/da5 0 2023-12-16T03:16:09.478 INFO:tasks.workunit.client.0.smithi064.stdout:2/528: fdatasync d1/d15/d23/d2d/f9b 0 2023-12-16T03:16:09.478 INFO:tasks.workunit.client.1.smithi184.stdout:4/959: dwrite d1/d29/d34/d5c/d76/d42/f92 [0,4194304] 0 2023-12-16T03:16:09.480 INFO:tasks.workunit.client.0.smithi064.stdout:3/756: write db/d12/d1a/d2c/d34/d4c/d6a/d93/fa6 [8130249,29680] 0 2023-12-16T03:16:09.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.480+0000 7f87757fa700 1 -- 172.21.15.64:0/3585440427 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mgrmap(e 22) v1 ==== 45674+0+0 (secure 0 0 0) 0x7f8768018cf0 con 0x7f8778104c40 2023-12-16T03:16:09.483 INFO:tasks.workunit.client.1.smithi184.stdout:1/965: creat d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/f14c x:0 0 0 2023-12-16T03:16:09.483 INFO:tasks.workunit.client.1.smithi184.stdout:1/966: truncate d3/d34/dbc/d38/f73 1776462 0 2023-12-16T03:16:09.483 INFO:tasks.workunit.client.1.smithi184.stdout:1/967: chown d3/d34/dbc/d3c/d41/f4d 1416869 1 2023-12-16T03:16:09.483 INFO:tasks.workunit.client.1.smithi184.stdout:1/968: chown d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/cc2 3830610 1 2023-12-16T03:16:09.490 INFO:tasks.workunit.client.0.smithi064.stdout:5/569: dwrite d0/d19/d48/d92/f9e [0,4194304] 0 2023-12-16T03:16:09.490 INFO:tasks.workunit.client.1.smithi184.stdout:5/809: dwrite d1/d3/d9/de/d15/d19/d48/fa1 [0,4194304] 0 2023-12-16T03:16:09.490 INFO:tasks.workunit.client.1.smithi184.stdout:5/810: readlink d1/d3/d9/de/d15/d19/d3a/lc4 0 2023-12-16T03:16:09.490 INFO:tasks.workunit.client.1.smithi184.stdout:5/811: write d1/d3/d2f/f3b [4846455,91770] 0 2023-12-16T03:16:09.492 INFO:tasks.workunit.client.0.smithi064.stdout:2/529: dread d1/f4 [0,4194304] 0 2023-12-16T03:16:09.492 INFO:tasks.workunit.client.0.smithi064.stdout:2/530: chown d1/d27/f84 222 1 2023-12-16T03:16:09.493 INFO:tasks.workunit.client.0.smithi064.stdout:7/678: creat d7/d26/d95/dca/dd2/fda x:0 0 0 2023-12-16T03:16:09.493 INFO:tasks.workunit.client.1.smithi184.stdout:5/812: write d1/d2a/d31/f54 [419114,103973] 0 2023-12-16T03:16:09.494 INFO:tasks.workunit.client.1.smithi184.stdout:5/813: write d1/d3/d9/f40 [5824398,123811] 0 2023-12-16T03:16:09.494 INFO:tasks.workunit.client.1.smithi184.stdout:7/970: creat d0/dd3/d11a/d3b/ddc/f133 x:0 0 0 2023-12-16T03:16:09.495 INFO:tasks.workunit.client.0.smithi064.stdout:4/656: rename d0/da/da6/cbb to d0/d42/d4c/d70/d85/ccc 0 2023-12-16T03:16:09.496 INFO:tasks.workunit.client.0.smithi064.stdout:4/657: stat d0/d1e/d36/f9b 0 2023-12-16T03:16:09.496 INFO:tasks.workunit.client.0.smithi064.stdout:4/658: chown d0/d1e/d36/l43 6277 1 2023-12-16T03:16:09.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/960: rmdir d1/d29/d34/d5c/d76/d3b/d12f 0 2023-12-16T03:16:09.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/961: fdatasync d1/d29/d34/d5c/d76/d33/f81 0 2023-12-16T03:16:09.500 INFO:tasks.workunit.client.0.smithi064.stdout:1/708: mkdir d3/dd/d23/dcb/de3 0 2023-12-16T03:16:09.501 INFO:tasks.workunit.client.1.smithi184.stdout:1/969: getdents d3/d13/d121/d99/db7 0 2023-12-16T03:16:09.507 INFO:tasks.workunit.client.1.smithi184.stdout:5/814: dwrite d1/d3/d9/de/d15/f61 [0,4194304] 0 2023-12-16T03:16:09.509 INFO:tasks.workunit.client.1.smithi184.stdout:7/971: symlink d0/dd3/d11a/d79/d32/d39/d9c/dc2/ddd/l134 0 2023-12-16T03:16:09.510 INFO:tasks.workunit.client.1.smithi184.stdout:7/972: fsync d0/dd3/d11a/d79/d32/d39/d8f/fa0 0 2023-12-16T03:16:09.510 INFO:tasks.workunit.client.1.smithi184.stdout:7/973: chown d0/dd3/d11a/d79/d32/d39/f70 9 1 2023-12-16T03:16:09.510 INFO:tasks.workunit.client.1.smithi184.stdout:7/974: read - d0/dd3/d11a/d79/d32/fd4 zero size 2023-12-16T03:16:09.512 INFO:tasks.workunit.client.1.smithi184.stdout:4/962: rename d1/d12/fcc to d1/d12/d13/f14c 0 2023-12-16T03:16:09.513 INFO:tasks.workunit.client.1.smithi184.stdout:1/970: symlink d3/d34/dbc/d38/d52/l14d 0 2023-12-16T03:16:09.515 INFO:tasks.workunit.client.1.smithi184.stdout:5/815: creat d1/d3/d9/de/d15/d27/ddd/f10a x:0 0 0 2023-12-16T03:16:09.515 INFO:tasks.workunit.client.1.smithi184.stdout:5/816: chown d1/d3/d105/dd4/c108 172 1 2023-12-16T03:16:09.515 INFO:tasks.workunit.client.1.smithi184.stdout:5/817: stat d1/d3/d9/de/d15/f52 0 2023-12-16T03:16:09.516 INFO:tasks.workunit.client.1.smithi184.stdout:5/818: truncate d1/d3/dc6/fd8 180516 0 2023-12-16T03:16:09.516 INFO:tasks.workunit.client.1.smithi184.stdout:5/819: chown d1/d3/d9/de/d15/d19/d5f/d45/l9e 13467 1 2023-12-16T03:16:09.516 INFO:tasks.workunit.client.1.smithi184.stdout:1/971: dread d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/fcf [0,4194304] 0 2023-12-16T03:16:09.523 INFO:tasks.workunit.client.1.smithi184.stdout:4/963: creat d1/d29/d34/d5c/d76/f14d x:0 0 0 2023-12-16T03:16:09.525 INFO:tasks.workunit.client.1.smithi184.stdout:5/820: dread d1/d3/fd [0,4194304] 0 2023-12-16T03:16:09.525 INFO:tasks.workunit.client.1.smithi184.stdout:5/821: stat d1/d3/d9/de/d15/d90/f104 0 2023-12-16T03:16:09.526 INFO:tasks.workunit.client.0.smithi064.stdout:3/757: unlink db/d12/d1a/d2c/d34/d4c/d6a/da7/l60 0 2023-12-16T03:16:09.530 INFO:tasks.workunit.client.1.smithi184.stdout:7/975: truncate d0/dd3/d11a/d79/f9a 48401 0 2023-12-16T03:16:09.533 INFO:tasks.workunit.client.0.smithi064.stdout:3/758: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/fda [0,4194304] 0 2023-12-16T03:16:09.535 INFO:tasks.workunit.client.0.smithi064.stdout:2/531: mkdir d1/d15/d23/d2d/da6 0 2023-12-16T03:16:09.539 INFO:tasks.workunit.client.1.smithi184.stdout:4/964: rmdir d1/d29/d34 39 2023-12-16T03:16:09.540 INFO:tasks.workunit.client.0.smithi064.stdout:7/679: getdents d7/d3e/d42/d89 0 2023-12-16T03:16:09.540 INFO:tasks.workunit.client.0.smithi064.stdout:7/680: fsync d7/d3e/d42/d43/f90 0 2023-12-16T03:16:09.542 INFO:tasks.workunit.client.1.smithi184.stdout:5/822: rmdir d1/d3/d9/de/d15 39 2023-12-16T03:16:09.543 INFO:tasks.workunit.client.0.smithi064.stdout:4/659: creat d0/d42/d66/d5a/fcd x:0 0 0 2023-12-16T03:16:09.544 INFO:tasks.workunit.client.1.smithi184.stdout:7/976: dread d0/dd3/d11a/d79/dd/d75/fb3 [0,4194304] 0 2023-12-16T03:16:09.544 INFO:tasks.workunit.client.0.smithi064.stdout:1/709: mkdir d3/dd/de4 0 2023-12-16T03:16:09.545 INFO:tasks.workunit.client.0.smithi064.stdout:1/710: write d3/dd/d23/d4f/f8d [107111,33744] 0 2023-12-16T03:16:09.545 INFO:tasks.workunit.client.0.smithi064.stdout:1/711: dread - d3/fde zero size 2023-12-16T03:16:09.546 INFO:tasks.workunit.client.0.smithi064.stdout:1/712: read d3/dd/d23/d60/f8b [3566668,17839] 0 2023-12-16T03:16:09.546 INFO:tasks.workunit.client.1.smithi184.stdout:4/965: rmdir d1/d11/d5a/dd7 0 2023-12-16T03:16:09.546 INFO:tasks.workunit.client.1.smithi184.stdout:4/966: dread - d1/d11/d5a/d63/d72/d98/f12b zero size 2023-12-16T03:16:09.548 INFO:tasks.workunit.client.0.smithi064.stdout:5/570: link d0/d19/d48/d8f/d3e/d35/d5d/d9a/lbb d0/d19/d48/d8f/dac/d23/lc7 0 2023-12-16T03:16:09.549 INFO:tasks.workunit.client.1.smithi184.stdout:5/823: truncate d1/d3/d9/d49/f95 1833741 0 2023-12-16T03:16:09.550 INFO:tasks.workunit.client.0.smithi064.stdout:2/532: chown d1/d15/d1b/c87 213 1 2023-12-16T03:16:09.552 INFO:tasks.workunit.client.1.smithi184.stdout:7/977: link d0/c71 d0/dd3/d11a/d79/d32/d39/d9c/d132/c135 0 2023-12-16T03:16:09.553 INFO:tasks.workunit.client.0.smithi064.stdout:4/660: unlink d0/d1e/c64 0 2023-12-16T03:16:09.557 INFO:tasks.workunit.client.1.smithi184.stdout:4/967: mkdir d1/d11/d5a/d63/d103/d45/d12d/d14e 0 2023-12-16T03:16:09.557 INFO:tasks.workunit.client.0.smithi064.stdout:1/713: link d3/dd/d23/d86/ca3 d3/dd/de4/ce5 0 2023-12-16T03:16:09.558 INFO:tasks.workunit.client.1.smithi184.stdout:4/968: write d1/d11/fdc [992584,22047] 0 2023-12-16T03:16:09.560 INFO:tasks.workunit.client.0.smithi064.stdout:5/571: link d0/d7/f1e d0/d7/d34/fc8 0 2023-12-16T03:16:09.563 INFO:tasks.workunit.client.0.smithi064.stdout:2/533: chown d1/d15/d1b/d49/f6b 68674 1 2023-12-16T03:16:09.566 INFO:tasks.workunit.client.0.smithi064.stdout:1/714: truncate d3/dd/d11/f80 2570675 0 2023-12-16T03:16:09.566 INFO:tasks.workunit.client.0.smithi064.stdout:1/715: truncate d3/dd/d23/d4f/f8d 898218 0 2023-12-16T03:16:09.566 INFO:tasks.workunit.client.0.smithi064.stdout:1/716: fdatasync d3/dd/d23/f7c 0 2023-12-16T03:16:09.566 INFO:tasks.workunit.client.0.smithi064.stdout:1/717: chown d3/fde 211536 1 2023-12-16T03:16:09.568 INFO:tasks.workunit.client.0.smithi064.stdout:1/718: write d3/d36/d44/f51 [195199,30666] 0 2023-12-16T03:16:09.568 INFO:tasks.workunit.client.0.smithi064.stdout:5/572: dread d0/d19/d48/d8f/dac/ff [0,4194304] 0 2023-12-16T03:16:09.568 INFO:tasks.workunit.client.0.smithi064.stdout:1/719: chown d3/dd/c14 1658 1 2023-12-16T03:16:09.568 INFO:tasks.workunit.client.0.smithi064.stdout:5/573: readlink d0/d19/d48/d8f/d3e/d35/d5d/d9a/lbb 0 2023-12-16T03:16:09.571 INFO:tasks.workunit.client.0.smithi064.stdout:2/534: creat d1/d15/d1b/d49/fa7 x:0 0 0 2023-12-16T03:16:09.574 INFO:tasks.workunit.client.0.smithi064.stdout:1/720: write d3/d22/f2e [531545,26712] 0 2023-12-16T03:16:09.574 INFO:tasks.workunit.client.0.smithi064.stdout:1/721: chown d3/d36/d44/d4d/d58 12911576 1 2023-12-16T03:16:09.574 INFO:tasks.workunit.client.1.smithi184.stdout:7/978: dwrite d0/d6b/d69/fa4 [0,4194304] 0 2023-12-16T03:16:09.574 INFO:tasks.workunit.client.1.smithi184.stdout:7/979: readlink d0/dd3/d11a/d79/d32/d39/dcb/lcc 0 2023-12-16T03:16:09.575 INFO:tasks.workunit.client.1.smithi184.stdout:7/980: readlink d0/dd3/d11a/d79/dd/le 0 2023-12-16T03:16:09.576 INFO:tasks.workunit.client.1.smithi184.stdout:5/824: creat d1/d3/d9/de/d30/d68/f10b x:0 0 0 2023-12-16T03:16:09.578 INFO:tasks.workunit.client.0.smithi064.stdout:5/574: mkdir d0/d50/d39/daa/dc5/dc9 0 2023-12-16T03:16:09.586 INFO:tasks.workunit.client.1.smithi184.stdout:4/969: mknod d1/d12/db3/db8/dd2/c14f 0 2023-12-16T03:16:09.587 INFO:tasks.workunit.client.0.smithi064.stdout:1/722: creat d3/dd/d23/d60/fe6 x:0 0 0 2023-12-16T03:16:09.587 INFO:tasks.workunit.client.0.smithi064.stdout:1/723: write d3/dd/d11/d6a/f75 [1087045,116825] 0 2023-12-16T03:16:09.589 INFO:tasks.workunit.client.1.smithi184.stdout:7/981: truncate d0/dd3/d11a/d79/d36/d3f/fcf 3814430 0 2023-12-16T03:16:09.590 INFO:tasks.workunit.client.1.smithi184.stdout:5/825: dwrite d1/d3/f62 [0,4194304] 0 2023-12-16T03:16:09.590 INFO:tasks.workunit.client.0.smithi064.stdout:5/575: creat d0/d19/d48/d8f/d5e/d84/fca x:0 0 0 2023-12-16T03:16:09.591 INFO:tasks.workunit.client.1.smithi184.stdout:4/970: symlink d1/d11/d5a/d63/d103/d45/dcf/dea/l150 0 2023-12-16T03:16:09.594 INFO:tasks.workunit.client.0.smithi064.stdout:2/535: rename d1/d15/d1b/d9c/d69/f5a to d1/d27/fa8 0 2023-12-16T03:16:09.601 INFO:tasks.workunit.client.0.smithi064.stdout:1/724: creat d3/dd/d23/d4f/daf/fe7 x:0 0 0 2023-12-16T03:16:09.601 INFO:tasks.workunit.client.0.smithi064.stdout:1/725: truncate d3/dd/d23/d4f/f9a 329246 0 2023-12-16T03:16:09.601 INFO:tasks.workunit.client.1.smithi184.stdout:7/982: dread d0/dd3/d11a/d79/d36/f4e [4194304,4194304] 0 2023-12-16T03:16:09.602 INFO:tasks.workunit.client.1.smithi184.stdout:5/826: truncate d1/d3/d9/de/d15/f61 1219863 0 2023-12-16T03:16:09.602 INFO:tasks.workunit.client.1.smithi184.stdout:5/827: chown d1/d3/d2f/f3d 268556 1 2023-12-16T03:16:09.602 INFO:tasks.workunit.client.0.smithi064.stdout:5/576: mknod d0/d14/d20/d37/ccb 0 2023-12-16T03:16:09.604 INFO:tasks.workunit.client.0.smithi064.stdout:2/536: mknod d1/d15/d23/d2d/da6/ca9 0 2023-12-16T03:16:09.604 INFO:tasks.workunit.client.1.smithi184.stdout:7/983: getdents d0/dd3/d11a/d79/d32/d39 0 2023-12-16T03:16:09.604 INFO:tasks.workunit.client.1.smithi184.stdout:7/984: fsync d0/fff 0 2023-12-16T03:16:09.606 INFO:tasks.workunit.client.0.smithi064.stdout:1/726: mkdir d3/dd/d11/dbf/de8 0 2023-12-16T03:16:09.609 INFO:tasks.workunit.client.1.smithi184.stdout:4/971: dwrite d1/d11/d5a/d63/d103/f115 [0,4194304] 0 2023-12-16T03:16:09.610 INFO:tasks.workunit.client.1.smithi184.stdout:7/985: creat d0/dd3/d11a/d3b/f136 x:0 0 0 2023-12-16T03:16:09.612 INFO:tasks.workunit.client.0.smithi064.stdout:5/577: read d0/d19/d48/d8f/d3e/d35/f8a [221802,28718] 0 2023-12-16T03:16:09.612 INFO:tasks.workunit.client.0.smithi064.stdout:5/578: dread - d0/d19/d48/d92/fb5 zero size 2023-12-16T03:16:09.615 INFO:tasks.workunit.client.1.smithi184.stdout:5/828: dread d1/d2a/d31/d58/f7f [0,4194304] 0 2023-12-16T03:16:09.615 INFO:tasks.workunit.client.1.smithi184.stdout:5/829: write d1/d3/d9/de/d15/f82 [598900,58250] 0 2023-12-16T03:16:09.615 INFO:tasks.workunit.client.0.smithi064.stdout:2/537: creat d1/d15/d1b/d49/da0/d8f/faa x:0 0 0 2023-12-16T03:16:09.620 INFO:tasks.workunit.client.0.smithi064.stdout:2/538: dread d1/f4 [0,4194304] 0 2023-12-16T03:16:09.621 INFO:tasks.workunit.client.0.smithi064.stdout:1/727: unlink d3/d22/dab/fc3 0 2023-12-16T03:16:09.622 INFO:tasks.workunit.client.0.smithi064.stdout:1/728: write d3/d22/d57/db1/fbe [805424,11773] 0 2023-12-16T03:16:09.623 INFO:tasks.workunit.client.1.smithi184.stdout:4/972: creat d1/d29/d34/d5c/d76/d3b/d137/f151 x:0 0 0 2023-12-16T03:16:09.629 INFO:tasks.workunit.client.0.smithi064.stdout:1/729: dread d3/dd/d11/f17 [0,4194304] 0 2023-12-16T03:16:09.629 INFO:tasks.workunit.client.1.smithi184.stdout:7/986: symlink d0/dd3/d11a/d79/d34/dc1/d107/l137 0 2023-12-16T03:16:09.632 INFO:tasks.workunit.client.1.smithi184.stdout:5/830: creat d1/d3/d9/de/d15/d19/d5f/f10c x:0 0 0 2023-12-16T03:16:09.636 INFO:tasks.workunit.client.1.smithi184.stdout:4/973: rmdir d1/d11/d5a/d63 39 2023-12-16T03:16:09.636 INFO:tasks.workunit.client.1.smithi184.stdout:4/974: chown d1/d11/d1b/d1e/f10d 183 1 2023-12-16T03:16:09.639 INFO:tasks.workunit.client.1.smithi184.stdout:7/987: rename d0/dd3/d11a/d79/d36/d3f/f6d to d0/dd3/d11a/d79/dd/f138 0 2023-12-16T03:16:09.639 INFO:tasks.workunit.client.1.smithi184.stdout:7/988: write d0/dd3/d11a/d79/d32/d39/d8f/dab/ff4 [503985,65811] 0 2023-12-16T03:16:09.639 INFO:tasks.workunit.client.1.smithi184.stdout:7/989: write d0/dd3/d11a/d79/d34/f12e [802485,56717] 0 2023-12-16T03:16:09.639 INFO:tasks.workunit.client.0.smithi064.stdout:2/539: dwrite d1/d15/d1b/d9c/d69/f56 [4194304,4194304] 0 2023-12-16T03:16:09.640 INFO:tasks.workunit.client.0.smithi064.stdout:5/579: symlink d0/d7/lcc 0 2023-12-16T03:16:09.643 INFO:tasks.workunit.client.1.smithi184.stdout:5/831: creat d1/d3/dc6/f10d x:0 0 0 2023-12-16T03:16:09.643 INFO:tasks.workunit.client.1.smithi184.stdout:5/832: read d1/d3/d9/f50 [897568,31308] 0 2023-12-16T03:16:09.645 INFO:tasks.workunit.client.1.smithi184.stdout:4/975: creat d1/d29/d34/d5c/d76/d33/d4a/f152 x:0 0 0 2023-12-16T03:16:09.645 INFO:tasks.workunit.client.1.smithi184.stdout:2/913: sync 2023-12-16T03:16:09.645 INFO:tasks.workunit.client.1.smithi184.stdout:2/914: fdatasync d3/f76 0 2023-12-16T03:16:09.645 INFO:tasks.workunit.client.0.smithi064.stdout:2/540: dread d1/d15/d1b/d49/da0/d8f/f9a [0,4194304] 0 2023-12-16T03:16:09.646 INFO:tasks.workunit.client.1.smithi184.stdout:7/990: rmdir d0/dd3/d11a/d79/d36/d84 39 2023-12-16T03:16:09.646 INFO:tasks.workunit.client.1.smithi184.stdout:7/991: truncate d0/dd3/d11a/d79/d32/d39/d9c/f117 888234 0 2023-12-16T03:16:09.647 INFO:tasks.workunit.client.0.smithi064.stdout:1/730: dwrite d3/d22/fd5 [0,4194304] 0 2023-12-16T03:16:09.647 INFO:tasks.workunit.client.0.smithi064.stdout:1/731: fdatasync d3/dd/d23/d60/fa9 0 2023-12-16T03:16:09.647 INFO:tasks.workunit.client.1.smithi184.stdout:7/992: write d0/dd3/d11a/d79/dd/d75/dfb/f105 [919840,118583] 0 2023-12-16T03:16:09.648 INFO:tasks.workunit.client.0.smithi064.stdout:5/580: creat d0/d19/d48/d8f/d3e/d35/d5d/d9a/fcd x:0 0 0 2023-12-16T03:16:09.648 INFO:tasks.workunit.client.0.smithi064.stdout:5/581: write d0/d19/d48/d92/fb5 [681664,127402] 0 2023-12-16T03:16:09.648 INFO:tasks.workunit.client.0.smithi064.stdout:5/582: fsync d0/d7/fc2 0 2023-12-16T03:16:09.649 INFO:tasks.workunit.client.1.smithi184.stdout:5/833: getdents d1/d3/d2f/d109 0 2023-12-16T03:16:09.650 INFO:tasks.workunit.client.1.smithi184.stdout:5/834: fdatasync d1/d3/d9/f40 0 2023-12-16T03:16:09.652 INFO:tasks.workunit.client.0.smithi064.stdout:2/541: mkdir d1/d15/d58/dab 0 2023-12-16T03:16:09.654 INFO:tasks.workunit.client.0.smithi064.stdout:2/542: write d1/d15/f75 [201680,80725] 0 2023-12-16T03:16:09.654 INFO:tasks.workunit.client.0.smithi064.stdout:2/543: write d1/d15/d23/d2d/fa1 [565157,16450] 0 2023-12-16T03:16:09.654 INFO:tasks.workunit.client.0.smithi064.stdout:2/544: write d1/d76/d57/f80 [4432881,51541] 0 2023-12-16T03:16:09.654 INFO:tasks.workunit.client.1.smithi184.stdout:4/976: getdents d1/d12/db3/db8/dd2 0 2023-12-16T03:16:09.654 INFO:tasks.workunit.client.1.smithi184.stdout:4/977: stat d1/d11/d1b/cd8 0 2023-12-16T03:16:09.655 INFO:tasks.workunit.client.1.smithi184.stdout:4/978: stat d1/d11/d5a/d63/d72/d98 0 2023-12-16T03:16:09.659 INFO:tasks.workunit.client.1.smithi184.stdout:2/915: rmdir d3/d29/d61/d6d/dd6 39 2023-12-16T03:16:09.659 INFO:tasks.workunit.client.1.smithi184.stdout:2/916: dread - d3/d29/d2f/d46/fba zero size 2023-12-16T03:16:09.661 INFO:tasks.workunit.client.1.smithi184.stdout:1/972: sync 2023-12-16T03:16:09.661 INFO:tasks.workunit.client.1.smithi184.stdout:1/973: fdatasync d3/d34/dbc/f58 0 2023-12-16T03:16:09.662 INFO:tasks.workunit.client.0.smithi064.stdout:1/732: truncate d3/dd/d11/f56 244213 0 2023-12-16T03:16:09.663 INFO:tasks.workunit.client.1.smithi184.stdout:7/993: mkdir d0/dd3/d11a/d79/dd/d75/d139 0 2023-12-16T03:16:09.666 INFO:tasks.workunit.client.0.smithi064.stdout:5/583: unlink d0/d50/d39/l43 0 2023-12-16T03:16:09.666 INFO:tasks.workunit.client.0.smithi064.stdout:1/733: write d3/f7b [1137390,67071] 0 2023-12-16T03:16:09.671 INFO:tasks.workunit.client.0.smithi064.stdout:1/734: write d3/d36/d44/d4d/f4e [2001694,2944] 0 2023-12-16T03:16:09.671 INFO:tasks.workunit.client.1.smithi184.stdout:4/979: rmdir d1/d11/d5a/d63/d103/d45/dcf/dea 39 2023-12-16T03:16:09.671 INFO:tasks.workunit.client.1.smithi184.stdout:4/980: dread - d1/d12/db3/ffe zero size 2023-12-16T03:16:09.671 INFO:tasks.workunit.client.1.smithi184.stdout:5/835: dwrite d1/d3/d9/de/d15/fb8 [0,4194304] 0 2023-12-16T03:16:09.678 INFO:tasks.workunit.client.1.smithi184.stdout:2/917: rename d3/d29/cdd to d3/d9/d19/d82/c12e 0 2023-12-16T03:16:09.678 INFO:tasks.workunit.client.1.smithi184.stdout:2/918: fsync d3/d13/f18 0 2023-12-16T03:16:09.678 INFO:tasks.workunit.client.1.smithi184.stdout:1/974: link d3/d13/d10b/l133 d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/d109/l14e 0 2023-12-16T03:16:09.682 INFO:tasks.workunit.client.1.smithi184.stdout:4/981: mknod d1/d11/d5a/d63/d103/d45/dcf/de6/c153 0 2023-12-16T03:16:09.686 INFO:tasks.workunit.client.1.smithi184.stdout:5/836: creat d1/d3/d9/de/d15/d19/d5f/f10e x:0 0 0 2023-12-16T03:16:09.690 INFO:tasks.workunit.client.1.smithi184.stdout:2/919: mknod d3/d13/d28/d83/dda/c12f 0 2023-12-16T03:16:09.692 INFO:tasks.workunit.client.1.smithi184.stdout:7/994: dwrite d0/dd3/d11a/d79/d32/d39/d9c/dc2/ddd/ff6 [0,4194304] 0 2023-12-16T03:16:09.692 INFO:tasks.workunit.client.1.smithi184.stdout:4/982: mknod d1/d12/db3/db8/d11e/c154 0 2023-12-16T03:16:09.692 INFO:tasks.workunit.client.1.smithi184.stdout:4/983: chown d1/d11/d5a 889950 1 2023-12-16T03:16:09.693 INFO:tasks.workunit.client.0.smithi064.stdout:1/735: dwrite d3/dd/d23/d60/fa9 [0,4194304] 0 2023-12-16T03:16:09.697 INFO:tasks.workunit.client.1.smithi184.stdout:5/837: getdents d1/d3/d9/de/d15/d19/d5f/d45 0 2023-12-16T03:16:09.697 INFO:tasks.workunit.client.0.smithi064.stdout:2/545: rename d1/d27 to d1/d15/d7d/dac 0 2023-12-16T03:16:09.700 INFO:tasks.workunit.client.1.smithi184.stdout:2/920: rename d3/f50 to d3/d29/d4d/d5b/da6/f130 0 2023-12-16T03:16:09.701 INFO:tasks.workunit.client.1.smithi184.stdout:4/984: dread d1/d12/d13/d40/f13b [0,4194304] 0 2023-12-16T03:16:09.705 INFO:tasks.workunit.client.1.smithi184.stdout:4/985: write d1/d29/d34/f9c [3909003,101486] 0 2023-12-16T03:16:09.705 INFO:tasks.workunit.client.1.smithi184.stdout:4/986: dread - d1/d29/d34/d5c/d76/f14d zero size 2023-12-16T03:16:09.705 INFO:tasks.workunit.client.1.smithi184.stdout:4/987: write d1/d12/d13/d40/fd3 [1035558,71481] 0 2023-12-16T03:16:09.705 INFO:tasks.workunit.client.1.smithi184.stdout:7/995: mknod d0/dd3/d11a/d79/d36/d84/dd2/c13a 0 2023-12-16T03:16:09.706 INFO:tasks.workunit.client.0.smithi064.stdout:1/736: dread d3/d36/d44/d4d/f6b [0,4194304] 0 2023-12-16T03:16:09.706 INFO:tasks.workunit.client.0.smithi064.stdout:2/546: rename d1/d15/d1b/d9c/d69/c5d to d1/d15/d23/d2d/cad 0 2023-12-16T03:16:09.706 INFO:tasks.workunit.client.1.smithi184.stdout:1/975: dwrite d3/d34/dbc/d3c/d41/d46/f69 [0,4194304] 0 2023-12-16T03:16:09.706 INFO:tasks.workunit.client.1.smithi184.stdout:1/976: truncate d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/dfd/f103 720360 0 2023-12-16T03:16:09.707 INFO:tasks.workunit.client.1.smithi184.stdout:5/838: mkdir d1/d3/d9/de/d10f 0 2023-12-16T03:16:09.707 INFO:tasks.workunit.client.1.smithi184.stdout:5/839: dread - d1/d3/ff5 zero size 2023-12-16T03:16:09.708 INFO:tasks.workunit.client.0.smithi064.stdout:1/737: creat d3/dd/d11/dbf/fe9 x:0 0 0 2023-12-16T03:16:09.708 INFO:tasks.workunit.client.0.smithi064.stdout:1/738: stat d3/dd/d11/d2f/c73 0 2023-12-16T03:16:09.710 INFO:tasks.workunit.client.0.smithi064.stdout:2/547: write d1/d15/d1b/d61/f5f [299414,30481] 0 2023-12-16T03:16:09.710 INFO:tasks.workunit.client.1.smithi184.stdout:5/840: dread d1/f29 [0,4194304] 0 2023-12-16T03:16:09.711 INFO:tasks.workunit.client.1.smithi184.stdout:2/921: link d3/d9/d19/c3f d3/d13/d10e/c131 0 2023-12-16T03:16:09.711 INFO:tasks.workunit.client.1.smithi184.stdout:2/922: write d3/d13/d28/fbe [341595,43398] 0 2023-12-16T03:16:09.712 INFO:tasks.workunit.client.1.smithi184.stdout:2/923: write d3/d29/d4d/d5b/ffe [755957,115990] 0 2023-12-16T03:16:09.712 INFO:tasks.workunit.client.0.smithi064.stdout:1/739: creat d3/d22/dab/fea x:0 0 0 2023-12-16T03:16:09.713 INFO:tasks.workunit.client.0.smithi064.stdout:1/740: write d3/d22/fd5 [2651081,93231] 0 2023-12-16T03:16:09.718 INFO:tasks.workunit.client.0.smithi064.stdout:2/548: rename d1/le to d1/d15/d1b/d9c/d69/lae 0 2023-12-16T03:16:09.719 INFO:tasks.workunit.client.1.smithi184.stdout:4/988: creat d1/d11/d1b/d1e/d128/d142/f155 x:0 0 0 2023-12-16T03:16:09.720 INFO:tasks.workunit.client.0.smithi064.stdout:0/640: sync 2023-12-16T03:16:09.720 INFO:tasks.workunit.client.0.smithi064.stdout:8/694: sync 2023-12-16T03:16:09.720 INFO:tasks.workunit.client.0.smithi064.stdout:9/625: sync 2023-12-16T03:16:09.720 INFO:tasks.workunit.client.0.smithi064.stdout:0/641: dread - d2/d7/d10/dc4/dcc/f68 zero size 2023-12-16T03:16:09.720 INFO:tasks.workunit.client.0.smithi064.stdout:6/591: sync 2023-12-16T03:16:09.723 INFO:tasks.workunit.client.1.smithi184.stdout:7/996: mknod d0/dd3/d11a/d79/d32/d39/d8f/dab/d119/c13b 0 2023-12-16T03:16:09.724 INFO:tasks.workunit.client.1.smithi184.stdout:5/841: dwrite d1/d3/fb2 [4194304,4194304] 0 2023-12-16T03:16:09.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.723+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 --> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8778115af0 con 0x7f8760038390 2023-12-16T03:16:09.727 INFO:tasks.workunit.client.0.smithi064.stdout:1/741: unlink d3/c8 0 2023-12-16T03:16:09.728 INFO:tasks.workunit.client.0.smithi064.stdout:9/626: dread d2/f1d [0,4194304] 0 2023-12-16T03:16:09.729 INFO:tasks.workunit.client.1.smithi184.stdout:1/977: mkdir d3/d13/d121/dc7/d141/d14f 0 2023-12-16T03:16:09.732 INFO:tasks.workunit.client.0.smithi064.stdout:2/549: unlink d1/d15/d1b/d61/f7f 0 2023-12-16T03:16:09.732 INFO:tasks.workunit.client.0.smithi064.stdout:2/550: write d1/d15/d1b/d61/d63/fa4 [295988,44694] 0 2023-12-16T03:16:09.732 INFO:tasks.workunit.client.0.smithi064.stdout:2/551: fdatasync d1/d15/d23/d2d/fa1 0 2023-12-16T03:16:09.733 INFO:tasks.workunit.client.0.smithi064.stdout:2/552: read d1/f7 [3451133,41232] 0 2023-12-16T03:16:09.734 INFO:tasks.workunit.client.1.smithi184.stdout:2/924: rmdir d3/d13/ddf/d10a 39 2023-12-16T03:16:09.734 INFO:tasks.workunit.client.1.smithi184.stdout:2/925: fdatasync d3/d29/d2f/d2e/f1a 0 2023-12-16T03:16:09.736 INFO:tasks.workunit.client.0.smithi064.stdout:8/695: creat d0/da/d3e/d46/feb x:0 0 0 2023-12-16T03:16:09.736 INFO:tasks.workunit.client.0.smithi064.stdout:6/592: symlink d3/d8/d1f/d26/d47/d4a/d67/d73/lb1 0 2023-12-16T03:16:09.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.736+0000 7f87757fa700 1 -- 172.21.15.64:0/3585440427 <== mgr.14582 v2:172.21.15.184:6828/2992718398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f8778115af0 con 0x7f8760038390 2023-12-16T03:16:09.739 INFO:tasks.workunit.client.1.smithi184.stdout:4/989: mknod d1/d11/d5a/d63/d103/d45/dcf/de6/d144/c156 0 2023-12-16T03:16:09.739 INFO:tasks.workunit.client.1.smithi184.stdout:4/990: chown d1/d12/d13/f31 2971 1 2023-12-16T03:16:09.739 INFO:tasks.workunit.client.1.smithi184.stdout:4/991: fdatasync d1/d11/d5a/d63/d103/d5e/d6a/f97 0 2023-12-16T03:16:09.740 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:16:09.740 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:16:09.740 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:16:09.741 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T03:16:09.741 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [], 2023-12-16T03:16:09.741 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "1/2 daemons upgraded", 2023-12-16T03:16:09.741 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2023-12-16T03:16:09.741 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:16:09.741 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:16:09.742 INFO:tasks.workunit.client.0.smithi064.stdout:1/742: creat d3/d36/d44/d4d/dad/dc5/feb x:0 0 0 2023-12-16T03:16:09.742 INFO:tasks.workunit.client.0.smithi064.stdout:1/743: fdatasync d3/dd/f59 0 2023-12-16T03:16:09.742 INFO:tasks.workunit.client.1.smithi184.stdout:4/992: read d1/d11/d5a/d63/d103/d5e/fa8 [2033696,66528] 0 2023-12-16T03:16:09.742 INFO:tasks.workunit.client.1.smithi184.stdout:4/993: truncate d1/d29/d37/d102/f125 1034658 0 2023-12-16T03:16:09.742 INFO:tasks.workunit.client.1.smithi184.stdout:7/997: unlink d0/d6b/fae 0 2023-12-16T03:16:09.742 INFO:tasks.workunit.client.1.smithi184.stdout:7/998: stat d0/dd3/d11a/d79/d36/d84/dd2/c118 0 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.739+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f8760038390 msgr2=0x7f876003a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.739+0000 7f877ec58700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f8760038390 0x7f876003a840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f877806ea70 tx=0x7f876c00b040 comp rx=0 tx=0).stop 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.739+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 msgr2=0x7f8778113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.739+0000 7f877ec58700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 0x7f8778113a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8768008f90 tx=0x7f8768009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.740+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 shutdown_connections 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.740+0000 7f877ec58700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f8760038390 0x7f876003a840 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.740+0000 7f877ec58700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8778104c40 0x7f8778113a50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.740+0000 7f877ec58700 1 --2- 172.21.15.64:0/3585440427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8778107560 0x7f8778113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.740+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 >> 172.21.15.64:0/3585440427 conn(0x7f8778069b20 msgr2=0x7f877806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.740+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 shutdown_connections 2023-12-16T03:16:09.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:09.740+0000 7f877ec58700 1 -- 172.21.15.64:0/3585440427 wait complete. 2023-12-16T03:16:09.744 INFO:tasks.workunit.client.0.smithi064.stdout:2/553: unlink d1/d15/d1b/d49/da0/d8f/faa 0 2023-12-16T03:16:09.744 INFO:tasks.workunit.client.0.smithi064.stdout:2/554: chown d1/d15/l48 6846369 1 2023-12-16T03:16:09.744 INFO:tasks.workunit.client.0.smithi064.stdout:2/555: write d1/d15/d7d/dac/fa8 [2012534,120800] 0 2023-12-16T03:16:09.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/556: fdatasync d1/f8 0 2023-12-16T03:16:09.749 INFO:tasks.workunit.client.0.smithi064.stdout:0/642: dwrite d2/d7/d10/d21/d7a/f60 [0,4194304] 0 2023-12-16T03:16:09.749 INFO:tasks.workunit.client.0.smithi064.stdout:8/696: mkdir d0/da/de9/d5a/dec 0 2023-12-16T03:16:09.749 INFO:tasks.workunit.client.0.smithi064.stdout:8/697: stat d0 0 2023-12-16T03:16:09.749 INFO:tasks.workunit.client.0.smithi064.stdout:9/627: dwrite d2/d2d/d6c/f95 [0,4194304] 0 2023-12-16T03:16:09.750 INFO:tasks.workunit.client.1.smithi184.stdout:1/978: truncate d3/d34/dbc/d3c/d41/d77/ff3 2610567 0 2023-12-16T03:16:09.750 INFO:tasks.workunit.client.1.smithi184.stdout:1/979: readlink d3/d34/dbc/d3c/d24/l9d 0 2023-12-16T03:16:09.750 INFO:tasks.workunit.client.1.smithi184.stdout:1/980: chown d3/d34/dbc/d3c/d41/f4d 13556 1 2023-12-16T03:16:09.750 INFO:tasks.workunit.client.1.smithi184.stdout:1/981: stat d3/d34/dbc/d3c/d41/d77 0 2023-12-16T03:16:09.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/744: truncate d3/d36/d44/d4d/d58/f6e 1663117 0 2023-12-16T03:16:09.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/745: chown d3/dd/d23/d60/fc2 192419 1 2023-12-16T03:16:09.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/746: write d3/d36/d44/d4d/d58/d96/f98 [767830,117088] 0 2023-12-16T03:16:09.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/747: truncate d3/dd/f59 1483279 0 2023-12-16T03:16:09.754 INFO:tasks.workunit.client.0.smithi064.stdout:2/557: getdents d1/d15/d1b/d9c/d69 0 2023-12-16T03:16:09.757 INFO:tasks.workunit.client.1.smithi184.stdout:4/994: truncate d1/d12/d13/d40/f4d 1007744 0 2023-12-16T03:16:09.757 INFO:tasks.workunit.client.1.smithi184.stdout:4/995: fsync d1/d12/db3/db8/dd2/fe9 0 2023-12-16T03:16:09.757 INFO:tasks.workunit.client.1.smithi184.stdout:4/996: readlink d1/d11/d5a/d63/d103/d45/l6e 0 2023-12-16T03:16:09.757 INFO:tasks.workunit.client.1.smithi184.stdout:4/997: chown d1/d11/l61 4 1 2023-12-16T03:16:09.758 INFO:tasks.workunit.client.0.smithi064.stdout:0/643: symlink d2/d8/da/df/db0/ld2 0 2023-12-16T03:16:09.758 INFO:tasks.workunit.client.0.smithi064.stdout:6/593: dread d3/d8/d1f/f5a [0,4194304] 0 2023-12-16T03:16:09.760 INFO:tasks.workunit.client.0.smithi064.stdout:2/558: read d1/d15/d1b/d9c/f34 [530079,75818] 0 2023-12-16T03:16:09.761 INFO:tasks.workunit.client.0.smithi064.stdout:8/698: dread d0/d1d/d24/d2f/d50/f87 [4194304,4194304] 0 2023-12-16T03:16:09.761 INFO:tasks.workunit.client.1.smithi184.stdout:7/999: rename d0/dd3/d11a/d79/d32/d39/d9c/dc2/ddd/d110 to d0/dd3/d11a/d3b/d13c 0 2023-12-16T03:16:09.762 INFO:tasks.workunit.client.0.smithi064.stdout:9/628: symlink d2/ld1 0 2023-12-16T03:16:09.765 INFO:tasks.workunit.client.0.smithi064.stdout:1/748: unlink d3/dd/d23/d60/fa9 0 2023-12-16T03:16:09.767 INFO:tasks.workunit.client.0.smithi064.stdout:0/644: mknod d2/d8/da/df/daf/dbd/cd3 0 2023-12-16T03:16:09.768 INFO:tasks.workunit.client.0.smithi064.stdout:6/594: symlink d3/d9e/lb2 0 2023-12-16T03:16:09.773 INFO:tasks.workunit.client.0.smithi064.stdout:2/559: write d1/d15/d1b/d9c/d68/f64 [118084,29637] 0 2023-12-16T03:16:09.777 INFO:tasks.workunit.client.0.smithi064.stdout:8/699: symlink d0/led 0 2023-12-16T03:16:09.780 INFO:tasks.workunit.client.0.smithi064.stdout:9/629: rename d2/d2d/d6c/da4/lb8 to d2/dc/d24/da9/ld2 0 2023-12-16T03:16:09.785 INFO:tasks.workunit.client.0.smithi064.stdout:1/749: creat d3/d36/d44/d4d/da8/fec x:0 0 0 2023-12-16T03:16:09.787 INFO:tasks.workunit.client.1.smithi184.stdout:5/842: truncate d1/d2a/f13 2439330 0 2023-12-16T03:16:09.789 INFO:tasks.workunit.client.0.smithi064.stdout:0/645: symlink d2/d7/d10/d21/d31/ld4 0 2023-12-16T03:16:09.791 INFO:tasks.workunit.client.1.smithi184.stdout:1/982: symlink d3/d34/d76/d91/d127/l150 0 2023-12-16T03:16:09.792 INFO:tasks.workunit.client.0.smithi064.stdout:9/630: mkdir d2/d2d/d3b/d3c/dd3 0 2023-12-16T03:16:09.793 INFO:tasks.workunit.client.0.smithi064.stdout:6/595: dwrite d3/d8/da/f23 [0,4194304] 0 2023-12-16T03:16:09.793 INFO:tasks.workunit.client.0.smithi064.stdout:1/750: truncate d3/d22/fd5 3546349 0 2023-12-16T03:16:09.795 INFO:tasks.workunit.client.1.smithi184.stdout:4/998: symlink d1/d11/d5a/d63/d72/l157 0 2023-12-16T03:16:09.795 INFO:tasks.workunit.client.1.smithi184.stdout:4/999: fsync d1/d12/d13/da1/fb6 0 2023-12-16T03:16:09.797 INFO:tasks.workunit.client.0.smithi064.stdout:9/631: unlink d2/d2d/d3b/d3c/l18 0 2023-12-16T03:16:09.797 INFO:tasks.workunit.client.0.smithi064.stdout:9/632: write d2/dc/f26 [1014315,90685] 0 2023-12-16T03:16:09.798 INFO:tasks.workunit.client.1.smithi184.stdout:5/843: mknod d1/d3/d9/de/d15/d27/dd2/c110 0 2023-12-16T03:16:09.799 INFO:tasks.workunit.client.0.smithi064.stdout:6/596: mkdir d3/d8/d1f/d26/d47/d4a/d67/d86/d99/db3 0 2023-12-16T03:16:09.800 INFO:tasks.workunit.client.0.smithi064.stdout:6/597: readlink d3/d8/d1f/d26/d47/d4a/d67/d73/lb1 0 2023-12-16T03:16:09.800 INFO:tasks.workunit.client.0.smithi064.stdout:6/598: fsync d3/d8/d1f/d26/f62 0 2023-12-16T03:16:09.800 INFO:tasks.workunit.client.1.smithi184.stdout:5/844: read d1/d3/d9/de/f37 [3091671,25872] 0 2023-12-16T03:16:09.800 INFO:tasks.workunit.client.1.smithi184.stdout:5/845: chown d1/d3/d9/de/d30/d68/f76 150780 1 2023-12-16T03:16:09.801 INFO:tasks.workunit.client.1.smithi184.stdout:1/983: truncate d3/d34/dbc/d3c/f10f 285921 0 2023-12-16T03:16:09.801 INFO:tasks.workunit.client.0.smithi064.stdout:9/633: dread d2/dc/d24/d39/d5e/f73 [0,4194304] 0 2023-12-16T03:16:09.803 INFO:tasks.workunit.client.0.smithi064.stdout:1/751: rename d3/d36/d44/d4d/f6b to d3/dd/de4/fed 0 2023-12-16T03:16:09.804 INFO:tasks.workunit.client.0.smithi064.stdout:6/599: dread d3/d8/da/f37 [0,4194304] 0 2023-12-16T03:16:09.804 INFO:tasks.workunit.client.0.smithi064.stdout:2/560: dwrite d1/d15/d1b/d49/fa7 [0,4194304] 0 2023-12-16T03:16:09.804 INFO:tasks.workunit.client.0.smithi064.stdout:0/646: dread d2/d5b/d8b/f9e [0,4194304] 0 2023-12-16T03:16:09.805 INFO:tasks.workunit.client.0.smithi064.stdout:8/700: dwrite d0/d1d/d24/d2f/f41 [8388608,4194304] 0 2023-12-16T03:16:09.806 INFO:tasks.workunit.client.0.smithi064.stdout:6/600: read d3/d8/d1f/d26/f62 [2353200,3512] 0 2023-12-16T03:16:09.806 INFO:tasks.workunit.client.0.smithi064.stdout:6/601: chown d3/d8/da/ca2 8397725 1 2023-12-16T03:16:09.807 INFO:tasks.workunit.client.0.smithi064.stdout:2/561: write d1/d15/d7d/dac/f84 [1764193,114643] 0 2023-12-16T03:16:09.809 INFO:tasks.workunit.client.1.smithi184.stdout:5/846: dread d1/d3/dc6/fd8 [0,4194304] 0 2023-12-16T03:16:09.810 INFO:tasks.workunit.client.0.smithi064.stdout:9/634: read d2/f85 [652353,125931] 0 2023-12-16T03:16:09.811 INFO:tasks.workunit.client.0.smithi064.stdout:1/752: symlink d3/d36/lee 0 2023-12-16T03:16:09.819 INFO:tasks.workunit.client.1.smithi184.stdout:1/984: dread d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/fed [0,4194304] 0 2023-12-16T03:16:09.819 INFO:tasks.workunit.client.1.smithi184.stdout:1/985: dread - d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/f110 zero size 2023-12-16T03:16:09.827 INFO:tasks.workunit.client.0.smithi064.stdout:0/647: mkdir d2/d29/d66/d97/dd5 0 2023-12-16T03:16:09.827 INFO:tasks.workunit.client.1.smithi184.stdout:1/986: rmdir d3/d34/dbc/d3c/d24 39 2023-12-16T03:16:09.831 INFO:tasks.workunit.client.1.smithi184.stdout:1/987: rename d3/d34/f129 to d3/d34/d76/df9/f151 0 2023-12-16T03:16:09.833 INFO:tasks.workunit.client.0.smithi064.stdout:8/701: symlink d0/da/de9/d5a/lee 0 2023-12-16T03:16:09.838 INFO:tasks.workunit.client.1.smithi184.stdout:1/988: mkdir d3/d34/d76/d91/d152 0 2023-12-16T03:16:09.839 INFO:tasks.workunit.client.0.smithi064.stdout:2/562: creat d1/d15/d1b/faf x:0 0 0 2023-12-16T03:16:09.844 INFO:tasks.workunit.client.1.smithi184.stdout:1/989: symlink d3/d34/dbc/d3c/l153 0 2023-12-16T03:16:09.848 INFO:tasks.workunit.client.1.smithi184.stdout:2/926: sync 2023-12-16T03:16:09.848 INFO:tasks.workunit.client.0.smithi064.stdout:0/648: creat d2/d8/da/dbc/fd6 x:0 0 0 2023-12-16T03:16:09.848 INFO:tasks.workunit.client.0.smithi064.stdout:0/649: chown d2/d29/f9f 9990 1 2023-12-16T03:16:09.848 INFO:tasks.workunit.client.0.smithi064.stdout:0/650: write d2/f7c [10378813,54452] 0 2023-12-16T03:16:09.848 INFO:tasks.workunit.client.0.smithi064.stdout:0/651: fsync d2/d7/d10/f6a 0 2023-12-16T03:16:09.850 INFO:tasks.workunit.client.1.smithi184.stdout:1/990: link d3/d34/dbc/d38/l5a d3/d34/d39/def/l154 0 2023-12-16T03:16:09.850 INFO:tasks.workunit.client.1.smithi184.stdout:1/991: fsync d3/d34/dbc/d3c/d41/d63/fd8 0 2023-12-16T03:16:09.851 INFO:tasks.workunit.client.0.smithi064.stdout:8/702: symlink d0/da/de9/d12/d1c/d59/lef 0 2023-12-16T03:16:09.852 INFO:tasks.workunit.client.0.smithi064.stdout:1/753: dwrite d3/d36/d44/d4d/da8/fd3 [0,4194304] 0 2023-12-16T03:16:09.853 INFO:tasks.workunit.client.1.smithi184.stdout:5/847: dwrite d1/d3/d2f/f3d [0,4194304] 0 2023-12-16T03:16:09.853 INFO:tasks.workunit.client.1.smithi184.stdout:5/848: readlink d1/d3/la4 0 2023-12-16T03:16:09.853 INFO:tasks.workunit.client.1.smithi184.stdout:5/849: readlink d1/d3/d9/de/d15/ld7 0 2023-12-16T03:16:09.854 INFO:tasks.workunit.client.0.smithi064.stdout:9/635: dwrite d2/dc/d24/d39/d5e/f8f [0,4194304] 0 2023-12-16T03:16:09.854 INFO:tasks.workunit.client.0.smithi064.stdout:9/636: write d2/f85 [1991666,3450] 0 2023-12-16T03:16:09.855 INFO:tasks.workunit.client.1.smithi184.stdout:2/927: symlink d3/d13/d28/dac/l132 0 2023-12-16T03:16:09.856 INFO:tasks.workunit.client.0.smithi064.stdout:6/602: mknod d3/d8/da/cb4 0 2023-12-16T03:16:09.859 INFO:tasks.workunit.client.1.smithi184.stdout:1/992: mkdir d3/d34/dbc/d3c/d41/d46/d4a/d155 0 2023-12-16T03:16:09.864 INFO:tasks.workunit.client.1.smithi184.stdout:5/850: symlink d1/d3/d9/de/l111 0 2023-12-16T03:16:09.866 INFO:tasks.workunit.client.1.smithi184.stdout:2/928: truncate d3/d29/d2f/d2e/f3a 3970697 0 2023-12-16T03:16:09.866 INFO:tasks.workunit.client.1.smithi184.stdout:2/929: stat d3/d29/d4d/d5b/ffe 0 2023-12-16T03:16:09.866 INFO:tasks.workunit.client.1.smithi184.stdout:2/930: write d3/d9/d19/f113 [307765,37198] 0 2023-12-16T03:16:09.868 INFO:tasks.workunit.client.0.smithi064.stdout:1/754: creat d3/dd/d11/d2f/fef x:0 0 0 2023-12-16T03:16:09.870 INFO:tasks.workunit.client.1.smithi184.stdout:5/851: read d1/d3/fd [1277510,104952] 0 2023-12-16T03:16:09.873 INFO:tasks.workunit.client.1.smithi184.stdout:2/931: stat d3/d29/d2f/d2e/l9e 0 2023-12-16T03:16:09.875 INFO:tasks.workunit.client.1.smithi184.stdout:5/852: dread d1/d3/d9/de/d15/f61 [0,4194304] 0 2023-12-16T03:16:09.876 INFO:tasks.workunit.client.0.smithi064.stdout:9/637: rename d2/dc/d24/da9/lc0 to d2/dc/d24/db2/dc3/ld4 0 2023-12-16T03:16:09.876 INFO:tasks.workunit.client.1.smithi184.stdout:1/993: dread d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/dfd/f103 [0,4194304] 0 2023-12-16T03:16:09.877 INFO:tasks.workunit.client.1.smithi184.stdout:5/853: read d1/f66 [2925975,100153] 0 2023-12-16T03:16:09.877 INFO:tasks.workunit.client.1.smithi184.stdout:5/854: stat d1/d3/d9/d49 0 2023-12-16T03:16:09.877 INFO:tasks.workunit.client.0.smithi064.stdout:0/652: dwrite d2/d7/d10/f52 [0,4194304] 0 2023-12-16T03:16:09.877 INFO:tasks.workunit.client.0.smithi064.stdout:6/603: creat d3/d9/db0/fb5 x:0 0 0 2023-12-16T03:16:09.879 INFO:tasks.workunit.client.1.smithi184.stdout:2/932: mknod d3/d29/d4d/d5b/da6/c133 0 2023-12-16T03:16:09.882 INFO:tasks.workunit.client.1.smithi184.stdout:1/994: rename d3/d34/dbc/d36/l57 to d3/d34/d39/def/l156 0 2023-12-16T03:16:09.882 INFO:tasks.workunit.client.1.smithi184.stdout:1/995: write d3/d34/dbc/d3c/d41/d46/d4a/d6a/da5/dd6/dfd/f11c [387166,110427] 0 2023-12-16T03:16:09.883 INFO:tasks.workunit.client.0.smithi064.stdout:8/703: dwrite d0/da/f65 [0,4194304] 0 2023-12-16T03:16:09.883 INFO:tasks.workunit.client.0.smithi064.stdout:8/704: chown d0/da/d3e/d46/d54/cac 52 1 2023-12-16T03:16:09.884 INFO:tasks.workunit.client.0.smithi064.stdout:8/705: dread - d0/da/d3e/f69 zero size 2023-12-16T03:16:09.884 INFO:tasks.workunit.client.1.smithi184.stdout:5/855: mkdir d1/d2a/d31/d58/daf/d112 0 2023-12-16T03:16:09.886 INFO:tasks.workunit.client.1.smithi184.stdout:5/856: write d1/d3/d2f/f3b [2526904,4699] 0 2023-12-16T03:16:09.889 INFO:tasks.workunit.client.1.smithi184.stdout:1/996: getdents d3/d34/dbc/d3c/d41/d77 0 2023-12-16T03:16:09.890 INFO:tasks.workunit.client.0.smithi064.stdout:6/604: mkdir d3/d8/d13/d58/db6 0 2023-12-16T03:16:09.893 INFO:tasks.workunit.client.0.smithi064.stdout:3/759: sync 2023-12-16T03:16:09.893 INFO:tasks.workunit.client.0.smithi064.stdout:4/661: sync 2023-12-16T03:16:09.893 INFO:tasks.workunit.client.0.smithi064.stdout:7/681: sync 2023-12-16T03:16:09.893 INFO:tasks.workunit.client.0.smithi064.stdout:4/662: getdents d0/d42/d4c/d70/d8c/dc7 0 2023-12-16T03:16:09.893 INFO:tasks.workunit.client.0.smithi064.stdout:4/663: fdatasync d0/d42/d56/f67 0 2023-12-16T03:16:09.893 INFO:tasks.workunit.client.0.smithi064.stdout:4/664: dread - d0/fc2 zero size 2023-12-16T03:16:09.893 INFO:tasks.workunit.client.0.smithi064.stdout:3/760: write db/d12/d1a/d2c/d34/d4c/d6a/f94 [732907,43741] 0 2023-12-16T03:16:09.893 INFO:tasks.workunit.client.0.smithi064.stdout:4/665: fsync d0/da/f6d 0 2023-12-16T03:16:09.893 INFO:tasks.workunit.client.0.smithi064.stdout:4/666: chown d0/d12 241068 1 2023-12-16T03:16:09.897 INFO:tasks.workunit.client.0.smithi064.stdout:9/638: link d2/d2d/d3b/d3c/d34/fcf d2/dc/d24/d39/d77/d7d/db9/fd5 0 2023-12-16T03:16:09.897 INFO:tasks.workunit.client.0.smithi064.stdout:9/639: fdatasync d2/dc/d24/d39/d42/d57/f46 0 2023-12-16T03:16:09.897 INFO:tasks.workunit.client.0.smithi064.stdout:9/640: fsync d2/dc/d24/d39/d42/d57/f46 0 2023-12-16T03:16:09.898 INFO:tasks.workunit.client.0.smithi064.stdout:3/761: read db/d4f/d51/fdc [458410,12318] 0 2023-12-16T03:16:09.898 INFO:tasks.workunit.client.0.smithi064.stdout:1/755: dwrite d3/d36/d44/d4d/dad/dc5/feb [0,4194304] 0 2023-12-16T03:16:09.899 INFO:tasks.workunit.client.0.smithi064.stdout:1/756: chown d3/dd/d11/d6a/f7a 28 1 2023-12-16T03:16:09.899 INFO:tasks.workunit.client.1.smithi184.stdout:5/857: unlink d1/d3/d9/de/d15/d90/f9d 0 2023-12-16T03:16:09.899 INFO:tasks.workunit.client.0.smithi064.stdout:5/584: sync 2023-12-16T03:16:09.899 INFO:tasks.workunit.client.0.smithi064.stdout:5/585: chown d0/d19/d48/d92/f9e 5643 1 2023-12-16T03:16:09.903 INFO:tasks.workunit.client.0.smithi064.stdout:8/706: symlink d0/da/de9/d37/d3a/lf0 0 2023-12-16T03:16:09.905 INFO:tasks.workunit.client.1.smithi184.stdout:1/997: symlink d3/d34/dbc/d3c/d41/d46/d4a/d6a/da6/dca/l157 0 2023-12-16T03:16:09.905 INFO:tasks.workunit.client.0.smithi064.stdout:1/757: dread d3/d22/d57/f5d [0,4194304] 0 2023-12-16T03:16:09.909 INFO:tasks.workunit.client.0.smithi064.stdout:9/641: creat d2/dc/d24/fd6 x:0 0 0 2023-12-16T03:16:09.909 INFO:tasks.workunit.client.0.smithi064.stdout:3/762: write db/d12/d1a/d2c/d34/f3d [363768,88381] 0 2023-12-16T03:16:09.913 INFO:tasks.workunit.client.1.smithi184.stdout:1/998: write d3/d34/dbc/d3c/d41/d46/d4a/de2/dfa/f12c [301431,39614] 0 2023-12-16T03:16:09.913 INFO:tasks.workunit.client.1.smithi184.stdout:1/999: fsync d3/d34/d39/f66 0 2023-12-16T03:16:09.914 INFO:tasks.workunit.client.1.smithi184.stdout:2/933: rename d3/d29/d4d/d5b/da6 to d3/d29/d2f/d2e/dcb/d134 0 2023-12-16T03:16:09.914 INFO:tasks.workunit.client.1.smithi184.stdout:2/934: chown d3/d29/d4d/d123 4 1 2023-12-16T03:16:09.916 INFO:tasks.workunit.client.0.smithi064.stdout:5/586: stat d0/d14/d20/l22 0 2023-12-16T03:16:09.916 INFO:tasks.workunit.client.0.smithi064.stdout:5/587: dread - d0/d7/d8b/fba zero size 2023-12-16T03:16:09.919 INFO:tasks.workunit.client.1.smithi184.stdout:2/935: creat d3/d13/ddf/d10a/f135 x:0 0 0 2023-12-16T03:16:09.920 INFO:tasks.workunit.client.0.smithi064.stdout:5/588: creat d0/d19/d48/d8f/d5e/d84/fce x:0 0 0 2023-12-16T03:16:09.921 INFO:tasks.workunit.client.1.smithi184.stdout:5/858: rename d1/d3/c44 to d1/d3/d9/de/c113 0 2023-12-16T03:16:09.922 INFO:tasks.workunit.client.1.smithi184.stdout:2/936: creat d3/d9/f136 x:0 0 0 2023-12-16T03:16:09.922 INFO:tasks.workunit.client.1.smithi184.stdout:2/937: stat d3/d29/d4d/d5b/fe9 0 2023-12-16T03:16:09.926 INFO:tasks.workunit.client.0.smithi064.stdout:5/589: symlink d0/d19/d48/d8f/d3e/d35/d5d/lcf 0 2023-12-16T03:16:09.927 INFO:tasks.workunit.client.1.smithi184.stdout:2/938: mkdir d3/d29/d61/d137 0 2023-12-16T03:16:09.931 INFO:tasks.workunit.client.0.smithi064.stdout:9/642: dread d2/dc/ff [0,4194304] 0 2023-12-16T03:16:09.931 INFO:tasks.workunit.client.0.smithi064.stdout:5/590: rmdir d0/d7/d8b 39 2023-12-16T03:16:09.935 INFO:tasks.workunit.client.0.smithi064.stdout:9/643: truncate d2/d2d/d6c/f89 824201 0 2023-12-16T03:16:09.937 INFO:tasks.workunit.client.0.smithi064.stdout:9/644: creat d2/dc/d24/d39/d77/d7d/fd7 x:0 0 0 2023-12-16T03:16:09.942 INFO:tasks.workunit.client.0.smithi064.stdout:6/605: dwrite d3/d8/d1f/d26/f3b [0,4194304] 0 2023-12-16T03:16:09.943 INFO:tasks.workunit.client.0.smithi064.stdout:9/645: dread d2/dc/f26 [0,4194304] 0 2023-12-16T03:16:09.944 INFO:tasks.workunit.client.0.smithi064.stdout:5/591: write d0/d19/d48/d8f/d5e/f93 [5550277,43974] 0 2023-12-16T03:16:09.956 INFO:tasks.workunit.client.0.smithi064.stdout:6/606: dread d3/d44/f71 [0,4194304] 0 2023-12-16T03:16:09.956 INFO:tasks.workunit.client.0.smithi064.stdout:6/607: truncate d3/d8/da/f37 1480347 0 2023-12-16T03:16:09.956 INFO:tasks.workunit.client.0.smithi064.stdout:6/608: chown d3/d9 270271 1 2023-12-16T03:16:09.957 INFO:tasks.workunit.client.0.smithi064.stdout:9/646: dread f1 [0,4194304] 0 2023-12-16T03:16:09.959 INFO:tasks.workunit.client.0.smithi064.stdout:9/647: creat d2/dc/d24/d39/d77/d7d/db9/fd8 x:0 0 0 2023-12-16T03:16:09.959 INFO:tasks.workunit.client.0.smithi064.stdout:9/648: fdatasync d2/d7e/fa2 0 2023-12-16T03:16:09.960 INFO:tasks.workunit.client.0.smithi064.stdout:9/649: getdents d2/dc/d8a 0 2023-12-16T03:16:09.961 INFO:tasks.workunit.client.0.smithi064.stdout:9/650: creat d2/d2d/d6c/fd9 x:0 0 0 2023-12-16T03:16:09.962 INFO:tasks.workunit.client.0.smithi064.stdout:9/651: creat d2/dc/d24/d39/d77/d7d/fda x:0 0 0 2023-12-16T03:16:09.970 INFO:tasks.workunit.client.0.smithi064.stdout:4/667: dwrite d0/da/f7a [0,4194304] 0 2023-12-16T03:16:09.970 INFO:tasks.workunit.client.0.smithi064.stdout:4/668: readlink d0/le 0 2023-12-16T03:16:09.974 INFO:tasks.workunit.client.0.smithi064.stdout:4/669: write d0/da/f6d [2738789,5271] 0 2023-12-16T03:16:09.974 INFO:tasks.workunit.client.0.smithi064.stdout:4/670: write d0/d42/d53/f6b [780787,67014] 0 2023-12-16T03:16:09.974 INFO:tasks.workunit.client.0.smithi064.stdout:9/652: dread d2/d2d/d3b/d3c/f20 [4194304,4194304] 0 2023-12-16T03:16:10.000 INFO:tasks.workunit.client.0.smithi064.stdout:9/653: dwrite d2/d2d/d3b/fc2 [0,4194304] 0 2023-12-16T03:16:10.000 INFO:tasks.workunit.client.0.smithi064.stdout:9/654: chown d2/d2d/d3b/d3c/d34/fcf 61 1 2023-12-16T03:16:10.011 INFO:tasks.workunit.client.0.smithi064.stdout:7/682: dwrite d7/d3e/d42/d43/f5f [4194304,4194304] 0 2023-12-16T03:16:10.011 INFO:tasks.workunit.client.0.smithi064.stdout:8/707: dwrite d0/fb6 [0,4194304] 0 2023-12-16T03:16:10.013 INFO:tasks.workunit.client.0.smithi064.stdout:7/683: rename d7/d3e/d42/d89/d20/d37/c7d to d7/d26/cdb 0 2023-12-16T03:16:10.015 INFO:tasks.workunit.client.0.smithi064.stdout:7/684: link d7/f53 d7/d26/d95/dca/dd2/fdc 0 2023-12-16T03:16:10.016 INFO:tasks.workunit.client.0.smithi064.stdout:7/685: creat d7/d26/d30/da3/dc3/fdd x:0 0 0 2023-12-16T03:16:10.017 INFO:tasks.workunit.client.0.smithi064.stdout:1/758: dwrite f2 [0,4194304] 0 2023-12-16T03:16:10.018 INFO:tasks.workunit.client.1.smithi184.stdout:2/939: dwrite d3/d13/d28/f117 [0,4194304] 0 2023-12-16T03:16:10.018 INFO:tasks.workunit.client.1.smithi184.stdout:5/859: dwrite d1/d3/d9/de/d15/db9/fdb [4194304,4194304] 0 2023-12-16T03:16:10.020 INFO:tasks.workunit.client.0.smithi064.stdout:6/609: dwrite d3/d8/da/f23 [8388608,4194304] 0 2023-12-16T03:16:10.020 INFO:tasks.workunit.client.0.smithi064.stdout:4/671: dwrite d0/d12/f35 [0,4194304] 0 2023-12-16T03:16:10.020 INFO:tasks.workunit.client.0.smithi064.stdout:5/592: dwrite d0/d19/d48/f69 [0,4194304] 0 2023-12-16T03:16:10.020 INFO:tasks.workunit.client.0.smithi064.stdout:5/593: write d0/d19/d48/d8f/dac/ff [9225039,69547] 0 2023-12-16T03:16:10.020 INFO:tasks.workunit.client.0.smithi064.stdout:5/594: readlink d0/d7/lcc 0 2023-12-16T03:16:10.020 INFO:tasks.workunit.client.0.smithi064.stdout:5/595: chown d0/d14/d20/d37/d70/d71/d80/f98 2 1 2023-12-16T03:16:10.020 INFO:tasks.workunit.client.0.smithi064.stdout:5/596: chown d0/d7/f1d 463664338 1 2023-12-16T03:16:10.021 INFO:tasks.workunit.client.0.smithi064.stdout:1/759: dread d3/d22/d57/f5d [0,4194304] 0 2023-12-16T03:16:10.021 INFO:tasks.workunit.client.0.smithi064.stdout:3/763: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/da4/fe4 [0,4194304] 0 2023-12-16T03:16:10.021 INFO:tasks.workunit.client.0.smithi064.stdout:3/764: stat db/d12/d1a/c36 0 2023-12-16T03:16:10.027 INFO:tasks.workunit.client.0.smithi064.stdout:3/765: write db/d12/d1a/d2c/d34/d4c/d6a/f6c [447277,22669] 0 2023-12-16T03:16:10.027 INFO:tasks.workunit.client.0.smithi064.stdout:3/766: chown db/d4f/da9/dbf/dcf 5774 1 2023-12-16T03:16:10.027 INFO:tasks.workunit.client.0.smithi064.stdout:3/767: fsync db/d12/d1a/d2c/d34/d4c/fbb 0 2023-12-16T03:16:10.031 INFO:tasks.workunit.client.0.smithi064.stdout:4/672: symlink d0/d1e/d36/db7/lce 0 2023-12-16T03:16:10.032 INFO:tasks.workunit.client.0.smithi064.stdout:5/597: mknod d0/d7/d8b/dc0/cd0 0 2023-12-16T03:16:10.040 INFO:tasks.workunit.client.0.smithi064.stdout:3/768: rename db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/da4 to db/d4f/da9/dbf/dfc 0 2023-12-16T03:16:10.040 INFO:tasks.workunit.client.0.smithi064.stdout:3/769: chown ca 217110 1 2023-12-16T03:16:10.041 INFO:tasks.workunit.client.0.smithi064.stdout:3/770: write db/d12/d1a/f54 [1916303,89226] 0 2023-12-16T03:16:10.041 INFO:tasks.workunit.client.0.smithi064.stdout:3/771: readlink db/d12/d1a/d2c/d34/d4c/lf4 0 2023-12-16T03:16:10.041 INFO:tasks.workunit.client.0.smithi064.stdout:3/772: stat db/d12/d21/f61 0 2023-12-16T03:16:10.041 INFO:tasks.workunit.client.0.smithi064.stdout:4/673: unlink d0/d42/d66/l47 0 2023-12-16T03:16:10.042 INFO:tasks.workunit.client.0.smithi064.stdout:4/674: write d0/d12/d48/fcb [385707,40512] 0 2023-12-16T03:16:10.042 INFO:tasks.workunit.client.0.smithi064.stdout:4/675: dread - d0/d42/d4c/d70/d8c/fc3 zero size 2023-12-16T03:16:10.044 INFO:tasks.workunit.client.1.smithi184.stdout:5/860: dwrite d1/d3/d9/de/d15/d27/ddd/f10a [0,4194304] 0 2023-12-16T03:16:10.044 INFO:tasks.workunit.client.1.smithi184.stdout:5/861: dread - d1/d2a/d31/d58/daf/fe8 zero size 2023-12-16T03:16:10.044 INFO:tasks.workunit.client.0.smithi064.stdout:6/610: link d3/d8/d1f/d26/d47/d4a/d67/d73/fad d3/d8/d1f/d26/fb7 0 2023-12-16T03:16:10.044 INFO:tasks.workunit.client.0.smithi064.stdout:6/611: truncate d3/d8/d1f/d26/d47/d4a/d67/d86/f8a 97207 0 2023-12-16T03:16:10.045 INFO:tasks.workunit.client.0.smithi064.stdout:3/773: symlink db/d12/d1a/d2c/d34/d4c/d6a/lfd 0 2023-12-16T03:16:10.046 INFO:tasks.workunit.client.1.smithi184.stdout:2/940: getdents d3/d9 0 2023-12-16T03:16:10.049 INFO:tasks.workunit.client.0.smithi064.stdout:5/598: dread d0/d19/fad [0,4194304] 0 2023-12-16T03:16:10.051 INFO:tasks.workunit.client.0.smithi064.stdout:5/599: creat d0/d50/d39/fd1 x:0 0 0 2023-12-16T03:16:10.053 INFO:tasks.workunit.client.1.smithi184.stdout:2/941: dread d3/d13/d6e/fd5 [0,4194304] 0 2023-12-16T03:16:10.053 INFO:tasks.workunit.client.1.smithi184.stdout:2/942: truncate d3/d9/f3b 446958 0 2023-12-16T03:16:10.053 INFO:tasks.workunit.client.1.smithi184.stdout:2/943: chown d3/d29/d2f/d46/d77/f98 3 1 2023-12-16T03:16:10.053 INFO:tasks.workunit.client.1.smithi184.stdout:2/944: dread - d3/d9/f136 zero size 2023-12-16T03:16:10.053 INFO:tasks.workunit.client.1.smithi184.stdout:5/862: mkdir d1/d3/d9/de/d30/d114 0 2023-12-16T03:16:10.054 INFO:tasks.workunit.client.1.smithi184.stdout:5/863: write d1/d3/d9/de/da5/ffe [1118394,78077] 0 2023-12-16T03:16:10.054 INFO:tasks.workunit.client.0.smithi064.stdout:5/600: symlink d0/d19/d48/d8f/d5e/d84/ld2 0 2023-12-16T03:16:10.055 INFO:tasks.workunit.client.1.smithi184.stdout:2/945: mknod d3/d29/d2f/d46/dfd/c138 0 2023-12-16T03:16:10.056 INFO:tasks.workunit.client.0.smithi064.stdout:4/676: dread d0/d42/d66/d33/f38 [0,4194304] 0 2023-12-16T03:16:10.056 INFO:tasks.workunit.client.0.smithi064.stdout:7/686: dwrite d7/d3e/d42/f73 [0,4194304] 0 2023-12-16T03:16:10.056 INFO:tasks.workunit.client.0.smithi064.stdout:4/677: getdents d0/d42/d66/d5a/d90 0 2023-12-16T03:16:10.057 INFO:tasks.workunit.client.1.smithi184.stdout:5/864: truncate d1/d2a/d31/d58/daf/f8a 859468 0 2023-12-16T03:16:10.059 INFO:tasks.workunit.client.0.smithi064.stdout:4/678: write d0/d42/d4c/d70/f82 [94753,130011] 0 2023-12-16T03:16:10.059 INFO:tasks.workunit.client.0.smithi064.stdout:5/601: mknod d0/d19/d48/d8f/d5e/d84/cd3 0 2023-12-16T03:16:10.060 INFO:tasks.workunit.client.0.smithi064.stdout:4/679: read d0/d1e/d36/f8f [254202,128981] 0 2023-12-16T03:16:10.062 INFO:tasks.workunit.client.1.smithi184.stdout:5/865: write d1/d3/d9/de/d30/d68/f76 [4272524,74085] 0 2023-12-16T03:16:10.063 INFO:tasks.workunit.client.0.smithi064.stdout:7/687: rename d7/d3e/lbc to d7/d3e/d42/d89/d74/d82/lde 0 2023-12-16T03:16:10.063 INFO:tasks.workunit.client.0.smithi064.stdout:7/688: write d7/d3e/fc1 [1583211,5700] 0 2023-12-16T03:16:10.064 INFO:tasks.workunit.client.0.smithi064.stdout:3/774: dread db/d12/d21/f3f [0,4194304] 0 2023-12-16T03:16:10.064 INFO:tasks.workunit.client.0.smithi064.stdout:5/602: read d0/d19/d48/d8f/d5e/d84/faf [7620873,76209] 0 2023-12-16T03:16:10.066 INFO:tasks.workunit.client.1.smithi184.stdout:5/866: unlink d1/dbb/cc9 0 2023-12-16T03:16:10.066 INFO:tasks.workunit.client.1.smithi184.stdout:5/867: write d1/d3/d9/de/d15/db9/ff7 [870972,89872] 0 2023-12-16T03:16:10.066 INFO:tasks.workunit.client.1.smithi184.stdout:5/868: dread - d1/d3/d9/de/d15/d90/fcf zero size 2023-12-16T03:16:10.073 INFO:tasks.workunit.client.0.smithi064.stdout:4/680: dread d0/f11 [0,4194304] 0 2023-12-16T03:16:10.074 INFO:tasks.workunit.client.0.smithi064.stdout:4/681: creat d0/d12/d48/fcf x:0 0 0 2023-12-16T03:16:10.074 INFO:tasks.workunit.client.0.smithi064.stdout:4/682: fsync d0/f2 0 2023-12-16T03:16:10.077 INFO:tasks.workunit.client.1.smithi184.stdout:5/869: write d1/d3/d9/de/d15/d19/d3a/f4b [8219128,67889] 0 2023-12-16T03:16:10.079 INFO:tasks.workunit.client.1.smithi184.stdout:5/870: mkdir d1/d3/d9/de/d15/d19/d3a/dde/d115 0 2023-12-16T03:16:10.081 INFO:tasks.workunit.client.1.smithi184.stdout:5/871: truncate d1/d3/d2f/f3d 1113350 0 2023-12-16T03:16:10.081 INFO:tasks.workunit.client.1.smithi184.stdout:5/872: truncate d1/d3/fd9 678008 0 2023-12-16T03:16:10.081 INFO:tasks.workunit.client.1.smithi184.stdout:5/873: getdents d1/d3/d9/d2e 0 2023-12-16T03:16:10.081 INFO:tasks.workunit.client.1.smithi184.stdout:5/874: fsync d1/d3/d9/d49/d74/f75 0 2023-12-16T03:16:10.081 INFO:tasks.workunit.client.1.smithi184.stdout:2/946: dwrite d3/d29/d61/f91 [0,4194304] 0 2023-12-16T03:16:10.081 INFO:tasks.workunit.client.1.smithi184.stdout:2/947: read - d3/d29/d2f/d2e/f8e zero size 2023-12-16T03:16:10.082 INFO:tasks.workunit.client.0.smithi064.stdout:7/689: dread d7/d3e/d42/d48/f49 [0,4194304] 0 2023-12-16T03:16:10.082 INFO:tasks.workunit.client.0.smithi064.stdout:5/603: dread d0/d19/d48/d8f/dac/ff [4194304,4194304] 0 2023-12-16T03:16:10.082 INFO:tasks.workunit.client.0.smithi064.stdout:6/612: dwrite d3/d8/d1f/d26/f9c [0,4194304] 0 2023-12-16T03:16:10.085 INFO:tasks.workunit.client.1.smithi184.stdout:5/875: rename d1/d3/d9/de/d15/d19/d48/fc8 to d1/d2a/d31/d58/f116 0 2023-12-16T03:16:10.094 INFO:tasks.workunit.client.1.smithi184.stdout:5/876: mknod d1/d3/d9/de/d15/d19/c117 0 2023-12-16T03:16:10.094 INFO:tasks.workunit.client.1.smithi184.stdout:5/877: write d1/d3/d9/de/d15/d19/d48/f98 [2035937,110824] 0 2023-12-16T03:16:10.099 INFO:tasks.workunit.client.0.smithi064.stdout:6/613: creat d3/d8/d1f/d26/fb8 x:0 0 0 2023-12-16T03:16:10.099 INFO:tasks.workunit.client.0.smithi064.stdout:6/614: truncate d3/d8/d1f/d26/d47/d4a/d67/d73/fad 204080 0 2023-12-16T03:16:10.102 INFO:tasks.workunit.client.0.smithi064.stdout:7/690: rmdir d7/d3e/d42/d89/d20 39 2023-12-16T03:16:10.102 INFO:tasks.workunit.client.0.smithi064.stdout:7/691: truncate d7/d3e/d42/d48/fce 962807 0 2023-12-16T03:16:10.103 INFO:tasks.workunit.client.0.smithi064.stdout:5/604: dwrite d0/d14/d20/d37/d70/d71/fb3 [4194304,4194304] 0 2023-12-16T03:16:10.105 INFO:tasks.workunit.client.0.smithi064.stdout:4/683: rmdir d0/d12/d48 39 2023-12-16T03:16:10.110 INFO:tasks.workunit.client.1.smithi184.stdout:5/878: mkdir d1/d3/d2f/db5/d118 0 2023-12-16T03:16:10.112 INFO:tasks.workunit.client.0.smithi064.stdout:4/684: dread d0/d42/d66/d33/fab [0,4194304] 0 2023-12-16T03:16:10.114 INFO:tasks.workunit.client.0.smithi064.stdout:6/615: dread d3/f5 [0,4194304] 0 2023-12-16T03:16:10.114 INFO:tasks.workunit.client.0.smithi064.stdout:6/616: write d3/d8/d1f/f22 [4777431,87981] 0 2023-12-16T03:16:10.115 INFO:tasks.workunit.client.0.smithi064.stdout:7/692: symlink d7/d3e/d42/d89/d20/d37/ldf 0 2023-12-16T03:16:10.118 INFO:tasks.workunit.client.0.smithi064.stdout:5/605: creat d0/d50/d39/daa/dc5/fd4 x:0 0 0 2023-12-16T03:16:10.120 INFO:tasks.workunit.client.0.smithi064.stdout:4/685: creat d0/d1e/d36/fd0 x:0 0 0 2023-12-16T03:16:10.121 INFO:tasks.workunit.client.0.smithi064.stdout:4/686: write d0/d12/f35 [3139904,56585] 0 2023-12-16T03:16:10.121 INFO:tasks.workunit.client.1.smithi184.stdout:5/879: mknod d1/d3/d2f/db5/d118/c119 0 2023-12-16T03:16:10.122 INFO:tasks.workunit.client.0.smithi064.stdout:6/617: truncate d3/d8/d13/fa0 1133477 0 2023-12-16T03:16:10.124 INFO:tasks.workunit.client.0.smithi064.stdout:7/693: creat d7/d3e/d42/d43/dc8/fe0 x:0 0 0 2023-12-16T03:16:10.124 INFO:tasks.workunit.client.0.smithi064.stdout:7/694: truncate d7/d3e/d42/faa 1378853 0 2023-12-16T03:16:10.125 INFO:tasks.workunit.client.1.smithi184.stdout:5/880: creat d1/d3/d9/de/f11a x:0 0 0 2023-12-16T03:16:10.126 INFO:tasks.workunit.client.0.smithi064.stdout:5/606: creat d0/d19/d48/d92/fd5 x:0 0 0 2023-12-16T03:16:10.128 INFO:tasks.workunit.client.1.smithi184.stdout:5/881: truncate d1/d3/fa 6169320 0 2023-12-16T03:16:10.129 INFO:tasks.workunit.client.0.smithi064.stdout:4/687: rename d0/d42/ca8 to d0/d42/d53/cd1 0 2023-12-16T03:16:10.130 INFO:tasks.workunit.client.0.smithi064.stdout:4/688: dread - d0/d42/d4c/d70/d8c/fc5 zero size 2023-12-16T03:16:10.131 INFO:tasks.workunit.client.0.smithi064.stdout:6/618: symlink d3/d9/lb9 0 2023-12-16T03:16:10.131 INFO:tasks.workunit.client.0.smithi064.stdout:6/619: fdatasync d3/f5 0 2023-12-16T03:16:10.133 INFO:tasks.workunit.client.0.smithi064.stdout:2/563: sync 2023-12-16T03:16:10.133 INFO:tasks.workunit.client.0.smithi064.stdout:6/620: write d3/d8/f5f [1348466,24006] 0 2023-12-16T03:16:10.133 INFO:tasks.workunit.client.0.smithi064.stdout:6/621: write d3/d8/da/f85 [222755,95607] 0 2023-12-16T03:16:10.134 INFO:tasks.workunit.client.1.smithi184.stdout:5/882: symlink d1/dbb/def/l11b 0 2023-12-16T03:16:10.134 INFO:tasks.workunit.client.1.smithi184.stdout:5/883: readlink d1/d3/d9/de/d15/d19/l51 0 2023-12-16T03:16:10.134 INFO:tasks.workunit.client.1.smithi184.stdout:5/884: stat d1/d3/d9/de/d15 0 2023-12-16T03:16:10.134 INFO:tasks.workunit.client.0.smithi064.stdout:7/695: mkdir d7/d3e/d42/d48/d51/d7c/d52/de1 0 2023-12-16T03:16:10.135 INFO:tasks.workunit.client.0.smithi064.stdout:7/696: chown d7/d26/dc2/lb4 58731 1 2023-12-16T03:16:10.135 INFO:tasks.workunit.client.0.smithi064.stdout:7/697: truncate d7/d26/d30/da3/fb9 4693799 0 2023-12-16T03:16:10.136 INFO:tasks.workunit.client.0.smithi064.stdout:5/607: creat d0/d14/d20/d37/d70/fd6 x:0 0 0 2023-12-16T03:16:10.136 INFO:tasks.workunit.client.0.smithi064.stdout:5/608: dread - d0/d50/d39/daa/dc5/fd4 zero size 2023-12-16T03:16:10.136 INFO:tasks.workunit.client.0.smithi064.stdout:5/609: read d0/f17 [2867691,60845] 0 2023-12-16T03:16:10.138 INFO:tasks.workunit.client.0.smithi064.stdout:4/689: truncate d0/d42/d66/d33/fad 240471 0 2023-12-16T03:16:10.138 INFO:tasks.workunit.client.0.smithi064.stdout:4/690: stat d0/d12/l15 0 2023-12-16T03:16:10.138 INFO:tasks.workunit.client.0.smithi064.stdout:4/691: chown d0/d42/d4c/f59 7571 1 2023-12-16T03:16:10.139 INFO:tasks.workunit.client.0.smithi064.stdout:2/564: symlink d1/d15/d1b/d61/d63/lb0 0 2023-12-16T03:16:10.139 INFO:tasks.workunit.client.0.smithi064.stdout:4/692: read d0/da/f16 [88857,15800] 0 2023-12-16T03:16:10.141 INFO:tasks.workunit.client.0.smithi064.stdout:5/610: write d0/d19/d48/d8f/dac/f36 [444874,11032] 0 2023-12-16T03:16:10.141 INFO:tasks.workunit.client.0.smithi064.stdout:6/622: fdatasync d3/d8/da/f43 0 2023-12-16T03:16:10.143 INFO:tasks.workunit.client.0.smithi064.stdout:5/611: read d0/d7/f1e [40815,78767] 0 2023-12-16T03:16:10.143 INFO:tasks.workunit.client.0.smithi064.stdout:2/565: creat d1/d15/d1b/d49/fb1 x:0 0 0 2023-12-16T03:16:10.144 INFO:tasks.workunit.client.0.smithi064.stdout:4/693: getdents d0/d1e/d36 0 2023-12-16T03:16:10.148 INFO:tasks.workunit.client.0.smithi064.stdout:6/623: getdents d3/d8/d1f/d26/d47/d4a/d67/d73 0 2023-12-16T03:16:10.148 INFO:tasks.workunit.client.0.smithi064.stdout:7/698: getdents d7/d3e/d42/d43/dc8 0 2023-12-16T03:16:10.154 INFO:tasks.workunit.client.0.smithi064.stdout:5/612: unlink d0/d14/d20/d37/d70/d71/d80/f98 0 2023-12-16T03:16:10.155 INFO:tasks.workunit.client.0.smithi064.stdout:2/566: creat d1/d15/d1b/d49/fb2 x:0 0 0 2023-12-16T03:16:10.155 INFO:tasks.workunit.client.0.smithi064.stdout:4/694: rmdir d0/d42/d4c/d70/dbe 39 2023-12-16T03:16:10.157 INFO:tasks.workunit.client.0.smithi064.stdout:6/624: rename d3/d8/d13/fa0 to d3/d9e/fba 0 2023-12-16T03:16:10.158 INFO:tasks.workunit.client.0.smithi064.stdout:7/699: mkdir d7/d3e/d42/d89/de2 0 2023-12-16T03:16:10.158 INFO:tasks.workunit.client.0.smithi064.stdout:7/700: chown d7/d3e/d42/d48/d51/la4 0 1 2023-12-16T03:16:10.158 INFO:tasks.workunit.client.0.smithi064.stdout:7/701: chown d7/d3e/d42/d89/f7a 842373109 1 2023-12-16T03:16:10.158 INFO:tasks.workunit.client.0.smithi064.stdout:2/567: mkdir d1/db3 0 2023-12-16T03:16:10.160 INFO:tasks.workunit.client.0.smithi064.stdout:7/702: unlink d7/d3e/d42/d89/d20/d37/l71 0 2023-12-16T03:16:10.163 INFO:tasks.workunit.client.0.smithi064.stdout:2/568: stat d1/d15/d1b/d49/da0/d8f/l91 0 2023-12-16T03:16:10.163 INFO:tasks.workunit.client.0.smithi064.stdout:7/703: rename d7/fae to d7/d26/d95/fe3 0 2023-12-16T03:16:10.165 INFO:tasks.workunit.client.0.smithi064.stdout:2/569: link d1/d15/d1b/d9c/f5b d1/d15/d1b/d49/d4e/fb4 0 2023-12-16T03:16:10.166 INFO:tasks.workunit.client.0.smithi064.stdout:2/570: creat d1/d15/d23/d2d/fb5 x:0 0 0 2023-12-16T03:16:10.167 INFO:tasks.workunit.client.0.smithi064.stdout:2/571: symlink d1/d15/d1b/d61/d63/lb6 0 2023-12-16T03:16:10.167 INFO:tasks.workunit.client.0.smithi064.stdout:2/572: chown d1/d15/d1b/d9c/d69/f56 1116 1 2023-12-16T03:16:10.168 INFO:tasks.workunit.client.0.smithi064.stdout:2/573: write d1/d15/d1b/d9c/d69/f56 [108011,42749] 0 2023-12-16T03:16:10.170 INFO:tasks.workunit.client.0.smithi064.stdout:2/574: creat d1/d15/d1b/d61/fb7 x:0 0 0 2023-12-16T03:16:10.170 INFO:tasks.workunit.client.0.smithi064.stdout:2/575: dread - d1/d15/d1b/faf zero size 2023-12-16T03:16:10.170 INFO:tasks.workunit.client.0.smithi064.stdout:2/576: stat d1/d15/d23/f7a 0 2023-12-16T03:16:10.170 INFO:tasks.workunit.client.0.smithi064.stdout:2/577: stat d1/d76/d57/l6e 0 2023-12-16T03:16:10.170 INFO:tasks.workunit.client.0.smithi064.stdout:2/578: stat d1/d15/d1b/d9c/d69/lae 0 2023-12-16T03:16:10.171 INFO:tasks.workunit.client.0.smithi064.stdout:2/579: creat d1/d15/fb8 x:0 0 0 2023-12-16T03:16:10.171 INFO:tasks.workunit.client.0.smithi064.stdout:2/580: truncate d1/d15/d1b/faf 484667 0 2023-12-16T03:16:10.171 INFO:tasks.workunit.client.0.smithi064.stdout:2/581: dread - d1/d15/d1b/d9c/f95 zero size 2023-12-16T03:16:10.182 INFO:tasks.workunit.client.0.smithi064.stdout:7/704: dread d7/d3e/d42/f73 [0,4194304] 0 2023-12-16T03:16:10.182 INFO:tasks.workunit.client.0.smithi064.stdout:7/705: chown d7/d3e/d42/d48/d51/d7c/d52 8 1 2023-12-16T03:16:10.191 INFO:tasks.workunit.client.0.smithi064.stdout:6/625: dwrite d3/f61 [4194304,4194304] 0 2023-12-16T03:16:10.193 INFO:tasks.workunit.client.0.smithi064.stdout:6/626: rename d3/d8/d13/d58/f5c to d3/d8/d1f/d26/d47/d4a/d67/fbb 0 2023-12-16T03:16:10.194 INFO:tasks.workunit.client.0.smithi064.stdout:2/582: dwrite d1/d15/d7d/dac/f4f [0,4194304] 0 2023-12-16T03:16:10.197 INFO:tasks.workunit.client.1.smithi184.stdout:5/885: dwrite d1/d3/d9/de/d30/d68/fee [0,4194304] 0 2023-12-16T03:16:10.199 INFO:tasks.workunit.client.0.smithi064.stdout:2/583: creat d1/d76/d57/fb9 x:0 0 0 2023-12-16T03:16:10.199 INFO:tasks.workunit.client.1.smithi184.stdout:2/948: sync 2023-12-16T03:16:10.199 INFO:tasks.workunit.client.1.smithi184.stdout:2/949: chown d3/d13/ddf/lf3 2020 1 2023-12-16T03:16:10.199 INFO:tasks.workunit.client.0.smithi064.stdout:4/695: dread d0/d42/d66/d33/fad [0,4194304] 0 2023-12-16T03:16:10.200 INFO:tasks.workunit.client.0.smithi064.stdout:2/584: symlink d1/db3/lba 0 2023-12-16T03:16:10.203 INFO:tasks.workunit.client.0.smithi064.stdout:4/696: symlink d0/d42/d56/ld2 0 2023-12-16T03:16:10.203 INFO:tasks.workunit.client.0.smithi064.stdout:4/697: dread - d0/d42/d66/d5a/fcd zero size 2023-12-16T03:16:10.203 INFO:tasks.workunit.client.0.smithi064.stdout:4/698: chown d0/d1e/l1f 792 1 2023-12-16T03:16:10.203 INFO:tasks.workunit.client.0.smithi064.stdout:4/699: chown d0/d42/f63 18500171 1 2023-12-16T03:16:10.203 INFO:tasks.workunit.client.0.smithi064.stdout:4/700: readlink d0/d42/d4c/d70/dbe/lc4 0 2023-12-16T03:16:10.206 INFO:tasks.workunit.client.1.smithi184.stdout:2/950: creat d3/d29/d4d/d123/f139 x:0 0 0 2023-12-16T03:16:10.207 INFO:tasks.workunit.client.1.smithi184.stdout:2/951: chown d3/d29/d2f/f93 38 1 2023-12-16T03:16:10.207 INFO:tasks.workunit.client.0.smithi064.stdout:7/706: dwrite d7/d26/d95/fe3 [0,4194304] 0 2023-12-16T03:16:10.207 INFO:tasks.workunit.client.0.smithi064.stdout:2/585: truncate d1/f8 317037 0 2023-12-16T03:16:10.211 INFO:tasks.workunit.client.0.smithi064.stdout:4/701: mkdir d0/d42/d4c/d70/d8c/dc7/dd3 0 2023-12-16T03:16:10.217 INFO:tasks.workunit.client.1.smithi184.stdout:2/952: symlink d3/d9/d19/d82/l13a 0 2023-12-16T03:16:10.219 INFO:tasks.workunit.client.1.smithi184.stdout:2/953: creat d3/d29/d8a/f13b x:0 0 0 2023-12-16T03:16:10.221 INFO:tasks.workunit.client.1.smithi184.stdout:2/954: read d3/d29/d2f/d46/d77/f80 [228135,97394] 0 2023-12-16T03:16:10.221 INFO:tasks.workunit.client.0.smithi064.stdout:6/627: dwrite d3/d8/d1f/f5a [0,4194304] 0 2023-12-16T03:16:10.221 INFO:tasks.workunit.client.0.smithi064.stdout:4/702: mkdir d0/d42/d53/dd4 0 2023-12-16T03:16:10.222 INFO:tasks.workunit.client.1.smithi184.stdout:2/955: mknod d3/d13/d28/dac/daf/c13c 0 2023-12-16T03:16:10.223 INFO:tasks.workunit.client.0.smithi064.stdout:6/628: symlink d3/d8/d1f/d26/d47/lbc 0 2023-12-16T03:16:10.223 INFO:tasks.workunit.client.0.smithi064.stdout:6/629: chown d3/l88 10791 1 2023-12-16T03:16:10.224 INFO:tasks.workunit.client.0.smithi064.stdout:4/703: symlink d0/d42/d66/d33/ld5 0 2023-12-16T03:16:10.224 INFO:tasks.workunit.client.0.smithi064.stdout:4/704: write d0/fc2 [305193,130044] 0 2023-12-16T03:16:10.225 INFO:tasks.workunit.client.1.smithi184.stdout:2/956: symlink d3/d13/d28/l13d 0 2023-12-16T03:16:10.227 INFO:tasks.workunit.client.0.smithi064.stdout:4/705: creat d0/d12/d48/d87/fd6 x:0 0 0 2023-12-16T03:16:10.227 INFO:tasks.workunit.client.0.smithi064.stdout:4/706: dread - d0/d1e/d36/f93 zero size 2023-12-16T03:16:10.228 INFO:tasks.workunit.client.1.smithi184.stdout:2/957: mkdir d3/d29/d61/d137/d13e 0 2023-12-16T03:16:10.228 INFO:tasks.workunit.client.0.smithi064.stdout:4/707: read d0/f2 [7499799,108264] 0 2023-12-16T03:16:10.228 INFO:tasks.workunit.client.0.smithi064.stdout:4/708: chown d0/d1e/l1f 5632 1 2023-12-16T03:16:10.229 INFO:tasks.workunit.client.0.smithi064.stdout:6/630: truncate d3/f61 6806850 0 2023-12-16T03:16:10.231 INFO:tasks.workunit.client.0.smithi064.stdout:7/707: dwrite d7/d3e/f78 [0,4194304] 0 2023-12-16T03:16:10.232 INFO:tasks.workunit.client.0.smithi064.stdout:7/708: fsync d7/d3e/d42/d43/f5f 0 2023-12-16T03:16:10.232 INFO:tasks.workunit.client.0.smithi064.stdout:4/709: rename d0/f11 to d0/d42/d66/d5a/fd7 0 2023-12-16T03:16:10.232 INFO:tasks.workunit.client.0.smithi064.stdout:2/586: dwrite d1/d15/d1b/d61/f5f [0,4194304] 0 2023-12-16T03:16:10.237 INFO:tasks.workunit.client.0.smithi064.stdout:7/709: dread d7/d3e/d42/d43/f5f [0,4194304] 0 2023-12-16T03:16:10.239 INFO:tasks.workunit.client.0.smithi064.stdout:4/710: truncate d0/d1e/d36/f4d 797636 0 2023-12-16T03:16:10.240 INFO:tasks.workunit.client.0.smithi064.stdout:6/631: dread d3/d9/f18 [0,4194304] 0 2023-12-16T03:16:10.240 INFO:tasks.workunit.client.0.smithi064.stdout:7/710: creat d7/d26/d95/dca/dd2/fe4 x:0 0 0 2023-12-16T03:16:10.241 INFO:tasks.workunit.client.1.smithi184.stdout:5/886: write d1/d3/d9/de/d30/fb1 [345465,70399] 0 2023-12-16T03:16:10.241 INFO:tasks.workunit.client.1.smithi184.stdout:2/958: dread d3/d9/d19/f26 [0,4194304] 0 2023-12-16T03:16:10.242 INFO:tasks.workunit.client.0.smithi064.stdout:4/711: getdents d0/d42/d4c/d70/dbe 0 2023-12-16T03:16:10.246 INFO:tasks.workunit.client.1.smithi184.stdout:5/887: rename d1/d3/d9/fbc to d1/dbb/f11c 0 2023-12-16T03:16:10.246 INFO:tasks.workunit.client.1.smithi184.stdout:5/888: chown d1/d3/d9/d49/d74/fa6 9881884 1 2023-12-16T03:16:10.246 INFO:tasks.workunit.client.1.smithi184.stdout:5/889: readlink d1/d3/d9/de/d15/d19/d3a/dde/lfa 0 2023-12-16T03:16:10.246 INFO:tasks.workunit.client.0.smithi064.stdout:9/655: sync 2023-12-16T03:16:10.249 INFO:tasks.workunit.client.0.smithi064.stdout:2/587: dread d1/d15/d1b/d9c/d69/f78 [0,4194304] 0 2023-12-16T03:16:10.249 INFO:tasks.workunit.client.0.smithi064.stdout:2/588: chown d1/d15/d7d/f79 45381 1 2023-12-16T03:16:10.250 INFO:tasks.workunit.client.0.smithi064.stdout:2/589: chown d1/d15/d23/d2d/da6/ca9 721978 1 2023-12-16T03:16:10.250 INFO:tasks.workunit.client.0.smithi064.stdout:6/632: rename d3/d8/d1f/d26/d47/d9d to d3/d9e/dbd 0 2023-12-16T03:16:10.250 INFO:tasks.workunit.client.0.smithi064.stdout:6/633: chown d3/d8/da/f43 174663261 1 2023-12-16T03:16:10.251 INFO:tasks.workunit.client.1.smithi184.stdout:2/959: creat d3/d9/d19/d101/f13f x:0 0 0 2023-12-16T03:16:10.252 INFO:tasks.workunit.client.0.smithi064.stdout:9/656: write d2/d2d/d36/f53 [940851,58671] 0 2023-12-16T03:16:10.252 INFO:tasks.workunit.client.0.smithi064.stdout:0/653: sync 2023-12-16T03:16:10.253 INFO:tasks.workunit.client.0.smithi064.stdout:2/590: dread d1/d15/d7d/f79 [0,4194304] 0 2023-12-16T03:16:10.253 INFO:tasks.workunit.client.1.smithi184.stdout:5/890: symlink d1/d3/d9/de/d15/d19/d48/l11d 0 2023-12-16T03:16:10.256 INFO:tasks.workunit.client.0.smithi064.stdout:2/591: getdents d1/d15/d1b/d9c/d68 0 2023-12-16T03:16:10.257 INFO:tasks.workunit.client.1.smithi184.stdout:2/960: symlink d3/d29/d61/d6d/dd6/l140 0 2023-12-16T03:16:10.259 INFO:tasks.workunit.client.1.smithi184.stdout:5/891: mkdir d1/dbb/d11e 0 2023-12-16T03:16:10.259 INFO:tasks.workunit.client.1.smithi184.stdout:5/892: readlink d1/d3/d9/de/l100 0 2023-12-16T03:16:10.259 INFO:tasks.workunit.client.0.smithi064.stdout:2/592: symlink d1/d15/d1b/d49/lbb 0 2023-12-16T03:16:10.259 INFO:tasks.workunit.client.0.smithi064.stdout:2/593: chown d1/d15/d7d/f79 15187864 1 2023-12-16T03:16:10.260 INFO:tasks.workunit.client.0.smithi064.stdout:6/634: dread d3/f5 [0,4194304] 0 2023-12-16T03:16:10.260 INFO:tasks.workunit.client.1.smithi184.stdout:2/961: symlink d3/d29/d61/l141 0 2023-12-16T03:16:10.261 INFO:tasks.workunit.client.1.smithi184.stdout:2/962: chown d3/d9/d19/f26 214242421 1 2023-12-16T03:16:10.262 INFO:tasks.workunit.client.0.smithi064.stdout:4/712: dwrite d0/d42/d66/f73 [0,4194304] 0 2023-12-16T03:16:10.264 INFO:tasks.workunit.client.0.smithi064.stdout:2/594: symlink d1/d15/da5/lbc 0 2023-12-16T03:16:10.264 INFO:tasks.workunit.client.0.smithi064.stdout:2/595: chown d1/lb 2085 1 2023-12-16T03:16:10.264 INFO:tasks.workunit.client.0.smithi064.stdout:6/635: write d3/fd [1840691,53733] 0 2023-12-16T03:16:10.266 INFO:tasks.workunit.client.1.smithi184.stdout:2/963: mknod d3/d29/d2f/d46/dfd/c142 0 2023-12-16T03:16:10.269 INFO:tasks.workunit.client.0.smithi064.stdout:4/713: mkdir d0/da/da6/dd8 0 2023-12-16T03:16:10.269 INFO:tasks.workunit.client.0.smithi064.stdout:4/714: chown d0/d42/d66/d5a/d75 3 1 2023-12-16T03:16:10.273 INFO:tasks.workunit.client.0.smithi064.stdout:6/636: mkdir d3/d9/dbe 0 2023-12-16T03:16:10.273 INFO:tasks.workunit.client.0.smithi064.stdout:6/637: dread - d3/f9a zero size 2023-12-16T03:16:10.274 INFO:tasks.workunit.client.0.smithi064.stdout:4/715: creat d0/d42/d4c/d70/dbe/fd9 x:0 0 0 2023-12-16T03:16:10.277 INFO:tasks.workunit.client.0.smithi064.stdout:4/716: getdents d0 0 2023-12-16T03:16:10.281 INFO:tasks.workunit.client.0.smithi064.stdout:4/717: link d0/d42/d53/f6b d0/d42/d4c/fda 0 2023-12-16T03:16:10.281 INFO:tasks.workunit.client.0.smithi064.stdout:4/718: dread - d0/d42/f52 zero size 2023-12-16T03:16:10.281 INFO:tasks.workunit.client.0.smithi064.stdout:4/719: truncate d0/d42/d4c/d70/dbe/fd9 453659 0 2023-12-16T03:16:10.282 INFO:tasks.workunit.client.0.smithi064.stdout:4/720: creat d0/d42/d4c/d70/fdb x:0 0 0 2023-12-16T03:16:10.283 INFO:tasks.workunit.client.0.smithi064.stdout:4/721: creat d0/d1e/d36/fdc x:0 0 0 2023-12-16T03:16:10.283 INFO:tasks.workunit.client.0.smithi064.stdout:4/722: readlink d0/d42/d56/ld2 0 2023-12-16T03:16:10.284 INFO:tasks.workunit.client.0.smithi064.stdout:4/723: symlink d0/d42/d66/d5a/d75/ldd 0 2023-12-16T03:16:10.284 INFO:tasks.workunit.client.1.smithi184.stdout:2/964: dread d3/d29/d2f/d2e/f3a [0,4194304] 0 2023-12-16T03:16:10.285 INFO:tasks.workunit.client.1.smithi184.stdout:2/965: stat d3/d29/d4d/ff5 0 2023-12-16T03:16:10.285 INFO:tasks.workunit.client.0.smithi064.stdout:4/724: mknod d0/d42/d4c/d70/cde 0 2023-12-16T03:16:10.287 INFO:tasks.workunit.client.1.smithi184.stdout:2/966: mkdir d3/d13/d28/d83/d143 0 2023-12-16T03:16:10.288 INFO:tasks.workunit.client.0.smithi064.stdout:4/725: creat d0/d1e/d36/db7/fdf x:0 0 0 2023-12-16T03:16:10.289 INFO:tasks.workunit.client.1.smithi184.stdout:2/967: getdents d3/d29/d4d/d123 0 2023-12-16T03:16:10.291 INFO:tasks.workunit.client.0.smithi064.stdout:4/726: symlink d0/d42/d66/d5a/d90/le0 0 2023-12-16T03:16:10.293 INFO:tasks.workunit.client.0.smithi064.stdout:4/727: symlink d0/d12/d48/d87/le1 0 2023-12-16T03:16:10.293 INFO:tasks.workunit.client.0.smithi064.stdout:2/596: dwrite d1/d15/d1b/d49/da0/d8f/f9a [0,4194304] 0 2023-12-16T03:16:10.293 INFO:tasks.workunit.client.0.smithi064.stdout:6/638: fdatasync d3/fd 0 2023-12-16T03:16:10.294 INFO:tasks.workunit.client.0.smithi064.stdout:4/728: write d0/d42/d66/d5a/fd7 [4123710,92528] 0 2023-12-16T03:16:10.294 INFO:tasks.workunit.client.0.smithi064.stdout:4/729: dread - d0/d42/d4c/f54 zero size 2023-12-16T03:16:10.294 INFO:tasks.workunit.client.0.smithi064.stdout:4/730: truncate d0/d12/fc8 588258 0 2023-12-16T03:16:10.294 INFO:tasks.workunit.client.0.smithi064.stdout:9/657: dwrite d2/d2d/d3b/d3c/d4b/f58 [0,4194304] 0 2023-12-16T03:16:10.298 INFO:tasks.workunit.client.0.smithi064.stdout:2/597: creat d1/d15/d23/fbd x:0 0 0 2023-12-16T03:16:10.299 INFO:tasks.workunit.client.0.smithi064.stdout:6/639: symlink d3/d8/lbf 0 2023-12-16T03:16:10.299 INFO:tasks.workunit.client.0.smithi064.stdout:6/640: chown d3/d8/f5f 0 1 2023-12-16T03:16:10.305 INFO:tasks.workunit.client.0.smithi064.stdout:9/658: dread - d2/d2d/fb6 zero size 2023-12-16T03:16:10.305 INFO:tasks.workunit.client.0.smithi064.stdout:4/731: link d0/d42/d66/d33/fad d0/d42/d4c/d70/fe2 0 2023-12-16T03:16:10.307 INFO:tasks.workunit.client.0.smithi064.stdout:2/598: rename d1/d15/d1b/d61/d63/fa4 to d1/d15/d7d/fbe 0 2023-12-16T03:16:10.307 INFO:tasks.workunit.client.0.smithi064.stdout:2/599: write d1/d15/d7d/f6f [324215,54428] 0 2023-12-16T03:16:10.307 INFO:tasks.workunit.client.0.smithi064.stdout:2/600: write d1/d15/d1b/d61/fb7 [985991,34977] 0 2023-12-16T03:16:10.309 INFO:tasks.workunit.client.0.smithi064.stdout:2/601: rmdir d1/d15/da5 39 2023-12-16T03:16:10.316 INFO:tasks.workunit.client.1.smithi184.stdout:5/893: dwrite d1/d3/d9/de/d30/f4e [4194304,4194304] 0 2023-12-16T03:16:10.319 INFO:tasks.workunit.client.1.smithi184.stdout:2/968: dwrite d3/d29/d2f/d2e/f1a [0,4194304] 0 2023-12-16T03:16:10.322 INFO:tasks.workunit.client.1.smithi184.stdout:5/894: rename d1/d2a/de3/leb to d1/d2a/d31/l11f 0 2023-12-16T03:16:10.322 INFO:tasks.workunit.client.1.smithi184.stdout:5/895: getdents d1/d3/d9/de/d10f 0 2023-12-16T03:16:10.322 INFO:tasks.workunit.client.1.smithi184.stdout:5/896: chown d1/d2a/d31/d28/d72/cb4 45800 1 2023-12-16T03:16:10.332 INFO:tasks.workunit.client.1.smithi184.stdout:5/897: mknod d1/d3/d9/de/d15/d19/d3a/dde/d115/c120 0 2023-12-16T03:16:10.332 INFO:tasks.workunit.client.1.smithi184.stdout:5/898: read d1/d3/d9/de/d15/d90/fa3 [555118,90810] 0 2023-12-16T03:16:10.332 INFO:tasks.workunit.client.1.smithi184.stdout:5/899: chown d1/d3/d9/de/l111 977488598 1 2023-12-16T03:16:10.332 INFO:tasks.workunit.client.1.smithi184.stdout:5/900: write d1/d2a/d31/f54 [467023,39885] 0 2023-12-16T03:16:10.339 INFO:tasks.workunit.client.1.smithi184.stdout:5/901: creat d1/d3/d9/de/d30/f121 x:0 0 0 2023-12-16T03:16:10.339 INFO:tasks.workunit.client.0.smithi064.stdout:6/641: dwrite d3/d8/fa4 [0,4194304] 0 2023-12-16T03:16:10.339 INFO:tasks.workunit.client.0.smithi064.stdout:6/642: readlink d3/d9/la3 0 2023-12-16T03:16:10.341 INFO:tasks.workunit.client.1.smithi184.stdout:5/902: rename d1/d3/d9/de/d15/d90/fcf to d1/d3/d9/de/d15/d19/d48/f122 0 2023-12-16T03:16:10.342 INFO:tasks.workunit.client.1.smithi184.stdout:5/903: symlink d1/d3/d9/de/d15/d27/ddd/l123 0 2023-12-16T03:16:10.342 INFO:tasks.workunit.client.1.smithi184.stdout:5/904: write d1/d3/d9/de/d15/fb8 [3046388,40880] 0 2023-12-16T03:16:10.343 INFO:tasks.workunit.client.1.smithi184.stdout:5/905: link d1/d3/dc6/fd8 d1/d2a/d31/d28/f124 0 2023-12-16T03:16:10.344 INFO:tasks.workunit.client.1.smithi184.stdout:5/906: creat d1/d3/d9/de/d15/d27/dd2/df0/f125 x:0 0 0 2023-12-16T03:16:10.344 INFO:tasks.workunit.client.1.smithi184.stdout:5/907: chown d1/d3/d9/de/f11a 46609499 1 2023-12-16T03:16:10.345 INFO:tasks.workunit.client.1.smithi184.stdout:5/908: dread d1/d3/d9/de/d15/d19/d3a/fea [0,4194304] 0 2023-12-16T03:16:10.345 INFO:tasks.workunit.client.1.smithi184.stdout:5/909: stat d1/d3/d2f/f6d 0 2023-12-16T03:16:10.346 INFO:tasks.workunit.client.1.smithi184.stdout:5/910: mkdir d1/d2a/d31/d28/d72/d126 0 2023-12-16T03:16:10.346 INFO:tasks.workunit.client.1.smithi184.stdout:5/911: chown d1/d3/d9/de/d15/f52 179 1 2023-12-16T03:16:10.346 INFO:tasks.workunit.client.1.smithi184.stdout:5/912: chown d1/d3/d2f/db5 6 1 2023-12-16T03:16:10.352 INFO:tasks.workunit.client.0.smithi064.stdout:4/732: dwrite d0/d1e/d36/f46 [0,4194304] 0 2023-12-16T03:16:10.353 INFO:tasks.workunit.client.0.smithi064.stdout:2/602: dwrite d1/d15/d7d/f79 [0,4194304] 0 2023-12-16T03:16:10.353 INFO:tasks.workunit.client.1.smithi184.stdout:2/969: dwrite d3/d29/d2f/d2e/f8e [0,4194304] 0 2023-12-16T03:16:10.353 INFO:tasks.workunit.client.0.smithi064.stdout:4/733: link d0/d42/d66/d33/ld5 d0/d42/d4c/d70/d8c/le3 0 2023-12-16T03:16:10.354 INFO:tasks.workunit.client.0.smithi064.stdout:4/734: chown d0/da/f9f 1001348039 1 2023-12-16T03:16:10.354 INFO:tasks.workunit.client.0.smithi064.stdout:9/659: dwrite d2/d2d/d3b/f49 [0,4194304] 0 2023-12-16T03:16:10.354 INFO:tasks.workunit.client.0.smithi064.stdout:9/660: truncate d2/d7e/fcd 1016652 0 2023-12-16T03:16:10.354 INFO:tasks.workunit.client.0.smithi064.stdout:9/661: chown d2/d2d/d3b/d3c/d34/fcf 3024464 1 2023-12-16T03:16:10.356 INFO:tasks.workunit.client.1.smithi184.stdout:5/913: dread d1/d3/d9/de/d15/d19/d48/f98 [0,4194304] 0 2023-12-16T03:16:10.356 INFO:tasks.workunit.client.1.smithi184.stdout:5/914: chown d1/d3/d9/de/d15/d19/d5f/d45/l9e 6955 1 2023-12-16T03:16:10.357 INFO:tasks.workunit.client.0.smithi064.stdout:2/603: getdents d1/d15/d23/d2d 0 2023-12-16T03:16:10.357 INFO:tasks.workunit.client.0.smithi064.stdout:2/604: dread - d1/d15/d23/d2d/f9b zero size 2023-12-16T03:16:10.358 INFO:tasks.workunit.client.1.smithi184.stdout:2/970: mknod d3/d9/d19/d82/c144 0 2023-12-16T03:16:10.358 INFO:tasks.workunit.client.0.smithi064.stdout:2/605: write d1/d15/d23/f7a [3540559,130053] 0 2023-12-16T03:16:10.360 INFO:tasks.workunit.client.0.smithi064.stdout:4/735: mkdir d0/da/da6/de4 0 2023-12-16T03:16:10.363 INFO:tasks.workunit.client.1.smithi184.stdout:5/915: mknod d1/d2a/d31/d28/c127 0 2023-12-16T03:16:10.369 INFO:tasks.workunit.client.0.smithi064.stdout:9/662: mknod d2/dc/d24/d39/d42/d94/cdb 0 2023-12-16T03:16:10.370 INFO:tasks.workunit.client.0.smithi064.stdout:9/663: dread - d2/dc/d24/d39/d42/f48 zero size 2023-12-16T03:16:10.370 INFO:tasks.workunit.client.0.smithi064.stdout:9/664: write d2/dc/d24/d39/d77/d7d/fad [976173,5358] 0 2023-12-16T03:16:10.371 INFO:tasks.workunit.client.0.smithi064.stdout:6/643: dread d3/d8/d1f/f5a [0,4194304] 0 2023-12-16T03:16:10.372 INFO:tasks.workunit.client.0.smithi064.stdout:6/644: chown d3/d9/l6a 65856738 1 2023-12-16T03:16:10.374 INFO:tasks.workunit.client.0.smithi064.stdout:2/606: creat d1/d15/d1b/d9c/fbf x:0 0 0 2023-12-16T03:16:10.388 INFO:tasks.workunit.client.0.smithi064.stdout:9/665: creat d2/d2d/d3b/d3c/fdc x:0 0 0 2023-12-16T03:16:10.388 INFO:tasks.workunit.client.1.smithi184.stdout:2/971: dwrite d3/d13/d28/f117 [4194304,4194304] 0 2023-12-16T03:16:10.388 INFO:tasks.workunit.client.1.smithi184.stdout:2/972: dread - d3/d29/d2f/d46/dfd/f108 zero size 2023-12-16T03:16:10.389 INFO:tasks.workunit.client.0.smithi064.stdout:6/645: unlink d3/d8/d1f/d26/fb8 0 2023-12-16T03:16:10.389 INFO:tasks.workunit.client.0.smithi064.stdout:6/646: chown d3/d8/d13/f24 23 1 2023-12-16T03:16:10.391 INFO:tasks.workunit.client.0.smithi064.stdout:2/607: link d1/d15/d1b/d49/da0/c4a d1/d15/da5/cc0 0 2023-12-16T03:16:10.391 INFO:tasks.workunit.client.1.smithi184.stdout:5/916: dwrite d1/d3/d9/de/d15/f1e [0,4194304] 0 2023-12-16T03:16:10.391 INFO:tasks.workunit.client.1.smithi184.stdout:2/973: write d3/d29/d61/d6d/f99 [1854712,3235] 0 2023-12-16T03:16:10.392 INFO:tasks.workunit.client.1.smithi184.stdout:5/917: read d1/d3/d9/f40 [1234786,53050] 0 2023-12-16T03:16:10.395 INFO:tasks.workunit.client.0.smithi064.stdout:4/736: dwrite d0/da/f16 [0,4194304] 0 2023-12-16T03:16:10.396 INFO:tasks.workunit.client.0.smithi064.stdout:2/608: creat d1/d15/d23/d2d/fc1 x:0 0 0 2023-12-16T03:16:10.397 INFO:tasks.workunit.client.1.smithi184.stdout:2/974: creat d3/d13/d28/d83/d143/f145 x:0 0 0 2023-12-16T03:16:10.397 INFO:tasks.workunit.client.0.smithi064.stdout:4/737: read d0/d1e/f60 [570004,117768] 0 2023-12-16T03:16:10.400 INFO:tasks.workunit.client.0.smithi064.stdout:2/609: mkdir d1/d15/d58/dab/dc2 0 2023-12-16T03:16:10.402 INFO:tasks.workunit.client.0.smithi064.stdout:9/666: dwrite d2/dc/d24/d39/d77/d7d/fd7 [0,4194304] 0 2023-12-16T03:16:10.402 INFO:tasks.workunit.client.0.smithi064.stdout:4/738: mknod d0/da/ce5 0 2023-12-16T03:16:10.402 INFO:tasks.workunit.client.0.smithi064.stdout:4/739: write d0/d42/f52 [219575,81933] 0 2023-12-16T03:16:10.402 INFO:tasks.workunit.client.0.smithi064.stdout:4/740: write d0/f2 [12986372,109614] 0 2023-12-16T03:16:10.403 INFO:tasks.workunit.client.1.smithi184.stdout:2/975: symlink d3/d29/d2f/d2e/dcb/d134/l146 0 2023-12-16T03:16:10.403 INFO:tasks.workunit.client.1.smithi184.stdout:2/976: write d3/d29/d2f/d46/d77/f80 [4320845,84224] 0 2023-12-16T03:16:10.410 INFO:tasks.workunit.client.0.smithi064.stdout:9/667: rmdir d2/dc/d24/d39/d77/d7d/db9 39 2023-12-16T03:16:10.410 INFO:tasks.workunit.client.0.smithi064.stdout:9/668: chown d2/dc/d24/fd6 1 1 2023-12-16T03:16:10.410 INFO:tasks.workunit.client.0.smithi064.stdout:9/669: getdents d2/dc/d8a 0 2023-12-16T03:16:10.412 INFO:tasks.workunit.client.0.smithi064.stdout:4/741: mkdir d0/d42/d53/de6 0 2023-12-16T03:16:10.421 INFO:tasks.workunit.client.0.smithi064.stdout:6/647: rmdir d3 39 2023-12-16T03:16:10.423 INFO:tasks.workunit.client.0.smithi064.stdout:6/648: mkdir d3/d9/dc0 0 2023-12-16T03:16:10.423 INFO:tasks.workunit.client.0.smithi064.stdout:6/649: getdents d3/d8/d13/d58/db6 0 2023-12-16T03:16:10.424 INFO:tasks.workunit.client.0.smithi064.stdout:6/650: symlink d3/d8/d13/d46/d5e/lc1 0 2023-12-16T03:16:10.425 INFO:tasks.workunit.client.0.smithi064.stdout:6/651: creat d3/d80/d92/fc2 x:0 0 0 2023-12-16T03:16:10.425 INFO:tasks.workunit.client.0.smithi064.stdout:6/652: chown d3/d9e 759 1 2023-12-16T03:16:10.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:10 smithi064 ceph-mon[111958]: [16/Dec/2023:03:16:08] ENGINE Bus STARTING 2023-12-16T03:16:10.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:10 smithi064 ceph-mon[111958]: [16/Dec/2023:03:16:08] ENGINE Serving on https://172.21.15.184:7150 2023-12-16T03:16:10.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:10 smithi064 ceph-mon[111958]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:10.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:10 smithi064 ceph-mon[111958]: [16/Dec/2023:03:16:08] ENGINE Serving on http://172.21.15.184:8765 2023-12-16T03:16:10.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:10 smithi064 ceph-mon[111958]: [16/Dec/2023:03:16:08] ENGINE Bus STARTED 2023-12-16T03:16:10.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:10 smithi064 ceph-mon[111958]: pgmap v4: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2023-12-16T03:16:10.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:10 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3160997960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:16:10.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:10 smithi064 ceph-mon[111958]: mgrmap e22: smithi184.urtxla(active, since 2s) 2023-12-16T03:16:10.445 INFO:tasks.workunit.client.0.smithi064.stdout:2/610: dwrite d1/d15/d1b/d61/f77 [4194304,4194304] 0 2023-12-16T03:16:10.448 INFO:tasks.workunit.client.0.smithi064.stdout:1/760: sync 2023-12-16T03:16:10.448 INFO:tasks.workunit.client.0.smithi064.stdout:1/761: chown d3/d22/dab/fea 0 1 2023-12-16T03:16:10.448 INFO:tasks.workunit.client.0.smithi064.stdout:8/708: sync 2023-12-16T03:16:10.448 INFO:tasks.workunit.client.0.smithi064.stdout:8/709: write d0/da/de9/f66 [4544930,93732] 0 2023-12-16T03:16:10.448 INFO:tasks.workunit.client.0.smithi064.stdout:3/775: sync 2023-12-16T03:16:10.450 INFO:tasks.workunit.client.0.smithi064.stdout:2/611: write d1/d15/d1b/d49/f8b [1222366,23783] 0 2023-12-16T03:16:10.450 INFO:tasks.workunit.client.0.smithi064.stdout:2/612: write d1/d15/d1b/d49/fb2 [767542,100186] 0 2023-12-16T03:16:10.450 INFO:tasks.workunit.client.0.smithi064.stdout:1/762: read d3/d36/f65 [281483,69097] 0 2023-12-16T03:16:10.450 INFO:tasks.workunit.client.0.smithi064.stdout:9/670: dwrite d2/dc/d24/d39/d5e/d6f/f84 [0,4194304] 0 2023-12-16T03:16:10.451 INFO:tasks.workunit.client.0.smithi064.stdout:3/776: creat db/d12/d1a/d2c/d34/d4c/de5/ffe x:0 0 0 2023-12-16T03:16:10.452 INFO:tasks.workunit.client.0.smithi064.stdout:4/742: dwrite d0/d42/d53/f6b [0,4194304] 0 2023-12-16T03:16:10.452 INFO:tasks.workunit.client.0.smithi064.stdout:3/777: write db/d12/d21/f33 [197319,56640] 0 2023-12-16T03:16:10.453 INFO:tasks.workunit.client.0.smithi064.stdout:6/653: dwrite d3/d8/d1f/d26/d47/d4a/d67/fbb [0,4194304] 0 2023-12-16T03:16:10.453 INFO:tasks.workunit.client.0.smithi064.stdout:8/710: write d0/da/de9/d12/f15 [1391908,11147] 0 2023-12-16T03:16:10.456 INFO:tasks.workunit.client.1.smithi184.stdout:2/977: dwrite d3/d29/d61/f91 [0,4194304] 0 2023-12-16T03:16:10.457 INFO:tasks.workunit.client.0.smithi064.stdout:9/671: symlink d2/d2d/d3b/d3c/dd3/ldd 0 2023-12-16T03:16:10.460 INFO:tasks.workunit.client.1.smithi184.stdout:2/978: dread d3/d29/d2f/f45 [0,4194304] 0 2023-12-16T03:16:10.460 INFO:tasks.workunit.client.0.smithi064.stdout:4/743: rename d0/d42/d66/d5a/d90/le0 to d0/d42/d4c/d70/d8c/dc7/le7 0 2023-12-16T03:16:10.465 INFO:tasks.workunit.client.0.smithi064.stdout:8/711: link d0/da/de9/d37/d3a/d6f/ldb d0/da/d3e/d46/d54/d8c/lf1 0 2023-12-16T03:16:10.465 INFO:tasks.workunit.client.0.smithi064.stdout:8/712: dread - d0/da/d3e/d46/d9d/da2/fae zero size 2023-12-16T03:16:10.467 INFO:tasks.workunit.client.0.smithi064.stdout:8/713: link d0/da/de9/d12/d44/fc7 d0/d1d/d24/d2f/d50/d70/dcc/ddf/ff2 0 2023-12-16T03:16:10.470 INFO:tasks.workunit.client.0.smithi064.stdout:8/714: rename d0/d1d/d24/d9c/lad to d0/da/de9/d12/d44/d68/lf3 0 2023-12-16T03:16:10.471 INFO:tasks.workunit.client.1.smithi184.stdout:2/979: write d3/d13/f9a [42116,12020] 0 2023-12-16T03:16:10.471 INFO:tasks.workunit.client.0.smithi064.stdout:8/715: getdents d0/d1d/d24/d2f/d50/d70/da4 0 2023-12-16T03:16:10.472 INFO:tasks.workunit.client.0.smithi064.stdout:8/716: readlink d0/da/de9/d5a/d97/lb1 0 2023-12-16T03:16:10.472 INFO:tasks.workunit.client.0.smithi064.stdout:8/717: readlink d0/d1d/d48/le7 0 2023-12-16T03:16:10.473 INFO:tasks.workunit.client.0.smithi064.stdout:8/718: mknod d0/d1d/d73/cf4 0 2023-12-16T03:16:10.473 INFO:tasks.workunit.client.0.smithi064.stdout:8/719: chown d0/d1d/d24/d2f/d50/d70/f9a 687917381 1 2023-12-16T03:16:10.474 INFO:tasks.workunit.client.0.smithi064.stdout:8/720: symlink d0/da/de9/d37/d3a/lf5 0 2023-12-16T03:16:10.476 INFO:tasks.workunit.client.0.smithi064.stdout:9/672: read d2/dc/d24/d39/d77/d7d/fad [929084,80047] 0 2023-12-16T03:16:10.476 INFO:tasks.workunit.client.0.smithi064.stdout:8/721: link d0/da/de9/c56 d0/da/de9/d12/d44/d68/d6d/cf6 0 2023-12-16T03:16:10.478 INFO:tasks.workunit.client.0.smithi064.stdout:9/673: creat d2/d2d/d36/db4/fde x:0 0 0 2023-12-16T03:16:10.479 INFO:tasks.workunit.client.0.smithi064.stdout:8/722: symlink d0/d1d/d24/d9c/lf7 0 2023-12-16T03:16:10.480 INFO:tasks.workunit.client.0.smithi064.stdout:8/723: getdents d0/da/de9/d37/dbf 0 2023-12-16T03:16:10.482 INFO:tasks.workunit.client.0.smithi064.stdout:8/724: mkdir d0/d1d/d73/dd9/df8 0 2023-12-16T03:16:10.483 INFO:tasks.workunit.client.0.smithi064.stdout:8/725: readlink d0/da/de9/d5a/lee 0 2023-12-16T03:16:10.484 INFO:tasks.workunit.client.0.smithi064.stdout:8/726: creat d0/d1d/d73/ff9 x:0 0 0 2023-12-16T03:16:10.484 INFO:tasks.workunit.client.0.smithi064.stdout:8/727: chown d0/da/de9/d12/d1c/d59/d77 999177093 1 2023-12-16T03:16:10.486 INFO:tasks.workunit.client.0.smithi064.stdout:9/674: write d2/dc/d24/d39/d77/fa0 [4142333,38421] 0 2023-12-16T03:16:10.486 INFO:tasks.workunit.client.0.smithi064.stdout:9/675: chown d2/d2d/d3b/d3c/d34/f50 7418 1 2023-12-16T03:16:10.486 INFO:tasks.workunit.client.0.smithi064.stdout:9/676: write d2/dc/d24/d39/d77/fa0 [4340216,121497] 0 2023-12-16T03:16:10.487 INFO:tasks.workunit.client.0.smithi064.stdout:9/677: readlink d2/dc/d8a/lc6 0 2023-12-16T03:16:10.487 INFO:tasks.workunit.client.0.smithi064.stdout:9/678: read - d2/d2d/d6c/fd9 zero size 2023-12-16T03:16:10.487 INFO:tasks.workunit.client.0.smithi064.stdout:9/679: rmdir d2/d7e 39 2023-12-16T03:16:10.488 INFO:tasks.workunit.client.0.smithi064.stdout:9/680: creat d2/dc/d24/db2/dc3/fdf x:0 0 0 2023-12-16T03:16:10.494 INFO:tasks.workunit.client.0.smithi064.stdout:2/613: dwrite d1/d15/d23/d2d/fb5 [0,4194304] 0 2023-12-16T03:16:10.498 INFO:tasks.workunit.client.0.smithi064.stdout:1/763: dwrite d3/dd/d23/d4f/f8d [0,4194304] 0 2023-12-16T03:16:10.498 INFO:tasks.workunit.client.0.smithi064.stdout:1/764: truncate d3/dd/d11/f1f 4605461 0 2023-12-16T03:16:10.500 INFO:tasks.workunit.client.0.smithi064.stdout:1/765: write d3/d36/d9e/f85 [757729,20924] 0 2023-12-16T03:16:10.501 INFO:tasks.workunit.client.0.smithi064.stdout:1/766: symlink d3/d36/d44/d4d/da8/dce/lf0 0 2023-12-16T03:16:10.501 INFO:tasks.workunit.client.0.smithi064.stdout:1/767: chown d3/d36/d44/d4d/fae 449 1 2023-12-16T03:16:10.501 INFO:tasks.workunit.client.0.smithi064.stdout:1/768: fsync d3/dd/d11/fa5 0 2023-12-16T03:16:10.502 INFO:tasks.workunit.client.0.smithi064.stdout:1/769: mkdir d3/d36/d44/d4d/d58/df1 0 2023-12-16T03:16:10.503 INFO:tasks.workunit.client.0.smithi064.stdout:1/770: dread d3/dd/d11/f56 [0,4194304] 0 2023-12-16T03:16:10.503 INFO:tasks.workunit.client.0.smithi064.stdout:1/771: chown d3/dd/de4 46363791 1 2023-12-16T03:16:10.504 INFO:tasks.workunit.client.0.smithi064.stdout:1/772: fdatasync d3/dd/d23/d4f/f9a 0 2023-12-16T03:16:10.504 INFO:tasks.workunit.client.0.smithi064.stdout:1/773: dread - d3/d22/dab/fea zero size 2023-12-16T03:16:10.504 INFO:tasks.workunit.client.0.smithi064.stdout:1/774: fsync d3/dd/d11/d6a/f75 0 2023-12-16T03:16:10.504 INFO:tasks.workunit.client.0.smithi064.stdout:1/775: fdatasync d3/d36/d44/d4d/d58/d96/f99 0 2023-12-16T03:16:10.504 INFO:tasks.workunit.client.0.smithi064.stdout:1/776: truncate d3/f26 3747510 0 2023-12-16T03:16:10.505 INFO:tasks.workunit.client.0.smithi064.stdout:1/777: truncate d3/d36/d44/d4d/dad/fb5 205850 0 2023-12-16T03:16:10.508 INFO:tasks.workunit.client.0.smithi064.stdout:6/654: dwrite d3/d8/d1f/d26/fb7 [0,4194304] 0 2023-12-16T03:16:10.508 INFO:tasks.workunit.client.1.smithi184.stdout:2/980: dwrite d3/d13/d28/d83/fb9 [4194304,4194304] 0 2023-12-16T03:16:10.509 INFO:tasks.workunit.client.0.smithi064.stdout:3/778: dwrite db/d12/d21/f33 [4194304,4194304] 0 2023-12-16T03:16:10.510 INFO:tasks.workunit.client.0.smithi064.stdout:6/655: write d3/d8/da/f23 [7977671,52822] 0 2023-12-16T03:16:10.511 INFO:tasks.workunit.client.0.smithi064.stdout:6/656: fsync d3/d8/d13/d58/fa1 0 2023-12-16T03:16:10.511 INFO:tasks.workunit.client.0.smithi064.stdout:6/657: readlink d3/d8/d1f/d26/d47/d4a/d67/d73/lb1 0 2023-12-16T03:16:10.515 INFO:tasks.workunit.client.0.smithi064.stdout:3/779: mknod db/d4f/d51/dd1/dd3/cff 0 2023-12-16T03:16:10.519 INFO:tasks.workunit.client.0.smithi064.stdout:4/744: dwrite d0/d1e/f69 [0,4194304] 0 2023-12-16T03:16:10.519 INFO:tasks.workunit.client.0.smithi064.stdout:4/745: write d0/d42/d66/d33/fad [1136183,6442] 0 2023-12-16T03:16:10.519 INFO:tasks.workunit.client.0.smithi064.stdout:1/778: dwrite d3/dd/d11/d2f/fb6 [0,4194304] 0 2023-12-16T03:16:10.520 INFO:tasks.workunit.client.0.smithi064.stdout:6/658: creat d3/d9/dbe/fc3 x:0 0 0 2023-12-16T03:16:10.522 INFO:tasks.workunit.client.0.smithi064.stdout:3/780: mknod db/d12/d1a/d2c/d34/d4c/d6a/c100 0 2023-12-16T03:16:10.522 INFO:tasks.workunit.client.0.smithi064.stdout:3/781: fdatasync db/d12/f18 0 2023-12-16T03:16:10.527 INFO:tasks.workunit.client.0.smithi064.stdout:8/728: rename d0/da/d3e to d0/da/de9/d37/d3a/dab/dfa 0 2023-12-16T03:16:10.528 INFO:tasks.workunit.client.0.smithi064.stdout:8/729: write d0/da/de9/d37/f43 [1632585,110455] 0 2023-12-16T03:16:10.528 INFO:tasks.workunit.client.0.smithi064.stdout:4/746: dread d0/d42/d4c/d70/f82 [0,4194304] 0 2023-12-16T03:16:10.538 INFO:tasks.workunit.client.0.smithi064.stdout:1/779: creat d3/d36/d44/ff2 x:0 0 0 2023-12-16T03:16:10.539 INFO:tasks.workunit.client.0.smithi064.stdout:6/659: truncate d3/d8/d1f/f22 4337952 0 2023-12-16T03:16:10.540 INFO:tasks.workunit.client.0.smithi064.stdout:3/782: mknod db/d4f/daa/c101 0 2023-12-16T03:16:10.544 INFO:tasks.workunit.client.0.smithi064.stdout:4/747: mkdir d0/d42/d53/de8 0 2023-12-16T03:16:10.544 INFO:tasks.workunit.client.0.smithi064.stdout:4/748: fdatasync d0/f2e 0 2023-12-16T03:16:10.545 INFO:tasks.workunit.client.0.smithi064.stdout:4/749: read d0/d12/d48/fcb [220028,90692] 0 2023-12-16T03:16:10.545 INFO:tasks.workunit.client.0.smithi064.stdout:4/750: fsync d0/d42/d66/d5a/fcd 0 2023-12-16T03:16:10.545 INFO:tasks.workunit.client.0.smithi064.stdout:4/751: stat d0/da/da6/de4 0 2023-12-16T03:16:10.545 INFO:tasks.workunit.client.0.smithi064.stdout:6/660: mkdir d3/d9/dc0/dc4 0 2023-12-16T03:16:10.547 INFO:tasks.workunit.client.0.smithi064.stdout:3/783: symlink db/d12/d1a/l102 0 2023-12-16T03:16:10.548 INFO:tasks.workunit.client.0.smithi064.stdout:8/730: symlink d0/da/de9/d37/d3a/dab/dfa/d46/d54/d7c/lfb 0 2023-12-16T03:16:10.548 INFO:tasks.workunit.client.0.smithi064.stdout:8/731: stat d0/da/de9/f4f 0 2023-12-16T03:16:10.548 INFO:tasks.workunit.client.0.smithi064.stdout:3/784: read db/d4f/fb1 [2106196,34447] 0 2023-12-16T03:16:10.549 INFO:tasks.workunit.client.0.smithi064.stdout:3/785: write db/d4f/daa/fbc [415302,65459] 0 2023-12-16T03:16:10.549 INFO:tasks.workunit.client.0.smithi064.stdout:8/732: read d0/d1d/d24/d2f/d50/f87 [2710660,33085] 0 2023-12-16T03:16:10.549 INFO:tasks.workunit.client.0.smithi064.stdout:3/786: write db/d12/d1a/d2c/d34/d4c/d6a/da7/f25 [4280659,92932] 0 2023-12-16T03:16:10.550 INFO:tasks.workunit.client.0.smithi064.stdout:4/752: rename d0/da/l3d to d0/d42/d4c/d70/d8c/dc7/le9 0 2023-12-16T03:16:10.550 INFO:tasks.workunit.client.0.smithi064.stdout:4/753: write d0/f2 [14038623,46504] 0 2023-12-16T03:16:10.552 INFO:tasks.workunit.client.0.smithi064.stdout:8/733: creat d0/da/de9/d12/d44/d68/ffc x:0 0 0 2023-12-16T03:16:10.552 INFO:tasks.workunit.client.0.smithi064.stdout:8/734: readlink d0/da/de9/d37/d3a/dab/lcb 0 2023-12-16T03:16:10.552 INFO:tasks.workunit.client.0.smithi064.stdout:8/735: fdatasync d0/da/de9/d12/d44/fc8 0 2023-12-16T03:16:10.554 INFO:tasks.workunit.client.0.smithi064.stdout:8/736: rename d0/da/de9/ld5 to d0/da/de9/d5a/d97/d38/dda/lfd 0 2023-12-16T03:16:10.554 INFO:tasks.workunit.client.0.smithi064.stdout:8/737: rmdir d0/da/de9/d12/d44/d68/d6d 39 2023-12-16T03:16:10.556 INFO:tasks.workunit.client.0.smithi064.stdout:8/738: symlink d0/d1d/d24/d2f/lfe 0 2023-12-16T03:16:10.557 INFO:tasks.workunit.client.0.smithi064.stdout:8/739: getdents d0/da/de9/d37 0 2023-12-16T03:16:10.557 INFO:tasks.workunit.client.0.smithi064.stdout:0/654: sync 2023-12-16T03:16:10.557 INFO:tasks.workunit.client.0.smithi064.stdout:5/613: sync 2023-12-16T03:16:10.558 INFO:tasks.workunit.client.0.smithi064.stdout:8/740: write d0/d1d/d24/d2f/f39 [1163080,37695] 0 2023-12-16T03:16:10.558 INFO:tasks.workunit.client.0.smithi064.stdout:8/741: dread - d0/fe4 zero size 2023-12-16T03:16:10.559 INFO:tasks.workunit.client.0.smithi064.stdout:1/780: dwrite d3/dd/d11/d38/f77 [0,4194304] 0 2023-12-16T03:16:10.559 INFO:tasks.workunit.client.0.smithi064.stdout:0/655: getdents d2/d29/d66/db9 0 2023-12-16T03:16:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:10 smithi184 ceph-mon[121180]: [16/Dec/2023:03:16:08] ENGINE Bus STARTING 2023-12-16T03:16:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:10 smithi184 ceph-mon[121180]: [16/Dec/2023:03:16:08] ENGINE Serving on https://172.21.15.184:7150 2023-12-16T03:16:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:10 smithi184 ceph-mon[121180]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:10 smithi184 ceph-mon[121180]: [16/Dec/2023:03:16:08] ENGINE Serving on http://172.21.15.184:8765 2023-12-16T03:16:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:10 smithi184 ceph-mon[121180]: [16/Dec/2023:03:16:08] ENGINE Bus STARTED 2023-12-16T03:16:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:10 smithi184 ceph-mon[121180]: pgmap v4: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2023-12-16T03:16:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:10 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3160997960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:16:10.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:10 smithi184 ceph-mon[121180]: mgrmap e22: smithi184.urtxla(active, since 2s) 2023-12-16T03:16:10.561 INFO:tasks.workunit.client.0.smithi064.stdout:5/614: creat d0/d50/d39/daa/dc5/fd7 x:0 0 0 2023-12-16T03:16:10.561 INFO:tasks.workunit.client.0.smithi064.stdout:7/711: sync 2023-12-16T03:16:10.562 INFO:tasks.workunit.client.0.smithi064.stdout:4/754: write d0/f5 [2984476,120652] 0 2023-12-16T03:16:10.562 INFO:tasks.workunit.client.0.smithi064.stdout:4/755: write d0/d42/f72 [1482105,5954] 0 2023-12-16T03:16:10.563 INFO:tasks.workunit.client.0.smithi064.stdout:8/742: creat d0/da/de9/d37/d3a/dab/dfa/d46/d54/d7c/db7/fff x:0 0 0 2023-12-16T03:16:10.563 INFO:tasks.workunit.client.0.smithi064.stdout:1/781: rmdir d3/dd/d2a 39 2023-12-16T03:16:10.565 INFO:tasks.workunit.client.0.smithi064.stdout:1/782: write d3/d22/f2e [1802086,29644] 0 2023-12-16T03:16:10.565 INFO:tasks.workunit.client.0.smithi064.stdout:0/656: mknod d2/d7/d10/d85/d88/da0/cd7 0 2023-12-16T03:16:10.566 INFO:tasks.workunit.client.0.smithi064.stdout:0/657: stat d2/d7/d10/d21/c9b 0 2023-12-16T03:16:10.566 INFO:tasks.workunit.client.0.smithi064.stdout:0/658: chown d2/d7/d10/d21/d7a/fa8 31853448 1 2023-12-16T03:16:10.566 INFO:tasks.workunit.client.0.smithi064.stdout:5/615: write d0/fc3 [2042989,81594] 0 2023-12-16T03:16:10.568 INFO:tasks.workunit.client.0.smithi064.stdout:3/787: dwrite db/d12/d1a/d2c/d34/d4c/d6a/f6c [0,4194304] 0 2023-12-16T03:16:10.568 INFO:tasks.workunit.client.0.smithi064.stdout:3/788: chown db/f67 74278391 1 2023-12-16T03:16:10.568 INFO:tasks.workunit.client.0.smithi064.stdout:3/789: fsync db/d12/d4e/f73 0 2023-12-16T03:16:10.568 INFO:tasks.workunit.client.0.smithi064.stdout:7/712: getdents d7/d3e/d42/d43 0 2023-12-16T03:16:10.568 INFO:tasks.workunit.client.0.smithi064.stdout:7/713: fdatasync d7/d26/d30/f39 0 2023-12-16T03:16:10.568 INFO:tasks.workunit.client.0.smithi064.stdout:7/714: chown d7/d3e/d42/d89/d20/d37/db1 67598 1 2023-12-16T03:16:10.572 INFO:tasks.workunit.client.0.smithi064.stdout:8/743: creat d0/d1d/d24/f100 x:0 0 0 2023-12-16T03:16:10.575 INFO:tasks.workunit.client.0.smithi064.stdout:1/783: mkdir d3/dd/d11/d38/df3 0 2023-12-16T03:16:10.575 INFO:tasks.workunit.client.0.smithi064.stdout:1/784: read - d3/dd/d11/d2f/fef zero size 2023-12-16T03:16:10.576 INFO:tasks.workunit.client.0.smithi064.stdout:0/659: creat d2/d29/d66/db9/fd8 x:0 0 0 2023-12-16T03:16:10.579 INFO:tasks.workunit.client.0.smithi064.stdout:5/616: rename d0/d19/d48/d8f/dac/d23/l59 to d0/d7/d97/ld8 0 2023-12-16T03:16:10.583 INFO:tasks.workunit.client.0.smithi064.stdout:7/715: symlink d7/d3e/d42/d89/d20/d37/db1/dbf/le5 0 2023-12-16T03:16:10.584 INFO:tasks.workunit.client.0.smithi064.stdout:0/660: mkdir d2/d29/d66/d97/dd9 0 2023-12-16T03:16:10.586 INFO:tasks.workunit.client.0.smithi064.stdout:5/617: mknod d0/d19/d73/cd9 0 2023-12-16T03:16:10.587 INFO:tasks.workunit.client.0.smithi064.stdout:3/790: rmdir db/d12/d1a/d2c/d34 39 2023-12-16T03:16:10.588 INFO:tasks.workunit.client.0.smithi064.stdout:7/716: truncate d7/d3e/d42/d89/d20/f80 316593 0 2023-12-16T03:16:10.589 INFO:tasks.workunit.client.0.smithi064.stdout:0/661: link d2/d8/da/d11/d64/c71 d2/d29/d66/d97/dd5/cda 0 2023-12-16T03:16:10.590 INFO:tasks.workunit.client.0.smithi064.stdout:5/618: symlink d0/d19/d48/d8f/d5e/lda 0 2023-12-16T03:16:10.590 INFO:tasks.workunit.client.0.smithi064.stdout:3/791: symlink db/d12/d1a/d31/df7/l103 0 2023-12-16T03:16:10.591 INFO:tasks.workunit.client.0.smithi064.stdout:1/785: dread d3/f9c [0,4194304] 0 2023-12-16T03:16:10.591 INFO:tasks.workunit.client.0.smithi064.stdout:4/756: dwrite d0/d42/d66/d5a/fcd [0,4194304] 0 2023-12-16T03:16:10.591 INFO:tasks.workunit.client.0.smithi064.stdout:8/744: dwrite d0/d1d/d48/fcf [0,4194304] 0 2023-12-16T03:16:10.592 INFO:tasks.workunit.client.0.smithi064.stdout:7/717: rename d7/d3e/d42/d48/d51/lcc to d7/d3e/d42/d89/d20/d37/db1/dbf/le6 0 2023-12-16T03:16:10.593 INFO:tasks.workunit.client.0.smithi064.stdout:7/718: read d7/d3e/d42/f44 [3637279,4595] 0 2023-12-16T03:16:10.593 INFO:tasks.workunit.client.0.smithi064.stdout:0/662: mknod d2/d7/d10/d85/d88/cdb 0 2023-12-16T03:16:10.593 INFO:tasks.workunit.client.0.smithi064.stdout:0/663: fsync d2/d8/f45 0 2023-12-16T03:16:10.594 INFO:tasks.workunit.client.0.smithi064.stdout:5/619: truncate d0/d19/d48/d8f/d3e/d35/f54 1586974 0 2023-12-16T03:16:10.594 INFO:tasks.workunit.client.0.smithi064.stdout:3/792: creat db/d12/d1a/d2c/d34/d4c/de5/f104 x:0 0 0 2023-12-16T03:16:10.597 INFO:tasks.workunit.client.0.smithi064.stdout:1/786: symlink d3/d22/d57/lf4 0 2023-12-16T03:16:10.599 INFO:tasks.workunit.client.0.smithi064.stdout:4/757: symlink d0/d42/d4c/d70/d8c/da9/lea 0 2023-12-16T03:16:10.601 INFO:tasks.workunit.client.1.smithi184.stdout:5/918: sync 2023-12-16T03:16:10.601 INFO:tasks.workunit.client.1.smithi184.stdout:5/919: chown d1/d2a/d31/c1f 781 1 2023-12-16T03:16:10.604 INFO:tasks.workunit.client.0.smithi064.stdout:8/745: rename d0/f14 to d0/da/de9/d12/d44/d68/d6d/f101 0 2023-12-16T03:16:10.605 INFO:tasks.workunit.client.0.smithi064.stdout:7/719: symlink d7/d26/dc2/le7 0 2023-12-16T03:16:10.605 INFO:tasks.workunit.client.0.smithi064.stdout:7/720: readlink d7/d26/l40 0 2023-12-16T03:16:10.608 INFO:tasks.workunit.client.1.smithi184.stdout:5/920: truncate d1/d3/d9/de/d15/d19/d48/fa1 1836129 0 2023-12-16T03:16:10.609 INFO:tasks.workunit.client.0.smithi064.stdout:0/664: creat d2/d8/da/dbc/fdc x:0 0 0 2023-12-16T03:16:10.609 INFO:tasks.workunit.client.0.smithi064.stdout:0/665: dread - d2/d7/d10/f84 zero size 2023-12-16T03:16:10.611 INFO:tasks.workunit.client.0.smithi064.stdout:5/620: mknod d0/d19/d48/d92/cdb 0 2023-12-16T03:16:10.614 INFO:tasks.workunit.client.0.smithi064.stdout:1/787: creat d3/d36/d44/ff5 x:0 0 0 2023-12-16T03:16:10.615 INFO:tasks.workunit.client.1.smithi184.stdout:5/921: dread d1/d3/d9/de/d30/f8b [0,4194304] 0 2023-12-16T03:16:10.615 INFO:tasks.workunit.client.1.smithi184.stdout:5/922: chown d1/d2a/d31/d58 41994579 1 2023-12-16T03:16:10.617 INFO:tasks.workunit.client.0.smithi064.stdout:3/793: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/fda [4194304,4194304] 0 2023-12-16T03:16:10.617 INFO:tasks.workunit.client.0.smithi064.stdout:3/794: chown db/d12/d1a/d2c/d34/d4c/d6a/c100 0 1 2023-12-16T03:16:10.617 INFO:tasks.workunit.client.0.smithi064.stdout:3/795: chown db/d12/d1a/d31/cad 0 1 2023-12-16T03:16:10.619 INFO:tasks.workunit.client.0.smithi064.stdout:8/746: symlink d0/d1d/d24/d2f/d50/d70/dcc/l102 0 2023-12-16T03:16:10.622 INFO:tasks.workunit.client.1.smithi184.stdout:5/923: creat d1/d3/d9/de/d15/d19/dcc/f128 x:0 0 0 2023-12-16T03:16:10.622 INFO:tasks.workunit.client.1.smithi184.stdout:5/924: chown d1/d3/fd9 7 1 2023-12-16T03:16:10.622 INFO:tasks.workunit.client.1.smithi184.stdout:5/925: readlink d1/d3/d9/d49/ld1 0 2023-12-16T03:16:10.623 INFO:tasks.workunit.client.0.smithi064.stdout:4/758: dwrite d0/d42/d66/d5a/fcd [0,4194304] 0 2023-12-16T03:16:10.627 INFO:tasks.workunit.client.1.smithi184.stdout:5/926: mknod d1/d3/d105/dd4/c129 0 2023-12-16T03:16:10.628 INFO:tasks.workunit.client.0.smithi064.stdout:4/759: read d0/da/da6/fb5 [3197981,92350] 0 2023-12-16T03:16:10.628 INFO:tasks.workunit.client.0.smithi064.stdout:4/760: dread - d0/d42/d4c/d70/d8c/fc5 zero size 2023-12-16T03:16:10.628 INFO:tasks.workunit.client.0.smithi064.stdout:4/761: chown d0/d42/d56/f7c 85988 1 2023-12-16T03:16:10.631 INFO:tasks.workunit.client.0.smithi064.stdout:3/796: creat db/d4f/d51/dd1/dd3/f105 x:0 0 0 2023-12-16T03:16:10.639 INFO:tasks.workunit.client.0.smithi064.stdout:8/747: dwrite d0/da/de9/f62 [0,4194304] 0 2023-12-16T03:16:10.641 INFO:tasks.workunit.client.0.smithi064.stdout:1/788: dwrite d3/dd/d11/d2f/fef [0,4194304] 0 2023-12-16T03:16:10.642 INFO:tasks.workunit.client.0.smithi064.stdout:0/666: dread d2/d7/d10/d21/d7a/fa8 [0,4194304] 0 2023-12-16T03:16:10.642 INFO:tasks.workunit.client.0.smithi064.stdout:0/667: stat d2/d7/d10/d85/d88/d92/fb7 0 2023-12-16T03:16:10.642 INFO:tasks.workunit.client.0.smithi064.stdout:0/668: getdents d2/d29/db1/db2 0 2023-12-16T03:16:10.643 INFO:tasks.workunit.client.0.smithi064.stdout:8/748: mkdir d0/d1d/d103 0 2023-12-16T03:16:10.647 INFO:tasks.workunit.client.0.smithi064.stdout:0/669: creat d2/d29/fdd x:0 0 0 2023-12-16T03:16:10.648 INFO:tasks.workunit.client.0.smithi064.stdout:8/749: mknod d0/d1d/d24/d9c/de5/c104 0 2023-12-16T03:16:10.648 INFO:tasks.workunit.client.0.smithi064.stdout:8/750: readlink d0/da/de9/d5a/d97/l33 0 2023-12-16T03:16:10.649 INFO:tasks.workunit.client.0.smithi064.stdout:0/670: creat d2/d8/da/df/daf/dbd/fde x:0 0 0 2023-12-16T03:16:10.651 INFO:tasks.workunit.client.0.smithi064.stdout:8/751: mknod d0/d1d/d24/d2f/c105 0 2023-12-16T03:16:10.651 INFO:tasks.workunit.client.0.smithi064.stdout:8/752: chown d0/da/de9/d37/d3a/dab/dfa/d46/d54/d8c/l9e 0 1 2023-12-16T03:16:10.652 INFO:tasks.workunit.client.0.smithi064.stdout:0/671: mknod d2/d5b/d8b/cdf 0 2023-12-16T03:16:10.653 INFO:tasks.workunit.client.0.smithi064.stdout:1/789: read d3/dd/d11/f56 [153236,127255] 0 2023-12-16T03:16:10.653 INFO:tasks.workunit.client.0.smithi064.stdout:8/753: mkdir d0/da/de9/d12/d44/d68/d106 0 2023-12-16T03:16:10.654 INFO:tasks.workunit.client.0.smithi064.stdout:0/672: symlink d2/le0 0 2023-12-16T03:16:10.655 INFO:tasks.workunit.client.0.smithi064.stdout:1/790: write d3/d36/d44/d4d/dad/dc5/feb [1938475,74157] 0 2023-12-16T03:16:10.655 INFO:tasks.workunit.client.0.smithi064.stdout:1/791: truncate d3/d36/d9e/f53 1952139 0 2023-12-16T03:16:10.655 INFO:tasks.workunit.client.0.smithi064.stdout:3/797: dwrite db/d12/d4e/fea [0,4194304] 0 2023-12-16T03:16:10.656 INFO:tasks.workunit.client.1.smithi184.stdout:5/927: dwrite d1/d3/d9/de/d15/d19/d5f/f41 [0,4194304] 0 2023-12-16T03:16:10.656 INFO:tasks.workunit.client.1.smithi184.stdout:5/928: chown d1/d3/d9/de/d15/d27/dd2/df0/f125 45491 1 2023-12-16T03:16:10.657 INFO:tasks.workunit.client.1.smithi184.stdout:5/929: symlink d1/d3/d9/de/l12a 0 2023-12-16T03:16:10.657 INFO:tasks.workunit.client.1.smithi184.stdout:5/930: stat d1/d3/d9/de/d15/d19 0 2023-12-16T03:16:10.659 INFO:tasks.workunit.client.0.smithi064.stdout:3/798: creat db/d12/d1a/d31/f106 x:0 0 0 2023-12-16T03:16:10.660 INFO:tasks.workunit.client.0.smithi064.stdout:0/673: dread d2/d7/f2b [0,4194304] 0 2023-12-16T03:16:10.660 INFO:tasks.workunit.client.0.smithi064.stdout:0/674: fsync d2/d5b/f81 0 2023-12-16T03:16:10.661 INFO:tasks.workunit.client.1.smithi184.stdout:5/931: mkdir d1/d3/d105/d12b 0 2023-12-16T03:16:10.664 INFO:tasks.workunit.client.0.smithi064.stdout:0/675: mknod d2/d7/d10/dc4/dcc/db5/ce1 0 2023-12-16T03:16:10.671 INFO:tasks.workunit.client.0.smithi064.stdout:8/754: write d0/d1d/d3c/d42/f5d [3311878,65052] 0 2023-12-16T03:16:10.671 INFO:tasks.workunit.client.0.smithi064.stdout:8/755: chown d0/d1d/d3c/d42/fdd 1514 1 2023-12-16T03:16:10.673 INFO:tasks.workunit.client.1.smithi184.stdout:5/932: creat d1/d3/d105/f12c x:0 0 0 2023-12-16T03:16:10.674 INFO:tasks.workunit.client.1.smithi184.stdout:5/933: fsync d1/d3/d9/de/d15/d19/d48/fe6 0 2023-12-16T03:16:10.674 INFO:tasks.workunit.client.1.smithi184.stdout:5/934: dread - d1/d3/d9/de/d15/d19/d5f/f10e zero size 2023-12-16T03:16:10.674 INFO:tasks.workunit.client.1.smithi184.stdout:5/935: fdatasync d1/d3/d9/f50 0 2023-12-16T03:16:10.674 INFO:tasks.workunit.client.1.smithi184.stdout:5/936: fsync d1/d3/d9/de/d30/fab 0 2023-12-16T03:16:10.674 INFO:tasks.workunit.client.1.smithi184.stdout:5/937: chown d1/d3/d9/de/d15/d19/dcc 29345087 1 2023-12-16T03:16:10.674 INFO:tasks.workunit.client.1.smithi184.stdout:5/938: fdatasync d1/d3/d9/de/d15/d90/fa3 0 2023-12-16T03:16:10.674 INFO:tasks.workunit.client.1.smithi184.stdout:5/939: truncate d1/d3/d9/de/d30/f121 304013 0 2023-12-16T03:16:10.674 INFO:tasks.workunit.client.0.smithi064.stdout:8/756: unlink d0/f27 0 2023-12-16T03:16:10.676 INFO:tasks.workunit.client.0.smithi064.stdout:8/757: truncate d0/da/de9/d5a/d97/f6e 1122618 0 2023-12-16T03:16:10.687 INFO:tasks.workunit.client.1.smithi184.stdout:5/940: dread d1/d3/d9/f50 [0,4194304] 0 2023-12-16T03:16:10.688 INFO:tasks.workunit.client.1.smithi184.stdout:5/941: creat d1/d3/d9/de/d15/d27/dd2/df0/f12d x:0 0 0 2023-12-16T03:16:10.694 INFO:tasks.workunit.client.0.smithi064.stdout:1/792: dwrite d3/f26 [0,4194304] 0 2023-12-16T03:16:10.695 INFO:tasks.workunit.client.0.smithi064.stdout:1/793: mknod d3/d36/d44/d4d/dad/dc5/cf6 0 2023-12-16T03:16:10.695 INFO:tasks.workunit.client.0.smithi064.stdout:1/794: readlink d3/d36/d9e/l71 0 2023-12-16T03:16:10.696 INFO:tasks.workunit.client.1.smithi184.stdout:5/942: creat d1/d3/d9/de/d15/d19/d53/dad/f12e x:0 0 0 2023-12-16T03:16:10.696 INFO:tasks.workunit.client.0.smithi064.stdout:1/795: read d3/f26 [483151,64896] 0 2023-12-16T03:16:10.697 INFO:tasks.workunit.client.0.smithi064.stdout:3/799: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/fda [0,4194304] 0 2023-12-16T03:16:10.698 INFO:tasks.workunit.client.0.smithi064.stdout:1/796: mknod d3/d36/cf7 0 2023-12-16T03:16:10.698 INFO:tasks.workunit.client.0.smithi064.stdout:4/762: dwrite d0/d1e/d36/f4d [0,4194304] 0 2023-12-16T03:16:10.698 INFO:tasks.workunit.client.0.smithi064.stdout:0/676: dwrite d2/d7/d10/d21/f39 [0,4194304] 0 2023-12-16T03:16:10.698 INFO:tasks.workunit.client.0.smithi064.stdout:8/758: dwrite d0/d1d/d3c/f7d [0,4194304] 0 2023-12-16T03:16:10.699 INFO:tasks.workunit.client.0.smithi064.stdout:3/800: write db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/fa1 [2572164,22116] 0 2023-12-16T03:16:10.700 INFO:tasks.workunit.client.0.smithi064.stdout:1/797: rename d3/dd/d11/d2f/f4c to d3/dd/d11/d6a/ff8 0 2023-12-16T03:16:10.700 INFO:tasks.workunit.client.0.smithi064.stdout:1/798: write d3/dd/d11/fa5 [669769,51011] 0 2023-12-16T03:16:10.704 INFO:tasks.workunit.client.0.smithi064.stdout:3/801: dread db/d12/d1a/f28 [0,4194304] 0 2023-12-16T03:16:10.706 INFO:tasks.workunit.client.0.smithi064.stdout:4/763: creat d0/feb x:0 0 0 2023-12-16T03:16:10.709 INFO:tasks.workunit.client.0.smithi064.stdout:0/677: mknod d2/d7/d10/d21/d31/ce2 0 2023-12-16T03:16:10.712 INFO:tasks.workunit.client.0.smithi064.stdout:3/802: mkdir db/d12/d1a/d2c/d34/d4c/d6a/da7/d107 0 2023-12-16T03:16:10.713 INFO:tasks.workunit.client.0.smithi064.stdout:4/764: truncate d0/d42/f63 363304 0 2023-12-16T03:16:10.713 INFO:tasks.workunit.client.0.smithi064.stdout:4/765: chown d0/d42/d4c/cb1 18 1 2023-12-16T03:16:10.714 INFO:tasks.workunit.client.0.smithi064.stdout:3/803: creat db/d12/d1a/d2c/d34/dcd/f108 x:0 0 0 2023-12-16T03:16:10.714 INFO:tasks.workunit.client.0.smithi064.stdout:3/804: chown db/d4f/da9/dbf/dfc/ccc 482963264 1 2023-12-16T03:16:10.716 INFO:tasks.workunit.client.0.smithi064.stdout:3/805: mkdir db/d12/d1a/d31/d109 0 2023-12-16T03:16:10.716 INFO:tasks.workunit.client.0.smithi064.stdout:3/806: chown db/d4f/da9/dbf/dcf 18111 1 2023-12-16T03:16:10.716 INFO:tasks.workunit.client.0.smithi064.stdout:3/807: chown db/d12/d1a/d2c/d34/d4c/d6a/lb8 8 1 2023-12-16T03:16:10.716 INFO:tasks.workunit.client.1.smithi184.stdout:2/981: sync 2023-12-16T03:16:10.719 INFO:tasks.workunit.client.1.smithi184.stdout:5/943: dwrite d1/d2a/d31/d28/f65 [0,4194304] 0 2023-12-16T03:16:10.721 INFO:tasks.workunit.client.1.smithi184.stdout:2/982: link d3/d9/lbb d3/d29/d61/l147 0 2023-12-16T03:16:10.724 INFO:tasks.workunit.client.1.smithi184.stdout:5/944: rmdir d1/d3/d9/de/d15/d27 39 2023-12-16T03:16:10.725 INFO:tasks.workunit.client.1.smithi184.stdout:2/983: truncate d3/d13/feb 3109794 0 2023-12-16T03:16:10.726 INFO:tasks.workunit.client.0.smithi064.stdout:0/678: dread d2/f5 [0,4194304] 0 2023-12-16T03:16:10.727 INFO:tasks.workunit.client.1.smithi184.stdout:5/945: creat d1/d3/d9/de/d15/d19/f12f x:0 0 0 2023-12-16T03:16:10.727 INFO:tasks.workunit.client.1.smithi184.stdout:5/946: getdents d1 0 2023-12-16T03:16:10.728 INFO:tasks.workunit.client.1.smithi184.stdout:2/984: unlink d3/d29/d2f/d2e/f5d 0 2023-12-16T03:16:10.729 INFO:tasks.workunit.client.0.smithi064.stdout:0/679: mknod d2/d5b/d8b/ce3 0 2023-12-16T03:16:10.729 INFO:tasks.workunit.client.0.smithi064.stdout:0/680: truncate d2/d29/fdd 883920 0 2023-12-16T03:16:10.730 INFO:tasks.workunit.client.1.smithi184.stdout:5/947: mknod d1/dbb/c130 0 2023-12-16T03:16:10.730 INFO:tasks.workunit.client.1.smithi184.stdout:5/948: chown d1/d2a/d31/l11f 249 1 2023-12-16T03:16:10.731 INFO:tasks.workunit.client.0.smithi064.stdout:0/681: rmdir d2/d29/d66/d97/dd5 39 2023-12-16T03:16:10.731 INFO:tasks.workunit.client.0.smithi064.stdout:0/682: stat d2/d7/l53 0 2023-12-16T03:16:10.731 INFO:tasks.workunit.client.0.smithi064.stdout:0/683: chown d2/d8/da/d11/d64/c71 21 1 2023-12-16T03:16:10.731 INFO:tasks.workunit.client.1.smithi184.stdout:5/949: mkdir d1/d3/d9/de/d131 0 2023-12-16T03:16:10.732 INFO:tasks.workunit.client.0.smithi064.stdout:0/684: mknod d2/ce4 0 2023-12-16T03:16:10.733 INFO:tasks.workunit.client.0.smithi064.stdout:8/759: dwrite d0/d1d/d24/f36 [4194304,4194304] 0 2023-12-16T03:16:10.733 INFO:tasks.workunit.client.0.smithi064.stdout:1/799: dwrite d3/dd/de4/fed [0,4194304] 0 2023-12-16T03:16:10.733 INFO:tasks.workunit.client.0.smithi064.stdout:0/685: mkdir d2/d29/d66/de5 0 2023-12-16T03:16:10.744 INFO:tasks.workunit.client.0.smithi064.stdout:8/760: rename d0/da/de9/d37/d3a/dab/dfa/d46/d9d/da2 to d0/da/de9/d12/d1c/d59/d107 0 2023-12-16T03:16:10.746 INFO:tasks.workunit.client.0.smithi064.stdout:0/686: creat d2/d29/d66/fe6 x:0 0 0 2023-12-16T03:16:10.747 INFO:tasks.workunit.client.0.smithi064.stdout:1/800: rename d3/d22/l46 to d3/dd/d23/lf9 0 2023-12-16T03:16:10.748 INFO:tasks.workunit.client.0.smithi064.stdout:8/761: mkdir d0/da/de9/d5a/dec/d108 0 2023-12-16T03:16:10.749 INFO:tasks.workunit.client.0.smithi064.stdout:0/687: mkdir d2/d29/de7 0 2023-12-16T03:16:10.752 INFO:tasks.workunit.client.0.smithi064.stdout:1/801: mknod d3/d36/d9e/cfa 0 2023-12-16T03:16:10.755 INFO:tasks.workunit.client.0.smithi064.stdout:3/808: truncate db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/fa1 1495445 0 2023-12-16T03:16:10.757 INFO:tasks.workunit.client.1.smithi184.stdout:2/985: dwrite d3/d13/d28/f117 [4194304,4194304] 0 2023-12-16T03:16:10.758 INFO:tasks.workunit.client.0.smithi064.stdout:0/688: truncate d2/d5b/f9c 3636675 0 2023-12-16T03:16:10.758 INFO:tasks.workunit.client.0.smithi064.stdout:0/689: chown d2/d7/d10/d21/d31/fca 64088591 1 2023-12-16T03:16:10.758 INFO:tasks.workunit.client.1.smithi184.stdout:5/950: dwrite d1/d3/fd [0,4194304] 0 2023-12-16T03:16:10.758 INFO:tasks.workunit.client.1.smithi184.stdout:5/951: dread - d1/d3/d9/de/d15/d19/dcc/f128 zero size 2023-12-16T03:16:10.758 INFO:tasks.workunit.client.0.smithi064.stdout:1/802: symlink d3/dd/de4/lfb 0 2023-12-16T03:16:10.762 INFO:tasks.workunit.client.1.smithi184.stdout:2/986: creat d3/d29/d4d/f148 x:0 0 0 2023-12-16T03:16:10.762 INFO:tasks.workunit.client.1.smithi184.stdout:2/987: dread - d3/d13/d28/d83/d143/f145 zero size 2023-12-16T03:16:10.762 INFO:tasks.workunit.client.1.smithi184.stdout:5/952: symlink d1/d2a/d31/d58/daf/l132 0 2023-12-16T03:16:10.762 INFO:tasks.workunit.client.1.smithi184.stdout:5/953: write d1/d3/fd9 [1391929,88548] 0 2023-12-16T03:16:10.764 INFO:tasks.workunit.client.1.smithi184.stdout:2/988: rmdir d3/d29/d2f/d2e/dcb/d134 39 2023-12-16T03:16:10.765 INFO:tasks.workunit.client.0.smithi064.stdout:8/762: dwrite d0/da/de9/d12/d1c/f72 [0,4194304] 0 2023-12-16T03:16:10.766 INFO:tasks.workunit.client.1.smithi184.stdout:5/954: symlink d1/d3/d9/l133 0 2023-12-16T03:16:10.768 INFO:tasks.workunit.client.0.smithi064.stdout:8/763: mkdir d0/d1d/d73/dd9/d109 0 2023-12-16T03:16:10.770 INFO:tasks.workunit.client.0.smithi064.stdout:8/764: symlink d0/d1d/d24/d2f/d50/d70/da4/l10a 0 2023-12-16T03:16:10.800 INFO:tasks.workunit.client.0.smithi064.stdout:3/809: dwrite db/d12/d1a/f54 [0,4194304] 0 2023-12-16T03:16:10.800 INFO:tasks.workunit.client.0.smithi064.stdout:0/690: dwrite d2/d29/fdd [0,4194304] 0 2023-12-16T03:16:10.801 INFO:tasks.workunit.client.1.smithi184.stdout:5/955: dwrite d1/d3/d9/d49/f95 [0,4194304] 0 2023-12-16T03:16:10.801 INFO:tasks.workunit.client.0.smithi064.stdout:8/765: dwrite d0/da/de9/f66 [4194304,4194304] 0 2023-12-16T03:16:10.804 INFO:tasks.workunit.client.1.smithi184.stdout:5/956: getdents d1/dbb 0 2023-12-16T03:16:10.805 INFO:tasks.workunit.client.0.smithi064.stdout:8/766: truncate d0/d1d/d24/d2f/d50/d70/dcc/fe8 63506 0 2023-12-16T03:16:10.805 INFO:tasks.workunit.client.1.smithi184.stdout:5/957: dread d1/d2a/d31/d58/daf/f8a [0,4194304] 0 2023-12-16T03:16:10.806 INFO:tasks.workunit.client.0.smithi064.stdout:8/767: write d0/d1d/d3c/f8e [1513862,41326] 0 2023-12-16T03:16:10.808 INFO:tasks.workunit.client.0.smithi064.stdout:8/768: write d0/da/de9/d37/d3a/dab/dfa/d46/d8f/f8a [1167175,6211] 0 2023-12-16T03:16:10.810 INFO:tasks.workunit.client.1.smithi184.stdout:5/958: creat d1/d3/d9/de/d15/d19/f134 x:0 0 0 2023-12-16T03:16:10.810 INFO:tasks.workunit.client.1.smithi184.stdout:5/959: write d1/d3/d9/de/d15/d19/d5f/f10e [967567,43808] 0 2023-12-16T03:16:10.812 INFO:tasks.workunit.client.0.smithi064.stdout:8/769: truncate d0/da/f30 3527519 0 2023-12-16T03:16:10.812 INFO:tasks.workunit.client.0.smithi064.stdout:8/770: write d0/da/de9/d5a/d97/d38/fd2 [842164,7058] 0 2023-12-16T03:16:10.812 INFO:tasks.workunit.client.0.smithi064.stdout:8/771: fdatasync d0/d1d/d3c/d42/f5d 0 2023-12-16T03:16:10.814 INFO:tasks.workunit.client.1.smithi184.stdout:5/960: mkdir d1/d3/d9/de/d30/d135 0 2023-12-16T03:16:10.815 INFO:tasks.workunit.client.0.smithi064.stdout:0/691: dread d2/d29/fdd [0,4194304] 0 2023-12-16T03:16:10.815 INFO:tasks.workunit.client.0.smithi064.stdout:8/772: symlink d0/da/de9/d37/d3a/d95/l10b 0 2023-12-16T03:16:10.815 INFO:tasks.workunit.client.0.smithi064.stdout:8/773: read d0/da/de9/d12/d44/f8b [194343,121118] 0 2023-12-16T03:16:10.815 INFO:tasks.workunit.client.0.smithi064.stdout:8/774: truncate d0/da/de9/d12/d44/f8b 975170 0 2023-12-16T03:16:10.816 INFO:tasks.workunit.client.0.smithi064.stdout:8/775: read - d0/da/de9/d37/d3a/dab/dfa/d46/f81 zero size 2023-12-16T03:16:10.817 INFO:tasks.workunit.client.1.smithi184.stdout:5/961: unlink d1/d3/d2f/db5/fba 0 2023-12-16T03:16:10.818 INFO:tasks.workunit.client.0.smithi064.stdout:0/692: link d2/d7/f2b d2/d29/d66/db9/fe8 0 2023-12-16T03:16:10.820 INFO:tasks.workunit.client.1.smithi184.stdout:5/962: mknod d1/d3/d9/de/d15/d19/d3a/c136 0 2023-12-16T03:16:10.820 INFO:tasks.workunit.client.1.smithi184.stdout:5/963: rename d1/d3/d9/de/d15 to d1/d3/d9/de/d15/d27/dd2/df0/d137 22 2023-12-16T03:16:10.820 INFO:tasks.workunit.client.1.smithi184.stdout:5/964: fsync d1/d3/d9/de/d15/d19/dcc/f128 0 2023-12-16T03:16:10.823 INFO:tasks.workunit.client.0.smithi064.stdout:0/693: rename d2/d7/d10/d85/d88/d92 to d2/d29/de9 0 2023-12-16T03:16:10.823 INFO:tasks.workunit.client.0.smithi064.stdout:0/694: write d2/d7/d10/d21/d7a/f9d [2068,98597] 0 2023-12-16T03:16:10.835 INFO:tasks.workunit.client.0.smithi064.stdout:8/776: dwrite d0/fb6 [0,4194304] 0 2023-12-16T03:16:10.839 INFO:tasks.workunit.client.0.smithi064.stdout:8/777: unlink d0/d1d/c2e 0 2023-12-16T03:16:10.839 INFO:tasks.workunit.client.0.smithi064.stdout:8/778: chown d0/d1d/d3c/d42/d93/fe0 4 1 2023-12-16T03:16:10.855 INFO:tasks.workunit.client.0.smithi064.stdout:8/779: dread d0/d1d/d3c/d42/f5d [0,4194304] 0 2023-12-16T03:16:10.858 INFO:tasks.workunit.client.0.smithi064.stdout:8/780: mkdir d0/da/de9/d5a/d10c 0 2023-12-16T03:16:10.860 INFO:tasks.workunit.client.0.smithi064.stdout:8/781: write d0/da/de9/d12/d1c/f1f [356290,262] 0 2023-12-16T03:16:10.873 INFO:tasks.workunit.client.0.smithi064.stdout:8/782: rename d0/da/de9/d5a/d97 to d0/da/de9/d37/d10d 0 2023-12-16T03:16:10.873 INFO:tasks.workunit.client.0.smithi064.stdout:8/783: read d0/da/de9/d37/d3a/f57 [1764332,125656] 0 2023-12-16T03:16:10.875 INFO:tasks.workunit.client.0.smithi064.stdout:9/681: sync 2023-12-16T03:16:10.875 INFO:tasks.workunit.client.0.smithi064.stdout:2/614: sync 2023-12-16T03:16:10.878 INFO:tasks.workunit.client.0.smithi064.stdout:2/615: rmdir d1/db3 39 2023-12-16T03:16:10.878 INFO:tasks.workunit.client.0.smithi064.stdout:9/682: mkdir d2/dc/d24/d39/d77/d7d/de0 0 2023-12-16T03:16:10.878 INFO:tasks.workunit.client.0.smithi064.stdout:2/616: write d1/d15/d1b/d49/fb1 [922785,50520] 0 2023-12-16T03:16:10.881 INFO:tasks.workunit.client.0.smithi064.stdout:2/617: mkdir d1/d15/d1b/dc3 0 2023-12-16T03:16:10.889 INFO:tasks.workunit.client.0.smithi064.stdout:8/784: dread d0/f7 [0,4194304] 0 2023-12-16T03:16:10.892 INFO:tasks.workunit.client.0.smithi064.stdout:9/683: dread d2/d2d/d3b/d3c/d4b/f58 [0,4194304] 0 2023-12-16T03:16:10.902 INFO:tasks.workunit.client.0.smithi064.stdout:2/618: dwrite d1/d15/d1b/d49/da0/f52 [0,4194304] 0 2023-12-16T03:16:10.902 INFO:tasks.workunit.client.0.smithi064.stdout:2/619: truncate d1/d15/d7d/dac/f84 5665321 0 2023-12-16T03:16:10.910 INFO:tasks.workunit.client.0.smithi064.stdout:9/684: dwrite d2/d2d/d3b/d3c/d34/f9f [0,4194304] 0 2023-12-16T03:16:10.914 INFO:tasks.workunit.client.1.smithi184.stdout:2/989: sync 2023-12-16T03:16:10.914 INFO:tasks.workunit.client.1.smithi184.stdout:2/990: fdatasync d3/d9/faa 0 2023-12-16T03:16:10.915 INFO:tasks.workunit.client.0.smithi064.stdout:9/685: link d2/dc/d24/d39/d42/d57/lae d2/d2d/le1 0 2023-12-16T03:16:10.915 INFO:tasks.workunit.client.0.smithi064.stdout:9/686: read - d2/dc/d24/d39/d42/f48 zero size 2023-12-16T03:16:10.915 INFO:tasks.workunit.client.0.smithi064.stdout:9/687: write d2/dc/d24/d39/d77/d7d/db9/fd8 [489783,37946] 0 2023-12-16T03:16:10.916 INFO:tasks.workunit.client.0.smithi064.stdout:9/688: rmdir d2/dc/d24/d39/d42 39 2023-12-16T03:16:10.916 INFO:tasks.workunit.client.0.smithi064.stdout:2/620: dread d1/d15/d1b/d9c/d68/f3f [0,4194304] 0 2023-12-16T03:16:10.916 INFO:tasks.workunit.client.0.smithi064.stdout:2/621: chown d1/d15/d23/f7a 1012 1 2023-12-16T03:16:10.917 INFO:tasks.workunit.client.0.smithi064.stdout:9/689: mkdir d2/d2d/d3b/d3c/d34/dce/de2 0 2023-12-16T03:16:10.917 INFO:tasks.workunit.client.0.smithi064.stdout:2/622: dread d1/d15/d7d/fbe [0,4194304] 0 2023-12-16T03:16:10.919 INFO:tasks.workunit.client.0.smithi064.stdout:9/690: creat d2/d2d/daf/fe3 x:0 0 0 2023-12-16T03:16:10.923 INFO:tasks.workunit.client.0.smithi064.stdout:2/623: rmdir d1/d15 39 2023-12-16T03:16:10.925 INFO:tasks.workunit.client.0.smithi064.stdout:2/624: link d1/d15/d1b/d9c/fbf d1/d15/d23/d2d/fc4 0 2023-12-16T03:16:10.926 INFO:tasks.workunit.client.1.smithi184.stdout:2/991: dread d3/d9/f8c [0,4194304] 0 2023-12-16T03:16:10.926 INFO:tasks.workunit.client.1.smithi184.stdout:2/992: readlink d3/d9/l73 0 2023-12-16T03:16:10.926 INFO:tasks.workunit.client.1.smithi184.stdout:2/993: write d3/f76 [611943,83185] 0 2023-12-16T03:16:10.926 INFO:tasks.workunit.client.0.smithi064.stdout:2/625: mkdir d1/db3/dc5 0 2023-12-16T03:16:10.928 INFO:tasks.workunit.client.1.smithi184.stdout:2/994: unlink d3/d29/d2f/l42 0 2023-12-16T03:16:10.929 INFO:tasks.workunit.client.0.smithi064.stdout:2/626: mkdir d1/d15/d7d/dc6 0 2023-12-16T03:16:10.930 INFO:tasks.workunit.client.0.smithi064.stdout:2/627: mknod d1/d15/d7d/dc6/cc7 0 2023-12-16T03:16:10.932 INFO:tasks.workunit.client.0.smithi064.stdout:2/628: symlink d1/d15/d23/d2d/da6/lc8 0 2023-12-16T03:16:10.942 INFO:tasks.workunit.client.0.smithi064.stdout:9/691: dwrite d2/dc/d24/d39/d5e/d6f/f70 [0,4194304] 0 2023-12-16T03:16:10.943 INFO:tasks.workunit.client.0.smithi064.stdout:9/692: write d2/d2d/d6c/f89 [1363063,87837] 0 2023-12-16T03:16:10.952 INFO:tasks.workunit.client.1.smithi184.stdout:2/995: dwrite d3/d9/f136 [0,4194304] 0 2023-12-16T03:16:10.955 INFO:tasks.workunit.client.0.smithi064.stdout:9/693: dread d2/dc/d24/d39/d5e/f8f [0,4194304] 0 2023-12-16T03:16:10.957 INFO:tasks.workunit.client.0.smithi064.stdout:9/694: creat d2/dc/d24/da9/fe4 x:0 0 0 2023-12-16T03:16:10.960 INFO:tasks.workunit.client.0.smithi064.stdout:9/695: rename d2/dc/d24/da9/cac to d2/dc/d24/d39/d5e/d6f/ce5 0 2023-12-16T03:16:10.964 INFO:tasks.workunit.client.1.smithi184.stdout:5/965: sync 2023-12-16T03:16:10.965 INFO:tasks.workunit.client.1.smithi184.stdout:5/966: rmdir d1/d3 39 2023-12-16T03:16:10.965 INFO:tasks.workunit.client.1.smithi184.stdout:5/967: truncate d1/d2a/d31/f54 2866317 0 2023-12-16T03:16:10.965 INFO:tasks.workunit.client.1.smithi184.stdout:5/968: truncate d1/d3/d9/de/d15/d90/f104 645477 0 2023-12-16T03:16:10.965 INFO:tasks.workunit.client.1.smithi184.stdout:5/969: symlink d1/d2a/d31/d58/daf/d112/l138 0 2023-12-16T03:16:10.965 INFO:tasks.workunit.client.1.smithi184.stdout:5/970: fdatasync d1/d3/d9/de/d30/d68/f10b 0 2023-12-16T03:16:10.966 INFO:tasks.workunit.client.1.smithi184.stdout:5/971: chown d1/d3/d9/de/da5/ffe 18 1 2023-12-16T03:16:10.966 INFO:tasks.workunit.client.1.smithi184.stdout:5/972: mknod d1/d3/d9/de/d15/d19/d5f/c139 0 2023-12-16T03:16:10.966 INFO:tasks.workunit.client.1.smithi184.stdout:5/973: stat d1/d3/fd 0 2023-12-16T03:16:10.968 INFO:tasks.workunit.client.1.smithi184.stdout:5/974: mknod d1/d3/d9/de/d10f/c13a 0 2023-12-16T03:16:10.968 INFO:tasks.workunit.client.1.smithi184.stdout:2/996: dwrite d3/d13/d28/d83/ffc [0,4194304] 0 2023-12-16T03:16:10.971 INFO:tasks.workunit.client.1.smithi184.stdout:5/975: symlink d1/d2a/d31/d28/d72/d126/l13b 0 2023-12-16T03:16:10.973 INFO:tasks.workunit.client.1.smithi184.stdout:2/997: link d3/d9/f136 d3/d29/d2f/d2e/f149 0 2023-12-16T03:16:10.973 INFO:tasks.workunit.client.1.smithi184.stdout:5/976: dread d1/d2a/d31/d28/f124 [0,4194304] 0 2023-12-16T03:16:10.982 INFO:tasks.workunit.client.1.smithi184.stdout:5/977: mkdir d1/d3/d9/de/d30/d13c 0 2023-12-16T03:16:10.984 INFO:tasks.workunit.client.1.smithi184.stdout:5/978: rename d1/d3/d9/de/d15/d19/d5f/f41 to d1/d3/dc6/f13d 0 2023-12-16T03:16:10.984 INFO:tasks.workunit.client.1.smithi184.stdout:5/979: dread - d1/d3/d9/de/f11a zero size 2023-12-16T03:16:10.984 INFO:tasks.workunit.client.1.smithi184.stdout:5/980: write d1/d3/d9/de/da5/f101 [259677,24611] 0 2023-12-16T03:16:10.985 INFO:tasks.workunit.client.0.smithi064.stdout:9/696: dwrite d2/d2d/d3b/d3c/d34/fcf [0,4194304] 0 2023-12-16T03:16:10.986 INFO:tasks.workunit.client.1.smithi184.stdout:5/981: dread d1/d3/d9/d49/d74/f75 [0,4194304] 0 2023-12-16T03:16:10.986 INFO:tasks.workunit.client.1.smithi184.stdout:5/982: stat d1/d3/d9/de/d15 0 2023-12-16T03:16:10.987 INFO:tasks.workunit.client.0.smithi064.stdout:9/697: creat d2/d2d/d3b/d3c/d4b/fe6 x:0 0 0 2023-12-16T03:16:10.988 INFO:tasks.workunit.client.1.smithi184.stdout:5/983: symlink d1/d3/d9/de/d15/d27/ddd/l13e 0 2023-12-16T03:16:10.988 INFO:tasks.workunit.client.1.smithi184.stdout:2/998: dwrite d3/d29/d2f/d46/d77/f7f [0,4194304] 0 2023-12-16T03:16:10.988 INFO:tasks.workunit.client.1.smithi184.stdout:2/999: fsync d3/d29/d4d/d123/f139 0 2023-12-16T03:16:10.989 INFO:tasks.workunit.client.0.smithi064.stdout:9/698: creat d2/dc/d24/d39/d42/d9a/d8b/fe7 x:0 0 0 2023-12-16T03:16:10.989 INFO:tasks.workunit.client.0.smithi064.stdout:9/699: dread - d2/d7e/fa2 zero size 2023-12-16T03:16:10.990 INFO:tasks.workunit.client.1.smithi184.stdout:5/984: unlink d1/d3/d9/de/f11a 0 2023-12-16T03:16:10.998 INFO:tasks.workunit.client.1.smithi184.stdout:5/985: dread d1/d2a/d31/f54 [0,4194304] 0 2023-12-16T03:16:10.998 INFO:tasks.workunit.client.1.smithi184.stdout:5/986: write d1/d3/d9/f39 [759106,14511] 0 2023-12-16T03:16:11.000 INFO:tasks.workunit.client.1.smithi184.stdout:5/987: rmdir d1/d3/d9/d49 39 2023-12-16T03:16:11.002 INFO:tasks.workunit.client.0.smithi064.stdout:9/700: dwrite d2/dc/d24/d39/d77/d7d/fd7 [0,4194304] 0 2023-12-16T03:16:11.003 INFO:tasks.workunit.client.1.smithi184.stdout:5/988: rename d1/d3/d9/de/d15/db9/ff7 to d1/d3/d9/de/d15/d19/f13f 0 2023-12-16T03:16:11.003 INFO:tasks.workunit.client.0.smithi064.stdout:9/701: write d2/dc/d24/d39/d5e/f73 [154220,91234] 0 2023-12-16T03:16:11.004 INFO:tasks.workunit.client.0.smithi064.stdout:9/702: unlink d2/dc/d24/d39/d77/lbd 0 2023-12-16T03:16:11.005 INFO:tasks.workunit.client.0.smithi064.stdout:9/703: write d2/dc/d24/d39/d5e/f8f [101996,37189] 0 2023-12-16T03:16:11.005 INFO:tasks.workunit.client.0.smithi064.stdout:9/704: read - d2/d2d/fb6 zero size 2023-12-16T03:16:11.006 INFO:tasks.workunit.client.0.smithi064.stdout:9/705: creat d2/dc/d24/db2/dc3/fe8 x:0 0 0 2023-12-16T03:16:11.007 INFO:tasks.workunit.client.0.smithi064.stdout:9/706: symlink d2/d2d/d3b/d3c/d34/dce/de2/le9 0 2023-12-16T03:16:11.008 INFO:tasks.workunit.client.0.smithi064.stdout:9/707: fsync d2/dc/d24/d39/d77/d7d/fda 0 2023-12-16T03:16:11.008 INFO:tasks.workunit.client.0.smithi064.stdout:9/708: mknod d2/dc/d24/d39/d42/cea 0 2023-12-16T03:16:11.009 INFO:tasks.workunit.client.0.smithi064.stdout:9/709: mkdir d2/dc/d8a/deb 0 2023-12-16T03:16:11.010 INFO:tasks.workunit.client.0.smithi064.stdout:9/710: mkdir d2/d2d/d6c/d83/dec 0 2023-12-16T03:16:11.019 INFO:tasks.workunit.client.0.smithi064.stdout:9/711: fsync d2/d2d/d6c/f89 0 2023-12-16T03:16:11.021 INFO:tasks.workunit.client.0.smithi064.stdout:9/712: rename d2/d2d/d3b/d3c/d4b/c5d to d2/d2d/d3b/d3c/d34/ced 0 2023-12-16T03:16:11.021 INFO:tasks.workunit.client.0.smithi064.stdout:9/713: truncate d2/dc/d24/d39/d42/d9a/d8b/fe7 946474 0 2023-12-16T03:16:11.021 INFO:tasks.workunit.client.0.smithi064.stdout:9/714: fsync d2/dc/d24/d39/d77/d7d/db9/fd5 0 2023-12-16T03:16:11.022 INFO:tasks.workunit.client.0.smithi064.stdout:9/715: getdents d2/d2d/d36 0 2023-12-16T03:16:11.022 INFO:tasks.workunit.client.0.smithi064.stdout:9/716: creat d2/dc/d24/d39/fee x:0 0 0 2023-12-16T03:16:11.026 INFO:tasks.workunit.client.0.smithi064.stdout:9/717: mkdir d2/d2d/d36/db4/def 0 2023-12-16T03:16:11.028 INFO:tasks.workunit.client.0.smithi064.stdout:9/718: link d2/d2d/d3b/fc2 d2/d2d/d3b/ff0 0 2023-12-16T03:16:11.030 INFO:tasks.workunit.client.1.smithi184.stdout:5/989: dwrite d1/d3/d9/de/da5/f101 [0,4194304] 0 2023-12-16T03:16:11.032 INFO:tasks.workunit.client.1.smithi184.stdout:5/990: creat d1/d2a/d31/d28/d72/d126/f140 x:0 0 0 2023-12-16T03:16:11.032 INFO:tasks.workunit.client.1.smithi184.stdout:5/991: fdatasync d1/d3/d9/de/d15/d19/d5f/fe1 0 2023-12-16T03:16:11.037 INFO:tasks.workunit.client.0.smithi064.stdout:9/719: dread d2/dc/d24/d39/d5e/d6f/f70 [0,4194304] 0 2023-12-16T03:16:11.040 INFO:tasks.workunit.client.0.smithi064.stdout:9/720: dread d2/dc/d24/d39/d77/f88 [0,4194304] 0 2023-12-16T03:16:11.041 INFO:tasks.workunit.client.0.smithi064.stdout:6/661: sync 2023-12-16T03:16:11.042 INFO:tasks.workunit.client.0.smithi064.stdout:6/662: write d3/d8/f5f [252443,3840] 0 2023-12-16T03:16:11.044 INFO:tasks.workunit.client.0.smithi064.stdout:6/663: mknod d3/d9/dbe/cc5 0 2023-12-16T03:16:11.045 INFO:tasks.workunit.client.0.smithi064.stdout:6/664: creat d3/d9/dc0/fc6 x:0 0 0 2023-12-16T03:16:11.049 INFO:tasks.workunit.client.1.smithi184.stdout:5/992: dwrite d1/d3/d9/de/d15/f1e [0,4194304] 0 2023-12-16T03:16:11.051 INFO:tasks.workunit.client.1.smithi184.stdout:5/993: mkdir d1/d3/d9/de/d15/d27/dd2/df0/d141 0 2023-12-16T03:16:11.052 INFO:tasks.workunit.client.1.smithi184.stdout:5/994: write d1/d3/d9/de/d15/d27/f81 [461852,123824] 0 2023-12-16T03:16:11.052 INFO:tasks.workunit.client.0.smithi064.stdout:9/721: write d2/dc/d24/d39/d42/d57/f46 [2463947,65408] 0 2023-12-16T03:16:11.053 INFO:tasks.workunit.client.0.smithi064.stdout:9/722: write d2/dc/d24/f63 [2737977,71359] 0 2023-12-16T03:16:11.053 INFO:tasks.workunit.client.0.smithi064.stdout:9/723: write d2/d2d/d6c/f89 [1596225,18761] 0 2023-12-16T03:16:11.053 INFO:tasks.workunit.client.1.smithi184.stdout:5/995: rename d1/d3/d9/de/d15/d19/cb0 to d1/d3/d9/de/d30/d68/dff/c142 0 2023-12-16T03:16:11.054 INFO:tasks.workunit.client.0.smithi064.stdout:9/724: creat d2/d2d/d36/ff1 x:0 0 0 2023-12-16T03:16:11.055 INFO:tasks.workunit.client.1.smithi184.stdout:5/996: symlink d1/d3/l143 0 2023-12-16T03:16:11.056 INFO:tasks.workunit.client.1.smithi184.stdout:5/997: write d1/d3/dc6/f13d [1290595,106910] 0 2023-12-16T03:16:11.059 INFO:tasks.workunit.client.1.smithi184.stdout:5/998: dread d1/d3/d9/de/d30/f8b [0,4194304] 0 2023-12-16T03:16:11.060 INFO:tasks.workunit.client.1.smithi184.stdout:5/999: symlink d1/d3/d9/de/d30/l144 0 2023-12-16T03:16:11.066 INFO:tasks.workunit.client.1.smithi184.stderr:+ rm -rf -- ./tmp.N1pUYskN62 2023-12-16T03:16:11.073 INFO:tasks.workunit.client.0.smithi064.stdout:9/725: dwrite d2/dc/d24/f5a [4194304,4194304] 0 2023-12-16T03:16:11.075 INFO:tasks.workunit.client.0.smithi064.stdout:9/726: write d2/d2d/d3b/d3c/d34/f50 [2268988,63261] 0 2023-12-16T03:16:11.077 INFO:tasks.workunit.client.0.smithi064.stdout:9/727: unlink d2/d2d/d3b/d3c/fdc 0 2023-12-16T03:16:11.078 INFO:tasks.workunit.client.0.smithi064.stdout:9/728: read d2/d2d/d6c/f89 [729455,104431] 0 2023-12-16T03:16:11.081 INFO:tasks.workunit.client.0.smithi064.stdout:9/729: chown d2/d2d/l47 129569087 1 2023-12-16T03:16:11.081 INFO:tasks.workunit.client.0.smithi064.stdout:9/730: write d2/d2d/d36/db4/fde [33822,13668] 0 2023-12-16T03:16:11.096 INFO:tasks.workunit.client.0.smithi064.stdout:9/731: dwrite d2/d7e/fa3 [0,4194304] 0 2023-12-16T03:16:11.101 INFO:tasks.workunit.client.0.smithi064.stdout:9/732: getdents d2/d2d/d6c 0 2023-12-16T03:16:11.103 INFO:tasks.workunit.client.0.smithi064.stdout:9/733: creat d2/d7e/ff2 x:0 0 0 2023-12-16T03:16:11.104 INFO:tasks.workunit.client.0.smithi064.stdout:9/734: read d2/d2d/d3b/d3c/d34/f75 [656,109919] 0 2023-12-16T03:16:11.106 INFO:tasks.workunit.client.0.smithi064.stdout:9/735: dread d2/d2d/d36/f53 [0,4194304] 0 2023-12-16T03:16:11.108 INFO:tasks.workunit.client.0.smithi064.stdout:9/736: mknod d2/d2d/d3b/d3c/d34/cf3 0 2023-12-16T03:16:11.111 INFO:tasks.workunit.client.0.smithi064.stdout:9/737: mkdir d2/dc/d24/d39/d42/d9a/d8b/df4 0 2023-12-16T03:16:11.112 INFO:tasks.workunit.client.0.smithi064.stdout:9/738: fdatasync d2/d2d/d6c/d83/faa 0 2023-12-16T03:16:11.172 INFO:tasks.workunit.client.0.smithi064.stdout:9/739: dwrite d2/d2d/d36/f60 [0,4194304] 0 2023-12-16T03:16:11.172 INFO:tasks.workunit.client.0.smithi064.stdout:9/740: truncate d2/d2d/daf/fe3 1016119 0 2023-12-16T03:16:11.182 INFO:tasks.workunit.client.0.smithi064.stdout:9/741: creat d2/d2d/ff5 x:0 0 0 2023-12-16T03:16:11.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:11 smithi064 ceph-mon[111958]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:11.202 INFO:tasks.workunit.client.0.smithi064.stdout:9/742: dwrite d2/dc/d24/d39/d42/d57/f8e [0,4194304] 0 2023-12-16T03:16:11.206 INFO:tasks.workunit.client.0.smithi064.stdout:9/743: rename d2/d2d/d36/c64 to d2/dc/d24/d39/d42/d94/cf6 0 2023-12-16T03:16:11.209 INFO:tasks.workunit.client.0.smithi064.stdout:9/744: mknod d2/d2d/cf7 0 2023-12-16T03:16:11.210 INFO:tasks.workunit.client.0.smithi064.stdout:9/745: readlink d2/d2d/d6c/la6 0 2023-12-16T03:16:11.213 INFO:tasks.workunit.client.0.smithi064.stdout:9/746: symlink d2/d2d/d3b/d3c/d34/dce/de2/lf8 0 2023-12-16T03:16:11.213 INFO:tasks.workunit.client.0.smithi064.stdout:9/747: stat d2/dc/d24/d39/d5e/f73 0 2023-12-16T03:16:11.213 INFO:tasks.workunit.client.0.smithi064.stdout:9/748: creat d2/dc/d24/d39/d42/d9a/d8b/da8/ff9 x:0 0 0 2023-12-16T03:16:11.214 INFO:tasks.workunit.client.0.smithi064.stdout:9/749: mknod d2/d2d/d36/db4/cfa 0 2023-12-16T03:16:11.215 INFO:tasks.workunit.client.0.smithi064.stdout:9/750: creat d2/dc/d24/d39/d42/ffb x:0 0 0 2023-12-16T03:16:11.232 INFO:tasks.workunit.client.0.smithi064.stdout:5/621: sync 2023-12-16T03:16:11.232 INFO:tasks.workunit.client.0.smithi064.stdout:7/721: sync 2023-12-16T03:16:11.233 INFO:tasks.workunit.client.0.smithi064.stdout:7/722: fdatasync d7/d3e/d42/d89/f7a 0 2023-12-16T03:16:11.236 INFO:tasks.workunit.client.0.smithi064.stdout:5/622: creat d0/d14/d20/d37/d70/d71/d80/fdc x:0 0 0 2023-12-16T03:16:11.237 INFO:tasks.workunit.client.0.smithi064.stdout:7/723: creat d7/d3e/d42/d89/d20/d6f/d93/fe8 x:0 0 0 2023-12-16T03:16:11.238 INFO:tasks.workunit.client.0.smithi064.stdout:7/724: dread - d7/d3e/d42/d89/fb3 zero size 2023-12-16T03:16:11.238 INFO:tasks.workunit.client.0.smithi064.stdout:7/725: chown d7/d26/d30/ld7 61 1 2023-12-16T03:16:11.242 INFO:tasks.workunit.client.0.smithi064.stdout:5/623: link d0/d19/d48/d8f/d3e/d35/f8a d0/d7/d97/fdd 0 2023-12-16T03:16:11.242 INFO:tasks.workunit.client.0.smithi064.stdout:5/624: chown d0/d19/d48/d8f/c6f 6958 1 2023-12-16T03:16:11.243 INFO:tasks.workunit.client.0.smithi064.stdout:7/726: mknod d7/d26/d95/dca/dd2/ce9 0 2023-12-16T03:16:11.247 INFO:tasks.workunit.client.0.smithi064.stdout:5/625: creat d0/d7/d8b/dc0/fde x:0 0 0 2023-12-16T03:16:11.247 INFO:tasks.workunit.client.0.smithi064.stdout:5/626: write d0/d19/d48/d8f/dac/fb4 [534004,95610] 0 2023-12-16T03:16:11.251 INFO:tasks.workunit.client.0.smithi064.stdout:7/727: creat d7/d3e/d42/d48/fea x:0 0 0 2023-12-16T03:16:11.253 INFO:tasks.workunit.client.0.smithi064.stdout:5/627: truncate d0/d14/d20/f38 4000544 0 2023-12-16T03:16:11.256 INFO:tasks.workunit.client.0.smithi064.stdout:7/728: truncate d7/d3e/d42/d89/f29 2693418 0 2023-12-16T03:16:11.261 INFO:tasks.workunit.client.0.smithi064.stdout:5/628: symlink d0/d19/d48/d8f/d3e/ldf 0 2023-12-16T03:16:11.267 INFO:tasks.workunit.client.0.smithi064.stdout:7/729: mkdir d7/d3e/d42/d89/d20/d6f/d91/deb 0 2023-12-16T03:16:11.272 INFO:tasks.workunit.client.0.smithi064.stdout:7/730: creat d7/d3e/d42/d48/d51/d7c/fec x:0 0 0 2023-12-16T03:16:11.284 INFO:tasks.workunit.client.0.smithi064.stdout:5/629: dwrite d0/d14/d20/d37/d70/da2/fa8 [0,4194304] 0 2023-12-16T03:16:11.287 INFO:tasks.workunit.client.0.smithi064.stdout:5/630: mknod d0/d19/d48/d8f/ce0 0 2023-12-16T03:16:11.288 INFO:tasks.workunit.client.0.smithi064.stdout:5/631: creat d0/d7/d8b/dc0/fe1 x:0 0 0 2023-12-16T03:16:11.290 INFO:tasks.workunit.client.0.smithi064.stdout:7/731: dwrite d7/d3e/d42/f72 [0,4194304] 0 2023-12-16T03:16:11.290 INFO:tasks.workunit.client.0.smithi064.stdout:5/632: rename d0/d14/d20/d37/d3c/f76 to d0/d50/d39/daa/dc5/db8/fe2 0 2023-12-16T03:16:11.291 INFO:tasks.workunit.client.0.smithi064.stdout:7/732: creat d7/d3e/d42/d89/d74/fed x:0 0 0 2023-12-16T03:16:11.294 INFO:tasks.workunit.client.0.smithi064.stdout:7/733: rename d7/d3e/d42/d89/fb3 to d7/d3e/d42/d89/d20/d6f/d91/deb/fee 0 2023-12-16T03:16:11.294 INFO:tasks.workunit.client.0.smithi064.stdout:7/734: readlink d7/d3e/d42/d89/d20/l5a 0 2023-12-16T03:16:11.295 INFO:tasks.workunit.client.0.smithi064.stdout:5/633: truncate d0/d7/f2e 1709801 0 2023-12-16T03:16:11.295 INFO:tasks.workunit.client.0.smithi064.stdout:5/634: read d0/d14/d20/f3d [36975,92174] 0 2023-12-16T03:16:11.295 INFO:tasks.workunit.client.0.smithi064.stdout:5/635: fsync d0/d7/d34/f5c 0 2023-12-16T03:16:11.295 INFO:tasks.workunit.client.0.smithi064.stdout:5/636: fsync d0/d50/d39/daa/dc5/fd7 0 2023-12-16T03:16:11.296 INFO:tasks.workunit.client.0.smithi064.stdout:5/637: symlink d0/le3 0 2023-12-16T03:16:11.298 INFO:tasks.workunit.client.0.smithi064.stdout:5/638: mkdir d0/d19/d48/d8f/dac/d23/d67/de4 0 2023-12-16T03:16:11.298 INFO:tasks.workunit.client.0.smithi064.stdout:5/639: readlink d0/d19/d48/d8f/d3e/d35/d5d/lcf 0 2023-12-16T03:16:11.300 INFO:tasks.workunit.client.0.smithi064.stdout:5/640: symlink d0/d7/d8b/le5 0 2023-12-16T03:16:11.300 INFO:tasks.workunit.client.0.smithi064.stdout:5/641: chown d0/d14/d20/d37/d70/da2/fa8 158545 1 2023-12-16T03:16:11.317 INFO:tasks.workunit.client.0.smithi064.stdout:5/642: dwrite d0/d14/d20/d37/d70/da2/fbc [0,4194304] 0 2023-12-16T03:16:11.320 INFO:tasks.workunit.client.0.smithi064.stdout:5/643: creat d0/d19/d48/d8f/d5e/fe6 x:0 0 0 2023-12-16T03:16:11.339 INFO:tasks.workunit.client.0.smithi064.stdout:5/644: dwrite d0/d7/d8b/fba [0,4194304] 0 2023-12-16T03:16:11.344 INFO:tasks.workunit.client.0.smithi064.stdout:5/645: creat d0/d19/d48/d8f/d3e/fe7 x:0 0 0 2023-12-16T03:16:11.344 INFO:tasks.workunit.client.0.smithi064.stdout:5/646: chown d0/d19/d48/fab 428382206 1 2023-12-16T03:16:11.366 INFO:tasks.workunit.client.0.smithi064.stdout:5/647: dwrite d0/d14/d20/f3d [0,4194304] 0 2023-12-16T03:16:11.379 INFO:tasks.workunit.client.0.smithi064.stdout:5/648: dwrite d0/d14/d20/d37/d70/d71/f72 [0,4194304] 0 2023-12-16T03:16:11.385 INFO:tasks.workunit.client.0.smithi064.stdout:5/649: mknod d0/d50/d39/daa/ce8 0 2023-12-16T03:16:11.385 INFO:tasks.workunit.client.0.smithi064.stdout:5/650: chown d0/d19/d48/d8f/d5e/fe6 65960584 1 2023-12-16T03:16:11.385 INFO:tasks.workunit.client.0.smithi064.stdout:5/651: write d0/d7/d8b/fbe [357062,51524] 0 2023-12-16T03:16:11.399 INFO:tasks.workunit.client.0.smithi064.stdout:5/652: dwrite d0/f5b [8388608,4194304] 0 2023-12-16T03:16:11.399 INFO:tasks.workunit.client.0.smithi064.stdout:5/653: fdatasync d0/d7/d8b/dc0/fde 0 2023-12-16T03:16:11.399 INFO:tasks.workunit.client.0.smithi064.stdout:5/654: write d0/d19/d48/fab [4387774,7479] 0 2023-12-16T03:16:11.402 INFO:tasks.workunit.client.0.smithi064.stdout:5/655: creat d0/d50/d39/daa/fe9 x:0 0 0 2023-12-16T03:16:11.424 INFO:tasks.workunit.client.0.smithi064.stdout:3/810: sync 2023-12-16T03:16:11.424 INFO:tasks.workunit.client.0.smithi064.stdout:4/766: sync 2023-12-16T03:16:11.424 INFO:tasks.workunit.client.0.smithi064.stdout:1/803: sync 2023-12-16T03:16:11.424 INFO:tasks.workunit.client.0.smithi064.stdout:3/811: fsync db/d12/d21/f74 0 2023-12-16T03:16:11.430 INFO:tasks.workunit.client.0.smithi064.stdout:4/767: creat d0/d42/d53/dd4/fec x:0 0 0 2023-12-16T03:16:11.430 INFO:tasks.workunit.client.0.smithi064.stdout:4/768: write d0/d1e/d36/db7/fdf [808457,76224] 0 2023-12-16T03:16:11.433 INFO:tasks.workunit.client.0.smithi064.stdout:3/812: symlink db/d12/d1a/d2c/d34/d4c/d6a/l10a 0 2023-12-16T03:16:11.433 INFO:tasks.workunit.client.0.smithi064.stdout:3/813: stat db/d12/d4e/f73 0 2023-12-16T03:16:11.439 INFO:tasks.workunit.client.0.smithi064.stdout:4/769: mknod d0/d42/d4c/d70/dbe/ced 0 2023-12-16T03:16:11.440 INFO:tasks.workunit.client.0.smithi064.stdout:3/814: symlink db/d12/d1a/d2c/d34/d4c/d6a/d93/l10b 0 2023-12-16T03:16:11.441 INFO:tasks.workunit.client.0.smithi064.stdout:3/815: dread db/d12/f27 [0,4194304] 0 2023-12-16T03:16:11.443 INFO:tasks.workunit.client.0.smithi064.stdout:4/770: mkdir d0/d42/d4c/d70/d8c/da9/dee 0 2023-12-16T03:16:11.444 INFO:tasks.workunit.client.0.smithi064.stdout:4/771: readlink d0/d1e/d36/db7/lbd 0 2023-12-16T03:16:11.445 INFO:tasks.workunit.client.0.smithi064.stdout:4/772: creat d0/d42/d56/fef x:0 0 0 2023-12-16T03:16:11.446 INFO:tasks.workunit.client.0.smithi064.stdout:4/773: stat d0/d42/d4c/d70/d8c/dc7/le7 0 2023-12-16T03:16:11.449 INFO:tasks.workunit.client.0.smithi064.stdout:1/804: dwrite d3/d36/d44/d4d/d58/d96/f99 [0,4194304] 0 2023-12-16T03:16:11.449 INFO:tasks.workunit.client.0.smithi064.stdout:4/774: link d0/d42/d4c/d70/f82 d0/da/da6/dd8/ff0 0 2023-12-16T03:16:11.451 INFO:tasks.workunit.client.0.smithi064.stdout:1/805: creat d3/dd/d23/d86/ffc x:0 0 0 2023-12-16T03:16:11.453 INFO:tasks.workunit.client.0.smithi064.stdout:4/775: mkdir d0/d42/d4c/d70/dbe/df1 0 2023-12-16T03:16:11.457 INFO:tasks.workunit.client.0.smithi064.stdout:1/806: rename d3/d36/la1 to d3/dd/d23/d4f/lfd 0 2023-12-16T03:16:11.457 INFO:tasks.workunit.client.0.smithi064.stdout:3/816: dwrite db/d12/d1a/d2c/d34/d4c/d6a/f94 [0,4194304] 0 2023-12-16T03:16:11.458 INFO:tasks.workunit.client.0.smithi064.stdout:4/776: mknod d0/d42/cf2 0 2023-12-16T03:16:11.460 INFO:tasks.workunit.client.0.smithi064.stdout:1/807: mkdir d3/dd/d11/dfe 0 2023-12-16T03:16:11.466 INFO:tasks.workunit.client.0.smithi064.stdout:4/777: rename d0/d42/d66/d5a/d75 to d0/d42/d4c/d70/d8c/da9/df3 0 2023-12-16T03:16:11.466 INFO:tasks.workunit.client.0.smithi064.stdout:4/778: write d0/d1e/d36/f46 [4531217,67086] 0 2023-12-16T03:16:11.466 INFO:tasks.workunit.client.0.smithi064.stdout:4/779: chown d0/d1e/lac 3 1 2023-12-16T03:16:11.468 INFO:tasks.workunit.client.0.smithi064.stdout:1/808: mknod d3/d36/d44/d4d/da8/dce/cff 0 2023-12-16T03:16:11.468 INFO:tasks.workunit.client.0.smithi064.stdout:1/809: chown d3/dd/d23/d4f/f9a 10 1 2023-12-16T03:16:11.468 INFO:tasks.workunit.client.0.smithi064.stdout:1/810: write d3/d22/dab/fea [602104,115067] 0 2023-12-16T03:16:11.480 INFO:tasks.workunit.client.0.smithi064.stdout:3/817: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/dc9/fed [0,4194304] 0 2023-12-16T03:16:11.494 INFO:tasks.workunit.client.0.smithi064.stdout:1/811: dwrite d3/dd/d11/d3b/fe0 [0,4194304] 0 2023-12-16T03:16:11.495 INFO:tasks.workunit.client.0.smithi064.stdout:4/780: dwrite d0/d12/d48/d87/f9c [0,4194304] 0 2023-12-16T03:16:11.509 INFO:tasks.workunit.client.0.smithi064.stdout:4/781: dwrite d0/d42/d56/fb0 [0,4194304] 0 2023-12-16T03:16:11.530 INFO:tasks.workunit.client.0.smithi064.stdout:4/782: dwrite d0/d1e/f69 [0,4194304] 0 2023-12-16T03:16:11.530 INFO:tasks.workunit.client.0.smithi064.stdout:4/783: chown d0/d12/d48/d87/fd6 5820262 1 2023-12-16T03:16:11.530 INFO:tasks.workunit.client.0.smithi064.stdout:4/784: stat d0/d42/d4c/d70/f7d 0 2023-12-16T03:16:11.538 INFO:tasks.workunit.client.0.smithi064.stdout:4/785: dread d0/da/f88 [0,4194304] 0 2023-12-16T03:16:11.546 INFO:tasks.workunit.client.0.smithi064.stdout:4/786: dread d0/d42/d66/d5a/fcd [0,4194304] 0 2023-12-16T03:16:11.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:11 smithi184 ceph-mon[121180]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:11.599 INFO:tasks.workunit.client.0.smithi064.stdout:1/812: creat d3/d36/d44/d4d/da8/dce/f100 x:0 0 0 2023-12-16T03:16:11.629 INFO:tasks.workunit.client.0.smithi064.stdout:4/787: mkdir d0/da/da6/df4 0 2023-12-16T03:16:11.634 INFO:tasks.workunit.client.0.smithi064.stdout:1/813: creat d3/dd/d11/d6a/f101 x:0 0 0 2023-12-16T03:16:11.634 INFO:tasks.workunit.client.0.smithi064.stdout:1/814: getdents d3/dd/d11/dfe 0 2023-12-16T03:16:11.639 INFO:tasks.workunit.client.0.smithi064.stdout:1/815: mknod d3/dd/d11/dfe/c102 0 2023-12-16T03:16:11.643 INFO:tasks.workunit.client.0.smithi064.stdout:1/816: symlink d3/d36/l103 0 2023-12-16T03:16:11.643 INFO:tasks.workunit.client.0.smithi064.stdout:1/817: dread - d3/d22/fd9 zero size 2023-12-16T03:16:11.643 INFO:tasks.workunit.client.0.smithi064.stdout:1/818: truncate d3/d36/d44/ff5 587763 0 2023-12-16T03:16:11.643 INFO:tasks.workunit.client.0.smithi064.stdout:1/819: chown d3/dd/l47 13 1 2023-12-16T03:16:11.657 INFO:tasks.workunit.client.0.smithi064.stdout:1/820: dwrite d3/dd/d11/d2f/fb3 [0,4194304] 0 2023-12-16T03:16:11.660 INFO:tasks.workunit.client.0.smithi064.stdout:1/821: symlink d3/d36/d44/d4d/da8/l104 0 2023-12-16T03:16:11.660 INFO:tasks.workunit.client.0.smithi064.stdout:1/822: read d3/d36/d44/d4d/d58/f6e [1778380,126336] 0 2023-12-16T03:16:11.660 INFO:tasks.workunit.client.0.smithi064.stdout:1/823: write d3/dd/d23/d60/fe6 [956232,21727] 0 2023-12-16T03:16:11.663 INFO:tasks.workunit.client.0.smithi064.stdout:1/824: dread d3/d22/d57/f5d [0,4194304] 0 2023-12-16T03:16:11.663 INFO:tasks.workunit.client.0.smithi064.stdout:1/825: truncate d3/dd/d11/d2f/fb6 4849719 0 2023-12-16T03:16:11.664 INFO:tasks.workunit.client.0.smithi064.stdout:1/826: read d3/dd/d11/d6a/ff8 [2479826,97179] 0 2023-12-16T03:16:11.664 INFO:tasks.workunit.client.0.smithi064.stdout:1/827: getdents d3/d36/d44/d4d/d58/df1 0 2023-12-16T03:16:11.665 INFO:tasks.workunit.client.0.smithi064.stdout:1/828: creat d3/dd/d23/d86/f105 x:0 0 0 2023-12-16T03:16:11.665 INFO:tasks.workunit.client.0.smithi064.stdout:1/829: fsync d3/d36/d44/d4d/f4e 0 2023-12-16T03:16:11.667 INFO:tasks.workunit.client.0.smithi064.stdout:1/830: unlink d3/dd/c6c 0 2023-12-16T03:16:11.667 INFO:tasks.workunit.client.0.smithi064.stdout:1/831: chown d3/dd/d23/d4f/lfd 176 1 2023-12-16T03:16:11.668 INFO:tasks.workunit.client.0.smithi064.stdout:1/832: creat d3/d36/d44/d4d/da8/dce/f106 x:0 0 0 2023-12-16T03:16:11.678 INFO:tasks.workunit.client.0.smithi064.stdout:1/833: dread d3/dd/d11/d2f/fb3 [0,4194304] 0 2023-12-16T03:16:11.679 INFO:tasks.workunit.client.0.smithi064.stdout:1/834: rmdir d3/dd/d23/d60 39 2023-12-16T03:16:11.680 INFO:tasks.workunit.client.0.smithi064.stdout:1/835: readlink d3/dd/d11/d38/l76 0 2023-12-16T03:16:11.680 INFO:tasks.workunit.client.0.smithi064.stdout:1/836: write d3/dd/d23/d4f/f54 [1850466,62541] 0 2023-12-16T03:16:11.686 INFO:tasks.workunit.client.0.smithi064.stdout:1/837: mknod d3/dd/c107 0 2023-12-16T03:16:11.690 INFO:tasks.workunit.client.0.smithi064.stdout:1/838: dread d3/dd/d11/f17 [0,4194304] 0 2023-12-16T03:16:11.707 INFO:tasks.workunit.client.0.smithi064.stdout:1/839: dwrite d3/d36/d44/d4d/d58/fa7 [0,4194304] 0 2023-12-16T03:16:11.707 INFO:tasks.workunit.client.0.smithi064.stdout:1/840: dread - d3/d36/d44/f8e zero size 2023-12-16T03:16:11.707 INFO:tasks.workunit.client.0.smithi064.stdout:1/841: write d3/d36/d44/d4d/fae [316159,47877] 0 2023-12-16T03:16:11.709 INFO:tasks.workunit.client.0.smithi064.stdout:1/842: creat d3/dd/d2a/f108 x:0 0 0 2023-12-16T03:16:11.710 INFO:tasks.workunit.client.0.smithi064.stdout:1/843: truncate d3/dd/d23/d4f/f8d 2420963 0 2023-12-16T03:16:11.711 INFO:tasks.workunit.client.0.smithi064.stdout:1/844: creat d3/d22/d57/f109 x:0 0 0 2023-12-16T03:16:11.712 INFO:tasks.workunit.client.0.smithi064.stdout:1/845: read - d3/d36/d44/d4d/da8/dce/f106 zero size 2023-12-16T03:16:11.712 INFO:tasks.workunit.client.0.smithi064.stdout:1/846: stat d3/f7b 0 2023-12-16T03:16:11.712 INFO:tasks.workunit.client.0.smithi064.stdout:1/847: stat d3/dd/d11/f17 0 2023-12-16T03:16:11.731 INFO:tasks.workunit.client.0.smithi064.stdout:1/848: dwrite d3/dd/d11/d38/f77 [0,4194304] 0 2023-12-16T03:16:11.733 INFO:tasks.workunit.client.0.smithi064.stdout:0/695: sync 2023-12-16T03:16:11.733 INFO:tasks.workunit.client.0.smithi064.stdout:8/785: sync 2023-12-16T03:16:11.733 INFO:tasks.workunit.client.0.smithi064.stdout:9/751: sync 2023-12-16T03:16:11.733 INFO:tasks.workunit.client.0.smithi064.stdout:0/696: write d2/d8/da/df/f5c [2029740,39718] 0 2023-12-16T03:16:11.733 INFO:tasks.workunit.client.0.smithi064.stdout:0/697: fsync d2/d7/f63 0 2023-12-16T03:16:11.734 INFO:tasks.workunit.client.0.smithi064.stdout:5/656: sync 2023-12-16T03:16:11.734 INFO:tasks.workunit.client.0.smithi064.stdout:2/629: sync 2023-12-16T03:16:11.734 INFO:tasks.workunit.client.0.smithi064.stdout:3/818: rmdir db/d4f/da9 39 2023-12-16T03:16:11.734 INFO:tasks.workunit.client.0.smithi064.stdout:3/819: chown db/d4f/d51/ff6 32416652 1 2023-12-16T03:16:11.734 INFO:tasks.workunit.client.0.smithi064.stdout:6/665: sync 2023-12-16T03:16:11.734 INFO:tasks.workunit.client.0.smithi064.stdout:7/735: sync 2023-12-16T03:16:11.734 INFO:tasks.workunit.client.0.smithi064.stdout:7/736: write d7/d3e/d42/d48/d51/d7c/f77 [639968,32806] 0 2023-12-16T03:16:11.744 INFO:tasks.workunit.client.0.smithi064.stdout:0/698: truncate d2/d7/d10/d21/f39 1315739 0 2023-12-16T03:16:11.744 INFO:tasks.workunit.client.0.smithi064.stdout:0/699: write d2/d29/d66/db9/fe8 [1512612,16687] 0 2023-12-16T03:16:11.744 INFO:tasks.workunit.client.0.smithi064.stdout:0/700: readlink d2/d7/d6b/la9 0 2023-12-16T03:16:11.744 INFO:tasks.workunit.client.0.smithi064.stdout:0/701: chown d2/d7/d10/d21/f39 67899 1 2023-12-16T03:16:11.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/630: symlink d1/d15/d1b/d9c/lc9 0 2023-12-16T03:16:11.750 INFO:tasks.workunit.client.0.smithi064.stdout:0/702: rename d2/d29/d66/d97 to d2/d29/dc8/dea 0 2023-12-16T03:16:11.751 INFO:tasks.workunit.client.0.smithi064.stdout:2/631: symlink d1/d15/d23/lca 0 2023-12-16T03:16:11.752 INFO:tasks.workunit.client.0.smithi064.stdout:0/703: creat d2/d29/de7/feb x:0 0 0 2023-12-16T03:16:11.752 INFO:tasks.workunit.client.0.smithi064.stdout:0/704: dread - d2/d7/d10/d21/d7a/f7f zero size 2023-12-16T03:16:11.753 INFO:tasks.workunit.client.0.smithi064.stdout:0/705: read - d2/d29/d66/db9/fbf zero size 2023-12-16T03:16:11.753 INFO:tasks.workunit.client.0.smithi064.stdout:2/632: symlink d1/d15/d1b/d49/da0/lcb 0 2023-12-16T03:16:11.758 INFO:tasks.workunit.client.0.smithi064.stdout:0/706: creat d2/d7/d10/dc4/dcc/dd0/fec x:0 0 0 2023-12-16T03:16:11.759 INFO:tasks.workunit.client.0.smithi064.stdout:9/752: rmdir d2/d2d/d3b/d3c 39 2023-12-16T03:16:11.759 INFO:tasks.workunit.client.0.smithi064.stdout:9/753: dread - d2/dc/d24/d39/d42/d9a/d8b/fcb zero size 2023-12-16T03:16:11.759 INFO:tasks.workunit.client.0.smithi064.stdout:9/754: fsync d2/f40 0 2023-12-16T03:16:11.760 INFO:tasks.workunit.client.0.smithi064.stdout:7/737: rmdir d7/d3e/d42/d48/d51/d7c 39 2023-12-16T03:16:11.761 INFO:tasks.workunit.client.0.smithi064.stdout:0/707: creat d2/d29/fed x:0 0 0 2023-12-16T03:16:11.762 INFO:tasks.workunit.client.0.smithi064.stdout:3/820: creat db/d4f/d51/f10c x:0 0 0 2023-12-16T03:16:11.762 INFO:tasks.workunit.client.0.smithi064.stdout:3/821: chown db/d4f/f5d 588 1 2023-12-16T03:16:11.762 INFO:tasks.workunit.client.0.smithi064.stdout:9/755: stat d2/d2d/le1 0 2023-12-16T03:16:11.762 INFO:tasks.workunit.client.0.smithi064.stdout:6/666: dwrite d3/d8/d13/f24 [0,4194304] 0 2023-12-16T03:16:11.763 INFO:tasks.workunit.client.0.smithi064.stdout:8/786: dwrite d0/da/de9/f62 [0,4194304] 0 2023-12-16T03:16:11.764 INFO:tasks.workunit.client.0.smithi064.stdout:7/738: truncate d7/d3e/d42/d48/f5b 4392781 0 2023-12-16T03:16:11.769 INFO:tasks.workunit.client.0.smithi064.stdout:0/708: rename d2/d7/d10/d21/d31/l94 to d2/d29/d66/de5/lee 0 2023-12-16T03:16:11.769 INFO:tasks.workunit.client.0.smithi064.stdout:0/709: dread - d2/d7/d10/dc4/dcc/f68 zero size 2023-12-16T03:16:11.769 INFO:tasks.workunit.client.0.smithi064.stdout:6/667: rmdir d3/d8/d1f/d26/d47/d4a/d67 39 2023-12-16T03:16:11.769 INFO:tasks.workunit.client.0.smithi064.stdout:8/787: creat d0/d1d/d24/f10e x:0 0 0 2023-12-16T03:16:11.770 INFO:tasks.workunit.client.0.smithi064.stdout:8/788: dread - d0/da/de9/d37/d3a/dab/dfa/d46/d8f/fd7 zero size 2023-12-16T03:16:11.770 INFO:tasks.workunit.client.0.smithi064.stdout:8/789: truncate d0/da/de9/d37/d3a/dab/dfa/f98 279461 0 2023-12-16T03:16:11.770 INFO:tasks.workunit.client.0.smithi064.stdout:7/739: mknod d7/d3e/d42/d89/de2/cef 0 2023-12-16T03:16:11.773 INFO:tasks.workunit.client.0.smithi064.stdout:2/633: dread d1/d15/d1b/d61/f77 [0,4194304] 0 2023-12-16T03:16:11.773 INFO:tasks.workunit.client.0.smithi064.stdout:5/657: dwrite d0/d14/d20/d37/d70/f81 [0,4194304] 0 2023-12-16T03:16:11.773 INFO:tasks.workunit.client.0.smithi064.stdout:2/634: readlink d1/d15/d1b/d9c/l8a 0 2023-12-16T03:16:11.774 INFO:tasks.workunit.client.0.smithi064.stdout:3/822: rename db/d4f/da9/dbf/dcf to db/d12/d1a/d31/df7/d10d 0 2023-12-16T03:16:11.774 INFO:tasks.workunit.client.0.smithi064.stdout:3/823: write db/d12/d1a/d2c/d34/d4c/d6a/da7/f24 [4527722,86930] 0 2023-12-16T03:16:11.775 INFO:tasks.workunit.client.0.smithi064.stdout:3/824: chown ca 4 1 2023-12-16T03:16:11.786 INFO:tasks.workunit.client.0.smithi064.stdout:9/756: dwrite d2/d2d/d36/ff1 [0,4194304] 0 2023-12-16T03:16:11.788 INFO:tasks.workunit.client.0.smithi064.stdout:2/635: link d1/d15/d1b/d9c/lc9 d1/d15/d23/lcc 0 2023-12-16T03:16:11.791 INFO:tasks.workunit.client.0.smithi064.stdout:7/740: rename d7/d26/f79 to d7/d3e/d42/d89/d20/d37/db1/ff0 0 2023-12-16T03:16:11.791 INFO:tasks.workunit.client.0.smithi064.stdout:7/741: fsync d7/d26/d30/da3/dc3/fdd 0 2023-12-16T03:16:11.794 INFO:tasks.workunit.client.0.smithi064.stdout:3/825: symlink db/d4f/d51/db3/l10e 0 2023-12-16T03:16:11.794 INFO:tasks.workunit.client.0.smithi064.stdout:3/826: chown db/d12/d1a/l4a 85 1 2023-12-16T03:16:11.800 INFO:tasks.workunit.client.0.smithi064.stdout:6/668: dwrite d3/d9/f18 [0,4194304] 0 2023-12-16T03:16:11.802 INFO:tasks.workunit.client.0.smithi064.stdout:5/658: dwrite d0/d7/d8b/dc0/fe1 [0,4194304] 0 2023-12-16T03:16:11.802 INFO:tasks.workunit.client.0.smithi064.stdout:5/659: chown d0/d19/d48/d8f/d3e/d35/f54 79 1 2023-12-16T03:16:11.803 INFO:tasks.workunit.client.0.smithi064.stdout:7/742: creat d7/d26/d95/ff1 x:0 0 0 2023-12-16T03:16:11.806 INFO:tasks.workunit.client.0.smithi064.stdout:2/636: rmdir d1/d15 39 2023-12-16T03:16:11.808 INFO:tasks.workunit.client.0.smithi064.stdout:6/669: rename d3/d44/f8c to d3/fc7 0 2023-12-16T03:16:11.815 INFO:tasks.workunit.client.0.smithi064.stdout:5/660: dread d0/d19/d48/d8f/d3e/d35/d5d/fbd [0,4194304] 0 2023-12-16T03:16:11.819 INFO:tasks.workunit.client.0.smithi064.stdout:7/743: getdents d7/d26/d30/da3/dc3 0 2023-12-16T03:16:11.821 INFO:tasks.workunit.client.0.smithi064.stdout:8/790: dwrite d0/f2 [0,4194304] 0 2023-12-16T03:16:11.821 INFO:tasks.workunit.client.0.smithi064.stdout:2/637: creat d1/d15/d1b/d49/da0/fcd x:0 0 0 2023-12-16T03:16:11.823 INFO:tasks.workunit.client.0.smithi064.stdout:5/661: creat d0/d19/d48/fea x:0 0 0 2023-12-16T03:16:11.823 INFO:tasks.workunit.client.0.smithi064.stdout:5/662: chown d0/d7/f1e 6 1 2023-12-16T03:16:11.823 INFO:tasks.workunit.client.0.smithi064.stdout:4/788: sync 2023-12-16T03:16:11.824 INFO:tasks.workunit.client.0.smithi064.stdout:7/744: symlink d7/d3e/d42/d89/d20/d6f/d91/lf2 0 2023-12-16T03:16:11.824 INFO:tasks.workunit.client.0.smithi064.stdout:7/745: chown d7/d3e/d42/d48/d51/d7c/d52 16 1 2023-12-16T03:16:11.826 INFO:tasks.workunit.client.0.smithi064.stdout:3/827: rmdir db/d12/d1a/d2c/db5 0 2023-12-16T03:16:11.832 INFO:tasks.workunit.client.0.smithi064.stdout:8/791: symlink d0/d1d/d73/dd9/d109/l10f 0 2023-12-16T03:16:11.833 INFO:tasks.workunit.client.0.smithi064.stdout:2/638: creat d1/d15/d1b/d9c/d68/fce x:0 0 0 2023-12-16T03:16:11.834 INFO:tasks.workunit.client.0.smithi064.stdout:2/639: read d1/f7 [224672,36583] 0 2023-12-16T03:16:11.835 INFO:tasks.workunit.client.0.smithi064.stdout:6/670: symlink d3/d8/da/lc8 0 2023-12-16T03:16:11.837 INFO:tasks.workunit.client.0.smithi064.stdout:5/663: link d0/d19/l68 d0/d7/d8b/leb 0 2023-12-16T03:16:11.840 INFO:tasks.workunit.client.0.smithi064.stdout:4/789: symlink d0/da/lf5 0 2023-12-16T03:16:11.840 INFO:tasks.workunit.client.0.smithi064.stdout:4/790: fdatasync d0/d42/d4c/d70/d8c/fc5 0 2023-12-16T03:16:11.840 INFO:tasks.workunit.client.0.smithi064.stdout:4/791: chown d0/d42/d53 30056 1 2023-12-16T03:16:11.840 INFO:tasks.workunit.client.0.smithi064.stdout:4/792: chown d0/d42/d66/l19 3647 1 2023-12-16T03:16:11.841 INFO:tasks.workunit.client.0.smithi064.stdout:7/746: truncate d7/d3e/f78 1965562 0 2023-12-16T03:16:11.844 INFO:tasks.workunit.client.0.smithi064.stdout:3/828: dwrite db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/dc9/fed [0,4194304] 0 2023-12-16T03:16:11.845 INFO:tasks.workunit.client.0.smithi064.stdout:8/792: mknod d0/da/de9/d37/d10d/d38/dda/c110 0 2023-12-16T03:16:11.845 INFO:tasks.workunit.client.0.smithi064.stdout:8/793: dread - d0/d1d/d24/fc3 zero size 2023-12-16T03:16:11.845 INFO:tasks.workunit.client.0.smithi064.stdout:8/794: chown d0/da/de9/d37/d3a/dab/dfa/d46/c6c 54 1 2023-12-16T03:16:11.846 INFO:tasks.workunit.client.0.smithi064.stdout:2/640: write d1/d15/d1b/f4c [442502,56212] 0 2023-12-16T03:16:11.847 INFO:tasks.workunit.client.0.smithi064.stdout:6/671: mknod d3/d80/cc9 0 2023-12-16T03:16:11.850 INFO:tasks.workunit.client.0.smithi064.stdout:5/664: unlink d0/d19/d48/fab 0 2023-12-16T03:16:11.850 INFO:tasks.workunit.client.0.smithi064.stdout:5/665: readlink d0/d14/d20/d37/l7e 0 2023-12-16T03:16:11.850 INFO:tasks.workunit.client.0.smithi064.stdout:5/666: readlink d0/d19/d48/d8f/d3e/d35/d5d/lcf 0 2023-12-16T03:16:11.853 INFO:tasks.workunit.client.0.smithi064.stdout:4/793: creat d0/d42/d56/ff6 x:0 0 0 2023-12-16T03:16:11.854 INFO:tasks.workunit.client.0.smithi064.stdout:7/747: rename d7/d3e/d42/d89/d20/d6f/d91/lf2 to d7/d3e/d42/d43/dc8/lf3 0 2023-12-16T03:16:11.898 INFO:tasks.workunit.client.0.smithi064.stdout:3/829: creat db/d12/d1a/d31/d109/f10f x:0 0 0 2023-12-16T03:16:11.898 INFO:tasks.workunit.client.0.smithi064.stdout:3/830: chown db/d12/d1a/d2c/d34/d4c/d6a/da7/c9e 19263 1 2023-12-16T03:16:11.898 INFO:tasks.workunit.client.0.smithi064.stdout:3/831: readlink db/l57 0 2023-12-16T03:16:11.901 INFO:tasks.workunit.client.0.smithi064.stdout:2/641: mkdir d1/d15/d1b/d9c/d69/dcf 0 2023-12-16T03:16:11.903 INFO:tasks.workunit.client.0.smithi064.stdout:6/672: creat d3/d8/d1f/d26/d47/fca x:0 0 0 2023-12-16T03:16:11.903 INFO:tasks.workunit.client.0.smithi064.stdout:6/673: stat d3/d8/d13/d58 0 2023-12-16T03:16:11.908 INFO:tasks.workunit.client.0.smithi064.stdout:4/794: mknod d0/d42/d66/d5a/cf7 0 2023-12-16T03:16:11.913 INFO:tasks.workunit.client.0.smithi064.stdout:8/795: rename d0/da/de9/d12/d44/d68/d6d/dbc to d0/da/de9/d111 0 2023-12-16T03:16:11.918 INFO:tasks.workunit.client.0.smithi064.stdout:7/748: creat d7/d26/d95/dca/ff4 x:0 0 0 2023-12-16T03:16:11.922 INFO:tasks.workunit.client.0.smithi064.stdout:2/642: mknod d1/d15/d1b/d61/cd0 0 2023-12-16T03:16:11.923 INFO:tasks.workunit.client.0.smithi064.stdout:2/643: write d1/d15/d1b/d49/da0/d8f/f9a [2765195,34036] 0 2023-12-16T03:16:11.926 INFO:tasks.workunit.client.0.smithi064.stdout:6/674: mkdir d3/d9e/dbd/dcb 0 2023-12-16T03:16:11.927 INFO:tasks.workunit.client.0.smithi064.stdout:4/795: stat d0/l76 0 2023-12-16T03:16:11.934 INFO:tasks.workunit.client.0.smithi064.stdout:3/832: rename db/d4f/d51/dd1/dd3/cff to db/d12/c110 0 2023-12-16T03:16:11.935 INFO:tasks.workunit.client.0.smithi064.stdout:3/833: stat db/d12/d1a/d31/c98 0 2023-12-16T03:16:11.935 INFO:tasks.workunit.client.0.smithi064.stdout:3/834: chown db/d12/d21/fe8 26 1 2023-12-16T03:16:11.936 INFO:tasks.workunit.client.0.smithi064.stdout:8/796: mknod d0/da/de9/d37/d3a/dab/dfa/d46/c112 0 2023-12-16T03:16:11.936 INFO:tasks.workunit.client.0.smithi064.stdout:8/797: chown d0/da/de9/f4f 52 1 2023-12-16T03:16:11.939 INFO:tasks.workunit.client.0.smithi064.stdout:2/644: mknod d1/d15/d1b/d49/da0/cd1 0 2023-12-16T03:16:11.939 INFO:tasks.workunit.client.0.smithi064.stdout:2/645: chown d1/d15/d1b/d49/da0/l4b 27 1 2023-12-16T03:16:11.943 INFO:tasks.workunit.client.0.smithi064.stdout:6/675: truncate d3/f5 930751 0 2023-12-16T03:16:11.945 INFO:tasks.workunit.client.0.smithi064.stdout:4/796: creat d0/d42/ff8 x:0 0 0 2023-12-16T03:16:11.949 INFO:tasks.workunit.client.0.smithi064.stdout:7/749: rename d7/d3e/d42/d89/d74 to d7/d3e/d42/d48/d51/d7c/df5 0 2023-12-16T03:16:11.955 INFO:tasks.workunit.client.0.smithi064.stdout:3/835: unlink db/d12/d1a/d2c/f5b 0 2023-12-16T03:16:11.958 INFO:tasks.workunit.client.0.smithi064.stdout:8/798: mkdir d0/d1d/d3c/d42/d113 0 2023-12-16T03:16:11.960 INFO:tasks.workunit.client.0.smithi064.stdout:8/799: write d0/fb6 [2508027,51527] 0 2023-12-16T03:16:11.963 INFO:tasks.workunit.client.0.smithi064.stdout:2/646: link d1/d15/fb8 d1/d15/fd2 0 2023-12-16T03:16:11.969 INFO:tasks.workunit.client.0.smithi064.stdout:4/797: creat d0/da/da6/df4/ff9 x:0 0 0 2023-12-16T03:16:11.970 INFO:tasks.workunit.client.0.smithi064.stdout:7/750: mkdir d7/d3e/d42/d89/d20/df6 0 2023-12-16T03:16:11.974 INFO:tasks.workunit.client.0.smithi064.stdout:8/800: creat d0/da/de9/d111/f114 x:0 0 0 2023-12-16T03:16:11.974 INFO:tasks.workunit.client.0.smithi064.stdout:8/801: chown d0/da/de9/d37/d3a/dab 364707 1 2023-12-16T03:16:11.976 INFO:tasks.workunit.client.0.smithi064.stdout:6/676: mkdir d3/d8/d1f/d26/dcc 0 2023-12-16T03:16:11.977 INFO:tasks.workunit.client.0.smithi064.stdout:4/798: stat d0/d42/d4c/l86 0 2023-12-16T03:16:11.977 INFO:tasks.workunit.client.0.smithi064.stdout:3/836: dwrite db/d12/d1a/d2c/d34/d4c/f82 [0,4194304] 0 2023-12-16T03:16:11.978 INFO:tasks.workunit.client.0.smithi064.stdout:7/751: mkdir d7/df7 0 2023-12-16T03:16:11.979 INFO:tasks.workunit.client.0.smithi064.stdout:7/752: getdents d7/d3e/d42/d43 0 2023-12-16T03:16:11.981 INFO:tasks.workunit.client.0.smithi064.stdout:8/802: creat d0/da/de9/d5a/d10c/f115 x:0 0 0 2023-12-16T03:16:11.981 INFO:tasks.workunit.client.0.smithi064.stdout:8/803: chown d0/da/de9/d37/d3a/dab/dfa 108 1 2023-12-16T03:16:11.983 INFO:tasks.workunit.client.0.smithi064.stdout:2/647: rename d1/d15/d1b/f33 to d1/d15/d1b/dc3/fd3 0 2023-12-16T03:16:11.983 INFO:tasks.workunit.client.0.smithi064.stdout:2/648: write d1/d15/d23/d2d/f9b [336442,43952] 0 2023-12-16T03:16:11.983 INFO:tasks.workunit.client.0.smithi064.stdout:2/649: chown d1/d15/d7d/f6f 33076805 1 2023-12-16T03:16:11.983 INFO:tasks.workunit.client.0.smithi064.stdout:2/650: chown d1/f3a 257960 1 2023-12-16T03:16:11.983 INFO:tasks.workunit.client.0.smithi064.stdout:2/651: chown d1/d15/d1b/d61/d63/c8c 38921507 1 2023-12-16T03:16:11.984 INFO:tasks.workunit.client.0.smithi064.stdout:6/677: symlink d3/d80/lcd 0 2023-12-16T03:16:11.984 INFO:tasks.workunit.client.0.smithi064.stdout:6/678: fsync d3/d9/f45 0 2023-12-16T03:16:11.985 INFO:tasks.workunit.client.0.smithi064.stdout:4/799: creat d0/d1e/d36/ffa x:0 0 0 2023-12-16T03:16:11.989 INFO:tasks.workunit.client.0.smithi064.stdout:3/837: getdents db/d12/d1a/d31 0 2023-12-16T03:16:11.993 INFO:tasks.workunit.client.0.smithi064.stdout:8/804: dread d0/f7 [0,4194304] 0 2023-12-16T03:16:11.993 INFO:tasks.workunit.client.0.smithi064.stdout:8/805: fdatasync d0/da/de9/d37/f74 0 2023-12-16T03:16:11.993 INFO:tasks.workunit.client.0.smithi064.stdout:3/838: write db/d12/d1a/d2c/d34/de7/f7a [379872,106817] 0 2023-12-16T03:16:11.993 INFO:tasks.workunit.client.0.smithi064.stdout:6/679: dread d3/d8/d1f/d26/f3b [0,4194304] 0 2023-12-16T03:16:11.996 INFO:tasks.workunit.client.0.smithi064.stdout:6/680: write d3/d8/da/f43 [885906,64333] 0 2023-12-16T03:16:11.996 INFO:tasks.workunit.client.0.smithi064.stdout:6/681: write d3/d8/da/f8e [199835,21828] 0 2023-12-16T03:16:11.997 INFO:tasks.workunit.client.0.smithi064.stdout:2/652: creat d1/db3/fd4 x:0 0 0 2023-12-16T03:16:11.998 INFO:tasks.workunit.client.0.smithi064.stdout:4/800: truncate d0/d42/d4c/d70/fbf 3376516 0 2023-12-16T03:16:11.998 INFO:tasks.workunit.client.0.smithi064.stdout:4/801: chown d0/d42/d4c/d70/cde 1032 1 2023-12-16T03:16:11.998 INFO:tasks.workunit.client.0.smithi064.stdout:4/802: read d0/d1e/f69 [2409342,30396] 0 2023-12-16T03:16:11.999 INFO:tasks.workunit.client.0.smithi064.stdout:7/753: dwrite d7/d3e/d42/d48/d51/d7c/d52/fbd [0,4194304] 0 2023-12-16T03:16:11.999 INFO:tasks.workunit.client.0.smithi064.stdout:3/839: mknod db/d12/d1a/d2c/d34/dcd/c111 0 2023-12-16T03:16:12.002 INFO:tasks.workunit.client.0.smithi064.stdout:3/840: dread db/d12/d4e/f73 [0,4194304] 0 2023-12-16T03:16:12.002 INFO:tasks.workunit.client.0.smithi064.stdout:3/841: chown db/d12/d1a/d2c/d34/d4c/de5/f104 15372 1 2023-12-16T03:16:12.003 INFO:tasks.workunit.client.0.smithi064.stdout:6/682: rmdir d3/d9/dbe 39 2023-12-16T03:16:12.004 INFO:tasks.workunit.client.0.smithi064.stdout:3/842: write db/d12/d1a/d2c/d34/f8b [50829,89149] 0 2023-12-16T03:16:12.004 INFO:tasks.workunit.client.0.smithi064.stdout:2/653: creat d1/d15/d1b/d9c/fd5 x:0 0 0 2023-12-16T03:16:12.007 INFO:tasks.workunit.client.0.smithi064.stdout:3/843: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/f78 [0,4194304] 0 2023-12-16T03:16:12.008 INFO:tasks.workunit.client.0.smithi064.stdout:8/806: symlink d0/da/de9/d37/d3a/dab/dfa/d46/d54/d7c/l116 0 2023-12-16T03:16:12.008 INFO:tasks.workunit.client.0.smithi064.stdout:0/710: sync 2023-12-16T03:16:12.008 INFO:tasks.workunit.client.0.smithi064.stdout:9/757: sync 2023-12-16T03:16:12.008 INFO:tasks.workunit.client.0.smithi064.stdout:1/849: sync 2023-12-16T03:16:12.008 INFO:tasks.workunit.client.0.smithi064.stdout:9/758: write d2/d2d/ff5 [812225,105089] 0 2023-12-16T03:16:12.008 INFO:tasks.workunit.client.0.smithi064.stdout:9/759: write d2/dc/d24/d39/fee [680918,12475] 0 2023-12-16T03:16:12.008 INFO:tasks.workunit.client.0.smithi064.stdout:9/760: readlink d2/d7e/l87 0 2023-12-16T03:16:12.008 INFO:tasks.workunit.client.0.smithi064.stdout:9/761: truncate d2/d2d/daf/fc5 779867 0 2023-12-16T03:16:12.009 INFO:tasks.workunit.client.0.smithi064.stdout:9/762: write d2/f2e [1413941,32924] 0 2023-12-16T03:16:12.009 INFO:tasks.workunit.client.0.smithi064.stdout:9/763: chown d2/d2d/d3b/d3c 12 1 2023-12-16T03:16:12.010 INFO:tasks.workunit.client.0.smithi064.stdout:4/803: rmdir d0/da/da6 39 2023-12-16T03:16:12.011 INFO:tasks.workunit.client.0.smithi064.stdout:4/804: readlink d0/d42/d66/d33/l9a 0 2023-12-16T03:16:12.011 INFO:tasks.workunit.client.0.smithi064.stdout:4/805: fsync d0/d1e/d36/f9b 0 2023-12-16T03:16:12.021 INFO:tasks.workunit.client.0.smithi064.stdout:6/683: mkdir d3/d80/d92/dce 0 2023-12-16T03:16:12.022 INFO:tasks.workunit.client.0.smithi064.stdout:6/684: write d3/d8/d13/d46/f98 [143406,55891] 0 2023-12-16T03:16:12.023 INFO:tasks.workunit.client.0.smithi064.stdout:2/654: rmdir d1/d15/d1b/d61/d63 39 2023-12-16T03:16:12.023 INFO:tasks.workunit.client.0.smithi064.stdout:2/655: stat d1/d15/fd2 0 2023-12-16T03:16:12.023 INFO:tasks.workunit.client.0.smithi064.stdout:2/656: fdatasync d1/d15/d7d/f62 0 2023-12-16T03:16:12.023 INFO:tasks.workunit.client.0.smithi064.stdout:2/657: readlink d1/d15/d1b/d49/lbb 0 2023-12-16T03:16:12.025 INFO:tasks.workunit.client.0.smithi064.stdout:8/807: rename d0/da/de9/d37/dbf to d0/da/de9/d37/d3a/dab/dfa/dc0/d117 0 2023-12-16T03:16:12.027 INFO:tasks.workunit.client.0.smithi064.stdout:9/764: link d2/d7e/f8d d2/d2d/d6c/ffc 0 2023-12-16T03:16:12.032 INFO:tasks.workunit.client.0.smithi064.stdout:5/667: sync 2023-12-16T03:16:12.034 INFO:tasks.workunit.client.0.smithi064.stdout:1/850: dwrite d3/dd/d11/d2f/f5f [0,4194304] 0 2023-12-16T03:16:12.034 INFO:tasks.workunit.client.0.smithi064.stdout:1/851: chown d3/dd/d23/d60/fe6 4718762 1 2023-12-16T03:16:12.034 INFO:tasks.workunit.client.0.smithi064.stdout:0/711: dwrite d2/f27 [0,4194304] 0 2023-12-16T03:16:12.034 INFO:tasks.workunit.client.0.smithi064.stdout:4/806: creat d0/d12/d48/d87/ffb x:0 0 0 2023-12-16T03:16:12.035 INFO:tasks.workunit.client.0.smithi064.stdout:8/808: mknod d0/d1d/d73/c118 0 2023-12-16T03:16:12.043 INFO:tasks.workunit.client.0.smithi064.stdout:9/765: dread d2/d2d/d3b/d3c/f1c [0,4194304] 0 2023-12-16T03:16:12.044 INFO:tasks.workunit.client.0.smithi064.stdout:2/658: dwrite d1/d15/d23/d2d/fc4 [0,4194304] 0 2023-12-16T03:16:12.046 INFO:tasks.workunit.client.0.smithi064.stdout:0/712: write d2/d8/f45 [3851142,59957] 0 2023-12-16T03:16:12.048 INFO:tasks.workunit.client.0.smithi064.stdout:2/659: write d1/d15/d23/d2d/f3c [209942,104685] 0 2023-12-16T03:16:12.048 INFO:tasks.workunit.client.0.smithi064.stdout:2/660: chown d1/d15/d23/d2d/f3c 249616720 1 2023-12-16T03:16:12.052 INFO:tasks.workunit.client.0.smithi064.stdout:9/766: dread d2/dc/d24/d39/d42/d57/f46 [0,4194304] 0 2023-12-16T03:16:12.052 INFO:tasks.workunit.client.0.smithi064.stdout:9/767: truncate d2/d2d/d3b/d3c/d4b/fc7 97806 0 2023-12-16T03:16:12.053 INFO:tasks.workunit.client.0.smithi064.stdout:0/713: symlink d2/d8/da/df/daf/lef 0 2023-12-16T03:16:12.056 INFO:tasks.workunit.client.0.smithi064.stdout:5/668: dwrite d0/d19/fad [4194304,4194304] 0 2023-12-16T03:16:12.056 INFO:tasks.workunit.client.0.smithi064.stdout:1/852: dwrite d3/d36/d44/d4d/fe1 [0,4194304] 0 2023-12-16T03:16:12.057 INFO:tasks.workunit.client.0.smithi064.stdout:1/853: chown d3/dd/d23/d60/cb0 25241106 1 2023-12-16T03:16:12.057 INFO:tasks.workunit.client.0.smithi064.stdout:1/854: write d3/d36/d44/d4d/da8/dce/fdc [923630,61819] 0 2023-12-16T03:16:12.057 INFO:tasks.workunit.client.0.smithi064.stdout:1/855: dread - d3/d36/f83 zero size 2023-12-16T03:16:12.057 INFO:tasks.workunit.client.0.smithi064.stdout:2/661: creat d1/d15/d1b/d61/d63/da2/fd6 x:0 0 0 2023-12-16T03:16:12.058 INFO:tasks.workunit.client.0.smithi064.stdout:1/856: dread d3/dd/d11/d2f/f64 [0,4194304] 0 2023-12-16T03:16:12.059 INFO:tasks.workunit.client.0.smithi064.stdout:9/768: mkdir d2/d2d/d36/db4/dfd 0 2023-12-16T03:16:12.067 INFO:tasks.workunit.client.0.smithi064.stdout:5/669: creat d0/d19/d48/d8f/dac/d23/fec x:0 0 0 2023-12-16T03:16:12.069 INFO:tasks.workunit.client.0.smithi064.stdout:5/670: write d0/d19/fad [7582141,34400] 0 2023-12-16T03:16:12.072 INFO:tasks.workunit.client.0.smithi064.stdout:4/807: write d0/d1e/f29 [6098066,130218] 0 2023-12-16T03:16:12.072 INFO:tasks.workunit.client.0.smithi064.stdout:9/769: rmdir d2/dc/d24/d39/d5e/d6f 39 2023-12-16T03:16:12.075 INFO:tasks.workunit.client.0.smithi064.stdout:5/671: link d0/d7/f2e d0/d7/d8b/dc0/fed 0 2023-12-16T03:16:12.077 INFO:tasks.workunit.client.0.smithi064.stdout:0/714: truncate d2/f27 1674283 0 2023-12-16T03:16:12.077 INFO:tasks.workunit.client.0.smithi064.stdout:0/715: chown d2/d29/dc8 129967581 1 2023-12-16T03:16:12.079 INFO:tasks.workunit.client.0.smithi064.stdout:5/672: creat d0/d19/fee x:0 0 0 2023-12-16T03:16:12.080 INFO:tasks.workunit.client.0.smithi064.stdout:4/808: mkdir d0/d42/d4c/d70/dfc 0 2023-12-16T03:16:12.080 INFO:tasks.workunit.client.0.smithi064.stdout:1/857: dwrite d3/dd/d11/f56 [0,4194304] 0 2023-12-16T03:16:12.082 INFO:tasks.workunit.client.0.smithi064.stdout:2/662: dwrite d1/f4 [4194304,4194304] 0 2023-12-16T03:16:12.084 INFO:tasks.workunit.client.0.smithi064.stdout:5/673: link d0/d14/d20/f38 d0/d19/d48/d8f/d3e/d35/d5d/d9a/fef 0 2023-12-16T03:16:12.092 INFO:tasks.workunit.client.0.smithi064.stdout:9/770: dwrite d2/f33 [0,4194304] 0 2023-12-16T03:16:12.096 INFO:tasks.workunit.client.0.smithi064.stdout:1/858: getdents d3/d36/d44/d4d/dad 0 2023-12-16T03:16:12.096 INFO:tasks.workunit.client.0.smithi064.stdout:1/859: fsync d3/d36/d44/d4d/f3f 0 2023-12-16T03:16:12.100 INFO:tasks.workunit.client.0.smithi064.stdout:9/771: truncate d2/d2d/daf/fc5 340253 0 2023-12-16T03:16:12.106 INFO:tasks.workunit.client.0.smithi064.stdout:5/674: rename d0/d7/d8b to d0/d19/d48/d8f/dac/d23/d67/de4/df0 0 2023-12-16T03:16:12.113 INFO:tasks.workunit.client.0.smithi064.stdout:2/663: dwrite d1/d15/d1b/dc3/fd3 [0,4194304] 0 2023-12-16T03:16:12.114 INFO:tasks.workunit.client.0.smithi064.stdout:0/716: dwrite d2/d8/da/fb6 [0,4194304] 0 2023-12-16T03:16:12.115 INFO:tasks.workunit.client.0.smithi064.stdout:4/809: dwrite d0/d12/f2a [0,4194304] 0 2023-12-16T03:16:12.118 INFO:tasks.workunit.client.0.smithi064.stdout:5/675: dread d0/d14/d20/d37/d70/d71/f72 [0,4194304] 0 2023-12-16T03:16:12.118 INFO:tasks.workunit.client.0.smithi064.stdout:5/676: fsync d0/fc3 0 2023-12-16T03:16:12.121 INFO:tasks.workunit.client.0.smithi064.stdout:0/717: truncate d2/d7/d10/d21/f39 447283 0 2023-12-16T03:16:12.122 INFO:tasks.workunit.client.0.smithi064.stdout:1/860: dwrite d3/d36/d44/d4d/da8/dce/f100 [0,4194304] 0 2023-12-16T03:16:12.127 INFO:tasks.workunit.client.0.smithi064.stdout:5/677: dread d0/d19/d48/d8f/d3e/d35/d5d/fbd [0,4194304] 0 2023-12-16T03:16:12.127 INFO:tasks.workunit.client.0.smithi064.stdout:0/718: read d2/d8/da/f62 [2211007,116197] 0 2023-12-16T03:16:12.139 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:12 smithi064 ceph-mon[111958]: pgmap v5: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2023-12-16T03:16:12.139 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:12 smithi064 ceph-mon[111958]: mgrmap e23: smithi184.urtxla(active, since 4s) 2023-12-16T03:16:12.142 INFO:tasks.workunit.client.0.smithi064.stdout:2/664: write d1/d15/f28 [829778,91270] 0 2023-12-16T03:16:12.147 INFO:tasks.workunit.client.0.smithi064.stdout:4/810: dwrite d0/da/f16 [0,4194304] 0 2023-12-16T03:16:12.156 INFO:tasks.workunit.client.0.smithi064.stdout:5/678: dwrite d0/d19/d48/d8f/dac/d23/d67/de4/df0/fba [0,4194304] 0 2023-12-16T03:16:12.156 INFO:tasks.workunit.client.0.smithi064.stdout:5/679: truncate d0/d14/d4e/fc6 158540 0 2023-12-16T03:16:12.156 INFO:tasks.workunit.client.0.smithi064.stdout:1/861: dwrite d3/dd/d11/d6a/f75 [0,4194304] 0 2023-12-16T03:16:12.157 INFO:tasks.workunit.client.0.smithi064.stdout:0/719: rename d2/d29/d66/db9/fbf to d2/d8/da/df/ff0 0 2023-12-16T03:16:12.158 INFO:tasks.workunit.client.0.smithi064.stdout:4/811: mknod d0/d42/d4c/d70/d8c/da9/dee/cfd 0 2023-12-16T03:16:12.162 INFO:tasks.workunit.client.0.smithi064.stdout:2/665: dwrite d1/d15/d23/f51 [0,4194304] 0 2023-12-16T03:16:12.162 INFO:tasks.workunit.client.0.smithi064.stdout:2/666: write d1/d15/d1b/d49/da0/d8f/f9d [677767,82009] 0 2023-12-16T03:16:12.163 INFO:tasks.workunit.client.0.smithi064.stdout:5/680: rename d0/d14/d20/d37/d3c/f52 to d0/d19/d48/d8f/dac/d23/d91/ff1 0 2023-12-16T03:16:12.164 INFO:tasks.workunit.client.0.smithi064.stdout:0/720: stat d2/d7/d10/d21/lac 0 2023-12-16T03:16:12.166 INFO:tasks.workunit.client.0.smithi064.stdout:4/812: symlink d0/d42/d66/d33/lfe 0 2023-12-16T03:16:12.170 INFO:tasks.workunit.client.0.smithi064.stdout:5/681: mkdir d0/d19/d48/d8f/d3e/d35/d5d/d9a/df2 0 2023-12-16T03:16:12.171 INFO:tasks.workunit.client.0.smithi064.stdout:0/721: rmdir d2/d8/da/df/db0 39 2023-12-16T03:16:12.172 INFO:tasks.workunit.client.0.smithi064.stdout:0/722: chown d2/d8/da/f9a 0 1 2023-12-16T03:16:12.175 INFO:tasks.workunit.client.0.smithi064.stdout:4/813: truncate d0/d1e/f29 5820363 0 2023-12-16T03:16:12.176 INFO:tasks.workunit.client.0.smithi064.stdout:0/723: mkdir d2/d8/da/d11/df1 0 2023-12-16T03:16:12.180 INFO:tasks.workunit.client.0.smithi064.stdout:4/814: link d0/d42/d4c/d70/d8c/lae d0/d42/d4c/d70/dbe/lff 0 2023-12-16T03:16:12.180 INFO:tasks.workunit.client.0.smithi064.stdout:4/815: readlink d0/d42/d4c/d70/laa 0 2023-12-16T03:16:12.181 INFO:tasks.workunit.client.0.smithi064.stdout:1/862: dwrite d3/dd/d23/d4f/f8d [0,4194304] 0 2023-12-16T03:16:12.181 INFO:tasks.workunit.client.0.smithi064.stdout:1/863: stat d3/dd/d23/d4f/cdd 0 2023-12-16T03:16:12.181 INFO:tasks.workunit.client.0.smithi064.stdout:1/864: fsync d3/dd/de4/fed 0 2023-12-16T03:16:12.182 INFO:tasks.workunit.client.0.smithi064.stdout:0/724: mknod d2/cf2 0 2023-12-16T03:16:12.182 INFO:tasks.workunit.client.0.smithi064.stdout:0/725: dread - d2/d7/d10/d21/d31/fa2 zero size 2023-12-16T03:16:12.182 INFO:tasks.workunit.client.0.smithi064.stdout:0/726: chown d2/d8/da/cc 150692039 1 2023-12-16T03:16:12.184 INFO:tasks.workunit.client.0.smithi064.stdout:4/816: mknod d0/d42/d4c/d70/d8c/dc7/c100 0 2023-12-16T03:16:12.184 INFO:tasks.workunit.client.0.smithi064.stdout:4/817: truncate d0/da/f7a 4925066 0 2023-12-16T03:16:12.186 INFO:tasks.workunit.client.0.smithi064.stdout:4/818: write d0/d42/d4c/f62 [454980,33963] 0 2023-12-16T03:16:12.186 INFO:tasks.workunit.client.0.smithi064.stdout:4/819: chown d0/d42/d53/f1d 55983 1 2023-12-16T03:16:12.191 INFO:tasks.workunit.client.0.smithi064.stdout:1/865: rename d3/d36/d44/d4d/da8/dce to d3/dd/d11/d2f/d10a 0 2023-12-16T03:16:12.192 INFO:tasks.workunit.client.0.smithi064.stdout:1/866: chown d3/dd/d23/dcb/de3 6 1 2023-12-16T03:16:12.192 INFO:tasks.workunit.client.0.smithi064.stdout:1/867: chown d3/d36/d44/d4d/da8/l104 1240 1 2023-12-16T03:16:12.192 INFO:tasks.workunit.client.0.smithi064.stdout:2/667: dwrite d1/d15/d1b/d61/fb7 [0,4194304] 0 2023-12-16T03:16:12.202 INFO:tasks.workunit.client.0.smithi064.stdout:2/668: dread d1/d15/d1b/d61/f5f [0,4194304] 0 2023-12-16T03:16:12.202 INFO:tasks.workunit.client.0.smithi064.stdout:0/727: dwrite d2/d7/d10/f1f [0,4194304] 0 2023-12-16T03:16:12.202 INFO:tasks.workunit.client.0.smithi064.stdout:0/728: stat d2/d8/da/d11/c26 0 2023-12-16T03:16:12.224 INFO:tasks.workunit.client.0.smithi064.stdout:2/669: dwrite d1/d15/d1b/d49/da0/fcd [0,4194304] 0 2023-12-16T03:16:12.225 INFO:tasks.workunit.client.0.smithi064.stdout:0/729: dwrite d2/d8/da/df/daf/dbd/fde [0,4194304] 0 2023-12-16T03:16:12.297 INFO:tasks.workunit.client.0.smithi064.stdout:4/820: link d0/d42/d4c/d70/d8c/da9/df3/l96 d0/d42/d4c/d70/d8c/da9/dee/l101 0 2023-12-16T03:16:12.304 INFO:tasks.workunit.client.0.smithi064.stdout:1/868: creat d3/dd/d23/f10b x:0 0 0 2023-12-16T03:16:12.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:12 smithi184 ceph-mon[121180]: pgmap v5: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2023-12-16T03:16:12.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:12 smithi184 ceph-mon[121180]: mgrmap e23: smithi184.urtxla(active, since 4s) 2023-12-16T03:16:12.313 INFO:tasks.workunit.client.0.smithi064.stdout:2/670: creat d1/d15/d58/fd7 x:0 0 0 2023-12-16T03:16:12.314 INFO:tasks.workunit.client.0.smithi064.stdout:2/671: write d1/d15/d1b/d9c/d69/f56 [1011707,65235] 0 2023-12-16T03:16:12.316 INFO:tasks.workunit.client.0.smithi064.stdout:7/754: sync 2023-12-16T03:16:12.317 INFO:tasks.workunit.client.0.smithi064.stdout:0/730: symlink d2/d29/db1/lf3 0 2023-12-16T03:16:12.318 INFO:tasks.workunit.client.0.smithi064.stdout:4/821: rename d0/d42/d66/d33/fab to d0/d42/d53/f102 0 2023-12-16T03:16:12.321 INFO:tasks.workunit.client.0.smithi064.stdout:1/869: mknod d3/d22/dab/c10c 0 2023-12-16T03:16:12.322 INFO:tasks.workunit.client.0.smithi064.stdout:2/672: mknod d1/d15/d1b/d61/d63/da2/cd8 0 2023-12-16T03:16:12.324 INFO:tasks.workunit.client.0.smithi064.stdout:7/755: link d7/d26/d30/fb5 d7/d3e/d42/d89/d20/d6f/d93/db0/ff8 0 2023-12-16T03:16:12.326 INFO:tasks.workunit.client.0.smithi064.stdout:0/731: creat d2/d29/db1/ff4 x:0 0 0 2023-12-16T03:16:12.329 INFO:tasks.workunit.client.0.smithi064.stdout:4/822: creat d0/d1e/f103 x:0 0 0 2023-12-16T03:16:12.334 INFO:tasks.workunit.client.0.smithi064.stdout:1/870: rename d3/d36/c7d to d3/dd/d11/dbf/c10d 0 2023-12-16T03:16:12.337 INFO:tasks.workunit.client.0.smithi064.stdout:2/673: rmdir d1/d15 39 2023-12-16T03:16:12.337 INFO:tasks.workunit.client.0.smithi064.stdout:2/674: write d1/d15/d7d/dac/f44 [828576,43867] 0 2023-12-16T03:16:12.338 INFO:tasks.workunit.client.0.smithi064.stdout:4/823: creat d0/d42/d53/dd4/f104 x:0 0 0 2023-12-16T03:16:12.341 INFO:tasks.workunit.client.0.smithi064.stdout:1/871: mkdir d3/d36/d44/d10e 0 2023-12-16T03:16:12.341 INFO:tasks.workunit.client.0.smithi064.stdout:1/872: chown d3/d36/d44/d4d/d58/c61 1328 1 2023-12-16T03:16:12.341 INFO:tasks.workunit.client.0.smithi064.stdout:0/732: dwrite d2/d8/f1c [0,4194304] 0 2023-12-16T03:16:12.341 INFO:tasks.workunit.client.0.smithi064.stdout:2/675: symlink d1/d76/ld9 0 2023-12-16T03:16:12.343 INFO:tasks.workunit.client.0.smithi064.stdout:4/824: creat d0/d42/d53/de6/f105 x:0 0 0 2023-12-16T03:16:12.343 INFO:tasks.workunit.client.0.smithi064.stdout:4/825: chown d0/da/f6f 99329 1 2023-12-16T03:16:12.343 INFO:tasks.workunit.client.0.smithi064.stdout:4/826: write d0/d42/d4c/d70/d8c/fc3 [1043793,115381] 0 2023-12-16T03:16:12.345 INFO:tasks.workunit.client.0.smithi064.stdout:1/873: rename d3/dd/d11/d6a to d3/dd/d11/dbf/d10f 0 2023-12-16T03:16:12.346 INFO:tasks.workunit.client.0.smithi064.stdout:0/733: creat d2/d8/da/dbc/ff5 x:0 0 0 2023-12-16T03:16:12.348 INFO:tasks.workunit.client.0.smithi064.stdout:0/734: symlink d2/d29/de7/lf6 0 2023-12-16T03:16:12.350 INFO:tasks.workunit.client.0.smithi064.stdout:0/735: link d2/d8/da/df/f80 d2/d7/d10/dc4/dcc/db5/ff7 0 2023-12-16T03:16:12.351 INFO:tasks.workunit.client.0.smithi064.stdout:0/736: write d2/d8/da/df/ff0 [344861,74389] 0 2023-12-16T03:16:12.352 INFO:tasks.workunit.client.0.smithi064.stdout:4/827: dread d0/d42/f5c [4194304,4194304] 0 2023-12-16T03:16:12.352 INFO:tasks.workunit.client.0.smithi064.stdout:4/828: truncate d0/d12/d48/d87/fca 841270 0 2023-12-16T03:16:12.353 INFO:tasks.workunit.client.0.smithi064.stdout:0/737: creat d2/d8/da/df/daf/dbd/ff8 x:0 0 0 2023-12-16T03:16:12.355 INFO:tasks.workunit.client.0.smithi064.stdout:4/829: truncate d0/d1e/f29 4658902 0 2023-12-16T03:16:12.360 INFO:tasks.workunit.client.0.smithi064.stdout:2/676: dwrite d1/d15/fb8 [0,4194304] 0 2023-12-16T03:16:12.361 INFO:tasks.workunit.client.0.smithi064.stdout:2/677: write d1/d15/d7d/f79 [3642131,11222] 0 2023-12-16T03:16:12.361 INFO:tasks.workunit.client.0.smithi064.stdout:2/678: stat d1/db3/lba 0 2023-12-16T03:16:12.362 INFO:tasks.workunit.client.0.smithi064.stdout:2/679: chown d1/d15/d7d/dac/c54 0 1 2023-12-16T03:16:12.370 INFO:tasks.workunit.client.0.smithi064.stdout:2/680: creat d1/d15/d1b/d9c/fda x:0 0 0 2023-12-16T03:16:12.376 INFO:tasks.workunit.client.0.smithi064.stdout:2/681: mknod d1/d15/d23/d2d/cdb 0 2023-12-16T03:16:12.376 INFO:tasks.workunit.client.0.smithi064.stdout:2/682: dread - d1/d15/d1b/d9c/fda zero size 2023-12-16T03:16:12.377 INFO:tasks.workunit.client.0.smithi064.stdout:2/683: readlink d1/d15/d1b/l25 0 2023-12-16T03:16:12.377 INFO:tasks.workunit.client.0.smithi064.stdout:2/684: fsync d1/d15/d1b/d49/f6b 0 2023-12-16T03:16:12.378 INFO:tasks.workunit.client.0.smithi064.stdout:2/685: link d1/d15/d1b/d61/d63/c8c d1/db3/cdc 0 2023-12-16T03:16:12.378 INFO:tasks.workunit.client.0.smithi064.stdout:2/686: fdatasync d1/d15/f75 0 2023-12-16T03:16:12.378 INFO:tasks.workunit.client.0.smithi064.stdout:2/687: truncate d1/d15/d23/d2d/fc1 685706 0 2023-12-16T03:16:12.378 INFO:tasks.workunit.client.0.smithi064.stdout:1/874: dwrite d3/dd/d11/d3b/fe0 [0,4194304] 0 2023-12-16T03:16:12.378 INFO:tasks.workunit.client.0.smithi064.stdout:1/875: chown d3/dd/f59 4137 1 2023-12-16T03:16:12.379 INFO:tasks.workunit.client.0.smithi064.stdout:4/830: dwrite d0/d42/d53/f1d [4194304,4194304] 0 2023-12-16T03:16:12.379 INFO:tasks.workunit.client.0.smithi064.stdout:2/688: mknod d1/d15/d58/dab/cdd 0 2023-12-16T03:16:12.379 INFO:tasks.workunit.client.0.smithi064.stdout:1/876: write d3/d22/d57/db1/fc1 [3876872,123046] 0 2023-12-16T03:16:12.382 INFO:tasks.workunit.client.0.smithi064.stdout:4/831: mknod d0/d42/d66/c106 0 2023-12-16T03:16:12.383 INFO:tasks.workunit.client.0.smithi064.stdout:2/689: symlink d1/d15/d7d/dc6/lde 0 2023-12-16T03:16:12.386 INFO:tasks.workunit.client.0.smithi064.stdout:1/877: symlink d3/dd/d11/d3b/l110 0 2023-12-16T03:16:12.386 INFO:tasks.workunit.client.0.smithi064.stdout:1/878: chown d3/d22/dab/fea 14242372 1 2023-12-16T03:16:12.386 INFO:tasks.workunit.client.0.smithi064.stdout:1/879: write d3/d22/fd8 [1794910,123809] 0 2023-12-16T03:16:12.389 INFO:tasks.workunit.client.0.smithi064.stdout:4/832: link d0/d42/d56/fef d0/da/da6/de4/f107 0 2023-12-16T03:16:12.393 INFO:tasks.workunit.client.0.smithi064.stdout:4/833: write d0/d42/f5c [1820886,63973] 0 2023-12-16T03:16:12.395 INFO:tasks.workunit.client.0.smithi064.stdout:2/690: rename d1/f3a to d1/d15/d1b/d49/da0/fdf 0 2023-12-16T03:16:12.395 INFO:tasks.workunit.client.0.smithi064.stdout:2/691: fsync d1/d15/f75 0 2023-12-16T03:16:12.401 INFO:tasks.workunit.client.0.smithi064.stdout:2/692: rename d1/d15/d1b/d61/d63/lb0 to d1/d15/d1b/d49/da0/d8f/le0 0 2023-12-16T03:16:12.401 INFO:tasks.workunit.client.0.smithi064.stdout:3/844: sync 2023-12-16T03:16:12.401 INFO:tasks.workunit.client.0.smithi064.stdout:3/845: write db/d4f/d51/fdc [953905,79634] 0 2023-12-16T03:16:12.401 INFO:tasks.workunit.client.0.smithi064.stdout:3/846: chown db/d12/d21/f69 81 1 2023-12-16T03:16:12.403 INFO:tasks.workunit.client.0.smithi064.stdout:2/693: mkdir d1/d15/d7d/dc6/de1 0 2023-12-16T03:16:12.405 INFO:tasks.workunit.client.0.smithi064.stdout:3/847: mknod db/d12/d1a/d2c/d34/d4c/d6a/d93/c112 0 2023-12-16T03:16:12.417 INFO:tasks.workunit.client.0.smithi064.stdout:1/880: dwrite d3/d22/fd5 [0,4194304] 0 2023-12-16T03:16:12.426 INFO:tasks.workunit.client.0.smithi064.stdout:4/834: dwrite d0/d1e/d36/f4d [0,4194304] 0 2023-12-16T03:16:12.428 INFO:tasks.workunit.client.0.smithi064.stdout:2/694: dwrite d1/d15/d1b/d9c/fda [0,4194304] 0 2023-12-16T03:16:12.428 INFO:tasks.workunit.client.0.smithi064.stdout:2/695: chown d1/d15/f75 46 1 2023-12-16T03:16:12.428 INFO:tasks.workunit.client.0.smithi064.stdout:2/696: chown d1/d15/d1b/d49/lbb 7151 1 2023-12-16T03:16:12.429 INFO:tasks.workunit.client.0.smithi064.stdout:4/835: link d0/d1e/d36/f46 d0/d42/d53/de6/f108 0 2023-12-16T03:16:12.429 INFO:tasks.workunit.client.0.smithi064.stdout:4/836: chown d0/d42/d4c/d70/d85 848723 1 2023-12-16T03:16:12.435 INFO:tasks.workunit.client.0.smithi064.stdout:2/697: mknod d1/db3/dc5/ce2 0 2023-12-16T03:16:12.436 INFO:tasks.workunit.client.0.smithi064.stdout:4/837: symlink d0/d42/d4c/d70/d8c/da9/df3/l109 0 2023-12-16T03:16:12.440 INFO:tasks.workunit.client.0.smithi064.stdout:1/881: dwrite d3/dd/d11/dbf/d10f/f7a [0,4194304] 0 2023-12-16T03:16:12.447 INFO:tasks.workunit.client.0.smithi064.stdout:1/882: unlink d3/d36/d44/d4d/da8/fd3 0 2023-12-16T03:16:12.447 INFO:tasks.workunit.client.0.smithi064.stdout:1/883: write d3/dd/d11/d2f/f64 [273895,8393] 0 2023-12-16T03:16:12.447 INFO:tasks.workunit.client.0.smithi064.stdout:1/884: write d3/d36/d44/d4d/dad/dc5/fc8 [355360,82265] 0 2023-12-16T03:16:12.456 INFO:tasks.workunit.client.0.smithi064.stdout:4/838: dwrite d0/d1e/f69 [0,4194304] 0 2023-12-16T03:16:12.458 INFO:tasks.workunit.client.0.smithi064.stdout:4/839: creat d0/d42/d4c/d70/dfc/f10a x:0 0 0 2023-12-16T03:16:12.460 INFO:tasks.workunit.client.0.smithi064.stdout:4/840: unlink d0/d1e/d36/l74 0 2023-12-16T03:16:12.460 INFO:tasks.workunit.client.0.smithi064.stdout:4/841: dread - d0/d12/d48/d87/ffb zero size 2023-12-16T03:16:12.463 INFO:tasks.workunit.client.0.smithi064.stdout:4/842: mkdir d0/da/da6/de4/d10b 0 2023-12-16T03:16:12.464 INFO:tasks.workunit.client.0.smithi064.stdout:1/885: dwrite d3/dd/d23/f10b [0,4194304] 0 2023-12-16T03:16:12.482 INFO:tasks.workunit.client.0.smithi064.stdout:2/698: dwrite d1/d15/d7d/dac/fa8 [0,4194304] 0 2023-12-16T03:16:12.483 INFO:tasks.workunit.client.0.smithi064.stdout:2/699: write d1/d15/d23/d2d/fc1 [57184,42051] 0 2023-12-16T03:16:12.483 INFO:tasks.workunit.client.0.smithi064.stdout:1/886: dwrite d3/d22/f28 [0,4194304] 0 2023-12-16T03:16:12.486 INFO:tasks.workunit.client.0.smithi064.stdout:1/887: dread d3/d36/d44/d4d/f3f [0,4194304] 0 2023-12-16T03:16:12.486 INFO:tasks.workunit.client.0.smithi064.stdout:1/888: write d3/dd/d11/d3b/f69 [1641548,72640] 0 2023-12-16T03:16:12.486 INFO:tasks.workunit.client.0.smithi064.stdout:1/889: getdents d3/dd/d11/d38/df3 0 2023-12-16T03:16:12.487 INFO:tasks.workunit.client.0.smithi064.stdout:2/700: creat d1/d15/d1b/d61/d63/fe3 x:0 0 0 2023-12-16T03:16:12.487 INFO:tasks.workunit.client.0.smithi064.stdout:2/701: stat d1/d15/l90 0 2023-12-16T03:16:12.487 INFO:tasks.workunit.client.0.smithi064.stdout:2/702: chown d1/d15/d1b/d9c/c6c 126892717 1 2023-12-16T03:16:12.487 INFO:tasks.workunit.client.0.smithi064.stdout:2/703: stat d1/d15/d1b/d49/d4e/fb4 0 2023-12-16T03:16:12.487 INFO:tasks.workunit.client.0.smithi064.stdout:2/704: chown d1/d15/d7d 442 1 2023-12-16T03:16:12.488 INFO:tasks.workunit.client.0.smithi064.stdout:2/705: write d1/d15/d1b/d49/da0/d8f/f9d [752992,91580] 0 2023-12-16T03:16:12.490 INFO:tasks.workunit.client.0.smithi064.stdout:2/706: unlink d1/d15/f1a 0 2023-12-16T03:16:12.495 INFO:tasks.workunit.client.0.smithi064.stdout:2/707: rmdir d1/d15/d1b/d49/da0 39 2023-12-16T03:16:12.495 INFO:tasks.workunit.client.0.smithi064.stdout:2/708: write d1/d15/d23/fbd [908974,90787] 0 2023-12-16T03:16:12.496 INFO:tasks.workunit.client.0.smithi064.stdout:2/709: mknod d1/d15/d1b/ce4 0 2023-12-16T03:16:12.498 INFO:tasks.workunit.client.0.smithi064.stdout:2/710: symlink d1/d15/d1b/d49/le5 0 2023-12-16T03:16:12.503 INFO:tasks.workunit.client.0.smithi064.stdout:1/890: dwrite d3/d36/d44/d4d/dcc/fcd [0,4194304] 0 2023-12-16T03:16:12.508 INFO:tasks.workunit.client.0.smithi064.stdout:1/891: creat d3/dd/d23/d86/f111 x:0 0 0 2023-12-16T03:16:12.509 INFO:tasks.workunit.client.0.smithi064.stdout:2/711: dread d1/d15/d23/d2d/fc4 [0,4194304] 0 2023-12-16T03:16:12.513 INFO:tasks.workunit.client.0.smithi064.stdout:2/712: mknod d1/d15/d7d/dc6/ce6 0 2023-12-16T03:16:12.516 INFO:tasks.workunit.client.0.smithi064.stdout:6/685: sync 2023-12-16T03:16:12.516 INFO:tasks.workunit.client.0.smithi064.stdout:6/686: dread - d3/d8/d1f/d26/d47/fca zero size 2023-12-16T03:16:12.521 INFO:tasks.workunit.client.0.smithi064.stdout:2/713: link d1/d15/d1b/l8e d1/d15/d1b/d9c/d69/dcf/le7 0 2023-12-16T03:16:12.522 INFO:tasks.workunit.client.0.smithi064.stdout:1/892: dwrite d3/d36/d44/d4d/f4e [4194304,4194304] 0 2023-12-16T03:16:12.527 INFO:tasks.workunit.client.0.smithi064.stdout:2/714: mkdir d1/d15/d1b/d49/da0/de8 0 2023-12-16T03:16:12.530 INFO:tasks.workunit.client.0.smithi064.stdout:1/893: creat d3/dd/d11/d2f/d10a/f112 x:0 0 0 2023-12-16T03:16:12.530 INFO:tasks.workunit.client.0.smithi064.stdout:1/894: fsync d3/f26 0 2023-12-16T03:16:12.532 INFO:tasks.workunit.client.0.smithi064.stdout:6/687: dwrite d3/d8/d1f/d26/fb7 [0,4194304] 0 2023-12-16T03:16:12.533 INFO:tasks.workunit.client.0.smithi064.stdout:2/715: creat d1/d15/d7d/dc6/de1/fe9 x:0 0 0 2023-12-16T03:16:12.534 INFO:tasks.workunit.client.0.smithi064.stdout:1/895: mkdir d3/dd/d23/d86/d113 0 2023-12-16T03:16:12.534 INFO:tasks.workunit.client.0.smithi064.stdout:1/896: chown d3/dd/d11/d38 2510 1 2023-12-16T03:16:12.541 INFO:tasks.workunit.client.0.smithi064.stdout:1/897: creat d3/dd/d23/dcb/de3/f114 x:0 0 0 2023-12-16T03:16:12.550 INFO:tasks.workunit.client.0.smithi064.stdout:2/716: dwrite d1/d15/d1b/d9c/fbf [0,4194304] 0 2023-12-16T03:16:12.552 INFO:tasks.workunit.client.0.smithi064.stdout:2/717: mknod d1/d15/d7d/cea 0 2023-12-16T03:16:12.552 INFO:tasks.workunit.client.0.smithi064.stdout:2/718: chown d1/d15/d1b/c87 103013336 1 2023-12-16T03:16:12.555 INFO:tasks.workunit.client.0.smithi064.stdout:6/688: rename d3/d8/d1f/d26 to d3/d80/dcf 0 2023-12-16T03:16:12.558 INFO:tasks.workunit.client.0.smithi064.stdout:1/898: dwrite d3/d36/d44/d4d/f92 [0,4194304] 0 2023-12-16T03:16:12.560 INFO:tasks.workunit.client.0.smithi064.stdout:1/899: mknod d3/dd/d23/dcb/c115 0 2023-12-16T03:16:12.562 INFO:tasks.workunit.client.0.smithi064.stdout:1/900: link d3/dd/d23/d4f/daf/cbc d3/dd/de4/c116 0 2023-12-16T03:16:12.564 INFO:tasks.workunit.client.0.smithi064.stdout:1/901: read d3/d36/d44/d4d/d58/fa7 [3941689,85732] 0 2023-12-16T03:16:12.564 INFO:tasks.workunit.client.0.smithi064.stdout:1/902: fdatasync d3/dd/f59 0 2023-12-16T03:16:12.565 INFO:tasks.workunit.client.0.smithi064.stdout:1/903: creat d3/d36/d44/d4d/da8/dc4/f117 x:0 0 0 2023-12-16T03:16:12.566 INFO:tasks.workunit.client.0.smithi064.stdout:2/719: dread d1/f6 [0,4194304] 0 2023-12-16T03:16:12.567 INFO:tasks.workunit.client.0.smithi064.stdout:1/904: write d3/dd/d11/fa5 [398609,16303] 0 2023-12-16T03:16:12.569 INFO:tasks.workunit.client.0.smithi064.stdout:1/905: creat d3/d36/d44/d4d/dad/dc5/f118 x:0 0 0 2023-12-16T03:16:12.571 INFO:tasks.workunit.client.0.smithi064.stdout:1/906: creat d3/d36/d44/d4d/dad/f119 x:0 0 0 2023-12-16T03:16:12.571 INFO:tasks.workunit.client.0.smithi064.stdout:1/907: dread - d3/dd/d11/d2f/d10a/f106 zero size 2023-12-16T03:16:12.573 INFO:tasks.workunit.client.0.smithi064.stdout:1/908: symlink d3/d36/d44/d4d/dcc/l11a 0 2023-12-16T03:16:12.574 INFO:tasks.workunit.client.0.smithi064.stdout:1/909: creat d3/d36/d44/d4d/f11b x:0 0 0 2023-12-16T03:16:12.582 INFO:tasks.workunit.client.0.smithi064.stdout:2/720: dwrite d1/d15/d23/d2d/f98 [0,4194304] 0 2023-12-16T03:16:12.583 INFO:tasks.workunit.client.0.smithi064.stdout:6/689: dwrite d3/d8/da/f37 [0,4194304] 0 2023-12-16T03:16:12.583 INFO:tasks.workunit.client.0.smithi064.stdout:1/910: dread d3/dd/d11/f56 [0,4194304] 0 2023-12-16T03:16:12.583 INFO:tasks.workunit.client.0.smithi064.stdout:6/690: write d3/d8/d13/d46/d5e/da8/fae [798612,58527] 0 2023-12-16T03:16:12.585 INFO:tasks.workunit.client.0.smithi064.stdout:1/911: mkdir d3/dd/d23/d11c 0 2023-12-16T03:16:12.585 INFO:tasks.workunit.client.0.smithi064.stdout:1/912: read - d3/dd/d23/d86/ffc zero size 2023-12-16T03:16:12.585 INFO:tasks.workunit.client.0.smithi064.stdout:1/913: readlink d3/d36/d9e/l5a 0 2023-12-16T03:16:12.585 INFO:tasks.workunit.client.0.smithi064.stdout:1/914: chown d3/dd/d23/d60/d9d/cb2 48 1 2023-12-16T03:16:12.585 INFO:tasks.workunit.client.0.smithi064.stdout:1/915: stat d3/dd/d11/dbf/d10f/f7a 0 2023-12-16T03:16:12.586 INFO:tasks.workunit.client.0.smithi064.stdout:1/916: dread - d3/dd/d11/d38/fd7 zero size 2023-12-16T03:16:12.586 INFO:tasks.workunit.client.0.smithi064.stdout:2/721: dread d1/d15/d7d/f62 [0,4194304] 0 2023-12-16T03:16:12.590 INFO:tasks.workunit.client.0.smithi064.stdout:6/691: dread d3/d8/d13/f24 [0,4194304] 0 2023-12-16T03:16:12.590 INFO:tasks.workunit.client.0.smithi064.stdout:6/692: chown d3/d80 332401102 1 2023-12-16T03:16:12.591 INFO:tasks.workunit.client.0.smithi064.stdout:6/693: chown d3/f5 1484 1 2023-12-16T03:16:12.592 INFO:tasks.workunit.client.0.smithi064.stdout:6/694: truncate d3/f5 597159 0 2023-12-16T03:16:12.592 INFO:tasks.workunit.client.0.smithi064.stdout:6/695: chown d3/d8/d13/d58/d65/d6e/cab 16979 1 2023-12-16T03:16:12.592 INFO:tasks.workunit.client.0.smithi064.stdout:6/696: fdatasync d3/d44/f71 0 2023-12-16T03:16:12.594 INFO:tasks.workunit.client.0.smithi064.stdout:6/697: rename d3/d8/da/f8e to d3/d80/dcf/dcc/fd0 0 2023-12-16T03:16:12.595 INFO:tasks.workunit.client.0.smithi064.stdout:6/698: readlink d3/d8/da/l38 0 2023-12-16T03:16:12.602 INFO:tasks.workunit.client.0.smithi064.stdout:1/917: dwrite d3/dd/d2a/f3d [0,4194304] 0 2023-12-16T03:16:12.694 INFO:tasks.workunit.client.0.smithi064.stdout:8/809: sync 2023-12-16T03:16:12.694 INFO:tasks.workunit.client.0.smithi064.stdout:9/772: sync 2023-12-16T03:16:12.694 INFO:tasks.workunit.client.0.smithi064.stdout:9/773: fdatasync d2/d2d/d3b/ff0 0 2023-12-16T03:16:12.694 INFO:tasks.workunit.client.0.smithi064.stdout:9/774: fdatasync d2/d2d/d36/f60 0 2023-12-16T03:16:12.789 INFO:tasks.workunit.client.0.smithi064.stdout:9/775: rmdir d2/d2d 39 2023-12-16T03:16:12.791 INFO:tasks.workunit.client.0.smithi064.stdout:9/776: getdents d2/d2d/d3b/d3c/d34/dce 0 2023-12-16T03:16:12.795 INFO:tasks.workunit.client.0.smithi064.stdout:9/777: truncate d2/d2d/d3b/d3c/d4b/f4c 2306689 0 2023-12-16T03:16:12.796 INFO:tasks.workunit.client.0.smithi064.stdout:9/778: symlink d2/dc/d24/d39/d42/dca/lfe 0 2023-12-16T03:16:12.796 INFO:tasks.workunit.client.0.smithi064.stdout:9/779: write d2/d7e/fa2 [278904,59870] 0 2023-12-16T03:16:12.800 INFO:tasks.workunit.client.0.smithi064.stdout:9/780: dread d2/f1d [0,4194304] 0 2023-12-16T03:16:12.802 INFO:tasks.workunit.client.0.smithi064.stdout:9/781: link d2/d2d/d3b/d3c/d4b/fe6 d2/dc/d24/db2/dc3/fff 0 2023-12-16T03:16:12.804 INFO:tasks.workunit.client.0.smithi064.stdout:9/782: getdents d2/dc/d24/d39/d77/d7d 0 2023-12-16T03:16:12.814 INFO:tasks.workunit.client.0.smithi064.stdout:7/756: sync 2023-12-16T03:16:12.815 INFO:tasks.workunit.client.0.smithi064.stdout:5/682: sync 2023-12-16T03:16:12.815 INFO:tasks.workunit.client.0.smithi064.stdout:7/757: mknod d7/d3e/d42/d89/d20/df6/cf9 0 2023-12-16T03:16:12.830 INFO:tasks.workunit.client.0.smithi064.stdout:5/683: dread d0/d14/d20/f3d [0,4194304] 0 2023-12-16T03:16:12.837 INFO:tasks.workunit.client.0.smithi064.stdout:7/758: dwrite d7/d3e/d42/d43/f5f [0,4194304] 0 2023-12-16T03:16:12.837 INFO:tasks.workunit.client.0.smithi064.stdout:7/759: write d7/d3e/d42/d48/d51/d7c/f94 [221926,32281] 0 2023-12-16T03:16:12.853 INFO:tasks.workunit.client.0.smithi064.stdout:5/684: dwrite d0/d19/d48/d8f/d5e/fe6 [0,4194304] 0 2023-12-16T03:16:12.854 INFO:tasks.workunit.client.0.smithi064.stdout:7/760: dwrite d7/d3e/d42/d48/d51/f60 [4194304,4194304] 0 2023-12-16T03:16:12.876 INFO:tasks.workunit.client.0.smithi064.stdout:7/761: dwrite d7/d3e/d42/d48/d51/f8d [0,4194304] 0 2023-12-16T03:16:12.876 INFO:tasks.workunit.client.0.smithi064.stdout:7/762: readlink d7/d3e/d42/d89/d20/d37/l70 0 2023-12-16T03:16:12.879 INFO:tasks.workunit.client.0.smithi064.stdout:5/685: creat d0/ff3 x:0 0 0 2023-12-16T03:16:12.885 INFO:tasks.workunit.client.0.smithi064.stdout:7/763: dread d7/d3e/f47 [0,4194304] 0 2023-12-16T03:16:12.885 INFO:tasks.workunit.client.0.smithi064.stdout:7/764: chown d7/d3e/d42/d89/fc9 484036 1 2023-12-16T03:16:12.885 INFO:tasks.workunit.client.0.smithi064.stdout:7/765: dread - d7/d3e/d42/d89/d20/d6f/d93/fe8 zero size 2023-12-16T03:16:12.885 INFO:tasks.workunit.client.0.smithi064.stdout:5/686: mkdir d0/d50/d39/daa/df4 0 2023-12-16T03:16:12.888 INFO:tasks.workunit.client.0.smithi064.stdout:7/766: mkdir d7/df7/dfa 0 2023-12-16T03:16:12.889 INFO:tasks.workunit.client.0.smithi064.stdout:5/687: mkdir d0/d50/df5 0 2023-12-16T03:16:12.892 INFO:tasks.workunit.client.0.smithi064.stdout:5/688: mkdir d0/d19/d48/d8f/dac/d23/d67/da7/df6 0 2023-12-16T03:16:12.893 INFO:tasks.workunit.client.0.smithi064.stdout:5/689: mkdir d0/d50/df5/df7 0 2023-12-16T03:16:12.894 INFO:tasks.workunit.client.0.smithi064.stdout:5/690: write d0/d7/d97/fdd [940557,108116] 0 2023-12-16T03:16:12.902 INFO:tasks.workunit.client.0.smithi064.stdout:5/691: dread d0/d50/d39/f63 [0,4194304] 0 2023-12-16T03:16:12.918 INFO:tasks.workunit.client.0.smithi064.stdout:0/738: sync 2023-12-16T03:16:12.919 INFO:tasks.workunit.client.0.smithi064.stdout:5/692: dwrite d0/d19/d48/d8f/dac/d23/f89 [0,4194304] 0 2023-12-16T03:16:12.919 INFO:tasks.workunit.client.0.smithi064.stdout:5/693: write d0/d19/d48/d8f/dac/d23/d67/de4/df0/fbe [1452131,37268] 0 2023-12-16T03:16:12.919 INFO:tasks.workunit.client.0.smithi064.stdout:0/739: mknod d2/d7/d10/d21/d31/cf9 0 2023-12-16T03:16:12.923 INFO:tasks.workunit.client.0.smithi064.stdout:0/740: unlink d2/d8/da/d11/c26 0 2023-12-16T03:16:12.945 INFO:tasks.workunit.client.0.smithi064.stdout:5/694: dwrite d0/d19/d48/d8f/dac/d23/fec [0,4194304] 0 2023-12-16T03:16:12.945 INFO:tasks.workunit.client.0.smithi064.stdout:0/741: dwrite d2/d7/d10/d21/d31/fca [0,4194304] 0 2023-12-16T03:16:12.945 INFO:tasks.workunit.client.0.smithi064.stdout:5/695: write d0/d7/f1e [3488055,42364] 0 2023-12-16T03:16:12.946 INFO:tasks.workunit.client.0.smithi064.stdout:5/696: write d0/d50/f33 [2508490,56566] 0 2023-12-16T03:16:12.947 INFO:tasks.workunit.client.0.smithi064.stdout:5/697: write d0/fc3 [2876766,70366] 0 2023-12-16T03:16:13.009 INFO:tasks.workunit.client.0.smithi064.stdout:0/742: creat d2/d7/d10/d85/d88/ffa x:0 0 0 2023-12-16T03:16:13.010 INFO:tasks.workunit.client.0.smithi064.stdout:0/743: write d2/d7/d10/d21/d31/f35 [3684846,32374] 0 2023-12-16T03:16:13.013 INFO:tasks.workunit.client.0.smithi064.stdout:5/698: unlink d0/lc 0 2023-12-16T03:16:13.013 INFO:tasks.workunit.client.0.smithi064.stdout:5/699: fsync d0/d14/d20/d37/d70/da2/fa8 0 2023-12-16T03:16:13.013 INFO:tasks.workunit.client.0.smithi064.stdout:5/700: write d0/d19/d48/d8f/dac/d23/d67/de4/df0/fbe [1548742,11688] 0 2023-12-16T03:16:13.017 INFO:tasks.workunit.client.0.smithi064.stdout:0/744: rename d2/d5b/d8b/c8c to d2/d7/d10/dc4/dcc/db5/cfb 0 2023-12-16T03:16:13.019 INFO:tasks.workunit.client.0.smithi064.stdout:5/701: rename d0/d14/ca3 to d0/d7/d97/cf8 0 2023-12-16T03:16:13.019 INFO:tasks.workunit.client.0.smithi064.stdout:5/702: fsync d0/d14/d20/d37/d70/d71/d5a/f8d 0 2023-12-16T03:16:13.020 INFO:tasks.workunit.client.0.smithi064.stdout:0/745: creat d2/d8/da/dbc/ffc x:0 0 0 2023-12-16T03:16:13.022 INFO:tasks.workunit.client.0.smithi064.stdout:5/703: dread d0/d14/d20/d37/d3c/f6b [0,4194304] 0 2023-12-16T03:16:13.022 INFO:tasks.workunit.client.0.smithi064.stdout:0/746: dread d2/d7/d10/d21/d7a/f9d [0,4194304] 0 2023-12-16T03:16:13.022 INFO:tasks.workunit.client.0.smithi064.stdout:0/747: read - d2/d7/d10/f84 zero size 2023-12-16T03:16:13.024 INFO:tasks.workunit.client.0.smithi064.stdout:4/843: sync 2023-12-16T03:16:13.024 INFO:tasks.workunit.client.0.smithi064.stdout:3/848: sync 2023-12-16T03:16:13.024 INFO:tasks.workunit.client.0.smithi064.stdout:3/849: fdatasync db/d4f/da9/fb6 0 2023-12-16T03:16:13.024 INFO:tasks.workunit.client.0.smithi064.stdout:3/850: chown db/d4f/fb1 21078535 1 2023-12-16T03:16:13.033 INFO:tasks.workunit.client.0.smithi064.stdout:0/748: getdents d2/d29/de7 0 2023-12-16T03:16:13.033 INFO:tasks.workunit.client.0.smithi064.stdout:0/749: readlink d2/d7/l91 0 2023-12-16T03:16:13.033 INFO:tasks.workunit.client.0.smithi064.stdout:4/844: dread d0/d42/d53/f1d [4194304,4194304] 0 2023-12-16T03:16:13.039 INFO:tasks.workunit.client.0.smithi064.stdout:0/750: symlink d2/d7/d10/dc4/lfd 0 2023-12-16T03:16:13.042 INFO:tasks.workunit.client.0.smithi064.stdout:3/851: dwrite db/d12/d1a/d2c/d34/d4c/f9d [0,4194304] 0 2023-12-16T03:16:13.042 INFO:tasks.workunit.client.0.smithi064.stdout:3/852: chown db/d12/d4e/fa5 13479869 1 2023-12-16T03:16:13.043 INFO:tasks.workunit.client.0.smithi064.stdout:3/853: dread - db/d4f/d51/dd1/dde/feb zero size 2023-12-16T03:16:13.043 INFO:tasks.workunit.client.0.smithi064.stdout:5/704: rmdir d0/d19 39 2023-12-16T03:16:13.045 INFO:tasks.workunit.client.0.smithi064.stdout:4/845: mkdir d0/d12/d48/d87/d10c 0 2023-12-16T03:16:13.045 INFO:tasks.workunit.client.0.smithi064.stdout:5/705: dread d0/d7/d34/f56 [0,4194304] 0 2023-12-16T03:16:13.046 INFO:tasks.workunit.client.0.smithi064.stdout:0/751: truncate d2/d8/da/df/f41 1501768 0 2023-12-16T03:16:13.050 INFO:tasks.workunit.client.0.smithi064.stdout:3/854: creat db/d12/d1a/d2c/d34/f113 x:0 0 0 2023-12-16T03:16:13.052 INFO:tasks.workunit.client.0.smithi064.stdout:3/855: write db/d12/d1a/d2c/d34/d4c/d6a/d93/fa6 [4941337,33336] 0 2023-12-16T03:16:13.052 INFO:tasks.workunit.client.0.smithi064.stdout:3/856: readlink db/d12/d1a/d2c/d34/d4c/lc0 0 2023-12-16T03:16:13.054 INFO:tasks.workunit.client.0.smithi064.stdout:4/846: unlink d0/d12/f79 0 2023-12-16T03:16:13.055 INFO:tasks.workunit.client.0.smithi064.stdout:4/847: fdatasync d0/d1e/f103 0 2023-12-16T03:16:13.057 INFO:tasks.workunit.client.0.smithi064.stdout:0/752: creat d2/d29/de7/ffe x:0 0 0 2023-12-16T03:16:13.058 INFO:tasks.workunit.client.0.smithi064.stdout:0/753: write d2/f7c [3642782,68177] 0 2023-12-16T03:16:13.061 INFO:tasks.workunit.client.0.smithi064.stdout:3/857: creat db/d4f/d51/dd2/f114 x:0 0 0 2023-12-16T03:16:13.063 INFO:tasks.workunit.client.0.smithi064.stdout:4/848: unlink d0/d12/l45 0 2023-12-16T03:16:13.063 INFO:tasks.workunit.client.0.smithi064.stdout:4/849: read d0/da/da6/fb3 [5018,32054] 0 2023-12-16T03:16:13.064 INFO:tasks.workunit.client.0.smithi064.stdout:0/754: unlink d2/d29/d66/c83 0 2023-12-16T03:16:13.064 INFO:tasks.workunit.client.0.smithi064.stdout:0/755: write d2/d7/d10/d21/d31/f87 [541028,46483] 0 2023-12-16T03:16:13.066 INFO:tasks.workunit.client.0.smithi064.stdout:4/850: mkdir d0/d10d 0 2023-12-16T03:16:13.066 INFO:tasks.workunit.client.0.smithi064.stdout:4/851: readlink d0/d42/d66/d33/l3f 0 2023-12-16T03:16:13.066 INFO:tasks.workunit.client.0.smithi064.stdout:0/756: dread d2/d8/da/f9a [0,4194304] 0 2023-12-16T03:16:13.069 INFO:tasks.workunit.client.0.smithi064.stdout:4/852: getdents d0/d42/d4c/d70 0 2023-12-16T03:16:13.069 INFO:tasks.workunit.client.0.smithi064.stdout:4/853: write d0/d42/d4c/d70/d8c/fc3 [72258,31961] 0 2023-12-16T03:16:13.072 INFO:tasks.workunit.client.0.smithi064.stdout:3/858: dread db/d12/d1a/f54 [0,4194304] 0 2023-12-16T03:16:13.072 INFO:tasks.workunit.client.0.smithi064.stdout:0/757: mkdir d2/d7/d10/d85/dff 0 2023-12-16T03:16:13.072 INFO:tasks.workunit.client.0.smithi064.stdout:3/859: write db/d12/d21/f30 [4700849,117568] 0 2023-12-16T03:16:13.073 INFO:tasks.workunit.client.0.smithi064.stdout:0/758: write d2/d8/da/f9a [142208,31224] 0 2023-12-16T03:16:13.074 INFO:tasks.workunit.client.0.smithi064.stdout:5/706: dwrite d0/d19/d48/d8f/dac/d23/d91/ff1 [4194304,4194304] 0 2023-12-16T03:16:13.075 INFO:tasks.workunit.client.0.smithi064.stdout:4/854: getdents d0/d12/d48 0 2023-12-16T03:16:13.079 INFO:tasks.workunit.client.0.smithi064.stdout:3/860: symlink db/d12/d1a/d2c/d34/d4c/l115 0 2023-12-16T03:16:13.079 INFO:tasks.workunit.client.0.smithi064.stdout:3/861: fsync db/d12/d1a/d2c/d34/d4c/d6a/da7/fb7 0 2023-12-16T03:16:13.080 INFO:tasks.workunit.client.0.smithi064.stdout:0/759: creat d2/d7/d10/d21/d31/f100 x:0 0 0 2023-12-16T03:16:13.080 INFO:tasks.workunit.client.0.smithi064.stdout:0/760: write d2/d8/da/df/fb4 [4635712,105348] 0 2023-12-16T03:16:13.080 INFO:tasks.workunit.client.0.smithi064.stdout:0/761: readlink d2/d7/d10/l12 0 2023-12-16T03:16:13.083 INFO:tasks.workunit.client.0.smithi064.stdout:5/707: unlink d0/d19/d48/d8f/d3e/d35/d5d/c61 0 2023-12-16T03:16:13.086 INFO:tasks.workunit.client.0.smithi064.stdout:4/855: rename d0/d42/d66/d5a/cf7 to d0/d42/d53/dd4/c10e 0 2023-12-16T03:16:13.093 INFO:tasks.workunit.client.0.smithi064.stdout:3/862: mknod db/d12/d1a/d2c/d34/d4c/d6a/c116 0 2023-12-16T03:16:13.096 INFO:tasks.workunit.client.0.smithi064.stdout:0/762: truncate d2/d8/da/fb6 2616607 0 2023-12-16T03:16:13.097 INFO:tasks.workunit.client.0.smithi064.stdout:5/708: getdents d0/d19/d48/d8f/dac/d23 0 2023-12-16T03:16:13.100 INFO:tasks.workunit.client.0.smithi064.stdout:4/856: mkdir d0/d42/d4c/d70/d8c/dc7/d10f 0 2023-12-16T03:16:13.102 INFO:tasks.workunit.client.0.smithi064.stdout:0/763: rmdir d2/d29/de9 39 2023-12-16T03:16:13.104 INFO:tasks.workunit.client.0.smithi064.stdout:5/709: mkdir d0/d14/d20/df9 0 2023-12-16T03:16:13.105 INFO:tasks.workunit.client.0.smithi064.stdout:4/857: mknod d0/d42/d66/c110 0 2023-12-16T03:16:13.108 INFO:tasks.workunit.client.0.smithi064.stdout:3/863: dwrite db/d12/d1a/fb9 [0,4194304] 0 2023-12-16T03:16:13.108 INFO:tasks.workunit.client.0.smithi064.stdout:3/864: fdatasync db/d12/d1a/d2c/d34/d4c/fbb 0 2023-12-16T03:16:13.108 INFO:tasks.workunit.client.0.smithi064.stdout:0/764: symlink d2/d8/da/l101 0 2023-12-16T03:16:13.109 INFO:tasks.workunit.client.0.smithi064.stdout:3/865: write db/d12/d1a/d2c/d34/d4c/d6a/da7/f24 [1515638,83293] 0 2023-12-16T03:16:13.109 INFO:tasks.workunit.client.0.smithi064.stdout:0/765: write d2/d7/d10/f1a [925226,34284] 0 2023-12-16T03:16:13.109 INFO:tasks.workunit.client.0.smithi064.stdout:5/710: truncate d0/d7/f2e 961714 0 2023-12-16T03:16:13.109 INFO:tasks.workunit.client.0.smithi064.stdout:0/766: fsync d2/d7/f63 0 2023-12-16T03:16:13.109 INFO:tasks.workunit.client.0.smithi064.stdout:0/767: fdatasync d2/d7/d10/f6a 0 2023-12-16T03:16:13.111 INFO:tasks.workunit.client.0.smithi064.stdout:4/858: truncate d0/d42/d66/d33/f80 109405 0 2023-12-16T03:16:13.117 INFO:tasks.workunit.client.0.smithi064.stdout:3/866: dread db/d12/d4e/fa5 [0,4194304] 0 2023-12-16T03:16:13.118 INFO:tasks.workunit.client.0.smithi064.stdout:3/867: fsync db/d12/d1a/d2c/d34/d4c/fbb 0 2023-12-16T03:16:13.123 INFO:tasks.workunit.client.0.smithi064.stdout:5/711: creat d0/d50/d39/daa/dc5/ffa x:0 0 0 2023-12-16T03:16:13.129 INFO:tasks.workunit.client.0.smithi064.stdout:4/859: rmdir d0/d42 39 2023-12-16T03:16:13.132 INFO:tasks.workunit.client.0.smithi064.stdout:1/918: sync 2023-12-16T03:16:13.132 INFO:tasks.workunit.client.0.smithi064.stdout:2/722: sync 2023-12-16T03:16:13.132 INFO:tasks.workunit.client.0.smithi064.stdout:1/919: readlink d3/d36/d44/d4d/da8/l104 0 2023-12-16T03:16:13.132 INFO:tasks.workunit.client.0.smithi064.stdout:8/810: sync 2023-12-16T03:16:13.132 INFO:tasks.workunit.client.0.smithi064.stdout:6/699: sync 2023-12-16T03:16:13.132 INFO:tasks.workunit.client.0.smithi064.stdout:6/700: dread - d3/d80/dcf/f83 zero size 2023-12-16T03:16:13.132 INFO:tasks.workunit.client.0.smithi064.stdout:6/701: stat d3/d44/fa9 0 2023-12-16T03:16:13.132 INFO:tasks.workunit.client.0.smithi064.stdout:0/768: truncate d2/f5 1464276 0 2023-12-16T03:16:13.135 INFO:tasks.workunit.client.0.smithi064.stdout:3/868: dwrite db/d12/d1a/d2c/d34/f5a [0,4194304] 0 2023-12-16T03:16:13.135 INFO:tasks.workunit.client.0.smithi064.stdout:3/869: readlink db/d4f/d51/dd2/ld6 0 2023-12-16T03:16:13.135 INFO:tasks.workunit.client.0.smithi064.stdout:3/870: write db/d12/d21/f65 [871591,118250] 0 2023-12-16T03:16:13.136 INFO:tasks.workunit.client.0.smithi064.stdout:5/712: rename d0/f3 to d0/d19/d48/d8f/dac/d23/ffb 0 2023-12-16T03:16:13.144 INFO:tasks.workunit.client.0.smithi064.stdout:4/860: rmdir d0/d12/d48 39 2023-12-16T03:16:13.145 INFO:tasks.workunit.client.0.smithi064.stdout:2/723: creat d1/d15/feb x:0 0 0 2023-12-16T03:16:13.145 INFO:tasks.workunit.client.0.smithi064.stdout:2/724: fsync d1/d15/d7d/f79 0 2023-12-16T03:16:13.146 INFO:tasks.workunit.client.0.smithi064.stdout:1/920: creat d3/dd/d23/dcb/de3/f11d x:0 0 0 2023-12-16T03:16:13.147 INFO:tasks.workunit.client.0.smithi064.stdout:9/783: sync 2023-12-16T03:16:13.147 INFO:tasks.workunit.client.0.smithi064.stdout:7/767: sync 2023-12-16T03:16:13.147 INFO:tasks.workunit.client.0.smithi064.stdout:7/768: fsync d7/d3e/d42/f73 0 2023-12-16T03:16:13.147 INFO:tasks.workunit.client.0.smithi064.stdout:9/784: getdents d2/d2d/d6c/d83/dec 0 2023-12-16T03:16:13.150 INFO:tasks.workunit.client.0.smithi064.stdout:2/725: write d1/d15/d1b/d49/da0/fcd [1587245,126680] 0 2023-12-16T03:16:13.153 INFO:tasks.workunit.client.0.smithi064.stdout:8/811: mkdir d0/da/de9/d37/d3a/dab/dfa/dc0/d119 0 2023-12-16T03:16:13.154 INFO:tasks.workunit.client.0.smithi064.stdout:6/702: rmdir d3/d9e 39 2023-12-16T03:16:13.158 INFO:tasks.workunit.client.0.smithi064.stdout:6/703: dread d3/d9e/fba [0,4194304] 0 2023-12-16T03:16:13.158 INFO:tasks.workunit.client.0.smithi064.stdout:6/704: write d3/d9/f68 [1740479,58027] 0 2023-12-16T03:16:13.158 INFO:tasks.workunit.client.0.smithi064.stdout:5/713: mkdir d0/d14/d20/df9/dfc 0 2023-12-16T03:16:13.158 INFO:tasks.workunit.client.0.smithi064.stdout:5/714: chown d0/d14/d20/d37/d70/d71/lae 76982100 1 2023-12-16T03:16:13.161 INFO:tasks.workunit.client.0.smithi064.stdout:4/861: symlink d0/da/da6/dd8/l111 0 2023-12-16T03:16:13.161 INFO:tasks.workunit.client.0.smithi064.stdout:4/862: write d0/d42/d66/f26 [1130492,18521] 0 2023-12-16T03:16:13.161 INFO:tasks.workunit.client.0.smithi064.stdout:4/863: dread - d0/d1e/d36/fdc zero size 2023-12-16T03:16:13.163 INFO:tasks.workunit.client.0.smithi064.stdout:1/921: rename d3/dd/d11/dbf/d10f/c87 to d3/d36/d44/d4d/d58/c11e 0 2023-12-16T03:16:13.163 INFO:tasks.workunit.client.0.smithi064.stdout:3/871: dwrite db/d12/d1a/d2c/d34/f8b [0,4194304] 0 2023-12-16T03:16:13.165 INFO:tasks.workunit.client.0.smithi064.stdout:1/922: write d3/d22/f68 [3611699,57128] 0 2023-12-16T03:16:13.165 INFO:tasks.workunit.client.0.smithi064.stdout:1/923: fsync d3/dd/d2a/f3d 0 2023-12-16T03:16:13.165 INFO:tasks.workunit.client.0.smithi064.stdout:4/864: dread d0/d42/d53/f1d [4194304,4194304] 0 2023-12-16T03:16:13.166 INFO:tasks.workunit.client.0.smithi064.stdout:4/865: stat d0/d12/d48/l57 0 2023-12-16T03:16:13.166 INFO:tasks.workunit.client.0.smithi064.stdout:9/785: creat d2/dc/d24/db2/dc3/f100 x:0 0 0 2023-12-16T03:16:13.166 INFO:tasks.workunit.client.0.smithi064.stdout:0/769: dwrite d2/d7/f49 [0,4194304] 0 2023-12-16T03:16:13.166 INFO:tasks.workunit.client.0.smithi064.stdout:9/786: truncate d2/dc/d24/d39/d77/d7d/fda 138116 0 2023-12-16T03:16:13.166 INFO:tasks.workunit.client.0.smithi064.stdout:0/770: read - d2/d5b/fae zero size 2023-12-16T03:16:13.167 INFO:tasks.workunit.client.0.smithi064.stdout:2/726: dwrite d1/d15/d1b/d9c/fbf [0,4194304] 0 2023-12-16T03:16:13.167 INFO:tasks.workunit.client.0.smithi064.stdout:2/727: write d1/d15/d1b/d49/f6b [952769,112842] 0 2023-12-16T03:16:13.171 INFO:tasks.workunit.client.0.smithi064.stdout:8/812: dread d0/fb6 [0,4194304] 0 2023-12-16T03:16:13.177 INFO:tasks.workunit.client.0.smithi064.stdout:9/787: dread d2/f33 [0,4194304] 0 2023-12-16T03:16:13.178 INFO:tasks.workunit.client.0.smithi064.stdout:3/872: link db/d12/f18 db/d4f/da9/dbf/d75/d92/f117 0 2023-12-16T03:16:13.178 INFO:tasks.workunit.client.0.smithi064.stdout:3/873: write db/d12/d1a/d2c/d34/d4c/d6a/fc7 [601313,58413] 0 2023-12-16T03:16:13.178 INFO:tasks.workunit.client.0.smithi064.stdout:3/874: chown db/d4f/d51/dd1/dd3/ce3 10 1 2023-12-16T03:16:13.178 INFO:tasks.workunit.client.0.smithi064.stdout:5/715: dwrite d0/d7/f1d [0,4194304] 0 2023-12-16T03:16:13.181 INFO:tasks.workunit.client.0.smithi064.stdout:1/924: creat d3/dd/de4/f11f x:0 0 0 2023-12-16T03:16:13.182 INFO:tasks.workunit.client.0.smithi064.stdout:4/866: mknod d0/d42/d4c/c112 0 2023-12-16T03:16:13.184 INFO:tasks.workunit.client.0.smithi064.stdout:0/771: creat d2/d29/d66/de5/f102 x:0 0 0 2023-12-16T03:16:13.185 INFO:tasks.workunit.client.0.smithi064.stdout:2/728: getdents d1/d15/d1b/d61/d63 0 2023-12-16T03:16:13.187 INFO:tasks.workunit.client.0.smithi064.stdout:6/705: symlink d3/d8/da/ld1 0 2023-12-16T03:16:13.189 INFO:tasks.workunit.client.0.smithi064.stdout:8/813: creat d0/da/de9/d5a/dec/d108/f11a x:0 0 0 2023-12-16T03:16:13.193 INFO:tasks.workunit.client.0.smithi064.stdout:9/788: creat d2/d2d/d36/db4/dfd/f101 x:0 0 0 2023-12-16T03:16:13.196 INFO:tasks.workunit.client.0.smithi064.stdout:3/875: creat db/d12/d1a/d2c/f118 x:0 0 0 2023-12-16T03:16:13.198 INFO:tasks.workunit.client.0.smithi064.stdout:5/716: rename d0/d19/d48/d8f/dac/d23/d67/de4 to d0/d14/d20/df9/dfc/dfd 0 2023-12-16T03:16:13.199 INFO:tasks.workunit.client.0.smithi064.stdout:5/717: write d0/d50/d39/daa/dc5/ffa [940307,20912] 0 2023-12-16T03:16:13.199 INFO:tasks.workunit.client.0.smithi064.stdout:2/729: dwrite d1/d15/d1b/d9c/fbf [0,4194304] 0 2023-12-16T03:16:13.201 INFO:tasks.workunit.client.0.smithi064.stdout:1/925: mknod d3/dd/d23/d4f/daf/c120 0 2023-12-16T03:16:13.203 INFO:tasks.workunit.client.0.smithi064.stdout:4/867: mknod d0/d42/d4c/d70/d8c/c113 0 2023-12-16T03:16:13.213 INFO:tasks.workunit.client.0.smithi064.stdout:0/772: mkdir d2/d5b/d103 0 2023-12-16T03:16:13.217 INFO:tasks.workunit.client.0.smithi064.stdout:8/814: symlink d0/da/de9/d12/d1c/l11b 0 2023-12-16T03:16:13.217 INFO:tasks.workunit.client.0.smithi064.stdout:8/815: stat d0/da/de9/d12/d44/dd0 0 2023-12-16T03:16:13.218 INFO:tasks.workunit.client.0.smithi064.stdout:2/730: dwrite d1/d15/d1b/d9c/f34 [4194304,4194304] 0 2023-12-16T03:16:13.220 INFO:tasks.workunit.client.0.smithi064.stdout:9/789: mknod d2/dc/d24/d39/d42/c102 0 2023-12-16T03:16:13.220 INFO:tasks.workunit.client.0.smithi064.stdout:3/876: symlink db/d4f/da9/dbf/d75/l119 0 2023-12-16T03:16:13.220 INFO:tasks.workunit.client.0.smithi064.stdout:4/868: dwrite d0/d12/d48/fcf [0,4194304] 0 2023-12-16T03:16:13.221 INFO:tasks.workunit.client.0.smithi064.stdout:1/926: creat d3/d22/f121 x:0 0 0 2023-12-16T03:16:13.221 INFO:tasks.workunit.client.0.smithi064.stdout:1/927: readlink d3/d36/d44/lcf 0 2023-12-16T03:16:13.221 INFO:tasks.workunit.client.0.smithi064.stdout:6/706: truncate d3/d9/f68 1229546 0 2023-12-16T03:16:13.223 INFO:tasks.workunit.client.0.smithi064.stdout:8/816: creat d0/da/de9/d37/d3a/dab/dfa/d46/d54/f11c x:0 0 0 2023-12-16T03:16:13.226 INFO:tasks.workunit.client.0.smithi064.stdout:3/877: mknod db/d4f/d51/dd2/c11a 0 2023-12-16T03:16:13.226 INFO:tasks.workunit.client.0.smithi064.stdout:0/773: dread d2/d7/d10/d21/d7a/fa8 [0,4194304] 0 2023-12-16T03:16:13.227 INFO:tasks.workunit.client.0.smithi064.stdout:4/869: symlink d0/d1e/d36/l114 0 2023-12-16T03:16:13.231 INFO:tasks.workunit.client.0.smithi064.stdout:0/774: symlink d2/d8/da/d11/l104 0 2023-12-16T03:16:13.233 INFO:tasks.workunit.client.0.smithi064.stdout:4/870: mkdir d0/d42/d4c/d70/dfc/d115 0 2023-12-16T03:16:13.235 INFO:tasks.workunit.client.0.smithi064.stdout:5/718: getdents d0/d19/d48/d8f/dac/d23/d67 0 2023-12-16T03:16:13.236 INFO:tasks.workunit.client.0.smithi064.stdout:9/790: dwrite d2/d2d/d3b/d3c/d34/fa5 [0,4194304] 0 2023-12-16T03:16:13.239 INFO:tasks.workunit.client.0.smithi064.stdout:3/878: dread db/d12/d1a/fb9 [0,4194304] 0 2023-12-16T03:16:13.239 INFO:tasks.workunit.client.0.smithi064.stdout:8/817: dread d0/d1d/d3c/f7d [0,4194304] 0 2023-12-16T03:16:13.239 INFO:tasks.workunit.client.0.smithi064.stdout:3/879: truncate db/d12/d1a/d31/f106 808414 0 2023-12-16T03:16:13.242 INFO:tasks.workunit.client.0.smithi064.stdout:1/928: rmdir d3/d36 39 2023-12-16T03:16:13.244 INFO:tasks.workunit.client.0.smithi064.stdout:5/719: dread d0/d50/d39/f7c [0,4194304] 0 2023-12-16T03:16:13.245 INFO:tasks.workunit.client.0.smithi064.stdout:5/720: write d0/d19/d48/d8f/d5e/d84/faf [6008406,97065] 0 2023-12-16T03:16:13.246 INFO:tasks.workunit.client.0.smithi064.stdout:6/707: mkdir d3/d8/da/dd2 0 2023-12-16T03:16:13.246 INFO:tasks.workunit.client.0.smithi064.stdout:6/708: stat d3/d8/f5f 0 2023-12-16T03:16:13.246 INFO:tasks.workunit.client.0.smithi064.stdout:6/709: dread - d3/d80/d92/fc2 zero size 2023-12-16T03:16:13.247 INFO:tasks.workunit.client.0.smithi064.stdout:0/775: symlink d2/d7/d10/dc4/l105 0 2023-12-16T03:16:13.259 INFO:tasks.workunit.client.0.smithi064.stdout:4/871: creat d0/d42/d4c/d70/d8c/da9/f116 x:0 0 0 2023-12-16T03:16:13.265 INFO:tasks.workunit.client.0.smithi064.stdout:9/791: mkdir d2/dc/d24/d39/d42/d9a/d8b/da8/d103 0 2023-12-16T03:16:13.267 INFO:tasks.workunit.client.0.smithi064.stdout:4/872: dread d0/d42/d56/f67 [0,4194304] 0 2023-12-16T03:16:13.268 INFO:tasks.workunit.client.0.smithi064.stdout:8/818: mkdir d0/da/de9/d12/d44/d68/d6d/d11d 0 2023-12-16T03:16:13.268 INFO:tasks.workunit.client.0.smithi064.stdout:8/819: readlink d0/da/de9/l31 0 2023-12-16T03:16:13.269 INFO:tasks.workunit.client.0.smithi064.stdout:3/880: rename db/d12/d1a/d2c/d34/d4c/d6a/c100 to db/d4f/da9/c11b 0 2023-12-16T03:16:13.270 INFO:tasks.workunit.client.0.smithi064.stdout:3/881: truncate db/d12/d1a/d2c/d34/d4c/d6a/da7/fb7 1258835 0 2023-12-16T03:16:13.270 INFO:tasks.workunit.client.0.smithi064.stdout:5/721: dwrite d0/d19/d48/d8f/d5e/d84/fca [0,4194304] 0 2023-12-16T03:16:13.270 INFO:tasks.workunit.client.0.smithi064.stdout:6/710: dwrite d3/f7d [8388608,4194304] 0 2023-12-16T03:16:13.273 INFO:tasks.workunit.client.0.smithi064.stdout:8/820: write d0/d1d/d3c/d42/d93/fa9 [666124,91912] 0 2023-12-16T03:16:13.273 INFO:tasks.workunit.client.0.smithi064.stdout:8/821: write d0/da/de9/d5a/dec/d108/f11a [61039,2847] 0 2023-12-16T03:16:13.273 INFO:tasks.workunit.client.0.smithi064.stdout:1/929: creat d3/dd/d11/d38/df3/f122 x:0 0 0 2023-12-16T03:16:13.273 INFO:tasks.workunit.client.0.smithi064.stdout:1/930: stat d3/d36/d44 0 2023-12-16T03:16:13.273 INFO:tasks.workunit.client.0.smithi064.stdout:1/931: readlink d3/dd/d23/d60/lb4 0 2023-12-16T03:16:13.278 INFO:tasks.workunit.client.0.smithi064.stdout:0/776: unlink d2/cf2 0 2023-12-16T03:16:13.281 INFO:tasks.workunit.client.0.smithi064.stdout:9/792: symlink d2/d2d/d3b/d3c/d34/l104 0 2023-12-16T03:16:13.281 INFO:tasks.workunit.client.0.smithi064.stdout:9/793: write d2/dc/d24/db2/dc3/f100 [708456,48232] 0 2023-12-16T03:16:13.291 INFO:tasks.workunit.client.0.smithi064.stdout:4/873: mknod d0/d42/d66/d33/c117 0 2023-12-16T03:16:13.297 INFO:tasks.workunit.client.0.smithi064.stdout:9/794: dwrite d2/dc/d24/d39/d42/f51 [0,4194304] 0 2023-12-16T03:16:13.297 INFO:tasks.workunit.client.0.smithi064.stdout:3/882: getdents db/d4f/d51/dd1/dd3 0 2023-12-16T03:16:13.300 INFO:tasks.workunit.client.0.smithi064.stdout:5/722: mkdir d0/d19/d48/d8f/dac/dfe 0 2023-12-16T03:16:13.308 INFO:tasks.workunit.client.0.smithi064.stdout:6/711: creat d3/d8/d1f/fd3 x:0 0 0 2023-12-16T03:16:13.308 INFO:tasks.workunit.client.0.smithi064.stdout:6/712: stat d3/d8/d13/d58/db6 0 2023-12-16T03:16:13.320 INFO:tasks.workunit.client.0.smithi064.stdout:1/932: creat d3/dd/d23/d4f/daf/dca/f123 x:0 0 0 2023-12-16T03:16:13.320 INFO:tasks.workunit.client.0.smithi064.stdout:1/933: chown d3/d36/cf7 3 1 2023-12-16T03:16:13.322 INFO:tasks.workunit.client.0.smithi064.stdout:0/777: creat d2/d5b/d103/f106 x:0 0 0 2023-12-16T03:16:13.322 INFO:tasks.workunit.client.0.smithi064.stdout:0/778: chown d2/d29/f9f 3230266 1 2023-12-16T03:16:13.322 INFO:tasks.workunit.client.0.smithi064.stdout:0/779: write d2/d7/f63 [996844,49165] 0 2023-12-16T03:16:13.323 INFO:tasks.workunit.client.0.smithi064.stdout:4/874: symlink d0/d42/d4c/d70/d8c/da9/df3/l118 0 2023-12-16T03:16:13.326 INFO:tasks.workunit.client.0.smithi064.stdout:9/795: rename d2/dc/d24/d39/d42/d94/cf6 to d2/d2d/d3b/d3c/d4b/c105 0 2023-12-16T03:16:13.326 INFO:tasks.workunit.client.0.smithi064.stdout:9/796: chown d2/dc/d24/da9/fe4 1181901056 1 2023-12-16T03:16:13.327 INFO:tasks.workunit.client.0.smithi064.stdout:6/713: creat d3/fd4 x:0 0 0 2023-12-16T03:16:13.327 INFO:tasks.workunit.client.0.smithi064.stdout:6/714: fsync d3/d8/d13/d58/fa1 0 2023-12-16T03:16:13.328 INFO:tasks.workunit.client.0.smithi064.stdout:8/822: dread d0/f3 [0,4194304] 0 2023-12-16T03:16:13.328 INFO:tasks.workunit.client.0.smithi064.stdout:5/723: dwrite d0/d19/d48/d8f/d5e/d84/fca [0,4194304] 0 2023-12-16T03:16:13.328 INFO:tasks.workunit.client.0.smithi064.stdout:1/934: dread d3/d36/d44/f51 [0,4194304] 0 2023-12-16T03:16:13.329 INFO:tasks.workunit.client.0.smithi064.stdout:6/715: write d3/d80/dcf/fb7 [1970503,119229] 0 2023-12-16T03:16:13.329 INFO:tasks.workunit.client.0.smithi064.stdout:8/823: write d0/da/de9/d12/d44/d68/fbe [3957800,1051] 0 2023-12-16T03:16:13.329 INFO:tasks.workunit.client.0.smithi064.stdout:3/883: dwrite db/d12/d1a/fc4 [0,4194304] 0 2023-12-16T03:16:13.330 INFO:tasks.workunit.client.0.smithi064.stdout:0/780: creat d2/d29/d66/db9/f107 x:0 0 0 2023-12-16T03:16:13.331 INFO:tasks.workunit.client.0.smithi064.stdout:4/875: mknod d0/d42/d4c/d70/d8c/da9/c119 0 2023-12-16T03:16:13.331 INFO:tasks.workunit.client.0.smithi064.stdout:4/876: chown d0/da/f6f 258962 1 2023-12-16T03:16:13.331 INFO:tasks.workunit.client.0.smithi064.stdout:4/877: chown d0/da/da6 2029138 1 2023-12-16T03:16:13.332 INFO:tasks.workunit.client.0.smithi064.stdout:9/797: link d2/d2d/d3b/c92 d2/dc/d24/d39/d42/dca/c106 0 2023-12-16T03:16:13.332 INFO:tasks.workunit.client.0.smithi064.stdout:9/798: dread - d2/dc/d24/d39/d42/ffb zero size 2023-12-16T03:16:13.335 INFO:tasks.workunit.client.0.smithi064.stdout:1/935: link d3/dd/d11/c1c d3/dd/d23/d86/c124 0 2023-12-16T03:16:13.335 INFO:tasks.workunit.client.0.smithi064.stdout:1/936: write d3/d36/d44/d4d/dad/dc5/fc8 [438281,52533] 0 2023-12-16T03:16:13.336 INFO:tasks.workunit.client.0.smithi064.stdout:5/724: creat d0/d14/d20/d37/d70/d71/fff x:0 0 0 2023-12-16T03:16:13.337 INFO:tasks.workunit.client.0.smithi064.stdout:6/716: mknod d3/d9e/dbd/cd5 0 2023-12-16T03:16:13.337 INFO:tasks.workunit.client.0.smithi064.stdout:6/717: stat d3/d9e/dbd/cd5 0 2023-12-16T03:16:13.338 INFO:tasks.workunit.client.0.smithi064.stdout:8/824: creat d0/da/de9/d5a/dec/d108/f11e x:0 0 0 2023-12-16T03:16:13.340 INFO:tasks.workunit.client.0.smithi064.stdout:3/884: creat db/d4f/da9/dbf/d75/d92/f11c x:0 0 0 2023-12-16T03:16:13.341 INFO:tasks.workunit.client.0.smithi064.stdout:0/781: creat d2/d8/da/d11/df1/f108 x:0 0 0 2023-12-16T03:16:13.346 INFO:tasks.workunit.client.0.smithi064.stdout:4/878: symlink d0/d10d/l11a 0 2023-12-16T03:16:13.347 INFO:tasks.workunit.client.0.smithi064.stdout:3/885: dread db/d12/d1a/fb9 [0,4194304] 0 2023-12-16T03:16:13.349 INFO:tasks.workunit.client.0.smithi064.stdout:9/799: dwrite d2/dc/d24/d39/d77/d7d/db9/fd8 [0,4194304] 0 2023-12-16T03:16:13.349 INFO:tasks.workunit.client.0.smithi064.stdout:1/937: mknod d3/d22/dab/c125 0 2023-12-16T03:16:13.354 INFO:tasks.workunit.client.0.smithi064.stdout:5/725: creat d0/d19/d48/d8f/dac/d23/d91/f100 x:0 0 0 2023-12-16T03:16:13.357 INFO:tasks.workunit.client.0.smithi064.stdout:6/718: creat d3/d8/d13/d46/d5e/fd6 x:0 0 0 2023-12-16T03:16:13.359 INFO:tasks.workunit.client.0.smithi064.stdout:8/825: symlink d0/da/de9/d111/l11f 0 2023-12-16T03:16:13.359 INFO:tasks.workunit.client.0.smithi064.stdout:3/886: dread db/d12/d1a/d2c/d34/de7/f7a [0,4194304] 0 2023-12-16T03:16:13.359 INFO:tasks.workunit.client.0.smithi064.stdout:3/887: dread - db/d12/d1a/d31/d109/f10f zero size 2023-12-16T03:16:13.379 INFO:tasks.workunit.client.0.smithi064.stdout:0/782: dwrite d2/d7/d10/d85/d88/ffa [0,4194304] 0 2023-12-16T03:16:13.379 INFO:tasks.workunit.client.0.smithi064.stdout:0/783: write d2/d29/f2c [235512,124202] 0 2023-12-16T03:16:13.382 INFO:tasks.workunit.client.0.smithi064.stdout:9/800: getdents d2/d2d/d6c 0 2023-12-16T03:16:13.384 INFO:tasks.workunit.client.0.smithi064.stdout:4/879: dwrite d0/d42/d53/dd4/f104 [0,4194304] 0 2023-12-16T03:16:13.384 INFO:tasks.workunit.client.0.smithi064.stdout:6/719: dwrite d3/d8/da/f85 [0,4194304] 0 2023-12-16T03:16:13.384 INFO:tasks.workunit.client.0.smithi064.stdout:4/880: stat d0/d1e/f37 0 2023-12-16T03:16:13.384 INFO:tasks.workunit.client.0.smithi064.stdout:6/720: dread - d3/d9/f89 zero size 2023-12-16T03:16:13.384 INFO:tasks.workunit.client.0.smithi064.stdout:3/888: dwrite f6 [4194304,4194304] 0 2023-12-16T03:16:13.385 INFO:tasks.workunit.client.0.smithi064.stdout:5/726: truncate d0/d19/d48/d8f/dac/d23/ffb 1116531 0 2023-12-16T03:16:13.389 INFO:tasks.workunit.client.0.smithi064.stdout:8/826: link d0/da/de9/d37/d3a/dab/dfa/d46/d54/d7c/l116 d0/da/de9/d37/d3a/dab/l120 0 2023-12-16T03:16:13.389 INFO:tasks.workunit.client.0.smithi064.stdout:8/827: truncate d0/da/de9/d12/d44/d68/ffc 386272 0 2023-12-16T03:16:13.389 INFO:tasks.workunit.client.0.smithi064.stdout:8/828: readlink d0/d1d/d24/d2f/d50/d70/da4/ld8 0 2023-12-16T03:16:13.394 INFO:tasks.workunit.client.0.smithi064.stdout:9/801: mkdir d2/dc/d24/d39/d5e/d6f/d107 0 2023-12-16T03:16:13.405 INFO:tasks.workunit.client.0.smithi064.stdout:3/889: dwrite db/d4f/f6b [0,4194304] 0 2023-12-16T03:16:13.406 INFO:tasks.workunit.client.0.smithi064.stdout:0/784: dwrite d2/d8/f1c [0,4194304] 0 2023-12-16T03:16:13.407 INFO:tasks.workunit.client.0.smithi064.stdout:4/881: creat d0/d10d/f11b x:0 0 0 2023-12-16T03:16:13.409 INFO:tasks.workunit.client.0.smithi064.stdout:4/882: dread d0/d42/d66/d33/fad [0,4194304] 0 2023-12-16T03:16:13.410 INFO:tasks.workunit.client.0.smithi064.stdout:4/883: chown d0/d42/d66/d5a/d90 1231 1 2023-12-16T03:16:13.410 INFO:tasks.workunit.client.0.smithi064.stdout:6/721: creat d3/d80/dcf/fd7 x:0 0 0 2023-12-16T03:16:13.413 INFO:tasks.workunit.client.0.smithi064.stdout:8/829: symlink d0/da/de9/d37/d3a/dab/dfa/d46/d54/d7c/d85/l121 0 2023-12-16T03:16:13.415 INFO:tasks.workunit.client.0.smithi064.stdout:9/802: symlink d2/l108 0 2023-12-16T03:16:13.417 INFO:tasks.workunit.client.0.smithi064.stdout:3/890: mknod db/d4f/da9/dbf/dfc/c11d 0 2023-12-16T03:16:13.419 INFO:tasks.workunit.client.0.smithi064.stdout:9/803: dread d2/dc/d24/d39/fee [0,4194304] 0 2023-12-16T03:16:13.419 INFO:tasks.workunit.client.0.smithi064.stdout:2/731: sync 2023-12-16T03:16:13.419 INFO:tasks.workunit.client.0.smithi064.stdout:7/769: sync 2023-12-16T03:16:13.419 INFO:tasks.workunit.client.0.smithi064.stdout:2/732: write d1/d15/d1b/d9c/d68/f64 [918361,5851] 0 2023-12-16T03:16:13.421 INFO:tasks.workunit.client.0.smithi064.stdout:0/785: creat d2/d29/d66/db9/f109 x:0 0 0 2023-12-16T03:16:13.421 INFO:tasks.workunit.client.0.smithi064.stdout:0/786: fsync d2/d7/f49 0 2023-12-16T03:16:13.421 INFO:tasks.workunit.client.0.smithi064.stdout:0/787: chown d2/d7/d6b/cba 237167121 1 2023-12-16T03:16:13.421 INFO:tasks.workunit.client.0.smithi064.stdout:0/788: dread - d2/d8/da/dbc/ff5 zero size 2023-12-16T03:16:13.421 INFO:tasks.workunit.client.0.smithi064.stdout:8/830: dread d0/da/de9/d12/d44/d68/fc6 [0,4194304] 0 2023-12-16T03:16:13.421 INFO:tasks.workunit.client.0.smithi064.stdout:8/831: chown d0/da/de9/l2b 2780 1 2023-12-16T03:16:13.421 INFO:tasks.workunit.client.0.smithi064.stdout:8/832: fdatasync d0/da/de9/d37/d3a/dab/dfa/d46/f81 0 2023-12-16T03:16:13.425 INFO:tasks.workunit.client.0.smithi064.stdout:6/722: unlink d3/d44/d7a/l9b 0 2023-12-16T03:16:13.427 INFO:tasks.workunit.client.0.smithi064.stdout:3/891: symlink db/l11e 0 2023-12-16T03:16:13.430 INFO:tasks.workunit.client.0.smithi064.stdout:9/804: creat d2/d2d/d6c/da4/f109 x:0 0 0 2023-12-16T03:16:13.430 INFO:tasks.workunit.client.0.smithi064.stdout:9/805: truncate d2/d2d/d36/f60 4404403 0 2023-12-16T03:16:13.431 INFO:tasks.workunit.client.0.smithi064.stdout:9/806: chown d2/d2d/d3b/c54 73638642 1 2023-12-16T03:16:13.435 INFO:tasks.workunit.client.0.smithi064.stdout:7/770: link d7/d3e/d42/d48/d51/d7c/c6a d7/d3e/d42/d89/d20/d37/db1/dbf/cfb 0 2023-12-16T03:16:13.435 INFO:tasks.workunit.client.0.smithi064.stdout:7/771: chown d7/d3e/d42/d89/d20/d37/l70 105 1 2023-12-16T03:16:13.435 INFO:tasks.workunit.client.0.smithi064.stdout:7/772: chown d7/d3e/d42/d48/d51/d7c/f94 257 1 2023-12-16T03:16:13.437 INFO:tasks.workunit.client.0.smithi064.stdout:2/733: mkdir d1/d15/d7d/dc6/dec 0 2023-12-16T03:16:13.437 INFO:tasks.workunit.client.0.smithi064.stdout:2/734: fdatasync d1/d15/d1b/dc3/fd3 0 2023-12-16T03:16:13.438 INFO:tasks.workunit.client.0.smithi064.stdout:4/884: dwrite d0/d42/d53/de6/f108 [0,4194304] 0 2023-12-16T03:16:13.438 INFO:tasks.workunit.client.0.smithi064.stdout:7/773: read d7/d26/d30/fab [1397767,15542] 0 2023-12-16T03:16:13.438 INFO:tasks.workunit.client.0.smithi064.stdout:7/774: dread - d7/d3e/d42/d48/d51/d7c/df5/f98 zero size 2023-12-16T03:16:13.438 INFO:tasks.workunit.client.0.smithi064.stdout:8/833: dread d0/da/de9/d12/f15 [0,4194304] 0 2023-12-16T03:16:13.441 INFO:tasks.workunit.client.0.smithi064.stdout:0/789: creat d2/d29/dc8/dea/f10a x:0 0 0 2023-12-16T03:16:13.444 INFO:tasks.workunit.client.0.smithi064.stdout:0/790: read d2/d8/da/df/f5c [1443564,94341] 0 2023-12-16T03:16:13.445 INFO:tasks.workunit.client.0.smithi064.stdout:0/791: chown d2/d8/f4c 1318544700 1 2023-12-16T03:16:13.447 INFO:tasks.workunit.client.0.smithi064.stdout:3/892: symlink db/d12/d1a/d2c/d34/d4c/d6a/da7/d39/l11f 0 2023-12-16T03:16:13.448 INFO:tasks.workunit.client.0.smithi064.stdout:5/727: dwrite d0/d19/fee [0,4194304] 0 2023-12-16T03:16:13.448 INFO:tasks.workunit.client.0.smithi064.stdout:6/723: dwrite d3/d8/d13/d46/f77 [0,4194304] 0 2023-12-16T03:16:13.449 INFO:tasks.workunit.client.0.smithi064.stdout:6/724: write d3/d9/dbe/fc3 [663740,67117] 0 2023-12-16T03:16:13.449 INFO:tasks.workunit.client.0.smithi064.stdout:6/725: stat d3/d8/d13/d46/l63 0 2023-12-16T03:16:13.450 INFO:tasks.workunit.client.0.smithi064.stdout:9/807: symlink d2/dc/d24/d39/d42/l10a 0 2023-12-16T03:16:13.450 INFO:tasks.workunit.client.0.smithi064.stdout:9/808: fdatasync d2/dc/d24/db2/dc3/fff 0 2023-12-16T03:16:13.451 INFO:tasks.workunit.client.0.smithi064.stdout:2/735: unlink d1/d15/da5/lbc 0 2023-12-16T03:16:13.456 INFO:tasks.workunit.client.0.smithi064.stdout:4/885: creat d0/d42/d4c/d70/f11c x:0 0 0 2023-12-16T03:16:13.456 INFO:tasks.workunit.client.0.smithi064.stdout:2/736: write d1/f8 [29184,5390] 0 2023-12-16T03:16:13.456 INFO:tasks.workunit.client.0.smithi064.stdout:7/775: dwrite d7/d3e/d42/d48/d51/d7c/d52/f99 [0,4194304] 0 2023-12-16T03:16:13.456 INFO:tasks.workunit.client.0.smithi064.stdout:8/834: link d0/da/de9/d37/d10d/l45 d0/da/de9/d37/d3a/dab/dfa/dc0/d117/l122 0 2023-12-16T03:16:13.457 INFO:tasks.workunit.client.0.smithi064.stdout:8/835: write d0/d1d/d24/f36 [3516419,28882] 0 2023-12-16T03:16:13.465 INFO:tasks.workunit.client.0.smithi064.stdout:0/792: creat d2/d8/da/df/db0/f10b x:0 0 0 2023-12-16T03:16:13.471 INFO:tasks.workunit.client.0.smithi064.stdout:5/728: getdents d0/d50/df5 0 2023-12-16T03:16:13.474 INFO:tasks.workunit.client.0.smithi064.stdout:6/726: mkdir d3/d80/dcf/d47/dd8 0 2023-12-16T03:16:13.477 INFO:tasks.workunit.client.0.smithi064.stdout:9/809: mkdir d2/dc/d24/d39/d42/d57/d10b 0 2023-12-16T03:16:13.483 INFO:tasks.workunit.client.0.smithi064.stdout:4/886: mknod d0/d42/d53/dd4/c11d 0 2023-12-16T03:16:13.483 INFO:tasks.workunit.client.0.smithi064.stdout:4/887: fdatasync d0/da/da6/dd8/ff0 0 2023-12-16T03:16:13.486 INFO:tasks.workunit.client.0.smithi064.stdout:3/893: rename db/d12/d1a/d2c/d34/d4c/l71 to db/d4f/da9/dbf/l120 0 2023-12-16T03:16:13.491 INFO:tasks.workunit.client.0.smithi064.stdout:2/737: mknod d1/d15/da5/ced 0 2023-12-16T03:16:13.496 INFO:tasks.workunit.client.0.smithi064.stdout:7/776: mkdir d7/d3e/d42/d48/d51/d7c/df5/d82/dfc 0 2023-12-16T03:16:13.496 INFO:tasks.workunit.client.0.smithi064.stdout:7/777: fsync d7/d3e/d42/d48/f5e 0 2023-12-16T03:16:13.496 INFO:tasks.workunit.client.0.smithi064.stdout:7/778: read - d7/d26/d30/da3/dc3/fdd zero size 2023-12-16T03:16:13.497 INFO:tasks.workunit.client.0.smithi064.stdout:8/836: truncate d0/da/de9/f4f 3935066 0 2023-12-16T03:16:13.499 INFO:tasks.workunit.client.0.smithi064.stdout:0/793: mkdir d2/d29/d10c 0 2023-12-16T03:16:13.501 INFO:tasks.workunit.client.0.smithi064.stdout:5/729: fdatasync d0/d19/fad 0 2023-12-16T03:16:13.501 INFO:tasks.workunit.client.0.smithi064.stdout:5/730: write d0/d50/d39/daa/dc5/ffa [575719,90053] 0 2023-12-16T03:16:13.502 INFO:tasks.workunit.client.0.smithi064.stdout:9/810: truncate d2/dc/d24/d39/d77/d7d/db9/fd5 989375 0 2023-12-16T03:16:13.505 INFO:tasks.workunit.client.0.smithi064.stdout:4/888: mknod d0/d42/d4c/d70/dfc/d115/c11e 0 2023-12-16T03:16:13.508 INFO:tasks.workunit.client.0.smithi064.stdout:6/727: rename d3/d8/lbf to d3/d80/dcf/d47/d7c/ld9 0 2023-12-16T03:16:13.508 INFO:tasks.workunit.client.0.smithi064.stdout:6/728: chown d3/c27 367926 1 2023-12-16T03:16:13.508 INFO:tasks.workunit.client.0.smithi064.stdout:6/729: read - d3/d80/d92/fc2 zero size 2023-12-16T03:16:13.511 INFO:tasks.workunit.client.0.smithi064.stdout:3/894: dread db/d12/d1a/d2c/d34/d4c/d6a/da7/fb7 [0,4194304] 0 2023-12-16T03:16:13.511 INFO:tasks.workunit.client.0.smithi064.stdout:2/738: symlink d1/d15/d7d/dc6/lee 0 2023-12-16T03:16:13.514 INFO:tasks.workunit.client.0.smithi064.stdout:7/779: mkdir d7/d3e/d42/d89/d20/d6f/d93/dfd 0 2023-12-16T03:16:13.516 INFO:tasks.workunit.client.0.smithi064.stdout:8/837: getdents d0/d1d/d73/dd9 0 2023-12-16T03:16:13.520 INFO:tasks.workunit.client.0.smithi064.stdout:5/731: creat d0/d14/f101 x:0 0 0 2023-12-16T03:16:13.522 INFO:tasks.workunit.client.0.smithi064.stdout:9/811: dwrite d2/d2d/d3b/d3c/d34/f9f [0,4194304] 0 2023-12-16T03:16:13.527 INFO:tasks.workunit.client.0.smithi064.stdout:2/739: mkdir d1/d15/da5/def 0 2023-12-16T03:16:13.528 INFO:tasks.workunit.client.0.smithi064.stdout:5/732: rmdir d0/d14/d20/df9/dfc/dfd 39 2023-12-16T03:16:13.532 INFO:tasks.workunit.client.0.smithi064.stdout:9/812: creat d2/d2d/d36/db4/f10c x:0 0 0 2023-12-16T03:16:13.534 INFO:tasks.workunit.client.0.smithi064.stdout:2/740: symlink d1/d15/d7d/dc6/de1/lf0 0 2023-12-16T03:16:13.534 INFO:tasks.workunit.client.0.smithi064.stdout:2/741: getdents d1/d15/d1b/d49/da0/de8 0 2023-12-16T03:16:13.535 INFO:tasks.workunit.client.0.smithi064.stdout:5/733: rmdir d0/d19/d48/d8f/d3e/d35/d5d/d9a 39 2023-12-16T03:16:13.536 INFO:tasks.workunit.client.0.smithi064.stdout:0/794: dwrite d2/d29/d66/db9/f109 [0,4194304] 0 2023-12-16T03:16:13.537 INFO:tasks.workunit.client.0.smithi064.stdout:2/742: mkdir d1/d15/d1b/d61/df1 0 2023-12-16T03:16:13.540 INFO:tasks.workunit.client.0.smithi064.stdout:5/734: dread d0/d7/d34/f83 [0,4194304] 0 2023-12-16T03:16:13.540 INFO:tasks.workunit.client.0.smithi064.stdout:5/735: getdents d0/d19/d48/d8f/dac/d23/d67/da7/df6 0 2023-12-16T03:16:13.541 INFO:tasks.workunit.client.0.smithi064.stdout:8/838: dwrite d0/da/de9/d12/d44/d68/ffc [0,4194304] 0 2023-12-16T03:16:13.541 INFO:tasks.workunit.client.0.smithi064.stdout:0/795: link d2/d8/da/f9a d2/d29/d66/f10d 0 2023-12-16T03:16:13.541 INFO:tasks.workunit.client.0.smithi064.stdout:0/796: read - d2/d29/de7/feb zero size 2023-12-16T03:16:13.541 INFO:tasks.workunit.client.0.smithi064.stdout:4/889: dwrite d0/d42/d53/f102 [0,4194304] 0 2023-12-16T03:16:13.543 INFO:tasks.workunit.client.0.smithi064.stdout:2/743: link d1/d15/d1b/d9c/fd5 d1/d15/d23/ff2 0 2023-12-16T03:16:13.545 INFO:tasks.workunit.client.0.smithi064.stdout:3/895: rename db/d12/d1a/d2c/d34/d4c to db/d12/d1a/d2c/d34/d121 0 2023-12-16T03:16:13.546 INFO:tasks.workunit.client.0.smithi064.stdout:3/896: write db/d12/d1a/d2c/d34/de7/f7a [1454396,14889] 0 2023-12-16T03:16:13.546 INFO:tasks.workunit.client.0.smithi064.stdout:3/897: write db/d12/d1a/d2c/d34/dcd/f108 [340281,70080] 0 2023-12-16T03:16:13.546 INFO:tasks.workunit.client.0.smithi064.stdout:2/744: write d1/d15/d23/d2d/f3c [2354918,95112] 0 2023-12-16T03:16:13.546 INFO:tasks.workunit.client.0.smithi064.stdout:2/745: chown d1/d15/d7d/dac/c54 30936 1 2023-12-16T03:16:13.547 INFO:tasks.workunit.client.0.smithi064.stdout:5/736: mknod d0/d19/d48/d8f/dac/d23/d67/da7/df6/c102 0 2023-12-16T03:16:13.547 INFO:tasks.workunit.client.0.smithi064.stdout:7/780: rmdir d7/d3e 39 2023-12-16T03:16:13.550 INFO:tasks.workunit.client.0.smithi064.stdout:8/839: truncate d0/da/de9/d37/f43 2088462 0 2023-12-16T03:16:13.553 INFO:tasks.workunit.client.0.smithi064.stdout:0/797: getdents d2/d8/da/d11 0 2023-12-16T03:16:13.553 INFO:tasks.workunit.client.0.smithi064.stdout:0/798: write d2/d8/da/d11/d64/f78 [1467676,34822] 0 2023-12-16T03:16:13.554 INFO:tasks.workunit.client.0.smithi064.stdout:0/799: readlink d2/d7/d10/dc4/l105 0 2023-12-16T03:16:13.554 INFO:tasks.workunit.client.0.smithi064.stdout:0/800: fsync d2/d8/f45 0 2023-12-16T03:16:13.556 INFO:tasks.workunit.client.0.smithi064.stdout:4/890: mknod d0/d42/d66/d5a/c11f 0 2023-12-16T03:16:13.561 INFO:tasks.workunit.client.0.smithi064.stdout:0/801: dread d2/d7/d10/d21/d31/fca [0,4194304] 0 2023-12-16T03:16:13.561 INFO:tasks.workunit.client.0.smithi064.stdout:3/898: mknod db/d12/d1a/d2c/c122 0 2023-12-16T03:16:13.562 INFO:tasks.workunit.client.0.smithi064.stdout:0/802: dread d2/d8/da/df/fb4 [0,4194304] 0 2023-12-16T03:16:13.565 INFO:tasks.workunit.client.0.smithi064.stdout:2/746: creat d1/d15/d7d/dc6/ff3 x:0 0 0 2023-12-16T03:16:13.566 INFO:tasks.workunit.client.0.smithi064.stdout:5/737: symlink d0/d14/d20/df9/l103 0 2023-12-16T03:16:13.566 INFO:tasks.workunit.client.0.smithi064.stdout:5/738: write d0/d19/d48/d8f/d3e/d35/f8a [1885061,51391] 0 2023-12-16T03:16:13.566 INFO:tasks.workunit.client.0.smithi064.stdout:5/739: chown d0/d50/f30 5 1 2023-12-16T03:16:13.568 INFO:tasks.workunit.client.0.smithi064.stdout:7/781: creat d7/d3e/d42/d48/d51/d7c/df5/d82/dfc/ffe x:0 0 0 2023-12-16T03:16:13.569 INFO:tasks.workunit.client.0.smithi064.stdout:7/782: write d7/d3e/f78 [2590446,63268] 0 2023-12-16T03:16:13.573 INFO:tasks.workunit.client.0.smithi064.stdout:8/840: creat d0/d1d/d24/d2f/d50/d70/dcc/f123 x:0 0 0 2023-12-16T03:16:13.573 INFO:tasks.workunit.client.0.smithi064.stdout:8/841: fdatasync d0/d1d/d24/fc3 0 2023-12-16T03:16:13.573 INFO:tasks.workunit.client.0.smithi064.stdout:8/842: readlink d0/da/de9/d111/l11f 0 2023-12-16T03:16:13.573 INFO:tasks.workunit.client.0.smithi064.stdout:8/843: dread - d0/da/de9/d111/fd3 zero size 2023-12-16T03:16:13.577 INFO:tasks.workunit.client.0.smithi064.stdout:1/938: sync 2023-12-16T03:16:13.577 INFO:tasks.workunit.client.0.smithi064.stdout:1/939: fsync d3/dd/d11/dbf/d10f/f101 0 2023-12-16T03:16:13.578 INFO:tasks.workunit.client.0.smithi064.stdout:3/899: unlink db/d4f/d51/db3/l10e 0 2023-12-16T03:16:13.580 INFO:tasks.workunit.client.0.smithi064.stdout:0/803: creat d2/d5b/f10e x:0 0 0 2023-12-16T03:16:13.580 INFO:tasks.workunit.client.0.smithi064.stdout:0/804: fdatasync d2/f7c 0 2023-12-16T03:16:13.585 INFO:tasks.workunit.client.0.smithi064.stdout:7/783: creat d7/d3e/d42/d48/d51/d7c/d52/fff x:0 0 0 2023-12-16T03:16:13.585 INFO:tasks.workunit.client.0.smithi064.stdout:7/784: write d7/d3e/d42/d48/d51/d7c/df5/fed [285026,91889] 0 2023-12-16T03:16:13.587 INFO:tasks.workunit.client.0.smithi064.stdout:4/891: dread d0/d12/fc8 [0,4194304] 0 2023-12-16T03:16:13.587 INFO:tasks.workunit.client.0.smithi064.stdout:5/740: dwrite d0/f7d [0,4194304] 0 2023-12-16T03:16:13.589 INFO:tasks.workunit.client.0.smithi064.stdout:0/805: rmdir d2/d7/d6b 39 2023-12-16T03:16:13.595 INFO:tasks.workunit.client.0.smithi064.stdout:8/844: unlink d0/da/de9/d111/fd3 0 2023-12-16T03:16:13.598 INFO:tasks.workunit.client.0.smithi064.stdout:2/747: rename d1/d15/d1b/c82 to d1/d15/d1b/d9c/d68/cf4 0 2023-12-16T03:16:13.598 INFO:tasks.workunit.client.0.smithi064.stdout:2/748: dread - d1/d15/d1b/d9c/f95 zero size 2023-12-16T03:16:13.599 INFO:tasks.workunit.client.0.smithi064.stdout:1/940: dwrite d3/d36/d44/d4d/fae [0,4194304] 0 2023-12-16T03:16:13.600 INFO:tasks.workunit.client.0.smithi064.stdout:7/785: stat d7/d26/dc2/lb4 0 2023-12-16T03:16:13.600 INFO:tasks.workunit.client.0.smithi064.stdout:7/786: write d7/d3e/d42/d48/fea [564638,125280] 0 2023-12-16T03:16:13.603 INFO:tasks.workunit.client.0.smithi064.stdout:8/845: rename d0/d1d/d24/d2f/d50/f87 to d0/da/de9/d12/f124 0 2023-12-16T03:16:13.603 INFO:tasks.workunit.client.0.smithi064.stdout:8/846: chown d0/da/de9/d37/d3a/dab/dfa/d46/d54/d7c/l116 11 1 2023-12-16T03:16:13.608 INFO:tasks.workunit.client.0.smithi064.stdout:1/941: creat d3/dd/d23/d86/f126 x:0 0 0 2023-12-16T03:16:13.609 INFO:tasks.workunit.client.0.smithi064.stdout:7/787: mknod d7/d3e/c100 0 2023-12-16T03:16:13.609 INFO:tasks.workunit.client.0.smithi064.stdout:7/788: fdatasync d7/d3e/d42/d89/f6e 0 2023-12-16T03:16:13.611 INFO:tasks.workunit.client.0.smithi064.stdout:4/892: dwrite d0/d42/d56/fef [0,4194304] 0 2023-12-16T03:16:13.613 INFO:tasks.workunit.client.0.smithi064.stdout:3/900: dwrite db/d12/d1a/d2c/d34/d121/d6a/da7/d39/f78 [4194304,4194304] 0 2023-12-16T03:16:13.613 INFO:tasks.workunit.client.0.smithi064.stdout:2/749: dread d1/d15/d1b/d9c/d68/f3f [0,4194304] 0 2023-12-16T03:16:13.613 INFO:tasks.workunit.client.0.smithi064.stdout:1/942: creat d3/dd/d11/dbf/f127 x:0 0 0 2023-12-16T03:16:13.614 INFO:tasks.workunit.client.0.smithi064.stdout:1/943: chown d3/dd/d2a/f108 8635 1 2023-12-16T03:16:13.614 INFO:tasks.workunit.client.0.smithi064.stdout:0/806: dwrite d2/d8/da/f9a [0,4194304] 0 2023-12-16T03:16:13.617 INFO:tasks.workunit.client.0.smithi064.stdout:7/789: rename d7/d3e/d42/d89/d20/c22 to d7/d3e/d42/d48/d51/c101 0 2023-12-16T03:16:13.619 INFO:tasks.workunit.client.0.smithi064.stdout:7/790: write d7/d26/dc2/fbb [117709,116293] 0 2023-12-16T03:16:13.619 INFO:tasks.workunit.client.0.smithi064.stdout:7/791: chown d7/d3e/d42/d89/d20/d6f/d93 1729069 1 2023-12-16T03:16:13.622 INFO:tasks.workunit.client.0.smithi064.stdout:4/893: dread d0/d42/d53/dd4/f104 [0,4194304] 0 2023-12-16T03:16:13.623 INFO:tasks.workunit.client.0.smithi064.stdout:8/847: rmdir d0/d1d/d24/d2f 39 2023-12-16T03:16:13.623 INFO:tasks.workunit.client.0.smithi064.stdout:8/848: chown d0/fb6 1664 1 2023-12-16T03:16:13.629 INFO:tasks.workunit.client.0.smithi064.stdout:2/750: unlink d1/d15/d7d/f6f 0 2023-12-16T03:16:13.631 INFO:tasks.workunit.client.0.smithi064.stdout:0/807: dwrite d2/d7/d10/d21/fc0 [0,4194304] 0 2023-12-16T03:16:13.632 INFO:tasks.workunit.client.0.smithi064.stdout:1/944: dwrite d3/dd/d11/dbf/f127 [0,4194304] 0 2023-12-16T03:16:13.636 INFO:tasks.workunit.client.0.smithi064.stdout:7/792: mkdir d7/d26/d95/d102 0 2023-12-16T03:16:13.639 INFO:tasks.workunit.client.0.smithi064.stdout:4/894: mkdir d0/d42/d4c/d70/dfc/d120 0 2023-12-16T03:16:13.639 INFO:tasks.workunit.client.0.smithi064.stdout:2/751: dread d1/f7 [0,4194304] 0 2023-12-16T03:16:13.643 INFO:tasks.workunit.client.0.smithi064.stdout:0/808: dread d2/f32 [0,4194304] 0 2023-12-16T03:16:13.643 INFO:tasks.workunit.client.0.smithi064.stdout:8/849: mknod d0/d1d/d24/d9c/de5/c125 0 2023-12-16T03:16:13.643 INFO:tasks.workunit.client.0.smithi064.stdout:8/850: dread - d0/d1d/d73/ff9 zero size 2023-12-16T03:16:13.643 INFO:tasks.workunit.client.0.smithi064.stdout:8/851: dread - d0/da/de9/d37/d3a/dab/dfa/d46/feb zero size 2023-12-16T03:16:13.643 INFO:tasks.workunit.client.0.smithi064.stdout:8/852: dread - d0/da/de9/d37/d3a/d95/fb8 zero size 2023-12-16T03:16:13.643 INFO:tasks.workunit.client.0.smithi064.stdout:2/752: dread d1/d15/d1b/dc3/fd3 [0,4194304] 0 2023-12-16T03:16:13.649 INFO:tasks.workunit.client.0.smithi064.stdout:3/901: rename db/d12/d1a/d31 to db/d12/d1a/d123 0 2023-12-16T03:16:13.653 INFO:tasks.workunit.client.0.smithi064.stdout:1/945: dread - d3/d36/d44/d4d/f88 zero size 2023-12-16T03:16:13.653 INFO:tasks.workunit.client.0.smithi064.stdout:1/946: chown d3/fde 434872551 1 2023-12-16T03:16:13.654 INFO:tasks.workunit.client.0.smithi064.stdout:7/793: mkdir d7/d26/d30/d103 0 2023-12-16T03:16:13.657 INFO:tasks.workunit.client.0.smithi064.stdout:4/895: creat d0/d42/d4c/d70/dfc/d115/f121 x:0 0 0 2023-12-16T03:16:13.661 INFO:tasks.workunit.client.0.smithi064.stdout:2/753: chown d1/d15/d1b/c8d 1 1 2023-12-16T03:16:13.664 INFO:tasks.workunit.client.0.smithi064.stdout:1/947: rename d3/dd/c7f to d3/d36/d44/d4d/d58/df1/c128 0 2023-12-16T03:16:13.664 INFO:tasks.workunit.client.0.smithi064.stdout:1/948: dread - d3/dd/d11/d2f/d10a/f106 zero size 2023-12-16T03:16:13.666 INFO:tasks.workunit.client.0.smithi064.stdout:0/809: dread d2/d8/da/df/f41 [0,4194304] 0 2023-12-16T03:16:13.667 INFO:tasks.workunit.client.0.smithi064.stdout:8/853: dwrite d0/da/de9/d37/d3a/f57 [0,4194304] 0 2023-12-16T03:16:13.667 INFO:tasks.workunit.client.0.smithi064.stdout:8/854: fsync d0/da/de9/f76 0 2023-12-16T03:16:13.668 INFO:tasks.workunit.client.0.smithi064.stdout:3/902: dwrite db/d4f/da9/dbf/d75/d92/f117 [4194304,4194304] 0 2023-12-16T03:16:13.669 INFO:tasks.workunit.client.0.smithi064.stdout:4/896: mkdir d0/d42/d4c/d70/d8c/d122 0 2023-12-16T03:16:13.674 INFO:tasks.workunit.client.0.smithi064.stdout:2/754: creat d1/d15/d7d/dc6/dec/ff5 x:0 0 0 2023-12-16T03:16:13.674 INFO:tasks.workunit.client.0.smithi064.stdout:2/755: write d1/d15/f28 [1788110,29812] 0 2023-12-16T03:16:13.676 INFO:tasks.workunit.client.0.smithi064.stdout:2/756: dread d1/d76/d57/f80 [0,4194304] 0 2023-12-16T03:16:13.676 INFO:tasks.workunit.client.0.smithi064.stdout:2/757: chown d1/d76/d57/fb9 674964 1 2023-12-16T03:16:13.677 INFO:tasks.workunit.client.0.smithi064.stdout:2/758: write d1/d15/d1b/d49/da0/d8f/f9d [169229,86652] 0 2023-12-16T03:16:13.677 INFO:tasks.workunit.client.0.smithi064.stdout:7/794: rename d7/d3e/d42/d48/d51/d7c/df5/f98 to d7/d3e/d42/d43/f104 0 2023-12-16T03:16:13.677 INFO:tasks.workunit.client.0.smithi064.stdout:7/795: write d7/d26/d30/fab [3454356,86024] 0 2023-12-16T03:16:13.680 INFO:tasks.workunit.client.0.smithi064.stdout:1/949: link d3/dd/d23/d60/fe6 d3/dd/d11/dbf/d10f/f129 0 2023-12-16T03:16:13.681 INFO:tasks.workunit.client.0.smithi064.stdout:0/810: symlink d2/d29/de7/l10f 0 2023-12-16T03:16:13.685 INFO:tasks.workunit.client.0.smithi064.stdout:8/855: dwrite d0/d1d/d24/d2f/d50/fe3 [0,4194304] 0 2023-12-16T03:16:13.687 INFO:tasks.workunit.client.0.smithi064.stdout:3/903: creat db/d4f/d51/dd1/dd3/f124 x:0 0 0 2023-12-16T03:16:13.687 INFO:tasks.workunit.client.0.smithi064.stdout:3/904: readlink db/d12/d1a/d2c/d34/d121/d6a/da7/d39/l11f 0 2023-12-16T03:16:13.688 INFO:tasks.workunit.client.0.smithi064.stdout:4/897: creat d0/d12/d48/d87/d10c/f123 x:0 0 0 2023-12-16T03:16:13.688 INFO:tasks.workunit.client.0.smithi064.stdout:8/856: write d0/da/de9/d37/f43 [984221,22169] 0 2023-12-16T03:16:13.690 INFO:tasks.workunit.client.0.smithi064.stdout:2/759: creat d1/d15/d58/ff6 x:0 0 0 2023-12-16T03:16:13.691 INFO:tasks.workunit.client.0.smithi064.stdout:3/905: dread db/d12/d21/f30 [4194304,4194304] 0 2023-12-16T03:16:13.692 INFO:tasks.workunit.client.0.smithi064.stdout:7/796: rmdir d7/df7 39 2023-12-16T03:16:13.693 INFO:tasks.workunit.client.0.smithi064.stdout:0/811: mknod d2/d8/da/df/daf/dbd/c110 0 2023-12-16T03:16:13.693 INFO:tasks.workunit.client.0.smithi064.stdout:0/812: readlink d2/d7/d10/dc4/dcc/db5/lb8 0 2023-12-16T03:16:13.702 INFO:tasks.workunit.client.0.smithi064.stdout:1/950: dwrite d3/d36/d44/d4d/da8/dc4/f117 [0,4194304] 0 2023-12-16T03:16:13.702 INFO:tasks.workunit.client.0.smithi064.stdout:4/898: dread d0/d12/d48/fcf [0,4194304] 0 2023-12-16T03:16:13.702 INFO:tasks.workunit.client.0.smithi064.stdout:2/760: dread d1/d15/d1b/d49/da0/d8f/f9d [0,4194304] 0 2023-12-16T03:16:13.703 INFO:tasks.workunit.client.0.smithi064.stdout:3/906: creat db/d12/d1a/d2c/d34/d121/d6a/f125 x:0 0 0 2023-12-16T03:16:13.703 INFO:tasks.workunit.client.0.smithi064.stdout:8/857: rename d0/d1d/d24/f100 to d0/da/de9/f126 0 2023-12-16T03:16:13.704 INFO:tasks.workunit.client.0.smithi064.stdout:1/951: dread d3/d36/d44/d4d/d58/f6e [0,4194304] 0 2023-12-16T03:16:13.704 INFO:tasks.workunit.client.0.smithi064.stdout:7/797: creat d7/f105 x:0 0 0 2023-12-16T03:16:13.704 INFO:tasks.workunit.client.0.smithi064.stdout:7/798: chown d7/la9 42343726 1 2023-12-16T03:16:13.710 INFO:tasks.workunit.client.0.smithi064.stdout:4/899: unlink d0/d42/d4c/d70/d8c/lae 0 2023-12-16T03:16:13.710 INFO:tasks.workunit.client.0.smithi064.stdout:8/858: mkdir d0/da/de9/d37/d3a/dab/dfa/dc0/d127 0 2023-12-16T03:16:13.710 INFO:tasks.workunit.client.0.smithi064.stdout:8/859: chown d0/da/de9/d12/d44/f8b 206543236 1 2023-12-16T03:16:13.712 INFO:tasks.workunit.client.0.smithi064.stdout:3/907: symlink db/d4f/da9/dbf/d75/l126 0 2023-12-16T03:16:13.713 INFO:tasks.workunit.client.0.smithi064.stdout:1/952: creat d3/dd/d23/d4f/daf/dca/f12a x:0 0 0 2023-12-16T03:16:13.717 INFO:tasks.workunit.client.0.smithi064.stdout:0/813: dwrite d2/d8/da/df/f4d [0,4194304] 0 2023-12-16T03:16:13.719 INFO:tasks.workunit.client.0.smithi064.stdout:8/860: truncate d0/da/de9/f4f 2822939 0 2023-12-16T03:16:13.719 INFO:tasks.workunit.client.0.smithi064.stdout:8/861: readlink d0/da/de9/d12/l19 0 2023-12-16T03:16:13.719 INFO:tasks.workunit.client.0.smithi064.stdout:7/799: write d7/d3e/d42/d48/d51/d7c/d52/f99 [497916,98291] 0 2023-12-16T03:16:13.719 INFO:tasks.workunit.client.0.smithi064.stdout:7/800: fsync d7/d3e/d42/d89/d20/d37/db1/fd9 0 2023-12-16T03:16:13.722 INFO:tasks.workunit.client.0.smithi064.stdout:2/761: dwrite d1/d15/d1b/d9c/f74 [0,4194304] 0 2023-12-16T03:16:13.722 INFO:tasks.workunit.client.0.smithi064.stdout:4/900: dread d0/d42/f5c [0,4194304] 0 2023-12-16T03:16:13.722 INFO:tasks.workunit.client.0.smithi064.stdout:4/901: chown d0/d42/l83 368358475 1 2023-12-16T03:16:13.726 INFO:tasks.workunit.client.0.smithi064.stdout:2/762: write d1/d15/d1b/d49/da0/fdf [545878,97157] 0 2023-12-16T03:16:13.727 INFO:tasks.workunit.client.0.smithi064.stdout:2/763: chown d1/d15/d7d/dac/c37 207635353 1 2023-12-16T03:16:13.728 INFO:tasks.workunit.client.0.smithi064.stdout:3/908: dwrite db/d12/d1a/d2c/d34/d121/d6a/f81 [0,4194304] 0 2023-12-16T03:16:13.728 INFO:tasks.workunit.client.0.smithi064.stdout:0/814: link d2/d8/c2e d2/d8/c111 0 2023-12-16T03:16:13.728 INFO:tasks.workunit.client.0.smithi064.stdout:0/815: write d2/d7/d10/dc4/dcc/f68 [534438,13631] 0 2023-12-16T03:16:13.730 INFO:tasks.workunit.client.0.smithi064.stdout:8/862: rename d0/da/f65 to d0/da/de9/d37/d3a/dab/dfa/dc0/d119/f128 0 2023-12-16T03:16:13.733 INFO:tasks.workunit.client.0.smithi064.stdout:7/801: symlink d7/d3e/d42/d89/d20/d37/db1/db6/dd6/l106 0 2023-12-16T03:16:13.737 INFO:tasks.workunit.client.0.smithi064.stdout:4/902: stat d0/d42/d66/d33/ld5 0 2023-12-16T03:16:13.737 INFO:tasks.workunit.client.0.smithi064.stdout:4/903: chown d0/l76 3 1 2023-12-16T03:16:13.737 INFO:tasks.workunit.client.0.smithi064.stdout:4/904: write d0/d42/f52 [981226,102985] 0 2023-12-16T03:16:13.737 INFO:tasks.workunit.client.0.smithi064.stdout:4/905: dread - d0/d42/d4c/d70/d8c/fc5 zero size 2023-12-16T03:16:13.738 INFO:tasks.workunit.client.0.smithi064.stdout:2/764: chown d1/d15/d1b/l96 393129744 1 2023-12-16T03:16:13.738 INFO:tasks.workunit.client.0.smithi064.stdout:2/765: chown d1/f4 2823 1 2023-12-16T03:16:13.739 INFO:tasks.workunit.client.0.smithi064.stdout:3/909: mkdir db/d12/d1a/d2c/d34/d121/d6a/d93/d127 0 2023-12-16T03:16:13.741 INFO:tasks.workunit.client.0.smithi064.stdout:0/816: creat d2/d7/d10/f112 x:0 0 0 2023-12-16T03:16:13.744 INFO:tasks.workunit.client.0.smithi064.stdout:2/766: dread d1/d15/d1b/d9c/d68/f3f [0,4194304] 0 2023-12-16T03:16:13.744 INFO:tasks.workunit.client.0.smithi064.stdout:8/863: mknod d0/d1d/d24/d2f/d50/d70/dcc/c129 0 2023-12-16T03:16:13.744 INFO:tasks.workunit.client.0.smithi064.stdout:2/767: chown d1/d15/d23/f7a 19842 1 2023-12-16T03:16:13.744 INFO:tasks.workunit.client.0.smithi064.stdout:2/768: write d1/d15/d1b/d49/f6b [1973849,13089] 0 2023-12-16T03:16:13.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/769: chown d1/d15/d1b/d49/da0/l92 4 1 2023-12-16T03:16:13.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/770: dread - d1/d15/d1b/d9c/d68/fce zero size 2023-12-16T03:16:13.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/771: fdatasync d1/d15/fd2 0 2023-12-16T03:16:13.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/772: chown d1/c13 479514 1 2023-12-16T03:16:13.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/773: chown d1/db3/dc5/ce2 1663 1 2023-12-16T03:16:13.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/774: stat d1/d15/d58/ff6 0 2023-12-16T03:16:13.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/775: chown d1/d15/d7d/dc6/de1/fe9 16 1 2023-12-16T03:16:13.745 INFO:tasks.workunit.client.0.smithi064.stdout:2/776: chown d1/d15/d23/fbd 1292 1 2023-12-16T03:16:13.747 INFO:tasks.workunit.client.0.smithi064.stdout:7/802: creat d7/d3e/d42/d48/d51/d7c/df5/d82/f107 x:0 0 0 2023-12-16T03:16:13.748 INFO:tasks.workunit.client.0.smithi064.stdout:4/906: creat d0/da/f124 x:0 0 0 2023-12-16T03:16:13.748 INFO:tasks.workunit.client.0.smithi064.stdout:5/741: sync 2023-12-16T03:16:13.748 INFO:tasks.workunit.client.0.smithi064.stdout:5/742: fsync d0/d19/d48/d8f/d3e/d35/f8a 0 2023-12-16T03:16:13.748 INFO:tasks.workunit.client.0.smithi064.stdout:5/743: fdatasync d0/d50/d39/fbf 0 2023-12-16T03:16:13.750 INFO:tasks.workunit.client.0.smithi064.stdout:0/817: creat d2/d8/da/df/f113 x:0 0 0 2023-12-16T03:16:13.751 INFO:tasks.workunit.client.0.smithi064.stdout:6/730: sync 2023-12-16T03:16:13.751 INFO:tasks.workunit.client.0.smithi064.stdout:6/731: write d3/d9/f89 [2963,108528] 0 2023-12-16T03:16:13.751 INFO:tasks.workunit.client.0.smithi064.stdout:6/732: truncate d3/d80/dcf/d47/d4a/d67/d73/fad 4608292 0 2023-12-16T03:16:13.751 INFO:tasks.workunit.client.0.smithi064.stdout:6/733: dread - d3/d80/dcf/d47/d4a/d67/d73/f76 zero size 2023-12-16T03:16:13.751 INFO:tasks.workunit.client.0.smithi064.stdout:9/813: sync 2023-12-16T03:16:13.756 INFO:tasks.workunit.client.0.smithi064.stdout:3/910: dwrite db/d12/d1a/d2c/d34/d121/d6a/da7/f24 [4194304,4194304] 0 2023-12-16T03:16:13.758 INFO:tasks.workunit.client.0.smithi064.stdout:3/911: write db/d4f/da9/dbf/d75/f8a [24386,99236] 0 2023-12-16T03:16:13.758 INFO:tasks.workunit.client.0.smithi064.stdout:2/777: creat d1/d15/d1b/d49/da0/ff7 x:0 0 0 2023-12-16T03:16:13.759 INFO:tasks.workunit.client.0.smithi064.stdout:0/818: dread d2/f27 [0,4194304] 0 2023-12-16T03:16:13.759 INFO:tasks.workunit.client.0.smithi064.stdout:3/912: read db/d12/d1a/d2c/d34/d121/d6a/da7/d39/f78 [1420180,2100] 0 2023-12-16T03:16:13.760 INFO:tasks.workunit.client.0.smithi064.stdout:5/744: mkdir d0/d50/d39/daa/dc5/d104 0 2023-12-16T03:16:13.760 INFO:tasks.workunit.client.0.smithi064.stdout:5/745: fdatasync d0/d19/d48/d8f/dac/d23/fec 0 2023-12-16T03:16:13.761 INFO:tasks.workunit.client.0.smithi064.stdout:3/913: read db/d12/d4e/f73 [289807,29521] 0 2023-12-16T03:16:13.762 INFO:tasks.workunit.client.0.smithi064.stdout:9/814: creat d2/d2d/d3b/d3c/d34/dce/de2/f10d x:0 0 0 2023-12-16T03:16:13.763 INFO:tasks.workunit.client.0.smithi064.stdout:9/815: dread - d2/dc/d24/d39/d42/f48 zero size 2023-12-16T03:16:13.763 INFO:tasks.workunit.client.0.smithi064.stdout:9/816: fdatasync d2/d7e/f8d 0 2023-12-16T03:16:13.763 INFO:tasks.workunit.client.0.smithi064.stdout:9/817: truncate d2/d2d/d3b/d3c/d4b/fc7 114493 0 2023-12-16T03:16:13.764 INFO:tasks.workunit.client.0.smithi064.stdout:9/818: write d2/dc/d24/f5a [2259367,116502] 0 2023-12-16T03:16:13.764 INFO:tasks.workunit.client.0.smithi064.stdout:7/803: dread d7/d3e/d42/d48/f5e [0,4194304] 0 2023-12-16T03:16:13.765 INFO:tasks.workunit.client.0.smithi064.stdout:3/914: write db/d12/d1a/f38 [1187296,88173] 0 2023-12-16T03:16:13.765 INFO:tasks.workunit.client.0.smithi064.stdout:3/915: fdatasync db/d4f/d51/ff6 0 2023-12-16T03:16:13.766 INFO:tasks.workunit.client.0.smithi064.stdout:5/746: dread d0/d19/d48/d8f/d3e/d35/d5d/f66 [0,4194304] 0 2023-12-16T03:16:13.775 INFO:tasks.workunit.client.0.smithi064.stdout:7/804: rename d7/d3e/d42/d43/f7e to d7/d3e/d42/d89/d20/d6f/d93/dfd/f108 0 2023-12-16T03:16:13.777 INFO:tasks.workunit.client.0.smithi064.stdout:3/916: mknod db/d4f/d51/dd1/c128 0 2023-12-16T03:16:13.780 INFO:tasks.workunit.client.0.smithi064.stdout:5/747: mknod d0/d19/d48/d8f/dac/d23/d91/c105 0 2023-12-16T03:16:13.787 INFO:tasks.workunit.client.0.smithi064.stdout:5/748: creat d0/d50/d39/daa/df4/f106 x:0 0 0 2023-12-16T03:16:13.788 INFO:tasks.workunit.client.0.smithi064.stdout:4/907: dwrite d0/d42/d66/d5a/fcd [0,4194304] 0 2023-12-16T03:16:13.788 INFO:tasks.workunit.client.0.smithi064.stdout:4/908: fdatasync d0/d1e/d36/f9b 0 2023-12-16T03:16:13.788 INFO:tasks.workunit.client.0.smithi064.stdout:5/749: stat d0/c46 0 2023-12-16T03:16:13.788 INFO:tasks.workunit.client.0.smithi064.stdout:5/750: write d0/d14/d20/f38 [4854616,100370] 0 2023-12-16T03:16:13.788 INFO:tasks.workunit.client.0.smithi064.stdout:6/734: dwrite d3/d8/da/f37 [0,4194304] 0 2023-12-16T03:16:13.789 INFO:tasks.workunit.client.0.smithi064.stdout:5/751: mknod d0/d50/df5/df7/c107 0 2023-12-16T03:16:13.792 INFO:tasks.workunit.client.0.smithi064.stdout:6/735: creat d3/d44/fda x:0 0 0 2023-12-16T03:16:13.793 INFO:tasks.workunit.client.0.smithi064.stdout:5/752: symlink d0/d50/d39/daa/dc5/d104/l108 0 2023-12-16T03:16:13.794 INFO:tasks.workunit.client.0.smithi064.stdout:6/736: creat d3/d8/d13/d46/fdb x:0 0 0 2023-12-16T03:16:13.794 INFO:tasks.workunit.client.0.smithi064.stdout:8/864: dwrite d0/da/de9/d37/d3a/dab/dfa/f98 [0,4194304] 0 2023-12-16T03:16:13.794 INFO:tasks.workunit.client.0.smithi064.stdout:8/865: stat d0/da/de9/d12/c3f 0 2023-12-16T03:16:13.795 INFO:tasks.workunit.client.0.smithi064.stdout:5/753: read d0/d19/fad [6182078,55366] 0 2023-12-16T03:16:13.795 INFO:tasks.workunit.client.0.smithi064.stdout:6/737: symlink d3/d8/d13/d58/ldc 0 2023-12-16T03:16:13.797 INFO:tasks.workunit.client.0.smithi064.stdout:7/805: dwrite d7/d3e/d42/d48/d51/d7c/df5/d82/dfc/ffe [0,4194304] 0 2023-12-16T03:16:13.797 INFO:tasks.workunit.client.0.smithi064.stdout:8/866: write d0/da/de9/d12/d44/d68/fbe [3927829,72001] 0 2023-12-16T03:16:13.797 INFO:tasks.workunit.client.0.smithi064.stdout:5/754: creat d0/d19/d48/d8f/d3e/d35/d5d/f109 x:0 0 0 2023-12-16T03:16:13.799 INFO:tasks.workunit.client.0.smithi064.stdout:6/738: mkdir d3/d80/d92/ddd 0 2023-12-16T03:16:13.804 INFO:tasks.workunit.client.0.smithi064.stdout:3/917: dwrite db/d4f/da9/dbf/d75/d92/f11c [0,4194304] 0 2023-12-16T03:16:13.804 INFO:tasks.workunit.client.0.smithi064.stdout:3/918: chown db/d12/d1a/d2c/d34/d121/d6a/d93/fa6 3697 1 2023-12-16T03:16:13.810 INFO:tasks.workunit.client.0.smithi064.stdout:8/867: getdents d0/da/de9/d37/d3a/dab/dfa/d46/d54/d7c 0 2023-12-16T03:16:13.810 INFO:tasks.workunit.client.0.smithi064.stdout:8/868: readlink d0/l9 0 2023-12-16T03:16:13.811 INFO:tasks.workunit.client.0.smithi064.stdout:5/755: truncate d0/d7/fc2 2427232 0 2023-12-16T03:16:13.819 INFO:tasks.workunit.client.0.smithi064.stdout:7/806: dwrite d7/d3e/d42/d43/f104 [0,4194304] 0 2023-12-16T03:16:13.820 INFO:tasks.workunit.client.0.smithi064.stdout:4/909: dwrite d0/d1e/d36/f9b [0,4194304] 0 2023-12-16T03:16:13.820 INFO:tasks.workunit.client.0.smithi064.stdout:7/807: read d7/d3e/d42/d43/f104 [3575960,109489] 0 2023-12-16T03:16:13.820 INFO:tasks.workunit.client.0.smithi064.stdout:7/808: chown d7/l4f 68336 1 2023-12-16T03:16:13.820 INFO:tasks.workunit.client.0.smithi064.stdout:7/809: fdatasync d7/d3e/d42/d89/fc4 0 2023-12-16T03:16:13.824 INFO:tasks.workunit.client.0.smithi064.stdout:3/919: getdents db/d12/d1a/d2c/d34/d121/d6a/da7/d39/dc9 0 2023-12-16T03:16:13.826 INFO:tasks.workunit.client.0.smithi064.stdout:7/810: fsync d7/d3e/d42/d89/d20/d6f/d93/dfd/f108 0 2023-12-16T03:16:13.826 INFO:tasks.workunit.client.0.smithi064.stdout:7/811: truncate d7/f9 5365823 0 2023-12-16T03:16:13.827 INFO:tasks.workunit.client.0.smithi064.stdout:8/869: mkdir d0/da/de9/d5a/dec/d108/d12a 0 2023-12-16T03:16:13.830 INFO:tasks.workunit.client.0.smithi064.stdout:5/756: unlink d0/d14/d20/d37/d70/da2/fa8 0 2023-12-16T03:16:13.834 INFO:tasks.workunit.client.0.smithi064.stdout:3/920: dread db/d12/d1a/d2c/d34/f8b [0,4194304] 0 2023-12-16T03:16:13.839 INFO:tasks.workunit.client.0.smithi064.stdout:4/910: truncate d0/d1e/d36/f4d 1737349 0 2023-12-16T03:16:13.839 INFO:tasks.workunit.client.0.smithi064.stdout:4/911: truncate d0/da/da6/fb5 5097416 0 2023-12-16T03:16:13.841 INFO:tasks.workunit.client.0.smithi064.stdout:9/819: truncate d2/dc/d24/f5a 2248729 0 2023-12-16T03:16:13.846 INFO:tasks.workunit.client.0.smithi064.stdout:7/812: mknod d7/d26/d95/d102/c109 0 2023-12-16T03:16:13.846 INFO:tasks.workunit.client.0.smithi064.stdout:7/813: write d7/d3e/d42/d89/d20/d6f/d91/deb/fee [281221,121942] 0 2023-12-16T03:16:13.846 INFO:tasks.workunit.client.0.smithi064.stdout:7/814: fsync d7/d3e/d42/d89/d20/f80 0 2023-12-16T03:16:13.846 INFO:tasks.workunit.client.0.smithi064.stdout:7/815: chown d7/d3e/d42/d48/d51/l5d 7225389 1 2023-12-16T03:16:13.846 INFO:tasks.workunit.client.0.smithi064.stdout:7/816: chown d7/l66 122479 1 2023-12-16T03:16:13.848 INFO:tasks.workunit.client.0.smithi064.stdout:8/870: unlink d0/da/de9/d37/d3a/d95/ca5 0 2023-12-16T03:16:13.848 INFO:tasks.workunit.client.0.smithi064.stdout:8/871: chown d0/fe4 21 1 2023-12-16T03:16:13.852 INFO:tasks.workunit.client.0.smithi064.stdout:5/757: rename d0/d14/d20/f38 to d0/d19/d48/d8f/dac/f10a 0 2023-12-16T03:16:13.854 INFO:tasks.workunit.client.0.smithi064.stdout:4/912: mkdir d0/d42/d4c/d125 0 2023-12-16T03:16:13.855 INFO:tasks.workunit.client.0.smithi064.stdout:3/921: dwrite db/d4f/fc1 [0,4194304] 0 2023-12-16T03:16:13.855 INFO:tasks.workunit.client.0.smithi064.stdout:3/922: chown db/d4f/da9/dbf/d75/c76 1443 1 2023-12-16T03:16:13.855 INFO:tasks.workunit.client.0.smithi064.stdout:8/872: dread d0/da/de9/d37/d3a/dab/dfa/dc0/d117/f92 [0,4194304] 0 2023-12-16T03:16:13.861 INFO:tasks.workunit.client.0.smithi064.stdout:7/817: unlink d7/d3e/d42/d48/d51/d7c/df5/d82/fd8 0 2023-12-16T03:16:13.864 INFO:tasks.workunit.client.0.smithi064.stdout:4/913: link d0/d42/d53/dd4/c10e d0/d1e/d36/db7/c126 0 2023-12-16T03:16:13.865 INFO:tasks.workunit.client.0.smithi064.stdout:4/914: read d0/d1e/f69 [499090,93708] 0 2023-12-16T03:16:13.866 INFO:tasks.workunit.client.0.smithi064.stdout:4/915: fsync d0/d1e/f103 0 2023-12-16T03:16:13.866 INFO:tasks.workunit.client.0.smithi064.stdout:4/916: truncate d0/d42/d4c/d70/dfc/d115/f121 38444 0 2023-12-16T03:16:13.866 INFO:tasks.workunit.client.0.smithi064.stdout:4/917: chown d0/d42/d4c/c112 3219 1 2023-12-16T03:16:13.869 INFO:tasks.workunit.client.0.smithi064.stdout:3/923: rmdir db/d12/d1a/d123/df7/d10d 0 2023-12-16T03:16:13.875 INFO:tasks.workunit.client.0.smithi064.stdout:8/873: symlink d0/d1d/d73/dd9/df8/l12b 0 2023-12-16T03:16:13.884 INFO:tasks.workunit.client.0.smithi064.stdout:7/818: creat d7/d3e/d42/d48/f10a x:0 0 0 2023-12-16T03:16:13.884 INFO:tasks.workunit.client.0.smithi064.stdout:7/819: chown d7/d3e/d42/f72 5757 1 2023-12-16T03:16:13.887 INFO:tasks.workunit.client.0.smithi064.stdout:7/820: creat d7/d26/d30/da3/dc3/f10b x:0 0 0 2023-12-16T03:16:13.887 INFO:tasks.workunit.client.0.smithi064.stdout:7/821: dread - d7/d3e/d42/d89/f7a zero size 2023-12-16T03:16:13.887 INFO:tasks.workunit.client.0.smithi064.stdout:7/822: chown d7/d3e/d42/d48/d51/d7c/df5/d82/dfc/ffe 68520 1 2023-12-16T03:16:13.894 INFO:tasks.workunit.client.0.smithi064.stdout:7/823: mknod d7/d26/d30/da3/dc3/c10c 0 2023-12-16T03:16:13.895 INFO:tasks.workunit.client.0.smithi064.stdout:4/918: dwrite d0/d42/d56/fa5 [0,4194304] 0 2023-12-16T03:16:13.898 INFO:tasks.workunit.client.0.smithi064.stdout:3/924: dwrite db/d4f/da9/dbf/dfc/fe4 [0,4194304] 0 2023-12-16T03:16:13.898 INFO:tasks.workunit.client.0.smithi064.stdout:3/925: write db/f16 [4990740,127157] 0 2023-12-16T03:16:13.898 INFO:tasks.workunit.client.0.smithi064.stdout:3/926: fdatasync db/d4f/d51/dd1/dde/feb 0 2023-12-16T03:16:13.898 INFO:tasks.workunit.client.0.smithi064.stdout:7/824: symlink d7/l10d 0 2023-12-16T03:16:13.899 INFO:tasks.workunit.client.0.smithi064.stdout:8/874: dwrite d0/da/de9/d12/d44/d68/fbe [0,4194304] 0 2023-12-16T03:16:13.900 INFO:tasks.workunit.client.0.smithi064.stdout:3/927: write db/d4f/da9/dbf/d75/d92/f117 [965553,74864] 0 2023-12-16T03:16:13.900 INFO:tasks.workunit.client.0.smithi064.stdout:7/825: write d7/d26/d30/f57 [394888,81917] 0 2023-12-16T03:16:13.901 INFO:tasks.workunit.client.0.smithi064.stdout:4/919: unlink d0/d42/d4c/d70/d8c/da9/df3/c8e 0 2023-12-16T03:16:13.915 INFO:tasks.workunit.client.0.smithi064.stdout:8/875: link d0/da/de9/f62 d0/da/de9/d111/f12c 0 2023-12-16T03:16:13.915 INFO:tasks.workunit.client.0.smithi064.stdout:8/876: dread - d0/d1d/d3c/d42/d93/fe0 zero size 2023-12-16T03:16:13.918 INFO:tasks.workunit.client.0.smithi064.stdout:3/928: rename db/d12/d1a/d2c/d34/d121/d6a/f81 to db/d12/d1a/d123/f129 0 2023-12-16T03:16:13.922 INFO:tasks.workunit.client.0.smithi064.stdout:7/826: rmdir d7/d26/d95/dca 39 2023-12-16T03:16:13.925 INFO:tasks.workunit.client.0.smithi064.stdout:4/920: mkdir d0/d42/d4c/d70/d127 0 2023-12-16T03:16:13.933 INFO:tasks.workunit.client.0.smithi064.stdout:9/820: dwrite d2/d2d/d3b/d3c/f20 [0,4194304] 0 2023-12-16T03:16:13.933 INFO:tasks.workunit.client.0.smithi064.stdout:3/929: write db/d12/d4e/fea [2801140,30709] 0 2023-12-16T03:16:13.934 INFO:tasks.workunit.client.0.smithi064.stdout:3/930: dread - db/d12/d21/fe8 zero size 2023-12-16T03:16:13.939 INFO:tasks.workunit.client.0.smithi064.stdout:7/827: write d7/fb [779918,69209] 0 2023-12-16T03:16:13.939 INFO:tasks.workunit.client.0.smithi064.stdout:4/921: creat d0/d42/d4c/d70/d127/f128 x:0 0 0 2023-12-16T03:16:13.943 INFO:tasks.workunit.client.0.smithi064.stdout:4/922: dread d0/d12/d48/fcf [0,4194304] 0 2023-12-16T03:16:13.953 INFO:tasks.workunit.client.0.smithi064.stdout:7/828: creat d7/d3e/d42/d89/d20/d6f/d93/db0/f10e x:0 0 0 2023-12-16T03:16:13.955 INFO:tasks.workunit.client.0.smithi064.stdout:8/877: rename d0/da/de9/d5a to d0/d1d/d24/d12d 0 2023-12-16T03:16:13.955 INFO:tasks.workunit.client.0.smithi064.stdout:8/878: chown d0/d1d/d24/d2f/d50/d70/lba 3723151 1 2023-12-16T03:16:13.955 INFO:tasks.workunit.client.0.smithi064.stdout:8/879: chown d0/d1d/d73/cf4 12228 1 2023-12-16T03:16:13.955 INFO:tasks.workunit.client.0.smithi064.stdout:8/880: chown d0/da/de9/d37/d10d/l33 724177 1 2023-12-16T03:16:13.956 INFO:tasks.workunit.client.0.smithi064.stdout:4/923: symlink d0/d42/d4c/d70/d127/l129 0 2023-12-16T03:16:13.959 INFO:tasks.workunit.client.0.smithi064.stdout:7/829: link d7/d3e/d42/d48/d51/c101 d7/d3e/d42/d89/d20/d37/db1/dbf/c10f 0 2023-12-16T03:16:13.962 INFO:tasks.workunit.client.0.smithi064.stdout:9/821: rename f1 to d2/d2d/d3b/d3c/dd3/f10e 0 2023-12-16T03:16:13.964 INFO:tasks.workunit.client.0.smithi064.stdout:4/924: creat d0/d42/d66/d33/f12a x:0 0 0 2023-12-16T03:16:13.964 INFO:tasks.workunit.client.0.smithi064.stdout:4/925: write d0/d10d/f11b [517985,64404] 0 2023-12-16T03:16:13.965 INFO:tasks.workunit.client.0.smithi064.stdout:7/830: mknod d7/d3e/d42/d89/d20/d6f/d91/c110 0 2023-12-16T03:16:13.966 INFO:tasks.workunit.client.0.smithi064.stdout:7/831: write d7/d3e/d42/d89/d20/d6f/d91/deb/fee [177481,6710] 0 2023-12-16T03:16:13.970 INFO:tasks.workunit.client.0.smithi064.stdout:8/881: rename d0/da/de9/d37/d3a/dab/dfa/dc0/d127 to d0/da/de9/d12/d1c/d59/d107/d12e 0 2023-12-16T03:16:13.971 INFO:tasks.workunit.client.0.smithi064.stdout:9/822: mkdir d2/dc/d24/d39/d77/d7d/d10f 0 2023-12-16T03:16:13.973 INFO:tasks.workunit.client.0.smithi064.stdout:4/926: link d0/d42/d4c/d70/laa d0/da/da6/l12b 0 2023-12-16T03:16:13.973 INFO:tasks.workunit.client.0.smithi064.stdout:4/927: stat d0/d42/d4c/d70/d8c/f98 0 2023-12-16T03:16:13.974 INFO:tasks.workunit.client.0.smithi064.stdout:7/832: symlink d7/d26/l111 0 2023-12-16T03:16:13.976 INFO:tasks.workunit.client.0.smithi064.stdout:8/882: creat d0/d1d/d24/d12d/dec/f12f x:0 0 0 2023-12-16T03:16:13.977 INFO:tasks.workunit.client.0.smithi064.stdout:9/823: link d2/ld1 d2/d2d/d36/db4/dfd/l110 0 2023-12-16T03:16:13.978 INFO:tasks.workunit.client.0.smithi064.stdout:4/928: symlink d0/l12c 0 2023-12-16T03:16:13.979 INFO:tasks.workunit.client.0.smithi064.stdout:7/833: mknod d7/d3e/d42/d48/d51/d7c/c112 0 2023-12-16T03:16:13.980 INFO:tasks.workunit.client.0.smithi064.stdout:7/834: write d7/d3e/fc1 [1464531,84278] 0 2023-12-16T03:16:13.980 INFO:tasks.workunit.client.0.smithi064.stdout:8/883: creat d0/f130 x:0 0 0 2023-12-16T03:16:13.982 INFO:tasks.workunit.client.0.smithi064.stdout:9/824: creat d2/dc/d24/d39/d77/d7d/db9/f111 x:0 0 0 2023-12-16T03:16:13.983 INFO:tasks.workunit.client.0.smithi064.stdout:9/825: chown d2/dc/d24/da9/ld2 2259916 1 2023-12-16T03:16:13.985 INFO:tasks.workunit.client.0.smithi064.stdout:4/929: rename d0/da/c39 to d0/d42/d53/c12d 0 2023-12-16T03:16:13.985 INFO:tasks.workunit.client.0.smithi064.stdout:4/930: chown d0/l12c 865 1 2023-12-16T03:16:13.986 INFO:tasks.workunit.client.0.smithi064.stdout:7/835: mknod d7/d26/d95/c113 0 2023-12-16T03:16:13.987 INFO:tasks.workunit.client.0.smithi064.stdout:7/836: chown d7/d3e/d42/d89/d20/d6f/d93/dfd 11105077 1 2023-12-16T03:16:13.987 INFO:tasks.workunit.client.0.smithi064.stdout:7/837: chown d7/d3e/ca5 360849 1 2023-12-16T03:16:13.989 INFO:tasks.workunit.client.0.smithi064.stdout:8/884: link d0/da/de9/d12/d44/d68/d6d/f101 d0/da/de9/d12/d1c/d59/d107/f131 0 2023-12-16T03:16:13.989 INFO:tasks.workunit.client.0.smithi064.stdout:8/885: chown d0/da/de9/d12/d44/d68/d106 57864 1 2023-12-16T03:16:13.989 INFO:tasks.workunit.client.0.smithi064.stdout:8/886: readlink d0/da/de9/l31 0 2023-12-16T03:16:13.991 INFO:tasks.workunit.client.0.smithi064.stdout:9/826: rmdir d2/dc/d24/d39/d42/d9a/d8b/df4 0 2023-12-16T03:16:13.994 INFO:tasks.workunit.client.0.smithi064.stdout:4/931: creat d0/d42/d4c/d70/dfc/f12e x:0 0 0 2023-12-16T03:16:13.995 INFO:tasks.workunit.client.0.smithi064.stdout:7/838: creat d7/d3e/d42/d89/d20/d6f/d93/f114 x:0 0 0 2023-12-16T03:16:13.996 INFO:tasks.workunit.client.0.smithi064.stdout:8/887: symlink d0/d1d/d24/d2f/l132 0 2023-12-16T03:16:13.999 INFO:tasks.workunit.client.0.smithi064.stdout:4/932: mknod d0/d42/d4c/d70/dfc/d115/c12f 0 2023-12-16T03:16:14.003 INFO:tasks.workunit.client.0.smithi064.stdout:7/839: rename d7/d26/d30/f33 to d7/d3e/d42/d89/d20/d6f/d91/f115 0 2023-12-16T03:16:14.003 INFO:tasks.workunit.client.0.smithi064.stdout:7/840: write d7/d3e/d42/d48/d51/f60 [9390799,101838] 0 2023-12-16T03:16:14.003 INFO:tasks.workunit.client.0.smithi064.stdout:7/841: write d7/d3e/d42/d48/d51/d7c/d52/fff [886085,49061] 0 2023-12-16T03:16:14.003 INFO:tasks.workunit.client.0.smithi064.stdout:7/842: chown d7/ca2 202 1 2023-12-16T03:16:14.006 INFO:tasks.workunit.client.0.smithi064.stdout:8/888: symlink d0/d1d/d24/d2f/d50/d70/da4/l133 0 2023-12-16T03:16:14.008 INFO:tasks.workunit.client.0.smithi064.stdout:4/933: creat d0/d42/d4c/d70/d85/f130 x:0 0 0 2023-12-16T03:16:14.009 INFO:tasks.workunit.client.0.smithi064.stdout:8/889: write d0/f3 [3448952,44262] 0 2023-12-16T03:16:14.010 INFO:tasks.workunit.client.0.smithi064.stdout:9/827: dwrite d2/dc/d24/f5a [0,4194304] 0 2023-12-16T03:16:14.012 INFO:tasks.workunit.client.0.smithi064.stdout:4/934: creat d0/d42/d53/de6/f131 x:0 0 0 2023-12-16T03:16:14.012 INFO:tasks.workunit.client.0.smithi064.stdout:4/935: fsync d0/d1e/d36/f93 0 2023-12-16T03:16:14.014 INFO:tasks.workunit.client.0.smithi064.stdout:8/890: mknod d0/d1d/d73/dd9/c134 0 2023-12-16T03:16:14.014 INFO:tasks.workunit.client.0.smithi064.stdout:8/891: dread - d0/da/de9/d37/d3a/dab/dfa/f69 zero size 2023-12-16T03:16:14.019 INFO:tasks.workunit.client.0.smithi064.stdout:7/843: dwrite d7/d3e/d42/d89/fc4 [0,4194304] 0 2023-12-16T03:16:14.020 INFO:tasks.workunit.client.0.smithi064.stdout:8/892: creat d0/d1d/d103/f135 x:0 0 0 2023-12-16T03:16:14.020 INFO:tasks.workunit.client.0.smithi064.stdout:9/828: read d2/d2d/d3b/d3c/d4b/fc7 [45745,4086] 0 2023-12-16T03:16:14.023 INFO:tasks.workunit.client.0.smithi064.stdout:7/844: write d7/d3e/d42/d89/d20/f3a [945421,97084] 0 2023-12-16T03:16:14.025 INFO:tasks.workunit.client.0.smithi064.stdout:8/893: creat d0/d1d/d24/d2f/f136 x:0 0 0 2023-12-16T03:16:14.026 INFO:tasks.workunit.client.0.smithi064.stdout:9/829: readlink d2/d2d/l30 0 2023-12-16T03:16:14.027 INFO:tasks.workunit.client.0.smithi064.stdout:4/936: dwrite d0/f2 [8388608,4194304] 0 2023-12-16T03:16:14.029 INFO:tasks.workunit.client.0.smithi064.stdout:7/845: symlink d7/df7/dfa/l116 0 2023-12-16T03:16:14.031 INFO:tasks.workunit.client.0.smithi064.stdout:8/894: creat d0/da/de9/d37/d3a/dab/dfa/d46/d54/f137 x:0 0 0 2023-12-16T03:16:14.032 INFO:tasks.workunit.client.0.smithi064.stdout:9/830: creat d2/dc/d24/d39/d42/d9a/d8b/da8/f112 x:0 0 0 2023-12-16T03:16:14.032 INFO:tasks.workunit.client.0.smithi064.stdout:9/831: stat d2/d7e/fa3 0 2023-12-16T03:16:14.034 INFO:tasks.workunit.client.0.smithi064.stdout:0/819: sync 2023-12-16T03:16:14.034 INFO:tasks.workunit.client.0.smithi064.stdout:0/820: fsync d2/d29/d66/f10d 0 2023-12-16T03:16:14.034 INFO:tasks.workunit.client.0.smithi064.stdout:0/821: stat d2/d8/da/d11/l7d 0 2023-12-16T03:16:14.041 INFO:tasks.workunit.client.0.smithi064.stdout:1/953: sync 2023-12-16T03:16:14.042 INFO:tasks.workunit.client.0.smithi064.stdout:1/954: dread d3/dd/d11/dbf/d10f/f129 [0,4194304] 0 2023-12-16T03:16:14.051 INFO:tasks.workunit.client.0.smithi064.stdout:8/895: creat d0/da/de9/d12/d44/d68/d6d/f138 x:0 0 0 2023-12-16T03:16:14.051 INFO:tasks.workunit.client.0.smithi064.stdout:9/832: creat d2/dc/d24/d39/d42/d57/d10b/f113 x:0 0 0 2023-12-16T03:16:14.051 INFO:tasks.workunit.client.0.smithi064.stdout:9/833: chown d2/f85 2 1 2023-12-16T03:16:14.051 INFO:tasks.workunit.client.0.smithi064.stdout:7/846: mkdir d7/d26/d30/d117 0 2023-12-16T03:16:14.051 INFO:tasks.workunit.client.0.smithi064.stdout:9/834: stat d2/dc/d24/fd6 0 2023-12-16T03:16:14.051 INFO:tasks.workunit.client.0.smithi064.stdout:0/822: unlink d2/f5 0 2023-12-16T03:16:14.052 INFO:tasks.workunit.client.0.smithi064.stdout:1/955: unlink d3/dd/d23/d86/f126 0 2023-12-16T03:16:14.056 INFO:tasks.workunit.client.0.smithi064.stdout:0/823: rename d2/d7/d10/d85/d88/da0 to d2/d7/d10/d114 0 2023-12-16T03:16:14.056 INFO:tasks.workunit.client.0.smithi064.stdout:0/824: chown d2/d8/da/dbc/ff5 29453 1 2023-12-16T03:16:14.060 INFO:tasks.workunit.client.0.smithi064.stdout:0/825: rename f1 to d2/d29/dc8/dea/f115 0 2023-12-16T03:16:14.063 INFO:tasks.workunit.client.0.smithi064.stdout:0/826: mkdir d2/d7/d10/dc4/dcc/db5/d116 0 2023-12-16T03:16:14.067 INFO:tasks.workunit.client.0.smithi064.stdout:0/827: creat d2/d29/de7/f117 x:0 0 0 2023-12-16T03:16:14.070 INFO:tasks.workunit.client.0.smithi064.stdout:8/896: dread d0/da/de9/d12/d44/fc7 [0,4194304] 0 2023-12-16T03:16:14.072 INFO:tasks.workunit.client.0.smithi064.stdout:8/897: symlink d0/d1d/d73/dd9/d109/l139 0 2023-12-16T03:16:14.073 INFO:tasks.workunit.client.0.smithi064.stdout:8/898: mkdir d0/d1d/d13a 0 2023-12-16T03:16:14.075 INFO:tasks.workunit.client.0.smithi064.stdout:8/899: creat d0/d1d/d73/f13b x:0 0 0 2023-12-16T03:16:14.077 INFO:tasks.workunit.client.0.smithi064.stdout:9/835: dwrite d2/d2d/d3b/d3c/d4b/fc7 [0,4194304] 0 2023-12-16T03:16:14.077 INFO:tasks.workunit.client.0.smithi064.stdout:9/836: write d2/d2d/ff5 [1482583,57207] 0 2023-12-16T03:16:14.077 INFO:tasks.workunit.client.0.smithi064.stdout:9/837: getdents d2/d2d/d6c/dc8 0 2023-12-16T03:16:14.077 INFO:tasks.workunit.client.0.smithi064.stdout:7/847: dwrite d7/f53 [0,4194304] 0 2023-12-16T03:16:14.078 INFO:tasks.workunit.client.0.smithi064.stdout:7/848: fdatasync d7/f14 0 2023-12-16T03:16:14.078 INFO:tasks.workunit.client.0.smithi064.stdout:8/900: unlink d0/da/de9/d37/d10d/d38/fd2 0 2023-12-16T03:16:14.078 INFO:tasks.workunit.client.0.smithi064.stdout:8/901: truncate d0/d1d/d3c/f8e 3316202 0 2023-12-16T03:16:14.087 INFO:tasks.workunit.client.0.smithi064.stdout:7/849: mknod d7/d3e/d42/d89/d20/d37/db1/c118 0 2023-12-16T03:16:14.087 INFO:tasks.workunit.client.0.smithi064.stdout:7/850: readlink d7/d26/l111 0 2023-12-16T03:16:14.089 INFO:tasks.workunit.client.0.smithi064.stdout:0/828: dwrite d2/f8d [0,4194304] 0 2023-12-16T03:16:14.091 INFO:tasks.workunit.client.0.smithi064.stdout:0/829: creat d2/d8/da/d11/f118 x:0 0 0 2023-12-16T03:16:14.106 INFO:tasks.workunit.client.0.smithi064.stdout:8/902: dread d0/d1d/d48/fcf [0,4194304] 0 2023-12-16T03:16:14.107 INFO:tasks.workunit.client.0.smithi064.stdout:9/838: dwrite d2/d2d/f8c [0,4194304] 0 2023-12-16T03:16:14.108 INFO:tasks.workunit.client.0.smithi064.stdout:8/903: rmdir d0/da/de9/d12/d1c/d59/d107 39 2023-12-16T03:16:14.117 INFO:tasks.workunit.client.0.smithi064.stdout:9/839: readlink d2/d2d/l65 0 2023-12-16T03:16:14.117 INFO:tasks.workunit.client.0.smithi064.stdout:0/830: dwrite d2/d7/d10/f1a [0,4194304] 0 2023-12-16T03:16:14.117 INFO:tasks.workunit.client.0.smithi064.stdout:9/840: mkdir d2/dc/d8a/deb/d114 0 2023-12-16T03:16:14.120 INFO:tasks.workunit.client.0.smithi064.stdout:0/831: creat d2/d7/d10/dc4/f119 x:0 0 0 2023-12-16T03:16:14.120 INFO:tasks.workunit.client.0.smithi064.stdout:0/832: truncate d2/d7/d10/d21/d7a/f74 564388 0 2023-12-16T03:16:14.121 INFO:tasks.workunit.client.0.smithi064.stdout:0/833: read - d2/d7/d10/f84 zero size 2023-12-16T03:16:14.123 INFO:tasks.workunit.client.0.smithi064.stdout:9/841: mknod d2/dc/d24/da9/c115 0 2023-12-16T03:16:14.123 INFO:tasks.workunit.client.0.smithi064.stdout:0/834: mkdir d2/d29/dc8/dea/d11a 0 2023-12-16T03:16:14.124 INFO:tasks.workunit.client.0.smithi064.stdout:0/835: read - d2/d7/d10/dc4/dcc/dd0/fec zero size 2023-12-16T03:16:14.124 INFO:tasks.workunit.client.0.smithi064.stdout:9/842: getdents d2/d2d/d3b/d3c/d34/dce/de2 0 2023-12-16T03:16:14.126 INFO:tasks.workunit.client.0.smithi064.stdout:8/904: dwrite d0/fb6 [4194304,4194304] 0 2023-12-16T03:16:14.126 INFO:tasks.workunit.client.0.smithi064.stdout:8/905: fsync d0/d1d/d3c/d42/f5d 0 2023-12-16T03:16:14.129 INFO:tasks.workunit.client.0.smithi064.stdout:0/836: mkdir d2/d29/d66/de5/d11b 0 2023-12-16T03:16:14.129 INFO:tasks.workunit.client.0.smithi064.stdout:9/843: symlink d2/dc/d24/db2/dc3/l116 0 2023-12-16T03:16:14.129 INFO:tasks.workunit.client.0.smithi064.stdout:0/837: dread - d2/d8/da/df/daf/dbd/ff8 zero size 2023-12-16T03:16:14.134 INFO:tasks.workunit.client.0.smithi064.stdout:8/906: getdents d0/da/de9/d12/d1c/d59/d107 0 2023-12-16T03:16:14.135 INFO:tasks.workunit.client.0.smithi064.stdout:8/907: write d0/d1d/d24/f36 [823955,127210] 0 2023-12-16T03:16:14.139 INFO:tasks.workunit.client.0.smithi064.stdout:0/838: creat d2/d29/db1/f11c x:0 0 0 2023-12-16T03:16:14.140 INFO:tasks.workunit.client.0.smithi064.stdout:8/908: symlink d0/da/de9/d37/d3a/dab/dfa/dc0/d117/l13c 0 2023-12-16T03:16:14.143 INFO:tasks.workunit.client.0.smithi064.stdout:0/839: mknod d2/d7/d10/d85/dff/c11d 0 2023-12-16T03:16:14.144 INFO:tasks.workunit.client.0.smithi064.stdout:8/909: rmdir d0/d1d/d24/d12d/dec/d108 39 2023-12-16T03:16:14.147 INFO:tasks.workunit.client.0.smithi064.stdout:9/844: rmdir d2/d2d/d3b 39 2023-12-16T03:16:14.151 INFO:tasks.workunit.client.0.smithi064.stdout:0/840: symlink d2/d8/da/d11/d64/l11e 0 2023-12-16T03:16:14.152 INFO:tasks.workunit.client.0.smithi064.stdout:8/910: truncate d0/d1d/d24/d2f/f4b 2179314 0 2023-12-16T03:16:14.152 INFO:tasks.workunit.client.0.smithi064.stdout:8/911: read - d0/d1d/d24/d12d/d10c/f115 zero size 2023-12-16T03:16:14.152 INFO:tasks.workunit.client.0.smithi064.stdout:8/912: stat d0/d1d/d24/d2f/d50/d70/lba 0 2023-12-16T03:16:14.155 INFO:tasks.workunit.client.0.smithi064.stdout:4/937: rmdir d0/d42/d53/de6 39 2023-12-16T03:16:14.155 INFO:tasks.workunit.client.0.smithi064.stdout:4/938: dread - d0/d42/d53/dd4/fec zero size 2023-12-16T03:16:14.161 INFO:tasks.workunit.client.0.smithi064.stdout:4/939: link d0/d12/d48/c4a d0/da/da6/de4/c132 0 2023-12-16T03:16:14.161 INFO:tasks.workunit.client.0.smithi064.stdout:4/940: stat d0/d42/d4c/cb1 0 2023-12-16T03:16:14.163 INFO:tasks.workunit.client.0.smithi064.stdout:9/845: dread d2/d2d/d3b/f49 [0,4194304] 0 2023-12-16T03:16:14.163 INFO:tasks.workunit.client.0.smithi064.stdout:9/846: chown d2/dc/l10 4905385 1 2023-12-16T03:16:14.167 INFO:tasks.workunit.client.0.smithi064.stdout:9/847: creat d2/d2d/d3b/d3c/d4b/f117 x:0 0 0 2023-12-16T03:16:14.167 INFO:tasks.workunit.client.0.smithi064.stdout:4/941: dread d0/da/da6/fb3 [0,4194304] 0 2023-12-16T03:16:14.169 INFO:tasks.workunit.client.0.smithi064.stdout:9/848: dread d2/d2d/d36/f53 [0,4194304] 0 2023-12-16T03:16:14.171 INFO:tasks.workunit.client.0.smithi064.stdout:8/913: dread d0/d1d/d48/fcf [0,4194304] 0 2023-12-16T03:16:14.175 INFO:tasks.workunit.client.0.smithi064.stdout:9/849: mknod d2/dc/d24/c118 0 2023-12-16T03:16:14.175 INFO:tasks.workunit.client.0.smithi064.stdout:9/850: write d2/d2d/d6c/da4/f109 [949836,69481] 0 2023-12-16T03:16:14.177 INFO:tasks.workunit.client.0.smithi064.stdout:4/942: dread d0/da/f88 [0,4194304] 0 2023-12-16T03:16:14.177 INFO:tasks.workunit.client.0.smithi064.stdout:4/943: chown d0/da/da6 0 1 2023-12-16T03:16:14.177 INFO:tasks.workunit.client.0.smithi064.stdout:4/944: chown d0/d42/d4c/d70/d8c/da9/dee 13 1 2023-12-16T03:16:14.177 INFO:tasks.workunit.client.0.smithi064.stdout:4/945: stat d0/da/ce5 0 2023-12-16T03:16:14.178 INFO:tasks.workunit.client.0.smithi064.stdout:4/946: write d0/d42/f72 [1391418,78808] 0 2023-12-16T03:16:14.179 INFO:tasks.workunit.client.0.smithi064.stdout:9/851: write d2/dc/d24/f5a [301616,72740] 0 2023-12-16T03:16:14.179 INFO:tasks.workunit.client.0.smithi064.stdout:8/914: mknod d0/d1d/d73/dd9/d109/c13d 0 2023-12-16T03:16:14.179 INFO:tasks.workunit.client.0.smithi064.stdout:8/915: fdatasync d0/da/de9/f66 0 2023-12-16T03:16:14.180 INFO:tasks.workunit.client.0.smithi064.stdout:1/956: rmdir d3/dd/d23 39 2023-12-16T03:16:14.180 INFO:tasks.workunit.client.0.smithi064.stdout:1/957: chown d3/dd/d11/dbf/c10d 5926916 1 2023-12-16T03:16:14.180 INFO:tasks.workunit.client.0.smithi064.stdout:1/958: fsync d3/f7b 0 2023-12-16T03:16:14.184 INFO:tasks.workunit.client.0.smithi064.stdout:9/852: mknod d2/d2d/d3b/d3c/d34/c119 0 2023-12-16T03:16:14.188 INFO:tasks.workunit.client.0.smithi064.stdout:8/916: mkdir d0/d1d/d24/d2f/d50/d70/da4/d13e 0 2023-12-16T03:16:14.188 INFO:tasks.workunit.client.0.smithi064.stdout:0/841: rmdir d2/d7/d10/d114 39 2023-12-16T03:16:14.193 INFO:tasks.workunit.client.0.smithi064.stdout:2/778: sync 2023-12-16T03:16:14.193 INFO:tasks.workunit.client.0.smithi064.stdout:1/959: mknod d3/dd/d23/d60/c12b 0 2023-12-16T03:16:14.194 INFO:tasks.workunit.client.0.smithi064.stdout:9/853: creat d2/dc/d24/d39/d5e/f11a x:0 0 0 2023-12-16T03:16:14.194 INFO:tasks.workunit.client.0.smithi064.stdout:9/854: readlink d2/dc/d24/d39/d42/l10a 0 2023-12-16T03:16:14.195 INFO:tasks.workunit.client.0.smithi064.stdout:8/917: mkdir d0/d1d/d73/dd9/d13f 0 2023-12-16T03:16:14.199 INFO:tasks.workunit.client.0.smithi064.stdout:0/842: write d2/d7/d10/d21/f39 [220632,37436] 0 2023-12-16T03:16:14.199 INFO:tasks.workunit.client.0.smithi064.stdout:0/843: write d2/d29/f2c [1214232,69566] 0 2023-12-16T03:16:14.202 INFO:tasks.workunit.client.0.smithi064.stdout:2/779: rename d1/d15/f1f to d1/d15/d1b/d9c/d69/dcf/ff8 0 2023-12-16T03:16:14.203 INFO:tasks.workunit.client.0.smithi064.stdout:1/960: getdents d3/d36/d44/d4d 0 2023-12-16T03:16:14.207 INFO:tasks.workunit.client.0.smithi064.stdout:0/844: mkdir d2/d8/da/d11/df1/d11f 0 2023-12-16T03:16:14.207 INFO:tasks.workunit.client.0.smithi064.stdout:0/845: dread - d2/d29/d66/fe6 zero size 2023-12-16T03:16:14.210 INFO:tasks.workunit.client.0.smithi064.stdout:2/780: link d1/d15/fd2 d1/d76/ff9 0 2023-12-16T03:16:14.212 INFO:tasks.workunit.client.0.smithi064.stdout:9/855: rename d2/d2d/d3b/d3c/d34/dce/de2/le9 to d2/dc/d24/d39/d42/d9a/d8b/da8/d103/l11b 0 2023-12-16T03:16:14.214 INFO:tasks.workunit.client.0.smithi064.stdout:1/961: creat d3/d36/d44/d4d/da8/dc4/f12c x:0 0 0 2023-12-16T03:16:14.216 INFO:tasks.workunit.client.0.smithi064.stdout:8/918: dwrite d0/da/de9/d12/d44/f8b [0,4194304] 0 2023-12-16T03:16:14.216 INFO:tasks.workunit.client.0.smithi064.stdout:0/846: mknod d2/d29/d10c/c120 0 2023-12-16T03:16:14.229 INFO:tasks.workunit.client.0.smithi064.stdout:2/781: mknod d1/d15/d1b/d49/cfa 0 2023-12-16T03:16:14.230 INFO:tasks.workunit.client.0.smithi064.stdout:2/782: chown d1/d15/d7d/dc6/de1/lf0 1546791459 1 2023-12-16T03:16:14.230 INFO:tasks.workunit.client.0.smithi064.stdout:9/856: link d2/dc/d24/d39/d42/dca/c106 d2/dc/d24/d39/d42/dca/c11c 0 2023-12-16T03:16:14.230 INFO:tasks.workunit.client.0.smithi064.stdout:1/962: link d3/d36/d44/d4d/dad/dc5/f118 d3/dd/de4/f12d 0 2023-12-16T03:16:14.230 INFO:tasks.workunit.client.0.smithi064.stdout:1/963: truncate d3/d36/d44/d4d/dad/dc5/f118 988803 0 2023-12-16T03:16:14.230 INFO:tasks.workunit.client.0.smithi064.stdout:1/964: readlink d3/d36/d9e/la2 0 2023-12-16T03:16:14.233 INFO:tasks.workunit.client.0.smithi064.stdout:2/783: getdents d1/d15/d7d/dc6/de1 0 2023-12-16T03:16:14.233 INFO:tasks.workunit.client.0.smithi064.stdout:2/784: chown d1/d15/d1b/d9c/d69/c47 51 1 2023-12-16T03:16:14.234 INFO:tasks.workunit.client.0.smithi064.stdout:1/965: link d3/d36/d9e/f4b d3/dd/d23/d86/d113/f12e 0 2023-12-16T03:16:14.235 INFO:tasks.workunit.client.0.smithi064.stdout:1/966: chown d3/dd/d11 2759863 1 2023-12-16T03:16:14.236 INFO:tasks.workunit.client.0.smithi064.stdout:2/785: truncate d1/f6 3193572 0 2023-12-16T03:16:14.236 INFO:tasks.workunit.client.0.smithi064.stdout:2/786: chown d1/d15/d1b/d49/cfa 7991024 1 2023-12-16T03:16:14.240 INFO:tasks.workunit.client.0.smithi064.stdout:8/919: dwrite d0/d1d/d3c/d42/d93/fbb [0,4194304] 0 2023-12-16T03:16:14.240 INFO:tasks.workunit.client.0.smithi064.stdout:1/967: dread d3/dd/d23/f7c [0,4194304] 0 2023-12-16T03:16:14.242 INFO:tasks.workunit.client.0.smithi064.stdout:8/920: read d0/da/de9/d12/d44/d68/d6d/f101 [960322,34401] 0 2023-12-16T03:16:14.246 INFO:tasks.workunit.client.0.smithi064.stdout:0/847: dwrite d2/d7/f23 [0,4194304] 0 2023-12-16T03:16:14.248 INFO:tasks.workunit.client.0.smithi064.stdout:2/787: dread d1/d15/d1b/d49/da0/fdf [0,4194304] 0 2023-12-16T03:16:14.251 INFO:tasks.workunit.client.0.smithi064.stdout:9/857: dwrite d2/dc/d24/d39/d77/d7d/fad [0,4194304] 0 2023-12-16T03:16:14.251 INFO:tasks.workunit.client.0.smithi064.stdout:9/858: readlink d2/dc/d24/d39/d5e/d6f/l79 0 2023-12-16T03:16:14.251 INFO:tasks.workunit.client.0.smithi064.stdout:9/859: readlink d2/d2d/d3b/d3c/l6a 0 2023-12-16T03:16:14.251 INFO:tasks.workunit.client.0.smithi064.stdout:1/968: rmdir d3/d22/d57 39 2023-12-16T03:16:14.253 INFO:tasks.workunit.client.0.smithi064.stdout:8/921: rename d0/da/de9/d37/d3a/f57 to d0/da/de9/d37/f140 0 2023-12-16T03:16:14.255 INFO:tasks.workunit.client.0.smithi064.stdout:0/848: mknod d2/d8/da/d11/c121 0 2023-12-16T03:16:14.258 INFO:tasks.workunit.client.0.smithi064.stdout:2/788: creat d1/d15/d58/dab/dc2/ffb x:0 0 0 2023-12-16T03:16:14.258 INFO:tasks.workunit.client.0.smithi064.stdout:2/789: write d1/d15/d1b/d9c/d68/f64 [1532370,11656] 0 2023-12-16T03:16:14.268 INFO:tasks.workunit.client.0.smithi064.stdout:1/969: creat d3/dd/d23/dcb/f12f x:0 0 0 2023-12-16T03:16:14.270 INFO:tasks.workunit.client.0.smithi064.stdout:8/922: mknod d0/d1d/d73/c141 0 2023-12-16T03:16:14.270 INFO:tasks.workunit.client.0.smithi064.stdout:6/739: sync 2023-12-16T03:16:14.270 INFO:tasks.workunit.client.0.smithi064.stdout:5/758: sync 2023-12-16T03:16:14.270 INFO:tasks.workunit.client.0.smithi064.stdout:5/759: fsync d0/f17 0 2023-12-16T03:16:14.270 INFO:tasks.workunit.client.0.smithi064.stdout:5/760: dread - d0/d50/d39/daa/dc5/fd4 zero size 2023-12-16T03:16:14.272 INFO:tasks.workunit.client.0.smithi064.stdout:6/740: write d3/d80/dcf/f9c [4135049,129862] 0 2023-12-16T03:16:14.283 INFO:tasks.workunit.client.0.smithi064.stdout:2/790: mknod d1/d15/d1b/d61/d63/cfc 0 2023-12-16T03:16:14.285 INFO:tasks.workunit.client.0.smithi064.stdout:5/761: dread d0/d19/d48/d8f/d5e/f93 [0,4194304] 0 2023-12-16T03:16:14.288 INFO:tasks.workunit.client.0.smithi064.stdout:1/970: link d3/dd/d11/d2f/c73 d3/dd/d11/dfe/c130 0 2023-12-16T03:16:14.292 INFO:tasks.workunit.client.0.smithi064.stdout:6/741: truncate d3/d8/da/f37 778523 0 2023-12-16T03:16:14.292 INFO:tasks.workunit.client.0.smithi064.stdout:6/742: fsync d3/d80/dcf/d47/d4a/d67/fbb 0 2023-12-16T03:16:14.292 INFO:tasks.workunit.client.0.smithi064.stdout:6/743: fsync d3/d80/dcf/fb7 0 2023-12-16T03:16:14.292 INFO:tasks.workunit.client.0.smithi064.stdout:6/744: getdents d3/d80/dcf/d47/d4a/d67/d73 0 2023-12-16T03:16:14.297 INFO:tasks.workunit.client.0.smithi064.stdout:8/923: dwrite d0/d1d/d24/d2f/d50/fe3 [0,4194304] 0 2023-12-16T03:16:14.297 INFO:tasks.workunit.client.0.smithi064.stdout:8/924: dread - d0/da/de9/d37/d3a/d95/fe1 zero size 2023-12-16T03:16:14.300 INFO:tasks.workunit.client.0.smithi064.stdout:5/762: mknod d0/d19/d48/d8f/d3e/d35/d5d/c10b 0 2023-12-16T03:16:14.300 INFO:tasks.workunit.client.0.smithi064.stdout:5/763: stat d0/d14/d20/d37/d70/cb0 0 2023-12-16T03:16:14.300 INFO:tasks.workunit.client.0.smithi064.stdout:5/764: fdatasync d0/d19/d48/d8f/d3e/d35/f54 0 2023-12-16T03:16:14.300 INFO:tasks.workunit.client.0.smithi064.stdout:1/971: getdents d3/d22/d57/db1 0 2023-12-16T03:16:14.302 INFO:tasks.workunit.client.0.smithi064.stdout:2/791: dread d1/d15/d1b/d9c/d69/f56 [0,4194304] 0 2023-12-16T03:16:14.313 INFO:tasks.workunit.client.0.smithi064.stdout:6/745: creat d3/d8/d13/d58/d65/fde x:0 0 0 2023-12-16T03:16:14.313 INFO:tasks.workunit.client.0.smithi064.stdout:8/925: mkdir d0/d1d/d24/d2f/d50/d70/dcc/ddf/d142 0 2023-12-16T03:16:14.313 INFO:tasks.workunit.client.0.smithi064.stdout:8/926: write d0/fa3 [218968,27880] 0 2023-12-16T03:16:14.313 INFO:tasks.workunit.client.0.smithi064.stdout:8/927: chown d0/da/de9/d37/d10d/d38/dda/c110 93722962 1 2023-12-16T03:16:14.313 INFO:tasks.workunit.client.0.smithi064.stdout:8/928: truncate d0/da/de9/d12/d44/fc8 958206 0 2023-12-16T03:16:14.327 INFO:tasks.workunit.client.0.smithi064.stdout:5/765: rmdir d0/d50/df5/df7 39 2023-12-16T03:16:14.328 INFO:tasks.workunit.client.0.smithi064.stdout:1/972: dread d3/dd/de4/fed [0,4194304] 0 2023-12-16T03:16:14.330 INFO:tasks.workunit.client.0.smithi064.stdout:6/746: symlink d3/d9/dbe/ldf 0 2023-12-16T03:16:14.330 INFO:tasks.workunit.client.0.smithi064.stdout:6/747: write d3/d9/f68 [1249560,55145] 0 2023-12-16T03:16:14.333 INFO:tasks.workunit.client.0.smithi064.stdout:5/766: symlink d0/d19/d48/d8f/d5e/l10c 0 2023-12-16T03:16:14.334 INFO:tasks.workunit.client.0.smithi064.stdout:1/973: rmdir d3/dd/d23/d60 39 2023-12-16T03:16:14.335 INFO:tasks.workunit.client.0.smithi064.stdout:6/748: mknod d3/d9/dc0/ce0 0 2023-12-16T03:16:14.338 INFO:tasks.workunit.client.0.smithi064.stdout:8/929: dwrite d0/d1d/d3c/d42/d93/fa9 [0,4194304] 0 2023-12-16T03:16:14.341 INFO:tasks.workunit.client.0.smithi064.stdout:2/792: dwrite d1/d15/d1b/faf [0,4194304] 0 2023-12-16T03:16:14.343 INFO:tasks.workunit.client.0.smithi064.stdout:5/767: mknod d0/d50/d99/c10d 0 2023-12-16T03:16:14.345 INFO:tasks.workunit.client.0.smithi064.stdout:1/974: creat d3/d36/d44/d4d/f131 x:0 0 0 2023-12-16T03:16:14.355 INFO:tasks.workunit.client.0.smithi064.stdout:2/793: symlink d1/d76/lfd 0 2023-12-16T03:16:14.361 INFO:tasks.workunit.client.0.smithi064.stdout:6/749: dwrite d3/d8/d13/d58/d65/fde [0,4194304] 0 2023-12-16T03:16:14.362 INFO:tasks.workunit.client.0.smithi064.stdout:1/975: rename d3/dd/d11/d3b/l110 to d3/d36/d9e/l132 0 2023-12-16T03:16:14.362 INFO:tasks.workunit.client.0.smithi064.stdout:1/976: write d3/dd/d23/f7c [834602,91231] 0 2023-12-16T03:16:14.362 INFO:tasks.workunit.client.0.smithi064.stdout:1/977: readlink d3/dd/d11/d2f/d10a/ldb 0 2023-12-16T03:16:14.362 INFO:tasks.workunit.client.0.smithi064.stdout:1/978: fsync d3/d36/d44/d4d/dad/dc5/fc8 0 2023-12-16T03:16:14.362 INFO:tasks.workunit.client.0.smithi064.stdout:1/979: stat d3/d36/cf7 0 2023-12-16T03:16:14.365 INFO:tasks.workunit.client.0.smithi064.stdout:2/794: mknod d1/d15/d1b/d49/da0/de8/cfe 0 2023-12-16T03:16:14.365 INFO:tasks.workunit.client.0.smithi064.stdout:2/795: fdatasync d1/d15/d23/ff2 0 2023-12-16T03:16:14.368 INFO:tasks.workunit.client.0.smithi064.stdout:6/750: mkdir d3/d9/db0/de1 0 2023-12-16T03:16:14.370 INFO:tasks.workunit.client.0.smithi064.stdout:1/980: mknod d3/d22/d57/db1/c133 0 2023-12-16T03:16:14.372 INFO:tasks.workunit.client.0.smithi064.stdout:0/849: write d2/d7/d10/d21/d7a/f74 [849962,40307] 0 2023-12-16T03:16:14.373 INFO:tasks.workunit.client.0.smithi064.stdout:5/768: dwrite d0/d50/d39/daa/df4/f106 [0,4194304] 0 2023-12-16T03:16:14.373 INFO:tasks.workunit.client.0.smithi064.stdout:5/769: readlink d0/d19/d48/d8f/dac/l6a 0 2023-12-16T03:16:14.373 INFO:tasks.workunit.client.0.smithi064.stdout:2/796: creat d1/d15/d1b/d9c/fff x:0 0 0 2023-12-16T03:16:14.379 INFO:tasks.workunit.client.0.smithi064.stdout:1/981: dread d3/dd/d11/d2f/fb6 [0,4194304] 0 2023-12-16T03:16:14.379 INFO:tasks.workunit.client.0.smithi064.stdout:1/982: readlink d3/dd/d2a/l2b 0 2023-12-16T03:16:14.381 INFO:tasks.workunit.client.0.smithi064.stdout:6/751: creat d3/d80/dcf/d47/d4a/d67/fe2 x:0 0 0 2023-12-16T03:16:14.382 INFO:tasks.workunit.client.0.smithi064.stdout:0/850: getdents d2/d29/de9 0 2023-12-16T03:16:14.388 INFO:tasks.workunit.client.0.smithi064.stdout:6/752: mknod d3/d44/d7a/ce3 0 2023-12-16T03:16:14.389 INFO:tasks.workunit.client.0.smithi064.stdout:2/797: dwrite d1/d15/d23/d2d/fc4 [4194304,4194304] 0 2023-12-16T03:16:14.389 INFO:tasks.workunit.client.0.smithi064.stdout:5/770: dread d0/f6c [0,4194304] 0 2023-12-16T03:16:14.389 INFO:tasks.workunit.client.0.smithi064.stdout:0/851: rename d2/le0 to d2/d29/de7/l122 0 2023-12-16T03:16:14.396 INFO:tasks.workunit.client.0.smithi064.stdout:5/771: dread d0/d7/d97/f9b [0,4194304] 0 2023-12-16T03:16:14.397 INFO:tasks.workunit.client.0.smithi064.stdout:2/798: dread d1/d15/d7d/dac/fa8 [0,4194304] 0 2023-12-16T03:16:14.402 INFO:tasks.workunit.client.0.smithi064.stdout:5/772: mkdir d0/d14/d4e/d10e 0 2023-12-16T03:16:14.403 INFO:tasks.workunit.client.0.smithi064.stdout:0/852: link d2/d8/da/df/f41 d2/d7/d10/d114/f123 0 2023-12-16T03:16:14.409 INFO:tasks.workunit.client.0.smithi064.stdout:3/931: sync 2023-12-16T03:16:14.411 INFO:tasks.workunit.client.0.smithi064.stdout:0/853: creat d2/d7/d10/dc4/dcc/dd0/f124 x:0 0 0 2023-12-16T03:16:14.413 INFO:tasks.workunit.client.0.smithi064.stdout:0/854: rmdir d2/d7/d10/d21/d7a 39 2023-12-16T03:16:14.419 INFO:tasks.workunit.client.0.smithi064.stdout:0/855: rename d2/d29/d66/fe6 to d2/d29/de7/f125 0 2023-12-16T03:16:14.422 INFO:tasks.workunit.client.0.smithi064.stdout:0/856: mknod d2/d7/d10/d21/d31/c126 0 2023-12-16T03:16:14.422 INFO:tasks.workunit.client.0.smithi064.stdout:0/857: dread - d2/d5b/f81 zero size 2023-12-16T03:16:14.422 INFO:tasks.workunit.client.0.smithi064.stdout:0/858: stat d2/d29/de7/feb 0 2023-12-16T03:16:14.423 INFO:tasks.workunit.client.0.smithi064.stdout:3/932: dread db/d4f/da9/dbf/dfc/fe4 [0,4194304] 0 2023-12-16T03:16:14.424 INFO:tasks.workunit.client.0.smithi064.stdout:3/933: write db/d12/d1a/d2c/d34/f3d [2608740,100380] 0 2023-12-16T03:16:14.424 INFO:tasks.workunit.client.0.smithi064.stdout:0/859: creat d2/d29/d66/de5/d11b/f127 x:0 0 0 2023-12-16T03:16:14.429 INFO:tasks.workunit.client.0.smithi064.stdout:0/860: dread d2/d7/f2b [0,4194304] 0 2023-12-16T03:16:14.432 INFO:tasks.workunit.client.0.smithi064.stdout:0/861: mkdir d2/d7/d10/d85/d88/d128 0 2023-12-16T03:16:14.437 INFO:tasks.workunit.client.0.smithi064.stdout:3/934: dread db/d12/d1a/f38 [0,4194304] 0 2023-12-16T03:16:14.437 INFO:tasks.workunit.client.0.smithi064.stdout:0/862: unlink d2/d7/d10/d114/cbe 0 2023-12-16T03:16:14.440 INFO:tasks.workunit.client.0.smithi064.stdout:0/863: creat d2/d7/d10/f129 x:0 0 0 2023-12-16T03:16:14.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:14 smithi064 ceph-mon[111958]: pgmap v6: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2023-12-16T03:16:14.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:14 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:14.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:14 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:14.442 INFO:tasks.workunit.client.0.smithi064.stdout:0/864: symlink d2/d29/dc8/dea/l12a 0 2023-12-16T03:16:14.445 INFO:tasks.workunit.client.0.smithi064.stdout:3/935: dread db/d4f/f6b [0,4194304] 0 2023-12-16T03:16:14.455 INFO:tasks.workunit.client.0.smithi064.stdout:0/865: rename d2/d29/dc8 to d2/d7/d10/d114/d12b 0 2023-12-16T03:16:14.455 INFO:tasks.workunit.client.0.smithi064.stdout:0/866: stat d2/cb 0 2023-12-16T03:16:14.457 INFO:tasks.workunit.client.0.smithi064.stdout:3/936: rename db/d12/d1a/f7d to db/d4f/d51/f12a 0 2023-12-16T03:16:14.459 INFO:tasks.workunit.client.0.smithi064.stdout:0/867: mknod d2/d29/d66/de5/d11b/c12c 0 2023-12-16T03:16:14.459 INFO:tasks.workunit.client.0.smithi064.stdout:0/868: fdatasync d2/d8/da/df/daf/fa7 0 2023-12-16T03:16:14.459 INFO:tasks.workunit.client.0.smithi064.stdout:0/869: write d2/d7/d10/dc4/dcc/dd0/f124 [782166,110020] 0 2023-12-16T03:16:14.467 INFO:tasks.workunit.client.0.smithi064.stdout:0/870: mkdir d2/d29/db1/d12d 0 2023-12-16T03:16:14.467 INFO:tasks.workunit.client.0.smithi064.stdout:0/871: read d2/d8/da/d11/f56 [1097216,75594] 0 2023-12-16T03:16:14.468 INFO:tasks.workunit.client.0.smithi064.stdout:0/872: write d2/d29/db1/ff4 [28736,40125] 0 2023-12-16T03:16:14.468 INFO:tasks.workunit.client.0.smithi064.stdout:0/873: readlink d2/d7/d6b/la9 0 2023-12-16T03:16:14.476 INFO:tasks.workunit.client.0.smithi064.stdout:7/851: sync 2023-12-16T03:16:14.476 INFO:tasks.workunit.client.0.smithi064.stdout:7/852: readlink d7/l10d 0 2023-12-16T03:16:14.477 INFO:tasks.workunit.client.0.smithi064.stdout:7/853: unlink d7/la9 0 2023-12-16T03:16:14.485 INFO:tasks.workunit.client.0.smithi064.stdout:3/937: dread db/d12/d1a/d2c/d34/d121/d6a/da7/d39/dc9/fed [0,4194304] 0 2023-12-16T03:16:14.501 INFO:tasks.workunit.client.0.smithi064.stdout:0/874: dwrite d2/d7/d10/f112 [0,4194304] 0 2023-12-16T03:16:14.503 INFO:tasks.workunit.client.0.smithi064.stdout:7/854: dwrite d7/d26/fb7 [0,4194304] 0 2023-12-16T03:16:14.503 INFO:tasks.workunit.client.0.smithi064.stdout:0/875: creat d2/d7/d10/dc4/dcc/f12e x:0 0 0 2023-12-16T03:16:14.503 INFO:tasks.workunit.client.0.smithi064.stdout:0/876: truncate d2/d29/d66/de5/f102 710954 0 2023-12-16T03:16:14.505 INFO:tasks.workunit.client.0.smithi064.stdout:3/938: dwrite db/d4f/da9/fb6 [0,4194304] 0 2023-12-16T03:16:14.509 INFO:tasks.workunit.client.0.smithi064.stdout:7/855: symlink d7/df7/l119 0 2023-12-16T03:16:14.509 INFO:tasks.workunit.client.0.smithi064.stdout:7/856: write d7/d26/d30/da3/dc3/f10b [689801,26180] 0 2023-12-16T03:16:14.509 INFO:tasks.workunit.client.0.smithi064.stdout:7/857: dread - d7/d3e/d42/d89/d20/d37/db1/ff0 zero size 2023-12-16T03:16:14.510 INFO:tasks.workunit.client.0.smithi064.stdout:0/877: write d2/d7/d10/d21/d31/f35 [421866,34966] 0 2023-12-16T03:16:14.512 INFO:tasks.workunit.client.0.smithi064.stdout:7/858: write d7/d3e/f55 [10039903,10816] 0 2023-12-16T03:16:14.514 INFO:tasks.workunit.client.0.smithi064.stdout:0/878: rename d2/d29/d66/cce to d2/d29/d66/de5/d11b/c12f 0 2023-12-16T03:16:14.516 INFO:tasks.workunit.client.0.smithi064.stdout:7/859: mknod d7/d26/d95/dca/c11a 0 2023-12-16T03:16:14.520 INFO:tasks.workunit.client.0.smithi064.stdout:0/879: dread d2/d7/f2b [0,4194304] 0 2023-12-16T03:16:14.525 INFO:tasks.workunit.client.0.smithi064.stdout:3/939: dwrite db/d4f/d51/fdc [0,4194304] 0 2023-12-16T03:16:14.525 INFO:tasks.workunit.client.0.smithi064.stdout:7/860: mknod d7/d26/d30/d117/c11b 0 2023-12-16T03:16:14.529 INFO:tasks.workunit.client.0.smithi064.stdout:3/940: rmdir db/d4f/da9/dbf/dfc 39 2023-12-16T03:16:14.529 INFO:tasks.workunit.client.0.smithi064.stdout:3/941: write db/d12/d1a/d2c/d34/d121/d6a/f125 [497420,81198] 0 2023-12-16T03:16:14.531 INFO:tasks.workunit.client.0.smithi064.stdout:0/880: dread d2/d29/f9f [0,4194304] 0 2023-12-16T03:16:14.532 INFO:tasks.workunit.client.0.smithi064.stdout:7/861: rmdir d7/df7 39 2023-12-16T03:16:14.532 INFO:tasks.workunit.client.0.smithi064.stdout:7/862: dread - d7/f105 zero size 2023-12-16T03:16:14.535 INFO:tasks.workunit.client.0.smithi064.stdout:0/881: symlink d2/d8/da/l130 0 2023-12-16T03:16:14.537 INFO:tasks.workunit.client.0.smithi064.stdout:0/882: creat d2/d8/da/d11/f131 x:0 0 0 2023-12-16T03:16:14.539 INFO:tasks.workunit.client.0.smithi064.stdout:0/883: getdents d2/d5b 0 2023-12-16T03:16:14.544 INFO:tasks.workunit.client.0.smithi064.stdout:3/942: dread db/d12/d1a/d2c/d34/d121/d6a/da7/d39/dc9/fdb [0,4194304] 0 2023-12-16T03:16:14.556 INFO:tasks.workunit.client.0.smithi064.stdout:7/863: dwrite d7/d26/d30/da3/dc3/fdd [0,4194304] 0 2023-12-16T03:16:14.556 INFO:tasks.workunit.client.0.smithi064.stdout:7/864: write d7/d3e/d42/d89/fc9 [537760,75] 0 2023-12-16T03:16:14.559 INFO:tasks.workunit.client.0.smithi064.stdout:7/865: link d7/d3e/d42/d48/d51/d7c/df5/d82/f107 d7/d3e/d42/d89/d20/d6f/d93/f11c 0 2023-12-16T03:16:14.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:14 smithi184 ceph-mon[121180]: pgmap v6: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2023-12-16T03:16:14.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:14 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:14.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:14 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:14.560 INFO:tasks.workunit.client.0.smithi064.stdout:0/884: dread d2/d7/d10/d85/d88/ffa [0,4194304] 0 2023-12-16T03:16:14.560 INFO:tasks.workunit.client.0.smithi064.stdout:0/885: chown d2/d7/c28 3376766 1 2023-12-16T03:16:14.561 INFO:tasks.workunit.client.0.smithi064.stdout:0/886: link d2/d7/d10/d21/d31/f65 d2/d29/db1/d12d/f132 0 2023-12-16T03:16:14.562 INFO:tasks.workunit.client.0.smithi064.stdout:0/887: creat d2/d7/d10/d114/d12b/dea/f133 x:0 0 0 2023-12-16T03:16:14.563 INFO:tasks.workunit.client.0.smithi064.stdout:0/888: truncate d2/f8d 2515887 0 2023-12-16T03:16:14.563 INFO:tasks.workunit.client.0.smithi064.stdout:0/889: write d2/d7/f23 [4391487,42297] 0 2023-12-16T03:16:14.564 INFO:tasks.workunit.client.0.smithi064.stdout:0/890: creat d2/d7/d10/dc4/dcc/db5/d116/f134 x:0 0 0 2023-12-16T03:16:14.566 INFO:tasks.workunit.client.0.smithi064.stdout:3/943: dwrite db/d4f/fc1 [4194304,4194304] 0 2023-12-16T03:16:14.566 INFO:tasks.workunit.client.0.smithi064.stdout:3/944: write db/d12/d1a/d123/d109/f10f [566060,32307] 0 2023-12-16T03:16:14.570 INFO:tasks.workunit.client.0.smithi064.stdout:7/866: dread d7/d3e/d42/d48/f5e [0,4194304] 0 2023-12-16T03:16:14.570 INFO:tasks.workunit.client.0.smithi064.stdout:7/867: fsync d7/d3e/d42/d89/fc4 0 2023-12-16T03:16:14.571 INFO:tasks.workunit.client.0.smithi064.stdout:3/945: link db/d12/d1a/d2c/d34/dcd/f108 db/d12/d1a/d2c/f12b 0 2023-12-16T03:16:14.571 INFO:tasks.workunit.client.0.smithi064.stdout:7/868: write d7/d3e/d42/d48/f49 [1259086,29785] 0 2023-12-16T03:16:14.572 INFO:tasks.workunit.client.0.smithi064.stdout:3/946: read db/d12/d1a/d2c/d34/d121/d6a/da7/f24 [3770951,50595] 0 2023-12-16T03:16:14.574 INFO:tasks.workunit.client.0.smithi064.stdout:7/869: mkdir d7/d3e/d42/d89/d20/d6f/d11d 0 2023-12-16T03:16:14.577 INFO:tasks.workunit.client.0.smithi064.stdout:3/947: symlink db/d12/d1a/d123/l12c 0 2023-12-16T03:16:14.579 INFO:tasks.workunit.client.0.smithi064.stdout:7/870: creat d7/d3e/d42/d89/f11e x:0 0 0 2023-12-16T03:16:14.582 INFO:tasks.workunit.client.0.smithi064.stdout:3/948: symlink db/d12/d1a/d123/d109/l12d 0 2023-12-16T03:16:14.582 INFO:tasks.workunit.client.0.smithi064.stdout:3/949: truncate db/d4f/d51/dd1/dde/feb 872811 0 2023-12-16T03:16:14.583 INFO:tasks.workunit.client.0.smithi064.stdout:0/891: dwrite d2/d8/da/f62 [0,4194304] 0 2023-12-16T03:16:14.583 INFO:tasks.workunit.client.0.smithi064.stdout:0/892: dread - d2/d5b/d103/f106 zero size 2023-12-16T03:16:14.583 INFO:tasks.workunit.client.0.smithi064.stdout:7/871: mknod d7/d3e/d42/d89/d20/d6f/d93/dfd/c11f 0 2023-12-16T03:16:14.584 INFO:tasks.workunit.client.0.smithi064.stdout:7/872: write d7/f53 [1283884,114864] 0 2023-12-16T03:16:14.585 INFO:tasks.workunit.client.0.smithi064.stdout:3/950: mknod db/d12/d1a/d2c/d34/d121/de5/c12e 0 2023-12-16T03:16:14.585 INFO:tasks.workunit.client.0.smithi064.stdout:3/951: fsync db/d12/d1a/d2c/d34/de7/f89 0 2023-12-16T03:16:14.587 INFO:tasks.workunit.client.0.smithi064.stdout:7/873: dread d7/d3e/d42/d89/fc9 [0,4194304] 0 2023-12-16T03:16:14.588 INFO:tasks.workunit.client.0.smithi064.stdout:7/874: read d7/d3e/d42/d43/f90 [3925811,93738] 0 2023-12-16T03:16:14.589 INFO:tasks.workunit.client.0.smithi064.stdout:0/893: unlink d2/d29/de7/ffe 0 2023-12-16T03:16:14.590 INFO:tasks.workunit.client.0.smithi064.stdout:3/952: symlink db/d12/d4e/da3/l12f 0 2023-12-16T03:16:14.593 INFO:tasks.workunit.client.0.smithi064.stdout:0/894: rename d2/d8/da/df/db0/cc9 to d2/d7/d10/d85/dff/c135 0 2023-12-16T03:16:14.594 INFO:tasks.workunit.client.0.smithi064.stdout:0/895: write d2/f7c [1403597,32352] 0 2023-12-16T03:16:14.598 INFO:tasks.workunit.client.0.smithi064.stdout:3/953: mknod db/d4f/da9/dbf/c130 0 2023-12-16T03:16:14.598 INFO:tasks.workunit.client.0.smithi064.stdout:3/954: stat db/d12/d1a/d2c/d34/dcd 0 2023-12-16T03:16:14.598 INFO:tasks.workunit.client.0.smithi064.stdout:0/896: read d2/d7/d10/d21/d31/fca [1174076,7086] 0 2023-12-16T03:16:14.601 INFO:tasks.workunit.client.0.smithi064.stdout:3/955: mkdir db/d12/d1a/d2c/d34/d121/d6a/da7/d39/d131 0 2023-12-16T03:16:14.601 INFO:tasks.workunit.client.0.smithi064.stdout:3/956: readlink db/d12/d1a/l102 0 2023-12-16T03:16:14.601 INFO:tasks.workunit.client.0.smithi064.stdout:7/875: dwrite d7/d3e/d42/d89/d20/d6f/d93/f11c [0,4194304] 0 2023-12-16T03:16:14.602 INFO:tasks.workunit.client.0.smithi064.stdout:0/897: creat d2/d8/da/dbc/f136 x:0 0 0 2023-12-16T03:16:14.603 INFO:tasks.workunit.client.0.smithi064.stdout:3/957: creat db/d4f/da9/dbf/d75/d92/f132 x:0 0 0 2023-12-16T03:16:14.603 INFO:tasks.workunit.client.0.smithi064.stdout:7/876: write d7/d3e/f78 [1628796,15198] 0 2023-12-16T03:16:14.606 INFO:tasks.workunit.client.0.smithi064.stdout:0/898: creat d2/d29/db1/f137 x:0 0 0 2023-12-16T03:16:14.610 INFO:tasks.workunit.client.0.smithi064.stdout:7/877: getdents d7/d3e/d42/d48/d51/d7c/df5/d82/dfc 0 2023-12-16T03:16:14.615 INFO:tasks.workunit.client.0.smithi064.stdout:0/899: dread d2/d8/da/df/daf/dbd/fde [0,4194304] 0 2023-12-16T03:16:14.615 INFO:tasks.workunit.client.0.smithi064.stdout:0/900: truncate d2/d8/da/df/f113 408847 0 2023-12-16T03:16:14.615 INFO:tasks.workunit.client.0.smithi064.stdout:3/958: mknod db/d12/d4e/c133 0 2023-12-16T03:16:14.618 INFO:tasks.workunit.client.0.smithi064.stdout:7/878: write d7/d3e/d42/d48/d51/d7c/df5/d82/f107 [4935940,91344] 0 2023-12-16T03:16:14.618 INFO:tasks.workunit.client.0.smithi064.stdout:7/879: chown d7/d26/cad 1 1 2023-12-16T03:16:14.618 INFO:tasks.workunit.client.0.smithi064.stdout:7/880: fsync d7/d3e/d42/f9c 0 2023-12-16T03:16:14.624 INFO:tasks.workunit.client.0.smithi064.stdout:3/959: rmdir db/d12/d1a/d2c/d34/d121/d6a/da7 39 2023-12-16T03:16:14.629 INFO:tasks.workunit.client.0.smithi064.stdout:7/881: link d7/d26/d30/da3/cd5 d7/d3e/d42/d48/d51/d7c/d52/de1/c120 0 2023-12-16T03:16:14.631 INFO:tasks.workunit.client.0.smithi064.stdout:7/882: creat d7/df7/dfa/f121 x:0 0 0 2023-12-16T03:16:14.632 INFO:tasks.workunit.client.0.smithi064.stdout:0/901: dwrite d2/d7/f2b [0,4194304] 0 2023-12-16T03:16:14.634 INFO:tasks.workunit.client.0.smithi064.stdout:7/883: symlink d7/d3e/d42/d89/d20/d37/l122 0 2023-12-16T03:16:14.643 INFO:tasks.workunit.client.0.smithi064.stdout:7/884: creat d7/d26/f123 x:0 0 0 2023-12-16T03:16:14.647 INFO:tasks.workunit.client.0.smithi064.stdout:0/902: rename d2/d5b/d8b to d2/d8/da/df/d138 0 2023-12-16T03:16:14.649 INFO:tasks.workunit.client.0.smithi064.stdout:0/903: dread d2/d7/d10/dc4/dcc/dd0/f124 [0,4194304] 0 2023-12-16T03:16:14.650 INFO:tasks.workunit.client.0.smithi064.stdout:7/885: dread d7/f3b [0,4194304] 0 2023-12-16T03:16:14.650 INFO:tasks.workunit.client.0.smithi064.stdout:7/886: write d7/d3e/d42/d48/d51/d7c/f77 [1352871,44348] 0 2023-12-16T03:16:14.651 INFO:tasks.workunit.client.0.smithi064.stdout:0/904: mknod d2/d29/d10c/c139 0 2023-12-16T03:16:14.654 INFO:tasks.workunit.client.0.smithi064.stdout:7/887: creat d7/d26/d30/d103/f124 x:0 0 0 2023-12-16T03:16:14.654 INFO:tasks.workunit.client.0.smithi064.stdout:7/888: chown d7/d3e/d42/d89/d20/d6f/d91/deb 132969 1 2023-12-16T03:16:14.654 INFO:tasks.workunit.client.0.smithi064.stdout:7/889: write d7/d3e/d42/d48/f49 [5139958,56862] 0 2023-12-16T03:16:14.657 INFO:tasks.workunit.client.0.smithi064.stdout:7/890: mknod d7/d3e/d42/d43/dc8/c125 0 2023-12-16T03:16:14.661 INFO:tasks.workunit.client.0.smithi064.stdout:7/891: mknod d7/d26/c126 0 2023-12-16T03:16:14.661 INFO:tasks.workunit.client.0.smithi064.stdout:7/892: dread - d7/d3e/d42/d89/d20/d6f/d93/db0/ff8 zero size 2023-12-16T03:16:14.663 INFO:tasks.workunit.client.0.smithi064.stdout:7/893: write d7/d3e/d42/d43/f90 [1269238,55861] 0 2023-12-16T03:16:14.663 INFO:tasks.workunit.client.0.smithi064.stdout:7/894: stat d7/d26/dc2 0 2023-12-16T03:16:14.663 INFO:tasks.workunit.client.0.smithi064.stdout:7/895: dread - d7/d3e/d42/d43/dc8/fe0 zero size 2023-12-16T03:16:14.663 INFO:tasks.workunit.client.0.smithi064.stdout:0/905: dwrite d2/d8/da/dbc/ff5 [0,4194304] 0 2023-12-16T03:16:14.663 INFO:tasks.workunit.client.0.smithi064.stdout:0/906: readlink d2/d8/da/l130 0 2023-12-16T03:16:14.665 INFO:tasks.workunit.client.0.smithi064.stdout:0/907: write d2/d8/da/f62 [2112650,22650] 0 2023-12-16T03:16:14.667 INFO:tasks.workunit.client.0.smithi064.stdout:7/896: getdents d7/d3e/d42/d43 0 2023-12-16T03:16:14.668 INFO:tasks.workunit.client.0.smithi064.stdout:7/897: write d7/d26/d30/fab [4674131,70221] 0 2023-12-16T03:16:14.668 INFO:tasks.workunit.client.0.smithi064.stdout:7/898: truncate d7/d26/d30/f57 3324910 0 2023-12-16T03:16:14.676 INFO:tasks.workunit.client.0.smithi064.stdout:0/908: stat d2/d7/d10/d85/d88/ccb 0 2023-12-16T03:16:14.677 INFO:tasks.workunit.client.0.smithi064.stdout:0/909: truncate d2/d8/da/fc3 66026 0 2023-12-16T03:16:14.677 INFO:tasks.workunit.client.0.smithi064.stdout:0/910: fdatasync d2/d29/db1/d12d/f132 0 2023-12-16T03:16:14.677 INFO:tasks.workunit.client.0.smithi064.stdout:0/911: readlink d2/d8/da/df/lbb 0 2023-12-16T03:16:14.679 INFO:tasks.workunit.client.0.smithi064.stdout:7/899: mkdir d7/d3e/d42/d89/d20/d6f/d91/d127 0 2023-12-16T03:16:14.689 INFO:tasks.workunit.client.0.smithi064.stdout:7/900: rmdir d7/d26/d30 39 2023-12-16T03:16:14.691 INFO:tasks.workunit.client.0.smithi064.stdout:7/901: mknod d7/d3e/d42/d89/d20/d6f/c128 0 2023-12-16T03:16:14.692 INFO:tasks.workunit.client.0.smithi064.stdout:7/902: fdatasync d7/d3e/d42/d48/fce 0 2023-12-16T03:16:14.692 INFO:tasks.workunit.client.0.smithi064.stdout:7/903: rename d7/d26/d30/da3/dc3/c10c to d7/d3e/d42/c129 0 2023-12-16T03:16:14.693 INFO:tasks.workunit.client.0.smithi064.stdout:7/904: readlink d7/d3e/d42/d48/d51/l5d 0 2023-12-16T03:16:14.693 INFO:tasks.workunit.client.0.smithi064.stdout:7/905: write d7/d3e/d42/d48/d51/d7c/d52/fbd [4867974,7682] 0 2023-12-16T03:16:14.694 INFO:tasks.workunit.client.0.smithi064.stdout:0/912: dwrite d2/f32 [0,4194304] 0 2023-12-16T03:16:14.694 INFO:tasks.workunit.client.0.smithi064.stdout:0/913: fdatasync d2/d7/f63 0 2023-12-16T03:16:14.703 INFO:tasks.workunit.client.0.smithi064.stdout:0/914: creat d2/d8/da/d11/df1/f13a x:0 0 0 2023-12-16T03:16:14.706 INFO:tasks.workunit.client.0.smithi064.stdout:0/915: link d2/cb d2/d8/da/d11/df1/c13b 0 2023-12-16T03:16:14.708 INFO:tasks.workunit.client.0.smithi064.stdout:0/916: rmdir d2/d8/da/df/db0 39 2023-12-16T03:16:14.708 INFO:tasks.workunit.client.0.smithi064.stdout:7/906: dwrite d7/d3e/d42/d48/d51/d7c/f77 [0,4194304] 0 2023-12-16T03:16:14.708 INFO:tasks.workunit.client.0.smithi064.stdout:7/907: truncate d7/d26/d95/dca/dd2/fda 419534 0 2023-12-16T03:16:14.710 INFO:tasks.workunit.client.0.smithi064.stdout:0/917: mknod d2/d7/d10/d114/d12b/dea/dd5/c13c 0 2023-12-16T03:16:14.710 INFO:tasks.workunit.client.0.smithi064.stdout:0/918: fsync d2/f8d 0 2023-12-16T03:16:14.715 INFO:tasks.workunit.client.0.smithi064.stdout:7/908: unlink d7/d3e/l83 0 2023-12-16T03:16:14.715 INFO:tasks.workunit.client.0.smithi064.stdout:7/909: truncate d7/d3e/f55 13252765 0 2023-12-16T03:16:14.718 INFO:tasks.workunit.client.0.smithi064.stdout:7/910: unlink d7/d26/d30/ca7 0 2023-12-16T03:16:14.729 INFO:tasks.workunit.client.0.smithi064.stdout:0/919: dread d2/d7/d10/d21/d31/f35 [0,4194304] 0 2023-12-16T03:16:14.729 INFO:tasks.workunit.client.0.smithi064.stdout:0/920: truncate d2/d8/da/df/f4d 1615236 0 2023-12-16T03:16:14.731 INFO:tasks.workunit.client.0.smithi064.stdout:0/921: rmdir d2/d5b 39 2023-12-16T03:16:14.731 INFO:tasks.workunit.client.0.smithi064.stdout:0/922: fdatasync d2/d29/de7/feb 0 2023-12-16T03:16:14.735 INFO:tasks.workunit.client.0.smithi064.stdout:7/911: dwrite d7/df7/dfa/f121 [0,4194304] 0 2023-12-16T03:16:14.735 INFO:tasks.workunit.client.0.smithi064.stdout:0/923: symlink d2/d7/d10/dc4/dcc/l13d 0 2023-12-16T03:16:14.736 INFO:tasks.workunit.client.0.smithi064.stdout:4/947: sync 2023-12-16T03:16:14.745 INFO:tasks.workunit.client.0.smithi064.stdout:0/924: fdatasync d2/d7/d10/f84 0 2023-12-16T03:16:14.745 INFO:tasks.workunit.client.0.smithi064.stdout:0/925: read d2/d8/da/fb6 [1252505,14195] 0 2023-12-16T03:16:14.749 INFO:tasks.workunit.client.0.smithi064.stdout:4/948: link d0/d42/d4c/d70/d8c/da9/df3/l96 d0/d42/d53/l133 0 2023-12-16T03:16:14.751 INFO:tasks.workunit.client.0.smithi064.stdout:0/926: mkdir d2/d8/da/df/daf/d13e 0 2023-12-16T03:16:14.753 INFO:tasks.workunit.client.0.smithi064.stdout:4/949: unlink d0/d12/l3e 0 2023-12-16T03:16:14.755 INFO:tasks.workunit.client.0.smithi064.stdout:4/950: mkdir d0/d42/d53/de6/d134 0 2023-12-16T03:16:14.758 INFO:tasks.workunit.client.0.smithi064.stdout:4/951: symlink d0/d42/d4c/d70/l135 0 2023-12-16T03:16:14.760 INFO:tasks.workunit.client.0.smithi064.stdout:4/952: truncate d0/d42/d4c/d70/f7d 574778 0 2023-12-16T03:16:14.761 INFO:tasks.workunit.client.0.smithi064.stdout:7/912: dwrite d7/d26/d30/fb5 [0,4194304] 0 2023-12-16T03:16:14.763 INFO:tasks.workunit.client.0.smithi064.stdout:4/953: mkdir d0/d42/d66/d33/d136 0 2023-12-16T03:16:14.767 INFO:tasks.workunit.client.0.smithi064.stdout:0/927: dwrite d2/d29/d66/db9/f107 [0,4194304] 0 2023-12-16T03:16:14.767 INFO:tasks.workunit.client.0.smithi064.stdout:0/928: readlink d2/d7/d10/d85/lcd 0 2023-12-16T03:16:14.768 INFO:tasks.workunit.client.0.smithi064.stdout:7/913: symlink d7/d26/d30/d103/l12a 0 2023-12-16T03:16:14.769 INFO:tasks.workunit.client.0.smithi064.stdout:7/914: dread - d7/d26/d95/ff1 zero size 2023-12-16T03:16:14.772 INFO:tasks.workunit.client.0.smithi064.stdout:0/929: mkdir d2/d7/d10/d114/d13f 0 2023-12-16T03:16:14.772 INFO:tasks.workunit.client.0.smithi064.stdout:0/930: write d2/d29/db1/ff4 [261273,16067] 0 2023-12-16T03:16:14.772 INFO:tasks.workunit.client.0.smithi064.stdout:0/931: dread - d2/d7/d10/d114/d12b/dea/f133 zero size 2023-12-16T03:16:14.784 INFO:tasks.workunit.client.0.smithi064.stdout:0/932: dread d2/d29/d66/f10d [0,4194304] 0 2023-12-16T03:16:14.784 INFO:tasks.workunit.client.0.smithi064.stdout:0/933: chown d2/d7/d10/dc4/dcc/db5/cfb 9830 1 2023-12-16T03:16:14.802 INFO:tasks.workunit.client.0.smithi064.stdout:7/915: dwrite d7/d3e/d42/d48/d51/d7c/df5/f81 [0,4194304] 0 2023-12-16T03:16:14.802 INFO:tasks.workunit.client.0.smithi064.stdout:4/954: dwrite d0/d42/d66/d5a/fd7 [0,4194304] 0 2023-12-16T03:16:14.803 INFO:tasks.workunit.client.0.smithi064.stdout:0/934: dwrite d2/d7/d10/dc4/dcc/db5/ff7 [0,4194304] 0 2023-12-16T03:16:14.804 INFO:tasks.workunit.client.0.smithi064.stdout:0/935: write d2/d5b/f9c [1264556,121769] 0 2023-12-16T03:16:14.808 INFO:tasks.workunit.client.0.smithi064.stdout:4/955: mknod d0/d10d/c137 0 2023-12-16T03:16:14.809 INFO:tasks.workunit.client.0.smithi064.stdout:0/936: creat d2/d7/d10/d21/d31/f140 x:0 0 0 2023-12-16T03:16:14.813 INFO:tasks.workunit.client.0.smithi064.stdout:7/916: dread d7/d3e/d42/d89/d20/d6f/d91/f115 [4194304,4194304] 0 2023-12-16T03:16:14.813 INFO:tasks.workunit.client.0.smithi064.stdout:4/956: write d0/d42/d66/d33/f81 [2939132,83436] 0 2023-12-16T03:16:14.814 INFO:tasks.workunit.client.0.smithi064.stdout:7/917: creat d7/d3e/d42/d89/d20/d6f/d11d/f12b x:0 0 0 2023-12-16T03:16:14.815 INFO:tasks.workunit.client.0.smithi064.stdout:7/918: chown d7/df7 122153726 1 2023-12-16T03:16:14.818 INFO:tasks.workunit.client.0.smithi064.stdout:4/957: creat d0/d42/d4c/f138 x:0 0 0 2023-12-16T03:16:14.819 INFO:tasks.workunit.client.0.smithi064.stdout:7/919: creat d7/f12c x:0 0 0 2023-12-16T03:16:14.821 INFO:tasks.workunit.client.0.smithi064.stdout:4/958: dread d0/da/da6/dd8/ff0 [0,4194304] 0 2023-12-16T03:16:14.822 INFO:tasks.workunit.client.0.smithi064.stdout:7/920: rmdir d7/df7/dfa 39 2023-12-16T03:16:14.823 INFO:tasks.workunit.client.0.smithi064.stdout:7/921: write d7/d26/d95/dca/ff4 [899840,68010] 0 2023-12-16T03:16:14.823 INFO:tasks.workunit.client.0.smithi064.stdout:7/922: chown d7/d26/d30/da3/dc3/ccf 1560 1 2023-12-16T03:16:14.823 INFO:tasks.workunit.client.0.smithi064.stdout:7/923: fdatasync d7/d3e/d42/d89/d20/d6f/d91/deb/fee 0 2023-12-16T03:16:14.823 INFO:tasks.workunit.client.0.smithi064.stdout:0/937: dread d2/d8/da/dbc/ff5 [0,4194304] 0 2023-12-16T03:16:14.824 INFO:tasks.workunit.client.0.smithi064.stdout:4/959: creat d0/d42/d66/d33/d136/f139 x:0 0 0 2023-12-16T03:16:14.830 INFO:tasks.workunit.client.0.smithi064.stdout:0/938: truncate d2/d8/da/df/ff0 57725 0 2023-12-16T03:16:14.831 INFO:tasks.workunit.client.0.smithi064.stdout:4/960: mknod d0/d12/c13a 0 2023-12-16T03:16:14.835 INFO:tasks.workunit.client.0.smithi064.stdout:0/939: unlink d2/d8/da/df/daf/dbd/cd3 0 2023-12-16T03:16:14.837 INFO:tasks.workunit.client.0.smithi064.stdout:4/961: rename d0/d42/d66/d33/l3f to d0/d42/d4c/d125/l13b 0 2023-12-16T03:16:14.838 INFO:tasks.workunit.client.0.smithi064.stdout:7/924: dwrite d7/d3e/d42/d89/d20/d37/f86 [0,4194304] 0 2023-12-16T03:16:14.840 INFO:tasks.workunit.client.0.smithi064.stdout:1/983: sync 2023-12-16T03:16:14.841 INFO:tasks.workunit.client.0.smithi064.stdout:8/930: sync 2023-12-16T03:16:14.841 INFO:tasks.workunit.client.0.smithi064.stdout:9/860: sync 2023-12-16T03:16:14.841 INFO:tasks.workunit.client.0.smithi064.stdout:6/753: sync 2023-12-16T03:16:14.843 INFO:tasks.workunit.client.0.smithi064.stdout:2/799: sync 2023-12-16T03:16:14.843 INFO:tasks.workunit.client.0.smithi064.stdout:5/773: sync 2023-12-16T03:16:14.843 INFO:tasks.workunit.client.0.smithi064.stdout:3/960: sync 2023-12-16T03:16:14.845 INFO:tasks.workunit.client.0.smithi064.stdout:4/962: creat d0/d42/d66/d33/d136/f13c x:0 0 0 2023-12-16T03:16:14.850 INFO:tasks.workunit.client.0.smithi064.stdout:5/774: dread d0/d19/d48/d8f/dac/d23/ffb [0,4194304] 0 2023-12-16T03:16:14.851 INFO:tasks.workunit.client.0.smithi064.stdout:7/925: creat d7/d3e/d42/d48/d51/d7c/df5/f12d x:0 0 0 2023-12-16T03:16:14.851 INFO:tasks.workunit.client.0.smithi064.stdout:7/926: chown d7/d3e/d42/d48/d51/d7c/f94 454 1 2023-12-16T03:16:14.852 INFO:tasks.workunit.client.0.smithi064.stdout:1/984: mknod d3/d36/d9e/c134 0 2023-12-16T03:16:14.852 INFO:tasks.workunit.client.0.smithi064.stdout:1/985: fdatasync d3/dd/d23/f10b 0 2023-12-16T03:16:14.853 INFO:tasks.workunit.client.0.smithi064.stdout:9/861: truncate d2/dc/d24/d39/d5e/f8f 2927121 0 2023-12-16T03:16:14.853 INFO:tasks.workunit.client.0.smithi064.stdout:9/862: fdatasync d2/d2d/d3b/fc2 0 2023-12-16T03:16:14.854 INFO:tasks.workunit.client.0.smithi064.stdout:6/754: truncate d3/d9/f45 1197157 0 2023-12-16T03:16:14.855 INFO:tasks.workunit.client.0.smithi064.stdout:2/800: mknod d1/d15/d1b/d61/d63/da2/c100 0 2023-12-16T03:16:14.858 INFO:tasks.workunit.client.0.smithi064.stdout:3/961: mkdir db/d12/d1a/d2c/d34/d121/d6a/d93/d127/d134 0 2023-12-16T03:16:14.860 INFO:tasks.workunit.client.0.smithi064.stdout:3/962: write db/d12/d1a/d2c/d34/de7/f7a [1298680,20898] 0 2023-12-16T03:16:14.861 INFO:tasks.workunit.client.0.smithi064.stdout:4/963: dread d0/d42/d53/f1d [4194304,4194304] 0 2023-12-16T03:16:14.861 INFO:tasks.workunit.client.0.smithi064.stdout:5/775: creat d0/d14/d4e/f10f x:0 0 0 2023-12-16T03:16:14.862 INFO:tasks.workunit.client.0.smithi064.stdout:0/940: dwrite d2/d7/d10/f1f [0,4194304] 0 2023-12-16T03:16:14.863 INFO:tasks.workunit.client.0.smithi064.stdout:7/927: creat d7/d26/dc2/f12e x:0 0 0 2023-12-16T03:16:14.866 INFO:tasks.workunit.client.0.smithi064.stdout:1/986: truncate d3/d36/d44/d4d/d58/fa7 2574399 0 2023-12-16T03:16:14.867 INFO:tasks.workunit.client.0.smithi064.stdout:1/987: chown d3/dd/d11/d38 288602727 1 2023-12-16T03:16:14.870 INFO:tasks.workunit.client.0.smithi064.stdout:6/755: creat d3/d8/d13/d46/d5e/da8/fe4 x:0 0 0 2023-12-16T03:16:14.873 INFO:tasks.workunit.client.0.smithi064.stdout:2/801: creat d1/d15/d1b/d49/da0/d8f/f101 x:0 0 0 2023-12-16T03:16:14.877 INFO:tasks.workunit.client.0.smithi064.stdout:4/964: mkdir d0/d42/d53/de8/d13d 0 2023-12-16T03:16:14.879 INFO:tasks.workunit.client.0.smithi064.stdout:5/776: creat d0/d14/d20/df9/dfc/dfd/df0/dc0/f110 x:0 0 0 2023-12-16T03:16:14.879 INFO:tasks.workunit.client.0.smithi064.stdout:5/777: dread - d0/d19/d48/d8f/d3e/d35/d5d/f109 zero size 2023-12-16T03:16:14.883 INFO:tasks.workunit.client.0.smithi064.stdout:0/941: mknod d2/d7/d10/d85/d88/d128/c141 0 2023-12-16T03:16:14.890 INFO:tasks.workunit.client.0.smithi064.stdout:7/928: rename d7/d3e/d42/d89/d20/d6f/d93/db0/ff8 to d7/d3e/d42/d43/f12f 0 2023-12-16T03:16:14.893 INFO:tasks.workunit.client.0.smithi064.stdout:6/756: link d3/d8/d13/c16 d3/d80/dcf/d47/d4a/d67/ce5 0 2023-12-16T03:16:14.893 INFO:tasks.workunit.client.0.smithi064.stdout:6/757: write d3/d9/f89 [584446,36456] 0 2023-12-16T03:16:14.894 INFO:tasks.workunit.client.0.smithi064.stdout:9/863: dwrite d2/d2d/d6c/d83/faa [0,4194304] 0 2023-12-16T03:16:14.894 INFO:tasks.workunit.client.0.smithi064.stdout:3/963: dwrite db/d12/d1a/d2c/d34/d121/fbb [0,4194304] 0 2023-12-16T03:16:14.894 INFO:tasks.workunit.client.0.smithi064.stdout:1/988: dwrite d3/d36/d44/d4d/f131 [0,4194304] 0 2023-12-16T03:16:14.895 INFO:tasks.workunit.client.0.smithi064.stdout:3/964: write db/d12/d1a/d2c/d34/d121/d6a/da7/d39/ff1 [1016584,83404] 0 2023-12-16T03:16:14.895 INFO:tasks.workunit.client.0.smithi064.stdout:3/965: write db/d12/d21/f69 [569779,30086] 0 2023-12-16T03:16:14.895 INFO:tasks.workunit.client.0.smithi064.stdout:2/802: dwrite d1/d15/d58/ff6 [0,4194304] 0 2023-12-16T03:16:14.898 INFO:tasks.workunit.client.0.smithi064.stdout:4/965: creat d0/d42/d4c/d70/d8c/dc7/d10f/f13e x:0 0 0 2023-12-16T03:16:14.905 INFO:tasks.workunit.client.0.smithi064.stdout:6/758: dread d3/d44/faf [0,4194304] 0 2023-12-16T03:16:14.907 INFO:tasks.workunit.client.0.smithi064.stdout:0/942: creat d2/d7/d10/d21/d31/f142 x:0 0 0 2023-12-16T03:16:14.908 INFO:tasks.workunit.client.0.smithi064.stdout:7/929: truncate d7/d26/d30/da3/dc3/f10b 419488 0 2023-12-16T03:16:14.912 INFO:tasks.workunit.client.0.smithi064.stdout:4/966: dread d0/d42/d53/f102 [0,4194304] 0 2023-12-16T03:16:14.912 INFO:tasks.workunit.client.0.smithi064.stdout:4/967: chown d0/d42/d66 10696095 1 2023-12-16T03:16:14.926 INFO:tasks.workunit.client.0.smithi064.stdout:2/803: dwrite d1/d15/d23/d2d/fb5 [0,4194304] 0 2023-12-16T03:16:14.928 INFO:tasks.workunit.client.0.smithi064.stdout:0/943: dwrite d2/d7/d10/dc4/dcc/db5/d116/f134 [0,4194304] 0 2023-12-16T03:16:14.929 INFO:tasks.workunit.client.0.smithi064.stdout:9/864: mkdir d2/dc/d24/d39/d77/d7d/d11d 0 2023-12-16T03:16:14.941 INFO:tasks.workunit.client.0.smithi064.stdout:1/989: unlink d3/dd/d11/dbf/d10f/f7a 0 2023-12-16T03:16:14.942 INFO:tasks.workunit.client.0.smithi064.stdout:3/966: symlink db/d4f/d51/db3/l135 0 2023-12-16T03:16:14.948 INFO:tasks.workunit.client.0.smithi064.stdout:5/778: rename d0/d19/f8e to d0/d50/d39/daa/dc5/f111 0 2023-12-16T03:16:14.949 INFO:tasks.workunit.client.0.smithi064.stdout:5/779: chown d0/d7/d34/f56 1 1 2023-12-16T03:16:14.949 INFO:tasks.workunit.client.0.smithi064.stdout:5/780: dread - d0/d14/d20/d37/d70/d71/d5a/f8d zero size 2023-12-16T03:16:14.949 INFO:tasks.workunit.client.0.smithi064.stdout:5/781: write d0/d7/d34/f56 [590891,5207] 0 2023-12-16T03:16:14.952 INFO:tasks.workunit.client.0.smithi064.stdout:4/968: creat d0/d42/d66/d5a/d90/f13f x:0 0 0 2023-12-16T03:16:14.960 INFO:tasks.workunit.client.0.smithi064.stdout:2/804: symlink d1/d15/d1b/d49/da0/l102 0 2023-12-16T03:16:14.965 INFO:tasks.workunit.client.0.smithi064.stdout:7/930: dread d7/d3e/d42/d48/f5b [0,4194304] 0 2023-12-16T03:16:14.966 INFO:tasks.workunit.client.0.smithi064.stdout:0/944: creat d2/d7/d10/d85/d88/d128/f143 x:0 0 0 2023-12-16T03:16:14.966 INFO:tasks.workunit.client.0.smithi064.stdout:0/945: readlink d2/d29/d66/la4 0 2023-12-16T03:16:14.968 INFO:tasks.workunit.client.0.smithi064.stdout:9/865: unlink d2/c4d 0 2023-12-16T03:16:14.971 INFO:tasks.workunit.client.0.smithi064.stdout:2/805: write d1/d15/d1b/d9c/fda [3922702,108932] 0 2023-12-16T03:16:14.973 INFO:tasks.workunit.client.0.smithi064.stdout:1/990: creat d3/dd/d23/dcb/f135 x:0 0 0 2023-12-16T03:16:14.974 INFO:tasks.workunit.client.0.smithi064.stdout:1/991: chown d3/dd/d11/dbf 1900 1 2023-12-16T03:16:14.975 INFO:tasks.workunit.client.0.smithi064.stdout:7/931: link d7/d26/d30/fb5 d7/d26/dc2/f130 0 2023-12-16T03:16:14.976 INFO:tasks.workunit.client.0.smithi064.stdout:0/946: write d2/d29/db1/d12d/f132 [107294,27628] 0 2023-12-16T03:16:14.978 INFO:tasks.workunit.client.0.smithi064.stdout:2/806: creat d1/d15/d1b/d61/d63/f103 x:0 0 0 2023-12-16T03:16:14.980 INFO:tasks.workunit.client.0.smithi064.stdout:1/992: mkdir d3/dd/d23/d4f/daf/dca/d136 0 2023-12-16T03:16:14.980 INFO:tasks.workunit.client.0.smithi064.stdout:1/993: chown d3/dd/d2a 12093449 1 2023-12-16T03:16:14.983 INFO:tasks.workunit.client.0.smithi064.stdout:7/932: getdents d7/d3e/d42/d48/d51/d7c/df5/d82/dfc 0 2023-12-16T03:16:14.986 INFO:tasks.workunit.client.0.smithi064.stdout:2/807: symlink d1/d15/d1b/d9c/d69/l104 0 2023-12-16T03:16:14.988 INFO:tasks.workunit.client.0.smithi064.stdout:3/967: dwrite db/d12/d1a/d2c/d34/f3d [0,4194304] 0 2023-12-16T03:16:14.992 INFO:tasks.workunit.client.0.smithi064.stdout:2/808: creat d1/d15/d1b/d9c/d69/f105 x:0 0 0 2023-12-16T03:16:14.992 INFO:tasks.workunit.client.0.smithi064.stdout:5/782: dwrite d0/d19/d48/d8f/d3e/d35/f8a [0,4194304] 0 2023-12-16T03:16:14.992 INFO:tasks.workunit.client.0.smithi064.stdout:5/783: truncate d0/d14/d20/d37/f51 4593382 0 2023-12-16T03:16:14.993 INFO:tasks.workunit.client.0.smithi064.stdout:1/994: dread d3/dd/d11/f1f [0,4194304] 0 2023-12-16T03:16:14.993 INFO:tasks.workunit.client.0.smithi064.stdout:4/969: dwrite d0/d42/d56/f7c [0,4194304] 0 2023-12-16T03:16:14.993 INFO:tasks.workunit.client.0.smithi064.stdout:4/970: truncate d0/d42/d4c/d70/dbe/fd9 888756 0 2023-12-16T03:16:14.997 INFO:tasks.workunit.client.0.smithi064.stdout:2/809: creat d1/d15/d58/dab/dc2/f106 x:0 0 0 2023-12-16T03:16:14.997 INFO:tasks.workunit.client.0.smithi064.stdout:2/810: stat d1/d15/d7d/dac/fa8 0 2023-12-16T03:16:14.997 INFO:tasks.workunit.client.0.smithi064.stdout:2/811: stat d1/d15/d1b/l25 0 2023-12-16T03:16:14.997 INFO:tasks.workunit.client.0.smithi064.stdout:2/812: stat d1/d15/d7d/fbe 0 2023-12-16T03:16:15.000 INFO:tasks.workunit.client.0.smithi064.stdout:4/971: dread d0/d42/d4c/d70/fbf [0,4194304] 0 2023-12-16T03:16:15.000 INFO:tasks.workunit.client.0.smithi064.stdout:4/972: dread - d0/d42/d4c/f138 zero size 2023-12-16T03:16:15.000 INFO:tasks.workunit.client.0.smithi064.stdout:4/973: truncate d0/feb 747519 0 2023-12-16T03:16:15.000 INFO:tasks.workunit.client.0.smithi064.stdout:9/866: dwrite d2/dc/d24/d39/d77/d7d/fda [0,4194304] 0 2023-12-16T03:16:15.005 INFO:tasks.workunit.client.0.smithi064.stdout:3/968: dread f4 [0,4194304] 0 2023-12-16T03:16:15.006 INFO:tasks.workunit.client.0.smithi064.stdout:0/947: dwrite d2/d7/d10/f129 [0,4194304] 0 2023-12-16T03:16:15.006 INFO:tasks.workunit.client.0.smithi064.stdout:5/784: unlink d0/d50/d39/f63 0 2023-12-16T03:16:15.006 INFO:tasks.workunit.client.0.smithi064.stdout:5/785: dread - d0/d19/d48/d92/fd5 zero size 2023-12-16T03:16:15.007 INFO:tasks.workunit.client.0.smithi064.stdout:7/933: dwrite d7/d3e/d42/d89/d20/d6f/d91/f115 [8388608,4194304] 0 2023-12-16T03:16:15.008 INFO:tasks.workunit.client.0.smithi064.stdout:1/995: mkdir d3/dd/d23/d86/d137 0 2023-12-16T03:16:15.012 INFO:tasks.workunit.client.0.smithi064.stdout:4/974: dread d0/d42/d56/fa5 [0,4194304] 0 2023-12-16T03:16:15.012 INFO:tasks.workunit.client.0.smithi064.stdout:4/975: read - d0/d42/d66/d33/f12a zero size 2023-12-16T03:16:15.012 INFO:tasks.workunit.client.0.smithi064.stdout:4/976: chown d0/d12/d48/d87/f9c 3 1 2023-12-16T03:16:15.013 INFO:tasks.workunit.client.0.smithi064.stdout:2/813: creat d1/d15/d1b/d49/da0/f107 x:0 0 0 2023-12-16T03:16:15.013 INFO:tasks.workunit.client.0.smithi064.stdout:2/814: fdatasync d1/d15/d58/f46 0 2023-12-16T03:16:15.014 INFO:tasks.workunit.client.0.smithi064.stdout:4/977: write d0/d42/d56/fef [319304,100727] 0 2023-12-16T03:16:15.015 INFO:tasks.workunit.client.0.smithi064.stdout:2/815: dread d1/d15/d1b/d9c/d68/f64 [0,4194304] 0 2023-12-16T03:16:15.015 INFO:tasks.workunit.client.0.smithi064.stdout:2/816: read - d1/d15/d1b/d61/d63/da2/fd6 zero size 2023-12-16T03:16:15.015 INFO:tasks.workunit.client.0.smithi064.stdout:2/817: chown d1/d15/d1b/d49/c73 2 1 2023-12-16T03:16:15.016 INFO:tasks.workunit.client.0.smithi064.stdout:2/818: dread d1/d15/d7d/f62 [0,4194304] 0 2023-12-16T03:16:15.019 INFO:tasks.workunit.client.0.smithi064.stdout:9/867: dwrite d2/d2d/d3b/d3c/f20 [4194304,4194304] 0 2023-12-16T03:16:15.020 INFO:tasks.workunit.client.0.smithi064.stdout:3/969: link db/d4f/d51/ff6 db/d12/d1a/d2c/d34/d121/d6a/f136 0 2023-12-16T03:16:15.027 INFO:tasks.workunit.client.0.smithi064.stdout:0/948: rename d2/d8/da/d11/f131 to d2/f144 0 2023-12-16T03:16:15.027 INFO:tasks.workunit.client.0.smithi064.stdout:0/949: chown d2/d7/d10/dc4/dcc/f12e 2 1 2023-12-16T03:16:15.031 INFO:tasks.workunit.client.0.smithi064.stdout:5/786: creat d0/d14/d20/df9/dfc/dfd/f112 x:0 0 0 2023-12-16T03:16:15.031 INFO:tasks.workunit.client.0.smithi064.stdout:5/787: dread - d0/d14/d20/d37/d70/d71/d80/fdc zero size 2023-12-16T03:16:15.032 INFO:tasks.workunit.client.0.smithi064.stdout:4/978: dwrite d0/d42/f52 [0,4194304] 0 2023-12-16T03:16:15.033 INFO:tasks.workunit.client.0.smithi064.stdout:7/934: link d7/d3e/d42/d89/d20/d37/f86 d7/d3e/d42/d89/d20/f131 0 2023-12-16T03:16:15.037 INFO:tasks.workunit.client.0.smithi064.stdout:2/819: symlink d1/d15/d1b/d49/da0/de8/l108 0 2023-12-16T03:16:15.037 INFO:tasks.workunit.client.0.smithi064.stdout:2/820: write d1/d15/d1b/d49/da0/fcd [4403102,32227] 0 2023-12-16T03:16:15.037 INFO:tasks.workunit.client.0.smithi064.stdout:5/788: dread d0/f6c [0,4194304] 0 2023-12-16T03:16:15.038 INFO:tasks.workunit.client.0.smithi064.stdout:5/789: chown d0/d19/d48/d8f/dac/l10 56262503 1 2023-12-16T03:16:15.038 INFO:tasks.workunit.client.0.smithi064.stdout:5/790: dread - d0/d19/d48/d92/fc4 zero size 2023-12-16T03:16:15.042 INFO:tasks.workunit.client.0.smithi064.stdout:9/868: creat d2/d2d/d6c/d83/dec/f11e x:0 0 0 2023-12-16T03:16:15.043 INFO:tasks.workunit.client.0.smithi064.stdout:3/970: mkdir db/d137 0 2023-12-16T03:16:15.048 INFO:tasks.workunit.client.0.smithi064.stdout:1/996: rename d3/d36/d44/d4d/dad/fb5 to d3/dd/d23/d86/f138 0 2023-12-16T03:16:15.049 INFO:tasks.workunit.client.0.smithi064.stdout:1/997: read - d3/dd/d11/dbf/d10f/f101 zero size 2023-12-16T03:16:15.049 INFO:tasks.workunit.client.0.smithi064.stdout:0/950: dwrite d2/f3e [0,4194304] 0 2023-12-16T03:16:15.055 INFO:tasks.workunit.client.0.smithi064.stdout:4/979: creat d0/d42/d66/f140 x:0 0 0 2023-12-16T03:16:15.055 INFO:tasks.workunit.client.0.smithi064.stdout:4/980: fdatasync d0/d12/d48/fcb 0 2023-12-16T03:16:15.055 INFO:tasks.workunit.client.0.smithi064.stdout:4/981: fdatasync d0/d42/d4c/d70/d8c/da9/f116 0 2023-12-16T03:16:15.055 INFO:tasks.workunit.client.0.smithi064.stdout:4/982: chown d0/d42/d53/de8/d13d 4 1 2023-12-16T03:16:15.058 INFO:tasks.workunit.client.0.smithi064.stdout:7/935: mkdir d7/d26/d30/da3/dc3/d132 0 2023-12-16T03:16:15.060 INFO:tasks.workunit.client.0.smithi064.stdout:5/791: link d0/d50/d39/la9 d0/d50/d39/daa/dc5/l113 0 2023-12-16T03:16:15.060 INFO:tasks.workunit.client.0.smithi064.stdout:5/792: truncate d0/d50/d39/fd1 696652 0 2023-12-16T03:16:15.060 INFO:tasks.workunit.client.0.smithi064.stdout:5/793: fsync d0/d19/fee 0 2023-12-16T03:16:15.061 INFO:tasks.workunit.client.0.smithi064.stdout:2/821: dwrite d1/db3/fd4 [0,4194304] 0 2023-12-16T03:16:15.061 INFO:tasks.workunit.client.0.smithi064.stdout:2/822: chown d1/d15/d1b/d9c/d68/c2c 1709 1 2023-12-16T03:16:15.061 INFO:tasks.workunit.client.0.smithi064.stdout:1/998: dread d3/dd/d23/d4f/f54 [0,4194304] 0 2023-12-16T03:16:15.062 INFO:tasks.workunit.client.0.smithi064.stdout:9/869: mkdir d2/dc/d24/da9/d11f 0 2023-12-16T03:16:15.063 INFO:tasks.workunit.client.0.smithi064.stdout:9/870: read - d2/d2d/d6c/ffc zero size 2023-12-16T03:16:15.067 INFO:tasks.workunit.client.0.smithi064.stdout:7/936: dread d7/d3e/d42/d89/d20/d37/f86 [0,4194304] 0 2023-12-16T03:16:15.067 INFO:tasks.workunit.client.0.smithi064.stdout:7/937: chown d7/d3e/d42/faa 28 1 2023-12-16T03:16:15.070 INFO:tasks.workunit.client.0.smithi064.stdout:0/951: truncate d2/d29/d66/de5/f102 664288 0 2023-12-16T03:16:15.070 INFO:tasks.workunit.client.0.smithi064.stdout:0/952: dread - d2/d8/da/dbc/fd6 zero size 2023-12-16T03:16:15.075 INFO:tasks.workunit.client.0.smithi064.stdout:5/794: unlink d0/d50/d99/la6 0 2023-12-16T03:16:15.076 INFO:tasks.workunit.client.0.smithi064.stdout:7/938: dread d7/d3e/d42/d43/f104 [0,4194304] 0 2023-12-16T03:16:15.081 INFO:tasks.workunit.client.0.smithi064.stdout:2/823: rmdir d1/d15/d1b/dc3 39 2023-12-16T03:16:15.083 INFO:tasks.workunit.client.0.smithi064.stdout:3/971: dwrite db/d12/d1a/d2c/d34/d121/d6a/da7/d39/ff5 [0,4194304] 0 2023-12-16T03:16:15.084 INFO:tasks.workunit.client.0.smithi064.stdout:1/999: rename d3/dd/d23/d60/c81 to d3/dd/d23/d86/c139 0 2023-12-16T03:16:15.084 INFO:tasks.workunit.client.0.smithi064.stdout:4/983: dwrite d0/d42/ff8 [0,4194304] 0 2023-12-16T03:16:15.084 INFO:tasks.workunit.client.0.smithi064.stdout:4/984: write d0/d12/d48/d87/d10c/f123 [526053,111931] 0 2023-12-16T03:16:15.085 INFO:tasks.workunit.client.0.smithi064.stdout:9/871: dwrite d2/dc/d24/db2/dc3/fdf [0,4194304] 0 2023-12-16T03:16:15.085 INFO:tasks.workunit.client.0.smithi064.stdout:5/795: creat d0/d50/df5/df7/f114 x:0 0 0 2023-12-16T03:16:15.086 INFO:tasks.workunit.client.0.smithi064.stdout:7/939: unlink d7/d3e/d42/d89/c36 0 2023-12-16T03:16:15.088 INFO:tasks.workunit.client.0.smithi064.stdout:2/824: creat d1/d15/d23/d2d/da6/f109 x:0 0 0 2023-12-16T03:16:15.089 INFO:tasks.workunit.client.0.smithi064.stdout:3/972: write db/d12/d4e/fea [1743555,26403] 0 2023-12-16T03:16:15.094 INFO:tasks.workunit.client.0.smithi064.stdout:9/872: dread d2/d2d/d3b/d3c/f1c [0,4194304] 0 2023-12-16T03:16:15.098 INFO:tasks.workunit.client.0.smithi064.stdout:4/985: mknod d0/d42/d4c/d70/dfc/d120/c141 0 2023-12-16T03:16:15.110 INFO:tasks.workunit.client.0.smithi064.stdout:5/796: mknod d0/d19/d48/d8f/dac/d23/c115 0 2023-12-16T03:16:15.111 INFO:tasks.workunit.client.0.smithi064.stdout:9/873: dwrite d2/dc/d24/d39/d42/f48 [0,4194304] 0 2023-12-16T03:16:15.111 INFO:tasks.workunit.client.0.smithi064.stdout:9/874: chown d2/dc/d24/d39/d77/d7d/d11d 865366 1 2023-12-16T03:16:15.112 INFO:tasks.workunit.client.0.smithi064.stdout:9/875: write d2/d2d/d6c/d83/faa [1704758,118007] 0 2023-12-16T03:16:15.123 INFO:tasks.workunit.client.0.smithi064.stdout:2/825: creat d1/d15/d1b/d61/d63/f10a x:0 0 0 2023-12-16T03:16:15.125 INFO:tasks.workunit.client.0.smithi064.stdout:2/826: write d1/d15/d23/d2d/fc4 [608577,130713] 0 2023-12-16T03:16:15.126 INFO:tasks.workunit.client.0.smithi064.stdout:3/973: link db/d12/d1a/d2c/c45 db/d4f/da9/c138 0 2023-12-16T03:16:15.126 INFO:tasks.workunit.client.0.smithi064.stdout:3/974: write db/d12/d1a/d2c/d34/d121/d6a/fc7 [1364404,3292] 0 2023-12-16T03:16:15.128 INFO:tasks.workunit.client.0.smithi064.stdout:4/986: unlink d0/d1e/d36/db7/fdf 0 2023-12-16T03:16:15.134 INFO:tasks.workunit.client.0.smithi064.stdout:5/797: mkdir d0/d14/d20/d116 0 2023-12-16T03:16:15.134 INFO:tasks.workunit.client.0.smithi064.stdout:5/798: chown d0/d50/d39/f7c 107 1 2023-12-16T03:16:15.135 INFO:tasks.workunit.client.0.smithi064.stdout:2/827: dread d1/d15/d1b/d49/f8b [0,4194304] 0 2023-12-16T03:16:15.135 INFO:tasks.workunit.client.0.smithi064.stdout:2/828: dread - d1/d15/d1b/d61/d63/f103 zero size 2023-12-16T03:16:15.140 INFO:tasks.workunit.client.0.smithi064.stdout:7/940: dread d7/d3e/d42/faa [0,4194304] 0 2023-12-16T03:16:15.219 INFO:tasks.workunit.client.0.smithi064.stdout:9/876: getdents d2/dc/d24/d39/d42/d9a/d8b 0 2023-12-16T03:16:15.224 INFO:tasks.workunit.client.0.smithi064.stdout:7/941: dwrite d7/d3e/d42/d48/d51/d7c/d52/f99 [0,4194304] 0 2023-12-16T03:16:15.226 INFO:tasks.workunit.client.0.smithi064.stdout:7/942: read d7/d26/dc2/f130 [2088782,108024] 0 2023-12-16T03:16:15.226 INFO:tasks.workunit.client.0.smithi064.stdout:7/943: fsync d7/d3e/d42/d48/d51/d7c/d52/fbd 0 2023-12-16T03:16:15.226 INFO:tasks.workunit.client.0.smithi064.stdout:3/975: rmdir db/d4f/d51 39 2023-12-16T03:16:15.227 INFO:tasks.workunit.client.0.smithi064.stdout:9/877: dread d2/dc/d24/d39/d42/d57/f46 [0,4194304] 0 2023-12-16T03:16:15.231 INFO:tasks.workunit.client.0.smithi064.stdout:4/987: unlink d0/d12/l15 0 2023-12-16T03:16:15.231 INFO:tasks.workunit.client.0.smithi064.stdout:4/988: truncate d0/d1e/d36/fdc 900314 0 2023-12-16T03:16:15.231 INFO:tasks.workunit.client.0.smithi064.stdout:4/989: fdatasync d0/da/f6d 0 2023-12-16T03:16:15.231 INFO:tasks.workunit.client.0.smithi064.stdout:4/990: chown d0/d42/d53/de6/f108 346 1 2023-12-16T03:16:15.234 INFO:tasks.workunit.client.0.smithi064.stdout:5/799: link d0/f7d d0/d19/d48/d8f/d3e/d35/f117 0 2023-12-16T03:16:15.235 INFO:tasks.workunit.client.0.smithi064.stdout:5/800: chown d0/d14/d20/d37/l7e 4702 1 2023-12-16T03:16:15.246 INFO:tasks.workunit.client.0.smithi064.stdout:2/829: creat d1/d15/d1b/d9c/d69/dcf/f10b x:0 0 0 2023-12-16T03:16:15.250 INFO:tasks.workunit.client.0.smithi064.stdout:7/944: mknod d7/d3e/d42/d89/d20/d37/db1/db6/c133 0 2023-12-16T03:16:15.252 INFO:tasks.workunit.client.0.smithi064.stdout:3/976: creat db/d12/d1a/d2c/d34/de7/f139 x:0 0 0 2023-12-16T03:16:15.253 INFO:tasks.workunit.client.0.smithi064.stdout:9/878: creat d2/dc/d24/db2/dc3/f120 x:0 0 0 2023-12-16T03:16:15.254 INFO:tasks.workunit.client.0.smithi064.stdout:4/991: creat d0/d42/d4c/d70/dbe/f142 x:0 0 0 2023-12-16T03:16:15.256 INFO:tasks.workunit.client.0.smithi064.stdout:2/830: creat d1/d15/d1b/d61/d63/da2/f10c x:0 0 0 2023-12-16T03:16:15.256 INFO:tasks.workunit.client.0.smithi064.stdout:2/831: chown d1/d15/d23/d2d 2 1 2023-12-16T03:16:15.256 INFO:tasks.workunit.client.0.smithi064.stdout:2/832: write d1/d15/d1b/d9c/d69/f105 [114558,2769] 0 2023-12-16T03:16:15.256 INFO:tasks.workunit.client.0.smithi064.stdout:5/801: dwrite d0/d19/d48/d8f/dac/d23/f89 [0,4194304] 0 2023-12-16T03:16:15.256 INFO:tasks.workunit.client.0.smithi064.stdout:7/945: creat d7/f134 x:0 0 0 2023-12-16T03:16:15.261 INFO:tasks.workunit.client.0.smithi064.stdout:6/759: sync 2023-12-16T03:16:15.261 INFO:tasks.workunit.client.0.smithi064.stdout:8/931: sync 2023-12-16T03:16:15.261 INFO:tasks.workunit.client.0.smithi064.stdout:6/760: write d3/fc7 [716093,36629] 0 2023-12-16T03:16:15.266 INFO:tasks.workunit.client.0.smithi064.stdout:9/879: creat d2/dc/d24/d39/d42/d9a/d8b/da8/d103/f121 x:0 0 0 2023-12-16T03:16:15.266 INFO:tasks.workunit.client.0.smithi064.stdout:4/992: mkdir d0/d42/d53/de6/d134/d143 0 2023-12-16T03:16:15.269 INFO:tasks.workunit.client.0.smithi064.stdout:5/802: symlink d0/d14/d20/df9/dfc/dfd/df0/l118 0 2023-12-16T03:16:15.271 INFO:tasks.workunit.client.0.smithi064.stdout:7/946: creat d7/d3e/d42/d89/d20/d37/db1/db6/f135 x:0 0 0 2023-12-16T03:16:15.277 INFO:tasks.workunit.client.0.smithi064.stdout:3/977: truncate db/d4f/d51/dd2/fe0 608409 0 2023-12-16T03:16:15.277 INFO:tasks.workunit.client.0.smithi064.stdout:3/978: write db/d12/ff9 [1814802,80639] 0 2023-12-16T03:16:15.277 INFO:tasks.workunit.client.0.smithi064.stdout:3/979: write db/d12/d1a/d2c/d34/d121/d6a/da7/f7f [605577,58257] 0 2023-12-16T03:16:15.278 INFO:tasks.workunit.client.0.smithi064.stdout:6/761: dwrite d3/d9/dc0/fc6 [0,4194304] 0 2023-12-16T03:16:15.281 INFO:tasks.workunit.client.0.smithi064.stdout:8/932: creat d0/f143 x:0 0 0 2023-12-16T03:16:15.281 INFO:tasks.workunit.client.0.smithi064.stdout:8/933: readlink d0/d1d/d73/dd9/d109/l10f 0 2023-12-16T03:16:15.281 INFO:tasks.workunit.client.0.smithi064.stdout:8/934: write d0/da/de9/d12/d44/d68/d6d/f101 [4185272,13358] 0 2023-12-16T03:16:15.292 INFO:tasks.workunit.client.0.smithi064.stdout:4/993: rmdir d0 39 2023-12-16T03:16:15.293 INFO:tasks.workunit.client.0.smithi064.stdout:7/947: dwrite d7/d3e/d42/d89/d20/d6f/d91/fba [0,4194304] 0 2023-12-16T03:16:15.293 INFO:tasks.workunit.client.0.smithi064.stdout:7/948: truncate d7/d3e/d42/d43/dc8/fe0 483650 0 2023-12-16T03:16:15.293 INFO:tasks.workunit.client.0.smithi064.stdout:7/949: write d7/f134 [312251,52296] 0 2023-12-16T03:16:15.293 INFO:tasks.workunit.client.0.smithi064.stdout:7/950: chown d7/d3e/d42/d89/d20 0 1 2023-12-16T03:16:15.293 INFO:tasks.workunit.client.0.smithi064.stdout:7/951: chown d7/d3e/d42/d89/de2 197756248 1 2023-12-16T03:16:15.294 INFO:tasks.workunit.client.0.smithi064.stdout:7/952: chown d7/d3e/d42/d43/f104 64063239 1 2023-12-16T03:16:15.297 INFO:tasks.workunit.client.0.smithi064.stdout:3/980: symlink db/d4f/d51/l13a 0 2023-12-16T03:16:15.297 INFO:tasks.workunit.client.0.smithi064.stdout:3/981: fdatasync db/d4f/d51/dd1/dd3/f105 0 2023-12-16T03:16:15.302 INFO:tasks.workunit.client.0.smithi064.stdout:6/762: mkdir d3/d8/d13/d58/db6/de6 0 2023-12-16T03:16:15.302 INFO:tasks.workunit.client.0.smithi064.stdout:6/763: stat d3/f7d 0 2023-12-16T03:16:15.308 INFO:tasks.workunit.client.0.smithi064.stdout:5/803: write d0/d14/d20/df9/dfc/dfd/df0/dc0/fed [844959,56578] 0 2023-12-16T03:16:15.308 INFO:tasks.workunit.client.0.smithi064.stdout:5/804: fsync d0/d14/d4e/fc6 0 2023-12-16T03:16:15.308 INFO:tasks.workunit.client.0.smithi064.stdout:5/805: fdatasync d0/d19/d48/d8f/d5e/fe6 0 2023-12-16T03:16:15.310 INFO:tasks.workunit.client.0.smithi064.stdout:8/935: truncate d0/da/de9/d37/d3a/dab/dfa/d46/f7b 4138156 0 2023-12-16T03:16:15.312 INFO:tasks.workunit.client.0.smithi064.stdout:4/994: getdents d0/d42/d56 0 2023-12-16T03:16:15.318 INFO:tasks.workunit.client.0.smithi064.stdout:8/936: dread d0/da/de9/f66 [0,4194304] 0 2023-12-16T03:16:15.324 INFO:tasks.workunit.client.0.smithi064.stdout:7/953: mknod d7/d3e/d42/d48/d51/c136 0 2023-12-16T03:16:15.325 INFO:tasks.workunit.client.0.smithi064.stdout:7/954: read d7/d3e/d42/f72 [762818,83522] 0 2023-12-16T03:16:15.326 INFO:tasks.workunit.client.0.smithi064.stdout:3/982: rmdir db/d12/d1a/d2c/d34/d121/d6a/d93 39 2023-12-16T03:16:15.326 INFO:tasks.workunit.client.0.smithi064.stdout:3/983: chown db/d12/d4e/l35 0 1 2023-12-16T03:16:15.329 INFO:tasks.workunit.client.0.smithi064.stdout:6/764: link d3/f5 d3/d8/da/dd2/fe7 0 2023-12-16T03:16:15.329 INFO:tasks.workunit.client.0.smithi064.stdout:6/765: fsync d3/d8/d13/d46/d5e/da8/fe4 0 2023-12-16T03:16:15.332 INFO:tasks.workunit.client.0.smithi064.stdout:5/806: getdents d0/d7/d34 0 2023-12-16T03:16:15.336 INFO:tasks.workunit.client.0.smithi064.stdout:4/995: unlink d0/d42/d4c/d70/dbe/fd9 0 2023-12-16T03:16:15.336 INFO:tasks.workunit.client.0.smithi064.stdout:4/996: chown d0/d42/d4c/f138 97 1 2023-12-16T03:16:15.338 INFO:tasks.workunit.client.0.smithi064.stdout:8/937: creat d0/d1d/d24/d2f/d50/d70/da4/f144 x:0 0 0 2023-12-16T03:16:15.345 INFO:tasks.workunit.client.0.smithi064.stdout:7/955: creat d7/d3e/d42/d89/de2/f137 x:0 0 0 2023-12-16T03:16:15.346 INFO:tasks.workunit.client.0.smithi064.stdout:3/984: rename db/d12/d1a/d2c/d34/d121/d6a/fc7 to db/d12/d1a/d2c/d34/dcd/f13b 0 2023-12-16T03:16:15.347 INFO:tasks.workunit.client.0.smithi064.stdout:6/766: rmdir d3/d80/dcf/d47 39 2023-12-16T03:16:15.351 INFO:tasks.workunit.client.0.smithi064.stdout:7/956: write d7/d3e/d42/f44 [1263415,121704] 0 2023-12-16T03:16:15.351 INFO:tasks.workunit.client.0.smithi064.stdout:7/957: write d7/d26/dc2/fd1 [749254,109934] 0 2023-12-16T03:16:15.351 INFO:tasks.workunit.client.0.smithi064.stdout:7/958: readlink d7/df7/l119 0 2023-12-16T03:16:15.355 INFO:tasks.workunit.client.0.smithi064.stdout:5/807: dwrite d0/d19/d48/d8f/d5e/fe6 [0,4194304] 0 2023-12-16T03:16:15.356 INFO:tasks.workunit.client.0.smithi064.stdout:4/997: dwrite d0/d1e/d36/f7e [0,4194304] 0 2023-12-16T03:16:15.362 INFO:tasks.workunit.client.0.smithi064.stdout:5/808: unlink d0/d50/d99/c10d 0 2023-12-16T03:16:15.362 INFO:tasks.workunit.client.0.smithi064.stdout:5/809: fsync d0/d50/f30 0 2023-12-16T03:16:15.362 INFO:tasks.workunit.client.0.smithi064.stdout:5/810: fdatasync d0/d19/d48/d8f/dac/d23/d91/f100 0 2023-12-16T03:16:15.362 INFO:tasks.workunit.client.0.smithi064.stdout:5/811: fsync d0/d19/d48/d8f/d3e/d35/f117 0 2023-12-16T03:16:15.364 INFO:tasks.workunit.client.0.smithi064.stdout:3/985: rmdir db/d12/d1a/d2c/d34/dcd 39 2023-12-16T03:16:15.365 INFO:tasks.workunit.client.0.smithi064.stdout:6/767: dread d3/d8/d13/f7b [0,4194304] 0 2023-12-16T03:16:15.365 INFO:tasks.workunit.client.0.smithi064.stdout:6/768: chown d3/d8/f5f 0 1 2023-12-16T03:16:15.365 INFO:tasks.workunit.client.0.smithi064.stdout:6/769: chown d3/d80/dcf/d47/d4a/d67 33466084 1 2023-12-16T03:16:15.367 INFO:tasks.workunit.client.0.smithi064.stdout:6/770: read d3/d8/da/f37 [252955,18317] 0 2023-12-16T03:16:15.369 INFO:tasks.workunit.client.0.smithi064.stdout:8/938: rename d0/d1d/d73/dd9 to d0/d1d/d3c/d42/d145 0 2023-12-16T03:16:15.375 INFO:tasks.workunit.client.0.smithi064.stdout:5/812: dread d0/d19/d48/d92/f9e [0,4194304] 0 2023-12-16T03:16:15.375 INFO:tasks.workunit.client.0.smithi064.stdout:5/813: chown d0/d19/d48/d8f/dac/d23/fec 8893511 1 2023-12-16T03:16:15.378 INFO:tasks.workunit.client.0.smithi064.stdout:7/959: dwrite d7/d3e/d42/d89/d20/d6f/d93/fe8 [0,4194304] 0 2023-12-16T03:16:15.379 INFO:tasks.workunit.client.0.smithi064.stdout:4/998: symlink d0/da/da6/de4/l144 0 2023-12-16T03:16:15.380 INFO:tasks.workunit.client.0.smithi064.stdout:6/771: write d3/d80/dcf/d47/d4a/d67/d73/fad [3719324,71335] 0 2023-12-16T03:16:15.381 INFO:tasks.workunit.client.0.smithi064.stdout:6/772: fsync d3/d8/d13/d46/d5e/f82 0 2023-12-16T03:16:15.381 INFO:tasks.workunit.client.0.smithi064.stdout:3/986: creat db/d4f/da9/f13c x:0 0 0 2023-12-16T03:16:15.381 INFO:tasks.workunit.client.0.smithi064.stdout:3/987: write db/d12/d1a/f54 [3741333,29500] 0 2023-12-16T03:16:15.385 INFO:tasks.workunit.client.0.smithi064.stdout:5/814: mkdir d0/d7/d97/dc1/d119 0 2023-12-16T03:16:15.388 INFO:tasks.workunit.client.0.smithi064.stdout:8/939: dwrite d0/d1d/d24/d2f/d50/d70/da4/f144 [0,4194304] 0 2023-12-16T03:16:15.393 INFO:tasks.workunit.client.0.smithi064.stdout:7/960: mknod d7/d26/c138 0 2023-12-16T03:16:15.393 INFO:tasks.workunit.client.0.smithi064.stdout:7/961: readlink d7/d3e/d42/d89/d20/d37/l70 0 2023-12-16T03:16:15.394 INFO:tasks.workunit.client.0.smithi064.stdout:4/999: dwrite d0/d12/d48/d87/fd6 [0,4194304] 0 2023-12-16T03:16:15.396 INFO:tasks.workunit.client.0.smithi064.stdout:3/988: dread db/d12/d1a/d2c/d34/d121/d6a/da7/fda [4194304,4194304] 0 2023-12-16T03:16:15.396 INFO:tasks.workunit.client.0.smithi064.stdout:6/773: creat d3/d80/fe8 x:0 0 0 2023-12-16T03:16:15.402 INFO:tasks.workunit.client.0.smithi064.stdout:8/940: unlink d0/da/de9/c56 0 2023-12-16T03:16:15.402 INFO:tasks.workunit.client.0.smithi064.stdout:8/941: fsync d0/da/de9/d37/d3a/dab/dfa/dc0/d119/f128 0 2023-12-16T03:16:15.402 INFO:tasks.workunit.client.0.smithi064.stdout:8/942: chown d0/da/de9/d12/d1c/d59/d77/la0 237 1 2023-12-16T03:16:15.404 INFO:tasks.workunit.client.0.smithi064.stdout:5/815: dread d0/d14/d4e/f53 [0,4194304] 0 2023-12-16T03:16:15.404 INFO:tasks.workunit.client.0.smithi064.stdout:7/962: creat d7/d3e/d42/d89/d20/d6f/d91/deb/f139 x:0 0 0 2023-12-16T03:16:15.405 INFO:tasks.workunit.client.0.smithi064.stdout:0/953: sync 2023-12-16T03:16:15.405 INFO:tasks.workunit.client.0.smithi064.stdout:0/954: chown d2/d8/da/d11 64099231 1 2023-12-16T03:16:15.410 INFO:tasks.workunit.client.0.smithi064.stdout:3/989: creat db/d12/d1a/d2c/d34/d121/f13d x:0 0 0 2023-12-16T03:16:15.411 INFO:tasks.workunit.client.0.smithi064.stdout:6/774: truncate d3/f7d 6188834 0 2023-12-16T03:16:15.412 INFO:tasks.workunit.client.0.smithi064.stdout:8/943: mknod d0/da/de9/d111/c146 0 2023-12-16T03:16:15.412 INFO:tasks.workunit.client.0.smithi064.stdout:6/775: dread d3/d8/da/dd2/fe7 [0,4194304] 0 2023-12-16T03:16:15.413 INFO:tasks.workunit.client.0.smithi064.stdout:6/776: write d3/d8/d1f/f5a [498857,130391] 0 2023-12-16T03:16:15.414 INFO:tasks.workunit.client.0.smithi064.stdout:5/816: mknod d0/d19/d48/d8f/d5e/c11a 0 2023-12-16T03:16:15.414 INFO:tasks.workunit.client.0.smithi064.stdout:6/777: write d3/d8/d1f/f22 [3651173,96647] 0 2023-12-16T03:16:15.414 INFO:tasks.workunit.client.0.smithi064.stdout:6/778: stat d3/d8/d13/d58/d65/fde 0 2023-12-16T03:16:15.417 INFO:tasks.workunit.client.0.smithi064.stdout:7/963: rename d7/d3e/d42/d89/d20/d37/db1/dbf/cfb to d7/d3e/d42/d89/d20/d37/db1/db6/dd6/c13a 0 2023-12-16T03:16:15.417 INFO:tasks.workunit.client.0.smithi064.stdout:7/964: fdatasync d7/d26/d95/ff1 0 2023-12-16T03:16:15.417 INFO:tasks.workunit.client.0.smithi064.stdout:7/965: chown d7/d3e/ca5 1239353994 1 2023-12-16T03:16:15.419 INFO:tasks.workunit.client.0.smithi064.stdout:3/990: getdents db/d12/d1a/d123 0 2023-12-16T03:16:15.420 INFO:tasks.workunit.client.0.smithi064.stdout:3/991: dread db/d12/d1a/d2c/d34/d121/f63 [0,4194304] 0 2023-12-16T03:16:15.421 INFO:tasks.workunit.client.0.smithi064.stdout:5/817: readlink d0/d19/d48/d8f/d3e/d35/d5d/d9a/lbb 0 2023-12-16T03:16:15.423 INFO:tasks.workunit.client.0.smithi064.stdout:5/818: write d0/f7d [78781,20215] 0 2023-12-16T03:16:15.550 INFO:tasks.workunit.client.0.smithi064.stdout:6/779: creat d3/d80/dcf/fe9 x:0 0 0 2023-12-16T03:16:15.550 INFO:tasks.workunit.client.0.smithi064.stdout:6/780: read d3/d8/da/dd2/fe7 [482243,96746] 0 2023-12-16T03:16:15.550 INFO:tasks.workunit.client.0.smithi064.stdout:6/781: chown d3/d80/dcf/d47/d4a/d67/fe2 634781 1 2023-12-16T03:16:15.552 INFO:tasks.workunit.client.0.smithi064.stdout:7/966: creat d7/d3e/d42/f13b x:0 0 0 2023-12-16T03:16:15.553 INFO:tasks.workunit.client.0.smithi064.stdout:3/992: symlink db/d12/l13e 0 2023-12-16T03:16:15.553 INFO:tasks.workunit.client.0.smithi064.stdout:3/993: fdatasync db/d12/d1a/d2c/d34/dcd/f13b 0 2023-12-16T03:16:15.556 INFO:tasks.workunit.client.0.smithi064.stdout:5/819: chown d0/d19/d48/d8f/d3e/d35/d5d/c10b 2030861 1 2023-12-16T03:16:15.556 INFO:tasks.workunit.client.0.smithi064.stdout:5/820: truncate d0/d50/d39/daa/dc5/fd4 462149 0 2023-12-16T03:16:15.568 INFO:tasks.workunit.client.0.smithi064.stdout:6/782: symlink d3/d80/dcf/d47/d7c/lea 0 2023-12-16T03:16:15.568 INFO:tasks.workunit.client.0.smithi064.stdout:6/783: write d3/d80/dcf/f83 [270407,84928] 0 2023-12-16T03:16:15.571 INFO:tasks.workunit.client.0.smithi064.stdout:3/994: creat db/d137/f13f x:0 0 0 2023-12-16T03:16:15.573 INFO:tasks.workunit.client.0.smithi064.stdout:5/821: rmdir d0/d14/d4e/d10e 0 2023-12-16T03:16:15.581 INFO:tasks.workunit.client.0.smithi064.stdout:3/995: mkdir db/d4f/daa/d140 0 2023-12-16T03:16:15.581 INFO:tasks.workunit.client.0.smithi064.stdout:3/996: fsync f4 0 2023-12-16T03:16:15.581 INFO:tasks.workunit.client.0.smithi064.stdout:3/997: truncate db/d12/d1a/d2c/d34/d121/d6a/da7/f7f 1135148 0 2023-12-16T03:16:15.581 INFO:tasks.workunit.client.0.smithi064.stdout:3/998: dread - db/d4f/d51/dd1/dde/ff0 zero size 2023-12-16T03:16:15.581 INFO:tasks.workunit.client.0.smithi064.stdout:3/999: chown db/d4f/da9/dbf/d75/d92/c9c 536285 1 2023-12-16T03:16:15.587 INFO:tasks.workunit.client.0.smithi064.stdout:6/784: dwrite d3/fd [0,4194304] 0 2023-12-16T03:16:15.587 INFO:tasks.workunit.client.0.smithi064.stdout:6/785: chown d3/d9e/dbd/dcb 3294206 1 2023-12-16T03:16:15.587 INFO:tasks.workunit.client.0.smithi064.stdout:6/786: write d3/d9e/fba [1210385,64675] 0 2023-12-16T03:16:15.588 INFO:tasks.workunit.client.0.smithi064.stdout:5/822: symlink d0/d7/l11b 0 2023-12-16T03:16:15.599 INFO:tasks.workunit.client.0.smithi064.stdout:5/823: dread d0/d19/d48/d8f/d5e/fe6 [0,4194304] 0 2023-12-16T03:16:15.600 INFO:tasks.workunit.client.0.smithi064.stdout:5/824: readlink d0/d19/d48/d8f/dac/d23/lc7 0 2023-12-16T03:16:15.605 INFO:tasks.workunit.client.0.smithi064.stdout:5/825: rename d0/d7/l11b to d0/d14/d20/d37/d70/l11c 0 2023-12-16T03:16:15.608 INFO:tasks.workunit.client.0.smithi064.stdout:6/787: rename d3/d8 to d3/deb 0 2023-12-16T03:16:15.615 INFO:tasks.workunit.client.0.smithi064.stdout:5/826: write d0/d14/d20/d37/f51 [4522666,38496] 0 2023-12-16T03:16:15.615 INFO:tasks.workunit.client.0.smithi064.stdout:5/827: truncate d0/d14/d20/d37/d70/d71/d5a/f8d 870433 0 2023-12-16T03:16:15.615 INFO:tasks.workunit.client.0.smithi064.stdout:5/828: dread - d0/d14/f101 zero size 2023-12-16T03:16:15.615 INFO:tasks.workunit.client.0.smithi064.stdout:6/788: dread d3/deb/d13/d46/d5e/f82 [0,4194304] 0 2023-12-16T03:16:15.616 INFO:tasks.workunit.client.0.smithi064.stdout:6/789: write d3/deb/d13/d46/fdb [178887,34102] 0 2023-12-16T03:16:15.616 INFO:tasks.workunit.client.0.smithi064.stdout:6/790: chown d3/deb/d1f/f56 124 1 2023-12-16T03:16:15.617 INFO:tasks.workunit.client.0.smithi064.stdout:5/829: mknod d0/d14/d20/d37/d70/d71/d5a/c11d 0 2023-12-16T03:16:15.618 INFO:tasks.workunit.client.0.smithi064.stdout:5/830: getdents d0/d14/d20/d37/d3c 0 2023-12-16T03:16:15.618 INFO:tasks.workunit.client.0.smithi064.stdout:5/831: stat d0/d19/d48/d8f/d3e/d35/d5d/d9a/fef 0 2023-12-16T03:16:15.618 INFO:tasks.workunit.client.0.smithi064.stdout:5/832: fsync d0/d19/d48/d8f/d3e/d35/f8a 0 2023-12-16T03:16:15.620 INFO:tasks.workunit.client.0.smithi064.stdout:5/833: mknod d0/d7/d34/c11e 0 2023-12-16T03:16:15.620 INFO:tasks.workunit.client.0.smithi064.stdout:5/834: fdatasync d0/d19/d48/d8f/d3e/d35/d5d/d9a/fcd 0 2023-12-16T03:16:15.621 INFO:tasks.workunit.client.0.smithi064.stdout:5/835: write d0/d7/d97/f9b [753800,33524] 0 2023-12-16T03:16:15.621 INFO:tasks.workunit.client.0.smithi064.stdout:5/836: chown d0/d19/d48/d8f/c6f 145 1 2023-12-16T03:16:15.624 INFO:tasks.workunit.client.0.smithi064.stdout:5/837: rename d0/d19/d48/d92/fc4 to d0/d14/d20/d37/d3c/f11f 0 2023-12-16T03:16:15.632 INFO:tasks.workunit.client.0.smithi064.stdout:5/838: dread d0/d14/d20/df9/dfc/dfd/df0/fbe [0,4194304] 0 2023-12-16T03:16:15.632 INFO:tasks.workunit.client.0.smithi064.stdout:6/791: dwrite d3/deb/d1f/f5a [4194304,4194304] 0 2023-12-16T03:16:15.632 INFO:tasks.workunit.client.0.smithi064.stdout:6/792: truncate d3/d44/fda 717526 0 2023-12-16T03:16:15.644 INFO:tasks.workunit.client.0.smithi064.stdout:6/793: rename d3/deb/d13/f24 to d3/deb/d13/d58/d65/fec 0 2023-12-16T03:16:15.647 INFO:tasks.workunit.client.0.smithi064.stdout:6/794: creat d3/d9/fed x:0 0 0 2023-12-16T03:16:15.651 INFO:tasks.workunit.client.0.smithi064.stdout:5/839: dwrite d0/d50/d39/daa/fe9 [0,4194304] 0 2023-12-16T03:16:15.671 INFO:tasks.workunit.client.0.smithi064.stdout:5/840: dwrite d0/d19/d48/d8f/dac/f10a [0,4194304] 0 2023-12-16T03:16:15.685 INFO:tasks.workunit.client.0.smithi064.stdout:5/841: dwrite d0/d50/d39/daa/dc5/ffa [0,4194304] 0 2023-12-16T03:16:15.690 INFO:tasks.workunit.client.0.smithi064.stdout:5/842: mknod d0/d7/d97/dc1/d119/c120 0 2023-12-16T03:16:15.708 INFO:tasks.workunit.client.0.smithi064.stdout:5/843: dwrite d0/d7/d34/fc8 [0,4194304] 0 2023-12-16T03:16:15.708 INFO:tasks.workunit.client.0.smithi064.stdout:5/844: write d0/d14/d20/d37/d70/f81 [2912079,125440] 0 2023-12-16T03:16:15.710 INFO:tasks.workunit.client.0.smithi064.stdout:5/845: creat d0/d19/d48/d8f/d5e/d84/f121 x:0 0 0 2023-12-16T03:16:15.711 INFO:tasks.workunit.client.0.smithi064.stdout:5/846: creat d0/d19/d48/d8f/d5e/d84/f122 x:0 0 0 2023-12-16T03:16:15.711 INFO:tasks.workunit.client.0.smithi064.stdout:5/847: stat d0/d19/d48/fea 0 2023-12-16T03:16:15.714 INFO:tasks.workunit.client.0.smithi064.stdout:5/848: symlink d0/d19/d73/l123 0 2023-12-16T03:16:15.789 INFO:tasks.workunit.client.0.smithi064.stdout:2/833: sync 2023-12-16T03:16:15.790 INFO:tasks.workunit.client.0.smithi064.stdout:2/834: dread - d1/d15/d1b/d9c/fff zero size 2023-12-16T03:16:15.790 INFO:tasks.workunit.client.0.smithi064.stdout:9/880: sync 2023-12-16T03:16:15.790 INFO:tasks.workunit.client.0.smithi064.stdout:0/955: sync 2023-12-16T03:16:15.790 INFO:tasks.workunit.client.0.smithi064.stdout:8/944: sync 2023-12-16T03:16:15.790 INFO:tasks.workunit.client.0.smithi064.stdout:8/945: chown d0/d1d/d24/d2f 3 1 2023-12-16T03:16:15.790 INFO:tasks.workunit.client.0.smithi064.stdout:9/881: truncate d2/dc/d24/d39/d42/d57/fb5 461859 0 2023-12-16T03:16:15.790 INFO:tasks.workunit.client.0.smithi064.stdout:8/946: fsync d0/da/f30 0 2023-12-16T03:16:15.797 INFO:tasks.workunit.client.0.smithi064.stdout:2/835: link d1/d15/d1b/f4c d1/d15/d58/dab/dc2/f10d 0 2023-12-16T03:16:15.797 INFO:tasks.workunit.client.0.smithi064.stdout:2/836: chown d1/d15/d1b/d49/da0/l9f 87577297 1 2023-12-16T03:16:15.798 INFO:tasks.workunit.client.0.smithi064.stdout:2/837: chown d1/lb 14869 1 2023-12-16T03:16:15.798 INFO:tasks.workunit.client.0.smithi064.stdout:2/838: fsync d1/d15/d58/dab/dc2/f106 0 2023-12-16T03:16:15.799 INFO:tasks.workunit.client.0.smithi064.stdout:0/956: creat d2/d8/da/df/daf/d13e/f145 x:0 0 0 2023-12-16T03:16:15.800 INFO:tasks.workunit.client.0.smithi064.stdout:8/947: unlink d0/f7 0 2023-12-16T03:16:15.801 INFO:tasks.workunit.client.0.smithi064.stdout:9/882: mkdir d2/d2d/d6c/da4/d122 0 2023-12-16T03:16:15.802 INFO:tasks.workunit.client.0.smithi064.stdout:2/839: symlink d1/d15/d58/l10e 0 2023-12-16T03:16:15.802 INFO:tasks.workunit.client.0.smithi064.stdout:2/840: truncate d1/d15/d1b/d61/fb7 5197336 0 2023-12-16T03:16:15.804 INFO:tasks.workunit.client.0.smithi064.stdout:0/957: rmdir d2/d29/d66/de5/d11b 39 2023-12-16T03:16:15.808 INFO:tasks.workunit.client.0.smithi064.stdout:9/883: rmdir d2/dc/d24/d39/d42/d9a/d8b/da8 39 2023-12-16T03:16:15.811 INFO:tasks.workunit.client.0.smithi064.stdout:2/841: mknod d1/db3/dc5/c10f 0 2023-12-16T03:16:15.812 INFO:tasks.workunit.client.0.smithi064.stdout:0/958: rmdir d2/d29/d66/db9 39 2023-12-16T03:16:15.814 INFO:tasks.workunit.client.0.smithi064.stdout:9/884: mknod d2/dc/d24/d39/d77/d7d/d11d/c123 0 2023-12-16T03:16:15.816 INFO:tasks.workunit.client.0.smithi064.stdout:9/885: write d2/d2d/daf/fb0 [1653181,93272] 0 2023-12-16T03:16:15.816 INFO:tasks.workunit.client.0.smithi064.stdout:9/886: write d2/dc/d24/d39/d5e/f8f [3626411,14454] 0 2023-12-16T03:16:15.816 INFO:tasks.workunit.client.0.smithi064.stdout:9/887: fdatasync d2/d2d/d3b/d3c/d34/f75 0 2023-12-16T03:16:15.817 INFO:tasks.workunit.client.0.smithi064.stdout:0/959: creat d2/d7/d10/d85/f146 x:0 0 0 2023-12-16T03:16:15.821 INFO:tasks.workunit.client.0.smithi064.stdout:2/842: rmdir d1/d15/d1b/d49 39 2023-12-16T03:16:15.833 INFO:tasks.workunit.client.0.smithi064.stdout:0/960: creat d2/d8/da/d11/d64/f147 x:0 0 0 2023-12-16T03:16:15.833 INFO:tasks.workunit.client.0.smithi064.stdout:0/961: write d2/d8/f40 [982273,124610] 0 2023-12-16T03:16:15.833 INFO:tasks.workunit.client.0.smithi064.stdout:0/962: write d2/d8/da/dbc/f136 [985414,29435] 0 2023-12-16T03:16:15.833 INFO:tasks.workunit.client.0.smithi064.stdout:0/963: chown d2/d29/d66/de5 20 1 2023-12-16T03:16:15.834 INFO:tasks.workunit.client.0.smithi064.stdout:2/843: creat d1/d15/d1b/d61/d63/f110 x:0 0 0 2023-12-16T03:16:15.836 INFO:tasks.workunit.client.0.smithi064.stdout:9/888: mkdir d2/d2d/d124 0 2023-12-16T03:16:15.837 INFO:tasks.workunit.client.0.smithi064.stdout:2/844: chown d1/d15/d1b/c88 6941663 1 2023-12-16T03:16:15.844 INFO:tasks.workunit.client.0.smithi064.stdout:9/889: link d2/d7e/fa2 d2/dc/d24/d39/f125 0 2023-12-16T03:16:15.846 INFO:tasks.workunit.client.0.smithi064.stdout:2/845: mkdir d1/d15/d58/dab/dc2/d111 0 2023-12-16T03:16:15.847 INFO:tasks.workunit.client.0.smithi064.stdout:2/846: write d1/d15/d1b/d49/f6b [56436,39258] 0 2023-12-16T03:16:15.847 INFO:tasks.workunit.client.0.smithi064.stdout:9/890: mknod d2/dc/d24/d39/d42/d9a/d8b/da8/c126 0 2023-12-16T03:16:15.849 INFO:tasks.workunit.client.0.smithi064.stdout:2/847: mknod d1/d15/d1b/d61/df1/c112 0 2023-12-16T03:16:15.851 INFO:tasks.workunit.client.0.smithi064.stdout:9/891: symlink d2/d2d/d6c/d83/l127 0 2023-12-16T03:16:15.851 INFO:tasks.workunit.client.0.smithi064.stdout:9/892: write d2/dc/ff [8971923,11115] 0 2023-12-16T03:16:15.853 INFO:tasks.workunit.client.0.smithi064.stdout:2/848: mknod d1/d15/d1b/d49/da0/d8f/c113 0 2023-12-16T03:16:15.853 INFO:tasks.workunit.client.0.smithi064.stdout:2/849: fdatasync d1/d15/d58/dab/dc2/ffb 0 2023-12-16T03:16:15.855 INFO:tasks.workunit.client.0.smithi064.stdout:2/850: symlink d1/d15/d58/dab/dc2/l114 0 2023-12-16T03:16:15.856 INFO:tasks.workunit.client.0.smithi064.stdout:2/851: symlink d1/d15/d1b/d61/d63/da2/l115 0 2023-12-16T03:16:15.859 INFO:tasks.workunit.client.0.smithi064.stdout:2/852: mknod d1/d15/d7d/dc6/de1/c116 0 2023-12-16T03:16:15.860 INFO:tasks.workunit.client.0.smithi064.stdout:2/853: symlink d1/d15/d7d/dac/l117 0 2023-12-16T03:16:15.860 INFO:tasks.workunit.client.0.smithi064.stdout:2/854: fsync d1/d15/d1b/d49/da0/d8f/f9a 0 2023-12-16T03:16:15.861 INFO:tasks.workunit.client.0.smithi064.stdout:9/893: dread d2/d2d/d3b/ff0 [0,4194304] 0 2023-12-16T03:16:15.861 INFO:tasks.workunit.client.0.smithi064.stdout:2/855: write d1/d15/d1b/d49/fa7 [437922,62174] 0 2023-12-16T03:16:15.864 INFO:tasks.workunit.client.0.smithi064.stdout:2/856: rmdir d1/d15/d1b/d49/da0/de8 39 2023-12-16T03:16:15.879 INFO:tasks.workunit.client.0.smithi064.stdout:9/894: dwrite d2/dc/f11 [0,4194304] 0 2023-12-16T03:16:15.884 INFO:tasks.workunit.client.0.smithi064.stdout:9/895: creat d2/dc/d24/db2/f128 x:0 0 0 2023-12-16T03:16:15.888 INFO:tasks.workunit.client.0.smithi064.stdout:9/896: creat d2/dc/d8a/deb/d114/f129 x:0 0 0 2023-12-16T03:16:15.888 INFO:tasks.workunit.client.0.smithi064.stdout:9/897: chown d2/d2d/d3b/d3c/d34/dce/de2/f10d 1003146 1 2023-12-16T03:16:15.888 INFO:tasks.workunit.client.0.smithi064.stdout:9/898: fdatasync d2/d2d/d6c/fd9 0 2023-12-16T03:16:15.891 INFO:tasks.workunit.client.0.smithi064.stdout:9/899: unlink d2/ld1 0 2023-12-16T03:16:15.891 INFO:tasks.workunit.client.0.smithi064.stdout:9/900: fdatasync d2/dc/d24/d39/d42/d9a/d8b/da8/d103/f121 0 2023-12-16T03:16:15.892 INFO:tasks.workunit.client.0.smithi064.stdout:9/901: read d2/dc/d24/d39/d77/d7d/fad [1750440,32459] 0 2023-12-16T03:16:15.894 INFO:tasks.workunit.client.0.smithi064.stdout:9/902: rename d2/dc/d24/d39/d5e/d6f/l91 to d2/d2d/d3b/d3c/dd3/l12a 0 2023-12-16T03:16:15.903 INFO:tasks.workunit.client.0.smithi064.stdout:9/903: dread d2/dc/ff [4194304,4194304] 0 2023-12-16T03:16:15.903 INFO:tasks.workunit.client.0.smithi064.stdout:9/904: read d2/dc/f26 [225225,121266] 0 2023-12-16T03:16:15.912 INFO:tasks.workunit.client.0.smithi064.stdout:9/905: dread d2/dc/d24/d39/d77/d7d/db9/fd5 [0,4194304] 0 2023-12-16T03:16:15.915 INFO:tasks.workunit.client.0.smithi064.stdout:9/906: rename d2/d7e/fc4 to d2/d2d/d3b/d3c/dd3/f12b 0 2023-12-16T03:16:15.957 INFO:tasks.workunit.client.0.smithi064.stdout:7/967: sync 2023-12-16T03:16:15.957 INFO:tasks.workunit.client.0.smithi064.stdout:7/968: truncate d7/d26/dc2/f12e 329548 0 2023-12-16T03:16:15.957 INFO:tasks.workunit.client.0.smithi064.stdout:7/969: write d7/d3e/d42/d89/d20/d6f/d93/dfd/f108 [119054,98714] 0 2023-12-16T03:16:15.979 INFO:tasks.workunit.client.0.smithi064.stdout:7/970: dwrite d7/d26/d30/d103/f124 [0,4194304] 0 2023-12-16T03:16:15.984 INFO:tasks.workunit.client.0.smithi064.stdout:7/971: creat d7/d3e/d42/d48/d51/d7c/df5/d82/f13c x:0 0 0 2023-12-16T03:16:15.987 INFO:tasks.workunit.client.0.smithi064.stdout:7/972: rmdir d7/d3e/d42/d89/de2 39 2023-12-16T03:16:15.999 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:15 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:15.999 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:15 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:15.999 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:15 smithi184 ceph-mon[121180]: pgmap v7: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 73 MiB/s rd, 169 MiB/s wr, 293 op/s 2023-12-16T03:16:16.043 INFO:tasks.workunit.client.0.smithi064.stdout:7/973: creat d7/d26/d30/d117/f13d x:0 0 0 2023-12-16T03:16:16.072 INFO:tasks.workunit.client.0.smithi064.stdout:7/974: dread d7/d3e/d42/d43/f104 [0,4194304] 0 2023-12-16T03:16:16.073 INFO:tasks.workunit.client.0.smithi064.stdout:7/975: symlink d7/d3e/d42/d89/d20/d6f/l13e 0 2023-12-16T03:16:16.073 INFO:tasks.workunit.client.0.smithi064.stdout:7/976: dwrite d7/d3e/d42/d48/d51/d7c/d52/fff [0,4194304] 0 2023-12-16T03:16:16.078 INFO:tasks.workunit.client.0.smithi064.stdout:7/977: mknod d7/d3e/d42/d48/d51/d7c/df5/d82/dfc/c13f 0 2023-12-16T03:16:16.078 INFO:tasks.workunit.client.0.smithi064.stdout:7/978: truncate d7/d26/d95/fe3 4583128 0 2023-12-16T03:16:16.091 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:15 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:16.091 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:15 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:16.091 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:15 smithi064 ceph-mon[111958]: pgmap v7: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 73 MiB/s rd, 169 MiB/s wr, 293 op/s 2023-12-16T03:16:16.093 INFO:tasks.workunit.client.0.smithi064.stdout:7/979: rmdir d7/d3e/d42/d48 39 2023-12-16T03:16:16.094 INFO:tasks.workunit.client.0.smithi064.stdout:7/980: write d7/d3e/d42/f72 [4426697,93672] 0 2023-12-16T03:16:16.098 INFO:tasks.workunit.client.0.smithi064.stdout:7/981: creat d7/d3e/d42/d89/d20/d6f/d91/f140 x:0 0 0 2023-12-16T03:16:16.106 INFO:tasks.workunit.client.0.smithi064.stdout:7/982: dread d7/d3e/d42/d89/d20/f3a [0,4194304] 0 2023-12-16T03:16:16.110 INFO:tasks.workunit.client.0.smithi064.stdout:7/983: truncate d7/d3e/d42/d89/fc9 505645 0 2023-12-16T03:16:16.134 INFO:tasks.workunit.client.0.smithi064.stdout:7/984: dwrite d7/d3e/d42/d89/d20/f80 [0,4194304] 0 2023-12-16T03:16:16.134 INFO:tasks.workunit.client.0.smithi064.stdout:7/985: readlink d7/d3e/d42/d89/d20/l5a 0 2023-12-16T03:16:16.146 INFO:tasks.workunit.client.0.smithi064.stdout:7/986: creat d7/d3e/d42/d48/d51/d7c/f141 x:0 0 0 2023-12-16T03:16:16.147 INFO:tasks.workunit.client.0.smithi064.stdout:7/987: truncate d7/d3e/d42/d48/d51/d7c/d52/f99 2902498 0 2023-12-16T03:16:16.150 INFO:tasks.workunit.client.0.smithi064.stdout:7/988: link d7/d3e/d42/d48/d51/c136 d7/d3e/d42/d48/c142 0 2023-12-16T03:16:16.174 INFO:tasks.workunit.client.0.smithi064.stdout:7/989: dwrite d7/d3e/d42/d89/d20/f80 [0,4194304] 0 2023-12-16T03:16:16.174 INFO:tasks.workunit.client.0.smithi064.stdout:7/990: rename d7/d3e/d42 to d7/d3e/d42/d89/d20/d6f/d91/deb/d143 22 2023-12-16T03:16:16.178 INFO:tasks.workunit.client.0.smithi064.stdout:6/795: sync 2023-12-16T03:16:16.179 INFO:tasks.workunit.client.0.smithi064.stdout:6/796: mknod d3/d9/dc0/cee 0 2023-12-16T03:16:16.180 INFO:tasks.workunit.client.0.smithi064.stdout:7/991: write d7/d26/d30/da3/fb9 [2722186,72959] 0 2023-12-16T03:16:16.180 INFO:tasks.workunit.client.0.smithi064.stdout:7/992: write d7/d3e/d42/f13b [894735,95390] 0 2023-12-16T03:16:16.180 INFO:tasks.workunit.client.0.smithi064.stdout:7/993: chown d7/d3e/d42/d89/d20/d37/db1/dbf/le5 140817707 1 2023-12-16T03:16:16.181 INFO:tasks.workunit.client.0.smithi064.stdout:6/797: unlink d3/deb/d1f/c5b 0 2023-12-16T03:16:16.183 INFO:tasks.workunit.client.0.smithi064.stdout:7/994: mknod d7/d3e/d42/d48/d51/c144 0 2023-12-16T03:16:16.187 INFO:tasks.workunit.client.0.smithi064.stdout:7/995: unlink d7/d3e/d42/d43/dc8/fe0 0 2023-12-16T03:16:16.201 INFO:tasks.workunit.client.0.smithi064.stdout:7/996: dwrite d7/d26/d30/d117/f13d [0,4194304] 0 2023-12-16T03:16:16.201 INFO:tasks.workunit.client.0.smithi064.stdout:7/997: truncate d7/d3e/d42/d48/d51/d7c/df5/d82/f13c 676677 0 2023-12-16T03:16:16.202 INFO:tasks.workunit.client.0.smithi064.stdout:7/998: read d7/d3e/d42/f13b [313254,126885] 0 2023-12-16T03:16:16.207 INFO:tasks.workunit.client.0.smithi064.stdout:7/999: truncate d7/f9 328612 0 2023-12-16T03:16:16.346 INFO:tasks.workunit.client.0.smithi064.stdout:5/849: sync 2023-12-16T03:16:16.347 INFO:tasks.workunit.client.0.smithi064.stdout:5/850: read - d0/d19/d48/d8f/d3e/d35/d5d/f109 zero size 2023-12-16T03:16:16.347 INFO:tasks.workunit.client.0.smithi064.stdout:5/851: fsync d0/d19/d48/d8f/d5e/d84/fce 0 2023-12-16T03:16:16.349 INFO:tasks.workunit.client.0.smithi064.stdout:5/852: rename d0/d50/d39/daa/dc5/d104/l108 to d0/d14/d20/d37/d70/d71/d80/l124 0 2023-12-16T03:16:16.349 INFO:tasks.workunit.client.0.smithi064.stdout:5/853: stat d0/d14/d20/df9/dfc/dfd/df0/dc0/fde 0 2023-12-16T03:16:16.349 INFO:tasks.workunit.client.0.smithi064.stdout:5/854: write d0/d7/d34/f5c [422356,11890] 0 2023-12-16T03:16:16.349 INFO:tasks.workunit.client.0.smithi064.stdout:5/855: symlink d0/d14/d20/d37/d70/d71/l125 0 2023-12-16T03:16:16.350 INFO:tasks.workunit.client.0.smithi064.stdout:5/856: mknod d0/d50/c126 0 2023-12-16T03:16:16.351 INFO:tasks.workunit.client.0.smithi064.stdout:5/857: creat d0/d7/f127 x:0 0 0 2023-12-16T03:16:16.352 INFO:tasks.workunit.client.0.smithi064.stdout:5/858: creat d0/d14/d4e/f128 x:0 0 0 2023-12-16T03:16:16.352 INFO:tasks.workunit.client.0.smithi064.stdout:5/859: chown d0/d19/d48/d8f/dac/f10a 48302 1 2023-12-16T03:16:16.354 INFO:tasks.workunit.client.0.smithi064.stdout:5/860: link d0/d19/d48/d8f/d5e/d84/cd3 d0/d19/d48/d8f/d3e/d35/c129 0 2023-12-16T03:16:16.371 INFO:tasks.workunit.client.0.smithi064.stdout:5/861: dwrite d0/d19/d48/d8f/dac/d23/d91/ff1 [4194304,4194304] 0 2023-12-16T03:16:16.371 INFO:tasks.workunit.client.0.smithi064.stdout:5/862: write d0/d7/d34/f56 [1227681,76584] 0 2023-12-16T03:16:16.371 INFO:tasks.workunit.client.0.smithi064.stdout:5/863: chown d0/fc3 22 1 2023-12-16T03:16:16.372 INFO:tasks.workunit.client.0.smithi064.stdout:5/864: read d0/d50/f33 [1580600,73099] 0 2023-12-16T03:16:16.372 INFO:tasks.workunit.client.0.smithi064.stdout:5/865: fsync d0/d14/d20/d37/d70/d71/fb3 0 2023-12-16T03:16:16.372 INFO:tasks.workunit.client.0.smithi064.stdout:5/866: fdatasync d0/d19/d48/d8f/dac/f36 0 2023-12-16T03:16:16.389 INFO:tasks.workunit.client.0.smithi064.stdout:5/867: dwrite d0/d14/d20/df9/dfc/dfd/df0/dc0/fe1 [0,4194304] 0 2023-12-16T03:16:16.405 INFO:tasks.workunit.client.0.smithi064.stdout:8/948: sync 2023-12-16T03:16:16.405 INFO:tasks.workunit.client.0.smithi064.stdout:2/857: sync 2023-12-16T03:16:16.405 INFO:tasks.workunit.client.0.smithi064.stdout:0/964: sync 2023-12-16T03:16:16.405 INFO:tasks.workunit.client.0.smithi064.stdout:6/798: sync 2023-12-16T03:16:16.405 INFO:tasks.workunit.client.0.smithi064.stdout:2/858: chown d1/d15/d7d/dc6/ce6 24 1 2023-12-16T03:16:16.405 INFO:tasks.workunit.client.0.smithi064.stdout:8/949: write d0/da/de9/d37/f74 [493971,110508] 0 2023-12-16T03:16:16.405 INFO:tasks.workunit.client.0.smithi064.stdout:9/907: sync 2023-12-16T03:16:16.407 INFO:tasks.workunit.client.0.smithi064.stdout:0/965: mknod d2/d8/c148 0 2023-12-16T03:16:16.407 INFO:tasks.workunit.client.0.smithi064.stdout:0/966: dread - d2/d7/d10/d114/d12b/dea/f10a zero size 2023-12-16T03:16:16.408 INFO:tasks.workunit.client.0.smithi064.stdout:5/868: dwrite d0/d19/d48/d8f/dac/f36 [0,4194304] 0 2023-12-16T03:16:16.409 INFO:tasks.workunit.client.0.smithi064.stdout:6/799: mknod d3/d80/d92/dce/cef 0 2023-12-16T03:16:16.411 INFO:tasks.workunit.client.0.smithi064.stdout:2/859: symlink d1/d15/d7d/dc6/l118 0 2023-12-16T03:16:16.413 INFO:tasks.workunit.client.0.smithi064.stdout:9/908: rmdir d2/dc/d24/d39/d42/d94 39 2023-12-16T03:16:16.415 INFO:tasks.workunit.client.0.smithi064.stdout:0/967: creat d2/d7/d10/d114/d12b/f149 x:0 0 0 2023-12-16T03:16:16.419 INFO:tasks.workunit.client.0.smithi064.stdout:5/869: getdents d0/d14/d20/d37/d70 0 2023-12-16T03:16:16.420 INFO:tasks.workunit.client.0.smithi064.stdout:5/870: fsync d0/fc3 0 2023-12-16T03:16:16.421 INFO:tasks.workunit.client.0.smithi064.stdout:6/800: truncate d3/deb/da/f85 1289326 0 2023-12-16T03:16:16.422 INFO:tasks.workunit.client.0.smithi064.stdout:6/801: fsync d3/d80/dcf/f3b 0 2023-12-16T03:16:16.423 INFO:tasks.workunit.client.0.smithi064.stdout:2/860: creat d1/d15/d1b/d9c/d69/dcf/f119 x:0 0 0 2023-12-16T03:16:16.423 INFO:tasks.workunit.client.0.smithi064.stdout:8/950: dwrite d0/da/de9/d37/f9b [0,4194304] 0 2023-12-16T03:16:16.425 INFO:tasks.workunit.client.0.smithi064.stdout:9/909: creat d2/dc/d24/d39/d5e/d6f/d107/f12c x:0 0 0 2023-12-16T03:16:16.427 INFO:tasks.workunit.client.0.smithi064.stdout:0/968: symlink d2/d8/da/d11/l14a 0 2023-12-16T03:16:16.429 INFO:tasks.workunit.client.0.smithi064.stdout:5/871: symlink d0/d14/d20/df9/dfc/dfd/l12a 0 2023-12-16T03:16:16.430 INFO:tasks.workunit.client.0.smithi064.stdout:2/861: symlink d1/d15/d7d/l11a 0 2023-12-16T03:16:16.430 INFO:tasks.workunit.client.0.smithi064.stdout:2/862: dread - d1/d15/d1b/d61/d63/da2/fd6 zero size 2023-12-16T03:16:16.433 INFO:tasks.workunit.client.0.smithi064.stdout:8/951: creat d0/da/de9/d37/d3a/dab/dfa/d46/d54/d7c/db7/f147 x:0 0 0 2023-12-16T03:16:16.436 INFO:tasks.workunit.client.0.smithi064.stdout:9/910: getdents d2/d2d/d36 0 2023-12-16T03:16:16.440 INFO:tasks.workunit.client.0.smithi064.stdout:0/969: creat d2/d5b/d103/f14b x:0 0 0 2023-12-16T03:16:16.440 INFO:tasks.workunit.client.0.smithi064.stdout:0/970: write d2/d29/db1/ff4 [373284,35095] 0 2023-12-16T03:16:16.440 INFO:tasks.workunit.client.0.smithi064.stdout:5/872: readlink d0/d19/l88 0 2023-12-16T03:16:16.441 INFO:tasks.workunit.client.0.smithi064.stdout:5/873: dread - d0/d14/d20/df9/dfc/dfd/f112 zero size 2023-12-16T03:16:16.443 INFO:tasks.workunit.client.0.smithi064.stdout:2/863: rename d1/d15/d7d/dc6/dec/ff5 to d1/d15/d7d/dc6/dec/f11b 0 2023-12-16T03:16:16.443 INFO:tasks.workunit.client.0.smithi064.stdout:0/971: symlink d2/l14c 0 2023-12-16T03:16:16.444 INFO:tasks.workunit.client.0.smithi064.stdout:5/874: stat d0/d19/d48/d8f/dac/l10 0 2023-12-16T03:16:16.446 INFO:tasks.workunit.client.0.smithi064.stdout:9/911: dread d2/dc/f11 [0,4194304] 0 2023-12-16T03:16:16.446 INFO:tasks.workunit.client.0.smithi064.stdout:2/864: creat d1/d15/d1b/d61/df1/f11c x:0 0 0 2023-12-16T03:16:16.447 INFO:tasks.workunit.client.0.smithi064.stdout:9/912: creat d2/d2d/d3b/d3c/d34/f12d x:0 0 0 2023-12-16T03:16:16.448 INFO:tasks.workunit.client.0.smithi064.stdout:2/865: creat d1/d15/d23/d2d/f11d x:0 0 0 2023-12-16T03:16:16.449 INFO:tasks.workunit.client.0.smithi064.stdout:9/913: creat d2/dc/d24/d39/d5e/f12e x:0 0 0 2023-12-16T03:16:16.449 INFO:tasks.workunit.client.0.smithi064.stdout:2/866: mknod d1/d15/da5/c11e 0 2023-12-16T03:16:16.450 INFO:tasks.workunit.client.0.smithi064.stdout:2/867: stat d1/d15/d58/dab 0 2023-12-16T03:16:16.451 INFO:tasks.workunit.client.0.smithi064.stdout:9/914: write d2/dc/f11 [3989726,25395] 0 2023-12-16T03:16:16.451 INFO:tasks.workunit.client.0.smithi064.stdout:9/915: chown d2/d2d/d6c/ffc 971940 1 2023-12-16T03:16:16.451 INFO:tasks.workunit.client.0.smithi064.stdout:9/916: fdatasync d2/d2d/d3b/d3c/d4b/fe6 0 2023-12-16T03:16:16.451 INFO:tasks.workunit.client.0.smithi064.stdout:2/868: dread d1/d15/d23/d2d/fc1 [0,4194304] 0 2023-12-16T03:16:16.452 INFO:tasks.workunit.client.0.smithi064.stdout:2/869: dread - d1/d15/d1b/d49/da0/f107 zero size 2023-12-16T03:16:16.453 INFO:tasks.workunit.client.0.smithi064.stdout:8/952: dwrite d0/da/de9/d37/f43 [0,4194304] 0 2023-12-16T03:16:16.457 INFO:tasks.workunit.client.0.smithi064.stdout:8/953: creat d0/da/de9/d12/d44/d68/d106/f148 x:0 0 0 2023-12-16T03:16:16.467 INFO:tasks.workunit.client.0.smithi064.stdout:8/954: dread d0/f3 [0,4194304] 0 2023-12-16T03:16:16.469 INFO:tasks.workunit.client.0.smithi064.stdout:8/955: dread d0/d1d/d73/fc4 [0,4194304] 0 2023-12-16T03:16:16.469 INFO:tasks.workunit.client.0.smithi064.stdout:8/956: chown d0/d1d/d24/d2f/c105 13442 1 2023-12-16T03:16:16.471 INFO:tasks.workunit.client.0.smithi064.stdout:8/957: mkdir d0/d1d/d24/d2f/d149 0 2023-12-16T03:16:16.471 INFO:tasks.workunit.client.0.smithi064.stdout:8/958: getdents d0/d1d/d13a 0 2023-12-16T03:16:16.500 INFO:tasks.workunit.client.0.smithi064.stdout:0/972: dwrite d2/d7/d10/d114/d12b/dea/f133 [0,4194304] 0 2023-12-16T03:16:16.503 INFO:tasks.workunit.client.0.smithi064.stdout:9/917: dwrite d2/dc/f26 [0,4194304] 0 2023-12-16T03:16:16.505 INFO:tasks.workunit.client.0.smithi064.stdout:5/875: dwrite d0/d19/d48/d8f/d3e/d35/f117 [0,4194304] 0 2023-12-16T03:16:16.505 INFO:tasks.workunit.client.0.smithi064.stdout:5/876: dread - d0/d14/d4e/f10f zero size 2023-12-16T03:16:16.505 INFO:tasks.workunit.client.0.smithi064.stdout:8/959: dwrite d0/d1d/d24/d2f/f4b [0,4194304] 0 2023-12-16T03:16:16.507 INFO:tasks.workunit.client.0.smithi064.stdout:2/870: dwrite d1/d15/d1b/d49/fa7 [0,4194304] 0 2023-12-16T03:16:16.507 INFO:tasks.workunit.client.0.smithi064.stdout:2/871: chown d1/d15/da5 28539370 1 2023-12-16T03:16:16.507 INFO:tasks.workunit.client.0.smithi064.stdout:2/872: write d1/d15/d23/d2d/f50 [5151355,13993] 0 2023-12-16T03:16:16.507 INFO:tasks.workunit.client.0.smithi064.stdout:9/918: read d2/f2a [3905497,121271] 0 2023-12-16T03:16:16.523 INFO:tasks.workunit.client.0.smithi064.stdout:8/960: dwrite d0/da/de9/d37/d10d/fb9 [0,4194304] 0 2023-12-16T03:16:16.619 INFO:tasks.workunit.client.0.smithi064.stdout:0/973: link d2/d29/d66/f10d d2/d29/d66/f14d 0 2023-12-16T03:16:16.620 INFO:tasks.workunit.client.0.smithi064.stdout:0/974: read d2/d8/da/df/f80 [857749,67294] 0 2023-12-16T03:16:16.637 INFO:tasks.workunit.client.0.smithi064.stdout:0/975: dwrite d2/d7/d10/d21/d31/f87 [0,4194304] 0 2023-12-16T03:16:16.637 INFO:tasks.workunit.client.0.smithi064.stdout:0/976: chown d2/d7/d10/d114/d12b/dea 846769383 1 2023-12-16T03:16:16.637 INFO:tasks.workunit.client.0.smithi064.stdout:0/977: readlink d2/d29/db1/lf3 0 2023-12-16T03:16:16.637 INFO:tasks.workunit.client.0.smithi064.stdout:0/978: dread - d2/d8/da/d11/f118 zero size 2023-12-16T03:16:16.644 INFO:tasks.workunit.client.0.smithi064.stdout:5/877: symlink d0/d14/d20/d37/d70/d71/l12b 0 2023-12-16T03:16:16.644 INFO:tasks.workunit.client.0.smithi064.stdout:5/878: readlink d0/d7/d97/ld8 0 2023-12-16T03:16:16.654 INFO:tasks.workunit.client.0.smithi064.stdout:2/873: link d1/d15/d1b/d9c/d69/l104 d1/d15/d1b/dc3/l11f 0 2023-12-16T03:16:16.680 INFO:tasks.workunit.client.0.smithi064.stdout:5/879: rmdir d0/d14/d20/d37/d70/d71/d80 39 2023-12-16T03:16:16.684 INFO:tasks.workunit.client.0.smithi064.stdout:2/874: mknod d1/d15/d1b/d9c/d68/c120 0 2023-12-16T03:16:16.701 INFO:tasks.workunit.client.0.smithi064.stdout:5/880: dwrite d0/d19/d48/d8f/d5e/d84/fce [0,4194304] 0 2023-12-16T03:16:16.720 INFO:tasks.workunit.client.0.smithi064.stdout:5/881: dwrite d0/d19/d48/d8f/d5e/f93 [4194304,4194304] 0 2023-12-16T03:16:16.731 INFO:tasks.workunit.client.0.smithi064.stdout:5/882: dread d0/d19/fad [4194304,4194304] 0 2023-12-16T03:16:16.731 INFO:tasks.workunit.client.0.smithi064.stdout:5/883: dread - d0/ff3 zero size 2023-12-16T03:16:16.731 INFO:tasks.workunit.client.0.smithi064.stdout:5/884: chown d0/d19/d48/d8f 11558305 1 2023-12-16T03:16:16.735 INFO:tasks.workunit.client.0.smithi064.stdout:5/885: creat d0/d19/d48/d92/f12c x:0 0 0 2023-12-16T03:16:16.739 INFO:tasks.workunit.client.0.smithi064.stdout:5/886: truncate d0/d19/d48/d8f/dac/d23/f89 1348830 0 2023-12-16T03:16:16.739 INFO:tasks.workunit.client.0.smithi064.stdout:5/887: dread - d0/d50/f8c zero size 2023-12-16T03:16:16.749 INFO:tasks.workunit.client.0.smithi064.stdout:0/979: symlink d2/d7/d10/d85/d88/l14e 0 2023-12-16T03:16:16.752 INFO:tasks.workunit.client.0.smithi064.stdout:0/980: mknod d2/d8/da/d11/df1/d11f/c14f 0 2023-12-16T03:16:16.758 INFO:tasks.workunit.client.0.smithi064.stdout:0/981: dread d2/d29/f2c [0,4194304] 0 2023-12-16T03:16:16.758 INFO:tasks.workunit.client.0.smithi064.stdout:0/982: write d2/d8/da/dbc/fd6 [277620,129048] 0 2023-12-16T03:16:16.758 INFO:tasks.workunit.client.0.smithi064.stdout:0/983: fdatasync d2/d7/d10/dc4/dcc/f68 0 2023-12-16T03:16:16.758 INFO:tasks.workunit.client.0.smithi064.stdout:0/984: chown d2/d29/d66/de5/d11b 440862 1 2023-12-16T03:16:16.768 INFO:tasks.workunit.client.0.smithi064.stdout:2/875: symlink d1/d15/d58/l121 0 2023-12-16T03:16:16.768 INFO:tasks.workunit.client.0.smithi064.stdout:2/876: dread - d1/d15/d1b/d61/d63/da2/fd6 zero size 2023-12-16T03:16:16.768 INFO:tasks.workunit.client.0.smithi064.stdout:2/877: stat d1/d15/d1b/d49/da0/f107 0 2023-12-16T03:16:16.768 INFO:tasks.workunit.client.0.smithi064.stdout:2/878: chown d1/d15/d23/d2d/f50 8 1 2023-12-16T03:16:16.769 INFO:tasks.workunit.client.0.smithi064.stdout:2/879: fsync d1/d15/d1b/d9c/fff 0 2023-12-16T03:16:16.770 INFO:tasks.workunit.client.0.smithi064.stdout:5/888: dwrite d0/fc3 [0,4194304] 0 2023-12-16T03:16:16.770 INFO:tasks.workunit.client.0.smithi064.stdout:2/880: getdents d1/d15/d23 0 2023-12-16T03:16:16.770 INFO:tasks.workunit.client.0.smithi064.stdout:2/881: chown d1/d15/d1b/d61/d63/da2 1229860533 1 2023-12-16T03:16:16.773 INFO:tasks.workunit.client.0.smithi064.stdout:5/889: mknod d0/d19/d48/d8f/dac/d23/d67/da7/c12d 0 2023-12-16T03:16:16.777 INFO:tasks.workunit.client.0.smithi064.stdout:2/882: mkdir d1/d15/d1b/d9c/d68/d122 0 2023-12-16T03:16:16.777 INFO:tasks.workunit.client.0.smithi064.stdout:2/883: write d1/d15/d7d/f62 [253443,51681] 0 2023-12-16T03:16:16.777 INFO:tasks.workunit.client.0.smithi064.stdout:2/884: truncate d1/d15/d1b/d49/f6b 2508432 0 2023-12-16T03:16:16.777 INFO:tasks.workunit.client.0.smithi064.stdout:5/890: mknod d0/d14/d20/d37/d3c/c12e 0 2023-12-16T03:16:16.777 INFO:tasks.workunit.client.0.smithi064.stdout:0/985: dwrite d2/d7/d10/fd1 [0,4194304] 0 2023-12-16T03:16:16.778 INFO:tasks.workunit.client.0.smithi064.stdout:2/885: link d1/d15/d1b/d9c/d68/c2c d1/d15/d7d/dc6/de1/c123 0 2023-12-16T03:16:16.778 INFO:tasks.workunit.client.0.smithi064.stdout:2/886: write d1/d15/d1b/d61/d63/da2/f10c [535119,67129] 0 2023-12-16T03:16:16.779 INFO:tasks.workunit.client.0.smithi064.stdout:5/891: rename d0/d19/d48/d8f/dac/l10 to d0/d19/d48/d8f/dac/d23/d67/da7/df6/l12f 0 2023-12-16T03:16:16.779 INFO:tasks.workunit.client.0.smithi064.stdout:5/892: truncate d0/d14/d20/d37/d70/d71/fb3 8657571 0 2023-12-16T03:16:16.779 INFO:tasks.workunit.client.0.smithi064.stdout:5/893: dread - d0/d14/d20/d37/d3c/f11f zero size 2023-12-16T03:16:16.784 INFO:tasks.workunit.client.0.smithi064.stdout:0/986: creat d2/d8/da/df/f150 x:0 0 0 2023-12-16T03:16:16.785 INFO:tasks.workunit.client.0.smithi064.stdout:2/887: mkdir d1/d15/d7d/dac/d124 0 2023-12-16T03:16:16.786 INFO:tasks.workunit.client.0.smithi064.stdout:2/888: chown d1/d15/d1b/d9c/f34 87670 1 2023-12-16T03:16:16.793 INFO:tasks.workunit.client.0.smithi064.stdout:0/987: dread d2/d7/d10/d21/fc0 [0,4194304] 0 2023-12-16T03:16:16.816 INFO:tasks.workunit.client.0.smithi064.stdout:5/894: dwrite d0/d19/fad [4194304,4194304] 0 2023-12-16T03:16:16.817 INFO:tasks.workunit.client.0.smithi064.stdout:5/895: creat d0/d14/d20/df9/dfc/dfd/df0/dc0/f130 x:0 0 0 2023-12-16T03:16:16.819 INFO:tasks.workunit.client.0.smithi064.stdout:2/889: dwrite d1/d15/d7d/dac/fa8 [0,4194304] 0 2023-12-16T03:16:16.819 INFO:tasks.workunit.client.0.smithi064.stdout:0/988: dwrite d2/d8/da/df/daf/dbd/ff8 [0,4194304] 0 2023-12-16T03:16:16.819 INFO:tasks.workunit.client.0.smithi064.stdout:2/890: write d1/d15/d1b/d9c/f95 [351441,109762] 0 2023-12-16T03:16:16.823 INFO:tasks.workunit.client.0.smithi064.stdout:2/891: creat d1/d15/d1b/d9c/d68/d122/f125 x:0 0 0 2023-12-16T03:16:16.826 INFO:tasks.workunit.client.0.smithi064.stdout:2/892: dread d1/d15/d1b/d9c/d68/f64 [0,4194304] 0 2023-12-16T03:16:16.826 INFO:tasks.workunit.client.0.smithi064.stdout:2/893: write d1/d15/d7d/dac/f44 [760712,81531] 0 2023-12-16T03:16:16.827 INFO:tasks.workunit.client.0.smithi064.stdout:0/989: dread d2/d7/d10/d85/d88/ffa [0,4194304] 0 2023-12-16T03:16:16.827 INFO:tasks.workunit.client.0.smithi064.stdout:2/894: creat d1/d15/d1b/d49/da0/d8f/f126 x:0 0 0 2023-12-16T03:16:16.828 INFO:tasks.workunit.client.0.smithi064.stdout:0/990: mknod d2/d8/da/dbc/c151 0 2023-12-16T03:16:16.830 INFO:tasks.workunit.client.0.smithi064.stdout:0/991: creat d2/d8/da/dbc/f152 x:0 0 0 2023-12-16T03:16:16.831 INFO:tasks.workunit.client.0.smithi064.stdout:0/992: write d2/d7/d10/d21/d31/f65 [2683091,24552] 0 2023-12-16T03:16:16.831 INFO:tasks.workunit.client.0.smithi064.stdout:0/993: fdatasync d2/d5b/f81 0 2023-12-16T03:16:16.833 INFO:tasks.workunit.client.0.smithi064.stdout:0/994: creat d2/d8/da/df/daf/d13e/f153 x:0 0 0 2023-12-16T03:16:16.833 INFO:tasks.workunit.client.0.smithi064.stdout:0/995: stat d2/d29/d66/de5/d11b 0 2023-12-16T03:16:16.852 INFO:tasks.workunit.client.0.smithi064.stdout:2/895: mkdir d1/d15/d1b/d49/d127 0 2023-12-16T03:16:16.852 INFO:tasks.workunit.client.0.smithi064.stdout:2/896: dread - d1/d15/d7d/dc6/dec/f11b zero size 2023-12-16T03:16:16.854 INFO:tasks.workunit.client.0.smithi064.stdout:2/897: link d1/d15/d1b/f4c d1/d15/f128 0 2023-12-16T03:16:16.856 INFO:tasks.workunit.client.0.smithi064.stdout:2/898: symlink d1/d76/d57/l129 0 2023-12-16T03:16:16.856 INFO:tasks.workunit.client.0.smithi064.stdout:2/899: readlink d1/d76/ld9 0 2023-12-16T03:16:16.856 INFO:tasks.workunit.client.0.smithi064.stdout:2/900: write d1/d15/d1b/d49/da0/d8f/f101 [430208,104161] 0 2023-12-16T03:16:16.858 INFO:tasks.workunit.client.0.smithi064.stdout:2/901: creat d1/d15/d7d/dac/f12a x:0 0 0 2023-12-16T03:16:16.858 INFO:tasks.workunit.client.0.smithi064.stdout:5/896: dread d0/d19/d48/d8f/dac/d23/f89 [0,4194304] 0 2023-12-16T03:16:16.859 INFO:tasks.workunit.client.0.smithi064.stdout:5/897: readlink d0/d19/d48/d8f/d5e/lda 0 2023-12-16T03:16:16.859 INFO:tasks.workunit.client.0.smithi064.stdout:5/898: chown d0/d19/l88 399223 1 2023-12-16T03:16:16.867 INFO:tasks.workunit.client.0.smithi064.stdout:5/899: dread d0/d14/d20/d37/d70/f81 [0,4194304] 0 2023-12-16T03:16:16.867 INFO:tasks.workunit.client.0.smithi064.stdout:5/900: fsync d0/d19/d48/d8f/dac/d23/ffb 0 2023-12-16T03:16:16.868 INFO:tasks.workunit.client.0.smithi064.stdout:5/901: chown d0/d14/d20/df9/dfc/dfd/df0 222 1 2023-12-16T03:16:16.869 INFO:tasks.workunit.client.0.smithi064.stdout:5/902: write d0/d7/d97/f9b [220912,52351] 0 2023-12-16T03:16:16.869 INFO:tasks.workunit.client.0.smithi064.stdout:5/903: read - d0/d14/d4e/f128 zero size 2023-12-16T03:16:16.874 INFO:tasks.workunit.client.0.smithi064.stdout:2/902: dread d1/d15/d1b/d9c/d69/f56 [0,4194304] 0 2023-12-16T03:16:16.874 INFO:tasks.workunit.client.0.smithi064.stdout:2/903: stat d1/d15/d1b/d49/d4e 0 2023-12-16T03:16:16.883 INFO:tasks.workunit.client.0.smithi064.stdout:5/904: dwrite d0/d19/d48/d8f/dac/f36 [0,4194304] 0 2023-12-16T03:16:16.883 INFO:tasks.workunit.client.0.smithi064.stdout:5/905: write d0/d19/fee [4810903,6160] 0 2023-12-16T03:16:16.886 INFO:tasks.workunit.client.0.smithi064.stdout:5/906: creat d0/d50/d39/daa/dc5/db8/f131 x:0 0 0 2023-12-16T03:16:16.886 INFO:tasks.workunit.client.0.smithi064.stdout:5/907: fsync d0/d7/d97/fdd 0 2023-12-16T03:16:16.886 INFO:tasks.workunit.client.0.smithi064.stdout:5/908: readlink d0/d7/lcc 0 2023-12-16T03:16:16.888 INFO:tasks.workunit.client.0.smithi064.stdout:5/909: mknod d0/d19/d48/d8f/dac/d23/c132 0 2023-12-16T03:16:16.889 INFO:tasks.workunit.client.0.smithi064.stdout:5/910: creat d0/d19/d48/d8f/dac/f133 x:0 0 0 2023-12-16T03:16:16.892 INFO:tasks.workunit.client.0.smithi064.stdout:5/911: unlink d0/d14/c31 0 2023-12-16T03:16:16.896 INFO:tasks.workunit.client.0.smithi064.stdout:0/996: truncate d2/d8/da/df/daf/dbd/ff8 274423 0 2023-12-16T03:16:16.898 INFO:tasks.workunit.client.0.smithi064.stdout:2/904: rmdir d1/d15/d1b/d49/da0 39 2023-12-16T03:16:16.901 INFO:tasks.workunit.client.0.smithi064.stdout:0/997: symlink d2/d8/da/df/l154 0 2023-12-16T03:16:16.901 INFO:tasks.workunit.client.0.smithi064.stdout:0/998: chown d2/d8/da/d11/df1 44834 1 2023-12-16T03:16:16.902 INFO:tasks.workunit.client.0.smithi064.stdout:2/905: mkdir d1/d15/d1b/d9c/d12b 0 2023-12-16T03:16:16.903 INFO:tasks.workunit.client.0.smithi064.stdout:0/999: creat d2/d7/d10/d85/d88/f155 x:0 0 0 2023-12-16T03:16:16.904 INFO:tasks.workunit.client.0.smithi064.stdout:2/906: mknod d1/c12c 0 2023-12-16T03:16:16.907 INFO:tasks.workunit.client.0.smithi064.stdout:5/912: dwrite d0/d19/d48/d8f/d3e/d35/d5d/f109 [0,4194304] 0 2023-12-16T03:16:16.909 INFO:tasks.workunit.client.0.smithi064.stdout:5/913: fsync d0/d7/d97/f9b 0 2023-12-16T03:16:16.909 INFO:tasks.workunit.client.0.smithi064.stdout:2/907: creat d1/d15/da5/def/f12d x:0 0 0 2023-12-16T03:16:16.911 INFO:tasks.workunit.client.0.smithi064.stdout:2/908: mknod d1/d15/d1b/d49/d4e/c12e 0 2023-12-16T03:16:16.911 INFO:tasks.workunit.client.0.smithi064.stdout:2/909: write d1/d76/d57/fb9 [959322,17603] 0 2023-12-16T03:16:16.911 INFO:tasks.workunit.client.0.smithi064.stdout:2/910: getdents d1/d15/d1b/d9c/d12b 0 2023-12-16T03:16:16.911 INFO:tasks.workunit.client.0.smithi064.stdout:2/911: chown d1/db3/dc5 44007 1 2023-12-16T03:16:16.934 INFO:tasks.workunit.client.0.smithi064.stdout:5/914: dwrite d0/d14/d4e/f128 [0,4194304] 0 2023-12-16T03:16:16.947 INFO:tasks.workunit.client.0.smithi064.stdout:5/915: dwrite d0/d19/d48/d8f/d3e/d35/f54 [0,4194304] 0 2023-12-16T03:16:16.962 INFO:tasks.workunit.client.0.smithi064.stdout:5/916: dwrite d0/d7/d34/f7b [0,4194304] 0 2023-12-16T03:16:16.963 INFO:tasks.workunit.client.0.smithi064.stdout:5/917: read - d0/d14/d20/d37/d70/fd6 zero size 2023-12-16T03:16:16.965 INFO:tasks.workunit.client.0.smithi064.stdout:5/918: getdents d0/d50/d99 0 2023-12-16T03:16:16.972 INFO:tasks.workunit.client.0.smithi064.stdout:5/919: dread d0/f7d [0,4194304] 0 2023-12-16T03:16:16.973 INFO:tasks.workunit.client.0.smithi064.stdout:5/920: creat d0/d50/d39/daa/df4/f134 x:0 0 0 2023-12-16T03:16:16.973 INFO:tasks.workunit.client.0.smithi064.stdout:5/921: read - d0/d14/d4e/f10f zero size 2023-12-16T03:16:16.977 INFO:tasks.workunit.client.0.smithi064.stdout:5/922: creat d0/d7/d97/dc1/f135 x:0 0 0 2023-12-16T03:16:16.987 INFO:tasks.workunit.client.0.smithi064.stdout:8/961: sync 2023-12-16T03:16:16.988 INFO:tasks.workunit.client.0.smithi064.stdout:9/919: sync 2023-12-16T03:16:16.988 INFO:tasks.workunit.client.0.smithi064.stdout:6/802: sync 2023-12-16T03:16:16.988 INFO:tasks.workunit.client.0.smithi064.stdout:6/803: chown d3/d80/dcf/d47/d7c/lea 1089289 1 2023-12-16T03:16:16.988 INFO:tasks.workunit.client.0.smithi064.stdout:9/920: fsync d2/d2d/d6c/f95 0 2023-12-16T03:16:16.989 INFO:tasks.workunit.client.0.smithi064.stdout:9/921: mknod d2/d2d/d3b/d3c/c12f 0 2023-12-16T03:16:16.995 INFO:tasks.workunit.client.0.smithi064.stdout:9/922: rename d2/d2d/d3b/d3c/d34/f12d to d2/d2d/f130 0 2023-12-16T03:16:17.004 INFO:tasks.workunit.client.0.smithi064.stdout:5/923: dwrite d0/d19/d48/d8f/d3e/d35/f117 [0,4194304] 0 2023-12-16T03:16:17.005 INFO:tasks.workunit.client.0.smithi064.stdout:9/923: dread d2/d2d/d3b/f49 [0,4194304] 0 2023-12-16T03:16:17.012 INFO:tasks.workunit.client.0.smithi064.stdout:8/962: dwrite d0/da/de9/d37/f74 [0,4194304] 0 2023-12-16T03:16:17.013 INFO:tasks.workunit.client.0.smithi064.stdout:6/804: dwrite d3/deb/d13/d58/d65/fec [0,4194304] 0 2023-12-16T03:16:17.013 INFO:tasks.workunit.client.0.smithi064.stdout:8/963: fdatasync d0/da/de9/d12/d1c/d59/d107/fae 0 2023-12-16T03:16:17.014 INFO:tasks.workunit.client.0.smithi064.stdout:6/805: read d3/d9/f45 [1196997,215] 0 2023-12-16T03:16:17.020 INFO:tasks.workunit.client.0.smithi064.stdout:8/964: dread - d0/da/de9/d12/d44/d68/d6d/f138 zero size 2023-12-16T03:16:17.021 INFO:tasks.workunit.client.0.smithi064.stdout:5/924: dwrite d0/d50/d39/daa/dc5/db8/fe2 [0,4194304] 0 2023-12-16T03:16:17.023 INFO:tasks.workunit.client.0.smithi064.stdout:6/806: rmdir d3/d9/dc0 39 2023-12-16T03:16:17.024 INFO:tasks.workunit.client.0.smithi064.stdout:8/965: mkdir d0/da/de9/d37/d14a 0 2023-12-16T03:16:17.027 INFO:tasks.workunit.client.0.smithi064.stdout:6/807: mknod d3/deb/d13/d46/d5e/cf0 0 2023-12-16T03:16:17.027 INFO:tasks.workunit.client.0.smithi064.stdout:6/808: chown d3/d9/l59 4120 1 2023-12-16T03:16:17.028 INFO:tasks.workunit.client.0.smithi064.stdout:8/966: getdents d0/d1d/d24/d9c 0 2023-12-16T03:16:17.038 INFO:tasks.workunit.client.0.smithi064.stdout:5/925: dwrite d0/d50/d39/daa/dc5/fd7 [0,4194304] 0 2023-12-16T03:16:17.043 INFO:tasks.workunit.client.0.smithi064.stdout:5/926: mknod d0/d14/c136 0 2023-12-16T03:16:17.043 INFO:tasks.workunit.client.0.smithi064.stdout:5/927: readlink d0/d19/d48/l85 0 2023-12-16T03:16:17.052 INFO:tasks.workunit.client.0.smithi064.stdout:6/809: dwrite d3/deb/da/dd2/fe7 [0,4194304] 0 2023-12-16T03:16:17.053 INFO:tasks.workunit.client.0.smithi064.stdout:6/810: creat d3/d9/dc0/dc4/ff1 x:0 0 0 2023-12-16T03:16:17.054 INFO:tasks.workunit.client.0.smithi064.stdout:6/811: rmdir d3/d44/d7a 39 2023-12-16T03:16:17.055 INFO:tasks.workunit.client.0.smithi064.stdout:6/812: link d3/d44/c74 d3/d80/dcf/d47/cf2 0 2023-12-16T03:16:17.061 INFO:tasks.workunit.client.0.smithi064.stdout:8/967: dwrite d0/d1d/fc5 [0,4194304] 0 2023-12-16T03:16:17.062 INFO:tasks.workunit.client.0.smithi064.stdout:5/928: dwrite d0/d50/d39/daa/dc5/ffa [0,4194304] 0 2023-12-16T03:16:17.069 INFO:tasks.workunit.client.0.smithi064.stdout:8/968: dread d0/da/de9/d12/f82 [0,4194304] 0 2023-12-16T03:16:17.069 INFO:tasks.workunit.client.0.smithi064.stdout:8/969: chown d0/f3 1048 1 2023-12-16T03:16:17.073 INFO:tasks.workunit.client.0.smithi064.stdout:5/929: dread d0/d14/d20/d37/f51 [0,4194304] 0 2023-12-16T03:16:17.075 INFO:tasks.workunit.client.0.smithi064.stdout:5/930: write d0/d19/d48/d8f/d5e/f93 [5018488,105186] 0 2023-12-16T03:16:17.077 INFO:tasks.workunit.client.0.smithi064.stdout:5/931: creat d0/d19/d48/d8f/d3e/d35/f137 x:0 0 0 2023-12-16T03:16:17.077 INFO:tasks.workunit.client.0.smithi064.stdout:5/932: chown d0/d14/d20/df9/dfc/dfd/df0/fba 446016 1 2023-12-16T03:16:17.078 INFO:tasks.workunit.client.0.smithi064.stdout:5/933: mkdir d0/d14/d138 0 2023-12-16T03:16:17.090 INFO:tasks.workunit.client.0.smithi064.stdout:8/970: dwrite d0/da/de9/d37/d3a/dab/dfa/d46/d54/d7c/db7/faf [0,4194304] 0 2023-12-16T03:16:17.090 INFO:tasks.workunit.client.0.smithi064.stdout:8/971: fdatasync d0/da/fc 0 2023-12-16T03:16:17.094 INFO:tasks.workunit.client.0.smithi064.stdout:5/934: dread d0/d50/d39/daa/df4/f106 [0,4194304] 0 2023-12-16T03:16:17.105 INFO:tasks.workunit.client.0.smithi064.stdout:8/972: dwrite d0/da/de9/d12/d1c/d59/d107/f131 [4194304,4194304] 0 2023-12-16T03:16:17.105 INFO:tasks.workunit.client.0.smithi064.stdout:8/973: truncate d0/da/de9/d37/d3a/dab/dfa/f53 4694706 0 2023-12-16T03:16:17.105 INFO:tasks.workunit.client.0.smithi064.stdout:5/935: getdents d0 0 2023-12-16T03:16:17.105 INFO:tasks.workunit.client.0.smithi064.stdout:5/936: fdatasync d0/d19/d48/d8f/d3e/d35/d5d/f109 0 2023-12-16T03:16:17.106 INFO:tasks.workunit.client.0.smithi064.stdout:5/937: write d0/d14/d20/f3d [446686,19472] 0 2023-12-16T03:16:17.107 INFO:tasks.workunit.client.0.smithi064.stdout:8/974: mknod d0/da/de9/d37/d3a/dab/dfa/d46/d8f/c14b 0 2023-12-16T03:16:17.107 INFO:tasks.workunit.client.0.smithi064.stdout:8/975: fdatasync d0/da/de9/d37/f140 0 2023-12-16T03:16:17.109 INFO:tasks.workunit.client.0.smithi064.stdout:8/976: symlink d0/da/de9/d37/d3a/dab/dfa/d46/d54/d8c/l14c 0 2023-12-16T03:16:17.109 INFO:tasks.workunit.client.0.smithi064.stdout:8/977: chown d0/da/de9/d12/d1c/d59/d107/fae 98704833 1 2023-12-16T03:16:17.117 INFO:tasks.workunit.client.0.smithi064.stdout:8/978: creat d0/da/de9/d37/d3a/d95/f14d x:0 0 0 2023-12-16T03:16:17.118 INFO:tasks.workunit.client.0.smithi064.stdout:8/979: write d0/da/de9/f66 [5078461,27494] 0 2023-12-16T03:16:17.120 INFO:tasks.workunit.client.0.smithi064.stdout:8/980: mkdir d0/d1d/d24/d2f/d149/d14e 0 2023-12-16T03:16:17.124 INFO:tasks.workunit.client.0.smithi064.stdout:8/981: rename d0/da/de9/f4f to d0/da/de9/d37/d3a/dab/dfa/d46/d54/d8c/f14f 0 2023-12-16T03:16:17.125 INFO:tasks.workunit.client.0.smithi064.stdout:8/982: stat d0/da/de9/d37/d3a/dab/dfa/d46/d8f/c14b 0 2023-12-16T03:16:17.125 INFO:tasks.workunit.client.0.smithi064.stdout:8/983: write d0/da/de9/d37/d3a/d95/fe1 [518503,34766] 0 2023-12-16T03:16:17.125 INFO:tasks.workunit.client.0.smithi064.stdout:8/984: write d0/da/de9/d12/d44/fc7 [3271583,57199] 0 2023-12-16T03:16:17.132 INFO:tasks.workunit.client.0.smithi064.stdout:8/985: dread d0/da/de9/d37/d3a/dab/dfa/f98 [0,4194304] 0 2023-12-16T03:16:17.153 INFO:tasks.workunit.client.0.smithi064.stdout:8/986: dwrite d0/da/de9/d12/f124 [0,4194304] 0 2023-12-16T03:16:17.174 INFO:tasks.workunit.client.0.smithi064.stdout:8/987: dwrite d0/da/de9/d37/f140 [0,4194304] 0 2023-12-16T03:16:17.203 INFO:tasks.workunit.client.0.smithi064.stdout:8/988: truncate d0/da/de9/d12/d1c/f72 1217636 0 2023-12-16T03:16:17.208 INFO:tasks.workunit.client.0.smithi064.stdout:8/989: rename d0/l13 to d0/d1d/d3c/d42/d145/d13f/l150 0 2023-12-16T03:16:17.209 INFO:tasks.workunit.client.0.smithi064.stdout:8/990: fsync d0/d1d/d73/fdc 0 2023-12-16T03:16:17.470 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:17 smithi184 ceph-mon[121180]: Standby manager daemon smithi064.ueciyw started 2023-12-16T03:16:17.470 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:17 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.64:0/1522563876' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.ueciyw/crt"}]: dispatch 2023-12-16T03:16:17.470 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:17 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.64:0/1522563876' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:16:17.470 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:17 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.64:0/1522563876' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.ueciyw/key"}]: dispatch 2023-12-16T03:16:17.470 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:17 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.64:0/1522563876' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:16:17.470 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:17 smithi184 ceph-mon[121180]: pgmap v8: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 57 MiB/s rd, 131 MiB/s wr, 227 op/s 2023-12-16T03:16:17.504 INFO:tasks.workunit.client.0.smithi064.stdout:9/924: sync 2023-12-16T03:16:17.504 INFO:tasks.workunit.client.0.smithi064.stdout:2/912: sync 2023-12-16T03:16:17.504 INFO:tasks.workunit.client.0.smithi064.stdout:9/925: read - d2/dc/d24/db2/dc3/fff zero size 2023-12-16T03:16:17.504 INFO:tasks.workunit.client.0.smithi064.stdout:9/926: dread - d2/dc/d24/d39/d42/d57/d10b/f113 zero size 2023-12-16T03:16:17.504 INFO:tasks.workunit.client.0.smithi064.stdout:9/927: stat d2/dc/d24/d39/d77/d7d/fd7 0 2023-12-16T03:16:17.506 INFO:tasks.workunit.client.0.smithi064.stdout:2/913: mkdir d1/d12f 0 2023-12-16T03:16:17.507 INFO:tasks.workunit.client.0.smithi064.stdout:9/928: rename d2/d2d/d6c/fd9 to d2/d2d/d3b/d3c/f131 0 2023-12-16T03:16:17.507 INFO:tasks.workunit.client.0.smithi064.stdout:9/929: chown d2/d2d/d3b/d3c/l23 0 1 2023-12-16T03:16:17.508 INFO:tasks.workunit.client.0.smithi064.stdout:9/930: mkdir d2/dc/d24/d132 0 2023-12-16T03:16:17.509 INFO:tasks.workunit.client.0.smithi064.stdout:9/931: symlink d2/dc/d8a/deb/l133 0 2023-12-16T03:16:17.510 INFO:tasks.workunit.client.0.smithi064.stdout:9/932: mknod d2/d2d/d6c/da4/d122/c134 0 2023-12-16T03:16:17.510 INFO:tasks.workunit.client.0.smithi064.stdout:9/933: chown d2/dc/d24/d39/d77/d7d/d11d/c123 31409666 1 2023-12-16T03:16:17.561 INFO:tasks.workunit.client.0.smithi064.stdout:9/934: creat d2/d2d/d3b/d3c/f135 x:0 0 0 2023-12-16T03:16:17.562 INFO:tasks.workunit.client.0.smithi064.stdout:9/935: rmdir d2/dc/d24/d39/d42/d9a/d8b/da8/d103 39 2023-12-16T03:16:17.580 INFO:tasks.workunit.client.0.smithi064.stdout:9/936: dwrite d2/dc/d24/d39/d5e/f8f [0,4194304] 0 2023-12-16T03:16:17.597 INFO:tasks.workunit.client.0.smithi064.stdout:9/937: dwrite d2/dc/d24/d39/d42/f51 [0,4194304] 0 2023-12-16T03:16:17.630 INFO:tasks.workunit.client.0.smithi064.stdout:9/938: creat d2/dc/d24/d39/d42/f136 x:0 0 0 2023-12-16T03:16:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:17 smithi064 ceph-mon[111958]: Standby manager daemon smithi064.ueciyw started 2023-12-16T03:16:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:17 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.64:0/1522563876' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.ueciyw/crt"}]: dispatch 2023-12-16T03:16:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:17 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.64:0/1522563876' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:16:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:17 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.64:0/1522563876' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.ueciyw/key"}]: dispatch 2023-12-16T03:16:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:17 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.64:0/1522563876' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:16:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:17 smithi064 ceph-mon[111958]: pgmap v8: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 57 MiB/s rd, 131 MiB/s wr, 227 op/s 2023-12-16T03:16:17.744 INFO:tasks.workunit.client.0.smithi064.stdout:9/939: mknod d2/dc/d24/d39/d42/d9a/d8b/da8/c137 0 2023-12-16T03:16:17.744 INFO:tasks.workunit.client.0.smithi064.stdout:9/940: dread - d2/dc/d24/db2/f128 zero size 2023-12-16T03:16:17.751 INFO:tasks.workunit.client.0.smithi064.stdout:9/941: dread d2/d2d/d3b/d3c/d34/fa5 [0,4194304] 0 2023-12-16T03:16:17.757 INFO:tasks.workunit.client.0.smithi064.stdout:9/942: unlink d2/d2d/d3b/d3c/d34/f99 0 2023-12-16T03:16:17.758 INFO:tasks.workunit.client.0.smithi064.stdout:9/943: symlink d2/d2d/d3b/d3c/d34/l138 0 2023-12-16T03:16:17.759 INFO:tasks.workunit.client.0.smithi064.stdout:9/944: creat d2/dc/d24/da9/f139 x:0 0 0 2023-12-16T03:16:17.759 INFO:tasks.workunit.client.0.smithi064.stdout:9/945: write d2/dc/d24/db2/dc3/fe8 [48652,125013] 0 2023-12-16T03:16:17.760 INFO:tasks.workunit.client.0.smithi064.stdout:9/946: mknod d2/d2d/d36/db4/dfd/c13a 0 2023-12-16T03:16:17.761 INFO:tasks.workunit.client.0.smithi064.stdout:9/947: creat d2/dc/d24/d39/d42/f13b x:0 0 0 2023-12-16T03:16:17.761 INFO:tasks.workunit.client.0.smithi064.stdout:9/948: truncate d2/dc/d24/d39/d42/d9a/d8b/fe7 1079132 0 2023-12-16T03:16:17.761 INFO:tasks.workunit.client.0.smithi064.stdout:9/949: fdatasync d2/d2d/fb6 0 2023-12-16T03:16:17.762 INFO:tasks.workunit.client.0.smithi064.stdout:9/950: write d2/dc/d24/db2/dc3/fe8 [751677,117442] 0 2023-12-16T03:16:17.762 INFO:tasks.workunit.client.0.smithi064.stdout:9/951: mknod d2/d2d/daf/c13c 0 2023-12-16T03:16:17.764 INFO:tasks.workunit.client.0.smithi064.stdout:9/952: rename d2/dc/d24/d39/d42/d57/d10b/f113 to d2/dc/d24/d39/d5e/f13d 0 2023-12-16T03:16:17.945 INFO:tasks.workunit.client.0.smithi064.stdout:5/938: sync 2023-12-16T03:16:17.945 INFO:tasks.workunit.client.0.smithi064.stdout:2/914: sync 2023-12-16T03:16:17.945 INFO:tasks.workunit.client.0.smithi064.stdout:6/813: sync 2023-12-16T03:16:17.945 INFO:tasks.workunit.client.0.smithi064.stdout:8/991: sync 2023-12-16T03:16:17.946 INFO:tasks.workunit.client.0.smithi064.stdout:8/992: rmdir d0/d1d/d24/d2f/d149 39 2023-12-16T03:16:17.946 INFO:tasks.workunit.client.0.smithi064.stdout:5/939: truncate d0/d7/d97/f9b 1755200 0 2023-12-16T03:16:17.950 INFO:tasks.workunit.client.0.smithi064.stdout:6/814: creat d3/d80/dcf/d47/d4a/d67/d86/d99/db3/ff3 x:0 0 0 2023-12-16T03:16:17.951 INFO:tasks.workunit.client.0.smithi064.stdout:8/993: creat d0/d1d/d3c/d42/d93/f151 x:0 0 0 2023-12-16T03:16:17.952 INFO:tasks.workunit.client.0.smithi064.stdout:8/994: write d0/da/de9/d12/d1c/d59/fb5 [292112,11662] 0 2023-12-16T03:16:17.952 INFO:tasks.workunit.client.0.smithi064.stdout:5/940: mkdir d0/d14/d20/d37/d70/d139 0 2023-12-16T03:16:17.952 INFO:tasks.workunit.client.0.smithi064.stdout:5/941: fsync d0/d14/d20/df9/dfc/dfd/df0/fbe 0 2023-12-16T03:16:17.953 INFO:tasks.workunit.client.0.smithi064.stdout:5/942: chown d0/d19/d48/d8f/d3e/l90 376 1 2023-12-16T03:16:17.956 INFO:tasks.workunit.client.0.smithi064.stdout:6/815: creat d3/deb/d13/d58/db6/ff4 x:0 0 0 2023-12-16T03:16:17.958 INFO:tasks.workunit.client.0.smithi064.stdout:8/995: rename d0/d1d/d73/f13b to d0/da/de9/f152 0 2023-12-16T03:16:17.960 INFO:tasks.workunit.client.0.smithi064.stdout:6/816: creat d3/deb/da/ff5 x:0 0 0 2023-12-16T03:16:17.963 INFO:tasks.workunit.client.0.smithi064.stdout:5/943: rename d0/d19/d48/d8f/d5e/d84/faf to d0/d50/d39/daa/df4/f13a 0 2023-12-16T03:16:17.963 INFO:tasks.workunit.client.0.smithi064.stdout:5/944: truncate d0/d50/d39/daa/fe9 5200517 0 2023-12-16T03:16:17.969 INFO:tasks.workunit.client.0.smithi064.stdout:2/915: dwrite d1/d15/d1b/dc3/fd3 [4194304,4194304] 0 2023-12-16T03:16:17.969 INFO:tasks.workunit.client.0.smithi064.stdout:2/916: chown d1/d15/d7d/dac/d124 7796 1 2023-12-16T03:16:17.970 INFO:tasks.workunit.client.0.smithi064.stdout:8/996: rmdir d0/da/de9/d37/d3a/dab/dfa 39 2023-12-16T03:16:17.975 INFO:tasks.workunit.client.0.smithi064.stdout:8/997: creat d0/da/de9/d37/d3a/f153 x:0 0 0 2023-12-16T03:16:17.980 INFO:tasks.workunit.client.0.smithi064.stdout:6/817: dread d3/deb/d13/d46/f77 [0,4194304] 0 2023-12-16T03:16:17.983 INFO:tasks.workunit.client.0.smithi064.stdout:2/917: dread d1/d15/d1b/d9c/d69/dcf/ff8 [4194304,4194304] 0 2023-12-16T03:16:17.984 INFO:tasks.workunit.client.0.smithi064.stdout:8/998: dread d0/da/de9/d12/d44/d68/fc6 [0,4194304] 0 2023-12-16T03:16:17.989 INFO:tasks.workunit.client.0.smithi064.stdout:8/999: mknod d0/d1d/c154 0 2023-12-16T03:16:17.993 INFO:tasks.workunit.client.0.smithi064.stdout:6/818: dread d3/deb/d1f/f5a [4194304,4194304] 0 2023-12-16T03:16:17.993 INFO:tasks.workunit.client.0.smithi064.stdout:6/819: stat d3/d80/dcf/d47/d4a/d67/d86/l9f 0 2023-12-16T03:16:17.994 INFO:tasks.workunit.client.0.smithi064.stdout:5/945: dwrite d0/d14/d20/df9/dfc/dfd/df0/dc0/f110 [0,4194304] 0 2023-12-16T03:16:17.996 INFO:tasks.workunit.client.0.smithi064.stdout:6/820: creat d3/d80/dcf/d47/d4a/d67/ff6 x:0 0 0 2023-12-16T03:16:18.009 INFO:tasks.workunit.client.0.smithi064.stdout:5/946: dread d0/d19/d48/d8f/d3e/d35/f8a [0,4194304] 0 2023-12-16T03:16:18.021 INFO:tasks.workunit.client.0.smithi064.stdout:5/947: dread d0/d50/f30 [0,4194304] 0 2023-12-16T03:16:18.024 INFO:tasks.workunit.client.0.smithi064.stdout:5/948: mknod d0/d19/d48/d8f/d3e/d35/d5d/c13b 0 2023-12-16T03:16:18.027 INFO:tasks.workunit.client.0.smithi064.stdout:5/949: symlink d0/d14/d20/d116/l13c 0 2023-12-16T03:16:18.032 INFO:tasks.workunit.client.0.smithi064.stdout:5/950: mknod d0/d7/d34/c13d 0 2023-12-16T03:16:18.034 INFO:tasks.workunit.client.0.smithi064.stdout:5/951: truncate d0/d19/d48/d8f/d3e/d35/d5d/f109 3876254 0 2023-12-16T03:16:18.052 INFO:tasks.workunit.client.0.smithi064.stdout:5/952: dwrite d0/d7/d34/f7b [0,4194304] 0 2023-12-16T03:16:18.057 INFO:tasks.workunit.client.0.smithi064.stdout:5/953: symlink d0/d50/d39/daa/df4/l13e 0 2023-12-16T03:16:18.061 INFO:tasks.workunit.client.0.smithi064.stdout:5/954: creat d0/d50/d39/daa/dc5/d104/f13f x:0 0 0 2023-12-16T03:16:18.061 INFO:tasks.workunit.client.0.smithi064.stdout:5/955: fdatasync d0/fc3 0 2023-12-16T03:16:18.069 INFO:tasks.workunit.client.0.smithi064.stdout:5/956: symlink d0/d50/d39/daa/dc5/d104/l140 0 2023-12-16T03:16:18.069 INFO:tasks.workunit.client.0.smithi064.stdout:5/957: stat d0/d7/f64 0 2023-12-16T03:16:18.077 INFO:tasks.workunit.client.0.smithi064.stdout:5/958: dread d0/d7/f1e [0,4194304] 0 2023-12-16T03:16:18.086 INFO:tasks.workunit.client.0.smithi064.stdout:5/959: dread d0/d19/d48/d8f/d3e/d35/d5d/fbd [0,4194304] 0 2023-12-16T03:16:18.089 INFO:tasks.workunit.client.0.smithi064.stdout:5/960: rename d0/d50/d39/daa/dc5/f111 to d0/d19/d48/d8f/dac/dfe/f141 0 2023-12-16T03:16:18.089 INFO:tasks.workunit.client.0.smithi064.stdout:5/961: stat d0/d19/d48/d92/f9e 0 2023-12-16T03:16:18.090 INFO:tasks.workunit.client.0.smithi064.stdout:5/962: creat d0/d50/d39/daa/df4/f142 x:0 0 0 2023-12-16T03:16:18.106 INFO:tasks.workunit.client.0.smithi064.stdout:5/963: dwrite d0/d50/d39/daa/df4/f134 [0,4194304] 0 2023-12-16T03:16:18.106 INFO:tasks.workunit.client.0.smithi064.stdout:5/964: chown d0/d7/d97 788985 1 2023-12-16T03:16:18.121 INFO:tasks.workunit.client.0.smithi064.stdout:5/965: dwrite d0/d14/d20/d37/d3c/f6b [0,4194304] 0 2023-12-16T03:16:18.123 INFO:tasks.workunit.client.0.smithi064.stdout:5/966: creat d0/d19/d48/d8f/dac/d23/f143 x:0 0 0 2023-12-16T03:16:18.124 INFO:tasks.workunit.client.0.smithi064.stdout:5/967: mknod d0/d19/d48/d8f/d3e/d35/c144 0 2023-12-16T03:16:18.124 INFO:tasks.workunit.client.0.smithi064.stdout:5/968: chown d0/d14/d4e/f128 862558 1 2023-12-16T03:16:18.124 INFO:tasks.workunit.client.0.smithi064.stdout:5/969: chown d0/d19/d48/d8f/dac/d23/d67/da7/df6/l12f 10 1 2023-12-16T03:16:18.148 INFO:tasks.workunit.client.0.smithi064.stdout:5/970: dwrite d0/d7/f2e [0,4194304] 0 2023-12-16T03:16:18.160 INFO:tasks.workunit.client.0.smithi064.stdout:5/971: dwrite d0/d7/f127 [0,4194304] 0 2023-12-16T03:16:18.163 INFO:tasks.workunit.client.0.smithi064.stdout:5/972: rmdir d0/d14/d20 39 2023-12-16T03:16:18.163 INFO:tasks.workunit.client.0.smithi064.stdout:5/973: fdatasync d0/d50/f33 0 2023-12-16T03:16:18.167 INFO:tasks.workunit.client.0.smithi064.stdout:5/974: creat d0/d19/d48/d8f/dac/d23/d67/f145 x:0 0 0 2023-12-16T03:16:18.168 INFO:tasks.workunit.client.0.smithi064.stdout:5/975: truncate d0/d19/d48/d8f/dac/dfe/f141 390099 0 2023-12-16T03:16:18.182 INFO:tasks.workunit.client.0.smithi064.stdout:5/976: dwrite d0/d19/d48/d8f/dac/f133 [0,4194304] 0 2023-12-16T03:16:18.189 INFO:tasks.workunit.client.0.smithi064.stdout:5/977: dread d0/d19/fad [4194304,4194304] 0 2023-12-16T03:16:18.204 INFO:tasks.workunit.client.0.smithi064.stdout:5/978: dwrite d0/d50/df5/df7/f114 [0,4194304] 0 2023-12-16T03:16:18.205 INFO:tasks.workunit.client.0.smithi064.stdout:5/979: dread - d0/d19/d48/d92/f12c zero size 2023-12-16T03:16:18.209 INFO:tasks.workunit.client.0.smithi064.stdout:5/980: rmdir d0/d19/d48/d8f/dac/d23/d67/da7 39 2023-12-16T03:16:18.209 INFO:tasks.workunit.client.0.smithi064.stdout:5/981: write d0/d7/f127 [4993232,69282] 0 2023-12-16T03:16:18.209 INFO:tasks.workunit.client.0.smithi064.stdout:5/982: dread - d0/d19/d48/fea zero size 2023-12-16T03:16:18.210 INFO:tasks.workunit.client.0.smithi064.stdout:5/983: mkdir d0/d14/d20/d116/d146 0 2023-12-16T03:16:18.212 INFO:tasks.workunit.client.0.smithi064.stdout:5/984: creat d0/d14/d20/d37/d70/d71/d5a/f147 x:0 0 0 2023-12-16T03:16:18.215 INFO:tasks.workunit.client.0.smithi064.stdout:5/985: link d0/d19/d48/d8f/d3e/d35/d5d/lb2 d0/d19/d48/d92/l148 0 2023-12-16T03:16:18.215 INFO:tasks.workunit.client.0.smithi064.stdout:5/986: mknod d0/d14/d138/c149 0 2023-12-16T03:16:18.217 INFO:tasks.workunit.client.0.smithi064.stdout:5/987: mknod d0/d19/d48/d8f/dac/d23/d67/da7/df6/c14a 0 2023-12-16T03:16:18.218 INFO:tasks.workunit.client.0.smithi064.stdout:5/988: creat d0/d14/f14b x:0 0 0 2023-12-16T03:16:18.219 INFO:tasks.workunit.client.0.smithi064.stdout:5/989: mkdir d0/d14/d20/d116/d146/d14c 0 2023-12-16T03:16:18.228 INFO:tasks.workunit.client.0.smithi064.stdout:5/990: dread d0/d50/d39/daa/fe9 [0,4194304] 0 2023-12-16T03:16:18.233 INFO:tasks.workunit.client.0.smithi064.stdout:5/991: dread d0/d50/d39/daa/df4/f106 [0,4194304] 0 2023-12-16T03:16:18.233 INFO:tasks.workunit.client.0.smithi064.stdout:5/992: truncate d0/d19/d48/d92/fd5 58094 0 2023-12-16T03:16:18.250 INFO:tasks.workunit.client.0.smithi064.stdout:5/993: dwrite d0/d50/f8c [0,4194304] 0 2023-12-16T03:16:18.250 INFO:tasks.workunit.client.0.smithi064.stdout:5/994: read d0/d7/d34/fc8 [1044532,90034] 0 2023-12-16T03:16:18.250 INFO:tasks.workunit.client.0.smithi064.stdout:5/995: chown d0/f6c 531 1 2023-12-16T03:16:18.264 INFO:tasks.workunit.client.0.smithi064.stdout:5/996: dwrite d0/d7/d97/f9b [0,4194304] 0 2023-12-16T03:16:18.268 INFO:tasks.workunit.client.0.smithi064.stdout:5/997: getdents d0/d19/d48/d8f/d3e/d35/d5d/d9a 0 2023-12-16T03:16:18.268 INFO:tasks.workunit.client.0.smithi064.stdout:5/998: getdents d0/d50/d39/daa/dc5/dc9 0 2023-12-16T03:16:18.284 INFO:tasks.workunit.client.0.smithi064.stdout:5/999: dwrite d0/d50/d39/daa/df4/f13a [0,4194304] 0 2023-12-16T03:16:18.356 INFO:tasks.workunit.client.0.smithi064.stdout:9/953: sync 2023-12-16T03:16:18.357 INFO:tasks.workunit.client.0.smithi064.stdout:9/954: truncate d2/dc/d24/d39/d42/f59 969227 0 2023-12-16T03:16:18.361 INFO:tasks.workunit.client.0.smithi064.stdout:9/955: write d2/dc/d24/d39/d42/d57/fb5 [292127,56892] 0 2023-12-16T03:16:18.362 INFO:tasks.workunit.client.0.smithi064.stdout:9/956: stat d2/dc/d24/d39/d77/d7d/d11d 0 2023-12-16T03:16:18.362 INFO:tasks.workunit.client.0.smithi064.stdout:9/957: truncate d2/d2d/d3b/d3c/fba 446990 0 2023-12-16T03:16:18.373 INFO:tasks.workunit.client.0.smithi064.stdout:9/958: dread d2/d2d/f8c [0,4194304] 0 2023-12-16T03:16:18.373 INFO:tasks.workunit.client.0.smithi064.stdout:9/959: fdatasync d2/d2d/d3b/d3c/d34/f75 0 2023-12-16T03:16:18.373 INFO:tasks.workunit.client.0.smithi064.stdout:9/960: dread - d2/dc/d24/d39/d5e/f12e zero size 2023-12-16T03:16:18.374 INFO:tasks.workunit.client.0.smithi064.stdout:9/961: write d2/d2d/ff5 [1030229,72970] 0 2023-12-16T03:16:18.375 INFO:tasks.workunit.client.0.smithi064.stdout:9/962: rename d2/d2d/d36/db4/f10c to d2/d2d/d6c/da4/f13e 0 2023-12-16T03:16:18.375 INFO:tasks.workunit.client.0.smithi064.stdout:9/963: write d2/dc/d24/d39/d42/ffb [351823,123235] 0 2023-12-16T03:16:18.379 INFO:tasks.workunit.client.0.smithi064.stdout:9/964: write d2/dc/d24/d39/d42/d9a/d8b/fe7 [1446279,106475] 0 2023-12-16T03:16:18.393 INFO:tasks.workunit.client.0.smithi064.stdout:9/965: dwrite d2/d2d/d3b/d3c/d34/dce/de2/f10d [0,4194304] 0 2023-12-16T03:16:18.397 INFO:tasks.workunit.client.0.smithi064.stdout:9/966: getdents d2/d2d 0 2023-12-16T03:16:18.397 INFO:tasks.workunit.client.0.smithi064.stdout:9/967: chown d2/dc/d24/d39/d77/d7d/db1 147759745 1 2023-12-16T03:16:18.398 INFO:tasks.workunit.client.0.smithi064.stdout:9/968: creat d2/dc/d8a/deb/f13f x:0 0 0 2023-12-16T03:16:18.398 INFO:tasks.workunit.client.0.smithi064.stdout:9/969: fsync d2/dc/d24/d39/d42/f6e 0 2023-12-16T03:16:18.400 INFO:tasks.workunit.client.0.smithi064.stdout:9/970: creat d2/d2d/d3b/f140 x:0 0 0 2023-12-16T03:16:18.400 INFO:tasks.workunit.client.0.smithi064.stdout:9/971: dread - d2/d2d/d3b/d3c/f131 zero size 2023-12-16T03:16:18.406 INFO:tasks.workunit.client.0.smithi064.stdout:9/972: rename d2/d2d/d3b/d3c/d34 to d2/d2d/d141 0 2023-12-16T03:16:18.408 INFO:tasks.workunit.client.0.smithi064.stdout:9/973: creat d2/dc/d24/d39/d77/d7d/db1/f142 x:0 0 0 2023-12-16T03:16:18.408 INFO:tasks.workunit.client.0.smithi064.stdout:9/974: read d2/dc/ff [7784517,72441] 0 2023-12-16T03:16:18.411 INFO:tasks.workunit.client.0.smithi064.stdout:9/975: unlink d2/d2d/d3b/d3c/l6a 0 2023-12-16T03:16:18.412 INFO:tasks.workunit.client.0.smithi064.stdout:9/976: symlink d2/dc/d24/d39/d5e/l143 0 2023-12-16T03:16:18.417 INFO:tasks.workunit.client.0.smithi064.stdout:9/977: dread d2/dc/d24/d39/d42/d94/fb3 [0,4194304] 0 2023-12-16T03:16:18.418 INFO:tasks.workunit.client.0.smithi064.stdout:9/978: truncate d2/d2d/d6c/f89 117971 0 2023-12-16T03:16:18.419 INFO:tasks.workunit.client.0.smithi064.stdout:9/979: mkdir d2/dc/d24/da9/d11f/d144 0 2023-12-16T03:16:18.421 INFO:tasks.workunit.client.0.smithi064.stdout:9/980: mkdir d2/d145 0 2023-12-16T03:16:18.421 INFO:tasks.workunit.client.0.smithi064.stdout:6/821: sync 2023-12-16T03:16:18.421 INFO:tasks.workunit.client.0.smithi064.stdout:2/918: sync 2023-12-16T03:16:18.423 INFO:tasks.workunit.client.0.smithi064.stdout:9/981: rmdir d2/d7e 39 2023-12-16T03:16:18.423 INFO:tasks.workunit.client.0.smithi064.stdout:9/982: dread - d2/dc/d24/d39/d42/d9a/d8b/da8/f112 zero size 2023-12-16T03:16:18.423 INFO:tasks.workunit.client.0.smithi064.stdout:9/983: write d2/dc/d24/d39/d5e/f11a [98102,121813] 0 2023-12-16T03:16:18.434 INFO:tasks.workunit.client.0.smithi064.stdout:2/919: unlink d1/f7 0 2023-12-16T03:16:18.442 INFO:tasks.workunit.client.0.smithi064.stdout:2/920: rename d1/d15/d1b/d49/da0/f107 to d1/d15/d23/f130 0 2023-12-16T03:16:18.442 INFO:tasks.workunit.client.0.smithi064.stdout:6/822: dwrite d3/d44/faf [0,4194304] 0 2023-12-16T03:16:18.442 INFO:tasks.workunit.client.0.smithi064.stdout:2/921: rmdir d1/d12f 0 2023-12-16T03:16:18.442 INFO:tasks.workunit.client.0.smithi064.stdout:2/922: rename d1 to d1/d15/d7d/dc6/d131 22 2023-12-16T03:16:18.443 INFO:tasks.workunit.client.0.smithi064.stdout:2/923: getdents d1/d15/da5 0 2023-12-16T03:16:18.443 INFO:tasks.workunit.client.0.smithi064.stdout:2/924: fsync d1/d15/d1b/d9c/d68/f64 0 2023-12-16T03:16:18.443 INFO:tasks.workunit.client.0.smithi064.stdout:2/925: mkdir d1/d15/d1b/d49/da0/de8/d132 0 2023-12-16T03:16:18.444 INFO:tasks.workunit.client.0.smithi064.stdout:2/926: truncate d1/d15/d1b/d9c/d68/f3f 3962493 0 2023-12-16T03:16:18.445 INFO:tasks.workunit.client.0.smithi064.stdout:2/927: write d1/d15/d1b/d9c/d68/f64 [1192571,125226] 0 2023-12-16T03:16:18.446 INFO:tasks.workunit.client.0.smithi064.stdout:6/823: write d3/d80/dcf/f9c [889240,4172] 0 2023-12-16T03:16:18.447 INFO:tasks.workunit.client.0.smithi064.stdout:2/928: rename d1/d15/d7d/dc6/l118 to d1/d15/d7d/dc6/de1/l133 0 2023-12-16T03:16:18.447 INFO:tasks.workunit.client.0.smithi064.stdout:2/929: stat d1/d15/d1b/d61/d63/cfc 0 2023-12-16T03:16:18.447 INFO:tasks.workunit.client.0.smithi064.stdout:2/930: dread - d1/d15/d1b/d9c/d68/d122/f125 zero size 2023-12-16T03:16:18.448 INFO:tasks.workunit.client.0.smithi064.stdout:2/931: unlink d1/f8 0 2023-12-16T03:16:18.450 INFO:tasks.workunit.client.0.smithi064.stdout:6/824: mkdir d3/d9e/dbd/dcb/df7 0 2023-12-16T03:16:18.450 INFO:tasks.workunit.client.0.smithi064.stdout:2/932: rename d1/d15/d23/d2d/f11d to d1/d15/d1b/d49/d127/f134 0 2023-12-16T03:16:18.452 INFO:tasks.workunit.client.0.smithi064.stdout:2/933: mkdir d1/d15/d23/d135 0 2023-12-16T03:16:18.452 INFO:tasks.workunit.client.0.smithi064.stdout:2/934: chown d1/d15/d1b/d49/da0/d8f/f126 0 1 2023-12-16T03:16:18.452 INFO:tasks.workunit.client.0.smithi064.stdout:6/825: link d3/deb/d13/d46/f98 d3/deb/d13/d58/db6/ff8 0 2023-12-16T03:16:18.454 INFO:tasks.workunit.client.0.smithi064.stdout:2/935: rename d1/l11 to d1/d15/d1b/d61/df1/l136 0 2023-12-16T03:16:18.456 INFO:tasks.workunit.client.0.smithi064.stdout:2/936: creat d1/d15/d1b/d61/f137 x:0 0 0 2023-12-16T03:16:18.457 INFO:tasks.workunit.client.0.smithi064.stdout:6/826: rename d3/d80/dcf/fe9 to d3/d80/dcf/d47/dd8/ff9 0 2023-12-16T03:16:18.457 INFO:tasks.workunit.client.0.smithi064.stdout:6/827: chown d3/d80/dcf/d47/d4a/d67/d86/d99 17830492 1 2023-12-16T03:16:18.457 INFO:tasks.workunit.client.0.smithi064.stdout:2/937: symlink d1/d15/d7d/dac/d124/l138 0 2023-12-16T03:16:18.458 INFO:tasks.workunit.client.0.smithi064.stdout:2/938: rmdir d1/d15/da5 39 2023-12-16T03:16:18.458 INFO:tasks.workunit.client.0.smithi064.stdout:2/939: readlink d1/d15/d1b/d49/da0/d8f/le0 0 2023-12-16T03:16:18.462 INFO:tasks.workunit.client.0.smithi064.stdout:6/828: rename d3/deb/da/lc8 to d3/d80/dcf/lfa 0 2023-12-16T03:16:18.462 INFO:tasks.workunit.client.0.smithi064.stdout:6/829: fdatasync d3/deb/da/dd2/fe7 0 2023-12-16T03:16:18.464 INFO:tasks.workunit.client.0.smithi064.stdout:6/830: dread d3/d9e/fba [0,4194304] 0 2023-12-16T03:16:18.476 INFO:tasks.workunit.client.0.smithi064.stdout:2/940: dwrite d1/d15/d1b/d9c/f74 [0,4194304] 0 2023-12-16T03:16:18.484 INFO:tasks.workunit.client.0.smithi064.stdout:6/831: dwrite d3/deb/d1f/f5a [0,4194304] 0 2023-12-16T03:16:18.484 INFO:tasks.workunit.client.0.smithi064.stdout:6/832: chown d3/deb/da/f43 11895 1 2023-12-16T03:16:18.484 INFO:tasks.workunit.client.0.smithi064.stdout:6/833: stat d3/deb/c2a 0 2023-12-16T03:16:18.484 INFO:tasks.workunit.client.0.smithi064.stdout:2/941: rename d1/d15/d1b/d9c/f74 to d1/d15/d1b/f139 0 2023-12-16T03:16:18.485 INFO:tasks.workunit.client.0.smithi064.stdout:6/834: dread d3/deb/d13/d46/d5e/da8/fae [0,4194304] 0 2023-12-16T03:16:18.488 INFO:tasks.workunit.client.0.smithi064.stdout:6/835: creat d3/deb/ffb x:0 0 0 2023-12-16T03:16:18.488 INFO:tasks.workunit.client.0.smithi064.stdout:6/836: dread - d3/d80/dcf/d47/dd8/ff9 zero size 2023-12-16T03:16:18.488 INFO:tasks.workunit.client.0.smithi064.stdout:6/837: chown d3/d9/f89 1868 1 2023-12-16T03:16:18.488 INFO:tasks.workunit.client.0.smithi064.stdout:6/838: chown d3/deb/d1f/l34 6 1 2023-12-16T03:16:18.488 INFO:tasks.workunit.client.0.smithi064.stdout:2/942: mknod d1/d15/d1b/d9c/d69/dcf/c13a 0 2023-12-16T03:16:18.488 INFO:tasks.workunit.client.0.smithi064.stdout:2/943: fdatasync d1/d15/d23/f130 0 2023-12-16T03:16:18.489 INFO:tasks.workunit.client.0.smithi064.stdout:2/944: truncate d1/d15/d7d/f62 1267272 0 2023-12-16T03:16:18.490 INFO:tasks.workunit.client.0.smithi064.stdout:6/839: mknod d3/deb/d13/d58/db6/cfc 0 2023-12-16T03:16:18.491 INFO:tasks.workunit.client.0.smithi064.stdout:2/945: creat d1/d15/d1b/d9c/d69/f13b x:0 0 0 2023-12-16T03:16:18.492 INFO:tasks.workunit.client.0.smithi064.stdout:6/840: mknod d3/d9e/dbd/dcb/df7/cfd 0 2023-12-16T03:16:18.492 INFO:tasks.workunit.client.0.smithi064.stdout:2/946: write d1/d15/d7d/f79 [496846,82037] 0 2023-12-16T03:16:18.494 INFO:tasks.workunit.client.0.smithi064.stdout:2/947: rename d1/d15/d1b/d49/f6b to d1/d15/d1b/dc3/f13c 0 2023-12-16T03:16:18.497 INFO:tasks.workunit.client.0.smithi064.stdout:6/841: dread d3/deb/d13/d46/f77 [0,4194304] 0 2023-12-16T03:16:18.497 INFO:tasks.workunit.client.0.smithi064.stdout:6/842: fdatasync d3/d80/fe8 0 2023-12-16T03:16:18.497 INFO:tasks.workunit.client.0.smithi064.stdout:6/843: chown d3/deb/da/ld1 5 1 2023-12-16T03:16:18.500 INFO:tasks.workunit.client.0.smithi064.stdout:6/844: rename d3/deb/l31 to d3/deb/d13/d58/db6/de6/lfe 0 2023-12-16T03:16:18.504 INFO:tasks.workunit.client.0.smithi064.stdout:6/845: rename d3/d9/f68 to d3/deb/d13/d58/db6/de6/fff 0 2023-12-16T03:16:18.508 INFO:tasks.workunit.client.0.smithi064.stdout:2/948: dwrite d1/d15/d7d/dc6/de1/fe9 [0,4194304] 0 2023-12-16T03:16:18.508 INFO:tasks.workunit.client.0.smithi064.stdout:2/949: dread - d1/d15/d1b/d61/df1/f11c zero size 2023-12-16T03:16:18.508 INFO:tasks.workunit.client.0.smithi064.stdout:2/950: chown d1/d15/l48 190315505 1 2023-12-16T03:16:18.508 INFO:tasks.workunit.client.0.smithi064.stdout:2/951: chown d1/d15/d1b/d61/f77 353593 1 2023-12-16T03:16:18.510 INFO:tasks.workunit.client.0.smithi064.stdout:2/952: mkdir d1/d15/d1b/d61/df1/d13d 0 2023-12-16T03:16:18.510 INFO:tasks.workunit.client.0.smithi064.stdout:2/953: fsync d1/d15/fb8 0 2023-12-16T03:16:18.513 INFO:tasks.workunit.client.0.smithi064.stdout:6/846: truncate d3/d44/faf 2987938 0 2023-12-16T03:16:18.514 INFO:tasks.workunit.client.0.smithi064.stdout:6/847: chown d3/f9a 220557 1 2023-12-16T03:16:18.524 INFO:tasks.workunit.client.0.smithi064.stdout:2/954: dwrite d1/d15/d1b/d61/f5f [0,4194304] 0 2023-12-16T03:16:18.548 INFO:tasks.workunit.client.0.smithi064.stdout:6/848: rmdir d3/deb/d1f 39 2023-12-16T03:16:18.549 INFO:tasks.workunit.client.0.smithi064.stdout:2/955: symlink d1/d15/d1b/d49/da0/l13e 0 2023-12-16T03:16:18.553 INFO:tasks.workunit.client.0.smithi064.stdout:6/849: link d3/fd d3/d80/dcf/d47/d4a/d67/d86/d99/db3/f100 0 2023-12-16T03:16:18.554 INFO:tasks.workunit.client.0.smithi064.stdout:6/850: truncate d3/d80/dcf/d47/d4a/d67/d73/fad 5449115 0 2023-12-16T03:16:18.559 INFO:tasks.workunit.client.0.smithi064.stdout:6/851: symlink d3/deb/d13/d46/d5e/da8/l101 0 2023-12-16T03:16:18.559 INFO:tasks.workunit.client.0.smithi064.stdout:2/956: creat d1/d15/f13f x:0 0 0 2023-12-16T03:16:18.559 INFO:tasks.workunit.client.0.smithi064.stdout:2/957: chown d1/d15/d1b/d61/d63/da2/fd6 2288054 1 2023-12-16T03:16:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:18 smithi184 ceph-mon[121180]: mgrmap e24: smithi184.urtxla(active, since 10s), standbys: smithi064.ueciyw 2023-12-16T03:16:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:18 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:16:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:18 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:18 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:18 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:18 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:18 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:18 smithi184 ceph-mon[121180]: Adjusting osd_memory_target on smithi184 to 2592M 2023-12-16T03:16:18.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:18 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:18.561 INFO:tasks.workunit.client.0.smithi064.stdout:6/852: creat d3/deb/d13/d58/f102 x:0 0 0 2023-12-16T03:16:18.562 INFO:tasks.workunit.client.0.smithi064.stdout:6/853: write d3/deb/d13/d46/d5e/da8/fae [429830,73963] 0 2023-12-16T03:16:18.565 INFO:tasks.workunit.client.0.smithi064.stdout:6/854: creat d3/deb/f103 x:0 0 0 2023-12-16T03:16:18.567 INFO:tasks.workunit.client.0.smithi064.stdout:6/855: creat d3/d44/d7a/f104 x:0 0 0 2023-12-16T03:16:18.568 INFO:tasks.workunit.client.0.smithi064.stdout:6/856: mknod d3/d9e/dbd/c105 0 2023-12-16T03:16:18.575 INFO:tasks.workunit.client.0.smithi064.stdout:2/958: dwrite d1/d15/d7d/dac/fa8 [4194304,4194304] 0 2023-12-16T03:16:18.578 INFO:tasks.workunit.client.0.smithi064.stdout:2/959: link d1/d15/d1b/l36 d1/l140 0 2023-12-16T03:16:18.578 INFO:tasks.workunit.client.0.smithi064.stdout:2/960: write d1/d15/d1b/d49/d4e/fb4 [4542371,46600] 0 2023-12-16T03:16:18.579 INFO:tasks.workunit.client.0.smithi064.stdout:2/961: stat d1/d15/d1b/d49/da0/d8f/le0 0 2023-12-16T03:16:18.580 INFO:tasks.workunit.client.0.smithi064.stdout:2/962: creat d1/d15/d58/dab/dc2/f141 x:0 0 0 2023-12-16T03:16:18.582 INFO:tasks.workunit.client.0.smithi064.stdout:2/963: symlink d1/d15/d23/d135/l142 0 2023-12-16T03:16:18.585 INFO:tasks.workunit.client.0.smithi064.stdout:6/857: dread d3/d80/dcf/d47/d4a/d67/d73/fad [0,4194304] 0 2023-12-16T03:16:18.585 INFO:tasks.workunit.client.0.smithi064.stdout:6/858: write d3/deb/d1f/f56 [977605,102940] 0 2023-12-16T03:16:18.598 INFO:tasks.workunit.client.0.smithi064.stdout:6/859: dwrite d3/f5 [4194304,4194304] 0 2023-12-16T03:16:18.599 INFO:tasks.workunit.client.0.smithi064.stdout:6/860: getdents d3/d9/dc0/dc4 0 2023-12-16T03:16:18.600 INFO:tasks.workunit.client.0.smithi064.stdout:6/861: read d3/d9/f45 [432179,105622] 0 2023-12-16T03:16:18.602 INFO:tasks.workunit.client.0.smithi064.stdout:6/862: write d3/f5 [1144294,115390] 0 2023-12-16T03:16:18.619 INFO:tasks.workunit.client.0.smithi064.stdout:6/863: dwrite d3/d80/dcf/d47/d4a/d67/d73/fad [0,4194304] 0 2023-12-16T03:16:18.624 INFO:tasks.workunit.client.0.smithi064.stdout:6/864: dread d3/deb/d13/d46/f77 [0,4194304] 0 2023-12-16T03:16:18.625 INFO:tasks.workunit.client.0.smithi064.stdout:6/865: write d3/d9/dc0/fc6 [4528396,85747] 0 2023-12-16T03:16:18.625 INFO:tasks.workunit.client.0.smithi064.stdout:6/866: chown d3/deb/d13/d58/d65/c6b 10067946 1 2023-12-16T03:16:18.626 INFO:tasks.workunit.client.0.smithi064.stdout:6/867: rmdir d3/d9/dc0 39 2023-12-16T03:16:18.626 INFO:tasks.workunit.client.0.smithi064.stdout:6/868: chown d3/d80/dcf/d47/dd8/ff9 78031989 1 2023-12-16T03:16:18.627 INFO:tasks.workunit.client.0.smithi064.stdout:6/869: mkdir d3/d80/dcf/d47/d106 0 2023-12-16T03:16:18.655 INFO:tasks.workunit.client.0.smithi064.stdout:6/870: write d3/d9/f89 [167142,102144] 0 2023-12-16T03:16:18.661 INFO:tasks.workunit.client.0.smithi064.stdout:6/871: dread d3/d80/dcf/f3b [0,4194304] 0 2023-12-16T03:16:18.661 INFO:tasks.workunit.client.0.smithi064.stdout:6/872: fdatasync d3/d9/fed 0 2023-12-16T03:16:18.661 INFO:tasks.workunit.client.0.smithi064.stdout:6/873: dread - d3/d80/dcf/d47/dd8/ff9 zero size 2023-12-16T03:16:18.663 INFO:tasks.workunit.client.0.smithi064.stdout:6/874: rename d3/d80/cc9 to d3/d80/dcf/d47/d4a/d67/d86/d99/db3/c107 0 2023-12-16T03:16:18.663 INFO:tasks.workunit.client.0.smithi064.stdout:6/875: write d3/d80/dcf/dcc/fd0 [1135749,34618] 0 2023-12-16T03:16:18.663 INFO:tasks.workunit.client.0.smithi064.stdout:6/876: truncate d3/d9/fed 970238 0 2023-12-16T03:16:18.677 INFO:tasks.workunit.client.0.smithi064.stdout:6/877: dwrite d3/d80/dcf/f62 [0,4194304] 0 2023-12-16T03:16:18.678 INFO:tasks.workunit.client.0.smithi064.stdout:6/878: mknod d3/deb/d1f/c108 0 2023-12-16T03:16:18.679 INFO:tasks.workunit.client.0.smithi064.stdout:6/879: mkdir d3/d80/dcf/d47/d4a/d67/d86/d99/d109 0 2023-12-16T03:16:18.679 INFO:tasks.workunit.client.0.smithi064.stdout:6/880: chown d3/d80/dcf/d47/fca 65898 1 2023-12-16T03:16:18.679 INFO:tasks.workunit.client.0.smithi064.stdout:6/881: stat d3/f5 0 2023-12-16T03:16:18.681 INFO:tasks.workunit.client.0.smithi064.stdout:6/882: dread d3/deb/d13/d46/f87 [0,4194304] 0 2023-12-16T03:16:18.682 INFO:tasks.workunit.client.0.smithi064.stdout:6/883: unlink d3/d80/dcf/lfa 0 2023-12-16T03:16:18.683 INFO:tasks.workunit.client.0.smithi064.stdout:6/884: symlink d3/d80/dcf/d47/d7c/l10a 0 2023-12-16T03:16:18.683 INFO:tasks.workunit.client.0.smithi064.stdout:6/885: chown d3/deb/d1f/f56 34689318 1 2023-12-16T03:16:18.685 INFO:tasks.workunit.client.0.smithi064.stdout:6/886: symlink d3/deb/da/l10b 0 2023-12-16T03:16:18.687 INFO:tasks.workunit.client.0.smithi064.stdout:6/887: link d3/deb/da/f85 d3/d9/f10c 0 2023-12-16T03:16:18.687 INFO:tasks.workunit.client.0.smithi064.stdout:6/888: stat d3/d80/dcf/d47/dd8/ff9 0 2023-12-16T03:16:18.689 INFO:tasks.workunit.client.0.smithi064.stdout:6/889: creat d3/deb/d13/d46/f10d x:0 0 0 2023-12-16T03:16:18.689 INFO:tasks.workunit.client.0.smithi064.stdout:6/890: chown d3/d80/d92/ddd 2037827 1 2023-12-16T03:16:18.689 INFO:tasks.workunit.client.0.smithi064.stdout:6/891: write d3/d44/faf [3687920,67716] 0 2023-12-16T03:16:18.689 INFO:tasks.workunit.client.0.smithi064.stdout:6/892: read d3/d9e/fba [516569,38256] 0 2023-12-16T03:16:18.689 INFO:tasks.workunit.client.0.smithi064.stdout:6/893: truncate d3/deb/d13/d46/d5e/da8/fe4 936533 0 2023-12-16T03:16:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:18 smithi064 ceph-mon[111958]: mgrmap e24: smithi184.urtxla(active, since 10s), standbys: smithi064.ueciyw 2023-12-16T03:16:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:18 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:16:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:18 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:18 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:18 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:18.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:18 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:18.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:18 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:18.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:18 smithi064 ceph-mon[111958]: Adjusting osd_memory_target on smithi184 to 2592M 2023-12-16T03:16:18.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:18 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:18.702 INFO:tasks.workunit.client.0.smithi064.stdout:6/894: dwrite d3/deb/d13/d46/d5e/da8/fae [0,4194304] 0 2023-12-16T03:16:18.704 INFO:tasks.workunit.client.0.smithi064.stdout:6/895: mknod d3/deb/d13/d58/db6/c10e 0 2023-12-16T03:16:18.707 INFO:tasks.workunit.client.0.smithi064.stdout:6/896: link d3/c4 d3/deb/d13/c10f 0 2023-12-16T03:16:18.709 INFO:tasks.workunit.client.0.smithi064.stdout:6/897: readlink d3/deb/da/l79 0 2023-12-16T03:16:18.711 INFO:tasks.workunit.client.0.smithi064.stdout:6/898: rmdir d3/d80/dcf/d47/d106 0 2023-12-16T03:16:18.711 INFO:tasks.workunit.client.0.smithi064.stdout:6/899: chown d3/fd4 0 1 2023-12-16T03:16:18.713 INFO:tasks.workunit.client.0.smithi064.stdout:6/900: creat d3/d9e/dbd/dcb/f110 x:0 0 0 2023-12-16T03:16:18.713 INFO:tasks.workunit.client.0.smithi064.stdout:6/901: readlink d3/deb/da/l38 0 2023-12-16T03:16:18.713 INFO:tasks.workunit.client.0.smithi064.stdout:6/902: chown d3/deb/d13/d46/d5e 3 1 2023-12-16T03:16:18.728 INFO:tasks.workunit.client.0.smithi064.stdout:6/903: dwrite d3/d9/f89 [0,4194304] 0 2023-12-16T03:16:18.737 INFO:tasks.workunit.client.0.smithi064.stdout:6/904: dread d3/fd [0,4194304] 0 2023-12-16T03:16:18.739 INFO:tasks.workunit.client.0.smithi064.stdout:6/905: getdents d3 0 2023-12-16T03:16:18.742 INFO:tasks.workunit.client.0.smithi064.stdout:6/906: symlink d3/d80/dcf/d47/d4a/d67/l111 0 2023-12-16T03:16:18.749 INFO:tasks.workunit.client.0.smithi064.stdout:6/907: creat d3/d9e/f112 x:0 0 0 2023-12-16T03:16:18.769 INFO:tasks.workunit.client.0.smithi064.stdout:6/908: mknod d3/d80/dcf/d47/d4a/d67/d86/d99/db3/c113 0 2023-12-16T03:16:18.772 INFO:tasks.workunit.client.0.smithi064.stdout:6/909: rename d3/d80/dcf/d47/cf2 to d3/d80/dcf/d47/d4a/c114 0 2023-12-16T03:16:18.772 INFO:tasks.workunit.client.0.smithi064.stdout:6/910: fdatasync d3/d80/dcf/f83 0 2023-12-16T03:16:18.774 INFO:tasks.workunit.client.0.smithi064.stdout:6/911: rename d3/deb/da/ld1 to d3/d80/dcf/d47/d4a/d67/d86/d99/db3/l115 0 2023-12-16T03:16:18.774 INFO:tasks.workunit.client.0.smithi064.stdout:6/912: fdatasync d3/deb/da/dd2/fe7 0 2023-12-16T03:16:18.782 INFO:tasks.workunit.client.0.smithi064.stdout:6/913: dread d3/deb/d13/d58/d65/fec [0,4194304] 0 2023-12-16T03:16:18.784 INFO:tasks.workunit.client.0.smithi064.stdout:6/914: rename d3/d80/dcf/d47/d4a/d67/l111 to d3/d80/d92/dce/l116 0 2023-12-16T03:16:18.784 INFO:tasks.workunit.client.0.smithi064.stdout:6/915: chown d3/d80/dcf/l42 5243 1 2023-12-16T03:16:18.785 INFO:tasks.workunit.client.0.smithi064.stdout:6/916: write d3/d44/d7a/f104 [132490,76077] 0 2023-12-16T03:16:18.785 INFO:tasks.workunit.client.0.smithi064.stdout:6/917: write d3/deb/d13/d46/f87 [1340566,88365] 0 2023-12-16T03:16:18.786 INFO:tasks.workunit.client.0.smithi064.stdout:6/918: truncate d3/deb/d1f/f22 2536963 0 2023-12-16T03:16:18.788 INFO:tasks.workunit.client.0.smithi064.stdout:6/919: symlink d3/d9/dc0/l117 0 2023-12-16T03:16:18.791 INFO:tasks.workunit.client.0.smithi064.stdout:6/920: unlink d3/d9/l60 0 2023-12-16T03:16:18.811 INFO:tasks.workunit.client.0.smithi064.stdout:6/921: dwrite d3/deb/d13/d58/d65/fde [0,4194304] 0 2023-12-16T03:16:18.814 INFO:tasks.workunit.client.0.smithi064.stdout:6/922: symlink d3/d80/dcf/d47/d7c/l118 0 2023-12-16T03:16:18.814 INFO:tasks.workunit.client.0.smithi064.stdout:6/923: truncate d3/d44/fda 1477659 0 2023-12-16T03:16:18.817 INFO:tasks.workunit.client.0.smithi064.stdout:6/924: creat d3/d80/dcf/d47/d7c/f119 x:0 0 0 2023-12-16T03:16:18.817 INFO:tasks.workunit.client.0.smithi064.stdout:6/925: chown d3/d80/dcf/d47/d4a/d67 61307312 1 2023-12-16T03:16:18.847 INFO:tasks.workunit.client.0.smithi064.stdout:9/984: sync 2023-12-16T03:16:18.848 INFO:tasks.workunit.client.0.smithi064.stdout:9/985: mkdir d2/dc/d24/d39/d42/d9a/d146 0 2023-12-16T03:16:18.848 INFO:tasks.workunit.client.0.smithi064.stdout:9/986: stat d2/dc/d24/d39/d77/fa0 0 2023-12-16T03:16:18.848 INFO:tasks.workunit.client.0.smithi064.stdout:9/987: chown d2/dc/d24/c43 53 1 2023-12-16T03:16:18.848 INFO:tasks.workunit.client.0.smithi064.stdout:9/988: stat d2/f40 0 2023-12-16T03:16:18.850 INFO:tasks.workunit.client.0.smithi064.stdout:9/989: rename d2/d2d/d3b/d3c/d4b/c105 to d2/dc/d24/db2/dc3/c147 0 2023-12-16T03:16:18.850 INFO:tasks.workunit.client.0.smithi064.stdout:9/990: truncate d2/d2d/d141/f37 3931324 0 2023-12-16T03:16:18.851 INFO:tasks.workunit.client.0.smithi064.stdout:9/991: stat d2/dc/d24/d39/d77/d7d/db9/fd8 0 2023-12-16T03:16:18.853 INFO:tasks.workunit.client.0.smithi064.stdout:9/992: symlink d2/dc/d24/d39/d77/l148 0 2023-12-16T03:16:18.853 INFO:tasks.workunit.client.0.smithi064.stdout:9/993: chown d2/d2d/d36/db4/dfd 1620 1 2023-12-16T03:16:19.085 INFO:tasks.workunit.client.0.smithi064.stdout:2/964: sync 2023-12-16T03:16:19.086 INFO:tasks.workunit.client.0.smithi064.stdout:2/965: read d1/d15/d23/d2d/fc4 [1059865,108210] 0 2023-12-16T03:16:19.088 INFO:tasks.workunit.client.0.smithi064.stdout:9/994: rmdir d2/d145 0 2023-12-16T03:16:19.089 INFO:tasks.workunit.client.0.smithi064.stdout:9/995: write d2/dc/d24/d39/d42/d57/f8e [2872126,130523] 0 2023-12-16T03:16:19.091 INFO:tasks.workunit.client.0.smithi064.stdout:9/996: creat d2/dc/d8a/deb/d114/f149 x:0 0 0 2023-12-16T03:16:19.098 INFO:tasks.workunit.client.0.smithi064.stdout:9/997: dread d2/d2d/d141/f9f [0,4194304] 0 2023-12-16T03:16:19.098 INFO:tasks.workunit.client.0.smithi064.stdout:9/998: chown d2/dc/d24/da9/d11f 392168 1 2023-12-16T03:16:19.100 INFO:tasks.workunit.client.0.smithi064.stdout:9/999: link d2/d2d/d141/fa5 d2/dc/d8a/f14a 0 2023-12-16T03:16:19.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:19 smithi184 ceph-mon[121180]: pgmap v9: 65 pgs: 65 active+clean; 3.6 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 86 MiB/s rd, 174 MiB/s wr, 336 op/s 2023-12-16T03:16:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:19 smithi064 ceph-mon[111958]: pgmap v9: 65 pgs: 65 active+clean; 3.6 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 86 MiB/s rd, 174 MiB/s wr, 336 op/s 2023-12-16T03:16:21.501 INFO:tasks.workunit.client.0.smithi064.stdout:2/966: sync 2023-12-16T03:16:21.501 INFO:tasks.workunit.client.0.smithi064.stdout:6/926: sync 2023-12-16T03:16:21.501 INFO:tasks.workunit.client.0.smithi064.stdout:6/927: chown d3/deb/d13/d46/d5e/da8/l101 4722613 1 2023-12-16T03:16:21.503 INFO:tasks.workunit.client.0.smithi064.stdout:2/967: creat d1/d15/d1b/d49/d4e/f143 x:0 0 0 2023-12-16T03:16:21.504 INFO:tasks.workunit.client.0.smithi064.stdout:2/968: mkdir d1/d76/d144 0 2023-12-16T03:16:21.516 INFO:tasks.workunit.client.0.smithi064.stdout:2/969: mknod d1/d15/d7d/dc6/dec/c145 0 2023-12-16T03:16:21.517 INFO:tasks.workunit.client.0.smithi064.stdout:2/970: mkdir d1/d15/d23/d2d/da6/d146 0 2023-12-16T03:16:21.518 INFO:tasks.workunit.client.0.smithi064.stdout:2/971: creat d1/d76/d57/f147 x:0 0 0 2023-12-16T03:16:21.520 INFO:tasks.workunit.client.0.smithi064.stdout:2/972: rename d1/d15/d1b/d61/f77 to d1/d15/da5/def/f148 0 2023-12-16T03:16:21.540 INFO:tasks.workunit.client.0.smithi064.stdout:2/973: dwrite d1/d15/d1b/d49/d127/f134 [0,4194304] 0 2023-12-16T03:16:21.542 INFO:tasks.workunit.client.0.smithi064.stdout:2/974: mkdir d1/d15/d58/dab/dc2/d149 0 2023-12-16T03:16:21.544 INFO:tasks.workunit.client.0.smithi064.stdout:2/975: creat d1/d15/d1b/d9c/d68/d122/f14a x:0 0 0 2023-12-16T03:16:21.544 INFO:tasks.workunit.client.0.smithi064.stdout:2/976: stat d1/d15/d23/d2d/da6/ca9 0 2023-12-16T03:16:21.545 INFO:tasks.workunit.client.0.smithi064.stdout:2/977: rmdir d1/db3/dc5 39 2023-12-16T03:16:21.546 INFO:tasks.workunit.client.0.smithi064.stdout:2/978: getdents d1/d15/d23/d135 0 2023-12-16T03:16:21.564 INFO:tasks.workunit.client.0.smithi064.stdout:2/979: dwrite d1/d15/f28 [0,4194304] 0 2023-12-16T03:16:21.566 INFO:tasks.workunit.client.0.smithi064.stdout:2/980: mkdir d1/d15/d1b/d49/da0/de8/d132/d14b 0 2023-12-16T03:16:21.566 INFO:tasks.workunit.client.0.smithi064.stdout:2/981: write d1/d15/d1b/d9c/fff [833600,30434] 0 2023-12-16T03:16:21.567 INFO:tasks.workunit.client.0.smithi064.stdout:2/982: link d1/d15/d1b/d9c/c6c d1/d15/d7d/dc6/dec/c14c 0 2023-12-16T03:16:21.567 INFO:tasks.workunit.client.0.smithi064.stdout:2/983: write d1/d15/d1b/d61/d63/fe3 [337672,33532] 0 2023-12-16T03:16:21.568 INFO:tasks.workunit.client.0.smithi064.stdout:2/984: creat d1/d15/d1b/d61/f14d x:0 0 0 2023-12-16T03:16:21.568 INFO:tasks.workunit.client.0.smithi064.stdout:2/985: chown d1/d15/d1b/d61/d63/da2/c100 493330783 1 2023-12-16T03:16:21.569 INFO:tasks.workunit.client.0.smithi064.stdout:2/986: write d1/d15/d23/d2d/f3c [1455994,117145] 0 2023-12-16T03:16:21.569 INFO:tasks.workunit.client.0.smithi064.stdout:2/987: write d1/d15/d1b/d9c/d69/f78 [9002637,1286] 0 2023-12-16T03:16:21.570 INFO:tasks.workunit.client.0.smithi064.stdout:2/988: mknod d1/d15/d1b/dc3/c14e 0 2023-12-16T03:16:21.570 INFO:tasks.workunit.client.0.smithi064.stdout:2/989: fsync d1/d15/d1b/d61/d63/f10a 0 2023-12-16T03:16:21.570 INFO:tasks.workunit.client.0.smithi064.stdout:2/990: read - d1/d15/d7d/dc6/dec/f11b zero size 2023-12-16T03:16:21.570 INFO:tasks.workunit.client.0.smithi064.stdout:2/991: fdatasync d1/d15/d23/f130 0 2023-12-16T03:16:21.585 INFO:tasks.workunit.client.0.smithi064.stdout:6/928: link d3/d44/faf d3/d80/f11a 0 2023-12-16T03:16:21.585 INFO:tasks.workunit.client.0.smithi064.stdout:6/929: chown d3/d80/dcf/d47/d7c/f119 465100 1 2023-12-16T03:16:21.586 INFO:tasks.workunit.client.0.smithi064.stdout:6/930: truncate d3/d80/d92/fc2 643224 0 2023-12-16T03:16:21.593 INFO:tasks.workunit.client.0.smithi064.stdout:2/992: dwrite d1/d15/d7d/dc6/de1/fe9 [0,4194304] 0 2023-12-16T03:16:21.593 INFO:tasks.workunit.client.0.smithi064.stdout:2/993: fdatasync d1/d15/d1b/d49/d127/f134 0 2023-12-16T03:16:21.593 INFO:tasks.workunit.client.0.smithi064.stdout:2/994: fdatasync d1/d15/d7d/dc6/de1/fe9 0 2023-12-16T03:16:21.595 INFO:tasks.workunit.client.0.smithi064.stdout:2/995: dread d1/d15/d23/d2d/f9b [0,4194304] 0 2023-12-16T03:16:21.603 INFO:tasks.workunit.client.0.smithi064.stdout:6/931: dwrite d3/d9/fed [0,4194304] 0 2023-12-16T03:16:21.611 INFO:tasks.workunit.client.0.smithi064.stdout:2/996: dread d1/d15/fb8 [0,4194304] 0 2023-12-16T03:16:21.621 INFO:tasks.workunit.client.0.smithi064.stdout:6/932: dwrite d3/d80/fe8 [0,4194304] 0 2023-12-16T03:16:21.623 INFO:tasks.workunit.client.0.smithi064.stdout:6/933: getdents d3/deb/d13 0 2023-12-16T03:16:21.625 INFO:tasks.workunit.client.0.smithi064.stdout:6/934: creat d3/d80/d92/ddd/f11b x:0 0 0 2023-12-16T03:16:21.625 INFO:tasks.workunit.client.0.smithi064.stdout:6/935: readlink d3/deb/d13/d46/l66 0 2023-12-16T03:16:21.627 INFO:tasks.workunit.client.0.smithi064.stdout:6/936: creat d3/d80/dcf/d47/dd8/f11c x:0 0 0 2023-12-16T03:16:21.627 INFO:tasks.workunit.client.0.smithi064.stdout:2/997: dwrite d1/d15/d1b/d61/d63/da2/fd6 [0,4194304] 0 2023-12-16T03:16:21.627 INFO:tasks.workunit.client.0.smithi064.stdout:2/998: readlink d1/d15/d1b/d49/lbb 0 2023-12-16T03:16:21.629 INFO:tasks.workunit.client.0.smithi064.stdout:6/937: mknod d3/d80/dcf/dcc/c11d 0 2023-12-16T03:16:21.629 INFO:tasks.workunit.client.0.smithi064.stdout:2/999: creat d1/d15/d1b/d61/d63/da2/f14f x:0 0 0 2023-12-16T03:16:21.629 INFO:tasks.workunit.client.0.smithi064.stdout:6/938: chown d3/d80/dcf/d47/d4a/d67/d73/fad 22677908 1 2023-12-16T03:16:21.629 INFO:tasks.workunit.client.0.smithi064.stdout:6/939: read - d3/d9e/dbd/dcb/f110 zero size 2023-12-16T03:16:21.638 INFO:tasks.workunit.client.0.smithi064.stdout:6/940: dread d3/deb/d13/f7b [0,4194304] 0 2023-12-16T03:16:21.639 INFO:tasks.workunit.client.0.smithi064.stdout:6/941: creat d3/deb/f11e x:0 0 0 2023-12-16T03:16:21.658 INFO:tasks.workunit.client.0.smithi064.stdout:6/942: dwrite d3/deb/d13/d46/d5e/da8/fe4 [0,4194304] 0 2023-12-16T03:16:21.662 INFO:tasks.workunit.client.0.smithi064.stdout:6/943: rename d3/deb/d13/d58/db6/ff4 to d3/d9e/dbd/dcb/df7/f11f 0 2023-12-16T03:16:21.663 INFO:tasks.workunit.client.0.smithi064.stdout:6/944: creat d3/deb/d13/d46/d5e/da8/f120 x:0 0 0 2023-12-16T03:16:21.664 INFO:tasks.workunit.client.0.smithi064.stdout:6/945: readlink d3/deb/d13/d58/ldc 0 2023-12-16T03:16:21.667 INFO:tasks.workunit.client.0.smithi064.stdout:6/946: unlink d3/fc7 0 2023-12-16T03:16:21.667 INFO:tasks.workunit.client.0.smithi064.stdout:6/947: chown d3/d9/db0 0 1 2023-12-16T03:16:21.668 INFO:tasks.workunit.client.0.smithi064.stdout:6/948: unlink d3/deb/da/f37 0 2023-12-16T03:16:21.682 INFO:tasks.workunit.client.0.smithi064.stdout:6/949: dwrite d3/deb/d1f/f22 [0,4194304] 0 2023-12-16T03:16:21.683 INFO:tasks.workunit.client.0.smithi064.stdout:6/950: creat d3/deb/da/dd2/f121 x:0 0 0 2023-12-16T03:16:21.685 INFO:tasks.workunit.client.0.smithi064.stdout:6/951: creat d3/d44/d7a/f122 x:0 0 0 2023-12-16T03:16:21.685 INFO:tasks.workunit.client.0.smithi064.stdout:6/952: dread - d3/fd4 zero size 2023-12-16T03:16:21.686 INFO:tasks.workunit.client.0.smithi064.stdout:6/953: rename d3/deb/da/f23 to d3/d80/dcf/d47/f123 0 2023-12-16T03:16:21.688 INFO:tasks.workunit.client.0.smithi064.stdout:6/954: rmdir d3/d9/db0/de1 0 2023-12-16T03:16:21.689 INFO:tasks.workunit.client.0.smithi064.stdout:6/955: write d3/fd [3681888,91508] 0 2023-12-16T03:16:21.692 INFO:tasks.workunit.client.0.smithi064.stdout:6/956: rename d3/d80/dcf/d47/d7c to d3/d80/dcf/d47/d4a/d67/d86/d99/d109/d124 0 2023-12-16T03:16:21.697 INFO:tasks.workunit.client.0.smithi064.stdout:6/957: rmdir d3/d80/dcf/d47/d4a/d67/d86/d99/d109 39 2023-12-16T03:16:21.697 INFO:tasks.workunit.client.0.smithi064.stdout:6/958: truncate d3/d9/f89 2726002 0 2023-12-16T03:16:21.701 INFO:tasks.workunit.client.0.smithi064.stdout:6/959: creat d3/f125 x:0 0 0 2023-12-16T03:16:21.709 INFO:tasks.workunit.client.0.smithi064.stdout:6/960: symlink d3/d80/dcf/l126 0 2023-12-16T03:16:21.709 INFO:tasks.workunit.client.0.smithi064.stdout:6/961: chown d3/d44/c74 740 1 2023-12-16T03:16:21.709 INFO:tasks.workunit.client.0.smithi064.stdout:6/962: write d3/d80/dcf/dcc/fd0 [1463886,41945] 0 2023-12-16T03:16:21.710 INFO:tasks.workunit.client.0.smithi064.stdout:6/963: dread d3/deb/d13/d46/f98 [0,4194304] 0 2023-12-16T03:16:21.710 INFO:tasks.workunit.client.0.smithi064.stdout:6/964: fsync d3/d9/f45 0 2023-12-16T03:16:21.710 INFO:tasks.workunit.client.0.smithi064.stdout:6/965: write d3/deb/fa4 [4986560,29494] 0 2023-12-16T03:16:21.710 INFO:tasks.workunit.client.0.smithi064.stdout:6/966: write d3/d80/dcf/d47/fca [594461,101323] 0 2023-12-16T03:16:21.711 INFO:tasks.workunit.client.0.smithi064.stdout:6/967: fdatasync d3/deb/d13/d58/f81 0 2023-12-16T03:16:21.712 INFO:tasks.workunit.client.0.smithi064.stdout:6/968: unlink d3/d80/dcf/d47/d4a/d67/d73/c4f 0 2023-12-16T03:16:21.717 INFO:tasks.workunit.client.0.smithi064.stdout:6/969: dread d3/deb/d13/f7b [0,4194304] 0 2023-12-16T03:16:21.717 INFO:tasks.workunit.client.0.smithi064.stdout:6/970: dread - d3/d44/d7a/f122 zero size 2023-12-16T03:16:21.719 INFO:tasks.workunit.client.0.smithi064.stdout:6/971: creat d3/deb/d13/d58/d65/f127 x:0 0 0 2023-12-16T03:16:21.720 INFO:tasks.workunit.client.0.smithi064.stdout:6/972: creat d3/d80/d92/dce/f128 x:0 0 0 2023-12-16T03:16:21.720 INFO:tasks.workunit.client.0.smithi064.stdout:6/973: dread - d3/d44/fa9 zero size 2023-12-16T03:16:21.726 INFO:tasks.workunit.client.0.smithi064.stdout:6/974: write d3/d44/fda [690764,41208] 0 2023-12-16T03:16:21.726 INFO:tasks.workunit.client.0.smithi064.stdout:6/975: fdatasync d3/d80/dcf/d47/d4a/d67/ff6 0 2023-12-16T03:16:21.727 INFO:tasks.workunit.client.0.smithi064.stdout:6/976: getdents d3/d9 0 2023-12-16T03:16:21.727 INFO:tasks.workunit.client.0.smithi064.stdout:6/977: write d3/d80/dcf/d47/d4a/d67/ff6 [729392,14043] 0 2023-12-16T03:16:21.728 INFO:tasks.workunit.client.0.smithi064.stdout:6/978: write d3/deb/f5f [3743900,55526] 0 2023-12-16T03:16:21.741 INFO:tasks.workunit.client.0.smithi064.stdout:6/979: dwrite d3/d9e/dbd/dcb/df7/f11f [0,4194304] 0 2023-12-16T03:16:21.746 INFO:tasks.workunit.client.0.smithi064.stdout:6/980: dread d3/deb/d13/d58/db6/de6/fff [0,4194304] 0 2023-12-16T03:16:21.746 INFO:tasks.workunit.client.0.smithi064.stdout:6/981: dread - d3/fd4 zero size 2023-12-16T03:16:21.759 INFO:tasks.workunit.client.0.smithi064.stdout:6/982: dwrite d3/deb/d13/d46/d5e/da8/fae [4194304,4194304] 0 2023-12-16T03:16:21.760 INFO:tasks.workunit.client.0.smithi064.stdout:6/983: mknod d3/d9e/c129 0 2023-12-16T03:16:21.770 INFO:tasks.workunit.client.0.smithi064.stdout:6/984: dread d3/f5 [0,4194304] 0 2023-12-16T03:16:21.771 INFO:tasks.workunit.client.0.smithi064.stdout:6/985: write d3/f61 [319595,98594] 0 2023-12-16T03:16:21.772 INFO:tasks.workunit.client.0.smithi064.stdout:6/986: readlink d3/deb/d13/d46/l66 0 2023-12-16T03:16:21.773 INFO:tasks.workunit.client.0.smithi064.stdout:6/987: unlink d3/deb/da/ff5 0 2023-12-16T03:16:21.775 INFO:tasks.workunit.client.0.smithi064.stdout:6/988: rename d3/deb/c2e to d3/d80/d92/c12a 0 2023-12-16T03:16:21.775 INFO:tasks.workunit.client.0.smithi064.stdout:6/989: write d3/fd4 [601789,64269] 0 2023-12-16T03:16:21.775 INFO:tasks.workunit.client.0.smithi064.stdout:6/990: truncate d3/d9e/f112 1020864 0 2023-12-16T03:16:21.775 INFO:tasks.workunit.client.0.smithi064.stdout:6/991: chown d3/d80/dcf/d47/f91 23188 1 2023-12-16T03:16:21.785 INFO:tasks.workunit.client.0.smithi064.stdout:6/992: dread d3/d80/dcf/fb7 [0,4194304] 0 2023-12-16T03:16:21.785 INFO:tasks.workunit.client.0.smithi064.stdout:6/993: truncate d3/d80/dcf/d47/f91 682712 0 2023-12-16T03:16:21.785 INFO:tasks.workunit.client.0.smithi064.stdout:6/994: fdatasync d3/d9/f18 0 2023-12-16T03:16:21.792 INFO:tasks.workunit.client.0.smithi064.stdout:6/995: dread d3/d9/f18 [0,4194304] 0 2023-12-16T03:16:21.795 INFO:tasks.workunit.client.0.smithi064.stdout:6/996: fdatasync d3/d80/dcf/d47/d4a/d67/d86/d99/db3/f100 0 2023-12-16T03:16:21.795 INFO:tasks.workunit.client.0.smithi064.stdout:6/997: chown d3/deb/d13/d58/d65/d6e 1033930321 1 2023-12-16T03:16:21.795 INFO:tasks.workunit.client.0.smithi064.stdout:6/998: readlink d3/deb/d13/d58/ldc 0 2023-12-16T03:16:21.795 INFO:tasks.workunit.client.0.smithi064.stdout:6/999: write d3/deb/d13/d58/db6/ff8 [848215,57222] 0 2023-12-16T03:16:21.805 INFO:tasks.workunit.client.0.smithi064.stderr:+ rm -rf -- ./tmp.RvMpVPfdoc 2023-12-16T03:16:22.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: pgmap v10: 65 pgs: 65 active+clean; 3.6 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 78 MiB/s rd, 159 MiB/s wr, 306 op/s 2023-12-16T03:16:22.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:22.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:22.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:22.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:16:22.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:21 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:16:22.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: pgmap v10: 65 pgs: 65 active+clean; 3.6 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 78 MiB/s rd, 159 MiB/s wr, 306 op/s 2023-12-16T03:16:22.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T03:16:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:16:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:21 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:16:23.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:22 smithi184 ceph-mon[121180]: Adjusting osd_memory_target on smithi064 to 1568M 2023-12-16T03:16:23.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:22 smithi184 ceph-mon[121180]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:16:23.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:22 smithi184 ceph-mon[121180]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:16:23.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:22 smithi184 ceph-mon[121180]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:16:23.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:22 smithi184 ceph-mon[121180]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:16:23.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:22 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:23.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:22 smithi184 ceph-mon[121180]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:16:23.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:22 smithi184 ceph-mon[121180]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:16:23.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:22 smithi064 ceph-mon[111958]: Adjusting osd_memory_target on smithi064 to 1568M 2023-12-16T03:16:23.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:22 smithi064 ceph-mon[111958]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:16:23.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:22 smithi064 ceph-mon[111958]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:16:23.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:22 smithi064 ceph-mon[111958]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:16:23.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:22 smithi064 ceph-mon[111958]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:16:23.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:22 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:23.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:22 smithi064 ceph-mon[111958]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:16:23.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:22 smithi064 ceph-mon[111958]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:23.938 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: Reconfiguring node-exporter.smithi064 (dependencies changed)... 2023-12-16T03:16:23.939 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: Reconfiguring daemon node-exporter.smithi064 on smithi064 2023-12-16T03:16:23.939 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:23 smithi064 ceph-mon[111958]: pgmap v11: 65 pgs: 65 active+clean; 3.6 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 78 MiB/s rd, 159 MiB/s wr, 306 op/s 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:24.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:24.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: Reconfiguring node-exporter.smithi064 (dependencies changed)... 2023-12-16T03:16:24.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: Reconfiguring daemon node-exporter.smithi064 on smithi064 2023-12-16T03:16:24.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:23 smithi184 ceph-mon[121180]: pgmap v11: 65 pgs: 65 active+clean; 3.6 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 78 MiB/s rd, 159 MiB/s wr, 306 op/s 2023-12-16T03:16:25.899 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:25 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:25.900 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:25 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:25.900 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:25 smithi064 ceph-mon[111958]: Reconfiguring alertmanager.smithi064 (dependencies changed)... 2023-12-16T03:16:25.900 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:25 smithi064 ceph-mon[111958]: Reconfiguring daemon alertmanager.smithi064 on smithi064 2023-12-16T03:16:25.900 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:25 smithi064 ceph-mon[111958]: pgmap v12: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 84 MiB/s rd, 170 MiB/s wr, 381 op/s 2023-12-16T03:16:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:25 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:25 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:26.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:25 smithi184 ceph-mon[121180]: Reconfiguring alertmanager.smithi064 (dependencies changed)... 2023-12-16T03:16:26.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:25 smithi184 ceph-mon[121180]: Reconfiguring daemon alertmanager.smithi064 on smithi064 2023-12-16T03:16:26.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:25 smithi184 ceph-mon[121180]: pgmap v12: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 84 MiB/s rd, 170 MiB/s wr, 381 op/s 2023-12-16T03:16:27.326 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:27 smithi064 ceph-mon[111958]: pgmap v13: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 42 MiB/s rd, 72 MiB/s wr, 212 op/s 2023-12-16T03:16:27.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:27 smithi184 ceph-mon[121180]: pgmap v13: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 42 MiB/s rd, 72 MiB/s wr, 212 op/s 2023-12-16T03:16:28.123 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T03:16:28.124 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-16T03:16:29.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:29 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:29.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:29 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:29.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:29 smithi184 ceph-mon[121180]: Reconfiguring grafana.smithi064 (dependencies changed)... 2023-12-16T03:16:29.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:29 smithi184 ceph-mon[121180]: Reconfiguring daemon grafana.smithi064 on smithi064 2023-12-16T03:16:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:29 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:29 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:29 smithi064 ceph-mon[111958]: Reconfiguring grafana.smithi064 (dependencies changed)... 2023-12-16T03:16:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:29 smithi064 ceph-mon[111958]: Reconfiguring daemon grafana.smithi064 on smithi064 2023-12-16T03:16:30.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:30 smithi064 ceph-mon[111958]: pgmap v14: 65 pgs: 65 active+clean; 1.8 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 73 MiB/s wr, 304 op/s 2023-12-16T03:16:30.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:30 smithi184 ceph-mon[121180]: pgmap v14: 65 pgs: 65 active+clean; 1.8 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 73 MiB/s wr, 304 op/s 2023-12-16T03:16:32.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:32 smithi184 ceph-mon[121180]: pgmap v15: 65 pgs: 65 active+clean; 1.8 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 6.5 MiB/s rd, 12 MiB/s wr, 167 op/s 2023-12-16T03:16:32.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:32 smithi064 ceph-mon[111958]: pgmap v15: 65 pgs: 65 active+clean; 1.8 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 6.5 MiB/s rd, 12 MiB/s wr, 167 op/s 2023-12-16T03:16:34.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:34 smithi184 ceph-mon[121180]: pgmap v16: 65 pgs: 65 active+clean; 1.8 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 6.5 MiB/s rd, 12 MiB/s wr, 167 op/s 2023-12-16T03:16:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:34 smithi064 ceph-mon[111958]: pgmap v16: 65 pgs: 65 active+clean; 1.8 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 6.5 MiB/s rd, 12 MiB/s wr, 167 op/s 2023-12-16T03:16:36.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:36 smithi184 ceph-mon[121180]: pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 6.5 MiB/s rd, 13 MiB/s wr, 244 op/s 2023-12-16T03:16:36.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:36 smithi064 ceph-mon[111958]: pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 6.5 MiB/s rd, 13 MiB/s wr, 244 op/s 2023-12-16T03:16:37.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:37 smithi184 ceph-mon[121180]: pgmap v18: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 26 KiB/s rd, 1.6 MiB/s wr, 169 op/s 2023-12-16T03:16:37.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:37 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:37 smithi064 ceph-mon[111958]: pgmap v18: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 26 KiB/s rd, 1.6 MiB/s wr, 169 op/s 2023-12-16T03:16:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:37 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:39.134 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T03:16:39.134 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-16T03:16:39.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.885+0000 7fbc6d61b700 1 -- 172.21.15.64:0/659926328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 msgr2=0x7fbc680fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.885+0000 7fbc6d61b700 1 --2- 172.21.15.64:0/659926328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 0x7fbc680fd000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbc58004940 tx=0x7fbc58009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.885+0000 7fbc6d61b700 1 -- 172.21.15.64:0/659926328 shutdown_connections 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.885+0000 7fbc6d61b700 1 --2- 172.21.15.64:0/659926328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc680fde00 0x7fbc680fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.885+0000 7fbc6d61b700 1 --2- 172.21.15.64:0/659926328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 0x7fbc680fd000 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.885+0000 7fbc6d61b700 1 -- 172.21.15.64:0/659926328 >> 172.21.15.64:0/659926328 conn(0x7fbc680f82d0 msgr2=0x7fbc680fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.885+0000 7fbc6d61b700 1 -- 172.21.15.64:0/659926328 shutdown_connections 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.885+0000 7fbc6d61b700 1 -- 172.21.15.64:0/659926328 wait complete. 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc6d61b700 1 Processor -- start 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc6d61b700 1 -- start start 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc6d61b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 0x7fbc6810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:39.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc6d61b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc680fde00 0x7fbc6810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:39.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc6d61b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6810e0b0 con 0x7fbc680fcbf0 2023-12-16T03:16:39.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc6d61b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6810e950 con 0x7fbc680fde00 2023-12-16T03:16:39.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc66ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 0x7fbc6810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:39.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc667fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc680fde00 0x7fbc6810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:39.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc66ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 0x7fbc6810d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36296/0 (socket says 172.21.15.64:36296) 2023-12-16T03:16:39.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.886+0000 7fbc66ffd700 1 -- 172.21.15.64:0/4113287114 learned_addr learned my addr 172.21.15.64:0/4113287114 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:39.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc66ffd700 1 -- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc680fde00 msgr2=0x7fbc6810dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:39.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc66ffd700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc680fde00 0x7fbc6810dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:39.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc66ffd700 1 -- 172.21.15.64:0/4113287114 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58005040 con 0x7fbc680fcbf0 2023-12-16T03:16:39.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc667fc700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc680fde00 0x7fbc6810dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:16:39.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc66ffd700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 0x7fbc6810d570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009380 tx=0x7fbc58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:39.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc4f7fe700 1 -- 172.21.15.64:0/4113287114 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5800e040 con 0x7fbc680fcbf0 2023-12-16T03:16:39.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6810ebd0 con 0x7fbc680fcbf0 2023-12-16T03:16:39.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc4f7fe700 1 -- 172.21.15.64:0/4113287114 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc5800bd20 con 0x7fbc680fcbf0 2023-12-16T03:16:39.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc4f7fe700 1 -- 172.21.15.64:0/4113287114 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5801c630 con 0x7fbc680fcbf0 2023-12-16T03:16:39.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.887+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6810f110 con 0x7fbc680fcbf0 2023-12-16T03:16:39.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.888+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6804bb80 con 0x7fbc680fcbf0 2023-12-16T03:16:39.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.889+0000 7fbc4f7fe700 1 -- 172.21.15.64:0/4113287114 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7fbc58013420 con 0x7fbc680fcbf0 2023-12-16T03:16:39.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.889+0000 7fbc4f7fe700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fbc5006ae40 0x7fbc5006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:39.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.890+0000 7fbc4f7fe700 1 -- 172.21.15.64:0/4113287114 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fbc5808ab30 con 0x7fbc680fcbf0 2023-12-16T03:16:39.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.890+0000 7fbc667fc700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fbc5006ae40 0x7fbc5006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:39.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.890+0000 7fbc667fc700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fbc5006ae40 0x7fbc5006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c010520 tx=0x7fbc5c00b040 comp rx=0 tx=0).ready entity=mgr.14582 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:39.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:39.898+0000 7fbc4f7fe700 1 -- 172.21.15.64:0/4113287114 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbc58058930 con 0x7fbc680fcbf0 2023-12-16T03:16:40.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.227+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 --> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc68102750 con 0x7fbc5006ae40 2023-12-16T03:16:40.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.229+0000 7fbc4f7fe700 1 -- 172.21.15.64:0/4113287114 <== mgr.14582 v2:172.21.15.184:6828/2992718398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fbc68102750 con 0x7fbc5006ae40 2023-12-16T03:16:40.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fbc5006ae40 msgr2=0x7fbc5006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:40.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fbc5006ae40 0x7fbc5006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c010520 tx=0x7fbc5c00b040 comp rx=0 tx=0).stop 2023-12-16T03:16:40.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 msgr2=0x7fbc6810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:40.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 0x7fbc6810d570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009380 tx=0x7fbc58009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:40.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 shutdown_connections 2023-12-16T03:16:40.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fbc5006ae40 0x7fbc5006d2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc680fcbf0 0x7fbc6810d570 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 --2- 172.21.15.64:0/4113287114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc680fde00 0x7fbc6810dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 >> 172.21.15.64:0/4113287114 conn(0x7fbc680f82d0 msgr2=0x7fbc68101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:40.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 shutdown_connections 2023-12-16T03:16:40.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.232+0000 7fbc6d61b700 1 -- 172.21.15.64:0/4113287114 wait complete. 2023-12-16T03:16:40.246 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:16:40.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.359+0000 7f4341791700 1 -- 172.21.15.64:0/472283724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433c0fcbf0 msgr2=0x7f433c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:40.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.359+0000 7f4341791700 1 --2- 172.21.15.64:0/472283724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433c0fcbf0 0x7f433c0fd000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f432c004940 tx=0x7f432c009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:40.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.359+0000 7f4341791700 1 -- 172.21.15.64:0/472283724 shutdown_connections 2023-12-16T03:16:40.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.359+0000 7f4341791700 1 --2- 172.21.15.64:0/472283724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f433c0fde00 0x7f433c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.359+0000 7f4341791700 1 --2- 172.21.15.64:0/472283724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433c0fcbf0 0x7f433c0fd000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.359+0000 7f4341791700 1 -- 172.21.15.64:0/472283724 >> 172.21.15.64:0/472283724 conn(0x7f433c0f82d0 msgr2=0x7f433c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.360+0000 7f4341791700 1 -- 172.21.15.64:0/472283724 shutdown_connections 2023-12-16T03:16:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.360+0000 7f4341791700 1 -- 172.21.15.64:0/472283724 wait complete. 2023-12-16T03:16:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.360+0000 7f4341791700 1 Processor -- start 2023-12-16T03:16:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.360+0000 7f4341791700 1 -- start start 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.360+0000 7f4341791700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433c0fcbf0 0x7f433c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.360+0000 7f4341791700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f433c0fde00 0x7f433c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.360+0000 7f4341791700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c10e010 con 0x7f433c0fcbf0 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.360+0000 7f4341791700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c10e8b0 con 0x7f433c0fde00 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f433affd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433c0fcbf0 0x7f433c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f433affd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433c0fcbf0 0x7f433c10d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36328/0 (socket says 172.21.15.64:36328) 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f433affd700 1 -- 172.21.15.64:0/1326330911 learned_addr learned my addr 172.21.15.64:0/1326330911 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f433a7fc700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f433c0fde00 0x7f433c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f433a7fc700 1 -- 172.21.15.64:0/1326330911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433c0fcbf0 msgr2=0x7f433c10d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f433a7fc700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433c0fcbf0 0x7f433c10d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f433a7fc700 1 -- 172.21.15.64:0/1326330911 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c005040 con 0x7f433c0fde00 2023-12-16T03:16:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f433a7fc700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f433c0fde00 0x7f433c10da10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4330009fd0 tx=0x7f433000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:40.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f43237fe700 1 -- 172.21.15.64:0/1326330911 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4330004e90 con 0x7f433c0fde00 2023-12-16T03:16:40.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f43237fe700 1 -- 172.21.15.64:0/1326330911 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f433000f040 con 0x7f433c0fde00 2023-12-16T03:16:40.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c10eb30 con 0x7f433c0fde00 2023-12-16T03:16:40.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f43237fe700 1 -- 172.21.15.64:0/1326330911 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433000c9b0 con 0x7f433c0fde00 2023-12-16T03:16:40.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.361+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c10f070 con 0x7f433c0fde00 2023-12-16T03:16:40.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.363+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c04bb80 con 0x7f433c0fde00 2023-12-16T03:16:40.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.363+0000 7f43237fe700 1 -- 172.21.15.64:0/1326330911 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f4330007cc0 con 0x7f433c0fde00 2023-12-16T03:16:40.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.364+0000 7f43237fe700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f432406ae40 0x7f432406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:40.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.364+0000 7f43237fe700 1 -- 172.21.15.64:0/1326330911 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f4330089270 con 0x7f433c0fde00 2023-12-16T03:16:40.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.364+0000 7f433affd700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f432406ae40 0x7f432406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:40.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.365+0000 7f433affd700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f432406ae40 0x7f432406d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f432c0136a0 tx=0x7f432c009e30 comp rx=0 tx=0).ready entity=mgr.14582 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:40.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.369+0000 7f43237fe700 1 -- 172.21.15.64:0/1326330911 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f433004ece0 con 0x7f433c0fde00 2023-12-16T03:16:40.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:40 smithi064 ceph-mon[111958]: pgmap v19: 65 pgs: 65 active+clean; 644 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 39 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2023-12-16T03:16:40.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:40 smithi184 ceph-mon[121180]: pgmap v19: 65 pgs: 65 active+clean; 644 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 39 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2023-12-16T03:16:40.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.716+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 --> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f433c10f4c0 con 0x7f432406ae40 2023-12-16T03:16:40.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.718+0000 7f43237fe700 1 -- 172.21.15.64:0/1326330911 <== mgr.14582 v2:172.21.15.184:6828/2992718398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f433c10f4c0 con 0x7f432406ae40 2023-12-16T03:16:40.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.720+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f432406ae40 msgr2=0x7f432406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:40.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.720+0000 7f4341791700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f432406ae40 0x7f432406d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f432c0136a0 tx=0x7f432c009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:40.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.720+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f433c0fde00 msgr2=0x7f433c10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:40.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.720+0000 7f4341791700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f433c0fde00 0x7f433c10da10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4330009fd0 tx=0x7f433000b040 comp rx=0 tx=0).stop 2023-12-16T03:16:40.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.721+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 shutdown_connections 2023-12-16T03:16:40.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.721+0000 7f4341791700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f432406ae40 0x7f432406d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.721+0000 7f4341791700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f433c0fcbf0 0x7f433c10d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.721+0000 7f4341791700 1 --2- 172.21.15.64:0/1326330911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f433c0fde00 0x7f433c10da10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.721+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 >> 172.21.15.64:0/1326330911 conn(0x7f433c0f82d0 msgr2=0x7f433c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:40.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.721+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 shutdown_connections 2023-12-16T03:16:40.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.721+0000 7f4341791700 1 -- 172.21.15.64:0/1326330911 wait complete. 2023-12-16T03:16:40.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.856+0000 7f09130e8700 1 -- 172.21.15.64:0/2165494413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 msgr2=0x7f090c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:40.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.856+0000 7f09130e8700 1 --2- 172.21.15.64:0/2165494413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 0x7f090c0fbf00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0900004940 tx=0x7f0900009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:40.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.856+0000 7f09130e8700 1 -- 172.21.15.64:0/2165494413 shutdown_connections 2023-12-16T03:16:40.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.856+0000 7f09130e8700 1 --2- 172.21.15.64:0/2165494413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f090c0fcd00 0x7f090c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.856+0000 7f09130e8700 1 --2- 172.21.15.64:0/2165494413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 0x7f090c0fbf00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.856+0000 7f09130e8700 1 -- 172.21.15.64:0/2165494413 >> 172.21.15.64:0/2165494413 conn(0x7f090c0f7190 msgr2=0x7f090c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:40.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.856+0000 7f09130e8700 1 -- 172.21.15.64:0/2165494413 shutdown_connections 2023-12-16T03:16:40.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.856+0000 7f09130e8700 1 -- 172.21.15.64:0/2165494413 wait complete. 2023-12-16T03:16:40.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f09130e8700 1 Processor -- start 2023-12-16T03:16:40.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f09130e8700 1 -- start start 2023-12-16T03:16:40.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f09130e8700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 0x7f090c1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:40.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f09130e8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f090c0fcd00 0x7f090c112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f09130e8700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c066170 con 0x7f090c0fbaf0 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f09130e8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0662b0 con 0x7f090c0fcd00 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f0910e84700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 0x7f090c1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f0910e84700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 0x7f090c1101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36332/0 (socket says 172.21.15.64:36332) 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f0910e84700 1 -- 172.21.15.64:0/2437820671 learned_addr learned my addr 172.21.15.64:0/2437820671 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.857+0000 7f090bfff700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f090c0fcd00 0x7f090c112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f0910e84700 1 -- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f090c0fcd00 msgr2=0x7f090c112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f0910e84700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f090c0fcd00 0x7f090c112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f0910e84700 1 -- 172.21.15.64:0/2437820671 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900005040 con 0x7f090c0fbaf0 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f090bfff700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f090c0fcd00 0x7f090c112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f0910e84700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 0x7f090c1101d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0900005010 tx=0x7f0900009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f09097fa700 1 -- 172.21.15.64:0/2437820671 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0900021070 con 0x7f090c0fbaf0 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c112d20 con 0x7f090c0fbaf0 2023-12-16T03:16:40.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f09097fa700 1 -- 172.21.15.64:0/2437820671 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f090001c400 con 0x7f090c0fbaf0 2023-12-16T03:16:40.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f09097fa700 1 -- 172.21.15.64:0/2437820671 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f090000e070 con 0x7f090c0fbaf0 2023-12-16T03:16:40.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.858+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c1131b0 con 0x7f090c0fbaf0 2023-12-16T03:16:40.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.859+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c04bb80 con 0x7f090c0fbaf0 2023-12-16T03:16:40.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.860+0000 7f09097fa700 1 -- 172.21.15.64:0/2437820671 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f090001c9c0 con 0x7f090c0fbaf0 2023-12-16T03:16:40.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.861+0000 7f09097fa700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f08fc06ae40 0x7f08fc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:40.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.861+0000 7f09097fa700 1 -- 172.21.15.64:0/2437820671 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f090008a8d0 con 0x7f090c0fbaf0 2023-12-16T03:16:40.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.861+0000 7f090bfff700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f08fc06ae40 0x7f08fc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:40.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.861+0000 7f090bfff700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f08fc06ae40 0x7f08fc06d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f08f8004fd0 tx=0x7f08f800b040 comp rx=0 tx=0).ready entity=mgr.14582 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:40.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:40.865+0000 7f09097fa700 1 -- 172.21.15.64:0/2437820671 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0900054ce0 con 0x7f090c0fbaf0 2023-12-16T03:16:41.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.141+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 --> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f090c1133d0 con 0x7f08fc06ae40 2023-12-16T03:16:41.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.156+0000 7f09097fa700 1 -- 172.21.15.64:0/2437820671 <== mgr.14582 v2:172.21.15.184:6828/2992718398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f090c1133d0 con 0x7f08fc06ae40 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 starting - - - - 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (6m) 20s ago 6m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (6m) 27s ago 6m 7478k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (5m) 20s ago 6m 91.6M - 9.4.7 954c08fa6188 697184eb15a8 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (2m) 20s ago 2m 13.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (2m) 20s ago 2m 2832M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (2m) 27s ago 2m 1786M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (2m) 27s ago 2m 14.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:9283 running (7m) 20s ago 7m 350M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f40249c90cfb 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283 running (46s) 27s ago 5m 494M - 19.0.0-191-g6d933094 a29c258b5d6f 5067afd9ddca 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (7m) 20s ago 7m 81.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (5m) 27s ago 5m 59.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:16:41.158 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 starting - - - - 2023-12-16T03:16:41.159 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (5m) 27s ago 5m 18.5M - 1.5.0 0da6a335fe13 67ad2f701450 2023-12-16T03:16:41.159 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (5m) 20s ago 5m 513M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:16:41.159 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (5m) 20s ago 5m 509M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:16:41.159 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (4m) 20s ago 4m 425M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:16:41.159 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (4m) 27s ago 4m 595M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:16:41.159 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (4m) 27s ago 4m 475M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:16:41.159 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (3m) 27s ago 3m 602M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:16:41.159 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (5m) 20s ago 6m 59.4M - 2.43.0 a07b618ecd1d 91a18452d564 2023-12-16T03:16:41.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.158+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f08fc06ae40 msgr2=0x7f08fc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:41.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.158+0000 7f09130e8700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f08fc06ae40 0x7f08fc06d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f08f8004fd0 tx=0x7f08f800b040 comp rx=0 tx=0).stop 2023-12-16T03:16:41.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.158+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 msgr2=0x7f090c1101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:41.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.158+0000 7f09130e8700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 0x7f090c1101d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0900005010 tx=0x7f0900009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:41.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.159+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 shutdown_connections 2023-12-16T03:16:41.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.159+0000 7f09130e8700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f08fc06ae40 0x7f08fc06d2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.159+0000 7f09130e8700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f090c0fbaf0 0x7f090c1101d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.159+0000 7f09130e8700 1 --2- 172.21.15.64:0/2437820671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f090c0fcd00 0x7f090c112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.159+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 >> 172.21.15.64:0/2437820671 conn(0x7f090c0f7190 msgr2=0x7f090c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:41.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.159+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 shutdown_connections 2023-12-16T03:16:41.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.159+0000 7f09130e8700 1 -- 172.21.15.64:0/2437820671 wait complete. 2023-12-16T03:16:41.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.307+0000 7f0374f7a700 1 -- 172.21.15.64:0/2718459072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03700faed0 msgr2=0x7f03700fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:41.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.307+0000 7f0374f7a700 1 --2- 172.21.15.64:0/2718459072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03700faed0 0x7f03700fb2e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0360004940 tx=0x7f0360009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:41.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.307+0000 7f0374f7a700 1 -- 172.21.15.64:0/2718459072 shutdown_connections 2023-12-16T03:16:41.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.307+0000 7f0374f7a700 1 --2- 172.21.15.64:0/2718459072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03700fdf60 0x7f03700fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.307+0000 7f0374f7a700 1 --2- 172.21.15.64:0/2718459072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03700faed0 0x7f03700fb2e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.307+0000 7f0374f7a700 1 -- 172.21.15.64:0/2718459072 >> 172.21.15.64:0/2718459072 conn(0x7f03700f6950 msgr2=0x7f03700f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:41.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.308+0000 7f0374f7a700 1 -- 172.21.15.64:0/2718459072 shutdown_connections 2023-12-16T03:16:41.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.308+0000 7f0374f7a700 1 -- 172.21.15.64:0/2718459072 wait complete. 2023-12-16T03:16:41.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.309+0000 7f0374f7a700 1 Processor -- start 2023-12-16T03:16:41.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.309+0000 7f0374f7a700 1 -- start start 2023-12-16T03:16:41.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f0374f7a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03700faed0 0x7f03700fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:41.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f0374f7a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03700fdf60 0x7f03700fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:41.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f0374f7a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370111220 con 0x7f03700faed0 2023-12-16T03:16:41.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f0374f7a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370111390 con 0x7f03700fdf60 2023-12-16T03:16:41.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f036dd9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03700fdf60 0x7f03700fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:41.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f036dd9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03700fdf60 0x7f03700fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.64:60720/0 (socket says 172.21.15.64:60720) 2023-12-16T03:16:41.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f036dd9b700 1 -- 172.21.15.64:0/942614537 learned_addr learned my addr 172.21.15.64:0/942614537 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:41.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f036dd9b700 1 -- 172.21.15.64:0/942614537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03700faed0 msgr2=0x7f03700fd9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:16:41.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f036dd9b700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03700faed0 0x7f03700fd9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f036dd9b700 1 -- 172.21.15.64:0/942614537 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0360005040 con 0x7f03700fdf60 2023-12-16T03:16:41.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f036dd9b700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03700fdf60 0x7f03700fbe70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f036400eb40 tx=0x7f036400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:41.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.310+0000 7f035effd700 1 -- 172.21.15.64:0/942614537 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0364007cc0 con 0x7f03700fdf60 2023-12-16T03:16:41.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.311+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0370111610 con 0x7f03700fdf60 2023-12-16T03:16:41.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.311+0000 7f035effd700 1 -- 172.21.15.64:0/942614537 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f036400f040 con 0x7f03700fdf60 2023-12-16T03:16:41.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.311+0000 7f035effd700 1 -- 172.21.15.64:0/942614537 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0364009570 con 0x7f03700fdf60 2023-12-16T03:16:41.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.311+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0370111b50 con 0x7f03700fdf60 2023-12-16T03:16:41.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.312+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037004bb80 con 0x7f03700fdf60 2023-12-16T03:16:41.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.312+0000 7f035effd700 1 -- 172.21.15.64:0/942614537 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f03640096d0 con 0x7f03700fdf60 2023-12-16T03:16:41.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.313+0000 7f035effd700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f035806af10 0x7f035806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:41.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.313+0000 7f035effd700 1 -- 172.21.15.64:0/942614537 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f03640893c0 con 0x7f03700fdf60 2023-12-16T03:16:41.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.315+0000 7f036e59c700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f035806af10 0x7f035806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:41.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.315+0000 7f036e59c700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f035806af10 0x7f035806d3c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f036000b0d0 tx=0x7f0360009e30 comp rx=0 tx=0).ready entity=mgr.14582 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:41.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.318+0000 7f035effd700 1 -- 172.21.15.64:0/942614537 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f036404ece0 con 0x7f03700fdf60 2023-12-16T03:16:41.448 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:41 smithi064 ceph-mon[111958]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:41.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:41 smithi184 ceph-mon[121180]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:41.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.763+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f03700fc3b0 con 0x7f03700fdf60 2023-12-16T03:16:41.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.763+0000 7f035effd700 1 -- 172.21.15.64:0/942614537 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7f03640571d0 con 0x7f03700fdf60 2023-12-16T03:16:41.765 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:16:41.765 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:16:41.765 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:16:41.765 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:16:41.765 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:16:41.765 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 13, 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:16:41.766 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:16:41.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.765+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f035806af10 msgr2=0x7f035806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:41.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.765+0000 7f0374f7a700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f035806af10 0x7f035806d3c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f036000b0d0 tx=0x7f0360009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:41.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.765+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03700fdf60 msgr2=0x7f03700fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:41.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.765+0000 7f0374f7a700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03700fdf60 0x7f03700fbe70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f036400eb40 tx=0x7f036400b040 comp rx=0 tx=0).stop 2023-12-16T03:16:41.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.766+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 shutdown_connections 2023-12-16T03:16:41.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.766+0000 7f0374f7a700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7f035806af10 0x7f035806d3c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.766+0000 7f0374f7a700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03700faed0 0x7f03700fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.766+0000 7f0374f7a700 1 --2- 172.21.15.64:0/942614537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03700fdf60 0x7f03700fbe70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.766+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 >> 172.21.15.64:0/942614537 conn(0x7f03700f6950 msgr2=0x7f0370101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:41.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.767+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 shutdown_connections 2023-12-16T03:16:41.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.767+0000 7f0374f7a700 1 -- 172.21.15.64:0/942614537 wait complete. 2023-12-16T03:16:41.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.877+0000 7fba91eca700 1 -- 172.21.15.64:0/3065248510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fcbf0 msgr2=0x7fba8c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.877+0000 7fba91eca700 1 --2- 172.21.15.64:0/3065248510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fcbf0 0x7fba8c0fd000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fba7c004940 tx=0x7fba7c009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.877+0000 7fba91eca700 1 -- 172.21.15.64:0/3065248510 shutdown_connections 2023-12-16T03:16:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.877+0000 7fba91eca700 1 --2- 172.21.15.64:0/3065248510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8c0fde00 0x7fba8c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.877+0000 7fba91eca700 1 --2- 172.21.15.64:0/3065248510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fcbf0 0x7fba8c0fd000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.877+0000 7fba91eca700 1 -- 172.21.15.64:0/3065248510 >> 172.21.15.64:0/3065248510 conn(0x7fba8c0f82d0 msgr2=0x7fba8c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.877+0000 7fba91eca700 1 -- 172.21.15.64:0/3065248510 shutdown_connections 2023-12-16T03:16:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.877+0000 7fba91eca700 1 -- 172.21.15.64:0/3065248510 wait complete. 2023-12-16T03:16:41.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.877+0000 7fba91eca700 1 Processor -- start 2023-12-16T03:16:41.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba91eca700 1 -- start start 2023-12-16T03:16:41.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba91eca700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8c0fcbf0 0x7fba8c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba91eca700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fde00 0x7fba8c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba91eca700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c10e010 con 0x7fba8c0fde00 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba91eca700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c10e8b0 con 0x7fba8c0fcbf0 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba8affd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fde00 0x7fba8c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba8affd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fde00 0x7fba8c10da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36372/0 (socket says 172.21.15.64:36372) 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba8affd700 1 -- 172.21.15.64:0/3639419965 learned_addr learned my addr 172.21.15.64:0/3639419965 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba8b7fe700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8c0fcbf0 0x7fba8c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba8affd700 1 -- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8c0fcbf0 msgr2=0x7fba8c10d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba8affd700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8c0fcbf0 0x7fba8c10d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba8affd700 1 -- 172.21.15.64:0/3639419965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c005040 con 0x7fba8c0fde00 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba8affd700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fde00 0x7fba8c10da10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fba8000eb40 tx=0x7fba8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.878+0000 7fba73fff700 1 -- 172.21.15.64:0/3639419965 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba80007cc0 con 0x7fba8c0fde00 2023-12-16T03:16:41.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.879+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c10eb30 con 0x7fba8c0fde00 2023-12-16T03:16:41.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.879+0000 7fba73fff700 1 -- 172.21.15.64:0/3639419965 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba8000f040 con 0x7fba8c0fde00 2023-12-16T03:16:41.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.879+0000 7fba73fff700 1 -- 172.21.15.64:0/3639419965 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8000c990 con 0x7fba8c0fde00 2023-12-16T03:16:41.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.879+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c10f070 con 0x7fba8c0fde00 2023-12-16T03:16:41.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.880+0000 7fba73fff700 1 -- 172.21.15.64:0/3639419965 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7fba8000cc00 con 0x7fba8c0fde00 2023-12-16T03:16:41.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.881+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c04bb80 con 0x7fba8c0fde00 2023-12-16T03:16:41.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.881+0000 7fba73fff700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fba7406ae40 0x7fba7406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:16:41.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.881+0000 7fba73fff700 1 -- 172.21.15.64:0/3639419965 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fba800893e0 con 0x7fba8c0fde00 2023-12-16T03:16:41.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.881+0000 7fba8b7fe700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fba7406ae40 0x7fba7406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:16:41.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.881+0000 7fba8b7fe700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fba7406ae40 0x7fba7406d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba7c013680 tx=0x7fba7c009e30 comp rx=0 tx=0).ready entity=mgr.14582 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:16:41.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:41.887+0000 7fba73fff700 1 -- 172.21.15.64:0/3639419965 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fba8004ece0 con 0x7fba8c0fde00 2023-12-16T03:16:42.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.182+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 --> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba8c10f4c0 con 0x7fba7406ae40 2023-12-16T03:16:42.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.184+0000 7fba73fff700 1 -- 172.21.15.64:0/3639419965 <== mgr.14582 v2:172.21.15.184:6828/2992718398 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fba8c10f4c0 con 0x7fba7406ae40 2023-12-16T03:16:42.189 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:16:42.189 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:16:42.189 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:16:42.189 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T03:16:42.189 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [], 2023-12-16T03:16:42.189 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "1/2 daemons upgraded", 2023-12-16T03:16:42.189 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2023-12-16T03:16:42.189 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:16:42.189 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:16:42.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.188+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fba7406ae40 msgr2=0x7fba7406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:42.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.188+0000 7fba91eca700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fba7406ae40 0x7fba7406d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba7c013680 tx=0x7fba7c009e30 comp rx=0 tx=0).stop 2023-12-16T03:16:42.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.188+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fde00 msgr2=0x7fba8c10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:16:42.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.188+0000 7fba91eca700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fde00 0x7fba8c10da10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fba8000eb40 tx=0x7fba8000b040 comp rx=0 tx=0).stop 2023-12-16T03:16:42.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.189+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 shutdown_connections 2023-12-16T03:16:42.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.189+0000 7fba91eca700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:6828/2992718398,v1:172.21.15.184:6829/2992718398] conn(0x7fba7406ae40 0x7fba7406d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:42.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.189+0000 7fba91eca700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8c0fcbf0 0x7fba8c10d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:42.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.189+0000 7fba91eca700 1 --2- 172.21.15.64:0/3639419965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba8c0fde00 0x7fba8c10da10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:16:42.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.189+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 >> 172.21.15.64:0/3639419965 conn(0x7fba8c0f82d0 msgr2=0x7fba8c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:16:42.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.189+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 shutdown_connections 2023-12-16T03:16:42.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:16:42.189+0000 7fba91eca700 1 -- 172.21.15.64:0/3639419965 wait complete. 2023-12-16T03:16:42.359 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:42 smithi064 ceph-mon[111958]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:42.359 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:42 smithi064 ceph-mon[111958]: pgmap v20: 65 pgs: 65 active+clean; 644 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 24 KiB/s rd, 2.1 MiB/s wr, 179 op/s 2023-12-16T03:16:42.359 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:42 smithi064 ceph-mon[111958]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:42.360 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:42 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/942614537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:16:42.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:42 smithi184 ceph-mon[121180]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:42.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:42 smithi184 ceph-mon[121180]: pgmap v20: 65 pgs: 65 active+clean; 644 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 24 KiB/s rd, 2.1 MiB/s wr, 179 op/s 2023-12-16T03:16:42.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:42 smithi184 ceph-mon[121180]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:42.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:42 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/942614537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:16:43.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:43 smithi064 ceph-mon[111958]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:43.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:43 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:43.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:43 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:43.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:43 smithi184 ceph-mon[121180]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:16:43.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:43 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:43.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:43 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:44.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:44 smithi064 ceph-mon[111958]: Reconfiguring prometheus.smithi064 (dependencies changed)... 2023-12-16T03:16:44.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:44 smithi064 ceph-mon[111958]: Reconfiguring daemon prometheus.smithi064 on smithi064 2023-12-16T03:16:44.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:44 smithi064 ceph-mon[111958]: pgmap v21: 65 pgs: 65 active+clean; 644 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 24 KiB/s rd, 2.1 MiB/s wr, 179 op/s 2023-12-16T03:16:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:44 smithi184 ceph-mon[121180]: Reconfiguring prometheus.smithi064 (dependencies changed)... 2023-12-16T03:16:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:44 smithi184 ceph-mon[121180]: Reconfiguring daemon prometheus.smithi064 on smithi064 2023-12-16T03:16:44.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:44 smithi184 ceph-mon[121180]: pgmap v21: 65 pgs: 65 active+clean; 644 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 24 KiB/s rd, 2.1 MiB/s wr, 179 op/s 2023-12-16T03:16:46.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:46 smithi064 ceph-mon[111958]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 3.1 MiB/s wr, 374 op/s 2023-12-16T03:16:46.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:46 smithi184 ceph-mon[121180]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 3.1 MiB/s wr, 374 op/s 2023-12-16T03:16:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:47 smithi184 ceph-mon[121180]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.2 MiB/s wr, 297 op/s 2023-12-16T03:16:47.580 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:47 smithi064 ceph-mon[111958]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.2 MiB/s wr, 297 op/s 2023-12-16T03:16:48.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:48 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:48.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:48 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:48.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:48 smithi184 ceph-mon[121180]: Reconfiguring node-exporter.smithi184 (dependencies changed)... 2023-12-16T03:16:48.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:48 smithi184 ceph-mon[121180]: Reconfiguring daemon node-exporter.smithi184 on smithi184 2023-12-16T03:16:49.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:48 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:49.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:48 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:49.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:48 smithi064 ceph-mon[111958]: Reconfiguring node-exporter.smithi184 (dependencies changed)... 2023-12-16T03:16:49.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:48 smithi064 ceph-mon[111958]: Reconfiguring daemon node-exporter.smithi184 on smithi184 2023-12-16T03:16:50.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:49 smithi184 ceph-mon[121180]: pgmap v24: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 3.1 MiB/s wr, 491 op/s 2023-12-16T03:16:50.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:49 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:50.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:49 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:50.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:49 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:16:50.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:49 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:16:50.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:49 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:16:50.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:49 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:50.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:49 smithi064 ceph-mon[111958]: pgmap v24: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 3.1 MiB/s wr, 491 op/s 2023-12-16T03:16:50.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:49 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:50.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:49 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:50.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:49 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:16:50.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:49 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:16:50.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:49 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:16:50.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:49 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:51.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:50 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:16:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:50 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:16:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:50 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:16:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:50 smithi184 ceph-mon[121180]: Upgrade: Need to upgrade myself (mgr.smithi184.urtxla) 2023-12-16T03:16:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:50 smithi184 ceph-mon[121180]: Upgrade: Need to upgrade myself (mgr.smithi184.urtxla) 2023-12-16T03:16:51.067 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:50 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:16:51.067 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:50 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:16:51.067 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:50 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:16:51.067 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:50 smithi064 ceph-mon[111958]: Upgrade: Need to upgrade myself (mgr.smithi184.urtxla) 2023-12-16T03:16:51.067 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:50 smithi064 ceph-mon[111958]: Upgrade: Need to upgrade myself (mgr.smithi184.urtxla) 2023-12-16T03:16:51.740 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:51 smithi064 ceph-mon[111958]: pgmap v25: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 388 op/s 2023-12-16T03:16:52.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:51 smithi184 ceph-mon[121180]: pgmap v25: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 388 op/s 2023-12-16T03:16:53.086 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:52 smithi064 ceph-mon[111958]: Upgrade: Updating mgr.smithi064.ueciyw 2023-12-16T03:16:53.086 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:52 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:53.086 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:52 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.ueciyw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:16:53.086 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:52 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:16:53.087 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:52 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:16:53.087 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:52 smithi064 ceph-mon[111958]: Deploying daemon mgr.smithi064.ueciyw on smithi064 2023-12-16T03:16:53.087 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:52 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:53.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:52 smithi184 ceph-mon[121180]: Upgrade: Updating mgr.smithi064.ueciyw 2023-12-16T03:16:53.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:52 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:53.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:52 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.ueciyw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:16:53.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:52 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:16:53.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:52 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:16:53.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:52 smithi184 ceph-mon[121180]: Deploying daemon mgr.smithi064.ueciyw on smithi064 2023-12-16T03:16:53.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:52 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:16:54.127 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:53 smithi064 ceph-mon[111958]: pgmap v26: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 388 op/s 2023-12-16T03:16:54.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:53 smithi184 ceph-mon[121180]: pgmap v26: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 388 op/s 2023-12-16T03:16:56.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:55 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:56.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:55 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:56.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:55 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:56.063 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:55 smithi184 ceph-mon[121180]: pgmap v27: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 60 KiB/s rd, 3.7 MiB/s wr, 589 op/s 2023-12-16T03:16:56.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:55 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:56.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:55 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:56.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:55 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:16:56.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:55 smithi064 ceph-mon[111958]: pgmap v27: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 60 KiB/s rd, 3.7 MiB/s wr, 589 op/s 2023-12-16T03:16:58.279 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:58 smithi064 ceph-mon[111958]: pgmap v28: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.7 MiB/s wr, 395 op/s 2023-12-16T03:16:58.279 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:58 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:58.279 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:16:58 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:58 smithi184 ceph-mon[121180]: pgmap v28: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.7 MiB/s wr, 395 op/s 2023-12-16T03:16:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:58 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:16:58.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:16:58 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:00.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:00 smithi064 ceph-mon[111958]: pgmap v29: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 3.9 MiB/s wr, 677 op/s 2023-12-16T03:17:00.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:00 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:00.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:00 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:00.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:00 smithi184 ceph-mon[121180]: pgmap v29: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 3.9 MiB/s wr, 677 op/s 2023-12-16T03:17:00.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:00 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:00.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:00 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:01.339 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:01 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:01.339 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:01 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:01.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:01 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:01.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:01 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:02.333 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:02 smithi064 ceph-mon[111958]: pgmap v30: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.9 MiB/s wr, 483 op/s 2023-12-16T03:17:02.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:02 smithi184 ceph-mon[121180]: pgmap v30: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.9 MiB/s wr, 483 op/s 2023-12-16T03:17:04.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:04 smithi064 ceph-mon[111958]: pgmap v31: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.9 MiB/s wr, 483 op/s 2023-12-16T03:17:04.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:04 smithi064 ceph-mon[111958]: Standby manager daemon smithi064.ueciyw restarted 2023-12-16T03:17:04.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:04 smithi064 ceph-mon[111958]: Standby manager daemon smithi064.ueciyw started 2023-12-16T03:17:04.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:04 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.ueciyw/crt"}]: dispatch 2023-12-16T03:17:04.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:04 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:17:04.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:04 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.ueciyw/key"}]: dispatch 2023-12-16T03:17:04.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:04 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:17:04.404 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:04 smithi184 ceph-mon[121180]: pgmap v31: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.9 MiB/s wr, 483 op/s 2023-12-16T03:17:04.404 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:04 smithi184 ceph-mon[121180]: Standby manager daemon smithi064.ueciyw restarted 2023-12-16T03:17:04.404 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:04 smithi184 ceph-mon[121180]: Standby manager daemon smithi064.ueciyw started 2023-12-16T03:17:04.404 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:04 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.ueciyw/crt"}]: dispatch 2023-12-16T03:17:04.404 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:04 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:17:04.404 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:04 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.ueciyw/key"}]: dispatch 2023-12-16T03:17:04.404 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:04 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: mgrmap e25: smithi184.urtxla(active, since 57s), standbys: smithi064.ueciyw 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mgr fail", "who": "smithi184.urtxla"}]: dispatch 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd='[{"prefix": "mgr fail", "who": "smithi184.urtxla"}]': finished 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: mgrmap e26: smithi064.ueciyw(active, starting, since 0.00804931s) 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:17:05.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.jaepzs"}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.edrjyd"}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.jfpiqk"}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.uqpwjn"}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: Manager daemon smithi064.ueciyw is now available 2023-12-16T03:17:05.445 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:05.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:05.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:17:05.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:17:05.446 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/trash_purge_schedule"}]: dispatch 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: mgrmap e25: smithi184.urtxla(active, since 57s), standbys: smithi064.ueciyw 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "mgr fail", "who": "smithi184.urtxla"}]: dispatch 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14582 172.21.15.184:0/3576566265' entity='mgr.smithi184.urtxla' cmd='[{"prefix": "mgr fail", "who": "smithi184.urtxla"}]': finished 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: mgrmap e26: smithi064.ueciyw(active, starting, since 0.00804931s) 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:17:05.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.jaepzs"}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.edrjyd"}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.jfpiqk"}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.uqpwjn"}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: Manager daemon smithi064.ueciyw is now available 2023-12-16T03:17:05.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:05.563 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:05.563 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:17:05.563 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:17:05.563 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/trash_purge_schedule"}]: dispatch 2023-12-16T03:17:06.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:06 smithi184 ceph-mon[121180]: [16/Dec/2023:03:17:04] ENGINE Bus STARTING 2023-12-16T03:17:06.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:06 smithi184 ceph-mon[121180]: [16/Dec/2023:03:17:05] ENGINE Serving on http://172.21.15.64:8765 2023-12-16T03:17:06.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:06 smithi184 ceph-mon[121180]: [16/Dec/2023:03:17:05] ENGINE Serving on https://172.21.15.64:7150 2023-12-16T03:17:06.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:06 smithi184 ceph-mon[121180]: [16/Dec/2023:03:17:05] ENGINE Bus STARTED 2023-12-16T03:17:06.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:06 smithi184 ceph-mon[121180]: mgrmap e27: smithi064.ueciyw(active, since 1.00839s) 2023-12-16T03:17:06.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:06 smithi184 ceph-mon[121180]: pgmap v3: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:17:06.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:06 smithi064 ceph-mon[111958]: [16/Dec/2023:03:17:04] ENGINE Bus STARTING 2023-12-16T03:17:06.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:06 smithi064 ceph-mon[111958]: [16/Dec/2023:03:17:05] ENGINE Serving on http://172.21.15.64:8765 2023-12-16T03:17:06.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:06 smithi064 ceph-mon[111958]: [16/Dec/2023:03:17:05] ENGINE Serving on https://172.21.15.64:7150 2023-12-16T03:17:06.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:06 smithi064 ceph-mon[111958]: [16/Dec/2023:03:17:05] ENGINE Bus STARTED 2023-12-16T03:17:06.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:06 smithi064 ceph-mon[111958]: mgrmap e27: smithi064.ueciyw(active, since 1.00839s) 2023-12-16T03:17:06.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:06 smithi064 ceph-mon[111958]: pgmap v3: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:17:07.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:07 smithi064 ceph-mon[111958]: pgmap v4: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:17:07.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:07 smithi064 ceph-mon[111958]: mgrmap e28: smithi064.ueciyw(active, since 2s) 2023-12-16T03:17:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:07 smithi184 ceph-mon[121180]: pgmap v4: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:17:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:07 smithi184 ceph-mon[121180]: mgrmap e28: smithi064.ueciyw(active, since 2s) 2023-12-16T03:17:08.788 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:08 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:08.789 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:08 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:08.789 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:08 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:08.789 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:08 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:08.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:08 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:08.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:08 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:08.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:08 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:08.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:08 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:09.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:09 smithi184 ceph-mon[121180]: pgmap v5: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:17:09.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:09 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:09.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:09 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:09.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:09 smithi184 ceph-mon[121180]: mgrmap e29: smithi064.ueciyw(active, since 4s) 2023-12-16T03:17:09.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:09 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:09.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:09 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:09.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:09 smithi064 ceph-mon[111958]: pgmap v5: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:17:09.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:09 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:09.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:09 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:09.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:09 smithi064 ceph-mon[111958]: mgrmap e29: smithi064.ueciyw(active, since 4s) 2023-12-16T03:17:09.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:09 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:09.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:09 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:11.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:11 smithi184 ceph-mon[121180]: pgmap v6: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 33 KiB/s wr, 72 op/s 2023-12-16T03:17:11.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:11 smithi064 ceph-mon[111958]: pgmap v6: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 33 KiB/s wr, 72 op/s 2023-12-16T03:17:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.332+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2016030762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 msgr2=0x7f54a40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.332+0000 7f54ab0ec700 1 --2- 172.21.15.64:0/2016030762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 0x7f54a40fd150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5490004880 tx=0x7f5490009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.333+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2016030762 shutdown_connections 2023-12-16T03:17:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.333+0000 7f54ab0ec700 1 --2- 172.21.15.64:0/2016030762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 0x7f54a40fd150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.333+0000 7f54ab0ec700 1 --2- 172.21.15.64:0/2016030762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54a40fbaf0 0x7f54a40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.333+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2016030762 >> 172.21.15.64:0/2016030762 conn(0x7f54a40f71d0 msgr2=0x7f54a40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.333+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2016030762 shutdown_connections 2023-12-16T03:17:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.333+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2016030762 wait complete. 2023-12-16T03:17:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.334+0000 7f54ab0ec700 1 Processor -- start 2023-12-16T03:17:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.335+0000 7f54ab0ec700 1 -- start start 2023-12-16T03:17:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.335+0000 7f54ab0ec700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54a40fbaf0 0x7f54a410c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.335+0000 7f54ab0ec700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 0x7f54a410c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.335+0000 7f54ab0ec700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a410cf00 con 0x7f54a40fbaf0 2023-12-16T03:17:12.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.335+0000 7f54ab0ec700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a410d7a0 con 0x7f54a40fcd00 2023-12-16T03:17:12.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.335+0000 7f54a3fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 0x7f54a410c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.335+0000 7f54a3fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 0x7f54a410c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.64:49446/0 (socket says 172.21.15.64:49446) 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.335+0000 7f54a3fff700 1 -- 172.21.15.64:0/2452487572 learned_addr learned my addr 172.21.15.64:0/2452487572 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.335+0000 7f54a8e88700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54a40fbaf0 0x7f54a410c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.336+0000 7f54a3fff700 1 -- 172.21.15.64:0/2452487572 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54a40fbaf0 msgr2=0x7f54a410c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.336+0000 7f54a3fff700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54a40fbaf0 0x7f54a410c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.336+0000 7f54a3fff700 1 -- 172.21.15.64:0/2452487572 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5498005040 con 0x7f54a40fcd00 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.336+0000 7f54a3fff700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 0x7f54a410c900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5490009360 tx=0x7f5490009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.336+0000 7f54a17fa700 1 -- 172.21.15.64:0/2452487572 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f549000e030 con 0x7f54a40fcd00 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.336+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5490005040 con 0x7f54a40fcd00 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.336+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a410dd50 con 0x7f54a40fcd00 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.336+0000 7f54a17fa700 1 -- 172.21.15.64:0/2452487572 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f549001a450 con 0x7f54a40fcd00 2023-12-16T03:17:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.336+0000 7f54a17fa700 1 -- 172.21.15.64:0/2452487572 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5490022610 con 0x7f54a40fcd00 2023-12-16T03:17:12.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.337+0000 7f54a17fa700 1 -- 172.21.15.64:0/2452487572 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 29) v1 ==== 45728+0+0 (secure 0 0 0) 0x7f5490022880 con 0x7f54a40fcd00 2023-12-16T03:17:12.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.337+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54880052e0 con 0x7f54a40fcd00 2023-12-16T03:17:12.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.338+0000 7f54a17fa700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f5494038760 0x7f549403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.338+0000 7f54a17fa700 1 -- 172.21.15.64:0/2452487572 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f549004d8e0 con 0x7f54a40fcd00 2023-12-16T03:17:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.338+0000 7f54a8e88700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f5494038760 0x7f549403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.338+0000 7f54a8e88700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f5494038760 0x7f549403ac10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54a40fcb60 tx=0x7f549800b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.343+0000 7f54a17fa700 1 -- 172.21.15.64:0/2452487572 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f549002b910 con 0x7f54a40fcd00 2023-12-16T03:17:12.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.592+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5488000bf0 con 0x7f5494038760 2023-12-16T03:17:12.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.593+0000 7f54a17fa700 1 -- 172.21.15.64:0/2452487572 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f5488000bf0 con 0x7f5494038760 2023-12-16T03:17:12.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f5494038760 msgr2=0x7f549403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f5494038760 0x7f549403ac10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54a40fcb60 tx=0x7f549800b040 comp rx=0 tx=0).stop 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 msgr2=0x7f54a410c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 0x7f54a410c900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5490009360 tx=0x7f5490009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 shutdown_connections 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f5494038760 0x7f549403ac10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54a40fbaf0 0x7f54a410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 --2- 172.21.15.64:0/2452487572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54a40fcd00 0x7f54a410c900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 >> 172.21.15.64:0/2452487572 conn(0x7f54a40f71d0 msgr2=0x7f54a40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 shutdown_connections 2023-12-16T03:17:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.596+0000 7f54ab0ec700 1 -- 172.21.15.64:0/2452487572 wait complete. 2023-12-16T03:17:12.612 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:17:12.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.725+0000 7fbcd3468700 1 -- 172.21.15.64:0/343625185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 msgr2=0x7fbccc0fd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:12.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.725+0000 7fbcd3468700 1 --2- 172.21.15.64:0/343625185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 0x7fbccc0fd4b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8004940 tx=0x7fbcc8009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:12.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.726+0000 7fbcd3468700 1 -- 172.21.15.64:0/343625185 shutdown_connections 2023-12-16T03:17:12.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.726+0000 7fbcd3468700 1 --2- 172.21.15.64:0/343625185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbccc0fbdf0 0x7fbccc0fc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:12.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.726+0000 7fbcd3468700 1 --2- 172.21.15.64:0/343625185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 0x7fbccc0fd4b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:12.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.726+0000 7fbcd3468700 1 -- 172.21.15.64:0/343625185 >> 172.21.15.64:0/343625185 conn(0x7fbccc0f6950 msgr2=0x7fbccc0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:12.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.726+0000 7fbcd3468700 1 -- 172.21.15.64:0/343625185 shutdown_connections 2023-12-16T03:17:12.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.726+0000 7fbcd3468700 1 -- 172.21.15.64:0/343625185 wait complete. 2023-12-16T03:17:12.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.726+0000 7fbcd3468700 1 Processor -- start 2023-12-16T03:17:12.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd3468700 1 -- start start 2023-12-16T03:17:12.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd3468700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbccc0fbdf0 0x7fbccc110240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:12.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd3468700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 0x7fbccc112790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:12.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd3468700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0fba80 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd3468700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0fbbc0 con 0x7fbccc0fbdf0 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd0a03700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 0x7fbccc112790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd0a03700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 0x7fbccc112790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35398/0 (socket says 172.21.15.64:35398) 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd1204700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbccc0fbdf0 0x7fbccc110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd0a03700 1 -- 172.21.15.64:0/247051374 learned_addr learned my addr 172.21.15.64:0/247051374 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd0a03700 1 -- 172.21.15.64:0/247051374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbccc0fbdf0 msgr2=0x7fbccc110240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd0a03700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbccc0fbdf0 0x7fbccc110240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd0a03700 1 -- 172.21.15.64:0/247051374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8005040 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.727+0000 7fbcd0a03700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 0x7fbccc112790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00eb40 tx=0x7fbcbc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.728+0000 7fbcc1ffb700 1 -- 172.21.15.64:0/247051374 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc007cc0 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.728+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc112d90 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.728+0000 7fbcc1ffb700 1 -- 172.21.15.64:0/247051374 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbcbc00f040 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.728+0000 7fbcc1ffb700 1 -- 172.21.15.64:0/247051374 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc00c990 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.728+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc1132a0 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.729+0000 7fbcc1ffb700 1 -- 172.21.15.64:0/247051374 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 29) v1 ==== 45728+0+0 (secure 0 0 0) 0x7fbcbc00cc00 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.729+0000 7fbcc1ffb700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fbcb8038760 0x7fbcb803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:12.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.729+0000 7fbcc1ffb700 1 -- 172.21.15.64:0/247051374 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbcbc04c050 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.729+0000 7fbcd1204700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fbcb8038760 0x7fbcb803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:12.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.729+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc04bb80 con 0x7fbccc0fd0a0 2023-12-16T03:17:12.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.730+0000 7fbcd1204700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fbcb8038760 0x7fbcb803ac10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009fd0 tx=0x7fbcc8009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:12.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:12.734+0000 7fbcc1ffb700 1 -- 172.21.15.64:0/247051374 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbcbc019020 con 0x7fbccc0fd0a0 2023-12-16T03:17:13.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.054+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbccc101750 con 0x7fbcb8038760 2023-12-16T03:17:13.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.055+0000 7fbcc1ffb700 1 -- 172.21.15.64:0/247051374 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fbccc101750 con 0x7fbcb8038760 2023-12-16T03:17:13.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.057+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fbcb8038760 msgr2=0x7fbcb803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:13.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.057+0000 7fbcd3468700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fbcb8038760 0x7fbcb803ac10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009fd0 tx=0x7fbcc8009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:13.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.057+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 msgr2=0x7fbccc112790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:13.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.057+0000 7fbcd3468700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 0x7fbccc112790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00eb40 tx=0x7fbcbc00b040 comp rx=0 tx=0).stop 2023-12-16T03:17:13.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.058+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 shutdown_connections 2023-12-16T03:17:13.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.058+0000 7fbcd3468700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fbcb8038760 0x7fbcb803ac10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.058+0000 7fbcd3468700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbccc0fbdf0 0x7fbccc110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.058+0000 7fbcd3468700 1 --2- 172.21.15.64:0/247051374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbccc0fd0a0 0x7fbccc112790 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.058+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 >> 172.21.15.64:0/247051374 conn(0x7fbccc0f6950 msgr2=0x7fbccc100030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:13.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.058+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 shutdown_connections 2023-12-16T03:17:13.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.058+0000 7fbcd3468700 1 -- 172.21.15.64:0/247051374 wait complete. 2023-12-16T03:17:13.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.197+0000 7fca62c78700 1 -- 172.21.15.64:0/3876318495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fbd50 msgr2=0x7fca5c0fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:13.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.197+0000 7fca62c78700 1 --2- 172.21.15.64:0/3876318495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fbd50 0x7fca5c0fc1c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fca48004940 tx=0x7fca48009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:13.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.197+0000 7fca62c78700 1 -- 172.21.15.64:0/3876318495 shutdown_connections 2023-12-16T03:17:13.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.197+0000 7fca62c78700 1 --2- 172.21.15.64:0/3876318495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fbd50 0x7fca5c0fc1c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.197+0000 7fca62c78700 1 --2- 172.21.15.64:0/3876318495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca5c0fd0e0 0x7fca5c0fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.197+0000 7fca62c78700 1 -- 172.21.15.64:0/3876318495 >> 172.21.15.64:0/3876318495 conn(0x7fca5c0f6950 msgr2=0x7fca5c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:13.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.197+0000 7fca62c78700 1 -- 172.21.15.64:0/3876318495 shutdown_connections 2023-12-16T03:17:13.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.197+0000 7fca62c78700 1 -- 172.21.15.64:0/3876318495 wait complete. 2023-12-16T03:17:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.198+0000 7fca62c78700 1 Processor -- start 2023-12-16T03:17:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.198+0000 7fca62c78700 1 -- start start 2023-12-16T03:17:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.198+0000 7fca62c78700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca5c0fbd50 0x7fca5c10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.198+0000 7fca62c78700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fd0e0 0x7fca5c10db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.198+0000 7fca62c78700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c10e100 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.198+0000 7fca62c78700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c10e9a0 con 0x7fca5c0fbd50 2023-12-16T03:17:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.199+0000 7fca5bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fd0e0 0x7fca5c10db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:13.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.199+0000 7fca5bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fd0e0 0x7fca5c10db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35410/0 (socket says 172.21.15.64:35410) 2023-12-16T03:17:13.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.199+0000 7fca5bfff700 1 -- 172.21.15.64:0/108250103 learned_addr learned my addr 172.21.15.64:0/108250103 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:13.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.199+0000 7fca60a14700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca5c0fbd50 0x7fca5c10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:13.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.199+0000 7fca5bfff700 1 -- 172.21.15.64:0/108250103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca5c0fbd50 msgr2=0x7fca5c10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:13.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.199+0000 7fca5bfff700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca5c0fbd50 0x7fca5c10d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.199+0000 7fca5bfff700 1 -- 172.21.15.64:0/108250103 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48005040 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.199+0000 7fca5bfff700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fd0e0 0x7fca5c10db00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fca48000c00 tx=0x7fca48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:13.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.199+0000 7fca597fa700 1 -- 172.21.15.64:0/108250103 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca4800e030 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.200+0000 7fca597fa700 1 -- 172.21.15.64:0/108250103 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca4801ed60 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.200+0000 7fca597fa700 1 -- 172.21.15.64:0/108250103 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca48023070 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.200+0000 7fca62c78700 1 -- 172.21.15.64:0/108250103 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5c10ec20 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.200+0000 7fca62c78700 1 -- 172.21.15.64:0/108250103 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c10f160 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.201+0000 7fca46ffd700 1 -- 172.21.15.64:0/108250103 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c0052b0 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.202+0000 7fca597fa700 1 -- 172.21.15.64:0/108250103 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 29) v1 ==== 45728+0+0 (secure 0 0 0) 0x7fca48013850 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.202+0000 7fca597fa700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fca4c038760 0x7fca4c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:13.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.202+0000 7fca597fa700 1 -- 172.21.15.64:0/108250103 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fca48055f30 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.205+0000 7fca60a14700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fca4c038760 0x7fca4c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:13.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.205+0000 7fca60a14700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fca4c038760 0x7fca4c03ac10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca50009b80 tx=0x7fca5000b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:13.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.208+0000 7fca597fa700 1 -- 172.21.15.64:0/108250103 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fca48029470 con 0x7fca5c0fd0e0 2023-12-16T03:17:13.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.543+0000 7fca46ffd700 1 -- 172.21.15.64:0/108250103 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fca3c000bc0 con 0x7fca4c038760 2023-12-16T03:17:13.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.555+0000 7fca597fa700 1 -- 172.21.15.64:0/108250103 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fca3c000bc0 con 0x7fca4c038760 2023-12-16T03:17:13.556 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:17:13.556 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (45s) 5s ago 7m 18.9M - 0.25.0 c8568f914cd2 47a34ff6100b 2023-12-16T03:17:13.556 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (7m) 5s ago 7m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:17:13.556 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (6m) 6s ago 6m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:17:13.556 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (31s) 5s ago 6m 80.6M - 9.4.7 954c08fa6188 8d5bf4bb96ea 2023-12-16T03:17:13.556 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (3m) 5s ago 3m 13.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (3m) 5s ago 3m 5314M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (3m) 6s ago 3m 3912M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (3m) 6s ago 3m 14.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (19s) 5s ago 8m 477M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283 running (78s) 6s ago 6m 71.7M - 19.0.0-191-g6d933094 a29c258b5d6f 5067afd9ddca 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (8m) 5s ago 8m 86.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (6m) 6s ago 6m 58.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (49s) 5s ago 7m 18.6M - 1.5.0 0da6a335fe13 e3a96162cefc 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (24s) 6s ago 6m 8522k - 1.5.0 0da6a335fe13 505a909ac074 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (5m) 5s ago 5m 656M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (5m) 5s ago 5m 720M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (5m) 5s ago 5m 542M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (4m) 6s ago 4m 828M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (4m) 6s ago 4m 667M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:17:13.557 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (4m) 6s ago 4m 732M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:17:13.558 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (27s) 5s ago 6m 43.0M - 2.43.0 a07b618ecd1d 044dc60386ec 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 -- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fca4c038760 msgr2=0x7fca4c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fca4c038760 0x7fca4c03ac10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca50009b80 tx=0x7fca5000b040 comp rx=0 tx=0).stop 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 -- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fd0e0 msgr2=0x7fca5c10db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fd0e0 0x7fca5c10db00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fca48000c00 tx=0x7fca48009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 -- 172.21.15.64:0/108250103 shutdown_connections 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fca4c038760 0x7fca4c03ac10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca5c0fbd50 0x7fca5c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 --2- 172.21.15.64:0/108250103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca5c0fd0e0 0x7fca5c10db00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 -- 172.21.15.64:0/108250103 >> 172.21.15.64:0/108250103 conn(0x7fca5c0f6950 msgr2=0x7fca5c0fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 -- 172.21.15.64:0/108250103 shutdown_connections 2023-12-16T03:17:13.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.558+0000 7fca46ffd700 1 -- 172.21.15.64:0/108250103 wait complete. 2023-12-16T03:17:13.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.711+0000 7f4bf668f700 1 -- 172.21.15.64:0/3661953205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bf0107560 msgr2=0x7f4bf0109940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:13.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.711+0000 7f4bf668f700 1 --2- 172.21.15.64:0/3661953205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bf0107560 0x7f4bf0109940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004940 tx=0x7f4be4009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:13.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.711+0000 7f4bf668f700 1 -- 172.21.15.64:0/3661953205 shutdown_connections 2023-12-16T03:17:13.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.711+0000 7f4bf668f700 1 --2- 172.21.15.64:0/3661953205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bf0107560 0x7f4bf0109940 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.711+0000 7f4bf668f700 1 --2- 172.21.15.64:0/3661953205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0104c40 0x7f4bf0107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.711+0000 7f4bf668f700 1 -- 172.21.15.64:0/3661953205 >> 172.21.15.64:0/3661953205 conn(0x7f4bf0069b20 msgr2=0x7f4bf006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:13.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.711+0000 7f4bf668f700 1 -- 172.21.15.64:0/3661953205 shutdown_connections 2023-12-16T03:17:13.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.711+0000 7f4bf668f700 1 -- 172.21.15.64:0/3661953205 wait complete. 2023-12-16T03:17:13.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.712+0000 7f4bf668f700 1 Processor -- start 2023-12-16T03:17:13.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.712+0000 7f4bf668f700 1 -- start start 2023-12-16T03:17:13.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.712+0000 7f4bf668f700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bf0104c40 0x7f4bf0113a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:13.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.712+0000 7f4bf668f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0107560 0x7f4bf0113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:13.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.712+0000 7f4bf668f700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf01145d0 con 0x7f4bf0104c40 2023-12-16T03:17:13.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.712+0000 7f4bf668f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf0114e90 con 0x7f4bf0107560 2023-12-16T03:17:13.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.713+0000 7f4bef7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0107560 0x7f4bf0113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:13.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.713+0000 7f4bef7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0107560 0x7f4bf0113f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.64:52850/0 (socket says 172.21.15.64:52850) 2023-12-16T03:17:13.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.713+0000 7f4bef7fe700 1 -- 172.21.15.64:0/606271117 learned_addr learned my addr 172.21.15.64:0/606271117 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:13.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.713+0000 7f4beffff700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bf0104c40 0x7f4bf0113a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:13.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.713+0000 7f4bef7fe700 1 -- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bf0104c40 msgr2=0x7f4bf0113a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:13.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.713+0000 7f4bef7fe700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bf0104c40 0x7f4bf0113a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:13.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.713+0000 7f4bef7fe700 1 -- 172.21.15.64:0/606271117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4005040 con 0x7f4bf0107560 2023-12-16T03:17:13.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.713+0000 7f4beffff700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bf0104c40 0x7f4bf0113a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:17:13.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.716+0000 7f4bef7fe700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0107560 0x7f4bf0113f80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004890 tx=0x7f4be4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:13.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.716+0000 7f4becff9700 1 -- 172.21.15.64:0/606271117 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be400e070 con 0x7f4bf0107560 2023-12-16T03:17:13.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.716+0000 7f4becff9700 1 -- 172.21.15.64:0/606271117 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4be4004290 con 0x7f4bf0107560 2023-12-16T03:17:13.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.716+0000 7f4becff9700 1 -- 172.21.15.64:0/606271117 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be400b410 con 0x7f4bf0107560 2023-12-16T03:17:13.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.716+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf0115110 con 0x7f4bf0107560 2023-12-16T03:17:13.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.716+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf01155f0 con 0x7f4bf0107560 2023-12-16T03:17:13.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.717+0000 7f4becff9700 1 -- 172.21.15.64:0/606271117 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 29) v1 ==== 45728+0+0 (secure 0 0 0) 0x7f4be400b570 con 0x7f4bf0107560 2023-12-16T03:17:13.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.718+0000 7f4becff9700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f4bd80387b0 0x7f4bd803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:13.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.718+0000 7f4becff9700 1 -- 172.21.15.64:0/606271117 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4be404db70 con 0x7f4bf0107560 2023-12-16T03:17:13.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.718+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf004bb80 con 0x7f4bf0107560 2023-12-16T03:17:13.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.719+0000 7f4beffff700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f4bd80387b0 0x7f4bd803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:13.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.720+0000 7f4beffff700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f4bd80387b0 0x7f4bd803ac60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4be0007fd0 tx=0x7f4be000b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:13.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.726+0000 7f4becff9700 1 -- 172.21.15.64:0/606271117 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4be400b960 con 0x7f4bf0107560 2023-12-16T03:17:13.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:13.752+0000 7f4becff9700 1 -- 172.21.15.64:0/606271117 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mgrmap(e 30) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f4be401c400 con 0x7f4bf0107560 2023-12-16T03:17:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: pgmap v7: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 304 op/s 2023-12-16T03:17:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/2431367475' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/2431367475' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/2431367475' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:17:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:13 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/2431367475' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:17:14.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.143+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4bf010ffd0 con 0x7f4bf0107560 2023-12-16T03:17:14.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.144+0000 7f4becff9700 1 -- 172.21.15.64:0/606271117 <== mon.1 v2:172.21.15.184:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f4be405da80 con 0x7f4bf0107560 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:17:14.146 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:17:14.147 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:17:14.147 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T03:17:14.147 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:17:14.147 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:17:14.147 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.146+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f4bd80387b0 msgr2=0x7f4bd803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.146+0000 7f4bf668f700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f4bd80387b0 0x7f4bd803ac60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4be0007fd0 tx=0x7f4be000b040 comp rx=0 tx=0).stop 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.146+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0107560 msgr2=0x7f4bf0113f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.146+0000 7f4bf668f700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0107560 0x7f4bf0113f80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004890 tx=0x7f4be4009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.147+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 shutdown_connections 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.147+0000 7f4bf668f700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f4bd80387b0 0x7f4bd803ac60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.147+0000 7f4bf668f700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bf0104c40 0x7f4bf0113a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.147+0000 7f4bf668f700 1 --2- 172.21.15.64:0/606271117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bf0107560 0x7f4bf0113f80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.147+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 >> 172.21.15.64:0/606271117 conn(0x7f4bf0069b20 msgr2=0x7f4bf006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.147+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 shutdown_connections 2023-12-16T03:17:14.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.147+0000 7f4bf668f700 1 -- 172.21.15.64:0/606271117 wait complete. 2023-12-16T03:17:14.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: pgmap v7: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 304 op/s 2023-12-16T03:17:14.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:14.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/2431367475' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/2431367475' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/2431367475' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:17:14.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:13 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/2431367475' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:17:14.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.281+0000 7f00d45d7700 1 -- 172.21.15.64:0/3710425096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 msgr2=0x7f00cc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.281+0000 7f00d45d7700 1 --2- 172.21.15.64:0/3710425096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 0x7f00cc0fe250 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f00bc004940 tx=0x7f00bc009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.281+0000 7f00d45d7700 1 -- 172.21.15.64:0/3710425096 shutdown_connections 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.281+0000 7f00d45d7700 1 --2- 172.21.15.64:0/3710425096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 0x7f00cc0fe250 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.281+0000 7f00d45d7700 1 --2- 172.21.15.64:0/3710425096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00cc0fcbf0 0x7f00cc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.281+0000 7f00d45d7700 1 -- 172.21.15.64:0/3710425096 >> 172.21.15.64:0/3710425096 conn(0x7f00cc0f82d0 msgr2=0x7f00cc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.281+0000 7f00d45d7700 1 -- 172.21.15.64:0/3710425096 shutdown_connections 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.281+0000 7f00d45d7700 1 -- 172.21.15.64:0/3710425096 wait complete. 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d45d7700 1 Processor -- start 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d45d7700 1 -- start start 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d45d7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00cc0fcbf0 0x7f00cc10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d45d7700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 0x7f00cc10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:14.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d45d7700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc10e030 con 0x7f00cc0fde00 2023-12-16T03:17:14.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d45d7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc10e8d0 con 0x7f00cc0fcbf0 2023-12-16T03:17:14.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d1b72700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 0x7f00cc10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:14.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d1b72700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 0x7f00cc10da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:35434/0 (socket says 172.21.15.64:35434) 2023-12-16T03:17:14.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d1b72700 1 -- 172.21.15.64:0/3505566168 learned_addr learned my addr 172.21.15.64:0/3505566168 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.282+0000 7f00d2373700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00cc0fcbf0 0x7f00cc10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.283+0000 7f00d1b72700 1 -- 172.21.15.64:0/3505566168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00cc0fcbf0 msgr2=0x7f00cc10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.283+0000 7f00d1b72700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00cc0fcbf0 0x7f00cc10d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.283+0000 7f00d1b72700 1 -- 172.21.15.64:0/3505566168 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8005040 con 0x7f00cc0fde00 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.283+0000 7f00d1b72700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 0x7f00cc10da30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f00bc000c00 tx=0x7f00bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.283+0000 7f00c2ffd700 1 -- 172.21.15.64:0/3505566168 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00bc021070 con 0x7f00cc0fde00 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.283+0000 7f00c2ffd700 1 -- 172.21.15.64:0/3505566168 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f00bc01c400 con 0x7f00cc0fde00 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.283+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc005040 con 0x7f00cc0fde00 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.283+0000 7f00c2ffd700 1 -- 172.21.15.64:0/3505566168 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00bc00e070 con 0x7f00cc0fde00 2023-12-16T03:17:14.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.283+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc10eea0 con 0x7f00cc0fde00 2023-12-16T03:17:14.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.285+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc04bb80 con 0x7f00cc0fde00 2023-12-16T03:17:14.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.286+0000 7f00c2ffd700 1 -- 172.21.15.64:0/3505566168 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 30) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f00bc01c9c0 con 0x7f00cc0fde00 2023-12-16T03:17:14.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.287+0000 7f00c2ffd700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f00b806cc00 0x7f00b806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:14.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.287+0000 7f00c2ffd700 1 -- 172.21.15.64:0/3505566168 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f00bc08d380 con 0x7f00cc0fde00 2023-12-16T03:17:14.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.287+0000 7f00d2373700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f00b806cc00 0x7f00b806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:14.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.288+0000 7f00d2373700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f00b806cc00 0x7f00b806f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0fdc60 tx=0x7f00c800b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:14.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.294+0000 7f00c2ffd700 1 -- 172.21.15.64:0/3505566168 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f00bc05b170 con 0x7f00cc0fde00 2023-12-16T03:17:14.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.598+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00cc10f380 con 0x7f00b806cc00 2023-12-16T03:17:14.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.609+0000 7f00c2ffd700 1 -- 172.21.15.64:0/3505566168 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f00cc10f380 con 0x7f00b806cc00 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "", 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:17:14.611 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:17:14.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.611+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f00b806cc00 msgr2=0x7f00b806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:14.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.611+0000 7f00d45d7700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f00b806cc00 0x7f00b806f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0fdc60 tx=0x7f00c800b040 comp rx=0 tx=0).stop 2023-12-16T03:17:14.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.611+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 msgr2=0x7f00cc10da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:14.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.611+0000 7f00d45d7700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 0x7f00cc10da30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f00bc000c00 tx=0x7f00bc009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:14.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.611+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 shutdown_connections 2023-12-16T03:17:14.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.611+0000 7f00d45d7700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f00b806cc00 0x7f00b806f0b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:14.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.611+0000 7f00d45d7700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00cc0fcbf0 0x7f00cc10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:14.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.611+0000 7f00d45d7700 1 --2- 172.21.15.64:0/3505566168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00cc0fde00 0x7f00cc10da30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:14.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.611+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 >> 172.21.15.64:0/3505566168 conn(0x7f00cc0f82d0 msgr2=0x7f00cc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:14.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.612+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 shutdown_connections 2023-12-16T03:17:14.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:14.612+0000 7f00d45d7700 1 -- 172.21.15.64:0/3505566168 wait complete. 2023-12-16T03:17:15.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:17:15.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:15.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:17:15.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: mgrmap e30: smithi064.ueciyw(active, since 9s), standbys: smithi184.urtxla 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi184.urtxla", "id": "smithi184.urtxla"}]: dispatch 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:14 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/606271117' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:15.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: mgrmap e30: smithi064.ueciyw(active, since 9s), standbys: smithi184.urtxla 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi184.urtxla", "id": "smithi184.urtxla"}]: dispatch 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:15.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:14 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/606271117' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:15.760 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:15 smithi064 ceph-mon[111958]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:17:15.761 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:15 smithi064 ceph-mon[111958]: Reconfiguring prometheus.smithi064 (dependencies changed)... 2023-12-16T03:17:15.761 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:15 smithi064 ceph-mon[111958]: pgmap v8: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 896 KiB/s wr, 237 op/s 2023-12-16T03:17:15.761 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:15 smithi064 ceph-mon[111958]: Reconfiguring daemon prometheus.smithi064 on smithi064 2023-12-16T03:17:15.761 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:15 smithi064 ceph-mon[111958]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:16.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:15 smithi184 ceph-mon[121180]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:17:16.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:15 smithi184 ceph-mon[121180]: Reconfiguring prometheus.smithi064 (dependencies changed)... 2023-12-16T03:17:16.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:15 smithi184 ceph-mon[121180]: pgmap v8: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 896 KiB/s wr, 237 op/s 2023-12-16T03:17:16.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:15 smithi184 ceph-mon[121180]: Reconfiguring daemon prometheus.smithi064 on smithi064 2023-12-16T03:17:16.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:15 smithi184 ceph-mon[121180]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:17.598 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:17 smithi064 ceph-mon[111958]: pgmap v9: 65 pgs: 65 active+clean; 324 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.8 MiB/s wr, 358 op/s 2023-12-16T03:17:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:17 smithi184 ceph-mon[121180]: pgmap v9: 65 pgs: 65 active+clean; 324 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.8 MiB/s wr, 358 op/s 2023-12-16T03:17:18.927 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:18 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:18.927 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:18 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:18.927 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:18 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:17:18.927 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:18 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:17:18.927 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:18 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:18.927 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:18 smithi184 ceph-mon[121180]: pgmap v10: 65 pgs: 65 active+clean; 324 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.7 MiB/s wr, 328 op/s 2023-12-16T03:17:19.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:18 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:19.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:18 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:19.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:18 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:17:19.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:18 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:17:19.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:18 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:19.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:18 smithi064 ceph-mon[111958]: pgmap v10: 65 pgs: 65 active+clean; 324 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.7 MiB/s wr, 328 op/s 2023-12-16T03:17:20.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:19 smithi184 ceph-mon[121180]: Upgrade: Updating mgr.smithi184.urtxla 2023-12-16T03:17:20.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:19 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:17:20.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:19 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:17:20.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:19 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:20.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:19 smithi184 ceph-mon[121180]: Deploying daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:17:20.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:19 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:17:20.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:19 smithi064 ceph-mon[111958]: Upgrade: Updating mgr.smithi184.urtxla 2023-12-16T03:17:20.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:19 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:17:20.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:19 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:17:20.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:19 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:20.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:19 smithi064 ceph-mon[111958]: Deploying daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:17:20.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:19 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:17:21.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:20 smithi184 ceph-mon[121180]: pgmap v11: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.7 MiB/s wr, 351 op/s 2023-12-16T03:17:21.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:20 smithi064 ceph-mon[111958]: pgmap v11: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.7 MiB/s wr, 351 op/s 2023-12-16T03:17:22.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:22 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:22.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:22 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:22.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:22 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:23.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:22 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:23.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:22 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:23.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:22 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:23.715 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:23 smithi064 ceph-mon[111958]: pgmap v12: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.4 MiB/s wr, 455 op/s 2023-12-16T03:17:24.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:23 smithi184 ceph-mon[121180]: pgmap v12: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.4 MiB/s wr, 455 op/s 2023-12-16T03:17:25.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:24 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:25.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:24 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:25.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:24 smithi184 ceph-mon[121180]: pgmap v13: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 307 op/s 2023-12-16T03:17:25.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:24 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:25.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:24 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:25.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:24 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:25.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:24 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:25.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:24 smithi064 ceph-mon[111958]: pgmap v13: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 307 op/s 2023-12-16T03:17:25.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:24 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:25.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:24 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:26.683 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:26 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:26.683 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:26 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:26.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:26 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:26.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:26 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:27.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:27 smithi184 ceph-mon[121180]: pgmap v14: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 452 op/s 2023-12-16T03:17:27.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:27 smithi064 ceph-mon[111958]: pgmap v14: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 452 op/s 2023-12-16T03:17:29.074 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-16T03:17:29.075 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-16T03:17:29.366 DEBUG:teuthology.parallel:result is None 2023-12-16T03:17:29.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:29 smithi064 ceph-mon[111958]: pgmap v15: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 301 op/s 2023-12-16T03:17:29.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:29 smithi064 ceph-mon[111958]: Standby manager daemon smithi184.urtxla restarted 2023-12-16T03:17:29.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:29 smithi064 ceph-mon[111958]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:17:29.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:29 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/1141489420' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:17:29.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:29 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/1141489420' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:17:29.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:29 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/1141489420' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:17:29.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:29 smithi064 ceph-mon[111958]: from='mgr.? 172.21.15.184:0/1141489420' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:17:30.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:29 smithi184 ceph-mon[121180]: pgmap v15: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 301 op/s 2023-12-16T03:17:30.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:29 smithi184 ceph-mon[121180]: Standby manager daemon smithi184.urtxla restarted 2023-12-16T03:17:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:29 smithi184 ceph-mon[121180]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:17:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:29 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/1141489420' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:17:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:29 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/1141489420' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:17:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:29 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/1141489420' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:17:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:29 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/1141489420' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:17:30.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: mgrmap e31: smithi064.ueciyw(active, since 25s), standbys: smithi184.urtxla 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.ueciyw"}]: dispatch 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.ueciyw"}]': finished 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi184.urtxla"}]: dispatch 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi184.urtxla"}]': finished 2023-12-16T03:17:30.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:30.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:30 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: mgrmap e31: smithi064.ueciyw(active, since 25s), standbys: smithi184.urtxla 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.ueciyw"}]: dispatch 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.ueciyw"}]': finished 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi184.urtxla"}]: dispatch 2023-12-16T03:17:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi184.urtxla"}]': finished 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:30 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:31.742 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:31 smithi064 ceph-mon[111958]: pgmap v16: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 413 op/s 2023-12-16T03:17:31.742 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:31 smithi064 ceph-mon[111958]: Upgrade: Setting container_image for all mgr 2023-12-16T03:17:31.742 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:31 smithi064 ceph-mon[111958]: Upgrade: Setting container_image for all rgw 2023-12-16T03:17:31.743 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:31 smithi064 ceph-mon[111958]: Upgrade: Setting container_image for all rbd-mirror 2023-12-16T03:17:31.743 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:31 smithi064 ceph-mon[111958]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-16T03:17:31.743 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:31 smithi064 ceph-mon[111958]: Upgrade: Setting container_image for all ceph-exporter 2023-12-16T03:17:31.743 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:31 smithi064 ceph-mon[111958]: Upgrade: Setting container_image for all iscsi 2023-12-16T03:17:31.743 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:31 smithi064 ceph-mon[111958]: Upgrade: Setting container_image for all nfs 2023-12-16T03:17:31.743 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:31 smithi064 ceph-mon[111958]: Upgrade: Setting container_image for all nvmeof 2023-12-16T03:17:32.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:31 smithi184 ceph-mon[121180]: pgmap v16: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 413 op/s 2023-12-16T03:17:32.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:31 smithi184 ceph-mon[121180]: Upgrade: Setting container_image for all mgr 2023-12-16T03:17:32.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:31 smithi184 ceph-mon[121180]: Upgrade: Setting container_image for all rgw 2023-12-16T03:17:32.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:31 smithi184 ceph-mon[121180]: Upgrade: Setting container_image for all rbd-mirror 2023-12-16T03:17:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:31 smithi184 ceph-mon[121180]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-16T03:17:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:31 smithi184 ceph-mon[121180]: Upgrade: Setting container_image for all ceph-exporter 2023-12-16T03:17:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:31 smithi184 ceph-mon[121180]: Upgrade: Setting container_image for all iscsi 2023-12-16T03:17:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:31 smithi184 ceph-mon[121180]: Upgrade: Setting container_image for all nfs 2023-12-16T03:17:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:31 smithi184 ceph-mon[121180]: Upgrade: Setting container_image for all nvmeof 2023-12-16T03:17:33.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:33 smithi064 ceph-mon[111958]: pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 416 op/s 2023-12-16T03:17:33.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:33 smithi064 ceph-mon[111958]: Upgrade: Updating node-exporter.smithi064 (1/2) 2023-12-16T03:17:33.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:33 smithi064 ceph-mon[111958]: Deploying daemon node-exporter.smithi064 on smithi064 2023-12-16T03:17:34.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:33 smithi184 ceph-mon[121180]: pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 416 op/s 2023-12-16T03:17:34.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:33 smithi184 ceph-mon[121180]: Upgrade: Updating node-exporter.smithi064 (1/2) 2023-12-16T03:17:34.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:33 smithi184 ceph-mon[121180]: Deploying daemon node-exporter.smithi064 on smithi064 2023-12-16T03:17:35.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:35 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:35.651 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:35 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:35.651 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:35 smithi064 ceph-mon[111958]: pgmap v18: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 282 op/s 2023-12-16T03:17:35.651 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:35 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:17:35.652 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-16T03:17:35.652 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-16T03:17:35.692 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:35 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:35.692 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:35 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:35.692 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:35 smithi184 ceph-mon[121180]: pgmap v18: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 282 op/s 2023-12-16T03:17:35.692 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:35 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:17:35.929 DEBUG:teuthology.parallel:result is None 2023-12-16T03:17:35.930 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T03:17:35.975 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T03:17:35.975 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-16T03:17:36.010 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-16T03:17:36.010 DEBUG:teuthology.parallel:result is None 2023-12-16T03:17:37.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:37 smithi184 ceph-mon[121180]: Upgrade: Updating node-exporter.smithi184 (2/2) 2023-12-16T03:17:37.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:37 smithi184 ceph-mon[121180]: Deploying daemon node-exporter.smithi184 on smithi184 2023-12-16T03:17:37.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:37 smithi184 ceph-mon[121180]: pgmap v19: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 403 op/s 2023-12-16T03:17:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:37 smithi064 ceph-mon[111958]: Upgrade: Updating node-exporter.smithi184 (2/2) 2023-12-16T03:17:37.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:37 smithi064 ceph-mon[111958]: Deploying daemon node-exporter.smithi184 on smithi184 2023-12-16T03:17:37.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:37 smithi064 ceph-mon[111958]: pgmap v19: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 403 op/s 2023-12-16T03:17:39.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:39 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:39.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:39 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:39.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:39 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:39.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:39 smithi064 ceph-mon[111958]: pgmap v20: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 258 op/s 2023-12-16T03:17:39.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:39 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:39.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:39 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:39.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:39 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:39.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:39 smithi184 ceph-mon[121180]: pgmap v20: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 258 op/s 2023-12-16T03:17:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:41 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:41 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:41 smithi064 ceph-mon[111958]: pgmap v21: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 297 op/s 2023-12-16T03:17:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:41 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:41 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:41.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:41 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:41.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:41 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:41.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:41 smithi184 ceph-mon[121180]: pgmap v21: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 297 op/s 2023-12-16T03:17:41.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:41 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:41.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:41 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:42.524 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:42 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:42.524 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:42 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:42.524 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:42 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:42.524 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:42 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:42.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:42 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:42.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:42 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:42.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:42 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:42.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:42 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:43.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:43 smithi184 ceph-mon[121180]: pgmap v22: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1017 KiB/s wr, 185 op/s 2023-12-16T03:17:43.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:43 smithi064 ceph-mon[111958]: pgmap v22: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1017 KiB/s wr, 185 op/s 2023-12-16T03:17:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:44 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:44.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:44 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.724+0000 7f389e23c700 1 -- 172.21.15.64:0/3175037930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 msgr2=0x7f38980ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.724+0000 7f389e23c700 1 --2- 172.21.15.64:0/3175037930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 0x7f38980ffb10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3888004940 tx=0x7f3888009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.724+0000 7f389e23c700 1 -- 172.21.15.64:0/3175037930 shutdown_connections 2023-12-16T03:17:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.724+0000 7f389e23c700 1 --2- 172.21.15.64:0/3175037930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3898100050 0x7f3898102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.724+0000 7f389e23c700 1 --2- 172.21.15.64:0/3175037930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 0x7f38980ffb10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.724+0000 7f389e23c700 1 -- 172.21.15.64:0/3175037930 >> 172.21.15.64:0/3175037930 conn(0x7f38980f7190 msgr2=0x7f38980f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.724+0000 7f389e23c700 1 -- 172.21.15.64:0/3175037930 shutdown_connections 2023-12-16T03:17:44.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.724+0000 7f389e23c700 1 -- 172.21.15.64:0/3175037930 wait complete. 2023-12-16T03:17:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.725+0000 7f389e23c700 1 Processor -- start 2023-12-16T03:17:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.725+0000 7f389e23c700 1 -- start start 2023-12-16T03:17:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.725+0000 7f389e23c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 0x7f389810f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.725+0000 7f389e23c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3898100050 0x7f389810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.725+0000 7f389e23c700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38981102c0 con 0x7f38980fd730 2023-12-16T03:17:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.725+0000 7f389e23c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3898110b00 con 0x7f3898100050 2023-12-16T03:17:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f38977fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 0x7f389810f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f38977fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 0x7f389810f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60316/0 (socket says 172.21.15.64:60316) 2023-12-16T03:17:44.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f38977fe700 1 -- 172.21.15.64:0/2172904465 learned_addr learned my addr 172.21.15.64:0/2172904465 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:44.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f3896ffd700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3898100050 0x7f389810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:44.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f38977fe700 1 -- 172.21.15.64:0/2172904465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3898100050 msgr2=0x7f389810fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:44.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f38977fe700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3898100050 0x7f389810fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f38977fe700 1 -- 172.21.15.64:0/2172904465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3888005040 con 0x7f38980fd730 2023-12-16T03:17:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f38977fe700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 0x7f389810f6f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3888009380 tx=0x7f3888009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f387ffff700 1 -- 172.21.15.64:0/2172904465 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388800e040 con 0x7f38980fd730 2023-12-16T03:17:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3898110d80 con 0x7f38980fd730 2023-12-16T03:17:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f387ffff700 1 -- 172.21.15.64:0/2172904465 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f388800bda0 con 0x7f38980fd730 2023-12-16T03:17:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f387ffff700 1 -- 172.21.15.64:0/2172904465 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388801c630 con 0x7f38980fd730 2023-12-16T03:17:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.726+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38981112c0 con 0x7f38980fd730 2023-12-16T03:17:44.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.727+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38980f8d30 con 0x7f38980fd730 2023-12-16T03:17:44.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.728+0000 7f387ffff700 1 -- 172.21.15.64:0/2172904465 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f38880139d0 con 0x7f38980fd730 2023-12-16T03:17:44.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.729+0000 7f387ffff700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f388006cc00 0x7f388006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:44.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.729+0000 7f387ffff700 1 -- 172.21.15.64:0/2172904465 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f388808dfb0 con 0x7f38980fd730 2023-12-16T03:17:44.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.729+0000 7f3896ffd700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f388006cc00 0x7f388006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:44.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.730+0000 7f3896ffd700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f388006cc00 0x7f388006f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f388c006fd0 tx=0x7f388c008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:44.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.733+0000 7f387ffff700 1 -- 172.21.15.64:0/2172904465 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f388805bc70 con 0x7f38980fd730 2023-12-16T03:17:44.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:44 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:44.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:44 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:44.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.977+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f389802b1f0 con 0x7f388006cc00 2023-12-16T03:17:44.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.980+0000 7f387ffff700 1 -- 172.21.15.64:0/2172904465 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f389802b1f0 con 0x7f388006cc00 2023-12-16T03:17:44.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.982+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f388006cc00 msgr2=0x7f388006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:44.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.982+0000 7f389e23c700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f388006cc00 0x7f388006f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f388c006fd0 tx=0x7f388c008040 comp rx=0 tx=0).stop 2023-12-16T03:17:44.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.982+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 msgr2=0x7f389810f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:44.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.982+0000 7f389e23c700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 0x7f389810f6f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3888009380 tx=0x7f3888009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:44.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.983+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 shutdown_connections 2023-12-16T03:17:44.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.983+0000 7f389e23c700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f388006cc00 0x7f388006f0b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:44.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.983+0000 7f389e23c700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38980fd730 0x7f389810f6f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:44.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.983+0000 7f389e23c700 1 --2- 172.21.15.64:0/2172904465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3898100050 0x7f389810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:44.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.983+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 >> 172.21.15.64:0/2172904465 conn(0x7f38980f7190 msgr2=0x7f3898100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:44.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.983+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 shutdown_connections 2023-12-16T03:17:44.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:44.983+0000 7f389e23c700 1 -- 172.21.15.64:0/2172904465 wait complete. 2023-12-16T03:17:44.997 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:17:45.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.090+0000 7f7957ab5700 1 -- 172.21.15.64:0/3158736153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 msgr2=0x7f79500fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.090+0000 7f7957ab5700 1 --2- 172.21.15.64:0/3158736153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 0x7f79500fd150 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7940004940 tx=0x7f7940009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:45.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.090+0000 7f7957ab5700 1 -- 172.21.15.64:0/3158736153 shutdown_connections 2023-12-16T03:17:45.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.090+0000 7f7957ab5700 1 --2- 172.21.15.64:0/3158736153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 0x7f79500fd150 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.090+0000 7f7957ab5700 1 --2- 172.21.15.64:0/3158736153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79500fbaf0 0x7f79500fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.090+0000 7f7957ab5700 1 -- 172.21.15.64:0/3158736153 >> 172.21.15.64:0/3158736153 conn(0x7f79500f7190 msgr2=0x7f79500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:45.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7957ab5700 1 -- 172.21.15.64:0/3158736153 shutdown_connections 2023-12-16T03:17:45.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7957ab5700 1 -- 172.21.15.64:0/3158736153 wait complete. 2023-12-16T03:17:45.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7957ab5700 1 Processor -- start 2023-12-16T03:17:45.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7957ab5700 1 -- start start 2023-12-16T03:17:45.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7957ab5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79500fbaf0 0x7f79500ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:45.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7957ab5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 0x7f79500fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:45.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7957ab5700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500fe640 con 0x7f79500fcd00 2023-12-16T03:17:45.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7957ab5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500fe7b0 con 0x7f79500fbaf0 2023-12-16T03:17:45.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7955050700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 0x7f79500fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:45.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7955050700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 0x7f79500fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60338/0 (socket says 172.21.15.64:60338) 2023-12-16T03:17:45.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7955050700 1 -- 172.21.15.64:0/1179829475 learned_addr learned my addr 172.21.15.64:0/1179829475 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.091+0000 7f7955851700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79500fbaf0 0x7f79500ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.092+0000 7f7955050700 1 -- 172.21.15.64:0/1179829475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79500fbaf0 msgr2=0x7f79500ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.092+0000 7f7955050700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79500fbaf0 0x7f79500ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.092+0000 7f7955050700 1 -- 172.21.15.64:0/1179829475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940005040 con 0x7f79500fcd00 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.092+0000 7f7955050700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 0x7f79500fe040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7940009360 tx=0x7f7940009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.092+0000 7f79467fc700 1 -- 172.21.15.64:0/1179829475 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794000e040 con 0x7f79500fcd00 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.092+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79500fea30 con 0x7f79500fcd00 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.092+0000 7f79467fc700 1 -- 172.21.15.64:0/1179829475 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f794000bc50 con 0x7f79500fcd00 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.092+0000 7f79467fc700 1 -- 172.21.15.64:0/1179829475 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794001c3f0 con 0x7f79500fcd00 2023-12-16T03:17:45.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.092+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79501155a0 con 0x7f79500fcd00 2023-12-16T03:17:45.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.093+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795004bb80 con 0x7f79500fcd00 2023-12-16T03:17:45.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.094+0000 7f79467fc700 1 -- 172.21.15.64:0/1179829475 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f7940013420 con 0x7f79500fcd00 2023-12-16T03:17:45.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.094+0000 7f79467fc700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f793c06cc00 0x7f793c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:45.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.094+0000 7f79467fc700 1 -- 172.21.15.64:0/1179829475 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f794008d3f0 con 0x7f79500fcd00 2023-12-16T03:17:45.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.094+0000 7f7955851700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f793c06cc00 0x7f793c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:45.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.094+0000 7f7955851700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f793c06cc00 0x7f793c06f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79500ff950 tx=0x7f794c00b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:45.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.099+0000 7f79467fc700 1 -- 172.21.15.64:0/1179829475 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f794005b010 con 0x7f79500fcd00 2023-12-16T03:17:45.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.325+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7950065a80 con 0x7f793c06cc00 2023-12-16T03:17:45.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.326+0000 7f79467fc700 1 -- 172.21.15.64:0/1179829475 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f7950065a80 con 0x7f793c06cc00 2023-12-16T03:17:45.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f793c06cc00 msgr2=0x7f793c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f793c06cc00 0x7f793c06f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79500ff950 tx=0x7f794c00b040 comp rx=0 tx=0).stop 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 msgr2=0x7f79500fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 0x7f79500fe040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7940009360 tx=0x7f7940009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 shutdown_connections 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f793c06cc00 0x7f793c06f0b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79500fbaf0 0x7f79500ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 --2- 172.21.15.64:0/1179829475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79500fcd00 0x7f79500fe040 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 >> 172.21.15.64:0/1179829475 conn(0x7f79500f7190 msgr2=0x7f7950065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 shutdown_connections 2023-12-16T03:17:45.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.328+0000 7f7957ab5700 1 -- 172.21.15.64:0/1179829475 wait complete. 2023-12-16T03:17:45.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.447+0000 7f8213be9700 1 -- 172.21.15.64:0/291667808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 msgr2=0x7f820c0fc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.447+0000 7f8213be9700 1 --2- 172.21.15.64:0/291667808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 0x7f820c0fc2e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f81fc004940 tx=0x7f81fc009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:45.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.447+0000 7f8213be9700 1 -- 172.21.15.64:0/291667808 shutdown_connections 2023-12-16T03:17:45.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.447+0000 7f8213be9700 1 --2- 172.21.15.64:0/291667808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 0x7f820c0fc2e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.447+0000 7f8213be9700 1 --2- 172.21.15.64:0/291667808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0fb520 0x7f820c0fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.447+0000 7f8213be9700 1 -- 172.21.15.64:0/291667808 >> 172.21.15.64:0/291667808 conn(0x7f820c0f7190 msgr2=0x7f820c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:45.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.447+0000 7f8213be9700 1 -- 172.21.15.64:0/291667808 shutdown_connections 2023-12-16T03:17:45.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.447+0000 7f8213be9700 1 -- 172.21.15.64:0/291667808 wait complete. 2023-12-16T03:17:45.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8213be9700 1 Processor -- start 2023-12-16T03:17:45.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8213be9700 1 -- start start 2023-12-16T03:17:45.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8213be9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0fb520 0x7f820c1184a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:45.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8213be9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 0x7f820c1189e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:45.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8213be9700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c118fe0 con 0x7f820c0fbe70 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8213be9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c119370 con 0x7f820c0fb520 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8211184700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 0x7f820c1189e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8211184700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 0x7f820c1189e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60358/0 (socket says 172.21.15.64:60358) 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8211184700 1 -- 172.21.15.64:0/1082604828 learned_addr learned my addr 172.21.15.64:0/1082604828 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8211985700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0fb520 0x7f820c1184a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8211184700 1 -- 172.21.15.64:0/1082604828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0fb520 msgr2=0x7f820c1184a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.448+0000 7f8211184700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0fb520 0x7f820c1184a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.449+0000 7f8211184700 1 -- 172.21.15.64:0/1082604828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc005040 con 0x7f820c0fbe70 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.449+0000 7f8211184700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 0x7f820c1189e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00b3b0 tx=0x7f81fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.449+0000 7f82027fc700 1 -- 172.21.15.64:0/1082604828 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81fc00e040 con 0x7f820c0fbe70 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.449+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c1195f0 con 0x7f820c0fbe70 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.449+0000 7f82027fc700 1 -- 172.21.15.64:0/1082604828 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81fc00bc50 con 0x7f820c0fbe70 2023-12-16T03:17:45.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.449+0000 7f82027fc700 1 -- 172.21.15.64:0/1082604828 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81fc01c630 con 0x7f820c0fbe70 2023-12-16T03:17:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.449+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c119b30 con 0x7f820c0fbe70 2023-12-16T03:17:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.450+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c04bb80 con 0x7f820c0fbe70 2023-12-16T03:17:45.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.450+0000 7f82027fc700 1 -- 172.21.15.64:0/1082604828 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f81fc013420 con 0x7f820c0fbe70 2023-12-16T03:17:45.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.451+0000 7f82027fc700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f81f806cc00 0x7f81f806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:45.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.451+0000 7f82027fc700 1 -- 172.21.15.64:0/1082604828 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f81fc08d440 con 0x7f820c0fbe70 2023-12-16T03:17:45.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.451+0000 7f8211985700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f81f806cc00 0x7f81f806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:45.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.451+0000 7f8211985700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f81f806cc00 0x7f81f806f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f820c118210 tx=0x7f820800b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:45.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.455+0000 7f82027fc700 1 -- 172.21.15.64:0/1082604828 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f81fc05b0e0 con 0x7f820c0fbe70 2023-12-16T03:17:45.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.672+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f820c119ff0 con 0x7f81f806cc00 2023-12-16T03:17:45.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.682+0000 7f82027fc700 1 -- 172.21.15.64:0/1082604828 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f820c119ff0 con 0x7f81f806cc00 2023-12-16T03:17:45.685 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:17:45.685 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (77s) 4s ago 7m 28.4M - 0.25.0 c8568f914cd2 47a34ff6100b 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (7m) 4s ago 7m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (7m) 5s ago 7m 7482k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (63s) 4s ago 7m 81.1M - 9.4.7 954c08fa6188 8d5bf4bb96ea 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (3m) 4s ago 3m 14.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (3m) 4s ago 3m 6643M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (3m) 5s ago 3m 4651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (3m) 5s ago 3m 15.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (51s) 4s ago 8m 502M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (24s) 5s ago 7m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (8m) 4s ago 8m 92.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (6m) 5s ago 6m 66.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (11s) 4s ago 7m 8879k - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (7s) 5s ago 7m 8564k - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:17:45.686 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (6m) 4s ago 6m 760M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:17:45.687 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (6m) 4s ago 6m 833M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:17:45.687 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (5m) 4s ago 5m 637M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:17:45.687 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (5m) 5s ago 5m 959M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:17:45.687 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (5m) 5s ago 5m 763M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:17:45.687 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (4m) 5s ago 4m 844M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:17:45.687 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (28s) 4s ago 7m 45.2M - 2.43.0 a07b618ecd1d c63097ae0089 2023-12-16T03:17:45.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.684+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f81f806cc00 msgr2=0x7f81f806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.684+0000 7f8213be9700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f81f806cc00 0x7f81f806f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f820c118210 tx=0x7f820800b040 comp rx=0 tx=0).stop 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.684+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 msgr2=0x7f820c1189e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.684+0000 7f8213be9700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 0x7f820c1189e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00b3b0 tx=0x7f81fc009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.685+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 shutdown_connections 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.685+0000 7f8213be9700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f81f806cc00 0x7f81f806f0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.685+0000 7f8213be9700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0fb520 0x7f820c1184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.685+0000 7f8213be9700 1 --2- 172.21.15.64:0/1082604828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f820c0fbe70 0x7f820c1189e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.685+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 >> 172.21.15.64:0/1082604828 conn(0x7f820c0f7190 msgr2=0x7f820c103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.685+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 shutdown_connections 2023-12-16T03:17:45.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.685+0000 7f8213be9700 1 -- 172.21.15.64:0/1082604828 wait complete. 2023-12-16T03:17:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: pgmap v23: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 668 KiB/s wr, 159 op/s 2023-12-16T03:17:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:45.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:45 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.789+0000 7f05f6d71700 1 -- 172.21.15.64:0/3413871395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 msgr2=0x7f05f00fd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.789+0000 7f05f6d71700 1 --2- 172.21.15.64:0/3413871395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 0x7f05f00fd5b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f05e4004940 tx=0x7f05e4009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.789+0000 7f05f6d71700 1 -- 172.21.15.64:0/3413871395 shutdown_connections 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.789+0000 7f05f6d71700 1 --2- 172.21.15.64:0/3413871395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05f00fdb80 0x7f05f0104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.789+0000 7f05f6d71700 1 --2- 172.21.15.64:0/3413871395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 0x7f05f00fd5b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.789+0000 7f05f6d71700 1 -- 172.21.15.64:0/3413871395 >> 172.21.15.64:0/3413871395 conn(0x7f05f00f6950 msgr2=0x7f05f00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.790+0000 7f05f6d71700 1 -- 172.21.15.64:0/3413871395 shutdown_connections 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.790+0000 7f05f6d71700 1 -- 172.21.15.64:0/3413871395 wait complete. 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.790+0000 7f05f6d71700 1 Processor -- start 2023-12-16T03:17:45.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.790+0000 7f05f6d71700 1 -- start start 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.790+0000 7f05f6d71700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 0x7f05f010f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.790+0000 7f05f6d71700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05f010fd30 0x7f05f0110bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.790+0000 7f05f6d71700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0110280 con 0x7f05f00fd1a0 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.790+0000 7f05f6d71700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f01103c0 con 0x7f05f010fd30 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.790+0000 7f05f4b0d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 0x7f05f010f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05f4b0d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 0x7f05f010f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60390/0 (socket says 172.21.15.64:60390) 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05f4b0d700 1 -- 172.21.15.64:0/1804255428 learned_addr learned my addr 172.21.15.64:0/1804255428 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05effff700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05f010fd30 0x7f05f0110bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05f4b0d700 1 -- 172.21.15.64:0/1804255428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05f010fd30 msgr2=0x7f05f0110bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05f4b0d700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05f010fd30 0x7f05f0110bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05f4b0d700 1 -- 172.21.15.64:0/1804255428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4005040 con 0x7f05f00fd1a0 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05f4b0d700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 0x7f05f010f7f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f05e40093b0 tx=0x7f05e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05ed7fa700 1 -- 172.21.15.64:0/1804255428 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e400e040 con 0x7f05f00fd1a0 2023-12-16T03:17:45.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f0111250 con 0x7f05f00fd1a0 2023-12-16T03:17:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05ed7fa700 1 -- 172.21.15.64:0/1804255428 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f05e4013420 con 0x7f05f00fd1a0 2023-12-16T03:17:45.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05ed7fa700 1 -- 172.21.15.64:0/1804255428 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e401c610 con 0x7f05f00fd1a0 2023-12-16T03:17:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.791+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f0111790 con 0x7f05f00fd1a0 2023-12-16T03:17:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.792+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f01098b0 con 0x7f05f00fd1a0 2023-12-16T03:17:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.793+0000 7f05ed7fa700 1 -- 172.21.15.64:0/1804255428 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f05e4013a00 con 0x7f05f00fd1a0 2023-12-16T03:17:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.793+0000 7f05ed7fa700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f05e006cc00 0x7f05e006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.793+0000 7f05ed7fa700 1 -- 172.21.15.64:0/1804255428 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f05e408d490 con 0x7f05f00fd1a0 2023-12-16T03:17:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.793+0000 7f05effff700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f05e006cc00 0x7f05e006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:45.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.794+0000 7f05effff700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f05e006cc00 0x7f05e006f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006fd0 tx=0x7f05dc008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:45.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:45.798+0000 7f05ed7fa700 1 -- 172.21.15.64:0/1804255428 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f05e405b090 con 0x7f05f00fd1a0 2023-12-16T03:17:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: pgmap v23: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 668 KiB/s wr, 159 op/s 2023-12-16T03:17:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:45.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:45 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:46.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.091+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f05f01119b0 con 0x7f05f00fd1a0 2023-12-16T03:17:46.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.092+0000 7f05ed7fa700 1 -- 172.21.15.64:0/1804255428 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f05e405ac20 con 0x7f05f00fd1a0 2023-12-16T03:17:46.094 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:17:46.094 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:17:46.094 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:17:46.094 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:17:46.095 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:17:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f05e006cc00 msgr2=0x7f05e006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f05e006cc00 0x7f05e006f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006fd0 tx=0x7f05dc008040 comp rx=0 tx=0).stop 2023-12-16T03:17:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 msgr2=0x7f05f010f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 0x7f05f010f7f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f05e40093b0 tx=0x7f05e4009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:46.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 shutdown_connections 2023-12-16T03:17:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f05e006cc00 0x7f05e006f0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f00fd1a0 0x7f05f010f7f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 --2- 172.21.15.64:0/1804255428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05f010fd30 0x7f05f0110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 >> 172.21.15.64:0/1804255428 conn(0x7f05f00f6950 msgr2=0x7f05f00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 shutdown_connections 2023-12-16T03:17:46.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.094+0000 7f05f6d71700 1 -- 172.21.15.64:0/1804255428 wait complete. 2023-12-16T03:17:46.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.203+0000 7f66db1c6700 1 -- 172.21.15.64:0/4052601700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 msgr2=0x7f66d40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:46.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.203+0000 7f66db1c6700 1 --2- 172.21.15.64:0/4052601700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 0x7f66d40fbf00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f66c8004940 tx=0x7f66c8009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:46.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.203+0000 7f66db1c6700 1 -- 172.21.15.64:0/4052601700 shutdown_connections 2023-12-16T03:17:46.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.203+0000 7f66db1c6700 1 --2- 172.21.15.64:0/4052601700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d40fcd00 0x7f66d40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:46.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.203+0000 7f66db1c6700 1 --2- 172.21.15.64:0/4052601700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 0x7f66d40fbf00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:46.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.203+0000 7f66db1c6700 1 -- 172.21.15.64:0/4052601700 >> 172.21.15.64:0/4052601700 conn(0x7f66d40f7190 msgr2=0x7f66d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:46.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.203+0000 7f66db1c6700 1 -- 172.21.15.64:0/4052601700 shutdown_connections 2023-12-16T03:17:46.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.203+0000 7f66db1c6700 1 -- 172.21.15.64:0/4052601700 wait complete. 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.204+0000 7f66db1c6700 1 Processor -- start 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.204+0000 7f66db1c6700 1 -- start start 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.204+0000 7f66db1c6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 0x7f66d410c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.204+0000 7f66db1c6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d40fcd00 0x7f66d410c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.204+0000 7f66db1c6700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d410cfe0 con 0x7f66d40fbaf0 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.204+0000 7f66db1c6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d410d880 con 0x7f66d40fcd00 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.204+0000 7f66d8f62700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 0x7f66d410c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.204+0000 7f66d8f62700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 0x7f66d410c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:60420/0 (socket says 172.21.15.64:60420) 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.204+0000 7f66d8f62700 1 -- 172.21.15.64:0/2077480262 learned_addr learned my addr 172.21.15.64:0/2077480262 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:17:46.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66d3fff700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d40fcd00 0x7f66d410c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66d8f62700 1 -- 172.21.15.64:0/2077480262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d40fcd00 msgr2=0x7f66d410c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66d8f62700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d40fcd00 0x7f66d410c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66d8f62700 1 -- 172.21.15.64:0/2077480262 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8005040 con 0x7f66d40fbaf0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66d8f62700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 0x7f66d410c4a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009360 tx=0x7f66c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66d17fa700 1 -- 172.21.15.64:0/2077480262 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c800e040 con 0x7f66d40fbaf0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66d17fa700 1 -- 172.21.15.64:0/2077480262 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f66c8004290 con 0x7f66d40fbaf0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d410db00 con 0x7f66d40fbaf0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66d17fa700 1 -- 172.21.15.64:0/2077480262 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c801c630 con 0x7f66d40fbaf0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.205+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d410e040 con 0x7f66d40fbaf0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.206+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d41064f0 con 0x7f66d40fbaf0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.207+0000 7f66d17fa700 1 -- 172.21.15.64:0/2077480262 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f66c8013960 con 0x7f66d40fbaf0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.207+0000 7f66d17fa700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f66c406cc00 0x7f66c406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.207+0000 7f66d17fa700 1 -- 172.21.15.64:0/2077480262 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f66c808d400 con 0x7f66d40fbaf0 2023-12-16T03:17:46.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.207+0000 7f66d3fff700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f66c406cc00 0x7f66c406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:17:46.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.208+0000 7f66d3fff700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f66c406cc00 0x7f66c406f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66c00041d0 tx=0x7f66c0009040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:17:46.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.212+0000 7f66d17fa700 1 -- 172.21.15.64:0/2077480262 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f66c805b0a0 con 0x7f66d40fbaf0 2023-12-16T03:17:46.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.439+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66d410e260 con 0x7f66c406cc00 2023-12-16T03:17:46.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.440+0000 7f66d17fa700 1 -- 172.21.15.64:0/2077480262 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f66d410e260 con 0x7f66c406cc00 2023-12-16T03:17:46.443 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:17:46.443 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:17:46.443 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:17:46.443 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T03:17:46.443 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:17:46.443 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:17:46.443 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:17:46.444 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T03:17:46.444 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Currently upgrading prometheus daemons", 2023-12-16T03:17:46.444 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:17:46.444 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:17:46.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.442+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f66c406cc00 msgr2=0x7f66c406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:46.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.442+0000 7f66db1c6700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f66c406cc00 0x7f66c406f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66c00041d0 tx=0x7f66c0009040 comp rx=0 tx=0).stop 2023-12-16T03:17:46.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.442+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 msgr2=0x7f66d410c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:17:46.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.442+0000 7f66db1c6700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 0x7f66d410c4a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009360 tx=0x7f66c8009e30 comp rx=0 tx=0).stop 2023-12-16T03:17:46.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.442+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 shutdown_connections 2023-12-16T03:17:46.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.442+0000 7f66db1c6700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f66c406cc00 0x7f66c406f0b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:46.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.442+0000 7f66db1c6700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66d40fbaf0 0x7f66d410c4a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:46.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.442+0000 7f66db1c6700 1 --2- 172.21.15.64:0/2077480262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d40fcd00 0x7f66d410c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:17:46.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.442+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 >> 172.21.15.64:0/2077480262 conn(0x7f66d40f7190 msgr2=0x7f66d40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:17:46.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.443+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 shutdown_connections 2023-12-16T03:17:46.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:17:46.443+0000 7f66db1c6700 1 -- 172.21.15.64:0/2077480262 wait complete. 2023-12-16T03:17:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:46 smithi064 ceph-mon[111958]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:46 smithi064 ceph-mon[111958]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:46 smithi064 ceph-mon[111958]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:46.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:46 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/1804255428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:46.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:46 smithi184 ceph-mon[121180]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:46.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:46 smithi184 ceph-mon[121180]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:46.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:46 smithi184 ceph-mon[121180]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:46.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:46 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/1804255428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:47 smithi064 ceph-mon[111958]: pgmap v24: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 668 KiB/s wr, 159 op/s 2023-12-16T03:17:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:47 smithi064 ceph-mon[111958]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:47 smithi064 ceph-mon[111958]: Upgrade: Updating prometheus.smithi064 2023-12-16T03:17:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:47 smithi064 ceph-mon[111958]: Deploying daemon prometheus.smithi064 on smithi064 2023-12-16T03:17:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:47 smithi184 ceph-mon[121180]: pgmap v24: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 668 KiB/s wr, 159 op/s 2023-12-16T03:17:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:47 smithi184 ceph-mon[121180]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:17:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:47 smithi184 ceph-mon[121180]: Upgrade: Updating prometheus.smithi064 2023-12-16T03:17:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:47 smithi184 ceph-mon[121180]: Deploying daemon prometheus.smithi064 on smithi064 2023-12-16T03:17:49.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:49 smithi064 ceph-mon[111958]: pgmap v25: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.0 KiB/s rd, 60 KiB/s wr, 39 op/s 2023-12-16T03:17:49.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:49 smithi184 ceph-mon[121180]: pgmap v25: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.0 KiB/s rd, 60 KiB/s wr, 39 op/s 2023-12-16T03:17:50.677 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:50 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:17:50.677 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:50 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:50.677 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:50 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:50.678 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:50 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:50.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:50 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:17:50.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:50 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:50.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:50 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:50.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:50 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:51.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:51 smithi064 ceph-mon[111958]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.0 KiB/s rd, 61 KiB/s wr, 39 op/s 2023-12-16T03:17:51.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:51 smithi184 ceph-mon[121180]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.0 KiB/s rd, 61 KiB/s wr, 39 op/s 2023-12-16T03:17:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:53 smithi064 ceph-mon[111958]: pgmap v27: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2023-12-16T03:17:53.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:53 smithi184 ceph-mon[121180]: pgmap v27: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2023-12-16T03:17:55.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:54 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:55.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:54 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:55.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:54 smithi184 ceph-mon[121180]: pgmap v28: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2023-12-16T03:17:55.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:54 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:55.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:54 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:55.064 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:54 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:55.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:54 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:55.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:54 smithi064 ceph-mon[111958]: pgmap v28: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2023-12-16T03:17:55.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:54 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:55.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:54 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:57.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:57 smithi064 ceph-mon[111958]: pgmap v29: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2023-12-16T03:17:57.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:57 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:57.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:57 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:57.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:57 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:57.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:57 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:57.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:57 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:57 smithi184 ceph-mon[121180]: pgmap v29: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s 2023-12-16T03:17:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:57 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:57 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:57 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:17:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:57 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:17:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:57 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:17:58.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:17:58.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:58 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:58 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:17:59.675 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:59 smithi064 ceph-mon[111958]: pgmap v30: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:17:59.675 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:59 smithi064 ceph-mon[111958]: Upgrade: Updating alertmanager.smithi064 2023-12-16T03:17:59.675 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:17:59 smithi064 ceph-mon[111958]: Deploying daemon alertmanager.smithi064 on smithi064 2023-12-16T03:17:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:59 smithi184 ceph-mon[121180]: pgmap v30: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:17:59.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:59 smithi184 ceph-mon[121180]: Upgrade: Updating alertmanager.smithi064 2023-12-16T03:17:59.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:17:59 smithi184 ceph-mon[121180]: Deploying daemon alertmanager.smithi064 on smithi064 2023-12-16T03:18:01.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:01 smithi064 ceph-mon[111958]: pgmap v31: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:18:01.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:01 smithi184 ceph-mon[121180]: pgmap v31: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T03:18:03.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:02 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:03.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:02 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:03.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:02 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:03.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:02 smithi064 ceph-mon[111958]: pgmap v32: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:03.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:02 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:03.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:02 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:03.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:02 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:03.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:02 smithi184 ceph-mon[121180]: pgmap v32: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:05 smithi064 ceph-mon[111958]: pgmap v33: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:05.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:05 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:18:05.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:05 smithi184 ceph-mon[121180]: pgmap v33: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:05.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:05 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:18:07.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:07 smithi064 ceph-mon[111958]: pgmap v34: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:07 smithi184 ceph-mon[121180]: pgmap v34: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:08.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:08 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:08.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:08 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:08.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:08 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:08.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:08 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:09.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:08 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:09.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:08 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:09.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:08 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:09.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:08 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:09.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:09 smithi064 ceph-mon[111958]: pgmap v35: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:10.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:09 smithi184 ceph-mon[121180]: pgmap v35: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:11.978 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: pgmap v36: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:11.978 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:11.978 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:11.978 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:18:11.978 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:18:11.978 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:11.978 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:18:11.978 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:11.979 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:11 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: pgmap v36: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:11 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:12.973 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:12 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:18:13.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:12 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T03:18:13.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:13 smithi064 ceph-mon[111958]: Upgrade: Updating grafana.smithi064 2023-12-16T03:18:13.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:13 smithi064 ceph-mon[111958]: Deploying daemon grafana.smithi064 on smithi064 2023-12-16T03:18:13.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:13 smithi064 ceph-mon[111958]: pgmap v37: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:13 smithi184 ceph-mon[121180]: Upgrade: Updating grafana.smithi064 2023-12-16T03:18:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:13 smithi184 ceph-mon[121180]: Deploying daemon grafana.smithi064 on smithi064 2023-12-16T03:18:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:13 smithi184 ceph-mon[121180]: pgmap v37: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:16.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:15 smithi184 ceph-mon[121180]: pgmap v38: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:16.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:15 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:16.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:15 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:16.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:15 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:15 smithi064 ceph-mon[111958]: pgmap v38: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:15 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:15 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:15 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.556+0000 7f6acf3ad700 1 -- 172.21.15.64:0/3951646669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac8100050 msgr2=0x7f6ac8102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.556+0000 7f6acf3ad700 1 --2- 172.21.15.64:0/3951646669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac8100050 0x7f6ac8102430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8004940 tx=0x7f6ab8009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.556+0000 7f6acf3ad700 1 -- 172.21.15.64:0/3951646669 shutdown_connections 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.556+0000 7f6acf3ad700 1 --2- 172.21.15.64:0/3951646669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac8100050 0x7f6ac8102430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.556+0000 7f6acf3ad700 1 --2- 172.21.15.64:0/3951646669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ac80fd730 0x7f6ac80ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.556+0000 7f6acf3ad700 1 -- 172.21.15.64:0/3951646669 >> 172.21.15.64:0/3951646669 conn(0x7f6ac80f7190 msgr2=0x7f6ac80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.556+0000 7f6acf3ad700 1 -- 172.21.15.64:0/3951646669 shutdown_connections 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.556+0000 7f6acf3ad700 1 -- 172.21.15.64:0/3951646669 wait complete. 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acf3ad700 1 Processor -- start 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acf3ad700 1 -- start start 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acf3ad700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac80fd730 0x7f6ac810d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acf3ad700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ac8100050 0x7f6ac810da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acf3ad700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac810e070 con 0x7f6ac80fd730 2023-12-16T03:18:16.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acf3ad700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac810e910 con 0x7f6ac8100050 2023-12-16T03:18:16.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acd149700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac80fd730 0x7f6ac810d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:16.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acd149700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac80fd730 0x7f6ac810d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57354/0 (socket says 172.21.15.64:57354) 2023-12-16T03:18:16.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acd149700 1 -- 172.21.15.64:0/1043316799 learned_addr learned my addr 172.21.15.64:0/1043316799 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:16.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.557+0000 7f6acc948700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ac8100050 0x7f6ac810da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.558+0000 7f6acd149700 1 -- 172.21.15.64:0/1043316799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ac8100050 msgr2=0x7f6ac810da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.558+0000 7f6acd149700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ac8100050 0x7f6ac810da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.558+0000 7f6acd149700 1 -- 172.21.15.64:0/1043316799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8005040 con 0x7f6ac80fd730 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.558+0000 7f6acd149700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac80fd730 0x7f6ac810d530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4002a50 tx=0x7f6ac40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.558+0000 7f6abdffb700 1 -- 172.21.15.64:0/1043316799 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ac4007cc0 con 0x7f6ac80fd730 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.558+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac810ebf0 con 0x7f6ac80fd730 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.558+0000 7f6abdffb700 1 -- 172.21.15.64:0/1043316799 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ac400f040 con 0x7f6ac80fd730 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.558+0000 7f6abdffb700 1 -- 172.21.15.64:0/1043316799 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ac400d9c0 con 0x7f6ac80fd730 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.558+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac810f130 con 0x7f6ac80fd730 2023-12-16T03:18:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.559+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac81075c0 con 0x7f6ac80fd730 2023-12-16T03:18:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.559+0000 7f6abdffb700 1 -- 172.21.15.64:0/1043316799 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f6ac400db20 con 0x7f6ac80fd730 2023-12-16T03:18:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.560+0000 7f6abdffb700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f6ab406cc00 0x7f6ab406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.560+0000 7f6abdffb700 1 -- 172.21.15.64:0/1043316799 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6ac408bdd0 con 0x7f6ac80fd730 2023-12-16T03:18:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.560+0000 7f6acc948700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f6ab406cc00 0x7f6ab406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.561+0000 7f6acc948700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f6ab406cc00 0x7f6ab406f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800b3b0 tx=0x7f6ab8009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:16.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.565+0000 7f6abdffb700 1 -- 172.21.15.64:0/1043316799 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6ac4059950 con 0x7f6ac80fd730 2023-12-16T03:18:16.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.825+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ac810f3c0 con 0x7f6ab406cc00 2023-12-16T03:18:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.827+0000 7f6abdffb700 1 -- 172.21.15.64:0/1043316799 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f6ac810f3c0 con 0x7f6ab406cc00 2023-12-16T03:18:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f6ab406cc00 msgr2=0x7f6ab406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f6ab406cc00 0x7f6ab406f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800b3b0 tx=0x7f6ab8009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac80fd730 msgr2=0x7f6ac810d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac80fd730 0x7f6ac810d530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4002a50 tx=0x7f6ac40046b0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 shutdown_connections 2023-12-16T03:18:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f6ab406cc00 0x7f6ab406f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ac80fd730 0x7f6ac810d530 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 --2- 172.21.15.64:0/1043316799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ac8100050 0x7f6ac810da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 >> 172.21.15.64:0/1043316799 conn(0x7f6ac80f7190 msgr2=0x7f6ac80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 shutdown_connections 2023-12-16T03:18:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.829+0000 7f6acf3ad700 1 -- 172.21.15.64:0/1043316799 wait complete. 2023-12-16T03:18:16.842 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:18:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 -- 172.21.15.64:0/1777673369 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 msgr2=0x7f0f040fc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 --2- 172.21.15.64:0/1777673369 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 0x7f0f040fc2a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8004940 tx=0x7f0ef8009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 -- 172.21.15.64:0/1777673369 shutdown_connections 2023-12-16T03:18:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 --2- 172.21.15.64:0/1777673369 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 0x7f0f040fc2a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 --2- 172.21.15.64:0/1777673369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f040fd0f0 0x7f0f040fd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 -- 172.21.15.64:0/1777673369 >> 172.21.15.64:0/1777673369 conn(0x7f0f040f6950 msgr2=0x7f0f040f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 -- 172.21.15.64:0/1777673369 shutdown_connections 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 -- 172.21.15.64:0/1777673369 wait complete. 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 Processor -- start 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.939+0000 7f0f088a9700 1 -- start start 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f088a9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 0x7f0f0410f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f088a9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f040fd0f0 0x7f0f0410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f088a9700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04110320 con 0x7f0f040fbe50 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f088a9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04110bc0 con 0x7f0f040fd0f0 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f0259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 0x7f0f0410f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f0259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 0x7f0f0410f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57374/0 (socket says 172.21.15.64:57374) 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f0259c700 1 -- 172.21.15.64:0/492986122 learned_addr learned my addr 172.21.15.64:0/492986122 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f01d9b700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f040fd0f0 0x7f0f0410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f0259c700 1 -- 172.21.15.64:0/492986122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f040fd0f0 msgr2=0x7f0f0410fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f0259c700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f040fd0f0 0x7f0f0410fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f0259c700 1 -- 172.21.15.64:0/492986122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8005040 con 0x7f0f040fbe50 2023-12-16T03:18:16.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f01d9b700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f040fd0f0 0x7f0f0410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:18:16.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f0259c700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 0x7f0f0410f7e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4002a80 tx=0x7f0ef4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:16.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0ef2ffd700 1 -- 172.21.15.64:0/492986122 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef4007cc0 con 0x7f0f040fbe50 2023-12-16T03:18:16.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f04110ea0 con 0x7f0f040fbe50 2023-12-16T03:18:16.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0ef2ffd700 1 -- 172.21.15.64:0/492986122 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ef400f040 con 0x7f0f040fbe50 2023-12-16T03:18:16.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.940+0000 7f0ef2ffd700 1 -- 172.21.15.64:0/492986122 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef400da20 con 0x7f0f040fbe50 2023-12-16T03:18:16.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.941+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f041113e0 con 0x7f0f040fbe50 2023-12-16T03:18:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.942+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0404bb80 con 0x7f0f040fbe50 2023-12-16T03:18:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.943+0000 7f0ef2ffd700 1 -- 172.21.15.64:0/492986122 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f0ef400db80 con 0x7f0f040fbe50 2023-12-16T03:18:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.943+0000 7f0ef2ffd700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f0eec06cc00 0x7f0eec06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.943+0000 7f0ef2ffd700 1 -- 172.21.15.64:0/492986122 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0ef408bdc0 con 0x7f0f040fbe50 2023-12-16T03:18:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.943+0000 7f0f01d9b700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f0eec06cc00 0x7f0eec06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.944+0000 7f0f01d9b700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f0eec06cc00 0x7f0eec06f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8004560 tx=0x7f0ef8009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:16.949 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:16.948+0000 7f0ef2ffd700 1 -- 172.21.15.64:0/492986122 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0ef40599e0 con 0x7f0f040fbe50 2023-12-16T03:18:17.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.188+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f04111850 con 0x7f0eec06cc00 2023-12-16T03:18:17.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.189+0000 7f0ef2ffd700 1 -- 172.21.15.64:0/492986122 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f0f04111850 con 0x7f0eec06cc00 2023-12-16T03:18:17.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f0eec06cc00 msgr2=0x7f0eec06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f0eec06cc00 0x7f0eec06f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8004560 tx=0x7f0ef8009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 msgr2=0x7f0f0410f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 0x7f0f0410f7e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4002a80 tx=0x7f0ef4004600 comp rx=0 tx=0).stop 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 shutdown_connections 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f0eec06cc00 0x7f0eec06f0b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f040fbe50 0x7f0f0410f7e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 --2- 172.21.15.64:0/492986122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f040fd0f0 0x7f0f0410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 >> 172.21.15.64:0/492986122 conn(0x7f0f040f6950 msgr2=0x7f0f040fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 shutdown_connections 2023-12-16T03:18:17.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.191+0000 7f0f088a9700 1 -- 172.21.15.64:0/492986122 wait complete. 2023-12-16T03:18:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 -- 172.21.15.64:0/260155448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580fdf60 msgr2=0x7f72580fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 --2- 172.21.15.64:0/260155448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580fdf60 0x7f72580fe3b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7248004940 tx=0x7f7248009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 -- 172.21.15.64:0/260155448 shutdown_connections 2023-12-16T03:18:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 --2- 172.21.15.64:0/260155448 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580fdf60 0x7f72580fe3b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 --2- 172.21.15.64:0/260155448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580faed0 0x7f72580fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 -- 172.21.15.64:0/260155448 >> 172.21.15.64:0/260155448 conn(0x7f72580f6950 msgr2=0x7f72580f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:17.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 -- 172.21.15.64:0/260155448 shutdown_connections 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 -- 172.21.15.64:0/260155448 wait complete. 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 Processor -- start 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 -- start start 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580faed0 0x7f72580fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.300+0000 7f72602ec700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580fdf60 0x7f72580fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f72602ec700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580fc470 con 0x7f72580faed0 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f72602ec700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580fc5e0 con 0x7f72580fdf60 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f725e088700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580faed0 0x7f72580fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f725e088700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580faed0 0x7f72580fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57396/0 (socket says 172.21.15.64:57396) 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f725e088700 1 -- 172.21.15.64:0/3293767710 learned_addr learned my addr 172.21.15.64:0/3293767710 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f725d887700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580fdf60 0x7f72580fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f725e088700 1 -- 172.21.15.64:0/3293767710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580fdf60 msgr2=0x7f72580fbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f725e088700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580fdf60 0x7f72580fbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f725e088700 1 -- 172.21.15.64:0/3293767710 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7248005040 con 0x7f72580faed0 2023-12-16T03:18:17.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f725e088700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580faed0 0x7f72580fd9f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f725400eb70 tx=0x7f725400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f724effd700 1 -- 172.21.15.64:0/3293767710 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7254007cc0 con 0x7f72580faed0 2023-12-16T03:18:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f724effd700 1 -- 172.21.15.64:0/3293767710 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f725400f040 con 0x7f72580faed0 2023-12-16T03:18:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f724effd700 1 -- 172.21.15.64:0/3293767710 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f725400c9d0 con 0x7f72580faed0 2023-12-16T03:18:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72580fc860 con 0x7f72580faed0 2023-12-16T03:18:17.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.301+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7258115580 con 0x7f72580faed0 2023-12-16T03:18:17.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.302+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725804bb80 con 0x7f72580faed0 2023-12-16T03:18:17.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.303+0000 7f724effd700 1 -- 172.21.15.64:0/3293767710 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f725400cc40 con 0x7f72580faed0 2023-12-16T03:18:17.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.303+0000 7f724effd700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f724406cc00 0x7f724406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:17.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.303+0000 7f724effd700 1 -- 172.21.15.64:0/3293767710 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f725408bab0 con 0x7f72580faed0 2023-12-16T03:18:17.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.303+0000 7f725d887700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f724406cc00 0x7f724406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:17.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.304+0000 7f725d887700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f724406cc00 0x7f724406f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7248009fd0 tx=0x7f7248009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:17.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.308+0000 7f724effd700 1 -- 172.21.15.64:0/3293767710 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7254059780 con 0x7f72580faed0 2023-12-16T03:18:17.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.528+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f72581028b0 con 0x7f724406cc00 2023-12-16T03:18:17.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.538+0000 7f724effd700 1 -- 172.21.15.64:0/3293767710 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f72581028b0 con 0x7f724406cc00 2023-12-16T03:18:17.540 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:18:17.540 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (16s) 9s ago 8m 17.6M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:18:17.540 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (8m) 9s ago 8m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:18:17.541 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (7m) 37s ago 7m 7482k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:18:17.541 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 starting - - - - 2023-12-16T03:18:17.541 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (4m) 9s ago 4m 14.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:18:17.541 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (4m) 9s ago 4m 6643M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:18:17.541 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (4m) 37s ago 4m 4651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:18:17.542 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (4m) 37s ago 4m 15.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:18:17.542 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (83s) 9s ago 9m 505M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:18:17.542 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (56s) 37s ago 7m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:18:17.542 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (9m) 9s ago 9m 96.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:18:17.542 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (7m) 37s ago 7m 66.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:18:17.542 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (43s) 9s ago 8m 9181k - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:18:17.542 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (39s) 37s ago 7m 8564k - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:18:17.543 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (6m) 9s ago 6m 761M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:18:17.543 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (6m) 9s ago 6m 835M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:18:17.543 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (6m) 9s ago 6m 639M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:18:17.543 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (5m) 37s ago 5m 959M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:18:17.543 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (5m) 37s ago 5m 763M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:18:17.543 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (5m) 37s ago 5m 844M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:18:17.544 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (27s) 9s ago 7m 44.2M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:18:17.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f724406cc00 msgr2=0x7f724406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f724406cc00 0x7f724406f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7248009fd0 tx=0x7f7248009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:17.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580faed0 msgr2=0x7f72580fd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580faed0 0x7f72580fd9f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f725400eb70 tx=0x7f725400b040 comp rx=0 tx=0).stop 2023-12-16T03:18:17.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 shutdown_connections 2023-12-16T03:18:17.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f724406cc00 0x7f724406f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72580faed0 0x7f72580fd9f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 --2- 172.21.15.64:0/3293767710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580fdf60 0x7f72580fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 >> 172.21.15.64:0/3293767710 conn(0x7f72580f6950 msgr2=0x7f7258101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:17.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.540+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 shutdown_connections 2023-12-16T03:18:17.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.541+0000 7f72602ec700 1 -- 172.21.15.64:0/3293767710 wait complete. 2023-12-16T03:18:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.671+0000 7f8b7e527700 1 -- 172.21.15.64:0/631469971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 msgr2=0x7f8b780fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.671+0000 7f8b7e527700 1 --2- 172.21.15.64:0/631469971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 0x7f8b780fe250 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c004940 tx=0x7f8b6c009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.672+0000 7f8b7e527700 1 -- 172.21.15.64:0/631469971 shutdown_connections 2023-12-16T03:18:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.672+0000 7f8b7e527700 1 --2- 172.21.15.64:0/631469971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 0x7f8b780fe250 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.672+0000 7f8b7e527700 1 --2- 172.21.15.64:0/631469971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b780fcbf0 0x7f8b780fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.672+0000 7f8b7e527700 1 -- 172.21.15.64:0/631469971 >> 172.21.15.64:0/631469971 conn(0x7f8b780f82d0 msgr2=0x7f8b780fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.672+0000 7f8b7e527700 1 -- 172.21.15.64:0/631469971 shutdown_connections 2023-12-16T03:18:17.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.672+0000 7f8b7e527700 1 -- 172.21.15.64:0/631469971 wait complete. 2023-12-16T03:18:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.672+0000 7f8b7e527700 1 Processor -- start 2023-12-16T03:18:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b7e527700 1 -- start start 2023-12-16T03:18:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b7e527700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b780fcbf0 0x7f8b7810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b7e527700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 0x7f8b7810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b7e527700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7810e130 con 0x7f8b780fde00 2023-12-16T03:18:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b7e527700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7810e970 con 0x7f8b780fcbf0 2023-12-16T03:18:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b777fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 0x7f8b7810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b777fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 0x7f8b7810daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57406/0 (socket says 172.21.15.64:57406) 2023-12-16T03:18:17.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b777fe700 1 -- 172.21.15.64:0/2348263480 learned_addr learned my addr 172.21.15.64:0/2348263480 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b77fff700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b780fcbf0 0x7f8b7810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b777fe700 1 -- 172.21.15.64:0/2348263480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b780fcbf0 msgr2=0x7f8b7810d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b777fe700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b780fcbf0 0x7f8b7810d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b777fe700 1 -- 172.21.15.64:0/2348263480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c005040 con 0x7f8b780fde00 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b77fff700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b780fcbf0 0x7f8b7810d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.673+0000 7f8b777fe700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 0x7f8b7810daa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00b3b0 tx=0x7f8b6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.674+0000 7f8b74ff9700 1 -- 172.21.15.64:0/2348263480 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6c00e040 con 0x7f8b780fde00 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.674+0000 7f8b74ff9700 1 -- 172.21.15.64:0/2348263480 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b6c009b10 con 0x7f8b780fde00 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.674+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7810ebf0 con 0x7f8b780fde00 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.674+0000 7f8b74ff9700 1 -- 172.21.15.64:0/2348263480 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6c01c630 con 0x7f8b780fde00 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.674+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7810f130 con 0x7f8b780fde00 2023-12-16T03:18:17.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.675+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7804bb80 con 0x7f8b780fde00 2023-12-16T03:18:17.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.675+0000 7f8b74ff9700 1 -- 172.21.15.64:0/2348263480 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f8b6c013960 con 0x7f8b780fde00 2023-12-16T03:18:17.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.676+0000 7f8b74ff9700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f8b6006cc00 0x7f8b6006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:17.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.676+0000 7f8b74ff9700 1 -- 172.21.15.64:0/2348263480 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8b6c08d490 con 0x7f8b780fde00 2023-12-16T03:18:17.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.676+0000 7f8b77fff700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f8b6006cc00 0x7f8b6006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:17.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.676+0000 7f8b77fff700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f8b6006cc00 0x7f8b6006f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8b68006fd0 tx=0x7f8b68008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:17.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.680+0000 7f8b74ff9700 1 -- 172.21.15.64:0/2348263480 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8b6c05b130 con 0x7f8b780fde00 2023-12-16T03:18:17.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:17 smithi064 ceph-mon[111958]: pgmap v39: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:17.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:17 smithi184 ceph-mon[121180]: pgmap v39: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:17.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.979+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b78105630 con 0x7f8b780fde00 2023-12-16T03:18:17.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.979+0000 7f8b74ff9700 1 -- 172.21.15.64:0/2348263480 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f8b6c05acc0 con 0x7f8b780fde00 2023-12-16T03:18:17.981 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:18:17.981 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:18:17.981 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:18:17.981 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:18:17.981 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:18:17.982 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:18:17.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f8b6006cc00 msgr2=0x7f8b6006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f8b6006cc00 0x7f8b6006f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8b68006fd0 tx=0x7f8b68008040 comp rx=0 tx=0).stop 2023-12-16T03:18:17.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 msgr2=0x7f8b7810daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:17.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 0x7f8b7810daa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00b3b0 tx=0x7f8b6c009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:17.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 shutdown_connections 2023-12-16T03:18:17.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f8b6006cc00 0x7f8b6006f0b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b780fcbf0 0x7f8b7810d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 --2- 172.21.15.64:0/2348263480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b780fde00 0x7f8b7810daa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:17.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 >> 172.21.15.64:0/2348263480 conn(0x7f8b780f82d0 msgr2=0x7f8b78101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:17.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 shutdown_connections 2023-12-16T03:18:17.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:17.981+0000 7f8b7e527700 1 -- 172.21.15.64:0/2348263480 wait complete. 2023-12-16T03:18:18.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.093+0000 7f87907dc700 1 -- 172.21.15.64:0/1509185424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87880ffd70 msgr2=0x7f87881021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:18.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.093+0000 7f87907dc700 1 --2- 172.21.15.64:0/1509185424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87880ffd70 0x7f87881021d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8778004940 tx=0x7f8778009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:18.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.093+0000 7f87907dc700 1 -- 172.21.15.64:0/1509185424 shutdown_connections 2023-12-16T03:18:18.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.093+0000 7f87907dc700 1 --2- 172.21.15.64:0/1509185424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87880ffd70 0x7f87881021d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:18.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.093+0000 7f87907dc700 1 --2- 172.21.15.64:0/1509185424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8788066920 0x7f87880ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:18.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.093+0000 7f87907dc700 1 -- 172.21.15.64:0/1509185424 >> 172.21.15.64:0/1509185424 conn(0x7f87880f71d0 msgr2=0x7f87880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:18.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.093+0000 7f87907dc700 1 -- 172.21.15.64:0/1509185424 shutdown_connections 2023-12-16T03:18:18.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.093+0000 7f87907dc700 1 -- 172.21.15.64:0/1509185424 wait complete. 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f87907dc700 1 Processor -- start 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f87907dc700 1 -- start start 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f87907dc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8788066920 0x7f878810d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f87907dc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87880ffd70 0x7f878810da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f87907dc700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878810e0f0 con 0x7f8788066920 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f87907dc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878810e930 con 0x7f87880ffd70 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f878e578700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8788066920 0x7f878810d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f878e578700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8788066920 0x7f878810d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57430/0 (socket says 172.21.15.64:57430) 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f878e578700 1 -- 172.21.15.64:0/1569163393 learned_addr learned my addr 172.21.15.64:0/1569163393 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f878dd77700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87880ffd70 0x7f878810da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f878e578700 1 -- 172.21.15.64:0/1569163393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87880ffd70 msgr2=0x7f878810da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f878e578700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87880ffd70 0x7f878810da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f878e578700 1 -- 172.21.15.64:0/1569163393 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778005040 con 0x7f8788066920 2023-12-16T03:18:18.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.094+0000 7f878e578700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8788066920 0x7f878810d520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f878400b790 tx=0x7f8784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.095+0000 7f877effd700 1 -- 172.21.15.64:0/1569163393 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f878400f770 con 0x7f8788066920 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.095+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878810ec10 con 0x7f8788066920 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.095+0000 7f877effd700 1 -- 172.21.15.64:0/1569163393 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f878400fd80 con 0x7f8788066920 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.095+0000 7f877effd700 1 -- 172.21.15.64:0/1569163393 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f878400d310 con 0x7f8788066920 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.095+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878810f150 con 0x7f8788066920 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.096+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8788107640 con 0x7f8788066920 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.096+0000 7f877effd700 1 -- 172.21.15.64:0/1569163393 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f8784010420 con 0x7f8788066920 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.097+0000 7f877effd700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f877406cc00 0x7f877406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.097+0000 7f877effd700 1 -- 172.21.15.64:0/1569163393 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f878408be90 con 0x7f8788066920 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.097+0000 7f878dd77700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f877406cc00 0x7f877406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:18.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.097+0000 7f878dd77700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f877406cc00 0x7f877406f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f877800b3b0 tx=0x7f8778009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:18.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.102+0000 7f877effd700 1 -- 172.21.15.64:0/1569163393 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8784059c40 con 0x7f8788066920 2023-12-16T03:18:18.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.361+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f878810f470 con 0x7f877406cc00 2023-12-16T03:18:18.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.362+0000 7f877effd700 1 -- 172.21.15.64:0/1569163393 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f878810f470 con 0x7f877406cc00 2023-12-16T03:18:18.363 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:18:18.363 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:18:18.363 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:18:18.363 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T03:18:18.363 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:18:18.364 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:18:18.364 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:18:18.364 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T03:18:18.364 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Currently upgrading grafana daemons", 2023-12-16T03:18:18.364 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:18:18.364 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f877406cc00 msgr2=0x7f877406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f877406cc00 0x7f877406f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f877800b3b0 tx=0x7f8778009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8788066920 msgr2=0x7f878810d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8788066920 0x7f878810d520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f878400b790 tx=0x7f8784009250 comp rx=0 tx=0).stop 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 shutdown_connections 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f877406cc00 0x7f877406f0b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8788066920 0x7f878810d520 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 --2- 172.21.15.64:0/1569163393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87880ffd70 0x7f878810da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 >> 172.21.15.64:0/1569163393 conn(0x7f87880f71d0 msgr2=0x7f87880f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 shutdown_connections 2023-12-16T03:18:18.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:18.364+0000 7f87907dc700 1 -- 172.21.15.64:0/1569163393 wait complete. 2023-12-16T03:18:18.660 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:18 smithi064 ceph-mon[111958]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:18.660 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:18 smithi064 ceph-mon[111958]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:18.660 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:18 smithi064 ceph-mon[111958]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:18.660 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:18 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2348263480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:18.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:18 smithi184 ceph-mon[121180]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:18.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:18 smithi184 ceph-mon[121180]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:18.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:18 smithi184 ceph-mon[121180]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:18.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:18 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2348263480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:19 smithi064 ceph-mon[111958]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:19 smithi064 ceph-mon[111958]: pgmap v40: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:19.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:19 smithi184 ceph-mon[121180]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:19.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:19 smithi184 ceph-mon[121180]: pgmap v40: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:20.669 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:20 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:20.669 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:20 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:20.669 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:20 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:18:20.669 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:20 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:20.669 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:20 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:20.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:20 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:20.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:20 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:20.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:20 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:18:20.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:20 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:20.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:20 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:21 smithi064 ceph-mon[111958]: pgmap v41: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:21 smithi184 ceph-mon[121180]: pgmap v41: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:23.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: pgmap v42: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:23.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:18:23.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-16T03:18:23.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-16T03:18:23.696 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.697 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:23.698 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:18:23.698 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:18:23.698 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:23 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: pgmap v42: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:18:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:18:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:23.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-16T03:18:23.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-16T03:18:23.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-16T03:18:23.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-16T03:18:23.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-16T03:18:23.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-16T03:18:23.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-16T03:18:23.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-16T03:18:23.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-16T03:18:23.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-16T03:18:23.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-16T03:18:23.815 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-16T03:18:23.815 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-16T03:18:23.815 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-16T03:18:23.815 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-16T03:18:23.815 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-16T03:18:23.815 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-16T03:18:23.815 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-16T03:18:23.815 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.815 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:18:23.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:23 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:24.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:24 smithi064 ceph-mon[111958]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:18:24.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:24 smithi064 ceph-mon[111958]: Upgrade: Finalizing container_image settings 2023-12-16T03:18:24.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:24 smithi064 ceph-mon[111958]: Upgrade: Complete! 2023-12-16T03:18:24.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:24 smithi184 ceph-mon[121180]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T03:18:24.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:24 smithi184 ceph-mon[121180]: Upgrade: Finalizing container_image settings 2023-12-16T03:18:24.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:24 smithi184 ceph-mon[121180]: Upgrade: Complete! 2023-12-16T03:18:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:25 smithi184 ceph-mon[121180]: pgmap v43: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:25.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:25 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:25.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:25 smithi064 ceph-mon[111958]: pgmap v43: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:25.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:25 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:18:27.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:27 smithi064 ceph-mon[111958]: pgmap v44: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:27 smithi184 ceph-mon[121180]: pgmap v44: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:29.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:29 smithi064 ceph-mon[111958]: pgmap v45: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:29 smithi184 ceph-mon[121180]: pgmap v45: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:31.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:31 smithi184 ceph-mon[121180]: pgmap v46: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:31.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:31 smithi064 ceph-mon[111958]: pgmap v46: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:33.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:33 smithi184 ceph-mon[121180]: pgmap v47: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:33.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:33 smithi064 ceph-mon[111958]: pgmap v47: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:35.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:35 smithi184 ceph-mon[121180]: pgmap v48: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:35.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:35 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:18:35.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:35 smithi064 ceph-mon[111958]: pgmap v48: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:35.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:35 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:18:37.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:37 smithi064 ceph-mon[111958]: pgmap v49: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T03:18:37.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:37 smithi184 ceph-mon[121180]: pgmap v49: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T03:18:38.660 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:38 smithi064 ceph-mon[111958]: mgrmap e32: smithi064.ueciyw(active, since 92s), standbys: smithi184.urtxla 2023-12-16T03:18:38.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:38 smithi184 ceph-mon[121180]: mgrmap e32: smithi064.ueciyw(active, since 92s), standbys: smithi184.urtxla 2023-12-16T03:18:39.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:39 smithi064 ceph-mon[111958]: pgmap v50: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T03:18:39.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:39 smithi184 ceph-mon[121180]: pgmap v50: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T03:18:41.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:41 smithi184 ceph-mon[121180]: pgmap v51: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:18:41.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:41 smithi064 ceph-mon[111958]: pgmap v51: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:18:43.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:43 smithi184 ceph-mon[121180]: pgmap v52: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:18:43.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:43 smithi064 ceph-mon[111958]: pgmap v52: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:18:45.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:45 smithi184 ceph-mon[121180]: pgmap v53: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:18:45.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:45 smithi064 ceph-mon[111958]: pgmap v53: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:18:47.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:47 smithi064 ceph-mon[111958]: pgmap v54: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:18:47.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:47 smithi184 ceph-mon[121180]: pgmap v54: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T03:18:48.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.483+0000 7fa572cd7700 1 -- 172.21.15.64:0/1035442333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c066090 msgr2=0x7fa56c101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:48.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.483+0000 7fa572cd7700 1 --2- 172.21.15.64:0/1035442333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c066090 0x7fa56c101ba0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa560004940 tx=0x7fa560009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:48.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.484+0000 7fa572cd7700 1 -- 172.21.15.64:0/1035442333 shutdown_connections 2023-12-16T03:18:48.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.484+0000 7fa572cd7700 1 --2- 172.21.15.64:0/1035442333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c1020e0 0x7fa56c1044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:48.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.484+0000 7fa572cd7700 1 --2- 172.21.15.64:0/1035442333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c066090 0x7fa56c101ba0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:48.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.484+0000 7fa572cd7700 1 -- 172.21.15.64:0/1035442333 >> 172.21.15.64:0/1035442333 conn(0x7fa56c0f7190 msgr2=0x7fa56c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:48.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.484+0000 7fa572cd7700 1 -- 172.21.15.64:0/1035442333 shutdown_connections 2023-12-16T03:18:48.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.484+0000 7fa572cd7700 1 -- 172.21.15.64:0/1035442333 wait complete. 2023-12-16T03:18:48.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa572cd7700 1 Processor -- start 2023-12-16T03:18:48.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa572cd7700 1 -- start start 2023-12-16T03:18:48.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa572cd7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c066090 0x7fa56c10f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:48.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa572cd7700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c1020e0 0x7fa56c10fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa572cd7700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1102d0 con 0x7fa56c1020e0 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa572cd7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c110b70 con 0x7fa56c066090 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa56bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c1020e0 0x7fa56c10fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa56bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c1020e0 0x7fa56c10fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43596/0 (socket says 172.21.15.64:43596) 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa56bfff700 1 -- 172.21.15.64:0/400477590 learned_addr learned my addr 172.21.15.64:0/400477590 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.485+0000 7fa570a73700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c066090 0x7fa56c10f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.486+0000 7fa56bfff700 1 -- 172.21.15.64:0/400477590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c066090 msgr2=0x7fa56c10f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.486+0000 7fa56bfff700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c066090 0x7fa56c10f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.486+0000 7fa56bfff700 1 -- 172.21.15.64:0/400477590 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560005040 con 0x7fa56c1020e0 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.486+0000 7fa56bfff700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c1020e0 0x7fa56c10fcd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa55800c890 tx=0x7fa5580044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.486+0000 7fa5697fa700 1 -- 172.21.15.64:0/400477590 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55800a700 con 0x7fa56c1020e0 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.486+0000 7fa5697fa700 1 -- 172.21.15.64:0/400477590 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa55800ad10 con 0x7fa56c1020e0 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.486+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c110e50 con 0x7fa56c1020e0 2023-12-16T03:18:48.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.486+0000 7fa5697fa700 1 -- 172.21.15.64:0/400477590 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa558012e70 con 0x7fa56c1020e0 2023-12-16T03:18:48.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.486+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c111390 con 0x7fa56c1020e0 2023-12-16T03:18:48.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.487+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c1097e0 con 0x7fa56c1020e0 2023-12-16T03:18:48.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.488+0000 7fa5697fa700 1 -- 172.21.15.64:0/400477590 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fa55800a860 con 0x7fa56c1020e0 2023-12-16T03:18:48.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.488+0000 7fa5697fa700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa55c06cae0 0x7fa55c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:48.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.488+0000 7fa5697fa700 1 -- 172.21.15.64:0/400477590 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa55808bda0 con 0x7fa56c1020e0 2023-12-16T03:18:48.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.488+0000 7fa570a73700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa55c06cae0 0x7fa55c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:48.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.489+0000 7fa570a73700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa55c06cae0 0x7fa55c06ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa56000b3b0 tx=0x7fa560009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:48.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.493+0000 7fa5697fa700 1 -- 172.21.15.64:0/400477590 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa558059c60 con 0x7fa56c1020e0 2023-12-16T03:18:48.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.714+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa56c111610 con 0x7fa55c06cae0 2023-12-16T03:18:48.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.715+0000 7fa5697fa700 1 -- 172.21.15.64:0/400477590 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fa56c111610 con 0x7fa55c06cae0 2023-12-16T03:18:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa55c06cae0 msgr2=0x7fa55c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa55c06cae0 0x7fa55c06ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa56000b3b0 tx=0x7fa560009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c1020e0 msgr2=0x7fa56c10fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c1020e0 0x7fa56c10fcd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa55800c890 tx=0x7fa5580044c0 comp rx=0 tx=0).stop 2023-12-16T03:18:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 shutdown_connections 2023-12-16T03:18:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa55c06cae0 0x7fa55c06ef90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:48.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c066090 0x7fa56c10f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:48.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 --2- 172.21.15.64:0/400477590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa56c1020e0 0x7fa56c10fcd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:48.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 >> 172.21.15.64:0/400477590 conn(0x7fa56c0f7190 msgr2=0x7fa56c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:48.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 shutdown_connections 2023-12-16T03:18:48.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:48.718+0000 7fa572cd7700 1 -- 172.21.15.64:0/400477590 wait complete. 2023-12-16T03:18:49.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:49 smithi184 ceph-mon[121180]: pgmap v55: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-16T03:18:49.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:49 smithi184 ceph-mon[121180]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:49.875 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:49 smithi064 ceph-mon[111958]: pgmap v55: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-16T03:18:49.876 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:49 smithi064 ceph-mon[111958]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:50.186 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2023-12-16T03:18:50.470 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:18:50.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:50 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:18:50.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:50 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:18:51.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.558+0000 7faff0bd3700 1 -- 172.21.15.64:0/130645198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 msgr2=0x7fafec0fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:51.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.558+0000 7faff0bd3700 1 --2- 172.21.15.64:0/130645198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 0x7fafec0fdfd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fafe0004940 tx=0x7fafe0009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:51.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.558+0000 7faff0bd3700 1 -- 172.21.15.64:0/130645198 shutdown_connections 2023-12-16T03:18:51.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.558+0000 7faff0bd3700 1 --2- 172.21.15.64:0/130645198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafec0fe5a0 0x7fafec106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.558+0000 7faff0bd3700 1 --2- 172.21.15.64:0/130645198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 0x7fafec0fdfd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.558+0000 7faff0bd3700 1 -- 172.21.15.64:0/130645198 >> 172.21.15.64:0/130645198 conn(0x7fafec0f7690 msgr2=0x7fafec0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.558+0000 7faff0bd3700 1 -- 172.21.15.64:0/130645198 shutdown_connections 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.558+0000 7faff0bd3700 1 -- 172.21.15.64:0/130645198 wait complete. 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.558+0000 7faff0bd3700 1 Processor -- start 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7faff0bd3700 1 -- start start 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7faff0bd3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 0x7fafec113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7faff0bd3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafec0fe5a0 0x7fafec113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7faff0bd3700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec114200 con 0x7fafec0fdc00 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7faff0bd3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec10d4f0 con 0x7fafec0fe5a0 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7fafea59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 0x7fafec113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7fafea59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 0x7fafec113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:43616/0 (socket says 172.21.15.64:43616) 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7fafea59c700 1 -- 172.21.15.64:0/3781470743 learned_addr learned my addr 172.21.15.64:0/3781470743 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7fafe9d9b700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafec0fe5a0 0x7fafec113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:51.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7fafea59c700 1 -- 172.21.15.64:0/3781470743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafec0fe5a0 msgr2=0x7fafec113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:51.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7fafea59c700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafec0fe5a0 0x7fafec113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:51.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7fafea59c700 1 -- 172.21.15.64:0/3781470743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0005040 con 0x7fafec0fdc00 2023-12-16T03:18:51.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7fafea59c700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 0x7fafec113630 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fafe000b3b0 tx=0x7fafe0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:51.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.559+0000 7fafdaffd700 1 -- 172.21.15.64:0/3781470743 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe000e040 con 0x7fafec0fdc00 2023-12-16T03:18:51.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.560+0000 7fafdaffd700 1 -- 172.21.15.64:0/3781470743 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fafe0009af0 con 0x7fafec0fdc00 2023-12-16T03:18:51.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.560+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec10d720 con 0x7fafec0fdc00 2023-12-16T03:18:51.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.560+0000 7fafdaffd700 1 -- 172.21.15.64:0/3781470743 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe001c3f0 con 0x7fafec0fdc00 2023-12-16T03:18:51.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.560+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec10dc60 con 0x7fafec0fdc00 2023-12-16T03:18:51.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.561+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec1041f0 con 0x7fafec0fdc00 2023-12-16T03:18:51.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.561+0000 7fafdaffd700 1 -- 172.21.15.64:0/3781470743 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fafe0013800 con 0x7fafec0fdc00 2023-12-16T03:18:51.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.561+0000 7fafdaffd700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fafd406cae0 0x7fafd406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:51.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.562+0000 7fafdaffd700 1 -- 172.21.15.64:0/3781470743 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fafe008cfa0 con 0x7fafec0fdc00 2023-12-16T03:18:51.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.562+0000 7fafe9d9b700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fafd406cae0 0x7fafd406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:51.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.562+0000 7fafe9d9b700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fafd406cae0 0x7fafd406ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fafec10eed0 tx=0x7fafdc00b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:51.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.566+0000 7fafdaffd700 1 -- 172.21.15.64:0/3781470743 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fafe005af00 con 0x7fafec0fdc00 2023-12-16T03:18:51.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:51 smithi184 ceph-mon[121180]: pgmap v56: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-16T03:18:51.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.853+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fafec10ec10 con 0x7fafec0fdc00 2023-12-16T03:18:51.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.853+0000 7fafdaffd700 1 -- 172.21.15.64:0/3781470743 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fafe005aa90 con 0x7fafec0fdc00 2023-12-16T03:18:51.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fafd406cae0 msgr2=0x7fafd406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:51.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fafd406cae0 0x7fafd406ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fafec10eed0 tx=0x7fafdc00b040 comp rx=0 tx=0).stop 2023-12-16T03:18:51.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 msgr2=0x7fafec113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:51.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 0x7fafec113630 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fafe000b3b0 tx=0x7fafe0009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:51.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 shutdown_connections 2023-12-16T03:18:51.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fafd406cae0 0x7fafd406ef90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:51.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafec0fdc00 0x7fafec113630 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:51.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 --2- 172.21.15.64:0/3781470743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafec0fe5a0 0x7fafec113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:51.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 >> 172.21.15.64:0/3781470743 conn(0x7fafec0f7690 msgr2=0x7fafec101370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:51.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 shutdown_connections 2023-12-16T03:18:51.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:51.856+0000 7faff0bd3700 1 -- 172.21.15.64:0/3781470743 wait complete. 2023-12-16T03:18:51.869 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:18:51.886 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:51 smithi064 ceph-mon[111958]: pgmap v56: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-16T03:18:52.248 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2023-12-16T03:18:52.524 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:18:52.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:52 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3781470743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:52.835 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:52 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3781470743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.602+0000 7f069e954700 1 -- 172.21.15.64:0/397605922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698065390 msgr2=0x7f0698065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.602+0000 7f069e954700 1 --2- 172.21.15.64:0/397605922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698065390 0x7f0698065800 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0680004940 tx=0x7f0680009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.602+0000 7f069e954700 1 -- 172.21.15.64:0/397605922 shutdown_connections 2023-12-16T03:18:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.602+0000 7f069e954700 1 --2- 172.21.15.64:0/397605922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698065390 0x7f0698065800 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.602+0000 7f069e954700 1 --2- 172.21.15.64:0/397605922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0698102c20 0x7f0698102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.602+0000 7f069e954700 1 -- 172.21.15.64:0/397605922 >> 172.21.15.64:0/397605922 conn(0x7f06980719b0 msgr2=0x7f0698071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.602+0000 7f069e954700 1 -- 172.21.15.64:0/397605922 shutdown_connections 2023-12-16T03:18:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.602+0000 7f069e954700 1 -- 172.21.15.64:0/397605922 wait complete. 2023-12-16T03:18:53.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f069e954700 1 Processor -- start 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f069e954700 1 -- start start 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f069e954700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0698065390 0x7f0698113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f069e954700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698102c20 0x7f0698113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f069e954700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06981142c0 con 0x7f0698102c20 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f069e954700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069810d5f0 con 0x7f0698065390 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f06977fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698102c20 0x7f0698113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f06977fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698102c20 0x7f0698113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54934/0 (socket says 172.21.15.64:54934) 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f06977fe700 1 -- 172.21.15.64:0/46034845 learned_addr learned my addr 172.21.15.64:0/46034845 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.603+0000 7f0697fff700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0698065390 0x7f0698113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.604+0000 7f06977fe700 1 -- 172.21.15.64:0/46034845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0698065390 msgr2=0x7f0698113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.604+0000 7f06977fe700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0698065390 0x7f0698113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:53.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.604+0000 7f06977fe700 1 -- 172.21.15.64:0/46034845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680005040 con 0x7f0698102c20 2023-12-16T03:18:53.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.604+0000 7f06977fe700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698102c20 0x7f0698113c70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f068000b3b0 tx=0x7f0680009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.604+0000 7f0694ff9700 1 -- 172.21.15.64:0/46034845 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f068000e040 con 0x7f0698102c20 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.604+0000 7f0694ff9700 1 -- 172.21.15.64:0/46034845 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f068001c430 con 0x7f0698102c20 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.604+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069810d870 con 0x7f0698102c20 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.604+0000 7f0694ff9700 1 -- 172.21.15.64:0/46034845 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0680013640 con 0x7f0698102c20 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.604+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069810ddb0 con 0x7f0698102c20 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.605+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06980fff40 con 0x7f0698102c20 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.606+0000 7f0694ff9700 1 -- 172.21.15.64:0/46034845 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f068001c5a0 con 0x7f0698102c20 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.606+0000 7f0694ff9700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f068406cae0 0x7f068406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.606+0000 7f0694ff9700 1 -- 172.21.15.64:0/46034845 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f068008c880 con 0x7f0698102c20 2023-12-16T03:18:53.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.606+0000 7f0697fff700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f068406cae0 0x7f068406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:53.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.607+0000 7f0697fff700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f068406cae0 0x7f068406ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0688004f40 tx=0x7f068800b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:53.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.611+0000 7f0694ff9700 1 -- 172.21.15.64:0/46034845 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f068005a7f0 con 0x7f0698102c20 2023-12-16T03:18:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:53 smithi064 ceph-mon[111958]: pgmap v57: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:53.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:53 smithi184 ceph-mon[121180]: pgmap v57: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:53.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.900+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f069804bb80 con 0x7f0698102c20 2023-12-16T03:18:53.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.901+0000 7f0694ff9700 1 -- 172.21.15.64:0/46034845 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f068005a380 con 0x7f0698102c20 2023-12-16T03:18:53.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f068406cae0 msgr2=0x7f068406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f068406cae0 0x7f068406ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0688004f40 tx=0x7f068800b040 comp rx=0 tx=0).stop 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698102c20 msgr2=0x7f0698113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698102c20 0x7f0698113c70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f068000b3b0 tx=0x7f0680009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 shutdown_connections 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f068406cae0 0x7f068406ef90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0698065390 0x7f0698113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 --2- 172.21.15.64:0/46034845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0698102c20 0x7f0698113c70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 >> 172.21.15.64:0/46034845 conn(0x7f06980719b0 msgr2=0x7f06980fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 shutdown_connections 2023-12-16T03:18:53.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:53.903+0000 7f069e954700 1 -- 172.21.15.64:0/46034845 wait complete. 2023-12-16T03:18:53.916 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)" 2023-12-16T03:18:54.311 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2023-12-16T03:18:54.586 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:18:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:54 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/46034845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:54.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:54 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/46034845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:55.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 -- 172.21.15.64:0/2705491577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 msgr2=0x7f954c106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 --2- 172.21.15.64:0/2705491577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 0x7f954c106ca0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9534004940 tx=0x7f9534009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 -- 172.21.15.64:0/2705491577 shutdown_connections 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 --2- 172.21.15.64:0/2705491577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 0x7f954c106ca0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 --2- 172.21.15.64:0/2705491577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f954c0fdc30 0x7f954c0fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 -- 172.21.15.64:0/2705491577 >> 172.21.15.64:0/2705491577 conn(0x7f954c0f7690 msgr2=0x7f954c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 -- 172.21.15.64:0/2705491577 shutdown_connections 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 -- 172.21.15.64:0/2705491577 wait complete. 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 Processor -- start 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.694+0000 7f9550a5c700 1 -- start start 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9550a5c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f954c0fdc30 0x7f954c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9550a5c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 0x7f954c113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9550a5c700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c1142e0 con 0x7f954c0fe5d0 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9550a5c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c10d610 con 0x7f954c0fdc30 2023-12-16T03:18:55.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9549d9b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 0x7f954c113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9549d9b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 0x7f954c113c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54952/0 (socket says 172.21.15.64:54952) 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9549d9b700 1 -- 172.21.15.64:0/957340248 learned_addr learned my addr 172.21.15.64:0/957340248 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f954a59c700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f954c0fdc30 0x7f954c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9549d9b700 1 -- 172.21.15.64:0/957340248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f954c0fdc30 msgr2=0x7f954c113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9549d9b700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f954c0fdc30 0x7f954c113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9549d9b700 1 -- 172.21.15.64:0/957340248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9534005040 con 0x7f954c0fe5d0 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f954a59c700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f954c0fdc30 0x7f954c113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.695+0000 7f9549d9b700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 0x7f954c113c90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f953400b3b0 tx=0x7f9534009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.696+0000 7f9542ffd700 1 -- 172.21.15.64:0/957340248 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953400e040 con 0x7f954c0fe5d0 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.696+0000 7f9542ffd700 1 -- 172.21.15.64:0/957340248 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9534009af0 con 0x7f954c0fe5d0 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.696+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c10d890 con 0x7f954c0fe5d0 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.696+0000 7f9542ffd700 1 -- 172.21.15.64:0/957340248 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953401c3f0 con 0x7f954c0fe5d0 2023-12-16T03:18:55.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.696+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c10ddd0 con 0x7f954c0fe5d0 2023-12-16T03:18:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.697+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c104360 con 0x7f954c0fe5d0 2023-12-16T03:18:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.697+0000 7f9542ffd700 1 -- 172.21.15.64:0/957340248 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f9534013420 con 0x7f954c0fe5d0 2023-12-16T03:18:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.697+0000 7f9542ffd700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f953806cae0 0x7f953806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.698+0000 7f9542ffd700 1 -- 172.21.15.64:0/957340248 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f953408d0f0 con 0x7f954c0fe5d0 2023-12-16T03:18:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.698+0000 7f954a59c700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f953806cae0 0x7f953806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:55.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.698+0000 7f954a59c700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f953806cae0 0x7f953806ef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f953c009fd0 tx=0x7f953c009ee0 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:55.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.702+0000 7f9542ffd700 1 -- 172.21.15.64:0/957340248 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f953405afb0 con 0x7f954c0fe5d0 2023-12-16T03:18:55.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:55 smithi184 ceph-mon[121180]: pgmap v58: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:55.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:55 smithi064 ceph-mon[111958]: pgmap v58: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:55.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.992+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f954c04bb80 con 0x7f954c0fe5d0 2023-12-16T03:18:55.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.992+0000 7f9542ffd700 1 -- 172.21.15.64:0/957340248 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f953405ab40 con 0x7f954c0fe5d0 2023-12-16T03:18:55.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.994+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f953806cae0 msgr2=0x7f953806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:55.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.994+0000 7f9550a5c700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f953806cae0 0x7f953806ef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f953c009fd0 tx=0x7f953c009ee0 comp rx=0 tx=0).stop 2023-12-16T03:18:55.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.994+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 msgr2=0x7f954c113c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:55.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.994+0000 7f9550a5c700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 0x7f954c113c90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f953400b3b0 tx=0x7f9534009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:55.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.994+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 shutdown_connections 2023-12-16T03:18:55.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.994+0000 7f9550a5c700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f953806cae0 0x7f953806ef90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:55.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.994+0000 7f9550a5c700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f954c0fdc30 0x7f954c113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:55.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.994+0000 7f9550a5c700 1 --2- 172.21.15.64:0/957340248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f954c0fe5d0 0x7f954c113c90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:55.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.994+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 >> 172.21.15.64:0/957340248 conn(0x7f954c0f7690 msgr2=0x7f954c1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:55.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.995+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 shutdown_connections 2023-12-16T03:18:55.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:55.995+0000 7f9550a5c700 1 -- 172.21.15.64:0/957340248 wait complete. 2023-12-16T03:18:56.006 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:18:56.405 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2023-12-16T03:18:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:18:56.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:56 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/957340248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:56 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/957340248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:18:57.641 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:57 smithi064 ceph-mon[111958]: pgmap v59: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:57 smithi184 ceph-mon[121180]: pgmap v59: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.839+0000 7f997028a700 1 -- 172.21.15.64:0/2823010991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968103590 msgr2=0x7f99680fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.839+0000 7f997028a700 1 --2- 172.21.15.64:0/2823010991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968103590 0x7f99680fcc00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9958004940 tx=0x7f9958009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 -- 172.21.15.64:0/2823010991 shutdown_connections 2023-12-16T03:18:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 --2- 172.21.15.64:0/2823010991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968103590 0x7f99680fcc00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 --2- 172.21.15.64:0/2823010991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9968102bf0 0x7f9968102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 -- 172.21.15.64:0/2823010991 >> 172.21.15.64:0/2823010991 conn(0x7f99680f87a0 msgr2=0x7f99680fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 -- 172.21.15.64:0/2823010991 shutdown_connections 2023-12-16T03:18:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 -- 172.21.15.64:0/2823010991 wait complete. 2023-12-16T03:18:57.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 Processor -- start 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 -- start start 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968102bf0 0x7f996806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9968103590 0x7f9968070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9968070a80 con 0x7f9968102bf0 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.840+0000 7f997028a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9968070bf0 con 0x7f9968103590 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f996e026700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968102bf0 0x7f996806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f996e026700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968102bf0 0x7f996806ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54972/0 (socket says 172.21.15.64:54972) 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f996e026700 1 -- 172.21.15.64:0/3007591187 learned_addr learned my addr 172.21.15.64:0/3007591187 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f996d825700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9968103590 0x7f9968070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f996e026700 1 -- 172.21.15.64:0/3007591187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9968103590 msgr2=0x7f9968070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f996e026700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9968103590 0x7f9968070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f996e026700 1 -- 172.21.15.64:0/3007591187 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958005040 con 0x7f9968102bf0 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f996e026700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968102bf0 0x7f996806ff40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9964002a50 tx=0x7f99640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:57.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f995effd700 1 -- 172.21.15.64:0/3007591187 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9964007cc0 con 0x7f9968102bf0 2023-12-16T03:18:57.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f995effd700 1 -- 172.21.15.64:0/3007591187 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f996400f040 con 0x7f9968102bf0 2023-12-16T03:18:57.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9968119920 con 0x7f9968102bf0 2023-12-16T03:18:57.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f995effd700 1 -- 172.21.15.64:0/3007591187 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f996400d9c0 con 0x7f9968102bf0 2023-12-16T03:18:57.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.841+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9968119dd0 con 0x7f9968102bf0 2023-12-16T03:18:57.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.842+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99681050c0 con 0x7f9968102bf0 2023-12-16T03:18:57.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.843+0000 7f995effd700 1 -- 172.21.15.64:0/3007591187 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f996400db20 con 0x7f9968102bf0 2023-12-16T03:18:57.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.843+0000 7f995effd700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f995406cae0 0x7f995406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:18:57.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.843+0000 7f995effd700 1 -- 172.21.15.64:0/3007591187 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f996408b9b0 con 0x7f9968102bf0 2023-12-16T03:18:57.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.843+0000 7f996d825700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f995406cae0 0x7f995406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:18:57.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.844+0000 7f996d825700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f995406cae0 0x7f995406ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9968072050 tx=0x7f9958009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:18:57.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:57.848+0000 7f995effd700 1 -- 172.21.15.64:0/3007591187 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9964055de0 con 0x7f9968102bf0 2023-12-16T03:18:58.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:58.068+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}) v1 -- 0x7f9968071680 con 0x7f995406cae0 2023-12-16T03:18:59.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.588+0000 7f995effd700 1 -- 172.21.15.64:0/3007591187 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5090 (secure 0 0 0) 0x7f9968071680 con 0x7f995406cae0 2023-12-16T03:18:59.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f995406cae0 msgr2=0x7f995406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:59.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f995406cae0 0x7f995406ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9968072050 tx=0x7f9958009e30 comp rx=0 tx=0).stop 2023-12-16T03:18:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968102bf0 msgr2=0x7f996806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:18:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968102bf0 0x7f996806ff40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9964002a50 tx=0x7f99640046b0 comp rx=0 tx=0).stop 2023-12-16T03:18:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 shutdown_connections 2023-12-16T03:18:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f995406cae0 0x7f995406ef90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9968102bf0 0x7f996806ff40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 --2- 172.21.15.64:0/3007591187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9968103590 0x7f9968070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:18:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 >> 172.21.15.64:0/3007591187 conn(0x7f99680f87a0 msgr2=0x7f99680fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:18:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 shutdown_connections 2023-12-16T03:18:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:18:59.590+0000 7f997028a700 1 -- 172.21.15.64:0/3007591187 wait complete. 2023-12-16T03:18:59.602 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:18:59.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:59 smithi064 ceph-mon[111958]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:59.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:18:59 smithi064 ceph-mon[111958]: pgmap v60: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:18:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:59 smithi184 ceph-mon[121180]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:18:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:18:59 smithi184 ceph-mon[121180]: pgmap v60: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:00.052 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch ps' 2023-12-16T03:19:00.326 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:19:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 -- 172.21.15.64:0/3894812016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 msgr2=0x7fd13c102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 --2- 172.21.15.64:0/3894812016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 0x7fd13c102fc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd12c004940 tx=0x7fd12c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 -- 172.21.15.64:0/3894812016 shutdown_connections 2023-12-16T03:19:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 --2- 172.21.15.64:0/3894812016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd13c103590 0x7fd13c0fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 --2- 172.21.15.64:0/3894812016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 0x7fd13c102fc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 -- 172.21.15.64:0/3894812016 >> 172.21.15.64:0/3894812016 conn(0x7fd13c0f87a0 msgr2=0x7fd13c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 -- 172.21.15.64:0/3894812016 shutdown_connections 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 -- 172.21.15.64:0/3894812016 wait complete. 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 Processor -- start 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.655+0000 7fd14250b700 1 -- start start 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd14250b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 0x7fd13c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd14250b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd13c103590 0x7fd13c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd14250b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c070a80 con 0x7fd13c102bf0 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd14250b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c070bf0 con 0x7fd13c103590 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd13bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 0x7fd13c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd13bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 0x7fd13c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54994/0 (socket says 172.21.15.64:54994) 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd13bfff700 1 -- 172.21.15.64:0/464598688 learned_addr learned my addr 172.21.15.64:0/464598688 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd13b7fe700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd13c103590 0x7fd13c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd13bfff700 1 -- 172.21.15.64:0/464598688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd13c103590 msgr2=0x7fd13c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd13bfff700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd13c103590 0x7fd13c070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd13bfff700 1 -- 172.21.15.64:0/464598688 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c005040 con 0x7fd13c102bf0 2023-12-16T03:19:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd13bfff700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 0x7fd13c06ff40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00b3b0 tx=0x7fd12c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd138ff9700 1 -- 172.21.15.64:0/464598688 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12c00e040 con 0x7fd13c102bf0 2023-12-16T03:19:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd138ff9700 1 -- 172.21.15.64:0/464598688 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd12c00bc50 con 0x7fd13c102bf0 2023-12-16T03:19:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c119850 con 0x7fd13c102bf0 2023-12-16T03:19:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd138ff9700 1 -- 172.21.15.64:0/464598688 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12c013420 con 0x7fd13c102bf0 2023-12-16T03:19:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.656+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c119cb0 con 0x7fd13c102bf0 2023-12-16T03:19:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.658+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c0fff00 con 0x7fd13c102bf0 2023-12-16T03:19:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.658+0000 7fd138ff9700 1 -- 172.21.15.64:0/464598688 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fd12c01c430 con 0x7fd13c102bf0 2023-12-16T03:19:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.658+0000 7fd138ff9700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd12406cae0 0x7fd12406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.659+0000 7fd138ff9700 1 -- 172.21.15.64:0/464598688 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd12c08ca50 con 0x7fd13c102bf0 2023-12-16T03:19:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.659+0000 7fd13b7fe700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd12406cae0 0x7fd12406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.659+0000 7fd13b7fe700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd12406cae0 0x7fd12406ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd13c071940 tx=0x7fd130009ee0 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:01.664 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.663+0000 7fd138ff9700 1 -- 172.21.15.64:0/464598688 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd12c056fd0 con 0x7fd13c102bf0 2023-12-16T03:19:01.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:01 smithi064 ceph-mon[111958]: pgmap v61: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:01.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:01 smithi184 ceph-mon[121180]: pgmap v61: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:01.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.874+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd13c071680 con 0x7fd12406cae0 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.884+0000 7fd138ff9700 1 -- 172.21.15.64:0/464598688 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd13c071680 con 0x7fd12406cae0 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (60s) 42s ago 8m 17.6M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (9m) 42s ago 9m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (8m) 81s ago 8m 7482k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (46s) 42s ago 8m 51.6M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (5m) 42s ago 5m 14.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (5m) 42s ago 5m 6643M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (5m) 81s ago 5m 4651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (4m) 81s ago 4m 15.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:19:01.886 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (2m) 42s ago 10m 507M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (100s) 81s ago 8m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (10m) 42s ago 10m 98.0M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (8m) 81s ago 8m 66.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (87s) 42s ago 9m 15.4M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (84s) 81s ago 8m 8564k - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (7m) 42s ago 7m 762M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (7m) 42s ago 7m 835M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (7m) 42s ago 7m 639M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (6m) 81s ago 6m 959M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (6m) 81s ago 6m 763M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (6m) 81s ago 6m 844M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:19:01.887 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (72s) 42s ago 8m 45.3M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:19:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd12406cae0 msgr2=0x7fd12406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd12406cae0 0x7fd12406ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd13c071940 tx=0x7fd130009ee0 comp rx=0 tx=0).stop 2023-12-16T03:19:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 msgr2=0x7fd13c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 0x7fd13c06ff40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00b3b0 tx=0x7fd12c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 shutdown_connections 2023-12-16T03:19:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd12406cae0 0x7fd12406ef90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd13c102bf0 0x7fd13c06ff40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 --2- 172.21.15.64:0/464598688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd13c103590 0x7fd13c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 >> 172.21.15.64:0/464598688 conn(0x7fd13c0f87a0 msgr2=0x7fd13c0fa340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.886+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 shutdown_connections 2023-12-16T03:19:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:01.887+0000 7fd14250b700 1 -- 172.21.15.64:0/464598688 wait complete. 2023-12-16T03:19:02.286 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T03:19:02.287 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:19:02.287 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2023-12-16T03:19:02.566 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:19:03.665 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.662+0000 7f090796e700 1 -- 172.21.15.64:0/2018816562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09001035a0 msgr2=0x7f09000fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.662+0000 7f090796e700 1 --2- 172.21.15.64:0/2018816562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09001035a0 0x7f09000fcc10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f08f0004940 tx=0x7f08f0009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.662+0000 7f090796e700 1 -- 172.21.15.64:0/2018816562 shutdown_connections 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.662+0000 7f090796e700 1 --2- 172.21.15.64:0/2018816562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09001035a0 0x7f09000fcc10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.662+0000 7f090796e700 1 --2- 172.21.15.64:0/2018816562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0900102c00 0x7f0900102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.662+0000 7f090796e700 1 -- 172.21.15.64:0/2018816562 >> 172.21.15.64:0/2018816562 conn(0x7f09000f8790 msgr2=0x7f09000faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.662+0000 7f090796e700 1 -- 172.21.15.64:0/2018816562 shutdown_connections 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.662+0000 7f090796e700 1 -- 172.21.15.64:0/2018816562 wait complete. 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090796e700 1 Processor -- start 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090796e700 1 -- start start 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090796e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900102c00 0x7f0900113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090796e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09001035a0 0x7f0900113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090796e700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900114210 con 0x7f0900102c00 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090796e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090010d500 con 0x7f09001035a0 2023-12-16T03:19:03.666 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090570a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900102c00 0x7f0900113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090570a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900102c00 0x7f0900113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45366/0 (socket says 172.21.15.64:45366) 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090570a700 1 -- 172.21.15.64:0/3207142314 learned_addr learned my addr 172.21.15.64:0/3207142314 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f0904f09700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09001035a0 0x7f0900113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090570a700 1 -- 172.21.15.64:0/3207142314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09001035a0 msgr2=0x7f0900113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090570a700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09001035a0 0x7f0900113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.663+0000 7f090570a700 1 -- 172.21.15.64:0/3207142314 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0005040 con 0x7f0900102c00 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.664+0000 7f090570a700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900102c00 0x7f0900113680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f08fc002a50 tx=0x7f08fc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.664+0000 7f08f5ffb700 1 -- 172.21.15.64:0/3207142314 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08fc007cc0 con 0x7f0900102c00 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.664+0000 7f08f5ffb700 1 -- 172.21.15.64:0/3207142314 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f08fc00f040 con 0x7f0900102c00 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.664+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090010d7e0 con 0x7f0900102c00 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.664+0000 7f08f5ffb700 1 -- 172.21.15.64:0/3207142314 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08fc00d9c0 con 0x7f0900102c00 2023-12-16T03:19:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.664+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090010dd20 con 0x7f0900102c00 2023-12-16T03:19:03.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.665+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0900113330 con 0x7f0900102c00 2023-12-16T03:19:03.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.665+0000 7f08f5ffb700 1 -- 172.21.15.64:0/3207142314 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f08fc00db20 con 0x7f0900102c00 2023-12-16T03:19:03.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.666+0000 7f08f5ffb700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f08ec06cae0 0x7f08ec06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:03.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.666+0000 7f08f5ffb700 1 -- 172.21.15.64:0/3207142314 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f08fc08b9b0 con 0x7f0900102c00 2023-12-16T03:19:03.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.666+0000 7f0904f09700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f08ec06cae0 0x7f08ec06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:03.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.666+0000 7f0904f09700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f08ec06cae0 0x7f08ec06ef90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f090010eee0 tx=0x7f08f0009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:03.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.670+0000 7f08f5ffb700 1 -- 172.21.15.64:0/3207142314 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f08fc059870 con 0x7f0900102c00 2023-12-16T03:19:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:03 smithi184 ceph-mon[121180]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:03 smithi184 ceph-mon[121180]: pgmap v62: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:03.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.871+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f09001050d0 con 0x7f0900102c00 2023-12-16T03:19:03.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.877+0000 7f08f5ffb700 1 -- 172.21.15.64:0/3207142314 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f08fc059400 con 0x7f0900102c00 2023-12-16T03:19:03.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.879+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f08ec06cae0 msgr2=0x7f08ec06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:03.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.879+0000 7f090796e700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f08ec06cae0 0x7f08ec06ef90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f090010eee0 tx=0x7f08f0009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:03.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.879+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900102c00 msgr2=0x7f0900113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:03.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.879+0000 7f090796e700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900102c00 0x7f0900113680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f08fc002a50 tx=0x7f08fc0046b0 comp rx=0 tx=0).stop 2023-12-16T03:19:03.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.880+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 shutdown_connections 2023-12-16T03:19:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.880+0000 7f090796e700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f08ec06cae0 0x7f08ec06ef90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.880+0000 7f090796e700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900102c00 0x7f0900113680 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.880+0000 7f090796e700 1 --2- 172.21.15.64:0/3207142314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09001035a0 0x7f0900113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.880+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 >> 172.21.15.64:0/3207142314 conn(0x7f09000f8790 msgr2=0x7f09000fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.880+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 shutdown_connections 2023-12-16T03:19:03.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:03.880+0000 7f090796e700 1 -- 172.21.15.64:0/3207142314 wait complete. 2023-12-16T03:19:03.885 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:03 smithi064 ceph-mon[111958]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:03.885 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:03 smithi064 ceph-mon[111958]: pgmap v62: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:04.287 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T03:19:04.288 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:19:04.288 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-16T03:19:04.569 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:19:05.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:04 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3207142314' entity='client.admin' 2023-12-16T03:19:05.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:04 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:05.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:04 smithi064 ceph-mon[111958]: pgmap v63: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:05.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:04 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:05.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:04 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:19:05.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:04 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:05.065 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:04 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:19:05.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:04 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3207142314' entity='client.admin' 2023-12-16T03:19:05.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:04 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:05.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:04 smithi184 ceph-mon[121180]: pgmap v63: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:05.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:04 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:05.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:04 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:19:05.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:04 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:05.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:04 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:19:05.657 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.654+0000 7f27d3c74700 1 -- 172.21.15.64:0/4228596531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 msgr2=0x7f27cc0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.654+0000 7f27d3c74700 1 --2- 172.21.15.64:0/4228596531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 0x7f27cc0fbf00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f27c8004940 tx=0x7f27c8009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.654+0000 7f27d3c74700 1 -- 172.21.15.64:0/4228596531 shutdown_connections 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.654+0000 7f27d3c74700 1 --2- 172.21.15.64:0/4228596531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 0x7f27cc0fbf00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.654+0000 7f27d3c74700 1 --2- 172.21.15.64:0/4228596531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc101ad0 0x7f27cc101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.654+0000 7f27d3c74700 1 -- 172.21.15.64:0/4228596531 >> 172.21.15.64:0/4228596531 conn(0x7f27cc071970 msgr2=0x7f27cc071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d3c74700 1 -- 172.21.15.64:0/4228596531 shutdown_connections 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d3c74700 1 -- 172.21.15.64:0/4228596531 wait complete. 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d3c74700 1 Processor -- start 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d3c74700 1 -- start start 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d3c74700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 0x7f27cc10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d3c74700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc101ad0 0x7f27cc10eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d3c74700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc10f140 con 0x7f27cc0fba90 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d3c74700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc117420 con 0x7f27cc101ad0 2023-12-16T03:19:05.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d1a10700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 0x7f27cc10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d1a10700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 0x7f27cc10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45376/0 (socket says 172.21.15.64:45376) 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d1a10700 1 -- 172.21.15.64:0/1991568322 learned_addr learned my addr 172.21.15.64:0/1991568322 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.655+0000 7f27d120f700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc101ad0 0x7f27cc10eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.656+0000 7f27d1a10700 1 -- 172.21.15.64:0/1991568322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc101ad0 msgr2=0x7f27cc10eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.656+0000 7f27d1a10700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc101ad0 0x7f27cc10eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.656+0000 7f27d1a10700 1 -- 172.21.15.64:0/1991568322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8005040 con 0x7f27cc0fba90 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.656+0000 7f27d1a10700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 0x7f27cc10e570 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00b790 tx=0x7f27bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.656+0000 7f27c27fc700 1 -- 172.21.15.64:0/1991568322 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27bc00f770 con 0x7f27cc0fba90 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.656+0000 7f27c27fc700 1 -- 172.21.15.64:0/1991568322 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27bc00fd80 con 0x7f27cc0fba90 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.656+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27cc117620 con 0x7f27cc0fba90 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.656+0000 7f27c27fc700 1 -- 172.21.15.64:0/1991568322 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27bc00d310 con 0x7f27cc0fba90 2023-12-16T03:19:05.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.656+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc117b30 con 0x7f27cc0fba90 2023-12-16T03:19:05.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.657+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc075970 con 0x7f27cc0fba90 2023-12-16T03:19:05.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.658+0000 7f27c27fc700 1 -- 172.21.15.64:0/1991568322 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f27bc010420 con 0x7f27cc0fba90 2023-12-16T03:19:05.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.658+0000 7f27c27fc700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f27b806cae0 0x7f27b806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:05.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.658+0000 7f27d120f700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f27b806cae0 0x7f27b806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:05.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.658+0000 7f27c27fc700 1 -- 172.21.15.64:0/1991568322 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f27bc08bd10 con 0x7f27cc0fba90 2023-12-16T03:19:05.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.659+0000 7f27d120f700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f27b806cae0 0x7f27b806ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27c8004f90 tx=0x7f27c8009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:05.664 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.663+0000 7f27c27fc700 1 -- 172.21.15.64:0/1991568322 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f27bc056140 con 0x7f27cc0fba90 2023-12-16T03:19:05.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.865+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f27cc065c70 con 0x7f27cc0fba90 2023-12-16T03:19:05.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.866+0000 7f27c27fc700 1 -- 172.21.15.64:0/1991568322 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f27bc059760 con 0x7f27cc0fba90 2023-12-16T03:19:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.867+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f27b806cae0 msgr2=0x7f27b806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.867+0000 7f27d3c74700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f27b806cae0 0x7f27b806ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27c8004f90 tx=0x7f27c8009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.867+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 msgr2=0x7f27cc10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.867+0000 7f27d3c74700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 0x7f27cc10e570 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00b790 tx=0x7f27bc009250 comp rx=0 tx=0).stop 2023-12-16T03:19:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.867+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 shutdown_connections 2023-12-16T03:19:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.867+0000 7f27d3c74700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f27b806cae0 0x7f27b806ef90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.867+0000 7f27d3c74700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27cc0fba90 0x7f27cc10e570 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:05.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.867+0000 7f27d3c74700 1 --2- 172.21.15.64:0/1991568322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc101ad0 0x7f27cc10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:05.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.867+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 >> 172.21.15.64:0/1991568322 conn(0x7f27cc071970 msgr2=0x7f27cc0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:05.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.868+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 shutdown_connections 2023-12-16T03:19:05.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:05.868+0000 7f27d3c74700 1 -- 172.21.15.64:0/1991568322 wait complete. 2023-12-16T03:19:06.269 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-16T03:19:06.543 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:19:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.624+0000 7f5138376700 1 -- 172.21.15.64:0/1427581656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 msgr2=0x7f51300fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.624+0000 7f5138376700 1 --2- 172.21.15.64:0/1427581656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 0x7f51300fbfb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5120004940 tx=0x7f5120009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.624+0000 7f5138376700 1 -- 172.21.15.64:0/1427581656 shutdown_connections 2023-12-16T03:19:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.624+0000 7f5138376700 1 --2- 172.21.15.64:0/1427581656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 0x7f51300fbfb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.624+0000 7f5138376700 1 --2- 172.21.15.64:0/1427581656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5130101b00 0x7f5130101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.624+0000 7f5138376700 1 -- 172.21.15.64:0/1427581656 >> 172.21.15.64:0/1427581656 conn(0x7f51300719b0 msgr2=0x7f5130071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.624+0000 7f5138376700 1 -- 172.21.15.64:0/1427581656 shutdown_connections 2023-12-16T03:19:07.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.624+0000 7f5138376700 1 -- 172.21.15.64:0/1427581656 wait complete. 2023-12-16T03:19:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.625+0000 7f5138376700 1 Processor -- start 2023-12-16T03:19:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.625+0000 7f5138376700 1 -- start start 2023-12-16T03:19:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.625+0000 7f5138376700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 0x7f5130112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.625+0000 7f5138376700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5130101b00 0x7f5130112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.625+0000 7f5138376700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51301131d0 con 0x7f51300fbb40 2023-12-16T03:19:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.625+0000 7f5138376700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513010c4c0 con 0x7f5130101b00 2023-12-16T03:19:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.625+0000 7f5136112700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 0x7f5130112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.625+0000 7f5136112700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 0x7f5130112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45382/0 (socket says 172.21.15.64:45382) 2023-12-16T03:19:07.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.625+0000 7f5136112700 1 -- 172.21.15.64:0/1209300831 learned_addr learned my addr 172.21.15.64:0/1209300831 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5135911700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5130101b00 0x7f5130112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5136112700 1 -- 172.21.15.64:0/1209300831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5130101b00 msgr2=0x7f5130112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5136112700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5130101b00 0x7f5130112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5136112700 1 -- 172.21.15.64:0/1209300831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5120005040 con 0x7f51300fbb40 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5135911700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5130101b00 0x7f5130112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5136112700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 0x7f5130112640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f512c00fce0 tx=0x7f512c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5126ffd700 1 -- 172.21.15.64:0/1209300831 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512c00fe90 con 0x7f51300fbb40 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5126ffd700 1 -- 172.21.15.64:0/1209300831 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f512c0090d0 con 0x7f51300fbb40 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513010c740 con 0x7f51300fbb40 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5126ffd700 1 -- 172.21.15.64:0/1209300831 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512c0126a0 con 0x7f51300fbb40 2023-12-16T03:19:07.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.626+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513010cc80 con 0x7f51300fbb40 2023-12-16T03:19:07.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.627+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51301122f0 con 0x7f51300fbb40 2023-12-16T03:19:07.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.628+0000 7f5126ffd700 1 -- 172.21.15.64:0/1209300831 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f512c009240 con 0x7f51300fbb40 2023-12-16T03:19:07.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.628+0000 7f5126ffd700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f511c06cae0 0x7f511c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:07.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.628+0000 7f5126ffd700 1 -- 172.21.15.64:0/1209300831 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f512c08e460 con 0x7f51300fbb40 2023-12-16T03:19:07.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.628+0000 7f5135911700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f511c06cae0 0x7f511c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:07.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.629+0000 7f5135911700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f511c06cae0 0x7f511c06ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5120009fd0 tx=0x7f5120009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:07.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.633+0000 7f5126ffd700 1 -- 172.21.15.64:0/1209300831 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f512c05c320 con 0x7f51300fbb40 2023-12-16T03:19:07.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:07 smithi064 ceph-mon[111958]: pgmap v64: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:07.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:07 smithi184 ceph-mon[121180]: pgmap v64: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:07.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.838+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f51300734d0 con 0x7f51300fbb40 2023-12-16T03:19:07.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.838+0000 7f5126ffd700 1 -- 172.21.15.64:0/1209300831 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f512c05beb0 con 0x7f51300fbb40 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f511c06cae0 msgr2=0x7f511c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f511c06cae0 0x7f511c06ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5120009fd0 tx=0x7f5120009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 msgr2=0x7f5130112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 0x7f5130112640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f512c00fce0 tx=0x7f512c0046b0 comp rx=0 tx=0).stop 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 shutdown_connections 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f511c06cae0 0x7f511c06ef90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51300fbb40 0x7f5130112640 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 --2- 172.21.15.64:0/1209300831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5130101b00 0x7f5130112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 >> 172.21.15.64:0/1209300831 conn(0x7f51300719b0 msgr2=0x7f51300fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 shutdown_connections 2023-12-16T03:19:07.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:07.840+0000 7f5138376700 1 -- 172.21.15.64:0/1209300831 wait complete. 2023-12-16T03:19:08.221 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-16T03:19:08.497 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.618+0000 7fda1680b700 1 -- 172.21.15.64:0/1451829429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 msgr2=0x7fda100fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.618+0000 7fda1680b700 1 --2- 172.21.15.64:0/1451829429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 0x7fda100fbf70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fda04004940 tx=0x7fda04009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.618+0000 7fda1680b700 1 -- 172.21.15.64:0/1451829429 shutdown_connections 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.618+0000 7fda1680b700 1 --2- 172.21.15.64:0/1451829429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 0x7fda100fbf70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.618+0000 7fda1680b700 1 --2- 172.21.15.64:0/1451829429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda10101b60 0x7fda10101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.618+0000 7fda1680b700 1 -- 172.21.15.64:0/1451829429 >> 172.21.15.64:0/1451829429 conn(0x7fda100f7680 msgr2=0x7fda100f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.618+0000 7fda1680b700 1 -- 172.21.15.64:0/1451829429 shutdown_connections 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.618+0000 7fda1680b700 1 -- 172.21.15.64:0/1451829429 wait complete. 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.619+0000 7fda1680b700 1 Processor -- start 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.619+0000 7fda1680b700 1 -- start start 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.619+0000 7fda1680b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 0x7fda100fd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:09.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.619+0000 7fda1680b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda10101b60 0x7fda100fdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.619+0000 7fda1680b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100fe210 con 0x7fda100fbb00 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.619+0000 7fda1680b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100fe380 con 0x7fda10101b60 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.619+0000 7fda0ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 0x7fda100fd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.619+0000 7fda0ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 0x7fda100fd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45394/0 (socket says 172.21.15.64:45394) 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.619+0000 7fda0ffff700 1 -- 172.21.15.64:0/1338474489 learned_addr learned my addr 172.21.15.64:0/1338474489 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda0f7fe700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda10101b60 0x7fda100fdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda0ffff700 1 -- 172.21.15.64:0/1338474489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda10101b60 msgr2=0x7fda100fdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda0ffff700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda10101b60 0x7fda100fdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda0ffff700 1 -- 172.21.15.64:0/1338474489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04005040 con 0x7fda100fbb00 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda0f7fe700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda10101b60 0x7fda100fdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda0ffff700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 0x7fda100fd6d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c8c0 tx=0x7fda000044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda0cff9700 1 -- 172.21.15.64:0/1338474489 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0000a980 con 0x7fda100fbb00 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda0cff9700 1 -- 172.21.15.64:0/1338474489 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda0000ce60 con 0x7fda100fbb00 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda10119900 con 0x7fda100fbb00 2023-12-16T03:19:09.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda0cff9700 1 -- 172.21.15.64:0/1338474489 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda000113a0 con 0x7fda100fbb00 2023-12-16T03:19:09.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.620+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda10119de0 con 0x7fda100fbb00 2023-12-16T03:19:09.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.621+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda10104f50 con 0x7fda100fbb00 2023-12-16T03:19:09.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.622+0000 7fda0cff9700 1 -- 172.21.15.64:0/1338474489 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fda00012400 con 0x7fda100fbb00 2023-12-16T03:19:09.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.622+0000 7fda0cff9700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd9f806cae0 0x7fd9f806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:09.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.622+0000 7fda0cff9700 1 -- 172.21.15.64:0/1338474489 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fda0008bd60 con 0x7fda100fbb00 2023-12-16T03:19:09.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.622+0000 7fda0f7fe700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd9f806cae0 0x7fd9f806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:09.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.623+0000 7fda0f7fe700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd9f806cae0 0x7fd9f806ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda04009fd0 tx=0x7fda04009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:09.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.626+0000 7fda0cff9700 1 -- 172.21.15.64:0/1338474489 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fda00056230 con 0x7fda100fbb00 2023-12-16T03:19:09.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:09 smithi064 ceph-mon[111958]: pgmap v65: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:09.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:09 smithi184 ceph-mon[121180]: pgmap v65: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:09.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.828+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fda100fb280 con 0x7fda100fbb00 2023-12-16T03:19:09.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.828+0000 7fda0cff9700 1 -- 172.21.15.64:0/1338474489 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7fda00059850 con 0x7fda100fbb00 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd9f806cae0 msgr2=0x7fd9f806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd9f806cae0 0x7fd9f806ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda04009fd0 tx=0x7fda04009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 msgr2=0x7fda100fd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 0x7fda100fd6d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c8c0 tx=0x7fda000044c0 comp rx=0 tx=0).stop 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 shutdown_connections 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fd9f806cae0 0x7fd9f806ef90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda100fbb00 0x7fda100fd6d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 --2- 172.21.15.64:0/1338474489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda10101b60 0x7fda100fdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 >> 172.21.15.64:0/1338474489 conn(0x7fda100f7680 msgr2=0x7fda10065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 shutdown_connections 2023-12-16T03:19:09.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:09.830+0000 7fda1680b700 1 -- 172.21.15.64:0/1338474489 wait complete. 2023-12-16T03:19:10.229 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-16T03:19:10.506 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.685+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/2485109890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f8101b00 msgr2=0x7ff2f8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.685+0000 7ff2ff4c1700 1 --2- 172.21.15.64:0/2485109890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f8101b00 0x7ff2f8101ed0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4004940 tx=0x7ff2f4009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.685+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/2485109890 shutdown_connections 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.685+0000 7ff2ff4c1700 1 --2- 172.21.15.64:0/2485109890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2f80fbb40 0x7ff2f80fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.685+0000 7ff2ff4c1700 1 --2- 172.21.15.64:0/2485109890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f8101b00 0x7ff2f8101ed0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.685+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/2485109890 >> 172.21.15.64:0/2485109890 conn(0x7ff2f80719b0 msgr2=0x7ff2f8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.685+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/2485109890 shutdown_connections 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.685+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/2485109890 wait complete. 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2ff4c1700 1 Processor -- start 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2ff4c1700 1 -- start start 2023-12-16T03:19:11.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2ff4c1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f80fbb40 0x7ff2f810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2ff4c1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2f8101b00 0x7ff2f810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2ff4c1700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f810f1c0 con 0x7ff2f80fbb40 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2ff4c1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f810f300 con 0x7ff2f8101b00 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2fd25d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f80fbb40 0x7ff2f810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2fd25d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f80fbb40 0x7ff2f810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45400/0 (socket says 172.21.15.64:45400) 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2fd25d700 1 -- 172.21.15.64:0/3462394207 learned_addr learned my addr 172.21.15.64:0/3462394207 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.686+0000 7ff2fca5c700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2f8101b00 0x7ff2f810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.687+0000 7ff2fd25d700 1 -- 172.21.15.64:0/3462394207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2f8101b00 msgr2=0x7ff2f810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.687+0000 7ff2fd25d700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2f8101b00 0x7ff2f810ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.687+0000 7ff2fd25d700 1 -- 172.21.15.64:0/3462394207 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f4005040 con 0x7ff2f80fbb40 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.687+0000 7ff2fd25d700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f80fbb40 0x7ff2f810e6f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400b3b0 tx=0x7ff2f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.687+0000 7ff2edffb700 1 -- 172.21.15.64:0/3462394207 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f400e040 con 0x7ff2f80fbb40 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.687+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f8117600 con 0x7ff2f80fbb40 2023-12-16T03:19:11.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.687+0000 7ff2edffb700 1 -- 172.21.15.64:0/3462394207 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff2f400bc50 con 0x7ff2f80fbb40 2023-12-16T03:19:11.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.687+0000 7ff2edffb700 1 -- 172.21.15.64:0/3462394207 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f4013420 con 0x7ff2f80fbb40 2023-12-16T03:19:11.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.687+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f8117b10 con 0x7ff2f80fbb40 2023-12-16T03:19:11.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.688+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f8103fb0 con 0x7ff2f80fbb40 2023-12-16T03:19:11.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.689+0000 7ff2edffb700 1 -- 172.21.15.64:0/3462394207 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7ff2f401c430 con 0x7ff2f80fbb40 2023-12-16T03:19:11.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.689+0000 7ff2edffb700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7ff2e406cae0 0x7ff2e406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:11.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.689+0000 7ff2edffb700 1 -- 172.21.15.64:0/3462394207 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff2f408cb10 con 0x7ff2f80fbb40 2023-12-16T03:19:11.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.689+0000 7ff2fca5c700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7ff2e406cae0 0x7ff2e406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:11.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.689+0000 7ff2fca5c700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7ff2e406cae0 0x7ff2e406ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8007fd0 tx=0x7ff2e8009040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:11.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.694+0000 7ff2edffb700 1 -- 172.21.15.64:0/3462394207 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff2f4056ff0 con 0x7ff2f80fbb40 2023-12-16T03:19:11.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:11 smithi184 ceph-mon[121180]: pgmap v66: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:11.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.913+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2f8065b70 con 0x7ff2e406cae0 2023-12-16T03:19:11.920 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.918+0000 7ff2edffb700 1 -- 172.21.15.64:0/3462394207 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff2f8065b70 con 0x7ff2e406cae0 2023-12-16T03:19:11.920 INFO:teuthology.orchestra.run.smithi064.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:19:11.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.920+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7ff2e406cae0 msgr2=0x7ff2e406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:11.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.920+0000 7ff2ff4c1700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7ff2e406cae0 0x7ff2e406ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8007fd0 tx=0x7ff2e8009040 comp rx=0 tx=0).stop 2023-12-16T03:19:11.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.920+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f80fbb40 msgr2=0x7ff2f810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:11.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.920+0000 7ff2ff4c1700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f80fbb40 0x7ff2f810e6f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400b3b0 tx=0x7ff2f4009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:11.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.921+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 shutdown_connections 2023-12-16T03:19:11.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.921+0000 7ff2ff4c1700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7ff2e406cae0 0x7ff2e406ef90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:11.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.921+0000 7ff2ff4c1700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2f80fbb40 0x7ff2f810e6f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:11.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.921+0000 7ff2ff4c1700 1 --2- 172.21.15.64:0/3462394207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2f8101b00 0x7ff2f810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:11.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.921+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 >> 172.21.15.64:0/3462394207 conn(0x7ff2f80719b0 msgr2=0x7ff2f80fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:11.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.921+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 shutdown_connections 2023-12-16T03:19:11.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:11.921+0000 7ff2ff4c1700 1 -- 172.21.15.64:0/3462394207 wait complete. 2023-12-16T03:19:11.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:11 smithi064 ceph-mon[111958]: pgmap v66: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:12.357 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T03:19:12.357 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:19:12.357 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-16T03:19:12.674 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:19:13.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:12 smithi064 ceph-mon[111958]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:13.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:12 smithi064 ceph-mon[111958]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:19:13.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:12 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:13.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:12 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:13.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:12 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:13.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:12 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:19:13.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:12 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:13.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:12 smithi064 ceph-mon[111958]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:19:13.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:12 smithi064 ceph-mon[111958]: pgmap v67: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:13.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:12 smithi184 ceph-mon[121180]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:13.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:12 smithi184 ceph-mon[121180]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:19:13.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:12 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:13.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:12 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:13.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:12 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:13.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:12 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:19:13.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:12 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:13.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:12 smithi184 ceph-mon[121180]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:19:13.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:12 smithi184 ceph-mon[121180]: pgmap v67: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:14.198 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.196+0000 7fb228596700 1 -- 172.21.15.64:0/1073448277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 msgr2=0x7fb220109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.198 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.196+0000 7fb228596700 1 --2- 172.21.15.64:0/1073448277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 0x7fb220109190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb210004940 tx=0x7fb210009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:14.198 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.196+0000 7fb228596700 1 -- 172.21.15.64:0/1073448277 shutdown_connections 2023-12-16T03:19:14.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.196+0000 7fb228596700 1 --2- 172.21.15.64:0/1073448277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 0x7fb220109190 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.196+0000 7fb228596700 1 --2- 172.21.15.64:0/1073448277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2200fc5d0 0x7fb2200fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.196+0000 7fb228596700 1 -- 172.21.15.64:0/1073448277 >> 172.21.15.64:0/1073448277 conn(0x7fb2200719b0 msgr2=0x7fb220071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:14.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.196+0000 7fb228596700 1 -- 172.21.15.64:0/1073448277 shutdown_connections 2023-12-16T03:19:14.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.196+0000 7fb228596700 1 -- 172.21.15.64:0/1073448277 wait complete. 2023-12-16T03:19:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.197+0000 7fb228596700 1 Processor -- start 2023-12-16T03:19:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.197+0000 7fb228596700 1 -- start start 2023-12-16T03:19:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.197+0000 7fb228596700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2200fc5d0 0x7fb2201157d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.197+0000 7fb228596700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 0x7fb220115d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.197+0000 7fb228596700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb220116360 con 0x7fb2200fcee0 2023-12-16T03:19:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.197+0000 7fb228596700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22010f700 con 0x7fb2200fc5d0 2023-12-16T03:19:14.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb225b31700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 0x7fb220115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb225b31700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 0x7fb220115d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59472/0 (socket says 172.21.15.64:59472) 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb225b31700 1 -- 172.21.15.64:0/3583412223 learned_addr learned my addr 172.21.15.64:0/3583412223 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb226332700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2200fc5d0 0x7fb2201157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb225b31700 1 -- 172.21.15.64:0/3583412223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2200fc5d0 msgr2=0x7fb2201157d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb225b31700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2200fc5d0 0x7fb2201157d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb225b31700 1 -- 172.21.15.64:0/3583412223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210005040 con 0x7fb2200fcee0 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb225b31700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 0x7fb220115d10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb210009180 tx=0x7fb210009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb216ffd700 1 -- 172.21.15.64:0/3583412223 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb21000e040 con 0x7fb2200fcee0 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb216ffd700 1 -- 172.21.15.64:0/3583412223 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb210004290 con 0x7fb2200fcee0 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22010f980 con 0x7fb2200fcee0 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb216ffd700 1 -- 172.21.15.64:0/3583412223 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb21001c3f0 con 0x7fb2200fcee0 2023-12-16T03:19:14.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.198+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22010fec0 con 0x7fb2200fcee0 2023-12-16T03:19:14.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.200+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2201068c0 con 0x7fb2200fcee0 2023-12-16T03:19:14.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.200+0000 7fb216ffd700 1 -- 172.21.15.64:0/3583412223 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fb210013420 con 0x7fb2200fcee0 2023-12-16T03:19:14.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.201+0000 7fb216ffd700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fb20c06cae0 0x7fb20c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:14.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.201+0000 7fb216ffd700 1 -- 172.21.15.64:0/3583412223 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb21008d080 con 0x7fb2200fcee0 2023-12-16T03:19:14.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.201+0000 7fb226332700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fb20c06cae0 0x7fb20c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:14.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.201+0000 7fb226332700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fb20c06cae0 0x7fb20c06ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009fd0 tx=0x7fb21c00b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:14.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.205+0000 7fb216ffd700 1 -- 172.21.15.64:0/3583412223 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb21005af40 con 0x7fb2200fcee0 2023-12-16T03:19:14.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.444+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb220110e90 con 0x7fb20c06cae0 2023-12-16T03:19:14.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.446+0000 7fb216ffd700 1 -- 172.21.15.64:0/3583412223 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fb220110e90 con 0x7fb20c06cae0 2023-12-16T03:19:14.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fb20c06cae0 msgr2=0x7fb20c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fb20c06cae0 0x7fb20c06ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009fd0 tx=0x7fb21c00b040 comp rx=0 tx=0).stop 2023-12-16T03:19:14.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 msgr2=0x7fb220115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 0x7fb220115d10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb210009180 tx=0x7fb210009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:14.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 shutdown_connections 2023-12-16T03:19:14.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fb20c06cae0 0x7fb20c06ef90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2200fc5d0 0x7fb2201157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 --2- 172.21.15.64:0/3583412223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2200fcee0 0x7fb220115d10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 >> 172.21.15.64:0/3583412223 conn(0x7fb2200719b0 msgr2=0x7fb2200fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:14.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 shutdown_connections 2023-12-16T03:19:14.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.448+0000 7fb228596700 1 -- 172.21.15.64:0/3583412223 wait complete. 2023-12-16T03:19:14.460 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:19:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.557+0000 7f3d536ac700 1 -- 172.21.15.64:0/1916719113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c065390 msgr2=0x7f3d4c065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.557+0000 7f3d536ac700 1 --2- 172.21.15.64:0/1916719113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c065390 0x7f3d4c065800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c004940 tx=0x7f3d3c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.557+0000 7f3d536ac700 1 -- 172.21.15.64:0/1916719113 shutdown_connections 2023-12-16T03:19:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.557+0000 7f3d536ac700 1 --2- 172.21.15.64:0/1916719113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c065390 0x7f3d4c065800 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.557+0000 7f3d536ac700 1 --2- 172.21.15.64:0/1916719113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d4c102c20 0x7f3d4c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.557+0000 7f3d536ac700 1 -- 172.21.15.64:0/1916719113 >> 172.21.15.64:0/1916719113 conn(0x7f3d4c0719b0 msgr2=0x7f3d4c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.557+0000 7f3d536ac700 1 -- 172.21.15.64:0/1916719113 shutdown_connections 2023-12-16T03:19:14.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.557+0000 7f3d536ac700 1 -- 172.21.15.64:0/1916719113 wait complete. 2023-12-16T03:19:14.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d536ac700 1 Processor -- start 2023-12-16T03:19:14.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d536ac700 1 -- start start 2023-12-16T03:19:14.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d536ac700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d4c065390 0x7f3d4c1135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:14.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d536ac700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c102c20 0x7f3d4c113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:14.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d536ac700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c114170 con 0x7f3d4c102c20 2023-12-16T03:19:14.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d536ac700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c10d4a0 con 0x7f3d4c065390 2023-12-16T03:19:14.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d50c47700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c102c20 0x7f3d4c113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d50c47700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c102c20 0x7f3d4c113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59494/0 (socket says 172.21.15.64:59494) 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d50c47700 1 -- 172.21.15.64:0/2914712536 learned_addr learned my addr 172.21.15.64:0/2914712536 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d51448700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d4c065390 0x7f3d4c1135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d50c47700 1 -- 172.21.15.64:0/2914712536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d4c065390 msgr2=0x7f3d4c1135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d50c47700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d4c065390 0x7f3d4c1135e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.558+0000 7f3d50c47700 1 -- 172.21.15.64:0/2914712536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c005040 con 0x7f3d4c102c20 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.559+0000 7f3d50c47700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c102c20 0x7f3d4c113b20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c000c00 tx=0x7f3d3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.559+0000 7f3d41ffb700 1 -- 172.21.15.64:0/2914712536 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d3c021070 con 0x7f3d4c102c20 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.559+0000 7f3d41ffb700 1 -- 172.21.15.64:0/2914712536 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d3c01c400 con 0x7f3d4c102c20 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.559+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c10d720 con 0x7f3d4c102c20 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.559+0000 7f3d41ffb700 1 -- 172.21.15.64:0/2914712536 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d3c00e070 con 0x7f3d4c102c20 2023-12-16T03:19:14.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.559+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c10dc00 con 0x7f3d4c102c20 2023-12-16T03:19:14.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.560+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c0fff40 con 0x7f3d4c102c20 2023-12-16T03:19:14.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.561+0000 7f3d41ffb700 1 -- 172.21.15.64:0/2914712536 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f3d3c01c970 con 0x7f3d4c102c20 2023-12-16T03:19:14.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.561+0000 7f3d41ffb700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f3d3806cae0 0x7f3d3806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:14.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.561+0000 7f3d41ffb700 1 -- 172.21.15.64:0/2914712536 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3d3c08ce70 con 0x7f3d4c102c20 2023-12-16T03:19:14.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.561+0000 7f3d51448700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f3d3806cae0 0x7f3d3806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:14.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.562+0000 7f3d51448700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f3d3806cae0 0x7f3d3806ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009b80 tx=0x7f3d4800b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:14.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.566+0000 7f3d41ffb700 1 -- 172.21.15.64:0/2914712536 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3d3c05ad10 con 0x7f3d4c102c20 2023-12-16T03:19:14.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.793+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d4c04bb80 con 0x7f3d3806cae0 2023-12-16T03:19:14.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.794+0000 7f3d41ffb700 1 -- 172.21.15.64:0/2914712536 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f3d4c04bb80 con 0x7f3d3806cae0 2023-12-16T03:19:14.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f3d3806cae0 msgr2=0x7f3d3806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f3d3806cae0 0x7f3d3806ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009b80 tx=0x7f3d4800b040 comp rx=0 tx=0).stop 2023-12-16T03:19:14.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c102c20 msgr2=0x7f3d4c113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c102c20 0x7f3d4c113b20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c000c00 tx=0x7f3d3c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:14.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 shutdown_connections 2023-12-16T03:19:14.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7f3d3806cae0 0x7f3d3806ef90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d4c065390 0x7f3d4c1135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 --2- 172.21.15.64:0/2914712536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d4c102c20 0x7f3d4c113b20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 >> 172.21.15.64:0/2914712536 conn(0x7f3d4c0719b0 msgr2=0x7f3d4c0fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:14.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.796+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 shutdown_connections 2023-12-16T03:19:14.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.797+0000 7f3d536ac700 1 -- 172.21.15.64:0/2914712536 wait complete. 2023-12-16T03:19:14.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.903+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2856807733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d80fbb40 msgr2=0x7fe8d80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.903+0000 7fe8ddacd700 1 --2- 172.21.15.64:0/2856807733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d80fbb40 0x7fe8d80fbfb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0004940 tx=0x7fe8c0009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:14.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.903+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2856807733 shutdown_connections 2023-12-16T03:19:14.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.903+0000 7fe8ddacd700 1 --2- 172.21.15.64:0/2856807733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d80fbb40 0x7fe8d80fbfb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.903+0000 7fe8ddacd700 1 --2- 172.21.15.64:0/2856807733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d8101b00 0x7fe8d8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.903+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2856807733 >> 172.21.15.64:0/2856807733 conn(0x7fe8d80719b0 msgr2=0x7fe8d8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:14.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.903+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2856807733 shutdown_connections 2023-12-16T03:19:14.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.903+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2856807733 wait complete. 2023-12-16T03:19:14.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8ddacd700 1 Processor -- start 2023-12-16T03:19:14.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8ddacd700 1 -- start start 2023-12-16T03:19:14.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8ddacd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d80fbb40 0x7fe8d8112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:14.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8ddacd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d8101b00 0x7fe8d8112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:14.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8ddacd700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d81131d0 con 0x7fe8d8101b00 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8ddacd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d810c4c0 con 0x7fe8d80fbb40 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8ceffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d8101b00 0x7fe8d8112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8ceffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d8101b00 0x7fe8d8112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59506/0 (socket says 172.21.15.64:59506) 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8ceffd700 1 -- 172.21.15.64:0/2691849717 learned_addr learned my addr 172.21.15.64:0/2691849717 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.904+0000 7fe8d77fe700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d80fbb40 0x7fe8d8112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.905+0000 7fe8ceffd700 1 -- 172.21.15.64:0/2691849717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d80fbb40 msgr2=0x7fe8d8112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.905+0000 7fe8ceffd700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d80fbb40 0x7fe8d8112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.905+0000 7fe8ceffd700 1 -- 172.21.15.64:0/2691849717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0005040 con 0x7fe8d8101b00 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.905+0000 7fe8ceffd700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d8101b00 0x7fe8d8112b80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000b3b0 tx=0x7fe8c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.905+0000 7fe8d4ff9700 1 -- 172.21.15.64:0/2691849717 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c000e040 con 0x7fe8d8101b00 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.905+0000 7fe8d4ff9700 1 -- 172.21.15.64:0/2691849717 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe8c001c430 con 0x7fe8d8101b00 2023-12-16T03:19:14.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.905+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d810c740 con 0x7fe8d8101b00 2023-12-16T03:19:14.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.905+0000 7fe8d4ff9700 1 -- 172.21.15.64:0/2691849717 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c0013640 con 0x7fe8d8101b00 2023-12-16T03:19:14.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.905+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d810cc80 con 0x7fe8d8101b00 2023-12-16T03:19:14.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.906+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d81122d0 con 0x7fe8d8101b00 2023-12-16T03:19:14.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.906+0000 7fe8d4ff9700 1 -- 172.21.15.64:0/2691849717 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fe8c001c5a0 con 0x7fe8d8101b00 2023-12-16T03:19:14.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.907+0000 7fe8d4ff9700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe8c406cae0 0x7fe8c406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:14.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.907+0000 7fe8d4ff9700 1 -- 172.21.15.64:0/2691849717 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe8c008c880 con 0x7fe8d8101b00 2023-12-16T03:19:14.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.907+0000 7fe8d77fe700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe8c406cae0 0x7fe8c406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:14.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.907+0000 7fe8d77fe700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe8c406cae0 0x7fe8c406ef90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8004f40 tx=0x7fe8c800b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:14.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:14.912+0000 7fe8d4ff9700 1 -- 172.21.15.64:0/2691849717 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe8c005a7f0 con 0x7fe8d8101b00 2023-12-16T03:19:15.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.130+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8d804bb80 con 0x7fe8c406cae0 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.141+0000 7fe8d4ff9700 1 -- 172.21.15.64:0/2691849717 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe8d804bb80 con 0x7fe8c406cae0 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (73s) 55s ago 9m 17.6M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (9m) 55s ago 9m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (8m) 95s ago 8m 7482k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (59s) 55s ago 8m 51.6M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (5m) 55s ago 5m 14.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (5m) 55s ago 5m 6643M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (5m) 95s ago 5m 4651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (5m) 95s ago 5m 15.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (2m) 55s ago 10m 507M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:19:15.143 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (113s) 95s ago 8m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (10m) 55s ago 10m 98.0M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 302d0d58c306 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (8m) 95s ago 8m 66.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 f54881c252b6 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (101s) 55s ago 9m 15.4M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (97s) 95s ago 8m 8564k - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (7m) 55s ago 7m 762M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (7m) 55s ago 7m 835M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (7m) 55s ago 7m 639M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (6m) 95s ago 6m 959M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (6m) 95s ago 6m 763M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (6m) 95s ago 6m 844M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:19:15.144 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (85s) 55s ago 8m 45.3M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:19:15.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.143+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe8c406cae0 msgr2=0x7fe8c406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.143+0000 7fe8ddacd700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe8c406cae0 0x7fe8c406ef90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8004f40 tx=0x7fe8c800b040 comp rx=0 tx=0).stop 2023-12-16T03:19:15.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.143+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d8101b00 msgr2=0x7fe8d8112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.143+0000 7fe8ddacd700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d8101b00 0x7fe8d8112b80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000b3b0 tx=0x7fe8c0009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:15.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.143+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 shutdown_connections 2023-12-16T03:19:15.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.143+0000 7fe8ddacd700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe8c406cae0 0x7fe8c406ef90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.143+0000 7fe8ddacd700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d80fbb40 0x7fe8d8112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.143+0000 7fe8ddacd700 1 --2- 172.21.15.64:0/2691849717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d8101b00 0x7fe8d8112b80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.143+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 >> 172.21.15.64:0/2691849717 conn(0x7fe8d80719b0 msgr2=0x7fe8d80fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:15.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.144+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 shutdown_connections 2023-12-16T03:19:15.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.144+0000 7fe8ddacd700 1 -- 172.21.15.64:0/2691849717 wait complete. 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.251+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3731174375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 msgr2=0x7fe0e00fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.251+0000 7fe0e67f6700 1 --2- 172.21.15.64:0/3731174375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 0x7fe0e00fbfb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4004940 tx=0x7fe0d4009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.251+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3731174375 shutdown_connections 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.251+0000 7fe0e67f6700 1 --2- 172.21.15.64:0/3731174375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 0x7fe0e00fbfb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.251+0000 7fe0e67f6700 1 --2- 172.21.15.64:0/3731174375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0e0101b00 0x7fe0e0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.251+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3731174375 >> 172.21.15.64:0/3731174375 conn(0x7fe0e00719b0 msgr2=0x7fe0e0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.251+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3731174375 shutdown_connections 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.251+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3731174375 wait complete. 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.252+0000 7fe0e67f6700 1 Processor -- start 2023-12-16T03:19:15.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.252+0000 7fe0e67f6700 1 -- start start 2023-12-16T03:19:15.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.252+0000 7fe0e67f6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 0x7fe0e00fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:15.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.252+0000 7fe0e67f6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0e0101b00 0x7fe0e00fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:15.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.252+0000 7fe0e67f6700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e00fe260 con 0x7fe0e00fbb40 2023-12-16T03:19:15.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.252+0000 7fe0e67f6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e00fe3d0 con 0x7fe0e0101b00 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 0x7fe0e00fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 0x7fe0e00fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59522/0 (socket says 172.21.15.64:59522) 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dffff700 1 -- 172.21.15.64:0/3694665879 learned_addr learned my addr 172.21.15.64:0/3694665879 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0df7fe700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0e0101b00 0x7fe0e00fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dffff700 1 -- 172.21.15.64:0/3694665879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0e0101b00 msgr2=0x7fe0e00fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dffff700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0e0101b00 0x7fe0e00fdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dffff700 1 -- 172.21.15.64:0/3694665879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d4005040 con 0x7fe0e00fbb40 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0df7fe700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0e0101b00 0x7fe0e00fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dffff700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 0x7fe0e00fd720 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0002a50 tx=0x7fe0d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dcff9700 1 -- 172.21.15.64:0/3694665879 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d0007cc0 con 0x7fe0e00fbb40 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e01198c0 con 0x7fe0e00fbb40 2023-12-16T03:19:15.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dcff9700 1 -- 172.21.15.64:0/3694665879 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0d000f040 con 0x7fe0e00fbb40 2023-12-16T03:19:15.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0dcff9700 1 -- 172.21.15.64:0/3694665879 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d000da70 con 0x7fe0e00fbb40 2023-12-16T03:19:15.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.253+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e0119da0 con 0x7fe0e00fbb40 2023-12-16T03:19:15.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.255+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e00734d0 con 0x7fe0e00fbb40 2023-12-16T03:19:15.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.255+0000 7fe0dcff9700 1 -- 172.21.15.64:0/3694665879 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fe0d000dc10 con 0x7fe0e00fbb40 2023-12-16T03:19:15.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.255+0000 7fe0dcff9700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe0c806caf0 0x7fe0c806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:15.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.255+0000 7fe0dcff9700 1 -- 172.21.15.64:0/3694665879 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe0d008b490 con 0x7fe0e00fbb40 2023-12-16T03:19:15.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.256+0000 7fe0df7fe700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe0c806caf0 0x7fe0c806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:15.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.256+0000 7fe0df7fe700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe0c806caf0 0x7fe0c806efa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00ff120 tx=0x7fe0d4009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:15.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.260+0000 7fe0dcff9700 1 -- 172.21.15.64:0/3694665879 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe0d0055840 con 0x7fe0e00fbb40 2023-12-16T03:19:15.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:15.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T03:19:15.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T03:19:15.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:15.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:19:15.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: Upgrade: Setting container_image for all mgr 2023-12-16T03:19:15.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:15.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T03:19:15.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: pgmap v68: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:15.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:14 smithi184 ceph-mon[121180]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:15.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:15.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T03:19:15.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T03:19:15.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:15.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:19:15.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: Upgrade: Setting container_image for all mgr 2023-12-16T03:19:15.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:15.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T03:19:15.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: pgmap v68: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:15.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:14 smithi064 ceph-mon[111958]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:15.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.563+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0e00fef60 con 0x7fe0e00fbb40 2023-12-16T03:19:15.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.563+0000 7fe0dcff9700 1 -- 172.21.15.64:0/3694665879 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fe0d0058e60 con 0x7fe0e00fbb40 2023-12-16T03:19:15.565 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:19:15.565 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:19:15.565 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T03:19:15.565 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:19:15.565 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:19:15.566 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:19:15.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.565+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe0c806caf0 msgr2=0x7fe0c806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.565+0000 7fe0e67f6700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe0c806caf0 0x7fe0c806efa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00ff120 tx=0x7fe0d4009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:15.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.565+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 msgr2=0x7fe0e00fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.565+0000 7fe0e67f6700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 0x7fe0e00fd720 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0002a50 tx=0x7fe0d00046b0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.566+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 shutdown_connections 2023-12-16T03:19:15.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.566+0000 7fe0e67f6700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe0c806caf0 0x7fe0c806efa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.566+0000 7fe0e67f6700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe0e00fbb40 0x7fe0e00fd720 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.566+0000 7fe0e67f6700 1 --2- 172.21.15.64:0/3694665879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0e0101b00 0x7fe0e00fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.566+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 >> 172.21.15.64:0/3694665879 conn(0x7fe0e00719b0 msgr2=0x7fe0e0065490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:15.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.566+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 shutdown_connections 2023-12-16T03:19:15.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.566+0000 7fe0e67f6700 1 -- 172.21.15.64:0/3694665879 wait complete. 2023-12-16T03:19:15.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 -- 172.21.15.64:0/2129666286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c101b00 msgr2=0x7fe27c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 --2- 172.21.15.64:0/2129666286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c101b00 0x7fe27c101ed0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe26c004940 tx=0x7fe26c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:15.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 -- 172.21.15.64:0/2129666286 shutdown_connections 2023-12-16T03:19:15.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 --2- 172.21.15.64:0/2129666286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe27c0fbb40 0x7fe27c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 --2- 172.21.15.64:0/2129666286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c101b00 0x7fe27c101ed0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 -- 172.21.15.64:0/2129666286 >> 172.21.15.64:0/2129666286 conn(0x7fe27c0719b0 msgr2=0x7fe27c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:15.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 -- 172.21.15.64:0/2129666286 shutdown_connections 2023-12-16T03:19:15.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 -- 172.21.15.64:0/2129666286 wait complete. 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 Processor -- start 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 -- start start 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c0fbb40 0x7fe27c10c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe27c101b00 0x7fe27c10c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c10cd10 con 0x7fe27c0fbb40 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.673+0000 7fe280c36700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c10ce50 con 0x7fe27c101b00 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe27a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c0fbb40 0x7fe27c10c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe27a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c0fbb40 0x7fe27c10c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59542/0 (socket says 172.21.15.64:59542) 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe27a59c700 1 -- 172.21.15.64:0/2884743469 learned_addr learned my addr 172.21.15.64:0/2884743469 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe279d9b700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe27c101b00 0x7fe27c10c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe27a59c700 1 -- 172.21.15.64:0/2884743469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe27c101b00 msgr2=0x7fe27c10c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe27a59c700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe27c101b00 0x7fe27c10c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe27a59c700 1 -- 172.21.15.64:0/2884743469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c005040 con 0x7fe27c0fbb40 2023-12-16T03:19:15.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe27a59c700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c0fbb40 0x7fe27c10c290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe26c008d80 tx=0x7fe26c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:15.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe26affd700 1 -- 172.21.15.64:0/2884743469 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe26c00e030 con 0x7fe27c0fbb40 2023-12-16T03:19:15.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27c10d0d0 con 0x7fe27c0fbb40 2023-12-16T03:19:15.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe26affd700 1 -- 172.21.15.64:0/2884743469 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe26c004290 con 0x7fe27c0fbb40 2023-12-16T03:19:15.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe26affd700 1 -- 172.21.15.64:0/2884743469 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe26c01cda0 con 0x7fe27c0fbb40 2023-12-16T03:19:15.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.674+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c119c80 con 0x7fe27c0fbb40 2023-12-16T03:19:15.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.675+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27c103fb0 con 0x7fe27c0fbb40 2023-12-16T03:19:15.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.676+0000 7fe26affd700 1 -- 172.21.15.64:0/2884743469 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fe26c01c600 con 0x7fe27c0fbb40 2023-12-16T03:19:15.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.676+0000 7fe26affd700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe26406caf0 0x7fe26406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:15.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.676+0000 7fe279d9b700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe26406caf0 0x7fe26406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:15.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.676+0000 7fe26affd700 1 -- 172.21.15.64:0/2884743469 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe26c08d5d0 con 0x7fe27c0fbb40 2023-12-16T03:19:15.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.677+0000 7fe279d9b700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe26406caf0 0x7fe26406efa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe27c10e3f0 tx=0x7fe27000b040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:15.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.681+0000 7fe26affd700 1 -- 172.21.15.64:0/2884743469 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe26c057a00 con 0x7fe27c0fbb40 2023-12-16T03:19:15.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.935+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe27c065b70 con 0x7fe27c0fbb40 2023-12-16T03:19:15.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.935+0000 7fe26affd700 1 -- 172.21.15.64:0/2884743469 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1850 (secure 0 0 0) 0x7fe26c05b020 con 0x7fe27c0fbb40 2023-12-16T03:19:15.937 INFO:teuthology.orchestra.run.smithi064.stdout:e15 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:legacy client fscid: 1 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:Filesystem 'cephfs' (1) 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:fs_name cephfs 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 15 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:19:15.938 INFO:teuthology.orchestra.run.smithi064.stdout:modified 2023-12-16T03:15:58.604245+0000 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:tableserver 0 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:root 0 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:session_timeout 60 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:session_autoclose 300 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:max_file_size 1099511627776 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:required_client_features {} 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure 0 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure_osd_epoch 0 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:max_mds 2 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:in 0,1 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:up {0=14460,1=24269} 2023-12-16T03:19:15.939 INFO:teuthology.orchestra.run.smithi064.stdout:failed 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:damaged 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:stopped 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:data_pools [3] 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:metadata_pool 2 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:inline_data enabled 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:balancer 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:standby_count_wanted 1 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout:Standby daemons: 2023-12-16T03:19:15.940 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:19:15.941 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:15.941 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.937+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe26406caf0 msgr2=0x7fe26406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.937+0000 7fe280c36700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe26406caf0 0x7fe26406efa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe27c10e3f0 tx=0x7fe27000b040 comp rx=0 tx=0).stop 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.938+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c0fbb40 msgr2=0x7fe27c10c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.938+0000 7fe280c36700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c0fbb40 0x7fe27c10c290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe26c008d80 tx=0x7fe26c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.938+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 shutdown_connections 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.938+0000 7fe280c36700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fe26406caf0 0x7fe26406efa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.938+0000 7fe280c36700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe27c0fbb40 0x7fe27c10c290 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.938+0000 7fe280c36700 1 --2- 172.21.15.64:0/2884743469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe27c101b00 0x7fe27c10c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.938+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 >> 172.21.15.64:0/2884743469 conn(0x7fe27c0719b0 msgr2=0x7fe27c0faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.938+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 shutdown_connections 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:15.938+0000 7fe280c36700 1 -- 172.21.15.64:0/2884743469 wait complete. 2023-12-16T03:19:15.942 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 15 2023-12-16T03:19:16.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.043+0000 7fa7ca085700 1 -- 172.21.15.64:0/3183125815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c40fbb40 msgr2=0x7fa7c40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:16.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.043+0000 7fa7ca085700 1 --2- 172.21.15.64:0/3183125815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c40fbb40 0x7fa7c40fbfb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8004940 tx=0x7fa7b8009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:16.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.043+0000 7fa7ca085700 1 -- 172.21.15.64:0/3183125815 shutdown_connections 2023-12-16T03:19:16.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.043+0000 7fa7ca085700 1 --2- 172.21.15.64:0/3183125815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c40fbb40 0x7fa7c40fbfb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.043+0000 7fa7ca085700 1 --2- 172.21.15.64:0/3183125815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c4101b00 0x7fa7c4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.043+0000 7fa7ca085700 1 -- 172.21.15.64:0/3183125815 >> 172.21.15.64:0/3183125815 conn(0x7fa7c40719b0 msgr2=0x7fa7c4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:16.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.043+0000 7fa7ca085700 1 -- 172.21.15.64:0/3183125815 shutdown_connections 2023-12-16T03:19:16.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.043+0000 7fa7ca085700 1 -- 172.21.15.64:0/3183125815 wait complete. 2023-12-16T03:19:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.044+0000 7fa7ca085700 1 Processor -- start 2023-12-16T03:19:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.044+0000 7fa7ca085700 1 -- start start 2023-12-16T03:19:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.044+0000 7fa7ca085700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c40fbb40 0x7fa7c4112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.044+0000 7fa7ca085700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c4101b00 0x7fa7c4112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7ca085700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41131d0 con 0x7fa7c4101b00 2023-12-16T03:19:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7ca085700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c410c4c0 con 0x7fa7c40fbb40 2023-12-16T03:19:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7c2ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c4101b00 0x7fa7c4112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:16.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7c2ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c4101b00 0x7fa7c4112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59568/0 (socket says 172.21.15.64:59568) 2023-12-16T03:19:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7c2ffd700 1 -- 172.21.15.64:0/3690975035 learned_addr learned my addr 172.21.15.64:0/3690975035 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7c37fe700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c40fbb40 0x7fa7c4112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7c2ffd700 1 -- 172.21.15.64:0/3690975035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c40fbb40 msgr2=0x7fa7c4112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7c2ffd700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c40fbb40 0x7fa7c4112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7c2ffd700 1 -- 172.21.15.64:0/3690975035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8005040 con 0x7fa7c4101b00 2023-12-16T03:19:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7c37fe700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c40fbb40 0x7fa7c4112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:19:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7c2ffd700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c4101b00 0x7fa7c4112b80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8009360 tx=0x7fa7b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.045+0000 7fa7abfff700 1 -- 172.21.15.64:0/3690975035 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7b800e040 con 0x7fa7c4101b00 2023-12-16T03:19:16.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.046+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c410c740 con 0x7fa7c4101b00 2023-12-16T03:19:16.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.046+0000 7fa7abfff700 1 -- 172.21.15.64:0/3690975035 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa7b8004290 con 0x7fa7c4101b00 2023-12-16T03:19:16.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.046+0000 7fa7abfff700 1 -- 172.21.15.64:0/3690975035 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7b801c630 con 0x7fa7c4101b00 2023-12-16T03:19:16.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.046+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c410cc80 con 0x7fa7c4101b00 2023-12-16T03:19:16.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.047+0000 7fa7abfff700 1 -- 172.21.15.64:0/3690975035 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fa7b800bc50 con 0x7fa7c4101b00 2023-12-16T03:19:16.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.047+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c41122d0 con 0x7fa7c4101b00 2023-12-16T03:19:16.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.048+0000 7fa7abfff700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa7ac06caf0 0x7fa7ac06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:16.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.048+0000 7fa7abfff700 1 -- 172.21.15.64:0/3690975035 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa7b808cd70 con 0x7fa7c4101b00 2023-12-16T03:19:16.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.048+0000 7fa7c37fe700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa7ac06caf0 0x7fa7ac06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:16.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.049+0000 7fa7c37fe700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa7ac06caf0 0x7fa7ac06efa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40041d0 tx=0x7fa7b4009040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:16.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.052+0000 7fa7abfff700 1 -- 172.21.15.64:0/3690975035 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa7b805ad80 con 0x7fa7c4101b00 2023-12-16T03:19:16.117 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:16.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: Upgrade: Updating mon.smithi064 2023-12-16T03:19:16.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:16.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:19:16.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:19:16.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:16.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: Deploying daemon mon.smithi064 on smithi064 2023-12-16T03:19:16.118 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:16.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/3694665879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:19:16.119 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-mon[111958]: from='client.? 172.21.15.64:0/2884743469' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:19:16.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.284+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 --> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7c404bb80 con 0x7fa7ac06caf0 2023-12-16T03:19:16.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.286+0000 7fa7abfff700 1 -- 172.21.15.64:0/3690975035 <== mgr.14644 v2:172.21.15.64:6800/795909098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa7c404bb80 con 0x7fa7ac06caf0 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "2/21 daemons upgraded", 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Currently upgrading mon daemons", 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:19:16.288 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:19:16.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.289+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa7ac06caf0 msgr2=0x7fa7ac06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:16.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.289+0000 7fa7ca085700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa7ac06caf0 0x7fa7ac06efa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40041d0 tx=0x7fa7b4009040 comp rx=0 tx=0).stop 2023-12-16T03:19:16.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.289+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c4101b00 msgr2=0x7fa7c4112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.289+0000 7fa7ca085700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c4101b00 0x7fa7c4112b80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8009360 tx=0x7fa7b8009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.290+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 shutdown_connections 2023-12-16T03:19:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.290+0000 7fa7ca085700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fa7ac06caf0 0x7fa7ac06efa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.290+0000 7fa7ca085700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c40fbb40 0x7fa7c4112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.290+0000 7fa7ca085700 1 --2- 172.21.15.64:0/3690975035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7c4101b00 0x7fa7c4112b80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.290+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 >> 172.21.15.64:0/3690975035 conn(0x7fa7c40719b0 msgr2=0x7fa7c40fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.290+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 shutdown_connections 2023-12-16T03:19:16.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.290+0000 7fa7ca085700 1 -- 172.21.15.64:0/3690975035 wait complete. 2023-12-16T03:19:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.402+0000 7fce608f4700 1 -- 172.21.15.64:0/96116253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fc300 msgr2=0x7fce5c109060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.402+0000 7fce608f4700 1 --2- 172.21.15.64:0/96116253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fc300 0x7fce5c109060 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fce50004940 tx=0x7fce50009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.402+0000 7fce608f4700 1 -- 172.21.15.64:0/96116253 shutdown_connections 2023-12-16T03:19:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.402+0000 7fce608f4700 1 --2- 172.21.15.64:0/96116253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fc300 0x7fce5c109060 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.402+0000 7fce608f4700 1 --2- 172.21.15.64:0/96116253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fb9f0 0x7fce5c0fbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.402+0000 7fce608f4700 1 -- 172.21.15.64:0/96116253 >> 172.21.15.64:0/96116253 conn(0x7fce5c0f76c0 msgr2=0x7fce5c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.402+0000 7fce608f4700 1 -- 172.21.15.64:0/96116253 shutdown_connections 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.402+0000 7fce608f4700 1 -- 172.21.15.64:0/96116253 wait complete. 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce608f4700 1 Processor -- start 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce608f4700 1 -- start start 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce608f4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 0x7fce5c115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce608f4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 0x7fce5c115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce608f4700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c116480 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce608f4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c10f720 con 0x7fce5c0fc300 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce5a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 0x7fce5c115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce5a59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 0x7fce5c115860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59584/0 (socket says 172.21.15.64:59584) 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce5a59c700 1 -- 172.21.15.64:0/3876280328 learned_addr learned my addr 172.21.15.64:0/3876280328 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.403+0000 7fce59d9b700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 0x7fce5c115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:16.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.404+0000 7fce5a59c700 1 -- 172.21.15.64:0/3876280328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 msgr2=0x7fce5c115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.404+0000 7fce5a59c700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 0x7fce5c115da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.404+0000 7fce5a59c700 1 -- 172.21.15.64:0/3876280328 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50005040 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.404+0000 7fce5a59c700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 0x7fce5c115860 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00b790 tx=0x7fce4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.404+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4c00f6f0 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.404+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce4c00fd00 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.404+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c10fa00 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.404+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4c0103a0 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.404+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c10ff10 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.405+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c106790 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.406+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fce4c00f850 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.406+0000 7fce4affd700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fce4406caf0 0x7fce4406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.407+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fce4c08bae0 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.407+0000 7fce59d9b700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fce4406caf0 0x7fce4406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.407+0000 7fce59d9b700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fce4406caf0 0x7fce4406efa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce5c110a50 tx=0x7fce50009e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:16.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.411+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fce4c059a40 con 0x7fce5c0fb9f0 2023-12-16T03:19:16.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 systemd[1]: Stopping Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:19:16.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.457+0000 7fce5a59c700 1 -- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 msgr2=0x7fce5c115860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-16T03:19:16.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.458+0000 7fce5a59c700 1 -- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 msgr2=0x7fce5c115860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.458+0000 7fce5a59c700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 0x7fce5c115860 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00b790 tx=0x7fce4c009250 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.458+0000 7fce5a59c700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 0x7fce5c115860 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00b790 tx=0x7fce4c009250 comp rx=0 tx=0).stop 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.458+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 msgr2=0x7fce5c115860 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.458+0000 7fce4affd700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce5c0fb9f0 0x7fce5c115860 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.458+0000 7fce4affd700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 0x7fce44076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.458+0000 7fce4affd700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce44076e50 0x7fce440792d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.458+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44079cf0 con 0x7fce44076e50 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.458+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44079e30 con 0x7fce5c0fc300 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.459+0000 7fce5ad9d700 1 -- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce44076e50 msgr2=0x7fce440792d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.64:3300/0 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.459+0000 7fce5a59c700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 0x7fce44076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.459+0000 7fce5ad9d700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce44076e50 0x7fce440792d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.459+0000 7fce5a59c700 1 -- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce44076e50 msgr2=0x7fce440792d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:19:16.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.459+0000 7fce5a59c700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce44076e50 0x7fce440792d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.459+0000 7fce5a59c700 1 -- 172.21.15.64:0/3876280328 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=3+}) v3 -- 0x7fce44079fd0 con 0x7fce5c0fc300 2023-12-16T03:19:16.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.459+0000 7fce5a59c700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 0x7fce44076750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce5c0fb420 tx=0x7fce4c08b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:16.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.460+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4c090020 con 0x7fce5c0fc300 2023-12-16T03:19:16.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.461+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce4c059a40 con 0x7fce5c0fc300 2023-12-16T03:19:16.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.463+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mgrmap(e 32) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fce4c020d30 con 0x7fce5c0fc300 2023-12-16T03:19:16.474 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:16.474 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: Upgrade: Updating mon.smithi064 2023-12-16T03:19:16.474 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:16.474 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:19:16.474 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:19:16.474 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:16.474 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: Deploying daemon mon.smithi064 on smithi064 2023-12-16T03:19:16.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:16.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/3694665879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:19:16.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:16 smithi184 ceph-mon[121180]: from='client.? 172.21.15.64:0/2884743469' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:19:16.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.715+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fce40005160 con 0x7fce5c0fc300 2023-12-16T03:19:16.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.716+0000 7fce4affd700 1 -- 172.21.15.64:0/3876280328 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fce4c068b10 con 0x7fce5c0fc300 2023-12-16T03:19:16.718 INFO:teuthology.orchestra.run.smithi064.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:16.718 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:16.718 INFO:teuthology.orchestra.run.smithi064.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:19:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fce4406caf0 msgr2=0x7fce4406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fce4406caf0 0x7fce4406efa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce5c110a50 tx=0x7fce50009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 msgr2=0x7fce44076750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 0x7fce44076750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce5c0fb420 tx=0x7fce4c08b040 comp rx=0 tx=0).stop 2023-12-16T03:19:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 shutdown_connections 2023-12-16T03:19:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:6800/795909098,v1:172.21.15.64:6801/795909098] conn(0x7fce4406caf0 0x7fce4406efa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce44076e50 0x7fce440792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 --2- 172.21.15.64:0/3876280328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c0fc300 0x7fce44076750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:16.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 >> 172.21.15.64:0/3876280328 conn(0x7fce5c0f76c0 msgr2=0x7fce5c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:16.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 shutdown_connections 2023-12-16T03:19:16.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:16.718+0000 7fce608f4700 1 -- 172.21.15.64:0/3876280328 wait complete. 2023-12-16T03:19:16.755 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064[111935]: 2023-12-16T03:19:16.457+0000 7f55e9852700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi064 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:19:16.755 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064[111935]: 2023-12-16T03:19:16.457+0000 7f55e9852700 -1 mon.smithi064@0(leader) e2 *** Got Signal Terminated *** 2023-12-16T03:19:17.058 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:16 smithi064 bash[216635]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064 2023-12-16T03:19:17.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 systemd[1]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi064.service: Succeeded. 2023-12-16T03:19:17.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 systemd[1]: Stopped Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:19:17.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 systemd[1]: Starting Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:19:17.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 bash[216817]: fcfcecd16324dd6da3c81253c1c8acee71a330ef7e60c5a9a05a371186abdcb6 2023-12-16T03:19:17.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev), process ceph-mon, pid 7 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: pidfile_write: ignore empty --pid-file 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 systemd[1]: Started Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: load: jerasure load: lrc 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: RocksDB version: 7.9.2 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Git sha 0 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Compile date 2023-12-15 16:32:04 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: DB SUMMARY 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: DB Session ID: B2T8MWBJG7GFJV3E32F4 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: CURRENT file: CURRENT 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1172 Bytes 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi064/store.db dir, Total Num: 1, files: 000033.sst 2023-12-16T03:19:17.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi064/store.db: 000031.log size: 123719 ; 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.error_if_exists: 0 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.create_if_missing: 0 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.paranoid_checks: 1 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.env: 0x55dcf657ba60 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.fs: PosixFileSystem 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.info_log: 0x55dcf860d620 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.statistics: (nil) 2023-12-16T03:19:17.945 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.use_fsync: 0 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_log_file_size: 0 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.allow_fallocate: 1 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.use_direct_reads: 0 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.db_log_dir: 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.wal_dir: 2023-12-16T03:19:17.946 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.write_buffer_manager: 0x55dcf85c3360 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T03:19:17.947 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.unordered_write: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.row_cache: None 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.wal_filter: None 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.two_write_queues: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.wal_compression: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.atomic_flush: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T03:19:17.948 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.log_readahead_size: 0 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_background_jobs: 2 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_background_compactions: -1 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_subcompactions: 1 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T03:19:17.949 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_open_files: -1 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_background_flushes: -1 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Compression algorithms supported: 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: kZSTD supported: 0 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: kXpressCompression supported: 0 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: kZlibCompression supported: 1 2023-12-16T03:19:17.950 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: kSnappyCompression supported: 1 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: kLZ4Compression supported: 1 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: kBZip2Compression supported: 0 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi064/store.db/MANIFEST-000015 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.merge_operator: 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_filter: None 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dcf860d720) 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: cache_index_and_filter_blocks: 1 2023-12-16T03:19:17.951 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: pin_top_level_index_and_filter: 1 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_type: 0 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_block_index_type: 0 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_shortening: 1 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: checksum: 4 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: no_block_cache: 0 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache: 0x55dcf8663090 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_name: BinnedLRUCache 2023-12-16T03:19:17.952 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_options: 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: capacity : 536870912 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: num_shard_bits : 4 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: strict_capacity_limit : 0 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: high_pri_pool_ratio: 0.000 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_compressed: (nil) 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: persistent_cache: (nil) 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_size: 4096 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_size_deviation: 10 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_restart_interval: 16 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_block_restart_interval: 1 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: metadata_block_size: 4096 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: partition_filters: 0 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: use_delta_encoding: 1 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: filter_policy: bloomfilter 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: whole_key_filtering: 1 2023-12-16T03:19:17.953 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: verify_compression: 0 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: read_amp_bytes_per_bit: 0 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: format_version: 5 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: enable_index_compression: 1 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_align: 0 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: max_auto_readahead_size: 262144 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: prepopulate_block_cache: 0 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: initial_auto_readahead_size: 8192 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: num_file_reads_for_auto_readahead: 2 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression: NoCompression 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T03:19:17.954 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.num_levels: 7 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T03:19:17.955 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T03:19:17.956 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-16T03:19:17.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.arena_block_size: 1048576 2023-12-16T03:19:17.958 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T03:19:17.958 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T03:19:17.958 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T03:19:17.958 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T03:19:17.958 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.table_properties_collectors: 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.inplace_update_support: 0 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T03:19:17.959 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.bloom_locality: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.max_successive_merges: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.ttl: 2592000 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.enable_blob_files: false 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.min_blob_size: 0 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T03:19:17.960 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.blob_file_starting_level: 0 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi064/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12609, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 18799e5e-de2a-4198-b960-0a57a469ed56 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696757618983, "job": 1, "event": "recovery_started", "wal_files": [31]} 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2023-12-16T03:19:17.961 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696757619970, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 120484, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12601, "largest_seqno": 12841, "table_properties": {"data_size": 118610, "index_size": 542, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 325, "raw_key_size": 2970, "raw_average_key_size": 25, "raw_value_size": 116085, "raw_average_value_size": 992, "num_data_blocks": 24, "num_entries": 117, "num_filter_entries": 117, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702696757, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "18799e5e-de2a-4198-b960-0a57a469ed56", "db_session_id": "B2T8MWBJG7GFJV3E32F4", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696757620057, "job": 1, "event": "recovery_finished"} 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi064/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dcf86fe000 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: DB pointer 0x55dcf86ec000 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** DB Stats ** 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T03:19:17.962 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: L0 1/0 117.66 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 199.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: L6 1/0 6.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Sum 2/0 7.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 199.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 199.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-16T03:19:17.963 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 199.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative compaction: 0.00 GB write, 35.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval compaction: 0.00 GB write, 35.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T03:19:17.964 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Block cache BinnedLRUCache@0x55dcf8663090#7 capacity: 512.00 MB usage: 1.02 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.38 KB,7.15256e-05%) IndexBlock(1,0.64 KB,0.00012219%) Misc(1,0.00 KB,0%) 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: starting mon.smithi064 rank 0 at public addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] at bind addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi064 fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: mon.smithi064@-1(???) e2 preinit fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: mon.smithi064@-1(???).mds e15 new map 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: mon.smithi064@-1(???).mds e15 print_map 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: e15 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: legacy client fscid: 1 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Filesystem 'cephfs' (1) 2023-12-16T03:19:17.965 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: fs_name cephfs 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: epoch 15 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: modified 2023-12-16T03:15:58.604245+0000 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: tableserver 0 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: root 0 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: session_timeout 60 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: session_autoclose 300 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: max_file_size 1099511627776 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: max_xattr_size 65536 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: required_client_features {} 2023-12-16T03:19:17.966 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: last_failure 0 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: last_failure_osd_epoch 0 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: max_mds 2 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: in 0,1 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: up {0=14460,1=24269} 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: failed 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: damaged 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: stopped 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_pools [3] 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: metadata_pool 2 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: inline_data enabled 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: balancer 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: bal_rank_mask -1 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: standby_count_wanted 1 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: [mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:17.967 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: [mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Standby daemons: 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: [mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: [mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: mon.smithi064@-1(???).osd e45 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: mon.smithi064@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: mon.smithi064@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: mon.smithi064@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T03:19:17.968 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:17 smithi064 ceph-mon[216854]: mon.smithi064@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-16T03:19:18.567 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: pgmap v69: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:18.567 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:19:18.567 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:19:18.567 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: from='client.14802 172.21.15.64:0/3876280328' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:19:18.567 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: mon.smithi064 calling monitor election 2023-12-16T03:19:18.567 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: mon.smithi064 is new leader, mons smithi064,smithi184 in quorum (ranks 0,1) 2023-12-16T03:19:18.567 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: monmap e2: 2 mons at {smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T03:19:18.567 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:19:18.568 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T03:19:18.568 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: mgrmap e32: smithi064.ueciyw(active, since 2m), standbys: smithi184.urtxla 2023-12-16T03:19:18.568 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: from='mgr.14644 ' entity='' 2023-12-16T03:19:18.568 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: mgrmap e33: smithi064.ueciyw(active, since 2m), standbys: smithi184.urtxla 2023-12-16T03:19:18.568 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:18.568 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:18.568 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:18 smithi184 ceph-mon[121180]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:19:18.639 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: pgmap v69: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:18.639 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:19:18.639 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: from='mgr.14644 172.21.15.64:0/715457197' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:19:18.639 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: from='client.14802 172.21.15.64:0/3876280328' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: mon.smithi064 calling monitor election 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: mon.smithi064 is new leader, mons smithi064,smithi184 in quorum (ranks 0,1) 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: monmap e2: 2 mons at {smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: mgrmap e32: smithi064.ueciyw(active, since 2m), standbys: smithi184.urtxla 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: from='mgr.14644 ' entity='' 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: mgrmap e33: smithi064.ueciyw(active, since 2m), standbys: smithi184.urtxla 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:18.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:18 smithi064 ceph-mon[216854]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:19:25.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:25 smithi064 ceph-mon[216854]: Standby manager daemon smithi184.urtxla restarted 2023-12-16T03:19:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:25 smithi064 ceph-mon[216854]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:19:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:25 smithi064 ceph-mon[216854]: from='mgr.? 172.21.15.184:0/470194442' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:19:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:25 smithi064 ceph-mon[216854]: from='mgr.? 172.21.15.184:0/470194442' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:19:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:25 smithi064 ceph-mon[216854]: from='mgr.? 172.21.15.184:0/470194442' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:19:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:25 smithi064 ceph-mon[216854]: from='mgr.? 172.21.15.184:0/470194442' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:19:25.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:25 smithi184 ceph-mon[121180]: Standby manager daemon smithi184.urtxla restarted 2023-12-16T03:19:25.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:25 smithi184 ceph-mon[121180]: Standby manager daemon smithi184.urtxla started 2023-12-16T03:19:25.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:25 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/470194442' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/crt"}]: dispatch 2023-12-16T03:19:25.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:25 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/470194442' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T03:19:25.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:25 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/470194442' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.urtxla/key"}]: dispatch 2023-12-16T03:19:25.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:25 smithi184 ceph-mon[121180]: from='mgr.? 172.21.15.184:0/470194442' entity='mgr.smithi184.urtxla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T03:19:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:25 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi184[121157]: 2023-12-16T03:19:25.384+0000 7f2c0043b700 -1 mon.smithi184@1(peon).osd e46 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-16T03:19:26.366 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: mgrmap e34: smithi064.ueciyw(active, since 2m), standbys: smithi184.urtxla 2023-12-16T03:19:26.366 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: Active manager daemon smithi064.ueciyw restarted 2023-12-16T03:19:26.366 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: Activating manager daemon smithi064.ueciyw 2023-12-16T03:19:26.366 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: failed to encode map e46 with expected crc 2023-12-16T03:19:26.366 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T03:19:26.366 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: mgrmap e35: smithi064.ueciyw(active, starting, since 0.00945175s), standbys: smithi184.urtxla 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.jaepzs"}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.edrjyd"}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.jfpiqk"}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.uqpwjn"}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi184.urtxla", "id": "smithi184.urtxla"}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:19:26.367 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: Manager daemon smithi064.ueciyw is now available 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:19:26.368 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:26 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/trash_purge_schedule"}]: dispatch 2023-12-16T03:19:26.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: mgrmap e34: smithi064.ueciyw(active, since 2m), standbys: smithi184.urtxla 2023-12-16T03:19:26.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: Active manager daemon smithi064.ueciyw restarted 2023-12-16T03:19:26.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: Activating manager daemon smithi064.ueciyw 2023-12-16T03:19:26.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: failed to encode map e46 with expected crc 2023-12-16T03:19:26.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T03:19:26.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: mgrmap e35: smithi064.ueciyw(active, starting, since 0.00945175s), standbys: smithi184.urtxla 2023-12-16T03:19:26.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:19:26.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:19:26.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.jaepzs"}]: dispatch 2023-12-16T03:19:26.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.edrjyd"}]: dispatch 2023-12-16T03:19:26.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.jfpiqk"}]: dispatch 2023-12-16T03:19:26.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.uqpwjn"}]: dispatch 2023-12-16T03:19:26.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi064.ueciyw", "id": "smithi064.ueciyw"}]: dispatch 2023-12-16T03:19:26.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr metadata", "who": "smithi184.urtxla", "id": "smithi184.urtxla"}]: dispatch 2023-12-16T03:19:26.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:19:26.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: Manager daemon smithi064.ueciyw is now available 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:19:26.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/mirror_snapshot_schedule"}]: dispatch 2023-12-16T03:19:26.403 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.ueciyw/trash_purge_schedule"}]: dispatch 2023-12-16T03:19:27.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:27 smithi184 ceph-mon[121180]: failed to encode map e46 with expected crc 2023-12-16T03:19:27.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:27 smithi184 ceph-mon[121180]: failed to encode map e46 with expected crc 2023-12-16T03:19:27.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:27 smithi184 ceph-mon[121180]: mgrmap e36: smithi064.ueciyw(active, since 1.0127s), standbys: smithi184.urtxla 2023-12-16T03:19:27.339 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:27 smithi064 ceph-mon[216854]: failed to encode map e46 with expected crc 2023-12-16T03:19:27.340 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:27 smithi064 ceph-mon[216854]: failed to encode map e46 with expected crc 2023-12-16T03:19:27.340 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:27 smithi064 ceph-mon[216854]: mgrmap e36: smithi064.ueciyw(active, since 1.0127s), standbys: smithi184.urtxla 2023-12-16T03:19:28.347 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:28 smithi064 ceph-mon[216854]: [16/Dec/2023:03:19:26] ENGINE Bus STARTING 2023-12-16T03:19:28.347 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:28 smithi064 ceph-mon[216854]: [16/Dec/2023:03:19:26] ENGINE Serving on https://172.21.15.64:7150 2023-12-16T03:19:28.347 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:28 smithi064 ceph-mon[216854]: [16/Dec/2023:03:19:26] ENGINE Serving on http://172.21.15.64:8765 2023-12-16T03:19:28.347 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:28 smithi064 ceph-mon[216854]: [16/Dec/2023:03:19:26] ENGINE Bus STARTED 2023-12-16T03:19:28.347 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:28.347 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:28 smithi184 ceph-mon[121180]: [16/Dec/2023:03:19:26] ENGINE Bus STARTING 2023-12-16T03:19:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:28 smithi184 ceph-mon[121180]: [16/Dec/2023:03:19:26] ENGINE Serving on https://172.21.15.64:7150 2023-12-16T03:19:28.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:28 smithi184 ceph-mon[121180]: [16/Dec/2023:03:19:26] ENGINE Serving on http://172.21.15.64:8765 2023-12-16T03:19:28.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:28 smithi184 ceph-mon[121180]: [16/Dec/2023:03:19:26] ENGINE Bus STARTED 2023-12-16T03:19:28.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:28 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:28.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:28 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:29.298 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:29 smithi184 ceph-mon[121180]: pgmap v4: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:29.299 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:29 smithi184 ceph-mon[121180]: mgrmap e37: smithi064.ueciyw(active, since 3s), standbys: smithi184.urtxla 2023-12-16T03:19:29.299 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:29 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:29.299 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:29 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:29.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:29 smithi064 ceph-mon[216854]: pgmap v4: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:29.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:29 smithi064 ceph-mon[216854]: mgrmap e37: smithi064.ueciyw(active, since 3s), standbys: smithi184.urtxla 2023-12-16T03:19:29.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:29 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:29.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:29 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:30.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:30.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:30.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:30.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:30.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:30 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:30.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:30 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:30.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:30 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:30.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:30 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:31.302 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:31 smithi064 ceph-mon[216854]: pgmap v5: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:31.302 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:31 smithi064 ceph-mon[216854]: mgrmap e38: smithi064.ueciyw(active, since 4s), standbys: smithi184.urtxla 2023-12-16T03:19:31.302 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:31 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:31.302 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:31 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:31.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:31 smithi184 ceph-mon[121180]: pgmap v5: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:31.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:31 smithi184 ceph-mon[121180]: mgrmap e38: smithi064.ueciyw(active, since 4s), standbys: smithi184.urtxla 2023-12-16T03:19:31.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:31 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:31.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:31 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:32.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:32 smithi184 ceph-mon[121180]: Detected new or changed devices on smithi184 2023-12-16T03:19:32.653 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:32 smithi064 ceph-mon[216854]: Detected new or changed devices on smithi184 2023-12-16T03:19:33.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:33 smithi184 ceph-mon[121180]: pgmap v6: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:33.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:33 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:33.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:33 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:33.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:33 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:33.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:33 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:19:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:33 smithi064 ceph-mon[216854]: pgmap v6: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:33 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:33 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:33 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:33.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:33 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:19:34.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: Detected new or changed devices on smithi064 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:19:34.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:34 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T03:19:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: Detected new or changed devices on smithi064 2023-12-16T03:19:34.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: Updating smithi064:/etc/ceph/ceph.conf 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: Updating smithi184:/etc/ceph/ceph.conf 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:19:34.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:34 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T03:19:35.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:35 smithi184 ceph-mon[121180]: pgmap v7: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-16T03:19:35.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:35 smithi184 ceph-mon[121180]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:19:35.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:35 smithi184 ceph-mon[121180]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:19:35.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:35 smithi184 ceph-mon[121180]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:19:35.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:35 smithi184 ceph-mon[121180]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:19:35.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:35 smithi064 ceph-mon[216854]: pgmap v7: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-16T03:19:35.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:35 smithi064 ceph-mon[216854]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:19:35.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:35 smithi064 ceph-mon[216854]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-12-16T03:19:35.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:35 smithi064 ceph-mon[216854]: Updating smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:19:35.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:35 smithi064 ceph-mon[216854]: Updating smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T03:19:36.449 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 ceph-mon[121180]: Upgrade: Updating mon.smithi184 2023-12-16T03:19:36.449 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:36.449 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:19:36.449 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:19:36.449 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 ceph-mon[121180]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:36.449 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 ceph-mon[121180]: Deploying daemon mon.smithi184 on smithi184 2023-12-16T03:19:36.449 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 ceph-mon[121180]: pgmap v8: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-16T03:19:36.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:36 smithi064 ceph-mon[216854]: Upgrade: Updating mon.smithi184 2023-12-16T03:19:36.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:36 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:36.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:36 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:19:36.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:36 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:19:36.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:36 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:36.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:36 smithi064 ceph-mon[216854]: Deploying daemon mon.smithi184 on smithi184 2023-12-16T03:19:36.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:36 smithi064 ceph-mon[216854]: pgmap v8: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-16T03:19:36.764 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 systemd[1]: Stopping Ceph mon.smithi184 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:19:37.022 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi184[121157]: 2023-12-16T03:19:36.760+0000 7f2c05c46700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi184 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:19:37.022 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:36 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi184[121157]: 2023-12-16T03:19:36.760+0000 7f2c05c46700 -1 mon.smithi184@1(peon) e2 *** Got Signal Terminated *** 2023-12-16T03:19:37.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 bash[183938]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi184 2023-12-16T03:19:37.809 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 systemd[1]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi184.service: Succeeded. 2023-12-16T03:19:37.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 systemd[1]: Stopped Ceph mon.smithi184 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:19:37.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 systemd[1]: Starting Ceph mon.smithi184 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:19:38.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T03:19:38.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev), process ceph-mon, pid 7 2023-12-16T03:19:38.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 bash[184092]: 1523b5eb5b045747148fb605d88f692e38715a2dbe7b98e35fd9c17a7341a346 2023-12-16T03:19:38.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: pidfile_write: ignore empty --pid-file 2023-12-16T03:19:38.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 systemd[1]: Started Ceph mon.smithi184 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:19:38.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: load: jerasure load: lrc 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: RocksDB version: 7.9.2 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Git sha 0 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Compile date 2023-12-15 16:32:04 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: DB SUMMARY 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: DB Session ID: LQK90XNAUHKCHYSTKTEC 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: CURRENT file: CURRENT 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1097 Bytes 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi184/store.db dir, Total Num: 1, files: 000027.sst 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi184/store.db: 000025.log size: 3028953 ; 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.error_if_exists: 0 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.create_if_missing: 0 2023-12-16T03:19:38.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.paranoid_checks: 1 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.env: 0x556c8c9a4a60 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.fs: PosixFileSystem 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.info_log: 0x556c8dec3620 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.statistics: (nil) 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.use_fsync: 0 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_log_file_size: 0 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T03:19:38.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.allow_fallocate: 1 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.use_direct_reads: 0 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.db_log_dir: 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.wal_dir: 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T03:19:38.314 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.write_buffer_manager: 0x556c8de79360 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.unordered_write: 0 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T03:19:38.315 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.row_cache: None 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.wal_filter: None 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.two_write_queues: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.wal_compression: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.atomic_flush: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.log_readahead_size: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T03:19:38.316 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_background_jobs: 2 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_background_compactions: -1 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_subcompactions: 1 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T03:19:38.318 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_open_files: -1 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_background_flushes: -1 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Compression algorithms supported: 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: kZSTD supported: 0 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: kXpressCompression supported: 0 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T03:19:38.319 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: kZlibCompression supported: 1 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: kSnappyCompression supported: 1 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: kLZ4Compression supported: 1 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: kBZip2Compression supported: 0 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi184/store.db/MANIFEST-000009 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.merge_operator: 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_filter: None 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556c8dec3720) 2023-12-16T03:19:38.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: cache_index_and_filter_blocks: 1 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: pin_top_level_index_and_filter: 1 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: index_type: 0 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: data_block_index_type: 0 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: index_shortening: 1 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: checksum: 4 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: no_block_cache: 0 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache: 0x556c8df19090 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache_name: BinnedLRUCache 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache_options: 2023-12-16T03:19:38.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: capacity : 536870912 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: num_shard_bits : 4 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: strict_capacity_limit : 0 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: high_pri_pool_ratio: 0.000 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache_compressed: (nil) 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: persistent_cache: (nil) 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_size: 4096 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_size_deviation: 10 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_restart_interval: 16 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: index_block_restart_interval: 1 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: metadata_block_size: 4096 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: partition_filters: 0 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: use_delta_encoding: 1 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: filter_policy: bloomfilter 2023-12-16T03:19:38.322 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: whole_key_filtering: 1 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: verify_compression: 0 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: read_amp_bytes_per_bit: 0 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: format_version: 5 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: enable_index_compression: 1 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_align: 0 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: max_auto_readahead_size: 262144 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: prepopulate_block_cache: 0 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: initial_auto_readahead_size: 8192 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: num_file_reads_for_auto_readahead: 2 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression: NoCompression 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T03:19:38.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.num_levels: 7 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T03:19:38.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T03:19:38.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T03:19:38.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.arena_block_size: 1048576 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T03:19:38.327 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.table_properties_collectors: 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.inplace_update_support: 0 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.bloom_locality: 0 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.max_successive_merges: 0 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T03:19:38.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.ttl: 2592000 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.enable_blob_files: false 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.min_blob_size: 0 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.blob_file_starting_level: 0 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-16T03:19:38.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi184/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12927, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6834e8d2-18e7-4019-bd9a-46012b4c6222 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696777900670, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696777908077, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1929924, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12922, "largest_seqno": 13690, "table_properties": {"data_size": 1926087, "index_size": 1927, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 901, "raw_key_size": 8221, "raw_average_key_size": 24, "raw_value_size": 1918926, "raw_average_value_size": 5711, "num_data_blocks": 87, "num_entries": 336, "num_filter_entries": 336, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702696777, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6834e8d2-18e7-4019-bd9a-46012b4c6222", "db_session_id": "LQK90XNAUHKCHYSTKTEC", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702696777908226, "job": 1, "event": "recovery_finished"} 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi184/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556c8dfb4000 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: DB pointer 0x556c8dfa2000 2023-12-16T03:19:38.330 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** DB Stats ** 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** Compaction Stats [default] ** 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: L0 1/0 1.84 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 595.3 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T03:19:38.331 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: L6 1/0 6.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Sum 2/0 8.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 595.3 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 595.3 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** Compaction Stats [default] ** 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 595.3 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T03:19:38.332 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T03:19:38.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T03:19:38.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T03:19:38.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative compaction: 0.00 GB write, 174.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:19:38.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval compaction: 0.00 GB write, 174.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T03:19:38.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T03:19:38.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Block cache BinnedLRUCache@0x556c8df19090#7 capacity: 512.00 MB usage: 3.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-12-16T03:19:38.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.03 KB,0.000196695%) IndexBlock(1,2.08 KB,0.000396371%) Misc(1,0.00 KB,0%) 2023-12-16T03:19:38.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:19:38.333 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: starting mon.smithi184 rank 1 at public addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] at bind addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi184 fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: mon.smithi184@-1(???) e2 preinit fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: mon.smithi184@-1(???).mds e15 new map 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: mon.smithi184@-1(???).mds e15 print_map 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: e15 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: legacy client fscid: 1 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Filesystem 'cephfs' (1) 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: fs_name cephfs 2023-12-16T03:19:38.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: epoch 15 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: modified 2023-12-16T03:15:58.604245+0000 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: tableserver 0 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: root 0 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: session_timeout 60 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: session_autoclose 300 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: max_file_size 1099511627776 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: max_xattr_size 65536 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: required_client_features {} 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: last_failure 0 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: last_failure_osd_epoch 0 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:19:38.335 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: max_mds 2 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: in 0,1 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: up {0=14460,1=24269} 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: failed 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: damaged 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: stopped 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: data_pools [3] 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: metadata_pool 2 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: inline_data enabled 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: balancer 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: bal_rank_mask -1 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: standby_count_wanted 1 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: [mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:38.336 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: [mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Standby daemons: 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: [mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: [mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: mon.smithi184@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: mon.smithi184@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: mon.smithi184@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: mon.smithi184@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T03:19:38.337 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:37 smithi184 ceph-mon[184130]: mon.smithi184@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-16T03:19:39.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: mon.smithi064 calling monitor election 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: mon.smithi184 calling monitor election 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: mon.smithi064 is new leader, mons smithi064,smithi184 in quorum (ranks 0,1) 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: monmap e3: 2 mons at {smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: mgrmap e38: smithi064.ueciyw(active, since 13s), standbys: smithi184.urtxla 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:19:39.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:39.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:39.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:39.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:39.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:39 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:40.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:40.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:40.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:19:40.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2023-12-16T03:19:40.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: mon.smithi064 calling monitor election 2023-12-16T03:19:40.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: mon.smithi184 calling monitor election 2023-12-16T03:19:40.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: mon.smithi064 is new leader, mons smithi064,smithi184 in quorum (ranks 0,1) 2023-12-16T03:19:40.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: monmap e3: 2 mons at {smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: mgrmap e38: smithi064.ueciyw(active, since 13s), standbys: smithi184.urtxla 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:40.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:39 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:41.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:41 smithi064 ceph-mon[216854]: pgmap v10: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T03:19:41.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:41 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:19:41.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:41 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:41.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:41 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:41.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:41 smithi184 ceph-mon[184130]: pgmap v10: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T03:19:41.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:41 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:19:41.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:41 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:41.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:41 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:42.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:42 smithi184 ceph-mon[184130]: pgmap v11: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T03:19:42.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:42 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:42.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:42 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:42.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:42 smithi064 ceph-mon[216854]: pgmap v11: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T03:19:42.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:42 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:42.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:42 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:45.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: pgmap v12: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: Reconfiguring mon.smithi064 (monmap changed)... 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:45.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:45 smithi184 ceph-mon[184130]: Reconfiguring daemon mon.smithi064 on smithi064 2023-12-16T03:19:45.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: pgmap v12: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T03:19:45.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:45.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:45.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:45.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:19:45.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:45.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: Reconfiguring mon.smithi064 (monmap changed)... 2023-12-16T03:19:45.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:19:45.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:19:45.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:45.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:45 smithi064 ceph-mon[216854]: Reconfiguring daemon mon.smithi064 on smithi064 2023-12-16T03:19:46.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:46 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:46.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:46 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:46.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:46 smithi064 ceph-mon[216854]: Reconfiguring mgr.smithi064.ueciyw (monmap changed)... 2023-12-16T03:19:46.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:46 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.ueciyw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:19:46.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:46 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:19:46.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:46 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:46.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:46 smithi064 ceph-mon[216854]: Reconfiguring daemon mgr.smithi064.ueciyw on smithi064 2023-12-16T03:19:46.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:46 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:46.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:46 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:46.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:46 smithi184 ceph-mon[184130]: Reconfiguring mgr.smithi064.ueciyw (monmap changed)... 2023-12-16T03:19:46.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:46 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.ueciyw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:19:46.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:46 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:19:46.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:46 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:46.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:46 smithi184 ceph-mon[184130]: Reconfiguring daemon mgr.smithi064.ueciyw on smithi064 2023-12-16T03:19:46.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.829+0000 7f23b67f4700 1 -- 172.21.15.64:0/3724999077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 msgr2=0x7f23b0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:46.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.829+0000 7f23b67f4700 1 --2- 172.21.15.64:0/3724999077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 0x7f23b0065800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f23a4004940 tx=0x7f23a4009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:46.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.829+0000 7f23b67f4700 1 -- 172.21.15.64:0/3724999077 shutdown_connections 2023-12-16T03:19:46.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.829+0000 7f23b67f4700 1 --2- 172.21.15.64:0/3724999077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 0x7f23b0065800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:46.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.829+0000 7f23b67f4700 1 --2- 172.21.15.64:0/3724999077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b0102c20 0x7f23b0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:46.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.829+0000 7f23b67f4700 1 -- 172.21.15.64:0/3724999077 >> 172.21.15.64:0/3724999077 conn(0x7f23b00719b0 msgr2=0x7f23b0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:46.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.829+0000 7f23b67f4700 1 -- 172.21.15.64:0/3724999077 shutdown_connections 2023-12-16T03:19:46.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.829+0000 7f23b67f4700 1 -- 172.21.15.64:0/3724999077 wait complete. 2023-12-16T03:19:46.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.829+0000 7f23b67f4700 1 Processor -- start 2023-12-16T03:19:46.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23b67f4700 1 -- start start 2023-12-16T03:19:46.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23b67f4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 0x7f23b00fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:46.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23b67f4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b0102c20 0x7f23b00fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:46.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23b67f4700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00fc730 con 0x7f23b0065390 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23b67f4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00fc8a0 con 0x7f23b0102c20 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23affff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 0x7f23b00fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23affff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 0x7f23b00fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42478/0 (socket says 172.21.15.64:42478) 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23affff700 1 -- 172.21.15.64:0/947314827 learned_addr learned my addr 172.21.15.64:0/947314827 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23af7fe700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b0102c20 0x7f23b00fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23affff700 1 -- 172.21.15.64:0/947314827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b0102c20 msgr2=0x7f23b00fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23affff700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b0102c20 0x7f23b00fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.830+0000 7f23affff700 1 -- 172.21.15.64:0/947314827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4005040 con 0x7f23b0065390 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.831+0000 7f23affff700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 0x7f23b00fbbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23a0002a50 tx=0x7f23a00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.831+0000 7f23acff9700 1 -- 172.21.15.64:0/947314827 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a0007cc0 con 0x7f23b0065390 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.831+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b0119970 con 0x7f23b0065390 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.831+0000 7f23acff9700 1 -- 172.21.15.64:0/947314827 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23a000f040 con 0x7f23b0065390 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.831+0000 7f23acff9700 1 -- 172.21.15.64:0/947314827 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a000d9c0 con 0x7f23b0065390 2023-12-16T03:19:46.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.831+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b0119e20 con 0x7f23b0065390 2023-12-16T03:19:46.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.832+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b00fff40 con 0x7f23b0065390 2023-12-16T03:19:46.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.832+0000 7f23acff9700 1 -- 172.21.15.64:0/947314827 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f23a000db20 con 0x7f23b0065390 2023-12-16T03:19:46.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.833+0000 7f23acff9700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f239806cf80 0x7f239806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:46.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.833+0000 7f23acff9700 1 -- 172.21.15.64:0/947314827 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f23a008c160 con 0x7f23b0065390 2023-12-16T03:19:46.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.833+0000 7f23af7fe700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f239806cf80 0x7f239806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:46.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.833+0000 7f23af7fe700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f239806cf80 0x7f239806f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23b00fdd00 tx=0x7f23a4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:46.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:46.838+0000 7f23acff9700 1 -- 172.21.15.64:0/947314827 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f23a0055ef0 con 0x7f23b0065390 2023-12-16T03:19:47.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.062+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23b00fd330 con 0x7f239806cf80 2023-12-16T03:19:47.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.064+0000 7f23acff9700 1 -- 172.21.15.64:0/947314827 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f23b00fd330 con 0x7f239806cf80 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f239806cf80 msgr2=0x7f239806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f239806cf80 0x7f239806f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23b00fdd00 tx=0x7f23a4009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 msgr2=0x7f23b00fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 0x7f23b00fbbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23a0002a50 tx=0x7f23a00046b0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 shutdown_connections 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f239806cf80 0x7f239806f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23b0065390 0x7f23b00fbbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 --2- 172.21.15.64:0/947314827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b0102c20 0x7f23b00fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 >> 172.21.15.64:0/947314827 conn(0x7f23b00719b0 msgr2=0x7f23b00fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 shutdown_connections 2023-12-16T03:19:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.066+0000 7f23b67f4700 1 -- 172.21.15.64:0/947314827 wait complete. 2023-12-16T03:19:47.078 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:19:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.172+0000 7fccd9291700 1 -- 172.21.15.64:0/71278021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 msgr2=0x7fccd4106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.172+0000 7fccd9291700 1 --2- 172.21.15.64:0/71278021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 0x7fccd4106c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fccbc004940 tx=0x7fccbc009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.172+0000 7fccd9291700 1 -- 172.21.15.64:0/71278021 shutdown_connections 2023-12-16T03:19:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.172+0000 7fccd9291700 1 --2- 172.21.15.64:0/71278021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 0x7fccd4106c50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.172+0000 7fccd9291700 1 --2- 172.21.15.64:0/71278021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccd40fdc70 0x7fccd40fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.172+0000 7fccd9291700 1 -- 172.21.15.64:0/71278021 >> 172.21.15.64:0/71278021 conn(0x7fccd40f76c0 msgr2=0x7fccd40f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.172+0000 7fccd9291700 1 -- 172.21.15.64:0/71278021 shutdown_connections 2023-12-16T03:19:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.172+0000 7fccd9291700 1 -- 172.21.15.64:0/71278021 wait complete. 2023-12-16T03:19:47.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.172+0000 7fccd9291700 1 Processor -- start 2023-12-16T03:19:47.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd9291700 1 -- start start 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd9291700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccd40fdc70 0x7fccd40fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd9291700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 0x7fccd40fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd9291700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40fc5e0 con 0x7fccd40fe610 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd9291700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40fc750 con 0x7fccd40fdc70 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd27fc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 0x7fccd40fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd27fc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 0x7fccd40fbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42492/0 (socket says 172.21.15.64:42492) 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd27fc700 1 -- 172.21.15.64:0/1099337039 learned_addr learned my addr 172.21.15.64:0/1099337039 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd2ffd700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccd40fdc70 0x7fccd40fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd27fc700 1 -- 172.21.15.64:0/1099337039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccd40fdc70 msgr2=0x7fccd40fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd27fc700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccd40fdc70 0x7fccd40fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.173+0000 7fccd27fc700 1 -- 172.21.15.64:0/1099337039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc005040 con 0x7fccd40fe610 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.174+0000 7fccd27fc700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 0x7fccd40fbfe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00b3b0 tx=0x7fccbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:47.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.174+0000 7fcccb7fe700 1 -- 172.21.15.64:0/1099337039 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccbc00e040 con 0x7fccd40fe610 2023-12-16T03:19:47.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.174+0000 7fcccb7fe700 1 -- 172.21.15.64:0/1099337039 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fccbc004290 con 0x7fccd40fe610 2023-12-16T03:19:47.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.174+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd4119850 con 0x7fccd40fe610 2023-12-16T03:19:47.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.174+0000 7fcccb7fe700 1 -- 172.21.15.64:0/1099337039 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccbc01c3f0 con 0x7fccd40fe610 2023-12-16T03:19:47.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.174+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd4119d30 con 0x7fccd40fe610 2023-12-16T03:19:47.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.175+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd4104260 con 0x7fccd40fe610 2023-12-16T03:19:47.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.175+0000 7fcccb7fe700 1 -- 172.21.15.64:0/1099337039 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fccbc013820 con 0x7fccd40fe610 2023-12-16T03:19:47.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.176+0000 7fcccb7fe700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fccc006cf80 0x7fccc006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:47.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.176+0000 7fcccb7fe700 1 -- 172.21.15.64:0/1099337039 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fccbc08d6e0 con 0x7fccd40fe610 2023-12-16T03:19:47.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.176+0000 7fccd2ffd700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fccc006cf80 0x7fccc006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:47.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.176+0000 7fccd2ffd700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fccc006cf80 0x7fccc006f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fccc4004f40 tx=0x7fccc400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:47.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.180+0000 7fcccb7fe700 1 -- 172.21.15.64:0/1099337039 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fccbc057510 con 0x7fccd40fe610 2023-12-16T03:19:47.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.412+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccd404bc20 con 0x7fccc006cf80 2023-12-16T03:19:47.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.413+0000 7fcccb7fe700 1 -- 172.21.15.64:0/1099337039 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fccc400f040 con 0x7fccc006cf80 2023-12-16T03:19:47.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fccc006cf80 msgr2=0x7fccc006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fccc006cf80 0x7fccc006f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fccc4004f40 tx=0x7fccc400b040 comp rx=0 tx=0).stop 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 msgr2=0x7fccd40fbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 0x7fccd40fbfe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00b3b0 tx=0x7fccbc009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 shutdown_connections 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fccc006cf80 0x7fccc006f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccd40fdc70 0x7fccd40fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 --2- 172.21.15.64:0/1099337039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccd40fe610 0x7fccd40fbfe0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 >> 172.21.15.64:0/1099337039 conn(0x7fccd40f76c0 msgr2=0x7fccd41013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 shutdown_connections 2023-12-16T03:19:47.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.415+0000 7fccd9291700 1 -- 172.21.15.64:0/1099337039 wait complete. 2023-12-16T03:19:47.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:47 smithi064 ceph-mon[216854]: pgmap v13: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:47.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:47 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:47 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:47 smithi064 ceph-mon[216854]: Reconfiguring crash.smithi064 (monmap changed)... 2023-12-16T03:19:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:47 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:19:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:47 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:47 smithi064 ceph-mon[216854]: Reconfiguring daemon crash.smithi064 on smithi064 2023-12-16T03:19:47.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.523+0000 7fa435b2b700 1 -- 172.21.15.64:0/501400529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 msgr2=0x7fa430102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.523+0000 7fa435b2b700 1 --2- 172.21.15.64:0/501400529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 0x7fa430102fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa420004940 tx=0x7fa420009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:47.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.523+0000 7fa435b2b700 1 -- 172.21.15.64:0/501400529 shutdown_connections 2023-12-16T03:19:47.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.523+0000 7fa435b2b700 1 --2- 172.21.15.64:0/501400529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa430103590 0x7fa4300fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.523+0000 7fa435b2b700 1 --2- 172.21.15.64:0/501400529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 0x7fa430102fc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.523+0000 7fa435b2b700 1 -- 172.21.15.64:0/501400529 >> 172.21.15.64:0/501400529 conn(0x7fa4300f87a0 msgr2=0x7fa4300fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:47.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.523+0000 7fa435b2b700 1 -- 172.21.15.64:0/501400529 shutdown_connections 2023-12-16T03:19:47.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.523+0000 7fa435b2b700 1 -- 172.21.15.64:0/501400529 wait complete. 2023-12-16T03:19:47.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.523+0000 7fa435b2b700 1 Processor -- start 2023-12-16T03:19:47.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa435b2b700 1 -- start start 2023-12-16T03:19:47.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa435b2b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 0x7fa430113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa435b2b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa430103590 0x7fa430113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa435b2b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430114220 con 0x7fa430102bf0 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa435b2b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43010d510 con 0x7fa430103590 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa42f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 0x7fa430113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa42f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 0x7fa430113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42504/0 (socket says 172.21.15.64:42504) 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa42f7fe700 1 -- 172.21.15.64:0/1568034939 learned_addr learned my addr 172.21.15.64:0/1568034939 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa42effd700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa430103590 0x7fa430113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa42f7fe700 1 -- 172.21.15.64:0/1568034939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa430103590 msgr2=0x7fa430113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa42f7fe700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa430103590 0x7fa430113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.524+0000 7fa42f7fe700 1 -- 172.21.15.64:0/1568034939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420005040 con 0x7fa430102bf0 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.525+0000 7fa42f7fe700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 0x7fa430113650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa420009fd0 tx=0x7fa420009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.525+0000 7fa417fff700 1 -- 172.21.15.64:0/1568034939 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42000e040 con 0x7fa430102bf0 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.525+0000 7fa417fff700 1 -- 172.21.15.64:0/1568034939 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa420013420 con 0x7fa430102bf0 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.525+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43010d740 con 0x7fa430102bf0 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.525+0000 7fa417fff700 1 -- 172.21.15.64:0/1568034939 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42001c630 con 0x7fa430102bf0 2023-12-16T03:19:47.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.525+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43010dc80 con 0x7fa430102bf0 2023-12-16T03:19:47.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.526+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4300fff00 con 0x7fa430102bf0 2023-12-16T03:19:47.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.527+0000 7fa417fff700 1 -- 172.21.15.64:0/1568034939 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fa420013590 con 0x7fa430102bf0 2023-12-16T03:19:47.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.527+0000 7fa417fff700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa41806cf80 0x7fa41806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:47.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.527+0000 7fa417fff700 1 -- 172.21.15.64:0/1568034939 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa42008d770 con 0x7fa430102bf0 2023-12-16T03:19:47.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.527+0000 7fa42effd700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa41806cf80 0x7fa41806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:47.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.528+0000 7fa42effd700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa41806cf80 0x7fa41806f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa43010eef0 tx=0x7fa42400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:47.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.532+0000 7fa417fff700 1 -- 172.21.15.64:0/1568034939 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fa42005af90 con 0x7fa430102bf0 2023-12-16T03:19:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:47 smithi184 ceph-mon[184130]: pgmap v13: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:47 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:47.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:47 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:47.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:47 smithi184 ceph-mon[184130]: Reconfiguring crash.smithi064 (monmap changed)... 2023-12-16T03:19:47.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:47 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:19:47.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:47 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:47.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:47 smithi184 ceph-mon[184130]: Reconfiguring daemon crash.smithi064 on smithi064 2023-12-16T03:19:47.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.765+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa43010ec30 con 0x7fa41806cf80 2023-12-16T03:19:47.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.775+0000 7fa417fff700 1 -- 172.21.15.64:0/1568034939 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa43010ec30 con 0x7fa41806cf80 2023-12-16T03:19:47.777 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:19:47.777 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (106s) 18s ago 9m 17.8M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (9m) 18s ago 9m 7432k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3e9c0c547baa 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (9m) 7s ago 9m 7478k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 35f253d1e1f5 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (92s) 18s ago 9m 84.0M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (5m) 18s ago 5m 14.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (5m) 18s ago 5m 6644M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (5m) 7s ago 5m 4651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (5m) 7s ago 5m 16.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (2m) 18s ago 10m 478M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (2m) 7s ago 9m 446M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (30s) 18s ago 10m 31.2M 2048M 19.0.0-191-g6d933094 a29c258b5d6f fcfcecd16324 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (10s) 7s ago 8m 23.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 1523b5eb5b04 2023-12-16T03:19:47.778 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (2m) 18s ago 9m 18.2M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:19:47.779 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (2m) 7s ago 9m 19.2M - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:19:47.779 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (8m) 18s ago 8m 765M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:19:47.779 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (8m) 18s ago 8m 840M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:19:47.779 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (7m) 18s ago 7m 643M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:19:47.779 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (7m) 7s ago 7m 969M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:19:47.779 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (7m) 7s ago 7m 771M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:19:47.779 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (6m) 7s ago 6m 851M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:19:47.779 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (118s) 18s ago 9m 56.0M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:19:47.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.777+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa41806cf80 msgr2=0x7fa41806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.777+0000 7fa435b2b700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa41806cf80 0x7fa41806f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa43010eef0 tx=0x7fa42400b040 comp rx=0 tx=0).stop 2023-12-16T03:19:47.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.777+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 msgr2=0x7fa430113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.777+0000 7fa435b2b700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 0x7fa430113650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa420009fd0 tx=0x7fa420009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:47.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.778+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 shutdown_connections 2023-12-16T03:19:47.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.778+0000 7fa435b2b700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa41806cf80 0x7fa41806f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.778+0000 7fa435b2b700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa430102bf0 0x7fa430113650 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.778+0000 7fa435b2b700 1 --2- 172.21.15.64:0/1568034939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa430103590 0x7fa430113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.778+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 >> 172.21.15.64:0/1568034939 conn(0x7fa4300f87a0 msgr2=0x7fa4300fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:47.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.778+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 shutdown_connections 2023-12-16T03:19:47.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.778+0000 7fa435b2b700 1 -- 172.21.15.64:0/1568034939 wait complete. 2023-12-16T03:19:47.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.882+0000 7f595352a700 1 -- 172.21.15.64:0/4220732664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c0fbb00 msgr2=0x7f594c0fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.882+0000 7f595352a700 1 --2- 172.21.15.64:0/4220732664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c0fbb00 0x7f594c0fbf70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f593c004940 tx=0x7f593c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:47.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.882+0000 7f595352a700 1 -- 172.21.15.64:0/4220732664 shutdown_connections 2023-12-16T03:19:47.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.882+0000 7f595352a700 1 --2- 172.21.15.64:0/4220732664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c0fbb00 0x7f594c0fbf70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.882+0000 7f595352a700 1 --2- 172.21.15.64:0/4220732664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f594c101b60 0x7f594c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.882+0000 7f595352a700 1 -- 172.21.15.64:0/4220732664 >> 172.21.15.64:0/4220732664 conn(0x7f594c0f7680 msgr2=0x7f594c0f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:47.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.882+0000 7f595352a700 1 -- 172.21.15.64:0/4220732664 shutdown_connections 2023-12-16T03:19:47.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.882+0000 7f595352a700 1 -- 172.21.15.64:0/4220732664 wait complete. 2023-12-16T03:19:47.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f595352a700 1 Processor -- start 2023-12-16T03:19:47.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f595352a700 1 -- start start 2023-12-16T03:19:47.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f595352a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f594c0fbb00 0x7f594c10e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f595352a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c101b60 0x7f594c10ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f595352a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c10f150 con 0x7f594c101b60 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f595352a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c10f2c0 con 0x7f594c0fbb00 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f5950ac5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c101b60 0x7f594c10ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f5950ac5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c101b60 0x7f594c10ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42522/0 (socket says 172.21.15.64:42522) 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f5950ac5700 1 -- 172.21.15.64:0/459572153 learned_addr learned my addr 172.21.15.64:0/459572153 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.883+0000 7f59512c6700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f594c0fbb00 0x7f594c10e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.884+0000 7f5950ac5700 1 -- 172.21.15.64:0/459572153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f594c0fbb00 msgr2=0x7f594c10e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.884+0000 7f5950ac5700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f594c0fbb00 0x7f594c10e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.884+0000 7f5950ac5700 1 -- 172.21.15.64:0/459572153 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c005040 con 0x7f594c101b60 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.884+0000 7f5950ac5700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c101b60 0x7f594c10ebc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f593c009360 tx=0x7f593c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:47.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.884+0000 7f5941ffb700 1 -- 172.21.15.64:0/459572153 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593c00e040 con 0x7f594c101b60 2023-12-16T03:19:47.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.884+0000 7f5941ffb700 1 -- 172.21.15.64:0/459572153 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f593c013420 con 0x7f594c101b60 2023-12-16T03:19:47.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.884+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c1175f0 con 0x7f594c101b60 2023-12-16T03:19:47.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.884+0000 7f5941ffb700 1 -- 172.21.15.64:0/459572153 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593c01c610 con 0x7f594c101b60 2023-12-16T03:19:47.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.884+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c117ae0 con 0x7f594c101b60 2023-12-16T03:19:47.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.885+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594c103f40 con 0x7f594c101b60 2023-12-16T03:19:47.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.886+0000 7f5941ffb700 1 -- 172.21.15.64:0/459572153 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f593c01c880 con 0x7f594c101b60 2023-12-16T03:19:47.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.886+0000 7f5941ffb700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f593806cf80 0x7f593806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:47.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.886+0000 7f5941ffb700 1 -- 172.21.15.64:0/459572153 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f593c08d700 con 0x7f594c101b60 2023-12-16T03:19:47.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.886+0000 7f59512c6700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f593806cf80 0x7f593806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:47.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.887+0000 7f59512c6700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f593806cf80 0x7f593806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5948004f40 tx=0x7f594800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:47.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:47.891+0000 7f5941ffb700 1 -- 172.21.15.64:0/459572153 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f593c057540 con 0x7f594c101b60 2023-12-16T03:19:48.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.187+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f594c04bb80 con 0x7f594c101b60 2023-12-16T03:19:48.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.188+0000 7f5941ffb700 1 -- 172.21.15.64:0/459572153 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7f593c05ab60 con 0x7f594c101b60 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T03:19:48.190 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:19:48.191 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:19:48.191 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:19:48.191 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:19:48.191 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:19:48.191 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 10, 2023-12-16T03:19:48.191 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 4 2023-12-16T03:19:48.191 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:19:48.191 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f593806cf80 msgr2=0x7f593806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f593806cf80 0x7f593806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5948004f40 tx=0x7f594800b040 comp rx=0 tx=0).stop 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c101b60 msgr2=0x7f594c10ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c101b60 0x7f594c10ebc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f593c009360 tx=0x7f593c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 shutdown_connections 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f593806cf80 0x7f593806f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f594c0fbb00 0x7f594c10e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 --2- 172.21.15.64:0/459572153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f594c101b60 0x7f594c10ebc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 >> 172.21.15.64:0/459572153 conn(0x7f594c0f7680 msgr2=0x7f594c0f8390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 shutdown_connections 2023-12-16T03:19:48.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.190+0000 7f595352a700 1 -- 172.21.15.64:0/459572153 wait complete. 2023-12-16T03:19:48.286 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:48 smithi064 ceph-mon[216854]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:48.286 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:48 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:48.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.295+0000 7f5d57fa2700 1 -- 172.21.15.64:0/166806819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 msgr2=0x7f5d500fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.295+0000 7f5d57fa2700 1 --2- 172.21.15.64:0/166806819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 0x7f5d500fbfb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d40004940 tx=0x7f5d40009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 -- 172.21.15.64:0/166806819 shutdown_connections 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 --2- 172.21.15.64:0/166806819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 0x7f5d500fbfb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 --2- 172.21.15.64:0/166806819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d50101b00 0x7f5d50101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 -- 172.21.15.64:0/166806819 >> 172.21.15.64:0/166806819 conn(0x7f5d500719b0 msgr2=0x7f5d50071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 -- 172.21.15.64:0/166806819 shutdown_connections 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 -- 172.21.15.64:0/166806819 wait complete. 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 Processor -- start 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 -- start start 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 0x7f5d5010e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d50101b00 0x7f5d5010ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5010f290 con 0x7f5d500fbb40 2023-12-16T03:19:48.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d57fa2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5010f400 con 0x7f5d50101b00 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d55d3e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 0x7f5d5010e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.296+0000 7f5d55d3e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 0x7f5d5010e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42542/0 (socket says 172.21.15.64:42542) 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d55d3e700 1 -- 172.21.15.64:0/3037348673 learned_addr learned my addr 172.21.15.64:0/3037348673 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d5553d700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d50101b00 0x7f5d5010ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d55d3e700 1 -- 172.21.15.64:0/3037348673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d50101b00 msgr2=0x7f5d5010ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d55d3e700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d50101b00 0x7f5d5010ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d55d3e700 1 -- 172.21.15.64:0/3037348673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40005040 con 0x7f5d500fbb40 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d5553d700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d50101b00 0x7f5d5010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d55d3e700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 0x7f5d5010e7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c002a50 tx=0x7f5d4c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d467fc700 1 -- 172.21.15.64:0/3037348673 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d4c007cc0 con 0x7f5d500fbb40 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d50117770 con 0x7f5d500fbb40 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d467fc700 1 -- 172.21.15.64:0/3037348673 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5d4c00f040 con 0x7f5d500fbb40 2023-12-16T03:19:48.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d467fc700 1 -- 172.21.15.64:0/3037348673 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d4c009540 con 0x7f5d500fbb40 2023-12-16T03:19:48.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.297+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d50117c80 con 0x7f5d500fbb40 2023-12-16T03:19:48.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.298+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d50103fb0 con 0x7f5d500fbb40 2023-12-16T03:19:48.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.299+0000 7f5d467fc700 1 -- 172.21.15.64:0/3037348673 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f5d4c0096a0 con 0x7f5d500fbb40 2023-12-16T03:19:48.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.299+0000 7f5d467fc700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5d3c06cf80 0x7f5d3c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:48.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.299+0000 7f5d5553d700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5d3c06cf80 0x7f5d3c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:48.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.299+0000 7f5d467fc700 1 -- 172.21.15.64:0/3037348673 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5d4c08c300 con 0x7f5d500fbb40 2023-12-16T03:19:48.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.299+0000 7f5d5553d700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5d3c06cf80 0x7f5d3c06f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d40004f90 tx=0x7f5d40009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:48.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.303+0000 7f5d467fc700 1 -- 172.21.15.64:0/3037348673 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f5d4c056010 con 0x7f5d500fbb40 2023-12-16T03:19:48.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:48 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:48.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:48 smithi064 ceph-mon[216854]: Reconfiguring osd.0 (monmap changed)... 2023-12-16T03:19:48.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:48 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T03:19:48.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:48 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:48.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:48 smithi064 ceph-mon[216854]: Reconfiguring daemon osd.0 on smithi064 2023-12-16T03:19:48.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:48 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/459572153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:19:48.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:48 smithi184 ceph-mon[184130]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:48.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:48 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:48.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:48 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:48.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:48 smithi184 ceph-mon[184130]: Reconfiguring osd.0 (monmap changed)... 2023-12-16T03:19:48.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:48 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T03:19:48.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:48 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:48.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:48 smithi184 ceph-mon[184130]: Reconfiguring daemon osd.0 on smithi064 2023-12-16T03:19:48.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:48 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/459572153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:19:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.582+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5d5004bbb0 con 0x7f5d500fbb40 2023-12-16T03:19:48.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.582+0000 7f5d467fc700 1 -- 172.21.15.64:0/3037348673 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1888 (secure 0 0 0) 0x7f5d4c059630 con 0x7f5d500fbb40 2023-12-16T03:19:48.584 INFO:teuthology.orchestra.run.smithi064.stdout:e15 2023-12-16T03:19:48.584 INFO:teuthology.orchestra.run.smithi064.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:19:48.584 INFO:teuthology.orchestra.run.smithi064.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:19:48.584 INFO:teuthology.orchestra.run.smithi064.stdout:legacy client fscid: 1 2023-12-16T03:19:48.584 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:Filesystem 'cephfs' (1) 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:fs_name cephfs 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 15 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:modified 2023-12-16T03:15:58.604245+0000 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:tableserver 0 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:root 0 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:session_timeout 60 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:session_autoclose 300 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:max_file_size 1099511627776 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:max_xattr_size 65536 2023-12-16T03:19:48.585 INFO:teuthology.orchestra.run.smithi064.stdout:required_client_features {} 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure 0 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure_osd_epoch 0 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:max_mds 2 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:in 0,1 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:up {0=14460,1=24269} 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:failed 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:damaged 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:stopped 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:data_pools [3] 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:metadata_pool 2 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:inline_data enabled 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:balancer 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:bal_rank_mask -1 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:standby_count_wanted 1 2023-12-16T03:19:48.586 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:48.587 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:48.587 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:19:48.587 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:19:48.587 INFO:teuthology.orchestra.run.smithi064.stdout:Standby daemons: 2023-12-16T03:19:48.587 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:19:48.587 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:48.587 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.584+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5d3c06cf80 msgr2=0x7f5d3c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.584+0000 7f5d57fa2700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5d3c06cf80 0x7f5d3c06f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d40004f90 tx=0x7f5d40009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.584+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 msgr2=0x7f5d5010e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.584+0000 7f5d57fa2700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 0x7f5d5010e7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c002a50 tx=0x7f5d4c0046b0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.585+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 shutdown_connections 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.585+0000 7f5d57fa2700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5d3c06cf80 0x7f5d3c06f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.585+0000 7f5d57fa2700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d500fbb40 0x7f5d5010e7a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.585+0000 7f5d57fa2700 1 --2- 172.21.15.64:0/3037348673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d50101b00 0x7f5d5010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.585+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 >> 172.21.15.64:0/3037348673 conn(0x7f5d500719b0 msgr2=0x7f5d500fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.585+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 shutdown_connections 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.585+0000 7f5d57fa2700 1 -- 172.21.15.64:0/3037348673 wait complete. 2023-12-16T03:19:48.588 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 15 2023-12-16T03:19:48.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.693+0000 7f7691e20700 1 -- 172.21.15.64:0/3565051098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 msgr2=0x7f768c0fb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.693+0000 7f7691e20700 1 --2- 172.21.15.64:0/3565051098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 0x7f768c0fb800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f767c004940 tx=0x7f767c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:48.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.693+0000 7f7691e20700 1 -- 172.21.15.64:0/3565051098 shutdown_connections 2023-12-16T03:19:48.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.693+0000 7f7691e20700 1 --2- 172.21.15.64:0/3565051098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0fbd40 0x7f768c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.693+0000 7f7691e20700 1 --2- 172.21.15.64:0/3565051098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 0x7f768c0fb800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.693+0000 7f7691e20700 1 -- 172.21.15.64:0/3565051098 >> 172.21.15.64:0/3565051098 conn(0x7f768c0711a0 msgr2=0x7f768c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:48.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.693+0000 7f7691e20700 1 -- 172.21.15.64:0/3565051098 shutdown_connections 2023-12-16T03:19:48.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.693+0000 7f7691e20700 1 -- 172.21.15.64:0/3565051098 wait complete. 2023-12-16T03:19:48.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.694+0000 7f7691e20700 1 Processor -- start 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.694+0000 7f7691e20700 1 -- start start 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.694+0000 7f7691e20700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 0x7f768c06a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.694+0000 7f7691e20700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0fbd40 0x7f768c06ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.694+0000 7f7691e20700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c06fa70 con 0x7f768c0fb430 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.694+0000 7f7691e20700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c06fbb0 con 0x7f768c0fbd40 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.694+0000 7f768b7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 0x7f768c06a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.694+0000 7f768b7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 0x7f768c06a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42558/0 (socket says 172.21.15.64:42558) 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.694+0000 7f768b7fe700 1 -- 172.21.15.64:0/980029559 learned_addr learned my addr 172.21.15.64:0/980029559 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f768affd700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0fbd40 0x7f768c06ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f768b7fe700 1 -- 172.21.15.64:0/980029559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0fbd40 msgr2=0x7f768c06ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f768b7fe700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0fbd40 0x7f768c06ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f768b7fe700 1 -- 172.21.15.64:0/980029559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c005040 con 0x7f768c0fb430 2023-12-16T03:19:48.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f768b7fe700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 0x7f768c06a810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f767c009fd0 tx=0x7f767c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:48.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f7673fff700 1 -- 172.21.15.64:0/980029559 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f767c00e040 con 0x7f768c0fb430 2023-12-16T03:19:48.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f7673fff700 1 -- 172.21.15.64:0/980029559 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f767c013420 con 0x7f768c0fb430 2023-12-16T03:19:48.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c06b290 con 0x7f768c0fb430 2023-12-16T03:19:48.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f7673fff700 1 -- 172.21.15.64:0/980029559 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f767c01c630 con 0x7f768c0fb430 2023-12-16T03:19:48.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.695+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c102910 con 0x7f768c0fb430 2023-12-16T03:19:48.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.697+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768c0fddb0 con 0x7f768c0fb430 2023-12-16T03:19:48.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.700+0000 7f7673fff700 1 -- 172.21.15.64:0/980029559 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f767c013a00 con 0x7f768c0fb430 2023-12-16T03:19:48.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.700+0000 7f7673fff700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f767406cf80 0x7f767406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:48.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.700+0000 7f7673fff700 1 -- 172.21.15.64:0/980029559 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f767c08d970 con 0x7f768c0fb430 2023-12-16T03:19:48.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.700+0000 7f768affd700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f767406cf80 0x7f767406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:48.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.701+0000 7f768affd700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f767406cf80 0x7f767406f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f768c06c210 tx=0x7f7680009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:48.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.703+0000 7f7673fff700 1 -- 172.21.15.64:0/980029559 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f767c0576e0 con 0x7f768c0fb430 2023-12-16T03:19:48.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.953+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f768c06bf50 con 0x7f767406cf80 2023-12-16T03:19:48.956 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.954+0000 7f7673fff700 1 -- 172.21.15.64:0/980029559 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f768c06bf50 con 0x7f767406cf80 2023-12-16T03:19:48.956 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:19:48.956 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:19:48.956 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:19:48.956 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T03:19:48.956 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:19:48.956 INFO:teuthology.orchestra.run.smithi064.stdout: "mon", 2023-12-16T03:19:48.956 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:19:48.956 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:19:48.957 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "4/21 daemons upgraded", 2023-12-16T03:19:48.957 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Currently upgrading mon daemons", 2023-12-16T03:19:48.957 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:19:48.957 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:19:48.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.957+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f767406cf80 msgr2=0x7f767406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.957+0000 7f7691e20700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f767406cf80 0x7f767406f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f768c06c210 tx=0x7f7680009040 comp rx=0 tx=0).stop 2023-12-16T03:19:48.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.957+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 msgr2=0x7f768c06a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:48.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.957+0000 7f7691e20700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 0x7f768c06a810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f767c009fd0 tx=0x7f767c009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:48.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.957+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 shutdown_connections 2023-12-16T03:19:48.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.957+0000 7f7691e20700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f767406cf80 0x7f767406f430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.957+0000 7f7691e20700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f768c0fb430 0x7f768c06a810 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.957+0000 7f7691e20700 1 --2- 172.21.15.64:0/980029559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0fbd40 0x7f768c06ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:48.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.958+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 >> 172.21.15.64:0/980029559 conn(0x7f768c0711a0 msgr2=0x7f768c101090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:48.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.958+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 shutdown_connections 2023-12-16T03:19:48.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:48.958+0000 7f7691e20700 1 -- 172.21.15.64:0/980029559 wait complete. 2023-12-16T03:19:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.065+0000 7f41bc12e700 1 -- 172.21.15.64:0/3575164695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4065390 msgr2=0x7f41b4065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.065+0000 7f41bc12e700 1 --2- 172.21.15.64:0/3575164695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4065390 0x7f41b4065800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41a4004940 tx=0x7f41a4009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.065+0000 7f41bc12e700 1 -- 172.21.15.64:0/3575164695 shutdown_connections 2023-12-16T03:19:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.065+0000 7f41bc12e700 1 --2- 172.21.15.64:0/3575164695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4065390 0x7f41b4065800 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.065+0000 7f41bc12e700 1 --2- 172.21.15.64:0/3575164695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41b4102c20 0x7f41b4102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.065+0000 7f41bc12e700 1 -- 172.21.15.64:0/3575164695 >> 172.21.15.64:0/3575164695 conn(0x7f41b40719b0 msgr2=0x7f41b4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.065+0000 7f41bc12e700 1 -- 172.21.15.64:0/3575164695 shutdown_connections 2023-12-16T03:19:49.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.065+0000 7f41bc12e700 1 -- 172.21.15.64:0/3575164695 wait complete. 2023-12-16T03:19:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41bc12e700 1 Processor -- start 2023-12-16T03:19:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41bc12e700 1 -- start start 2023-12-16T03:19:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41bc12e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41b4065390 0x7f41b410b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41bc12e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4102c20 0x7f41b410b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41bc12e700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b410e4c0 con 0x7f41b4102c20 2023-12-16T03:19:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41bc12e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b410e600 con 0x7f41b4065390 2023-12-16T03:19:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41b96c9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4102c20 0x7f41b410b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41b96c9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4102c20 0x7f41b410b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:42582/0 (socket says 172.21.15.64:42582) 2023-12-16T03:19:49.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41b96c9700 1 -- 172.21.15.64:0/1524132450 learned_addr learned my addr 172.21.15.64:0/1524132450 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.066+0000 7f41b9eca700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41b4065390 0x7f41b410b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41b96c9700 1 -- 172.21.15.64:0/1524132450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41b4065390 msgr2=0x7f41b410b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41b96c9700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41b4065390 0x7f41b410b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41b96c9700 1 -- 172.21.15.64:0/1524132450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4005040 con 0x7f41b4102c20 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41b9eca700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41b4065390 0x7f41b410b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41b96c9700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4102c20 0x7f41b410b7c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c00 tx=0x7f41a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41aa7fc700 1 -- 172.21.15.64:0/1524132450 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a4021070 con 0x7f41b4102c20 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41aa7fc700 1 -- 172.21.15.64:0/1524132450 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f41a401c400 con 0x7f41b4102c20 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b410bdf0 con 0x7f41b4102c20 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41aa7fc700 1 -- 172.21.15.64:0/1524132450 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a400e070 con 0x7f41b4102c20 2023-12-16T03:19:49.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.067+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b411e1d0 con 0x7f41b4102c20 2023-12-16T03:19:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.068+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b40734d0 con 0x7f41b4102c20 2023-12-16T03:19:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.068+0000 7f41aa7fc700 1 -- 172.21.15.64:0/1524132450 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f41a401c9e0 con 0x7f41b4102c20 2023-12-16T03:19:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.069+0000 7f41aa7fc700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f41a006cf80 0x7f41a006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:19:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.069+0000 7f41aa7fc700 1 -- 172.21.15.64:0/1524132450 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f41a408d5c0 con 0x7f41b4102c20 2023-12-16T03:19:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.069+0000 7f41b9eca700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f41a006cf80 0x7f41a006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:19:49.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.069+0000 7f41b9eca700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f41a006cf80 0x7f41a006f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41b0004600 tx=0x7f41b000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:19:49.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.073+0000 7f41aa7fc700 1 -- 172.21.15.64:0/1524132450 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f41a40573f0 con 0x7f41b4102c20 2023-12-16T03:19:49.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.362+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f41b410c9c0 con 0x7f41b4102c20 2023-12-16T03:19:49.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.363+0000 7f41aa7fc700 1 -- 172.21.15.64:0/1524132450 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f41a405aa10 con 0x7f41b4102c20 2023-12-16T03:19:49.364 INFO:teuthology.orchestra.run.smithi064.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:49.365 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:19:49.365 INFO:teuthology.orchestra.run.smithi064.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:19:49.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f41a006cf80 msgr2=0x7f41a006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f41a006cf80 0x7f41a006f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41b0004600 tx=0x7f41b000b040 comp rx=0 tx=0).stop 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4102c20 msgr2=0x7f41b410b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4102c20 0x7f41b410b7c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c00 tx=0x7f41a4009e30 comp rx=0 tx=0).stop 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 shutdown_connections 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f41a006cf80 0x7f41a006f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41b4065390 0x7f41b410b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 --2- 172.21.15.64:0/1524132450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41b4102c20 0x7f41b410b7c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 >> 172.21.15.64:0/1524132450 conn(0x7f41b40719b0 msgr2=0x7f41b40fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 shutdown_connections 2023-12-16T03:19:49.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:19:49.365+0000 7f41bc12e700 1 -- 172.21.15.64:0/1524132450 wait complete. 2023-12-16T03:19:49.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:49 smithi064 ceph-mon[216854]: pgmap v14: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:49.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:49 smithi064 ceph-mon[216854]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:49.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:49 smithi064 ceph-mon[216854]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:49.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:49 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:49.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:49 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:49.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:49 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T03:19:49.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:49 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:49.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:49 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/3037348673' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:19:49.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:49 smithi184 ceph-mon[184130]: pgmap v14: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:49.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:49 smithi184 ceph-mon[184130]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:49.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:49 smithi184 ceph-mon[184130]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:49.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:49 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:49.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:49 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:49.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:49 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T03:19:49.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:49 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:49.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:49 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/3037348673' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:19:50.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:50 smithi184 ceph-mon[184130]: Reconfiguring osd.1 (monmap changed)... 2023-12-16T03:19:50.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:50 smithi184 ceph-mon[184130]: Reconfiguring daemon osd.1 on smithi064 2023-12-16T03:19:50.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:50 smithi184 ceph-mon[184130]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:50.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:50 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/1524132450' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:19:50.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:50 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:50.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:50 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:50.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:50 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T03:19:50.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:50 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:50.562 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:50 smithi064 ceph-mon[216854]: Reconfiguring osd.1 (monmap changed)... 2023-12-16T03:19:50.562 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:50 smithi064 ceph-mon[216854]: Reconfiguring daemon osd.1 on smithi064 2023-12-16T03:19:50.562 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:50 smithi064 ceph-mon[216854]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:19:50.562 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:50 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/1524132450' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:19:50.562 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:50 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:50.562 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:50 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:50.562 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:50 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T03:19:50.562 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:50 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:51.433 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:51 smithi064 ceph-mon[216854]: pgmap v15: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:51.433 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:51 smithi064 ceph-mon[216854]: Reconfiguring osd.2 (monmap changed)... 2023-12-16T03:19:51.433 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:51 smithi064 ceph-mon[216854]: Reconfiguring daemon osd.2 on smithi064 2023-12-16T03:19:51.433 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:51 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:51.433 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:51 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:51.434 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:51 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.jaepzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:19:51.434 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:51 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:51.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:51 smithi184 ceph-mon[184130]: pgmap v15: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:51.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:51 smithi184 ceph-mon[184130]: Reconfiguring osd.2 (monmap changed)... 2023-12-16T03:19:51.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:51 smithi184 ceph-mon[184130]: Reconfiguring daemon osd.2 on smithi064 2023-12-16T03:19:51.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:51 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:51.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:51 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:51.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:51 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.jaepzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:19:51.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:51 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:52.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:52 smithi064 ceph-mon[216854]: Reconfiguring mds.cephfs.smithi064.jaepzs (monmap changed)... 2023-12-16T03:19:52.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:52 smithi064 ceph-mon[216854]: Reconfiguring daemon mds.cephfs.smithi064.jaepzs on smithi064 2023-12-16T03:19:52.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:52 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:52.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:52 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:52.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:52 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.edrjyd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:19:52.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:52 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:52.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:52 smithi184 ceph-mon[184130]: Reconfiguring mds.cephfs.smithi064.jaepzs (monmap changed)... 2023-12-16T03:19:52.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:52 smithi184 ceph-mon[184130]: Reconfiguring daemon mds.cephfs.smithi064.jaepzs on smithi064 2023-12-16T03:19:52.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:52 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:52.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:52 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:52.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:52 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.edrjyd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:19:52.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:52 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:53.528 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:53 smithi184 ceph-mon[184130]: pgmap v16: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:53.528 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:53 smithi184 ceph-mon[184130]: Reconfiguring mds.cephfs.smithi064.edrjyd (monmap changed)... 2023-12-16T03:19:53.529 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:53 smithi184 ceph-mon[184130]: Reconfiguring daemon mds.cephfs.smithi064.edrjyd on smithi064 2023-12-16T03:19:53.529 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:53 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:53.529 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:53 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:53.529 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:53 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:19:53.529 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:53 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:53 smithi064 ceph-mon[216854]: pgmap v16: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:53.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:53 smithi064 ceph-mon[216854]: Reconfiguring mds.cephfs.smithi064.edrjyd (monmap changed)... 2023-12-16T03:19:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:53 smithi064 ceph-mon[216854]: Reconfiguring daemon mds.cephfs.smithi064.edrjyd on smithi064 2023-12-16T03:19:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:53 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:53 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:53 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:19:53.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:53 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:54 smithi184 ceph-mon[184130]: Reconfiguring crash.smithi184 (monmap changed)... 2023-12-16T03:19:54.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:54 smithi184 ceph-mon[184130]: Reconfiguring daemon crash.smithi184 on smithi184 2023-12-16T03:19:54.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:54.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:54.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:19:54.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:19:54.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:54 smithi064 ceph-mon[216854]: Reconfiguring crash.smithi184 (monmap changed)... 2023-12-16T03:19:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:54 smithi064 ceph-mon[216854]: Reconfiguring daemon crash.smithi184 on smithi184 2023-12-16T03:19:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.urtxla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T03:19:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T03:19:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:55.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:55 smithi184 ceph-mon[184130]: pgmap v17: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:55.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:55 smithi184 ceph-mon[184130]: Reconfiguring mgr.smithi184.urtxla (monmap changed)... 2023-12-16T03:19:55.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:55 smithi184 ceph-mon[184130]: Reconfiguring daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:19:55.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:55 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:55.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:55 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:55.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:55 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:19:55.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:55 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:19:55.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:55 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:55.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:55 smithi064 ceph-mon[216854]: pgmap v17: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:55.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:55 smithi064 ceph-mon[216854]: Reconfiguring mgr.smithi184.urtxla (monmap changed)... 2023-12-16T03:19:55.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:55 smithi064 ceph-mon[216854]: Reconfiguring daemon mgr.smithi184.urtxla on smithi184 2023-12-16T03:19:55.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:55 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:55.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:55 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:55.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:55 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T03:19:55.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:55 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T03:19:55.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:55 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:56.535 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:56 smithi184 ceph-mon[184130]: Reconfiguring mon.smithi184 (monmap changed)... 2023-12-16T03:19:56.535 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:56 smithi184 ceph-mon[184130]: Reconfiguring daemon mon.smithi184 on smithi184 2023-12-16T03:19:56.535 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:19:56.535 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:56.535 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:56.535 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T03:19:56.535 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:56.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:56 smithi064 ceph-mon[216854]: Reconfiguring mon.smithi184 (monmap changed)... 2023-12-16T03:19:56.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:56 smithi064 ceph-mon[216854]: Reconfiguring daemon mon.smithi184 on smithi184 2023-12-16T03:19:56.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:19:56.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:56.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:56.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T03:19:56.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:57.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:57 smithi184 ceph-mon[184130]: pgmap v18: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:57.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:57 smithi184 ceph-mon[184130]: Reconfiguring osd.3 (monmap changed)... 2023-12-16T03:19:57.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:57 smithi184 ceph-mon[184130]: Reconfiguring daemon osd.3 on smithi184 2023-12-16T03:19:57.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:57.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:57.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T03:19:57.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:57 smithi064 ceph-mon[216854]: pgmap v18: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:57 smithi064 ceph-mon[216854]: Reconfiguring osd.3 (monmap changed)... 2023-12-16T03:19:57.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:57 smithi064 ceph-mon[216854]: Reconfiguring daemon osd.3 on smithi184 2023-12-16T03:19:57.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:57.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:57.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T03:19:57.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:58.660 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:58 smithi064 ceph-mon[216854]: Reconfiguring osd.4 (monmap changed)... 2023-12-16T03:19:58.660 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:58 smithi064 ceph-mon[216854]: Reconfiguring daemon osd.4 on smithi184 2023-12-16T03:19:58.661 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:58 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:58.661 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:58 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:58.661 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:58 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T03:19:58.661 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:58 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:58.685 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:58 smithi184 ceph-mon[184130]: Reconfiguring osd.4 (monmap changed)... 2023-12-16T03:19:58.685 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:58 smithi184 ceph-mon[184130]: Reconfiguring daemon osd.4 on smithi184 2023-12-16T03:19:58.685 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:58 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:58.685 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:58 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:58.685 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:58 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T03:19:58.685 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:58 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:59.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:59 smithi064 ceph-mon[216854]: pgmap v19: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:59.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:59 smithi064 ceph-mon[216854]: Reconfiguring osd.5 (monmap changed)... 2023-12-16T03:19:59.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:59 smithi064 ceph-mon[216854]: Reconfiguring daemon osd.5 on smithi184 2023-12-16T03:19:59.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:59.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:59.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.jfpiqk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:19:59.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:19:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:19:59.734 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:59 smithi184 ceph-mon[184130]: pgmap v19: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:19:59.734 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:59 smithi184 ceph-mon[184130]: Reconfiguring osd.5 (monmap changed)... 2023-12-16T03:19:59.734 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:59 smithi184 ceph-mon[184130]: Reconfiguring daemon osd.5 on smithi184 2023-12-16T03:19:59.734 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:59.735 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:19:59.735 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.jfpiqk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:19:59.735 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:19:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:00.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:00 smithi184 ceph-mon[184130]: Reconfiguring mds.cephfs.smithi184.jfpiqk (monmap changed)... 2023-12-16T03:20:00.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:00 smithi184 ceph-mon[184130]: Reconfiguring daemon mds.cephfs.smithi184.jfpiqk on smithi184 2023-12-16T03:20:00.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:00 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:00.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:00 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:00.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:00 smithi184 ceph-mon[184130]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:20:00.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:00 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.uqpwjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:20:00.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:00 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:00.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:00 smithi064 ceph-mon[216854]: Reconfiguring mds.cephfs.smithi184.jfpiqk (monmap changed)... 2023-12-16T03:20:00.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:00 smithi064 ceph-mon[216854]: Reconfiguring daemon mds.cephfs.smithi184.jfpiqk on smithi184 2023-12-16T03:20:00.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:00 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:00.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:00 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:00.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:00 smithi064 ceph-mon[216854]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T03:20:00.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:00 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.uqpwjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T03:20:00.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:00 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:01.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: pgmap v20: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:01.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: Reconfiguring mds.cephfs.smithi184.uqpwjn (monmap changed)... 2023-12-16T03:20:01.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: Reconfiguring daemon mds.cephfs.smithi184.uqpwjn on smithi184 2023-12-16T03:20:01.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:01.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:01.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:01.583 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:01.583 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:01.583 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:01.583 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi064"}]: dispatch 2023-12-16T03:20:01.583 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi064"}]': finished 2023-12-16T03:20:01.583 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi184"}]: dispatch 2023-12-16T03:20:01.583 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi184"}]': finished 2023-12-16T03:20:01.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: pgmap v20: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: Reconfiguring mds.cephfs.smithi184.uqpwjn (monmap changed)... 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: Reconfiguring daemon mds.cephfs.smithi184.uqpwjn on smithi184 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi064"}]: dispatch 2023-12-16T03:20:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi064"}]': finished 2023-12-16T03:20:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi184"}]: dispatch 2023-12-16T03:20:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi184"}]': finished 2023-12-16T03:20:02.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:02 smithi064 ceph-mon[216854]: Upgrade: Setting container_image for all mon 2023-12-16T03:20:02.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:02 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:02.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:02 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:20:02.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:02 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:02 smithi184 ceph-mon[184130]: Upgrade: Setting container_image for all mon 2023-12-16T03:20:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:02 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:02 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:20:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:02 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:03.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:03 smithi064 ceph-mon[216854]: pgmap v21: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:03.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:03 smithi064 ceph-mon[216854]: Upgrade: Updating crash.smithi064 (1/2) 2023-12-16T03:20:03.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:03 smithi064 ceph-mon[216854]: Deploying daemon crash.smithi064 on smithi064 2023-12-16T03:20:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:03 smithi184 ceph-mon[184130]: pgmap v21: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:03.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:03 smithi184 ceph-mon[184130]: Upgrade: Updating crash.smithi064 (1/2) 2023-12-16T03:20:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:03 smithi184 ceph-mon[184130]: Deploying daemon crash.smithi064 on smithi064 2023-12-16T03:20:04.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:04 smithi064 ceph-mon[216854]: pgmap v22: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:04.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:04 smithi184 ceph-mon[184130]: pgmap v22: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:05.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:05 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:05.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:05 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:05 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:05 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:06.953 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:06 smithi184 ceph-mon[184130]: pgmap v23: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:06.953 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:06 smithi184 ceph-mon[184130]: Upgrade: Updating crash.smithi184 (2/2) 2023-12-16T03:20:06.953 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:06 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:06.953 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:06 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:20:06.953 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:06 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:06.953 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:06 smithi184 ceph-mon[184130]: Deploying daemon crash.smithi184 on smithi184 2023-12-16T03:20:07.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:06 smithi064 ceph-mon[216854]: pgmap v23: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:07.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:06 smithi064 ceph-mon[216854]: Upgrade: Updating crash.smithi184 (2/2) 2023-12-16T03:20:07.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:06 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:07.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:06 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T03:20:07.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:06 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:07.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:06 smithi064 ceph-mon[216854]: Deploying daemon crash.smithi184 on smithi184 2023-12-16T03:20:09.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:09 smithi184 ceph-mon[184130]: pgmap v24: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:09.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:09 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:09.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:09 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:09.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:09 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:09.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:09 smithi064 ceph-mon[216854]: pgmap v24: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:09.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:09 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:09.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:09 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:09.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:09 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:11.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:11 smithi064 ceph-mon[216854]: pgmap v25: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:11.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:11 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:11.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:11 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:11.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:11 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:20:11.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:11 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:11.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:11 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:11.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:11 smithi184 ceph-mon[184130]: pgmap v25: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:11.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:11 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:11.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:11 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:11.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:11 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:20:11.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:11 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:11.475 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:11 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:12.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:12 smithi064 ceph-mon[216854]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:12.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:12 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:12.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:12 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:12.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:12 smithi064 ceph-mon[216854]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:20:12.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:12 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:12.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:12 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:13.048 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:12 smithi184 ceph-mon[184130]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:13.048 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:12 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:13.048 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:12 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:13.048 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:12 smithi184 ceph-mon[184130]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:20:13.048 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:12 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:13.048 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:12 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:14.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:14 smithi184 ceph-mon[184130]: pgmap v27: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:14.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:14 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:14.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:14 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:14.855 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:14 smithi064 ceph-mon[216854]: pgmap v27: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:14.855 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:14 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:14.855 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:14 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:16.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: Upgrade: Setting container_image for all crash 2023-12-16T03:20:16.381 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:16.381 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi064"}]: dispatch 2023-12-16T03:20:16.381 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi064"}]': finished 2023-12-16T03:20:16.381 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi184"}]: dispatch 2023-12-16T03:20:16.381 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi184"}]': finished 2023-12-16T03:20:16.381 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T03:20:16.381 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T03:20:16.381 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:16 smithi064 ceph-mon[216854]: Upgrade: osd.0 is safe to restart 2023-12-16T03:20:16.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: Upgrade: Setting container_image for all crash 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi064"}]: dispatch 2023-12-16T03:20:16.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi064"}]': finished 2023-12-16T03:20:16.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi184"}]: dispatch 2023-12-16T03:20:16.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi184"}]': finished 2023-12-16T03:20:16.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T03:20:16.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T03:20:16.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:16 smithi184 ceph-mon[184130]: Upgrade: osd.0 is safe to restart 2023-12-16T03:20:17.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:17 smithi184 ceph-mon[184130]: pgmap v28: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:17.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:17 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:17.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:17 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T03:20:17.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:17 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:17.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:17 smithi064 ceph-mon[216854]: pgmap v28: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:17.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:17 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:17.646 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:17 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T03:20:17.647 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:17 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:18.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:18 smithi184 ceph-mon[184130]: Upgrade: Updating osd.0 2023-12-16T03:20:18.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:18 smithi184 ceph-mon[184130]: Deploying daemon osd.0 on smithi064 2023-12-16T03:20:18.596 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:18 smithi064 ceph-mon[216854]: Upgrade: Updating osd.0 2023-12-16T03:20:18.596 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:18 smithi064 ceph-mon[216854]: Deploying daemon osd.0 on smithi064 2023-12-16T03:20:18.921 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:18 smithi064 systemd[1]: Stopping Ceph osd.0 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:20:19.192 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:18 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[135616]: 2023-12-16T03:20:18.917+0000 7ffa7544d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:20:19.193 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:18 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[135616]: 2023-12-16T03:20:18.917+0000 7ffa7544d700 -1 osd.0 46 *** Got signal Terminated *** 2023-12-16T03:20:19.193 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:18 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[135616]: 2023-12-16T03:20:18.917+0000 7ffa7544d700 -1 osd.0 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:20:19.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.475+0000 7f9c63161700 1 -- 172.21.15.64:0/1414829717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c0fbb00 msgr2=0x7f9c5c0fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:19.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.475+0000 7f9c63161700 1 --2- 172.21.15.64:0/1414829717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c0fbb00 0x7f9c5c0fbf70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9c48004940 tx=0x7f9c48009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:19.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.475+0000 7f9c63161700 1 -- 172.21.15.64:0/1414829717 shutdown_connections 2023-12-16T03:20:19.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.475+0000 7f9c63161700 1 --2- 172.21.15.64:0/1414829717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c0fbb00 0x7f9c5c0fbf70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:19.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.475+0000 7f9c63161700 1 --2- 172.21.15.64:0/1414829717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c101b60 0x7f9c5c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:19.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.475+0000 7f9c63161700 1 -- 172.21.15.64:0/1414829717 >> 172.21.15.64:0/1414829717 conn(0x7f9c5c0f7680 msgr2=0x7f9c5c0f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:19.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.475+0000 7f9c63161700 1 -- 172.21.15.64:0/1414829717 shutdown_connections 2023-12-16T03:20:19.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.475+0000 7f9c63161700 1 -- 172.21.15.64:0/1414829717 wait complete. 2023-12-16T03:20:19.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c63161700 1 Processor -- start 2023-12-16T03:20:19.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c63161700 1 -- start start 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c63161700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c0fbb00 0x7f9c5c10c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c63161700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c101b60 0x7f9c5c10c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c63161700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c10ce90 con 0x7f9c5c101b60 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c63161700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c10d000 con 0x7f9c5c0fbb00 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c5bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c101b60 0x7f9c5c10c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c5bfff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c101b60 0x7f9c5c10c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33442/0 (socket says 172.21.15.64:33442) 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c5bfff700 1 -- 172.21.15.64:0/4027939358 learned_addr learned my addr 172.21.15.64:0/4027939358 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.476+0000 7f9c60efd700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c0fbb00 0x7f9c5c10c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.477+0000 7f9c5bfff700 1 -- 172.21.15.64:0/4027939358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c0fbb00 msgr2=0x7f9c5c10c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:19.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.477+0000 7f9c5bfff700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c0fbb00 0x7f9c5c10c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:19.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.477+0000 7f9c5bfff700 1 -- 172.21.15.64:0/4027939358 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48005040 con 0x7f9c5c101b60 2023-12-16T03:20:19.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.477+0000 7f9c5bfff700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c101b60 0x7f9c5c10c8c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800b3b0 tx=0x7f9c48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:19.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.477+0000 7f9c597fa700 1 -- 172.21.15.64:0/4027939358 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4800e040 con 0x7f9c5c101b60 2023-12-16T03:20:19.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.477+0000 7f9c597fa700 1 -- 172.21.15.64:0/4027939358 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c4800bc50 con 0x7f9c5c101b60 2023-12-16T03:20:19.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.477+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c1199f0 con 0x7f9c5c101b60 2023-12-16T03:20:19.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.477+0000 7f9c597fa700 1 -- 172.21.15.64:0/4027939358 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c48013420 con 0x7f9c5c101b60 2023-12-16T03:20:19.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.477+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c119e50 con 0x7f9c5c101b60 2023-12-16T03:20:19.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.478+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c103f40 con 0x7f9c5c101b60 2023-12-16T03:20:19.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.478+0000 7f9c597fa700 1 -- 172.21.15.64:0/4027939358 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f9c4801c430 con 0x7f9c5c101b60 2023-12-16T03:20:19.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.479+0000 7f9c597fa700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f9c4c06cf80 0x7f9c4c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:19.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.479+0000 7f9c597fa700 1 -- 172.21.15.64:0/4027939358 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9c4808d290 con 0x7f9c5c101b60 2023-12-16T03:20:19.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.479+0000 7f9c60efd700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f9c4c06cf80 0x7f9c4c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:19.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.479+0000 7f9c60efd700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f9c4c06cf80 0x7f9c4c06f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006fd0 tx=0x7f9c50008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:19.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.484+0000 7f9c597fa700 1 -- 172.21.15.64:0/4027939358 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9c4805ab60 con 0x7f9c5c101b60 2023-12-16T03:20:19.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:19 smithi184 ceph-mon[184130]: pgmap v29: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:19.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:19 smithi184 ceph-mon[184130]: osd.0 marked itself down and dead 2023-12-16T03:20:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:19 smithi064 ceph-mon[216854]: pgmap v29: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:19.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:19 smithi064 ceph-mon[216854]: osd.0 marked itself down and dead 2023-12-16T03:20:19.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.708+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c5c066400 con 0x7f9c4c06cf80 2023-12-16T03:20:19.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.710+0000 7f9c597fa700 1 -- 172.21.15.64:0/4027939358 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9c5c066400 con 0x7f9c4c06cf80 2023-12-16T03:20:19.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f9c4c06cf80 msgr2=0x7f9c4c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f9c4c06cf80 0x7f9c4c06f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006fd0 tx=0x7f9c50008040 comp rx=0 tx=0).stop 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c101b60 msgr2=0x7f9c5c10c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c101b60 0x7f9c5c10c8c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800b3b0 tx=0x7f9c48009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 shutdown_connections 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f9c4c06cf80 0x7f9c4c06f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c0fbb00 0x7f9c5c10c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 --2- 172.21.15.64:0/4027939358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c5c101b60 0x7f9c5c10c8c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 >> 172.21.15.64:0/4027939358 conn(0x7f9c5c0f7680 msgr2=0x7f9c5c0f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 shutdown_connections 2023-12-16T03:20:19.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.712+0000 7f9c63161700 1 -- 172.21.15.64:0/4027939358 wait complete. 2023-12-16T03:20:19.725 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:20:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.829+0000 7ff5178dd700 1 -- 172.21.15.64:0/1986609972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 msgr2=0x7ff510106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.829+0000 7ff5178dd700 1 --2- 172.21.15.64:0/1986609972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 0x7ff510106c40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff504004940 tx=0x7ff504009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:19.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.829+0000 7ff5178dd700 1 -- 172.21.15.64:0/1986609972 shutdown_connections 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.829+0000 7ff5178dd700 1 --2- 172.21.15.64:0/1986609972 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 0x7ff510106c40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.829+0000 7ff5178dd700 1 --2- 172.21.15.64:0/1986609972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5100fdc60 0x7ff5100fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.829+0000 7ff5178dd700 1 -- 172.21.15.64:0/1986609972 >> 172.21.15.64:0/1986609972 conn(0x7ff5100f7690 msgr2=0x7ff5100f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.829+0000 7ff5178dd700 1 -- 172.21.15.64:0/1986609972 shutdown_connections 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.829+0000 7ff5178dd700 1 -- 172.21.15.64:0/1986609972 wait complete. 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff5178dd700 1 Processor -- start 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff5178dd700 1 -- start start 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff5178dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5100fdc60 0x7ff510113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff5178dd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 0x7ff510113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff5178dd700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff510114260 con 0x7ff5100fe600 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff5178dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51010d550 con 0x7ff5100fdc60 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff514e78700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 0x7ff510113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff514e78700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 0x7ff510113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33460/0 (socket says 172.21.15.64:33460) 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff514e78700 1 -- 172.21.15.64:0/886637412 learned_addr learned my addr 172.21.15.64:0/886637412 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:19.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff515679700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5100fdc60 0x7ff510113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff514e78700 1 -- 172.21.15.64:0/886637412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5100fdc60 msgr2=0x7ff510113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff514e78700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5100fdc60 0x7ff510113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.830+0000 7ff514e78700 1 -- 172.21.15.64:0/886637412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504005040 con 0x7ff5100fe600 2023-12-16T03:20:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.831+0000 7ff514e78700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 0x7ff510113c10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff50400b3b0 tx=0x7ff504009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.831+0000 7ff50dffb700 1 -- 172.21.15.64:0/886637412 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50400e040 con 0x7ff5100fe600 2023-12-16T03:20:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.831+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51010d7e0 con 0x7ff5100fe600 2023-12-16T03:20:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.831+0000 7ff50dffb700 1 -- 172.21.15.64:0/886637412 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff504004290 con 0x7ff5100fe600 2023-12-16T03:20:19.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.831+0000 7ff50dffb700 1 -- 172.21.15.64:0/886637412 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50401c3f0 con 0x7ff5100fe600 2023-12-16T03:20:19.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.831+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51010dd20 con 0x7ff5100fe600 2023-12-16T03:20:19.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.832+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff510104250 con 0x7ff5100fe600 2023-12-16T03:20:19.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.832+0000 7ff50dffb700 1 -- 172.21.15.64:0/886637412 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7ff504013820 con 0x7ff5100fe600 2023-12-16T03:20:19.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.833+0000 7ff50dffb700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4f806cf80 0x7ff4f806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:19.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.833+0000 7ff50dffb700 1 -- 172.21.15.64:0/886637412 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff50408d850 con 0x7ff5100fe600 2023-12-16T03:20:19.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.833+0000 7ff515679700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4f806cf80 0x7ff4f806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:19.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.833+0000 7ff515679700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4f806cf80 0x7ff4f806f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff5100f8fb0 tx=0x7ff500009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:19.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:19.838+0000 7ff50dffb700 1 -- 172.21.15.64:0/886637412 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7ff50405b070 con 0x7ff5100fe600 2023-12-16T03:20:20.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.065+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff51004bb80 con 0x7ff4f806cf80 2023-12-16T03:20:20.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.066+0000 7ff50dffb700 1 -- 172.21.15.64:0/886637412 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff51004bb80 con 0x7ff4f806cf80 2023-12-16T03:20:20.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4f806cf80 msgr2=0x7ff4f806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4f806cf80 0x7ff4f806f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff5100f8fb0 tx=0x7ff500009da0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 msgr2=0x7ff510113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 0x7ff510113c10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff50400b3b0 tx=0x7ff504009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:20.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 shutdown_connections 2023-12-16T03:20:20.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4f806cf80 0x7ff4f806f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5100fdc60 0x7ff510113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 --2- 172.21.15.64:0/886637412 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5100fe600 0x7ff510113c10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 >> 172.21.15.64:0/886637412 conn(0x7ff5100f7690 msgr2=0x7ff5101013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:20.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 shutdown_connections 2023-12-16T03:20:20.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.068+0000 7ff5178dd700 1 -- 172.21.15.64:0/886637412 wait complete. 2023-12-16T03:20:20.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.177+0000 7eff66eea700 1 -- 172.21.15.64:0/4048185867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60102bf0 msgr2=0x7eff60102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.177+0000 7eff66eea700 1 --2- 172.21.15.64:0/4048185867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60102bf0 0x7eff60102fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7eff54004940 tx=0x7eff54009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.177+0000 7eff66eea700 1 -- 172.21.15.64:0/4048185867 shutdown_connections 2023-12-16T03:20:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.177+0000 7eff66eea700 1 --2- 172.21.15.64:0/4048185867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff60103590 0x7eff600fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.177+0000 7eff66eea700 1 --2- 172.21.15.64:0/4048185867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60102bf0 0x7eff60102fc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.177+0000 7eff66eea700 1 -- 172.21.15.64:0/4048185867 >> 172.21.15.64:0/4048185867 conn(0x7eff600f87a0 msgr2=0x7eff600fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.177+0000 7eff66eea700 1 -- 172.21.15.64:0/4048185867 shutdown_connections 2023-12-16T03:20:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.177+0000 7eff66eea700 1 -- 172.21.15.64:0/4048185867 wait complete. 2023-12-16T03:20:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.178+0000 7eff66eea700 1 Processor -- start 2023-12-16T03:20:20.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.178+0000 7eff66eea700 1 -- start start 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.178+0000 7eff66eea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff60102bf0 0x7eff60113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.178+0000 7eff66eea700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60103590 0x7eff60113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.178+0000 7eff66eea700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff601141e0 con 0x7eff60103590 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.178+0000 7eff66eea700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6010d4d0 con 0x7eff60102bf0 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.178+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60103590 0x7eff60113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.178+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60103590 0x7eff60113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33478/0 (socket says 172.21.15.64:33478) 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.178+0000 7eff5ffff700 1 -- 172.21.15.64:0/12530776 learned_addr learned my addr 172.21.15.64:0/12530776 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff64c86700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff60102bf0 0x7eff60113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff5ffff700 1 -- 172.21.15.64:0/12530776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff60102bf0 msgr2=0x7eff60113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff5ffff700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff60102bf0 0x7eff60113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff5ffff700 1 -- 172.21.15.64:0/12530776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff54005040 con 0x7eff60103590 2023-12-16T03:20:20.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff5ffff700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60103590 0x7eff60113b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff4c002a50 tx=0x7eff4c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:20.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff5d7fa700 1 -- 172.21.15.64:0/12530776 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff4c007cc0 con 0x7eff60103590 2023-12-16T03:20:20.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6010d760 con 0x7eff60103590 2023-12-16T03:20:20.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff5d7fa700 1 -- 172.21.15.64:0/12530776 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff4c00f040 con 0x7eff60103590 2023-12-16T03:20:20.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff5d7fa700 1 -- 172.21.15.64:0/12530776 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff4c00d920 con 0x7eff60103590 2023-12-16T03:20:20.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.179+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6010dca0 con 0x7eff60103590 2023-12-16T03:20:20.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.180+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff600fff00 con 0x7eff60103590 2023-12-16T03:20:20.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.181+0000 7eff5d7fa700 1 -- 172.21.15.64:0/12530776 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7eff4c009680 con 0x7eff60103590 2023-12-16T03:20:20.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.182+0000 7eff5d7fa700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7eff5006cf80 0x7eff5006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:20.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.182+0000 7eff5d7fa700 1 -- 172.21.15.64:0/12530776 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7eff4c08c250 con 0x7eff60103590 2023-12-16T03:20:20.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.182+0000 7eff64c86700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7eff5006cf80 0x7eff5006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:20.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.182+0000 7eff64c86700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7eff5006cf80 0x7eff5006f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7eff5400b3b0 tx=0x7eff54009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:20.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.186+0000 7eff5d7fa700 1 -- 172.21.15.64:0/12530776 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7eff4c0599f0 con 0x7eff60103590 2023-12-16T03:20:20.309 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:20 smithi064 bash[231412]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0 2023-12-16T03:20:20.309 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:20 smithi064 ceph-mon[216854]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:20:20.309 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:20 smithi064 ceph-mon[216854]: failed to encode map e47 with expected crc 2023-12-16T03:20:20.309 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:20 smithi064 ceph-mon[216854]: osdmap e47: 6 total, 5 up, 6 in 2023-12-16T03:20:20.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.435+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7eff6004bc20 con 0x7eff5006cf80 2023-12-16T03:20:20.448 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.445+0000 7eff5d7fa700 1 -- 172.21.15.64:0/12530776 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7eff54007d50 con 0x7eff5006cf80 2023-12-16T03:20:20.448 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:20:20.448 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (2m) 8s ago 10m 29.4M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:20:20.448 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (16s) 8s ago 10m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f a416f0797862 2023-12-16T03:20:20.448 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (12s) 10s ago 9m 7440k - 19.0.0-191-g6d933094 a29c258b5d6f 4d5da6df7dee 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (2m) 8s ago 10m 84.1M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (6m) 8s ago 6m 15.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (6m) 8s ago 6m 6644M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (6m) 10s ago 6m 4651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (6m) 10s ago 6m 16.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (3m) 8s ago 11m 504M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (2m) 10s ago 9m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (63s) 8s ago 11m 53.0M 2048M 19.0.0-191-g6d933094 a29c258b5d6f fcfcecd16324 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (42s) 10s ago 9m 38.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 1523b5eb5b04 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (2m) 8s ago 10m 18.0M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (2m) 10s ago 9m 19.5M - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (9m) 8s ago 9m 767M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5015d2a7aecd 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (8m) 8s ago 8m 842M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:20:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (8m) 8s ago 8m 645M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:20:20.450 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (8m) 10s ago 8m 971M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:20:20.450 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (7m) 10s ago 7m 772M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:20:20.450 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (7m) 10s ago 7m 853M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:20:20.450 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (2m) 8s ago 9m 60.4M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:20:20.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.447+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7eff5006cf80 msgr2=0x7eff5006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.447+0000 7eff66eea700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7eff5006cf80 0x7eff5006f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7eff5400b3b0 tx=0x7eff54009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.447+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60103590 msgr2=0x7eff60113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.447+0000 7eff66eea700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60103590 0x7eff60113b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff4c002a50 tx=0x7eff4c004600 comp rx=0 tx=0).stop 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.448+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 shutdown_connections 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.448+0000 7eff66eea700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7eff5006cf80 0x7eff5006f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.448+0000 7eff66eea700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff60102bf0 0x7eff60113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.448+0000 7eff66eea700 1 --2- 172.21.15.64:0/12530776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff60103590 0x7eff60113b90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.448+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 >> 172.21.15.64:0/12530776 conn(0x7eff600f87a0 msgr2=0x7eff600fa340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.448+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 shutdown_connections 2023-12-16T03:20:20.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.448+0000 7eff66eea700 1 -- 172.21.15.64:0/12530776 wait complete. 2023-12-16T03:20:20.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.555+0000 7ff2f294d700 1 -- 172.21.15.64:0/1968990356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fdc50 msgr2=0x7ff2ec0fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.555+0000 7ff2f294d700 1 --2- 172.21.15.64:0/1968990356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fdc50 0x7ff2ec0fe020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc004940 tx=0x7ff2dc009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:20.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.555+0000 7ff2f294d700 1 -- 172.21.15.64:0/1968990356 shutdown_connections 2023-12-16T03:20:20.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.555+0000 7ff2f294d700 1 --2- 172.21.15.64:0/1968990356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2ec0fe5f0 0x7ff2ec106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.555+0000 7ff2f294d700 1 --2- 172.21.15.64:0/1968990356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fdc50 0x7ff2ec0fe020 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.555+0000 7ff2f294d700 1 -- 172.21.15.64:0/1968990356 >> 172.21.15.64:0/1968990356 conn(0x7ff2ec0f7680 msgr2=0x7ff2ec0f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:20.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.555+0000 7ff2f294d700 1 -- 172.21.15.64:0/1968990356 shutdown_connections 2023-12-16T03:20:20.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.555+0000 7ff2f294d700 1 -- 172.21.15.64:0/1968990356 wait complete. 2023-12-16T03:20:20.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2f294d700 1 Processor -- start 2023-12-16T03:20:20.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2f294d700 1 -- start start 2023-12-16T03:20:20.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2f294d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2ec0fdc50 0x7ff2ec113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:20.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2f294d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fe5f0 0x7ff2ec113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:20.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2f294d700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec114230 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2f294d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec10d520 con 0x7ff2ec0fdc50 2023-12-16T03:20:20.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fe5f0 0x7ff2ec113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:20.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fe5f0 0x7ff2ec113be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33496/0 (socket says 172.21.15.64:33496) 2023-12-16T03:20:20.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2eb7fe700 1 -- 172.21.15.64:0/2217565986 learned_addr learned my addr 172.21.15.64:0/2217565986 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2ebfff700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2ec0fdc50 0x7ff2ec113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2eb7fe700 1 -- 172.21.15.64:0/2217565986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2ec0fdc50 msgr2=0x7ff2ec113660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2eb7fe700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2ec0fdc50 0x7ff2ec113660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.556+0000 7ff2eb7fe700 1 -- 172.21.15.64:0/2217565986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc005040 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.557+0000 7ff2eb7fe700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fe5f0 0x7ff2ec113be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0002a50 tx=0x7ff2e00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.557+0000 7ff2e8ff9700 1 -- 172.21.15.64:0/2217565986 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e0007cc0 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.557+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec10d7b0 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.557+0000 7ff2e8ff9700 1 -- 172.21.15.64:0/2217565986 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff2e000f040 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.557+0000 7ff2e8ff9700 1 -- 172.21.15.64:0/2217565986 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e0009540 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.557+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec10dcf0 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:20 smithi184 ceph-mon[184130]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:20:20.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:20 smithi184 ceph-mon[184130]: failed to encode map e47 with expected crc 2023-12-16T03:20:20.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:20 smithi184 ceph-mon[184130]: osdmap e47: 6 total, 5 up, 6 in 2023-12-16T03:20:20.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.558+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec104240 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.559+0000 7ff2e8ff9700 1 -- 172.21.15.64:0/2217565986 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7ff2e00096c0 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.559+0000 7ff2e8ff9700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff2d406cf80 0x7ff2d406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:20.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.559+0000 7ff2e8ff9700 1 -- 172.21.15.64:0/2217565986 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff2e008c200 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.560+0000 7ff2ebfff700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff2d406cf80 0x7ff2d406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:20.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.560+0000 7ff2ebfff700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff2d406cf80 0x7ff2d406f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009fd0 tx=0x7ff2dc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:20.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.564+0000 7ff2e8ff9700 1 -- 172.21.15.64:0/2217565986 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7ff2e0059a20 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.857+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff2ec04bb80 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.858+0000 7ff2e8ff9700 1 -- 172.21.15.64:0/2217565986 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7ff2e0009970 con 0x7ff2ec0fe5f0 2023-12-16T03:20:20.860 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:20:20.861 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:20:20.861 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:20:20.861 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:20:20.861 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:20:20.861 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:20:20.861 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:20:20.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:20:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5 2023-12-16T03:20:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:20:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:20:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:20:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:20:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:20:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 9, 2023-12-16T03:20:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 4 2023-12-16T03:20:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:20:20.863 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:20:20.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff2d406cf80 msgr2=0x7ff2d406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff2d406cf80 0x7ff2d406f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009fd0 tx=0x7ff2dc009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:20.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fe5f0 msgr2=0x7ff2ec113be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fe5f0 0x7ff2ec113be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0002a50 tx=0x7ff2e00046b0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 shutdown_connections 2023-12-16T03:20:20.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff2d406cf80 0x7ff2d406f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2ec0fdc50 0x7ff2ec113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 --2- 172.21.15.64:0/2217565986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2ec0fe5f0 0x7ff2ec113be0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 >> 172.21.15.64:0/2217565986 conn(0x7ff2ec0f7680 msgr2=0x7ff2ec1013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:20.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 shutdown_connections 2023-12-16T03:20:20.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.860+0000 7ff2f294d700 1 -- 172.21.15.64:0/2217565986 wait complete. 2023-12-16T03:20:20.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.968+0000 7f124517c700 1 -- 172.21.15.64:0/117411243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 msgr2=0x7f12400fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.968+0000 7f124517c700 1 --2- 172.21.15.64:0/117411243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 0x7f12400fbfb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1228004940 tx=0x7f1228009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.968+0000 7f124517c700 1 -- 172.21.15.64:0/117411243 shutdown_connections 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.968+0000 7f124517c700 1 --2- 172.21.15.64:0/117411243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 0x7f12400fbfb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.968+0000 7f124517c700 1 --2- 172.21.15.64:0/117411243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240101b00 0x7f1240101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.968+0000 7f124517c700 1 -- 172.21.15.64:0/117411243 >> 172.21.15.64:0/117411243 conn(0x7f12400719b0 msgr2=0x7f1240071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.968+0000 7f124517c700 1 -- 172.21.15.64:0/117411243 shutdown_connections 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.968+0000 7f124517c700 1 -- 172.21.15.64:0/117411243 wait complete. 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f124517c700 1 Processor -- start 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f124517c700 1 -- start start 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f124517c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 0x7f12401136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f124517c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240101b00 0x7f1240113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f124517c700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240114290 con 0x7f12400fbb40 2023-12-16T03:20:20.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f124517c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124010d580 con 0x7f1240101b00 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f123ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 0x7f12401136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f123ed9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 0x7f12401136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33506/0 (socket says 172.21.15.64:33506) 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f123ed9d700 1 -- 172.21.15.64:0/635411297 learned_addr learned my addr 172.21.15.64:0/635411297 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f123e59c700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240101b00 0x7f1240113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f123ed9d700 1 -- 172.21.15.64:0/635411297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240101b00 msgr2=0x7f1240113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f123ed9d700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240101b00 0x7f1240113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.969+0000 7f123ed9d700 1 -- 172.21.15.64:0/635411297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228005040 con 0x7f12400fbb40 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.970+0000 7f123ed9d700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 0x7f12401136c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1230002a50 tx=0x7f12300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.970+0000 7f12377fe700 1 -- 172.21.15.64:0/635411297 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1230007cc0 con 0x7f12400fbb40 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.970+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124010d810 con 0x7f12400fbb40 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.970+0000 7f12377fe700 1 -- 172.21.15.64:0/635411297 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f123000f040 con 0x7f12400fbb40 2023-12-16T03:20:20.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.970+0000 7f12377fe700 1 -- 172.21.15.64:0/635411297 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123000d9c0 con 0x7f12400fbb40 2023-12-16T03:20:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.970+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124010dd50 con 0x7f12400fbb40 2023-12-16T03:20:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.971+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12400734d0 con 0x7f12400fbb40 2023-12-16T03:20:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.972+0000 7f12377fe700 1 -- 172.21.15.64:0/635411297 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f123000db20 con 0x7f12400fbb40 2023-12-16T03:20:20.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.972+0000 7f12377fe700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f122c06cf80 0x7f122c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.972+0000 7f12377fe700 1 -- 172.21.15.64:0/635411297 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f123008c200 con 0x7f12400fbb40 2023-12-16T03:20:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.972+0000 7f123e59c700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f122c06cf80 0x7f122c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:20.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.973+0000 7f123e59c700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f122c06cf80 0x7f122c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f12280043d0 tx=0x7f1228009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:20.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:20.977+0000 7f12377fe700 1 -- 172.21.15.64:0/635411297 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f12300599a0 con 0x7f12400fbb40 2023-12-16T03:20:21.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.224+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f124010eca0 con 0x7f12400fbb40 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.225+0000 7f12377fe700 1 -- 172.21.15.64:0/635411297 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1871 (secure 0 0 0) 0x7f1230059530 con 0x7f12400fbb40 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stdout:e16 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stdout:legacy client fscid: 1 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stdout:Filesystem 'cephfs' (1) 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stdout:fs_name cephfs 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 16 2023-12-16T03:20:21.228 INFO:teuthology.orchestra.run.smithi064.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:modified 2023-12-16T03:20:11.493821+0000 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:tableserver 0 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:root 0 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:session_timeout 60 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:session_autoclose 300 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:max_file_size 1099511627776 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:max_xattr_size 65536 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:required_client_features {} 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure 0 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure_osd_epoch 0 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:max_mds 2 2023-12-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:in 0,1 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:up {0=14460,1=24269} 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:failed 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:damaged 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:stopped 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:data_pools [3] 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:metadata_pool 2 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:inline_data enabled 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:balancer 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:bal_rank_mask -1 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:standby_count_wanted 1 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:20:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:Standby daemons: 2023-12-16T03:20:21.231 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:20:21.231 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:20:21.231 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:20:21.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f122c06cf80 msgr2=0x7f122c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:21.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f122c06cf80 0x7f122c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f12280043d0 tx=0x7f1228009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 msgr2=0x7f12401136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 0x7f12401136c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1230002a50 tx=0x7f12300046b0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 shutdown_connections 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f122c06cf80 0x7f122c06f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12400fbb40 0x7f12401136c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 --2- 172.21.15.64:0/635411297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240101b00 0x7f1240113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 >> 172.21.15.64:0/635411297 conn(0x7f12400719b0 msgr2=0x7f1240065550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 shutdown_connections 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.227+0000 7f124517c700 1 -- 172.21.15.64:0/635411297 wait complete. 2023-12-16T03:20:21.232 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 16 2023-12-16T03:20:21.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.337+0000 7f80c6f99700 1 -- 172.21.15.64:0/236963183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 msgr2=0x7f80c00fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:21.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.337+0000 7f80c6f99700 1 --2- 172.21.15.64:0/236963183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 0x7f80c00fdfe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80b4004940 tx=0x7f80b4009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:21.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.337+0000 7f80c6f99700 1 -- 172.21.15.64:0/236963183 shutdown_connections 2023-12-16T03:20:21.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.337+0000 7f80c6f99700 1 --2- 172.21.15.64:0/236963183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c00fe5b0 0x7f80c0106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.337+0000 7f80c6f99700 1 --2- 172.21.15.64:0/236963183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 0x7f80c00fdfe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.337+0000 7f80c6f99700 1 -- 172.21.15.64:0/236963183 >> 172.21.15.64:0/236963183 conn(0x7f80c00f76c0 msgr2=0x7f80c00f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:21.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.337+0000 7f80c6f99700 1 -- 172.21.15.64:0/236963183 shutdown_connections 2023-12-16T03:20:21.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.337+0000 7f80c6f99700 1 -- 172.21.15.64:0/236963183 wait complete. 2023-12-16T03:20:21.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.338+0000 7f80c6f99700 1 Processor -- start 2023-12-16T03:20:21.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.338+0000 7f80c6f99700 1 -- start start 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.338+0000 7f80c6f99700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 0x7f80c01135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.338+0000 7f80c6f99700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c00fe5b0 0x7f80c0113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.338+0000 7f80c6f99700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0114170 con 0x7f80c00fdc10 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.338+0000 7f80c6f99700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c010d4a0 con 0x7f80c00fe5b0 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80c4d35700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 0x7f80c01135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80c4d35700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 0x7f80c01135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33524/0 (socket says 172.21.15.64:33524) 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80c4d35700 1 -- 172.21.15.64:0/1418630082 learned_addr learned my addr 172.21.15.64:0/1418630082 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80bffff700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c00fe5b0 0x7f80c0113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80c4d35700 1 -- 172.21.15.64:0/1418630082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c00fe5b0 msgr2=0x7f80c0113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80c4d35700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c00fe5b0 0x7f80c0113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80c4d35700 1 -- 172.21.15.64:0/1418630082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4005040 con 0x7f80c00fdc10 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80c4d35700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 0x7f80c01135e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000c00 tx=0x7f80b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:21.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80bd7fa700 1 -- 172.21.15.64:0/1418630082 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b4021070 con 0x7f80c00fdc10 2023-12-16T03:20:21.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80bd7fa700 1 -- 172.21.15.64:0/1418630082 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f80b401c400 con 0x7f80c00fdc10 2023-12-16T03:20:21.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c010d720 con 0x7f80c00fdc10 2023-12-16T03:20:21.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80bd7fa700 1 -- 172.21.15.64:0/1418630082 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b400e070 con 0x7f80c00fdc10 2023-12-16T03:20:21.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.339+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c010dc60 con 0x7f80c00fdc10 2023-12-16T03:20:21.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.340+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c0104200 con 0x7f80c00fdc10 2023-12-16T03:20:21.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.341+0000 7f80bd7fa700 1 -- 172.21.15.64:0/1418630082 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f80b401c570 con 0x7f80c00fdc10 2023-12-16T03:20:21.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.341+0000 7f80bd7fa700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f80b006cf80 0x7f80b006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:21.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.342+0000 7f80bd7fa700 1 -- 172.21.15.64:0/1418630082 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f80b408d6c0 con 0x7f80c00fdc10 2023-12-16T03:20:21.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.342+0000 7f80bffff700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f80b006cf80 0x7f80b006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:21.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.342+0000 7f80bffff700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f80b006cf80 0x7f80b006f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f80ac004600 tx=0x7f80ac00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:21.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.346+0000 7f80bd7fa700 1 -- 172.21.15.64:0/1418630082 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f80b405aee0 con 0x7f80c00fdc10 2023-12-16T03:20:21.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.598+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80c010ebc0 con 0x7f80b006cf80 2023-12-16T03:20:21.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.599+0000 7f80bd7fa700 1 -- 172.21.15.64:0/1418630082 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f80c010ebc0 con 0x7f80b006cf80 2023-12-16T03:20:21.602 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:20:21.602 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:20:21.602 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:20:21.602 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T03:20:21.602 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:20:21.602 INFO:teuthology.orchestra.run.smithi064.stdout: "crash", 2023-12-16T03:20:21.603 INFO:teuthology.orchestra.run.smithi064.stdout: "mon", 2023-12-16T03:20:21.603 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:20:21.603 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:20:21.603 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "6/21 daemons upgraded", 2023-12-16T03:20:21.603 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T03:20:21.603 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:20:21.603 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:20:21.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f80b006cf80 msgr2=0x7f80b006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:21.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f80b006cf80 0x7f80b006f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f80ac004600 tx=0x7f80ac00b040 comp rx=0 tx=0).stop 2023-12-16T03:20:21.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 msgr2=0x7f80c01135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:21.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 0x7f80c01135e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000c00 tx=0x7f80b4009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:21.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 shutdown_connections 2023-12-16T03:20:21.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f80b006cf80 0x7f80b006f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c00fdc10 0x7f80c01135e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 --2- 172.21.15.64:0/1418630082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c00fe5b0 0x7f80c0113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 >> 172.21.15.64:0/1418630082 conn(0x7f80c00f76c0 msgr2=0x7f80c0101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:21.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 shutdown_connections 2023-12-16T03:20:21.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.602+0000 7f80c6f99700 1 -- 172.21.15.64:0/1418630082 wait complete. 2023-12-16T03:20:21.692 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:21 smithi064 systemd[1]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.0.service: Succeeded. 2023-12-16T03:20:21.693 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:21 smithi064 systemd[1]: Stopped Ceph osd.0 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:20:21.693 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:21 smithi064 systemd[1]: Starting Ceph osd.0 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: pgmap v31: 65 pgs: 9 stale+active+clean, 56 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: osdmap e48: 6 total, 5 up, 6 in 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/2217565986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:21.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:21 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/635411297' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:20:21.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.714+0000 7fd56d6e0700 1 -- 172.21.15.64:0/648717477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5680fb1e0 msgr2=0x7fd5680fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:21.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.714+0000 7fd56d6e0700 1 --2- 172.21.15.64:0/648717477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5680fb1e0 0x7fd5680fb630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd55c004940 tx=0x7fd55c009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 -- 172.21.15.64:0/648717477 shutdown_connections 2023-12-16T03:20:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 --2- 172.21.15.64:0/648717477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5680fb1e0 0x7fd5680fb630 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 --2- 172.21.15.64:0/648717477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd568102c70 0x7fd568103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 -- 172.21.15.64:0/648717477 >> 172.21.15.64:0/648717477 conn(0x7fd5680711a0 msgr2=0x7fd5680715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 -- 172.21.15.64:0/648717477 shutdown_connections 2023-12-16T03:20:21.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 -- 172.21.15.64:0/648717477 wait complete. 2023-12-16T03:20:21.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 Processor -- start 2023-12-16T03:20:21.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 -- start start 2023-12-16T03:20:21.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5680fb1e0 0x7fd568113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:21.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd568102c70 0x7fd568113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:21.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5681141e0 con 0x7fd568102c70 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.715+0000 7fd56d6e0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56810d4d0 con 0x7fd5680fb1e0 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd5667fc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd568102c70 0x7fd568113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd5667fc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd568102c70 0x7fd568113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33544/0 (socket says 172.21.15.64:33544) 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd5667fc700 1 -- 172.21.15.64:0/1430397707 learned_addr learned my addr 172.21.15.64:0/1430397707 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd566ffd700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5680fb1e0 0x7fd568113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd5667fc700 1 -- 172.21.15.64:0/1430397707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5680fb1e0 msgr2=0x7fd568113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd5667fc700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5680fb1e0 0x7fd568113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd5667fc700 1 -- 172.21.15.64:0/1430397707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c005040 con 0x7fd568102c70 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd566ffd700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5680fb1e0 0x7fd568113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:20:21.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd5667fc700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd568102c70 0x7fd568113b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00b3b0 tx=0x7fd55c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:21.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd54f7fe700 1 -- 172.21.15.64:0/1430397707 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd55c00e040 con 0x7fd568102c70 2023-12-16T03:20:21.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd54f7fe700 1 -- 172.21.15.64:0/1430397707 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd55c00bc50 con 0x7fd568102c70 2023-12-16T03:20:21.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56810d700 con 0x7fd568102c70 2023-12-16T03:20:21.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd54f7fe700 1 -- 172.21.15.64:0/1430397707 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd55c013420 con 0x7fd568102c70 2023-12-16T03:20:21.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.716+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56810dc40 con 0x7fd568102c70 2023-12-16T03:20:21.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.717+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568105050 con 0x7fd568102c70 2023-12-16T03:20:21.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.718+0000 7fd54f7fe700 1 -- 172.21.15.64:0/1430397707 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fd55c01c430 con 0x7fd568102c70 2023-12-16T03:20:21.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.718+0000 7fd54f7fe700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd55006cf80 0x7fd55006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:21.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.718+0000 7fd54f7fe700 1 -- 172.21.15.64:0/1430397707 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd55c08d290 con 0x7fd568102c70 2023-12-16T03:20:21.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.718+0000 7fd566ffd700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd55006cf80 0x7fd55006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:21.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.719+0000 7fd566ffd700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd55006cf80 0x7fd55006f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd558009fd0 tx=0x7fd558009f00 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:21.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:21.723+0000 7fd54f7fe700 1 -- 172.21.15.64:0/1430397707 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fd55c05ab60 con 0x7fd568102c70 2023-12-16T03:20:21.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: pgmap v31: 65 pgs: 9 stale+active+clean, 56 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:21.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:21.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:21.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: osdmap e48: 6 total, 5 up, 6 in 2023-12-16T03:20:21.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: failed to encode map e48 with expected crc 2023-12-16T03:20:21.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/2217565986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:21.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:21 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/635411297' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:20:22.026 INFO:teuthology.orchestra.run.smithi064.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2023-12-16T03:20:22.026 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:20:22.026 INFO:teuthology.orchestra.run.smithi064.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:20:22.026 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-16T03:20:22.026 INFO:teuthology.orchestra.run.smithi064.stdout: osd.0 (root=default,host=smithi064) is down 2023-12-16T03:20:22.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.022+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd568072cc0 con 0x7fd568102c70 2023-12-16T03:20:22.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.023+0000 7fd54f7fe700 1 -- 172.21.15.64:0/1430397707 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+290 (secure 0 0 0) 0x7fd55c05a6f0 con 0x7fd568102c70 2023-12-16T03:20:22.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd55006cf80 msgr2=0x7fd55006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:22.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd55006cf80 0x7fd55006f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd558009fd0 tx=0x7fd558009f00 comp rx=0 tx=0).stop 2023-12-16T03:20:22.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd568102c70 msgr2=0x7fd568113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:22.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd568102c70 0x7fd568113b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00b3b0 tx=0x7fd55c009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:22.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 shutdown_connections 2023-12-16T03:20:22.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd55006cf80 0x7fd55006f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:22.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5680fb1e0 0x7fd568113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:22.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 --2- 172.21.15.64:0/1430397707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd568102c70 0x7fd568113b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:22.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 >> 172.21.15.64:0/1430397707 conn(0x7fd5680711a0 msgr2=0x7fd5680fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:22.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 shutdown_connections 2023-12-16T03:20:22.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:22.025+0000 7fd56d6e0700 1 -- 172.21.15.64:0/1430397707 wait complete. 2023-12-16T03:20:22.587 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:22 smithi064 ceph-mon[216854]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:22.588 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:22 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/1430397707' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:20:22.588 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:22 smithi064 bash[231816]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T03:20:22.588 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:22 smithi064 bash[231816]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T03:20:22.588 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:22 smithi064 bash[231816]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T03:20:22.588 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:22 smithi064 bash[231816]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T03:20:22.588 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:22 smithi064 bash[231816]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-16T03:20:22.588 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:22 smithi064 bash[231816]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T03:20:22.588 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:22 smithi064 bash[231816]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-16T03:20:22.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:22 smithi184 ceph-mon[184130]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:22.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:22 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/1430397707' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:20:23.442 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:23 smithi064 ceph-osd[232140]: -- 172.21.15.64:0/572443402 <== mon.0 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555e7b5a56c0 con 0x555e7b575000 2023-12-16T03:20:23.443 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:23 smithi064 bash[232102]: ff051ca1c9baf804ee7c899a88d5a9617d2342b50047e3b41207c5e6d63bd11a 2023-12-16T03:20:23.443 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:23 smithi064 systemd[1]: Started Ceph osd.0 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:20:23.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:23 smithi064 ceph-mon[216854]: pgmap v33: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:23.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:23 smithi064 ceph-mon[216854]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:23.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:23 smithi064 ceph-mon[216854]: Health check failed: Degraded data redundancy: 71/366 objects degraded (19.399%), 20 pgs degraded (PG_DEGRADED) 2023-12-16T03:20:23.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:23 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:23.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:23 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:23.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:23 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:23 smithi184 ceph-mon[184130]: pgmap v33: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:23 smithi184 ceph-mon[184130]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:23 smithi184 ceph-mon[184130]: Health check failed: Degraded data redundancy: 71/366 objects degraded (19.399%), 20 pgs degraded (PG_DEGRADED) 2023-12-16T03:20:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:23 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:23 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:23.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:23 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:23.943 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:23 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[232116]: 2023-12-16T03:20:23.627+0000 7fa6f0b93640 -1 Falling back to public interface 2023-12-16T03:20:25.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:25 smithi064 ceph-mon[216854]: pgmap v34: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:25 smithi184 ceph-mon[184130]: pgmap v34: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:26.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:26 smithi064 ceph-mon[216854]: pgmap v35: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:26.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:26.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:20:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:26 smithi184 ceph-mon[184130]: pgmap v35: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:26 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:26.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:26 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:20:27.942 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:27 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[232116]: 2023-12-16T03:20:27.863+0000 7fa6f0b93640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-16T03:20:27.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:27 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:27.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:27 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:27.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:27 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:27.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:27 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:28.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:27 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:28.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:27 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:28.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:27 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:28.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:27 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:28.660 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:28 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[232116]: 2023-12-16T03:20:28.294+0000 7fa6f0b93640 -1 osd.0 46 log_to_monitors true 2023-12-16T03:20:28.942 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:20:28 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[232116]: 2023-12-16T03:20:28.707+0000 7fa6e1803700 -1 osd.0 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:20:28.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:28 smithi064 ceph-mon[216854]: pgmap v36: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:28.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:28 smithi064 ceph-mon[216854]: from='osd.0 [v2:172.21.15.64:6802/224541298,v1:172.21.15.64:6803/224541298]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T03:20:29.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:28 smithi184 ceph-mon[184130]: pgmap v36: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:29.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:28 smithi184 ceph-mon[184130]: from='osd.0 [v2:172.21.15.64:6802/224541298,v1:172.21.15.64:6803/224541298]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T03:20:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:29 smithi184 ceph-mon[184130]: from='osd.0 [v2:172.21.15.64:6802/224541298,v1:172.21.15.64:6803/224541298]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T03:20:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:29 smithi184 ceph-mon[184130]: failed to encode map e49 with expected crc 2023-12-16T03:20:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:29 smithi184 ceph-mon[184130]: osdmap e49: 6 total, 5 up, 6 in 2023-12-16T03:20:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:29 smithi184 ceph-mon[184130]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:20:30.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:29 smithi184 ceph-mon[184130]: from='osd.0 [v2:172.21.15.64:6802/224541298,v1:172.21.15.64:6803/224541298]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:20:30.098 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:29 smithi064 ceph-mon[216854]: from='osd.0 [v2:172.21.15.64:6802/224541298,v1:172.21.15.64:6803/224541298]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T03:20:30.099 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:29 smithi064 ceph-mon[216854]: failed to encode map e49 with expected crc 2023-12-16T03:20:30.099 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:29 smithi064 ceph-mon[216854]: osdmap e49: 6 total, 5 up, 6 in 2023-12-16T03:20:30.099 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:29 smithi064 ceph-mon[216854]: fsmap cephfs:2 {0=cephfs.smithi064.jaepzs=up:active,1=cephfs.smithi184.jfpiqk=up:active} 2 up:standby 2023-12-16T03:20:30.099 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:29 smithi064 ceph-mon[216854]: from='osd.0 [v2:172.21.15.64:6802/224541298,v1:172.21.15.64:6803/224541298]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:20:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: pgmap v38: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:20:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: failed to encode map e49 with expected crc 2023-12-16T03:20:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: osd.0 [v2:172.21.15.64:6802/224541298,v1:172.21.15.64:6803/224541298] boot 2023-12-16T03:20:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: osdmap e50: 6 total, 6 up, 6 in 2023-12-16T03:20:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:20:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: failed to encode map e49 with expected crc 2023-12-16T03:20:31.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:20:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:31.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T03:20:31.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: pgmap v38: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 71/366 objects degraded (19.399%) 2023-12-16T03:20:31.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:20:31.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: failed to encode map e49 with expected crc 2023-12-16T03:20:31.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: osd.0 [v2:172.21.15.64:6802/224541298,v1:172.21.15.64:6803/224541298] boot 2023-12-16T03:20:31.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: osdmap e50: 6 total, 6 up, 6 in 2023-12-16T03:20:31.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T03:20:31.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: failed to encode map e49 with expected crc 2023-12-16T03:20:31.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:31.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:31.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:31.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:20:31.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:31.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:31.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:31.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:31.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:31.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T03:20:32.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: osdmap e51: 6 total, 6 up, 6 in 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:31 smithi184 ceph-mon[184130]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: osdmap e51: 6 total, 6 up, 6 in 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: failed to encode map e51 with expected crc 2023-12-16T03:20:32.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:31 smithi064 ceph-mon[216854]: failed to encode map e51 with expected crc 2023-12-16T03:20:33.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:32 smithi184 ceph-mon[184130]: pgmap v41: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12/366 objects degraded (3.279%) 2023-12-16T03:20:33.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:32 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 12/366 objects degraded (3.279%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T03:20:33.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:32 smithi064 ceph-mon[216854]: pgmap v41: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12/366 objects degraded (3.279%) 2023-12-16T03:20:33.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:32 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 12/366 objects degraded (3.279%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T03:20:35.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:34 smithi184 ceph-mon[184130]: pgmap v42: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12/366 objects degraded (3.279%) 2023-12-16T03:20:35.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:34 smithi064 ceph-mon[216854]: pgmap v42: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12/366 objects degraded (3.279%) 2023-12-16T03:20:36.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:35 smithi184 ceph-mon[184130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/366 objects degraded (3.279%), 3 pgs degraded) 2023-12-16T03:20:36.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:35 smithi064 ceph-mon[216854]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/366 objects degraded (3.279%), 3 pgs degraded) 2023-12-16T03:20:37.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:36 smithi184 ceph-mon[184130]: pgmap v43: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:37.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:36 smithi064 ceph-mon[216854]: pgmap v43: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:38.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:38 smithi064 ceph-mon[216854]: pgmap v44: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:39.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:38 smithi184 ceph-mon[184130]: pgmap v44: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:41.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:40 smithi184 ceph-mon[184130]: pgmap v45: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:41.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:40 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:41.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:40 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:20:41.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:40 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:40 smithi064 ceph-mon[216854]: pgmap v45: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:40 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:41.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:40 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:20:41.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:40 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:43.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:42 smithi184 ceph-mon[184130]: pgmap v46: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:43.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:42 smithi064 ceph-mon[216854]: pgmap v46: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:45.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:44 smithi184 ceph-mon[184130]: pgmap v47: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:45.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:44 smithi064 ceph-mon[216854]: pgmap v47: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:46.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:45 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T03:20:46.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:45 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T03:20:46.789 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:46 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T03:20:46.789 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:46 smithi064 ceph-mon[216854]: Upgrade: osd.1 is safe to restart 2023-12-16T03:20:46.789 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:46 smithi064 ceph-mon[216854]: pgmap v48: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:46.789 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:46 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:46.789 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:46 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T03:20:47.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:46 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T03:20:47.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:46 smithi184 ceph-mon[184130]: Upgrade: osd.1 is safe to restart 2023-12-16T03:20:47.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:46 smithi184 ceph-mon[184130]: pgmap v48: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:47.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:46 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:47.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:46 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T03:20:47.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:47 smithi064 ceph-mon[216854]: Upgrade: Updating osd.1 2023-12-16T03:20:47.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:47 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:47.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:47 smithi064 ceph-mon[216854]: Deploying daemon osd.1 on smithi064 2023-12-16T03:20:48.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:47 smithi184 ceph-mon[184130]: Upgrade: Updating osd.1 2023-12-16T03:20:48.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:47 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:20:48.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:47 smithi184 ceph-mon[184130]: Deploying daemon osd.1 on smithi064 2023-12-16T03:20:49.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:48 smithi184 ceph-mon[184130]: pgmap v49: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:49.061 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:48 smithi064 ceph-mon[216854]: pgmap v49: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:49.401 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:49 smithi064 systemd[1]: Stopping Ceph osd.1 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:20:49.693 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:49 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[144777]: 2023-12-16T03:20:49.398+0000 7f61bb324700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:20:49.693 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:49 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[144777]: 2023-12-16T03:20:49.398+0000 7f61bb324700 -1 osd.1 51 *** Got signal Terminated *** 2023-12-16T03:20:49.693 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:49 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[144777]: 2023-12-16T03:20:49.398+0000 7f61bb324700 -1 osd.1 51 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:20:50.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:49 smithi184 ceph-mon[184130]: osd.1 marked itself down and dead 2023-12-16T03:20:50.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:49 smithi064 ceph-mon[216854]: osd.1 marked itself down and dead 2023-12-16T03:20:50.692 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:50 smithi064 bash[238780]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1 2023-12-16T03:20:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:50 smithi184 ceph-mon[184130]: pgmap v50: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:50 smithi184 ceph-mon[184130]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:20:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:50 smithi184 ceph-mon[184130]: failed to encode map e52 with expected crc 2023-12-16T03:20:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:50 smithi184 ceph-mon[184130]: failed to encode map e52 with expected crc 2023-12-16T03:20:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:50 smithi184 ceph-mon[184130]: failed to encode map e52 with expected crc 2023-12-16T03:20:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:50 smithi184 ceph-mon[184130]: failed to encode map e52 with expected crc 2023-12-16T03:20:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:50 smithi184 ceph-mon[184130]: osdmap e52: 6 total, 5 up, 6 in 2023-12-16T03:20:51.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:50 smithi064 ceph-mon[216854]: pgmap v50: 65 pgs: 65 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:20:51.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:50 smithi064 ceph-mon[216854]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:20:51.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:50 smithi064 ceph-mon[216854]: failed to encode map e52 with expected crc 2023-12-16T03:20:51.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:50 smithi064 ceph-mon[216854]: failed to encode map e52 with expected crc 2023-12-16T03:20:51.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:50 smithi064 ceph-mon[216854]: failed to encode map e52 with expected crc 2023-12-16T03:20:51.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:50 smithi064 ceph-mon[216854]: failed to encode map e52 with expected crc 2023-12-16T03:20:51.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:50 smithi064 ceph-mon[216854]: osdmap e52: 6 total, 5 up, 6 in 2023-12-16T03:20:51.943 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:51 smithi064 systemd[1]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.1.service: Succeeded. 2023-12-16T03:20:51.943 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:51 smithi064 systemd[1]: Stopped Ceph osd.1 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:20:51.943 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:51 smithi064 systemd[1]: Starting Ceph osd.1 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:20:51.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:51 smithi064 ceph-mon[216854]: failed to encode map e53 with expected crc 2023-12-16T03:20:51.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:51 smithi064 ceph-mon[216854]: osdmap e53: 6 total, 5 up, 6 in 2023-12-16T03:20:51.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:51 smithi064 ceph-mon[216854]: failed to encode map e53 with expected crc 2023-12-16T03:20:51.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:51 smithi064 ceph-mon[216854]: failed to encode map e53 with expected crc 2023-12-16T03:20:51.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:51 smithi064 ceph-mon[216854]: failed to encode map e53 with expected crc 2023-12-16T03:20:51.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:51 smithi064 ceph-mon[216854]: failed to encode map e53 with expected crc 2023-12-16T03:20:52.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.138+0000 7f7344403700 1 -- 172.21.15.64:0/3009350274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c065390 msgr2=0x7f733c065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.138+0000 7f7344403700 1 --2- 172.21.15.64:0/3009350274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c065390 0x7f733c065800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f732c004940 tx=0x7f732c009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.138+0000 7f7344403700 1 -- 172.21.15.64:0/3009350274 shutdown_connections 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.138+0000 7f7344403700 1 --2- 172.21.15.64:0/3009350274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c065390 0x7f733c065800 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 --2- 172.21.15.64:0/3009350274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f733c102c20 0x7f733c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 -- 172.21.15.64:0/3009350274 >> 172.21.15.64:0/3009350274 conn(0x7f733c0719b0 msgr2=0x7f733c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 -- 172.21.15.64:0/3009350274 shutdown_connections 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 -- 172.21.15.64:0/3009350274 wait complete. 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 Processor -- start 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 -- start start 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f733c065390 0x7f733c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c102c20 0x7f733c113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:52.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c1142c0 con 0x7f733c102c20 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.139+0000 7f7344403700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c10d5f0 con 0x7f733c065390 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f734199e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c102c20 0x7f733c113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f734199e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c102c20 0x7f733c113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39130/0 (socket says 172.21.15.64:39130) 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f734199e700 1 -- 172.21.15.64:0/154238683 learned_addr learned my addr 172.21.15.64:0/154238683 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f734219f700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f733c065390 0x7f733c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f734199e700 1 -- 172.21.15.64:0/154238683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f733c065390 msgr2=0x7f733c113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f734199e700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f733c065390 0x7f733c113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f734199e700 1 -- 172.21.15.64:0/154238683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c005040 con 0x7f733c102c20 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f734199e700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c102c20 0x7f733c113c70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f732c009fd0 tx=0x7f732c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f7332ffd700 1 -- 172.21.15.64:0/154238683 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732c00e040 con 0x7f733c102c20 2023-12-16T03:20:52.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f7332ffd700 1 -- 172.21.15.64:0/154238683 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f732c00bc50 con 0x7f733c102c20 2023-12-16T03:20:52.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c10d870 con 0x7f733c102c20 2023-12-16T03:20:52.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f7332ffd700 1 -- 172.21.15.64:0/154238683 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732c013ea0 con 0x7f733c102c20 2023-12-16T03:20:52.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.140+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c10ddb0 con 0x7f733c102c20 2023-12-16T03:20:52.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.141+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733c0fff40 con 0x7f733c102c20 2023-12-16T03:20:52.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.142+0000 7f7332ffd700 1 -- 172.21.15.64:0/154238683 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f732c013420 con 0x7f733c102c20 2023-12-16T03:20:52.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.142+0000 7f7332ffd700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f732806cf80 0x7f732806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:52.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.142+0000 7f7332ffd700 1 -- 172.21.15.64:0/154238683 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f732c08da60 con 0x7f733c102c20 2023-12-16T03:20:52.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.142+0000 7f734219f700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f732806cf80 0x7f732806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:52.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.143+0000 7f734219f700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f732806cf80 0x7f732806f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7338007fd0 tx=0x7f7338009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:52.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.147+0000 7f7332ffd700 1 -- 172.21.15.64:0/154238683 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f732c05b200 con 0x7f733c102c20 2023-12-16T03:20:52.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:51 smithi184 ceph-mon[184130]: failed to encode map e53 with expected crc 2023-12-16T03:20:52.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:51 smithi184 ceph-mon[184130]: osdmap e53: 6 total, 5 up, 6 in 2023-12-16T03:20:52.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:51 smithi184 ceph-mon[184130]: failed to encode map e53 with expected crc 2023-12-16T03:20:52.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:51 smithi184 ceph-mon[184130]: failed to encode map e53 with expected crc 2023-12-16T03:20:52.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:51 smithi184 ceph-mon[184130]: failed to encode map e53 with expected crc 2023-12-16T03:20:52.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:51 smithi184 ceph-mon[184130]: failed to encode map e53 with expected crc 2023-12-16T03:20:52.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.372+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f733c113400 con 0x7f732806cf80 2023-12-16T03:20:52.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.373+0000 7f7332ffd700 1 -- 172.21.15.64:0/154238683 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f733c113400 con 0x7f732806cf80 2023-12-16T03:20:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f732806cf80 msgr2=0x7f732806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f732806cf80 0x7f732806f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7338007fd0 tx=0x7f7338009040 comp rx=0 tx=0).stop 2023-12-16T03:20:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c102c20 msgr2=0x7f733c113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c102c20 0x7f733c113c70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f732c009fd0 tx=0x7f732c009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 shutdown_connections 2023-12-16T03:20:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f732806cf80 0x7f732806f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f733c065390 0x7f733c113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 --2- 172.21.15.64:0/154238683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f733c102c20 0x7f733c113c70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 >> 172.21.15.64:0/154238683 conn(0x7f733c0719b0 msgr2=0x7f733c0fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 shutdown_connections 2023-12-16T03:20:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.375+0000 7f7344403700 1 -- 172.21.15.64:0/154238683 wait complete. 2023-12-16T03:20:52.388 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:20:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.486+0000 7fc55435a700 1 -- 172.21.15.64:0/1457411470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 msgr2=0x7fc54c0fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.486+0000 7fc55435a700 1 --2- 172.21.15.64:0/1457411470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 0x7fc54c0fdfc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc548004940 tx=0x7fc548009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.486+0000 7fc55435a700 1 -- 172.21.15.64:0/1457411470 shutdown_connections 2023-12-16T03:20:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.486+0000 7fc55435a700 1 --2- 172.21.15.64:0/1457411470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc54c0fe590 0x7fc54c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.486+0000 7fc55435a700 1 --2- 172.21.15.64:0/1457411470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 0x7fc54c0fdfc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.486+0000 7fc55435a700 1 -- 172.21.15.64:0/1457411470 >> 172.21.15.64:0/1457411470 conn(0x7fc54c0f7680 msgr2=0x7fc54c0f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.486+0000 7fc55435a700 1 -- 172.21.15.64:0/1457411470 shutdown_connections 2023-12-16T03:20:52.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.486+0000 7fc55435a700 1 -- 172.21.15.64:0/1457411470 wait complete. 2023-12-16T03:20:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.486+0000 7fc55435a700 1 Processor -- start 2023-12-16T03:20:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc55435a700 1 -- start start 2023-12-16T03:20:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc55435a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 0x7fc54c1135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc55435a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc54c0fe590 0x7fc54c113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc55435a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c114140 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc55435a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c10d470 con 0x7fc54c0fe590 2023-12-16T03:20:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc5520f6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 0x7fc54c1135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:52.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc5520f6700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 0x7fc54c1135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59322/0 (socket says 172.21.15.64:59322) 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc5520f6700 1 -- 172.21.15.64:0/3972422561 learned_addr learned my addr 172.21.15.64:0/3972422561 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc5518f5700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc54c0fe590 0x7fc54c113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc5520f6700 1 -- 172.21.15.64:0/3972422561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc54c0fe590 msgr2=0x7fc54c113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc5520f6700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc54c0fe590 0x7fc54c113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc5520f6700 1 -- 172.21.15.64:0/3972422561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548005040 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc5518f5700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc54c0fe590 0x7fc54c113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.487+0000 7fc5520f6700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 0x7fc54c1135b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc548009390 tx=0x7fc548009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.488+0000 7fc542ffd700 1 -- 172.21.15.64:0/3972422561 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc54800e040 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.488+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c10d6f0 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.488+0000 7fc542ffd700 1 -- 172.21.15.64:0/3972422561 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc548004290 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.488+0000 7fc542ffd700 1 -- 172.21.15.64:0/3972422561 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc54801c3f0 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.488+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c10dc30 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.489+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c1041e0 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.489+0000 7fc542ffd700 1 -- 172.21.15.64:0/3972422561 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fc54800bc50 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.490+0000 7fc542ffd700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc53806cf80 0x7fc53806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:52.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.490+0000 7fc542ffd700 1 -- 172.21.15.64:0/3972422561 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc54808d910 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.490+0000 7fc5518f5700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc53806cf80 0x7fc53806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:52.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.490+0000 7fc5518f5700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc53806cf80 0x7fc53806f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc53c007fd0 tx=0x7fc53c009f60 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:52.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.495+0000 7fc542ffd700 1 -- 172.21.15.64:0/3972422561 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc54805b130 con 0x7fc54c0fdbf0 2023-12-16T03:20:52.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.730+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc54c10eb90 con 0x7fc53806cf80 2023-12-16T03:20:52.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.731+0000 7fc542ffd700 1 -- 172.21.15.64:0/3972422561 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc54c10eb90 con 0x7fc53806cf80 2023-12-16T03:20:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc53806cf80 msgr2=0x7fc53806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc53806cf80 0x7fc53806f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc53c007fd0 tx=0x7fc53c009f60 comp rx=0 tx=0).stop 2023-12-16T03:20:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 msgr2=0x7fc54c1135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 0x7fc54c1135b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc548009390 tx=0x7fc548009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 shutdown_connections 2023-12-16T03:20:52.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc53806cf80 0x7fc53806f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc54c0fdbf0 0x7fc54c1135b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 --2- 172.21.15.64:0/3972422561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc54c0fe590 0x7fc54c113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 >> 172.21.15.64:0/3972422561 conn(0x7fc54c0f7680 msgr2=0x7fc54c101360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 shutdown_connections 2023-12-16T03:20:52.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.733+0000 7fc55435a700 1 -- 172.21.15.64:0/3972422561 wait complete. 2023-12-16T03:20:52.817 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:52 smithi064 bash[239046]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T03:20:52.817 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:52 smithi064 bash[239046]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T03:20:52.817 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:52 smithi064 bash[239046]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T03:20:52.817 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:52 smithi064 bash[239046]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T03:20:52.817 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:52 smithi064 bash[239046]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-16T03:20:52.817 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:52 smithi064 bash[239046]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T03:20:52.817 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:52 smithi064 bash[239046]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-16T03:20:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.840+0000 7f33e77eb700 1 -- 172.21.15.64:0/516403104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0102c20 msgr2=0x7f33e0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.840+0000 7f33e77eb700 1 --2- 172.21.15.64:0/516403104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0102c20 0x7f33e0102ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33d0004940 tx=0x7f33d0009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.840+0000 7f33e77eb700 1 -- 172.21.15.64:0/516403104 shutdown_connections 2023-12-16T03:20:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.840+0000 7f33e77eb700 1 --2- 172.21.15.64:0/516403104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33e0065390 0x7f33e0065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.840+0000 7f33e77eb700 1 --2- 172.21.15.64:0/516403104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0102c20 0x7f33e0102ff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.840+0000 7f33e77eb700 1 -- 172.21.15.64:0/516403104 >> 172.21.15.64:0/516403104 conn(0x7f33e00719b0 msgr2=0x7f33e0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.840+0000 7f33e77eb700 1 -- 172.21.15.64:0/516403104 shutdown_connections 2023-12-16T03:20:52.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.840+0000 7f33e77eb700 1 -- 172.21.15.64:0/516403104 wait complete. 2023-12-16T03:20:52.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e77eb700 1 Processor -- start 2023-12-16T03:20:52.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e77eb700 1 -- start start 2023-12-16T03:20:52.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e77eb700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0065390 0x7f33e0113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:52.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e77eb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33e0102c20 0x7f33e0113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:52.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e77eb700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0114220 con 0x7f33e0065390 2023-12-16T03:20:52.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e77eb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e010d570 con 0x7f33e0102c20 2023-12-16T03:20:52.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e5587700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0065390 0x7f33e0113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:52.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e5587700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0065390 0x7f33e0113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59342/0 (socket says 172.21.15.64:59342) 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e5587700 1 -- 172.21.15.64:0/2629340398 learned_addr learned my addr 172.21.15.64:0/2629340398 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e4d86700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33e0102c20 0x7f33e0113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e5587700 1 -- 172.21.15.64:0/2629340398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33e0102c20 msgr2=0x7f33e0113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e5587700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33e0102c20 0x7f33e0113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e5587700 1 -- 172.21.15.64:0/2629340398 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d0005040 con 0x7f33e0065390 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.841+0000 7f33e4d86700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33e0102c20 0x7f33e0113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.842+0000 7f33e5587700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0065390 0x7f33e0113690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009180 tx=0x7f33d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.842+0000 7f33d5ffb700 1 -- 172.21.15.64:0/2629340398 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d000e040 con 0x7f33e0065390 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.842+0000 7f33d5ffb700 1 -- 172.21.15.64:0/2629340398 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f33d0013420 con 0x7f33e0065390 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.842+0000 7f33d5ffb700 1 -- 172.21.15.64:0/2629340398 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d001c630 con 0x7f33e0065390 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.842+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e010d7f0 con 0x7f33e0065390 2023-12-16T03:20:52.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.842+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e010dd30 con 0x7f33e0065390 2023-12-16T03:20:52.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.843+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e00fff40 con 0x7f33e0065390 2023-12-16T03:20:52.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.843+0000 7f33d5ffb700 1 -- 172.21.15.64:0/2629340398 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f33d00139e0 con 0x7f33e0065390 2023-12-16T03:20:52.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.844+0000 7f33d5ffb700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f33cc06cf80 0x7f33cc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:52.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.844+0000 7f33d5ffb700 1 -- 172.21.15.64:0/2629340398 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f33d008d7a0 con 0x7f33e0065390 2023-12-16T03:20:52.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.844+0000 7f33e4d86700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f33cc06cf80 0x7f33cc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:52.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.844+0000 7f33e4d86700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f33cc06cf80 0x7f33cc06f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f33dc007fd0 tx=0x7f33dc009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:52.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:52.849+0000 7f33d5ffb700 1 -- 172.21.15.64:0/2629340398 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f33d005b060 con 0x7f33e0065390 2023-12-16T03:20:53.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.092+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f33e004bb80 con 0x7f33cc06cf80 2023-12-16T03:20:53.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.103+0000 7f33d5ffb700 1 -- 172.21.15.64:0/2629340398 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f33e004bb80 con 0x7f33cc06cf80 2023-12-16T03:20:53.104 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (2m) 26s ago 10m 29.4M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (48s) 26s ago 10m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f a416f0797862 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (45s) 43s ago 10m 7440k - 19.0.0-191-g6d933094 a29c258b5d6f 4d5da6df7dee 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (2m) 26s ago 10m 85.0M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (6m) 26s ago 6m 15.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (6m) 26s ago 6m 6645M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (6m) 43s ago 6m 4651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (6m) 43s ago 6m 16.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (3m) 26s ago 11m 507M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:20:53.105 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (3m) 43s ago 10m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (95s) 26s ago 12m 56.5M 2048M 19.0.0-191-g6d933094 a29c258b5d6f fcfcecd16324 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (75s) 43s ago 10m 38.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 1523b5eb5b04 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (3m) 26s ago 10m 18.2M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (3m) 43s ago 10m 19.5M - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (30s) 26s ago 9m 12.6M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ff051ca1c9ba 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (9m) 26s ago 9m 844M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c353b84ccd4a 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (8m) 26s ago 8m 646M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2bfbca6d1bc1 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (8m) 43s ago 8m 971M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (8m) 43s ago 8m 772M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (7m) 43s ago 7m 853M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:20:53.106 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (3m) 26s ago 10m 60.4M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:20:53.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f33cc06cf80 msgr2=0x7f33cc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f33cc06cf80 0x7f33cc06f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f33dc007fd0 tx=0x7f33dc009040 comp rx=0 tx=0).stop 2023-12-16T03:20:53.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0065390 msgr2=0x7f33e0113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0065390 0x7f33e0113690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009180 tx=0x7f33d0009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:53.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 shutdown_connections 2023-12-16T03:20:53.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f33cc06cf80 0x7f33cc06f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33e0065390 0x7f33e0113690 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 --2- 172.21.15.64:0/2629340398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33e0102c20 0x7f33e0113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 >> 172.21.15.64:0/2629340398 conn(0x7f33e00719b0 msgr2=0x7f33e00fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:53.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 shutdown_connections 2023-12-16T03:20:53.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.105+0000 7f33e77eb700 1 -- 172.21.15.64:0/2629340398 wait complete. 2023-12-16T03:20:53.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:52 smithi064 ceph-mon[216854]: pgmap v53: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 49/366 objects degraded (13.388%) 2023-12-16T03:20:53.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:52 smithi064 ceph-mon[216854]: Health check failed: Degraded data redundancy: 49/366 objects degraded (13.388%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T03:20:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.210+0000 7f899d0d5700 1 -- 172.21.15.64:0/2285521383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 msgr2=0x7f8998070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.210+0000 7f899d0d5700 1 --2- 172.21.15.64:0/2285521383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 0x7f8998070350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8988009d10 tx=0x7f8988004d10 comp rx=0 tx=0).stop 2023-12-16T03:20:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.210+0000 7f899d0d5700 1 -- 172.21.15.64:0/2285521383 shutdown_connections 2023-12-16T03:20:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.210+0000 7f899d0d5700 1 --2- 172.21.15.64:0/2285521383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8998070890 0x7f8998108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.210+0000 7f899d0d5700 1 --2- 172.21.15.64:0/2285521383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 0x7f8998070350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.210+0000 7f899d0d5700 1 -- 172.21.15.64:0/2285521383 >> 172.21.15.64:0/2285521383 conn(0x7f89980f8790 msgr2=0x7f89980faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:53.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.210+0000 7f899d0d5700 1 -- 172.21.15.64:0/2285521383 shutdown_connections 2023-12-16T03:20:53.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.210+0000 7f899d0d5700 1 -- 172.21.15.64:0/2285521383 wait complete. 2023-12-16T03:20:53.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f899d0d5700 1 Processor -- start 2023-12-16T03:20:53.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f899d0d5700 1 -- start start 2023-12-16T03:20:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f899d0d5700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 0x7f8998115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f899d0d5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8998070890 0x7f8998115ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f899d0d5700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89981164f0 con 0x7f899806ff80 2023-12-16T03:20:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f899d0d5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899810f820 con 0x7f8998070890 2023-12-16T03:20:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f8996d9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 0x7f8998115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f8996d9d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 0x7f8998115960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59360/0 (socket says 172.21.15.64:59360) 2023-12-16T03:20:53.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f8996d9d700 1 -- 172.21.15.64:0/3546081994 learned_addr learned my addr 172.21.15.64:0/3546081994 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:53.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.211+0000 7f899659c700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8998070890 0x7f8998115ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:53.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f8996d9d700 1 -- 172.21.15.64:0/3546081994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8998070890 msgr2=0x7f8998115ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f8996d9d700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8998070890 0x7f8998115ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f8996d9d700 1 -- 172.21.15.64:0/3546081994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8988009940 con 0x7f899806ff80 2023-12-16T03:20:53.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f899659c700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8998070890 0x7f8998115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:20:53.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f8996d9d700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 0x7f8998115960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8988009840 tx=0x7f8988004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:53.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f898f7fe700 1 -- 172.21.15.64:0/3546081994 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f898800e070 con 0x7f899806ff80 2023-12-16T03:20:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f898f7fe700 1 -- 172.21.15.64:0/3546081994 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89880128c0 con 0x7f899806ff80 2023-12-16T03:20:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899810faa0 con 0x7f899806ff80 2023-12-16T03:20:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f898f7fe700 1 -- 172.21.15.64:0/3546081994 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f898801b790 con 0x7f899806ff80 2023-12-16T03:20:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.212+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899810ffe0 con 0x7f899806ff80 2023-12-16T03:20:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.213+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8998106630 con 0x7f899806ff80 2023-12-16T03:20:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.214+0000 7f898f7fe700 1 -- 172.21.15.64:0/3546081994 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f8988019040 con 0x7f899806ff80 2023-12-16T03:20:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.214+0000 7f898f7fe700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f898406cf80 0x7f898406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:53.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.214+0000 7f898f7fe700 1 -- 172.21.15.64:0/3546081994 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f898808d980 con 0x7f899806ff80 2023-12-16T03:20:53.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.214+0000 7f899659c700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f898406cf80 0x7f898406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:53.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.215+0000 7f899659c700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f898406cf80 0x7f898406f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8998111190 tx=0x7f898000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:53.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.219+0000 7f898f7fe700 1 -- 172.21.15.64:0/3546081994 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f898805b1a0 con 0x7f899806ff80 2023-12-16T03:20:53.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:52 smithi184 ceph-mon[184130]: pgmap v53: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 49/366 objects degraded (13.388%) 2023-12-16T03:20:53.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:52 smithi184 ceph-mon[184130]: Health check failed: Degraded data redundancy: 49/366 objects degraded (13.388%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T03:20:53.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.524+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f899804bb80 con 0x7f899806ff80 2023-12-16T03:20:53.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.524+0000 7f898f7fe700 1 -- 172.21.15.64:0/3546081994 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f898805ad30 con 0x7f899806ff80 2023-12-16T03:20:53.526 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:20:53.526 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:20:53.526 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:20:53.526 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:20:53.526 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:20:53.526 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:20:53.526 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:20:53.526 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 8, 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 5 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:20:53.527 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f898406cf80 msgr2=0x7f898406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f898406cf80 0x7f898406f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8998111190 tx=0x7f898000b040 comp rx=0 tx=0).stop 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 msgr2=0x7f8998115960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 0x7f8998115960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8988009840 tx=0x7f8988004d10 comp rx=0 tx=0).stop 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 shutdown_connections 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f898406cf80 0x7f898406f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899806ff80 0x7f8998115960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 --2- 172.21.15.64:0/3546081994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8998070890 0x7f8998115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 >> 172.21.15.64:0/3546081994 conn(0x7f89980f8790 msgr2=0x7f89981037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:53.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 shutdown_connections 2023-12-16T03:20:53.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.528+0000 7f899d0d5700 1 -- 172.21.15.64:0/3546081994 wait complete. 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.639+0000 7faaf30d1700 1 -- 172.21.15.64:0/2431391676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 msgr2=0x7faaec065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.639+0000 7faaf30d1700 1 --2- 172.21.15.64:0/2431391676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 0x7faaec065800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faad8004940 tx=0x7faad8009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.639+0000 7faaf30d1700 1 -- 172.21.15.64:0/2431391676 shutdown_connections 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.639+0000 7faaf30d1700 1 --2- 172.21.15.64:0/2431391676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 0x7faaec065800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.639+0000 7faaf30d1700 1 --2- 172.21.15.64:0/2431391676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec102c20 0x7faaec102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.639+0000 7faaf30d1700 1 -- 172.21.15.64:0/2431391676 >> 172.21.15.64:0/2431391676 conn(0x7faaec0719b0 msgr2=0x7faaec071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.640+0000 7faaf30d1700 1 -- 172.21.15.64:0/2431391676 shutdown_connections 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.640+0000 7faaf30d1700 1 -- 172.21.15.64:0/2431391676 wait complete. 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.640+0000 7faaf30d1700 1 Processor -- start 2023-12-16T03:20:53.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.640+0000 7faaf30d1700 1 -- start start 2023-12-16T03:20:53.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.640+0000 7faaf30d1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 0x7faaec0fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:53.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.640+0000 7faaf30d1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec102c20 0x7faaec0fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:53.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.640+0000 7faaf30d1700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0fc730 con 0x7faaec065390 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf30d1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0fc8a0 con 0x7faaec102c20 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf0e6d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 0x7faaec0fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf0e6d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 0x7faaec0fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59388/0 (socket says 172.21.15.64:59388) 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf0e6d700 1 -- 172.21.15.64:0/2609388480 learned_addr learned my addr 172.21.15.64:0/2609388480 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaebfff700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec102c20 0x7faaec0fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf0e6d700 1 -- 172.21.15.64:0/2609388480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec102c20 msgr2=0x7faaec0fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf0e6d700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec102c20 0x7faaec0fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf0e6d700 1 -- 172.21.15.64:0/2609388480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad8005040 con 0x7faaec065390 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf0e6d700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 0x7faaec0fbbf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faae0002a50 tx=0x7faae00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faae97fa700 1 -- 172.21.15.64:0/2609388480 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae0007cc0 con 0x7faaec065390 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec119970 con 0x7faaec065390 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faae97fa700 1 -- 172.21.15.64:0/2609388480 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faae000f040 con 0x7faaec065390 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faae97fa700 1 -- 172.21.15.64:0/2609388480 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae000d9c0 con 0x7faaec065390 2023-12-16T03:20:53.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.641+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec119e20 con 0x7faaec065390 2023-12-16T03:20:53.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.642+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaec0fff40 con 0x7faaec065390 2023-12-16T03:20:53.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.643+0000 7faae97fa700 1 -- 172.21.15.64:0/2609388480 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7faae000db20 con 0x7faaec065390 2023-12-16T03:20:53.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.643+0000 7faae97fa700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7faadc06cf80 0x7faadc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:53.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.643+0000 7faae97fa700 1 -- 172.21.15.64:0/2609388480 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6328+0+0 (secure 0 0 0) 0x7faae008c200 con 0x7faaec065390 2023-12-16T03:20:53.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.643+0000 7faaebfff700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7faadc06cf80 0x7faadc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:53.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.644+0000 7faaebfff700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7faadc06cf80 0x7faadc06f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faaec0fdd00 tx=0x7faad8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:53.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.648+0000 7faae97fa700 1 -- 172.21.15.64:0/2609388480 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7faae0055f10 con 0x7faaec065390 2023-12-16T03:20:53.692 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-osd[239461]: -- 172.21.15.64:0/245595365 <== mon.0 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55afae1a96c0 con 0x55afae179000 2023-12-16T03:20:53.693 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:53 smithi064 bash[239400]: 16e84d48176143e3858eb8823d7d0d4b36280d484f4bf543b737e8f77ec9cf4d 2023-12-16T03:20:53.693 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:53 smithi064 systemd[1]: Started Ceph osd.1 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:20:53.919 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.917+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faaec04bb80 con 0x7faaec065390 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.918+0000 7faae97fa700 1 -- 172.21.15.64:0/2609388480 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1854 (secure 0 0 0) 0x7faae0059530 con 0x7faaec065390 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:e17 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:legacy client fscid: 1 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:Filesystem 'cephfs' (1) 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:fs_name cephfs 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 17 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:20:53.920 INFO:teuthology.orchestra.run.smithi064.stdout:modified 2023-12-16T03:20:28.477911+0000 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:tableserver 0 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:root 0 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:session_timeout 60 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:session_autoclose 300 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:max_file_size 1099511627776 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:max_xattr_size 65536 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:required_client_features {} 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure 0 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure_osd_epoch 0 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:max_mds 2 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:in 0,1 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:up {0=14460,1=24269} 2023-12-16T03:20:53.921 INFO:teuthology.orchestra.run.smithi064.stdout:failed 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:damaged 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:stopped 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:data_pools [3] 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:metadata_pool 2 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:inline_data enabled 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:balancer 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:bal_rank_mask -1 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:standby_count_wanted 1 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:Standby daemons: 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:20:53.922 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:20:53.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7faadc06cf80 msgr2=0x7faadc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7faadc06cf80 0x7faadc06f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faaec0fdd00 tx=0x7faad8009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:53.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 msgr2=0x7faaec0fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:53.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 0x7faaec0fbbf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faae0002a50 tx=0x7faae00046b0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 shutdown_connections 2023-12-16T03:20:53.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7faadc06cf80 0x7faadc06f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec065390 0x7faaec0fbbf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 --2- 172.21.15.64:0/2609388480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec102c20 0x7faaec0fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:53.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 >> 172.21.15.64:0/2609388480 conn(0x7faaec0719b0 msgr2=0x7faaec0fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:53.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 shutdown_connections 2023-12-16T03:20:53.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:53.920+0000 7faaf30d1700 1 -- 172.21.15.64:0/2609388480 wait complete. 2023-12-16T03:20:53.924 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 17 2023-12-16T03:20:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.032+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2354728947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef41035a0 msgr2=0x7f0ef40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.032+0000 7f0ef8eeb700 1 --2- 172.21.15.64:0/2354728947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef41035a0 0x7f0ef40fcc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8004940 tx=0x7f0ee8009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.032+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2354728947 shutdown_connections 2023-12-16T03:20:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.032+0000 7f0ef8eeb700 1 --2- 172.21.15.64:0/2354728947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef41035a0 0x7f0ef40fcc10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.032+0000 7f0ef8eeb700 1 --2- 172.21.15.64:0/2354728947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef4102c00 0x7f0ef4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.032+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2354728947 >> 172.21.15.64:0/2354728947 conn(0x7f0ef40f8790 msgr2=0x7f0ef40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.032+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2354728947 shutdown_connections 2023-12-16T03:20:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.032+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2354728947 wait complete. 2023-12-16T03:20:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef8eeb700 1 Processor -- start 2023-12-16T03:20:54.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef8eeb700 1 -- start start 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef8eeb700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef4102c00 0x7f0ef41135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef8eeb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef41035a0 0x7f0ef4113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef8eeb700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4114160 con 0x7f0ef4102c00 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef8eeb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef410d490 con 0x7f0ef41035a0 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef4102c00 0x7f0ef41135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef259c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef4102c00 0x7f0ef41135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59396/0 (socket says 172.21.15.64:59396) 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef259c700 1 -- 172.21.15.64:0/2365306813 learned_addr learned my addr 172.21.15.64:0/2365306813 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef1d9b700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef41035a0 0x7f0ef4113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef259c700 1 -- 172.21.15.64:0/2365306813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef41035a0 msgr2=0x7f0ef4113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:54.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef259c700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef41035a0 0x7f0ef4113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.033+0000 7f0ef259c700 1 -- 172.21.15.64:0/2365306813 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8005040 con 0x7f0ef4102c00 2023-12-16T03:20:54.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.034+0000 7f0ef259c700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef4102c00 0x7f0ef41135d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400eb40 tx=0x7f0ee400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:54.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.034+0000 7f0ee2ffd700 1 -- 172.21.15.64:0/2365306813 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee4007cc0 con 0x7f0ef4102c00 2023-12-16T03:20:54.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.034+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef410d710 con 0x7f0ef4102c00 2023-12-16T03:20:54.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.034+0000 7f0ee2ffd700 1 -- 172.21.15.64:0/2365306813 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ee400f040 con 0x7f0ef4102c00 2023-12-16T03:20:54.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.034+0000 7f0ee2ffd700 1 -- 172.21.15.64:0/2365306813 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee4009570 con 0x7f0ef4102c00 2023-12-16T03:20:54.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.034+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef410dc50 con 0x7f0ef4102c00 2023-12-16T03:20:54.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.035+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef40fc390 con 0x7f0ef4102c00 2023-12-16T03:20:54.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.035+0000 7f0ee2ffd700 1 -- 172.21.15.64:0/2365306813 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f0ee40096d0 con 0x7f0ef4102c00 2023-12-16T03:20:54.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.036+0000 7f0ee2ffd700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0edc06cf80 0x7f0edc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:54.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.036+0000 7f0ee2ffd700 1 -- 172.21.15.64:0/2365306813 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0ee408c190 con 0x7f0ef4102c00 2023-12-16T03:20:54.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.036+0000 7f0ef1d9b700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0edc06cf80 0x7f0edc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:54.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.036+0000 7f0ef1d9b700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0edc06cf80 0x7f0edc06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ef410ee70 tx=0x7f0ee8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:54.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.040+0000 7f0ee2ffd700 1 -- 172.21.15.64:0/2365306813 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0ee40599e0 con 0x7f0ef4102c00 2023-12-16T03:20:54.193 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[239418]: 2023-12-16T03:20:53.808+0000 7fc3caaef640 -1 Falling back to public interface 2023-12-16T03:20:54.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-mon[216854]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:54.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-mon[216854]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:54.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-mon[216854]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:54.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:54.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:54.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:54.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/3546081994' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:54.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:54.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:53 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:54.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.270+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ef410ec50 con 0x7f0edc06cf80 2023-12-16T03:20:54.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.271+0000 7f0ee2ffd700 1 -- 172.21.15.64:0/2365306813 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0ef410ec50 con 0x7f0edc06cf80 2023-12-16T03:20:54.273 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:20:54.273 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:20:54.273 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:20:54.273 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T03:20:54.273 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:20:54.274 INFO:teuthology.orchestra.run.smithi064.stdout: "crash", 2023-12-16T03:20:54.274 INFO:teuthology.orchestra.run.smithi064.stdout: "mon", 2023-12-16T03:20:54.274 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:20:54.274 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:20:54.274 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "7/21 daemons upgraded", 2023-12-16T03:20:54.274 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T03:20:54.274 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:20:54.274 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:20:54.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0edc06cf80 msgr2=0x7f0edc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:54.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0edc06cf80 0x7f0edc06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ef410ee70 tx=0x7f0ee8009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef4102c00 msgr2=0x7f0ef41135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef4102c00 0x7f0ef41135d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400eb40 tx=0x7f0ee400b040 comp rx=0 tx=0).stop 2023-12-16T03:20:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 shutdown_connections 2023-12-16T03:20:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0edc06cf80 0x7f0edc06f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef4102c00 0x7f0ef41135d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 --2- 172.21.15.64:0/2365306813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef41035a0 0x7f0ef4113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 >> 172.21.15.64:0/2365306813 conn(0x7f0ef40f8790 msgr2=0x7f0ef40fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 shutdown_connections 2023-12-16T03:20:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.274+0000 7f0ef8eeb700 1 -- 172.21.15.64:0/2365306813 wait complete. 2023-12-16T03:20:54.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:53 smithi184 ceph-mon[184130]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:54.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:53 smithi184 ceph-mon[184130]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:54.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:53 smithi184 ceph-mon[184130]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:54.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:53 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:54.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:53 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:54.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:53 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:20:54.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:53 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/3546081994' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:20:54.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:53 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:54.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:53 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:54.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.392+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/3294613415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb0101b00 msgr2=0x7f6cb0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:54.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.392+0000 7f6cb4c6a700 1 --2- 172.21.15.64:0/3294613415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb0101b00 0x7f6cb0101ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0004940 tx=0x7f6ca0009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:54.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.393+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/3294613415 shutdown_connections 2023-12-16T03:20:54.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.393+0000 7f6cb4c6a700 1 --2- 172.21.15.64:0/3294613415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb00fbb40 0x7f6cb00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.393+0000 7f6cb4c6a700 1 --2- 172.21.15.64:0/3294613415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb0101b00 0x7f6cb0101ed0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.393+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/3294613415 >> 172.21.15.64:0/3294613415 conn(0x7f6cb00719b0 msgr2=0x7f6cb0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:54.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.393+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/3294613415 shutdown_connections 2023-12-16T03:20:54.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.393+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/3294613415 wait complete. 2023-12-16T03:20:54.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.393+0000 7f6cb4c6a700 1 Processor -- start 2023-12-16T03:20:54.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.393+0000 7f6cb4c6a700 1 -- start start 2023-12-16T03:20:54.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cb4c6a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb00fbb40 0x7f6cb0112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:54.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cb4c6a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb0101b00 0x7f6cb0112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cb4c6a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0113100 con 0x7f6cb00fbb40 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cb4c6a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb010c430 con 0x7f6cb0101b00 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cae59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb00fbb40 0x7f6cb0112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cae59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb00fbb40 0x7f6cb0112570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59404/0 (socket says 172.21.15.64:59404) 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cae59c700 1 -- 172.21.15.64:0/1320861117 learned_addr learned my addr 172.21.15.64:0/1320861117 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cae59c700 1 -- 172.21.15.64:0/1320861117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb0101b00 msgr2=0x7f6cb0112ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cae59c700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb0101b00 0x7f6cb0112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cae59c700 1 -- 172.21.15.64:0/1320861117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0005040 con 0x7f6cb00fbb40 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6cae59c700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb00fbb40 0x7f6cb0112570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009fd0 tx=0x7f6ca0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.394+0000 7f6c9effd700 1 -- 172.21.15.64:0/1320861117 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ca000e040 con 0x7f6cb00fbb40 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.395+0000 7f6c9effd700 1 -- 172.21.15.64:0/1320861117 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ca000bc50 con 0x7f6cb00fbb40 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.395+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb010c6b0 con 0x7f6cb00fbb40 2023-12-16T03:20:54.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.395+0000 7f6c9effd700 1 -- 172.21.15.64:0/1320861117 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ca0013ea0 con 0x7f6cb00fbb40 2023-12-16T03:20:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.395+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb010cbf0 con 0x7f6cb00fbb40 2023-12-16T03:20:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.396+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb0103fb0 con 0x7f6cb00fbb40 2023-12-16T03:20:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.396+0000 7f6c9effd700 1 -- 172.21.15.64:0/1320861117 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f6ca0013420 con 0x7f6cb00fbb40 2023-12-16T03:20:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.397+0000 7f6c9effd700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c9806cf80 0x7f6c9806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:20:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.397+0000 7f6c9effd700 1 -- 172.21.15.64:0/1320861117 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6ca008da60 con 0x7f6cb00fbb40 2023-12-16T03:20:54.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.397+0000 7f6cadd9b700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c9806cf80 0x7f6c9806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:20:54.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.397+0000 7f6cadd9b700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c9806cf80 0x7f6c9806f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6cb010de10 tx=0x7f6ca4009ce0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:20:54.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.401+0000 7f6c9effd700 1 -- 172.21.15.64:0/1320861117 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f6ca005b200 con 0x7f6cb00fbb40 2023-12-16T03:20:54.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.698+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6cb004bc10 con 0x7f6cb00fbb40 2023-12-16T03:20:54.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.699+0000 7f6c9effd700 1 -- 172.21.15.64:0/1320861117 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1239 (secure 0 0 0) 0x7f6ca005ad90 con 0x7f6cb00fbb40 2023-12-16T03:20:54.700 INFO:teuthology.orchestra.run.smithi064.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 49/366 objects degraded (13.388%), 14 pgs degraded 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: osd.1 (root=default,host=smithi064) is down 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 49/366 objects degraded (13.388%), 14 pgs degraded 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2023-12-16T03:20:54.701 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2023-12-16T03:20:54.702 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2023-12-16T03:20:54.702 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2023-12-16T03:20:54.702 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2023-12-16T03:20:54.702 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2023-12-16T03:20:54.702 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2023-12-16T03:20:54.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c9806cf80 msgr2=0x7f6c9806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c9806cf80 0x7f6c9806f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6cb010de10 tx=0x7f6ca4009ce0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb00fbb40 msgr2=0x7f6cb0112570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb00fbb40 0x7f6cb0112570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009fd0 tx=0x7f6ca0009e30 comp rx=0 tx=0).stop 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 shutdown_connections 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c9806cf80 0x7f6c9806f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cb00fbb40 0x7f6cb0112570 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 --2- 172.21.15.64:0/1320861117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb0101b00 0x7f6cb0112ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 >> 172.21.15.64:0/1320861117 conn(0x7f6cb00719b0 msgr2=0x7f6cb00fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 shutdown_connections 2023-12-16T03:20:54.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:20:54.701+0000 7f6cb4c6a700 1 -- 172.21.15.64:0/1320861117 wait complete. 2023-12-16T03:20:54.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:54 smithi064 ceph-mon[216854]: pgmap v54: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 49/366 objects degraded (13.388%) 2023-12-16T03:20:54.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:54 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/2609388480' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:20:54.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:54 smithi064 ceph-mon[216854]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:54.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:54 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/1320861117' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:20:55.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:54 smithi184 ceph-mon[184130]: pgmap v54: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 49/366 objects degraded (13.388%) 2023-12-16T03:20:55.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:54 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/2609388480' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:20:55.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:54 smithi184 ceph-mon[184130]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:20:55.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:54 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/1320861117' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:20:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:56 smithi184 ceph-mon[184130]: pgmap v55: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2023-12-16T03:20:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:20:56.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:56 smithi064 ceph-mon[216854]: pgmap v55: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2023-12-16T03:20:56.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:56.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:20:57.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:57 smithi184 ceph-mon[184130]: mgrmap e39: smithi064.ueciyw(active, since 91s), standbys: smithi184.urtxla 2023-12-16T03:20:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:57.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:57 smithi064 ceph-mon[216854]: mgrmap e39: smithi064.ueciyw(active, since 91s), standbys: smithi184.urtxla 2023-12-16T03:20:57.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:57.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:58.661 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:58 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[239418]: 2023-12-16T03:20:58.355+0000 7fc3caaef640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-16T03:20:58.661 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:58 smithi064 ceph-mon[216854]: pgmap v56: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 56/366 objects degraded (15.301%) 2023-12-16T03:20:58.661 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:58 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 56/366 objects degraded (15.301%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T03:20:58.661 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:58 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:58.661 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:58 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:58.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:58 smithi184 ceph-mon[184130]: pgmap v56: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 56/366 objects degraded (15.301%) 2023-12-16T03:20:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:58 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 56/366 objects degraded (15.301%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T03:20:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:58 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:58 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:20:59.442 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:58 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[239418]: 2023-12-16T03:20:58.967+0000 7fc3caaef640 -1 osd.1 51 log_to_monitors true 2023-12-16T03:20:59.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:20:59 smithi184 ceph-mon[184130]: from='osd.1 [v2:172.21.15.64:6810/262863118,v1:172.21.15.64:6811/262863118]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T03:20:59.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:20:59 smithi064 ceph-mon[216854]: from='osd.1 [v2:172.21.15.64:6810/262863118,v1:172.21.15.64:6811/262863118]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T03:20:59.943 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:20:59 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[239418]: 2023-12-16T03:20:59.483+0000 7fc3b975b700 -1 osd.1 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:21:00.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:00 smithi184 ceph-mon[184130]: pgmap v57: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 639 B/s wr, 0 op/s; 56/366 objects degraded (15.301%) 2023-12-16T03:21:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:00 smithi184 ceph-mon[184130]: from='osd.1 [v2:172.21.15.64:6810/262863118,v1:172.21.15.64:6811/262863118]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T03:21:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:00 smithi184 ceph-mon[184130]: osdmap e54: 6 total, 5 up, 6 in 2023-12-16T03:21:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:00 smithi184 ceph-mon[184130]: from='osd.1 [v2:172.21.15.64:6810/262863118,v1:172.21.15.64:6811/262863118]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:21:00.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:00 smithi064 ceph-mon[216854]: pgmap v57: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 639 B/s wr, 0 op/s; 56/366 objects degraded (15.301%) 2023-12-16T03:21:00.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:00 smithi064 ceph-mon[216854]: from='osd.1 [v2:172.21.15.64:6810/262863118,v1:172.21.15.64:6811/262863118]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T03:21:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:00 smithi064 ceph-mon[216854]: osdmap e54: 6 total, 5 up, 6 in 2023-12-16T03:21:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:00 smithi064 ceph-mon[216854]: from='osd.1 [v2:172.21.15.64:6810/262863118,v1:172.21.15.64:6811/262863118]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:21:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: failed to encode map e54 with expected crc 2023-12-16T03:21:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: failed to encode map e54 with expected crc 2023-12-16T03:21:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: failed to encode map e54 with expected crc 2023-12-16T03:21:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: failed to encode map e54 with expected crc 2023-12-16T03:21:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:21:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: failed to encode map e55 with expected crc 2023-12-16T03:21:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: osd.1 [v2:172.21.15.64:6810/262863118,v1:172.21.15.64:6811/262863118] boot 2023-12-16T03:21:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: osdmap e55: 6 total, 6 up, 6 in 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T03:21:01.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:01 smithi184 ceph-mon[184130]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: failed to encode map e54 with expected crc 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: failed to encode map e54 with expected crc 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: failed to encode map e54 with expected crc 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: failed to encode map e54 with expected crc 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: failed to encode map e55 with expected crc 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: osd.1 [v2:172.21.15.64:6810/262863118,v1:172.21.15.64:6811/262863118] boot 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: osdmap e55: 6 total, 6 up, 6 in 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T03:21:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T03:21:01.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:01 smithi064 ceph-mon[216854]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-16T03:21:02.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: pgmap v60: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 24/366 objects degraded (6.557%) 2023-12-16T03:21:02.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: osdmap e56: 6 total, 6 up, 6 in 2023-12-16T03:21:02.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:02 smithi064 ceph-mon[216854]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: pgmap v60: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 24/366 objects degraded (6.557%) 2023-12-16T03:21:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: osdmap e56: 6 total, 6 up, 6 in 2023-12-16T03:21:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: failed to encode map e56 with expected crc 2023-12-16T03:21:02.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:02 smithi184 ceph-mon[184130]: failed to encode map e56 with expected crc 2023-12-16T03:21:03.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:03 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 24/366 objects degraded (6.557%), 7 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:03.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:03 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 24/366 objects degraded (6.557%), 7 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:04.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:04 smithi064 ceph-mon[216854]: pgmap v62: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 24/366 objects degraded (6.557%) 2023-12-16T03:21:05.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:04 smithi184 ceph-mon[184130]: pgmap v62: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 24/366 objects degraded (6.557%) 2023-12-16T03:21:06.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:05 smithi184 ceph-mon[184130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/366 objects degraded (6.557%), 7 pgs degraded) 2023-12-16T03:21:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:05 smithi064 ceph-mon[216854]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/366 objects degraded (6.557%), 7 pgs degraded) 2023-12-16T03:21:07.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:06 smithi184 ceph-mon[184130]: pgmap v63: 65 pgs: 20 peering, 45 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:21:07.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:06 smithi064 ceph-mon[216854]: pgmap v63: 65 pgs: 20 peering, 45 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:21:08.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:08 smithi064 ceph-mon[216854]: pgmap v64: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 11 B/s, 0 objects/s recovering 2023-12-16T03:21:09.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:08 smithi184 ceph-mon[184130]: pgmap v64: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 11 B/s, 0 objects/s recovering 2023-12-16T03:21:11.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:10 smithi184 ceph-mon[184130]: pgmap v65: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 10 B/s, 0 objects/s recovering 2023-12-16T03:21:11.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:10 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:11.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:10 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:21:11.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:10 smithi064 ceph-mon[216854]: pgmap v65: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 10 B/s, 0 objects/s recovering 2023-12-16T03:21:11.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:10 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:11.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:10 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:21:13.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:12 smithi184 ceph-mon[184130]: pgmap v66: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 8 B/s, 0 objects/s recovering 2023-12-16T03:21:13.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:12 smithi064 ceph-mon[216854]: pgmap v66: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 8 B/s, 0 objects/s recovering 2023-12-16T03:21:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:14 smithi184 ceph-mon[184130]: pgmap v67: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-16T03:21:15.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:14 smithi064 ceph-mon[216854]: pgmap v67: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-16T03:21:16.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:16 smithi064 ceph-mon[216854]: pgmap v68: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-16T03:21:16.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:16.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:16 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T03:21:16.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:16 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T03:21:16.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:16 smithi064 ceph-mon[216854]: Upgrade: osd.2 is safe to restart 2023-12-16T03:21:16.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:16 smithi184 ceph-mon[184130]: pgmap v68: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-16T03:21:16.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:16.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:16 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T03:21:16.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:16 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T03:21:16.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:16 smithi184 ceph-mon[184130]: Upgrade: osd.2 is safe to restart 2023-12-16T03:21:18.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:17 smithi184 ceph-mon[184130]: Upgrade: Updating osd.2 2023-12-16T03:21:18.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:17 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:18.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:17 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T03:21:18.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:17 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:21:18.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:17 smithi184 ceph-mon[184130]: Deploying daemon osd.2 on smithi064 2023-12-16T03:21:18.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:17 smithi064 ceph-mon[216854]: Upgrade: Updating osd.2 2023-12-16T03:21:18.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:17 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:18.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:17 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T03:21:18.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:17 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:21:18.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:17 smithi064 ceph-mon[216854]: Deploying daemon osd.2 on smithi064 2023-12-16T03:21:18.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:18 smithi064 ceph-mon[216854]: pgmap v69: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-16T03:21:19.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:18 smithi184 ceph-mon[184130]: pgmap v69: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-16T03:21:19.443 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:19 smithi064 systemd[1]: Stopping Ceph osd.2 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:21:19.443 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:19 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[154458]: 2023-12-16T03:21:19.200+0000 7f01d54ec700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:21:19.443 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:19 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[154458]: 2023-12-16T03:21:19.200+0000 7f01d54ec700 -1 osd.2 56 *** Got signal Terminated *** 2023-12-16T03:21:19.443 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:19 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[154458]: 2023-12-16T03:21:19.200+0000 7f01d54ec700 -1 osd.2 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:21:20.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:19 smithi184 ceph-mon[184130]: osd.2 marked itself down and dead 2023-12-16T03:21:20.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:19 smithi064 ceph-mon[216854]: osd.2 marked itself down and dead 2023-12-16T03:21:20.692 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:20 smithi064 bash[246210]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2 2023-12-16T03:21:21.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:20 smithi064 ceph-mon[216854]: pgmap v70: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:21:21.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:20 smithi064 ceph-mon[216854]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:21:21.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:20 smithi064 ceph-mon[216854]: osdmap e57: 6 total, 5 up, 6 in 2023-12-16T03:21:21.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:20 smithi064 ceph-mon[216854]: failed to encode map e57 with expected crc 2023-12-16T03:21:21.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:20 smithi064 ceph-mon[216854]: failed to encode map e57 with expected crc 2023-12-16T03:21:21.194 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:20 smithi064 ceph-mon[216854]: failed to encode map e57 with expected crc 2023-12-16T03:21:21.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:20 smithi184 ceph-mon[184130]: pgmap v70: 65 pgs: 65 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T03:21:21.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:20 smithi184 ceph-mon[184130]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:21:21.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:20 smithi184 ceph-mon[184130]: osdmap e57: 6 total, 5 up, 6 in 2023-12-16T03:21:21.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:20 smithi184 ceph-mon[184130]: failed to encode map e57 with expected crc 2023-12-16T03:21:21.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:20 smithi184 ceph-mon[184130]: failed to encode map e57 with expected crc 2023-12-16T03:21:21.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:20 smithi184 ceph-mon[184130]: failed to encode map e57 with expected crc 2023-12-16T03:21:22.096 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:21 smithi064 ceph-mon[216854]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.096 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:21 smithi064 ceph-mon[216854]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.096 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:21 smithi064 ceph-mon[216854]: osdmap e58: 6 total, 5 up, 6 in 2023-12-16T03:21:22.096 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:21 smithi064 ceph-mon[216854]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.096 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:21 smithi064 ceph-mon[216854]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.096 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:21 smithi064 ceph-mon[216854]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.097 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:21 smithi064 ceph-mon[216854]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.097 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:21 smithi064 ceph-mon[216854]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.097 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:21 smithi064 systemd[1]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.2.service: Succeeded. 2023-12-16T03:21:22.097 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:21 smithi064 systemd[1]: Stopped Ceph osd.2 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:21:22.098 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:21 smithi064 systemd[1]: Starting Ceph osd.2 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:21:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:21 smithi184 ceph-mon[184130]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:21 smithi184 ceph-mon[184130]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:21 smithi184 ceph-mon[184130]: osdmap e58: 6 total, 5 up, 6 in 2023-12-16T03:21:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:21 smithi184 ceph-mon[184130]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:21 smithi184 ceph-mon[184130]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:21 smithi184 ceph-mon[184130]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:21 smithi184 ceph-mon[184130]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:21 smithi184 ceph-mon[184130]: failed to encode map e58 with expected crc 2023-12-16T03:21:22.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:22 smithi064 ceph-mon[216854]: pgmap v73: 65 pgs: 6 active+undersized+degraded, 7 stale+active+clean, 6 active+undersized, 46 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17/366 objects degraded (4.645%) 2023-12-16T03:21:22.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:22 smithi064 ceph-mon[216854]: Health check failed: Degraded data redundancy: 17/366 objects degraded (4.645%), 6 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:22.943 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:22 smithi064 bash[246475]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T03:21:22.943 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:22 smithi064 bash[246475]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T03:21:22.943 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:22 smithi064 bash[246475]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T03:21:22.943 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:22 smithi064 bash[246475]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T03:21:22.943 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:22 smithi064 bash[246475]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-16T03:21:22.943 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:22 smithi064 bash[246475]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T03:21:22.943 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:22 smithi064 bash[246475]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-16T03:21:23.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:22 smithi184 ceph-mon[184130]: pgmap v73: 65 pgs: 6 active+undersized+degraded, 7 stale+active+clean, 6 active+undersized, 46 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17/366 objects degraded (4.645%) 2023-12-16T03:21:23.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:22 smithi184 ceph-mon[184130]: Health check failed: Degraded data redundancy: 17/366 objects degraded (4.645%), 6 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:23.693 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:23 smithi064 ceph-osd[246790]: -- 172.21.15.64:0/3214145965 <== mon.0 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55899fc1b6c0 con 0x55899fbeb000 2023-12-16T03:21:23.693 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:23 smithi064 bash[246752]: 237e9d69d7c9dae16008ff73c64637b39d60a8b7af04ee013538f5b6fc0ce257 2023-12-16T03:21:23.693 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:23 smithi064 systemd[1]: Started Ceph osd.2 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:21:24.192 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:23 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[246767]: 2023-12-16T03:21:23.850+0000 7faa9e6ad640 -1 Falling back to public interface 2023-12-16T03:21:24.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:24 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:24.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:24 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:24.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:24 smithi064 ceph-mon[216854]: pgmap v74: 65 pgs: 6 active+undersized+degraded, 7 stale+active+clean, 6 active+undersized, 46 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17/366 objects degraded (4.645%) 2023-12-16T03:21:24.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:24 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:21:24.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:24 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:24.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:24 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:24.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:24 smithi184 ceph-mon[184130]: pgmap v74: 65 pgs: 6 active+undersized+degraded, 7 stale+active+clean, 6 active+undersized, 46 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17/366 objects degraded (4.645%) 2023-12-16T03:21:24.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:24 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:21:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.813+0000 7f5ec46ca700 1 -- 172.21.15.64:0/65046453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 msgr2=0x7f5ebc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.813+0000 7f5ec46ca700 1 --2- 172.21.15.64:0/65046453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 0x7f5ebc101ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8004940 tx=0x7f5eb8009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.813+0000 7f5ec46ca700 1 -- 172.21.15.64:0/65046453 shutdown_connections 2023-12-16T03:21:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.813+0000 7f5ec46ca700 1 --2- 172.21.15.64:0/65046453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ebc0fbb40 0x7f5ebc0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.813+0000 7f5ec46ca700 1 --2- 172.21.15.64:0/65046453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 0x7f5ebc101ed0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.813+0000 7f5ec46ca700 1 -- 172.21.15.64:0/65046453 >> 172.21.15.64:0/65046453 conn(0x7f5ebc0719b0 msgr2=0x7f5ebc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.813+0000 7f5ec46ca700 1 -- 172.21.15.64:0/65046453 shutdown_connections 2023-12-16T03:21:24.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.813+0000 7f5ec46ca700 1 -- 172.21.15.64:0/65046453 wait complete. 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec46ca700 1 Processor -- start 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec46ca700 1 -- start start 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec46ca700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ebc0fbb40 0x7f5ebc1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec46ca700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 0x7f5ebc113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec46ca700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc114230 con 0x7f5ebc101b00 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec46ca700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc10d520 con 0x7f5ebc0fbb40 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec1c65700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 0x7f5ebc113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec1c65700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 0x7f5ebc113be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40620/0 (socket says 172.21.15.64:40620) 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec1c65700 1 -- 172.21.15.64:0/1118099959 learned_addr learned my addr 172.21.15.64:0/1118099959 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:24.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.814+0000 7f5ec2466700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ebc0fbb40 0x7f5ebc1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5ec1c65700 1 -- 172.21.15.64:0/1118099959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ebc0fbb40 msgr2=0x7f5ebc1136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5ec1c65700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ebc0fbb40 0x7f5ebc1136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5ec1c65700 1 -- 172.21.15.64:0/1118099959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8005040 con 0x7f5ebc101b00 2023-12-16T03:21:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5ec2466700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ebc0fbb40 0x7f5ebc1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:21:24.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5ec1c65700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 0x7f5ebc113be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5eac002a50 tx=0x7f5eac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5eb2ffd700 1 -- 172.21.15.64:0/1118099959 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eac007cc0 con 0x7f5ebc101b00 2023-12-16T03:21:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc10d800 con 0x7f5ebc101b00 2023-12-16T03:21:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5eb2ffd700 1 -- 172.21.15.64:0/1118099959 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5eac00f040 con 0x7f5ebc101b00 2023-12-16T03:21:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5eb2ffd700 1 -- 172.21.15.64:0/1118099959 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eac00d9c0 con 0x7f5ebc101b00 2023-12-16T03:21:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.815+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc10dd40 con 0x7f5ebc101b00 2023-12-16T03:21:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.817+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc113330 con 0x7f5ebc101b00 2023-12-16T03:21:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.817+0000 7f5eb2ffd700 1 -- 172.21.15.64:0/1118099959 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5eac009070 con 0x7f5ebc101b00 2023-12-16T03:21:24.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.817+0000 7f5eb2ffd700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5ea806ce60 0x7f5ea806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:24.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.818+0000 7f5eb2ffd700 1 -- 172.21.15.64:0/1118099959 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5eac08bfe0 con 0x7f5ebc101b00 2023-12-16T03:21:24.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.818+0000 7f5ec2466700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5ea806ce60 0x7f5ea806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:24.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.818+0000 7f5ec2466700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5ea806ce60 0x7f5ea806f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8004f90 tx=0x7f5eb8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:24.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:24.823+0000 7f5eb2ffd700 1 -- 172.21.15.64:0/1118099959 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f5eac0599a0 con 0x7f5ebc101b00 2023-12-16T03:21:25.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.068+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ebc10ec40 con 0x7f5ea806ce60 2023-12-16T03:21:25.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.070+0000 7f5eb2ffd700 1 -- 172.21.15.64:0/1118099959 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5ebc10ec40 con 0x7f5ea806ce60 2023-12-16T03:21:25.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5ea806ce60 msgr2=0x7f5ea806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5ea806ce60 0x7f5ea806f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8004f90 tx=0x7f5eb8009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:25.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 msgr2=0x7f5ebc113be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 0x7f5ebc113be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5eac002a50 tx=0x7f5eac0046b0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 shutdown_connections 2023-12-16T03:21:25.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5ea806ce60 0x7f5ea806f310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ebc0fbb40 0x7f5ebc1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 --2- 172.21.15.64:0/1118099959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ebc101b00 0x7f5ebc113be0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 >> 172.21.15.64:0/1118099959 conn(0x7f5ebc0719b0 msgr2=0x7f5ebc0654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:25.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 shutdown_connections 2023-12-16T03:21:25.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.072+0000 7f5ec46ca700 1 -- 172.21.15.64:0/1118099959 wait complete. 2023-12-16T03:21:25.086 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:21:25.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.178+0000 7fc3548e9700 1 -- 172.21.15.64:0/596044717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc350101b00 msgr2=0x7fc350101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.178+0000 7fc3548e9700 1 --2- 172.21.15.64:0/596044717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc350101b00 0x7fc350101ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc340004940 tx=0x7fc340009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:25.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.178+0000 7fc3548e9700 1 -- 172.21.15.64:0/596044717 shutdown_connections 2023-12-16T03:21:25.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.178+0000 7fc3548e9700 1 --2- 172.21.15.64:0/596044717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3500fbb40 0x7fc3500fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.178+0000 7fc3548e9700 1 --2- 172.21.15.64:0/596044717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc350101b00 0x7fc350101ed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.178+0000 7fc3548e9700 1 -- 172.21.15.64:0/596044717 >> 172.21.15.64:0/596044717 conn(0x7fc3500719b0 msgr2=0x7fc350071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:25.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc3548e9700 1 -- 172.21.15.64:0/596044717 shutdown_connections 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc3548e9700 1 -- 172.21.15.64:0/596044717 wait complete. 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc3548e9700 1 Processor -- start 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc3548e9700 1 -- start start 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc3548e9700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3500fbb40 0x7fc3500fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc3548e9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc350101b00 0x7fc3500fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc3548e9700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3500fe2d0 con 0x7fc3500fbb40 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc3548e9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3500fe440 con 0x7fc350101b00 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc34e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3500fbb40 0x7fc3500fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc34e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3500fbb40 0x7fc3500fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40640/0 (socket says 172.21.15.64:40640) 2023-12-16T03:21:25.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.179+0000 7fc34e59c700 1 -- 172.21.15.64:0/4075495480 learned_addr learned my addr 172.21.15.64:0/4075495480 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc34dd9b700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc350101b00 0x7fc3500fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc34e59c700 1 -- 172.21.15.64:0/4075495480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc350101b00 msgr2=0x7fc3500fdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc34e59c700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc350101b00 0x7fc3500fdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc34e59c700 1 -- 172.21.15.64:0/4075495480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340005040 con 0x7fc3500fbb40 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc34e59c700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3500fbb40 0x7fc3500fd720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc34000b3b0 tx=0x7fc340009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc33effd700 1 -- 172.21.15.64:0/4075495480 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34000e040 con 0x7fc3500fbb40 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc33effd700 1 -- 172.21.15.64:0/4075495480 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc34000bc50 con 0x7fc3500fbb40 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3501198c0 con 0x7fc3500fbb40 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc33effd700 1 -- 172.21.15.64:0/4075495480 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc340013420 con 0x7fc3500fbb40 2023-12-16T03:21:25.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.180+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc350119da0 con 0x7fc3500fbb40 2023-12-16T03:21:25.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.181+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3500734d0 con 0x7fc3500fbb40 2023-12-16T03:21:25.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.182+0000 7fc33effd700 1 -- 172.21.15.64:0/4075495480 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc34001c430 con 0x7fc3500fbb40 2023-12-16T03:21:25.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.182+0000 7fc33effd700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc33806ce60 0x7fc33806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:25.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.182+0000 7fc33effd700 1 -- 172.21.15.64:0/4075495480 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc34008cfd0 con 0x7fc3500fbb40 2023-12-16T03:21:25.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.182+0000 7fc34dd9b700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc33806ce60 0x7fc33806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:25.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.183+0000 7fc34dd9b700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc33806ce60 0x7fc33806f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc344007fd0 tx=0x7fc344009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:25.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.187+0000 7fc33effd700 1 -- 172.21.15.64:0/4075495480 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc340057030 con 0x7fc3500fbb40 2023-12-16T03:21:25.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.419+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3500fef70 con 0x7fc33806ce60 2023-12-16T03:21:25.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.420+0000 7fc33effd700 1 -- 172.21.15.64:0/4075495480 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc3500fef70 con 0x7fc33806ce60 2023-12-16T03:21:25.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc33806ce60 msgr2=0x7fc33806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc33806ce60 0x7fc33806f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc344007fd0 tx=0x7fc344009040 comp rx=0 tx=0).stop 2023-12-16T03:21:25.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3500fbb40 msgr2=0x7fc3500fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3500fbb40 0x7fc3500fd720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc34000b3b0 tx=0x7fc340009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:25.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 shutdown_connections 2023-12-16T03:21:25.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc33806ce60 0x7fc33806f310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3500fbb40 0x7fc3500fd720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 --2- 172.21.15.64:0/4075495480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc350101b00 0x7fc3500fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 >> 172.21.15.64:0/4075495480 conn(0x7fc3500719b0 msgr2=0x7fc350065410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:25.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 shutdown_connections 2023-12-16T03:21:25.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.422+0000 7fc3548e9700 1 -- 172.21.15.64:0/4075495480 wait complete. 2023-12-16T03:21:25.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.543+0000 7f45349e3700 1 -- 172.21.15.64:0/140768039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530102c20 msgr2=0x7f4530102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.543+0000 7f45349e3700 1 --2- 172.21.15.64:0/140768039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530102c20 0x7f4530102ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4520004940 tx=0x7f4520009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:25.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.543+0000 7f45349e3700 1 -- 172.21.15.64:0/140768039 shutdown_connections 2023-12-16T03:21:25.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.543+0000 7f45349e3700 1 --2- 172.21.15.64:0/140768039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4530065390 0x7f4530065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.543+0000 7f45349e3700 1 --2- 172.21.15.64:0/140768039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530102c20 0x7f4530102ff0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.543+0000 7f45349e3700 1 -- 172.21.15.64:0/140768039 >> 172.21.15.64:0/140768039 conn(0x7f45300719b0 msgr2=0x7f4530071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:25.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.543+0000 7f45349e3700 1 -- 172.21.15.64:0/140768039 shutdown_connections 2023-12-16T03:21:25.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.543+0000 7f45349e3700 1 -- 172.21.15.64:0/140768039 wait complete. 2023-12-16T03:21:25.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.544+0000 7f45349e3700 1 Processor -- start 2023-12-16T03:21:25.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.544+0000 7f45349e3700 1 -- start start 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.544+0000 7f45349e3700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530065390 0x7f45301158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.544+0000 7f45349e3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4530102c20 0x7f4530115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.544+0000 7f45349e3700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4530116440 con 0x7f4530065390 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.544+0000 7f45349e3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453010f770 con 0x7f4530102c20 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.544+0000 7f452e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530065390 0x7f45301158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.544+0000 7f452e59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530065390 0x7f45301158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40656/0 (socket says 172.21.15.64:40656) 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f452e59c700 1 -- 172.21.15.64:0/1654648725 learned_addr learned my addr 172.21.15.64:0/1654648725 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f452dd9b700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4530102c20 0x7f4530115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f452e59c700 1 -- 172.21.15.64:0/1654648725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4530102c20 msgr2=0x7f4530115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f452e59c700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4530102c20 0x7f4530115df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f452e59c700 1 -- 172.21.15.64:0/1654648725 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520005040 con 0x7f4530065390 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f452e59c700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530065390 0x7f45301158b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f452000b3b0 tx=0x7f4520009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f451effd700 1 -- 172.21.15.64:0/1654648725 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f452000e040 con 0x7f4530065390 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f45349e3700 1 -- 172.21.15.64:0/1654648725 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453010f9f0 con 0x7f4530065390 2023-12-16T03:21:25.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f45349e3700 1 -- 172.21.15.64:0/1654648725 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453010ff30 con 0x7f4530065390 2023-12-16T03:21:25.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f451effd700 1 -- 172.21.15.64:0/1654648725 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f452000bc50 con 0x7f4530065390 2023-12-16T03:21:25.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.545+0000 7f451effd700 1 -- 172.21.15.64:0/1654648725 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4520013420 con 0x7f4530065390 2023-12-16T03:21:25.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.546+0000 7f451cff9700 1 -- 172.21.15.64:0/1654648725 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45140052b0 con 0x7f4530065390 2023-12-16T03:21:25.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.547+0000 7f451effd700 1 -- 172.21.15.64:0/1654648725 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f452001c430 con 0x7f4530065390 2023-12-16T03:21:25.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.547+0000 7f451effd700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f451806ce60 0x7f451806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:25.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.547+0000 7f451effd700 1 -- 172.21.15.64:0/1654648725 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f452008d040 con 0x7f4530065390 2023-12-16T03:21:25.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.547+0000 7f452dd9b700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f451806ce60 0x7f451806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:25.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.548+0000 7f452dd9b700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f451806ce60 0x7f451806f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45301110e0 tx=0x7f4524009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:25.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.552+0000 7f451effd700 1 -- 172.21.15.64:0/1654648725 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f452005aa90 con 0x7f4530065390 2023-12-16T03:21:25.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:25 smithi064 ceph-mon[216854]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:25.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.778+0000 7f451cff9700 1 -- 172.21.15.64:0/1654648725 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4514000bc0 con 0x7f451806ce60 2023-12-16T03:21:25.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.791+0000 7f451effd700 1 -- 172.21.15.64:0/1654648725 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4514000bc0 con 0x7f451806ce60 2023-12-16T03:21:25.793 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:21:25.793 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (3m) 28s ago 11m 29.4M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:21:25.793 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (81s) 28s ago 11m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f a416f0797862 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (77s) 75s ago 10m 7440k - 19.0.0-191-g6d933094 a29c258b5d6f 4d5da6df7dee 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (3m) 28s ago 11m 85.2M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (7m) 28s ago 7m 15.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (7m) 28s ago 7m 6645M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (7m) 75s ago 7m 4651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (7m) 75s ago 7m 16.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (4m) 28s ago 12m 510M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (4m) 75s ago 10m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (2m) 28s ago 12m 60.5M 2048M 19.0.0-191-g6d933094 a29c258b5d6f fcfcecd16324 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (108s) 75s ago 10m 38.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 1523b5eb5b04 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (3m) 28s ago 11m 18.3M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (3m) 75s ago 10m 19.5M - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (62s) 28s ago 10m 114M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ff051ca1c9ba 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (32s) 28s ago 9m 12.6M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 16e84d481761 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 starting - - - 1568M 2023-12-16T03:21:25.794 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (9m) 75s ago 9m 971M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d00418d50a6e 2023-12-16T03:21:25.795 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (8m) 75s ago 8m 772M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:21:25.795 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (8m) 75s ago 8m 853M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:21:25.795 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (3m) 28s ago 11m 60.5M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:21:25.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 -- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f451806ce60 msgr2=0x7f451806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f451806ce60 0x7f451806f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45301110e0 tx=0x7f4524009040 comp rx=0 tx=0).stop 2023-12-16T03:21:25.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 -- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530065390 msgr2=0x7f45301158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530065390 0x7f45301158b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f452000b3b0 tx=0x7f4520009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:25.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 -- 172.21.15.64:0/1654648725 shutdown_connections 2023-12-16T03:21:25.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f451806ce60 0x7f451806f310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4530065390 0x7f45301158b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 --2- 172.21.15.64:0/1654648725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4530102c20 0x7f4530115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 -- 172.21.15.64:0/1654648725 >> 172.21.15.64:0/1654648725 conn(0x7f45300719b0 msgr2=0x7f45300fac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:25.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 -- 172.21.15.64:0/1654648725 shutdown_connections 2023-12-16T03:21:25.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.793+0000 7f451cff9700 1 -- 172.21.15.64:0/1654648725 wait complete. 2023-12-16T03:21:25.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:25 smithi184 ceph-mon[184130]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:25.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.900+0000 7fd2ceaed700 1 -- 172.21.15.64:0/3079602622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c8101b00 msgr2=0x7fd2c8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.900+0000 7fd2ceaed700 1 --2- 172.21.15.64:0/3079602622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c8101b00 0x7fd2c8101ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc004940 tx=0x7fd2bc009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:25.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.900+0000 7fd2ceaed700 1 -- 172.21.15.64:0/3079602622 shutdown_connections 2023-12-16T03:21:25.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.901+0000 7fd2ceaed700 1 --2- 172.21.15.64:0/3079602622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2c80fbb40 0x7fd2c80fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.901+0000 7fd2ceaed700 1 --2- 172.21.15.64:0/3079602622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c8101b00 0x7fd2c8101ed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.901+0000 7fd2ceaed700 1 -- 172.21.15.64:0/3079602622 >> 172.21.15.64:0/3079602622 conn(0x7fd2c80719b0 msgr2=0x7fd2c8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:25.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.901+0000 7fd2ceaed700 1 -- 172.21.15.64:0/3079602622 shutdown_connections 2023-12-16T03:21:25.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.901+0000 7fd2ceaed700 1 -- 172.21.15.64:0/3079602622 wait complete. 2023-12-16T03:21:25.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.901+0000 7fd2ceaed700 1 Processor -- start 2023-12-16T03:21:25.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.901+0000 7fd2ceaed700 1 -- start start 2023-12-16T03:21:25.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2ceaed700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c80fbb40 0x7fd2c810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:25.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2ceaed700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2c8101b00 0x7fd2c810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:25.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2ceaed700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c810f1c0 con 0x7fd2c80fbb40 2023-12-16T03:21:25.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2ceaed700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c810f300 con 0x7fd2c8101b00 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2cc889700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c80fbb40 0x7fd2c810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2cc889700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c80fbb40 0x7fd2c810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40676/0 (socket says 172.21.15.64:40676) 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2cc889700 1 -- 172.21.15.64:0/776777602 learned_addr learned my addr 172.21.15.64:0/776777602 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2c7fff700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2c8101b00 0x7fd2c810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2cc889700 1 -- 172.21.15.64:0/776777602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2c8101b00 msgr2=0x7fd2c810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2cc889700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2c8101b00 0x7fd2c810ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2cc889700 1 -- 172.21.15.64:0/776777602 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc005040 con 0x7fd2c80fbb40 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2cc889700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c80fbb40 0x7fd2c810e6f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00b3b0 tx=0x7fd2bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2c57fa700 1 -- 172.21.15.64:0/776777602 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2bc00e040 con 0x7fd2c80fbb40 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c8117600 con 0x7fd2c80fbb40 2023-12-16T03:21:25.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2c57fa700 1 -- 172.21.15.64:0/776777602 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2bc00bc50 con 0x7fd2c80fbb40 2023-12-16T03:21:25.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2c57fa700 1 -- 172.21.15.64:0/776777602 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2bc013420 con 0x7fd2c80fbb40 2023-12-16T03:21:25.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.902+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c8117b10 con 0x7fd2c80fbb40 2023-12-16T03:21:25.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.904+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c8103fb0 con 0x7fd2c80fbb40 2023-12-16T03:21:25.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.904+0000 7fd2c57fa700 1 -- 172.21.15.64:0/776777602 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fd2bc01c430 con 0x7fd2c80fbb40 2023-12-16T03:21:25.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.904+0000 7fd2c57fa700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd2b806ce60 0x7fd2b806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:25.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.905+0000 7fd2c57fa700 1 -- 172.21.15.64:0/776777602 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd2bc08d020 con 0x7fd2c80fbb40 2023-12-16T03:21:25.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.905+0000 7fd2c7fff700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd2b806ce60 0x7fd2b806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:25.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.905+0000 7fd2c7fff700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd2b806ce60 0x7fd2b806f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8065e30 tx=0x7fd2b4009ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:25.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:25.909+0000 7fd2c57fa700 1 -- 172.21.15.64:0/776777602 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fd2bc057080 con 0x7fd2c80fbb40 2023-12-16T03:21:26.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.206+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd2c8065b70 con 0x7fd2c80fbb40 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.207+0000 7fd2c57fa700 1 -- 172.21.15.64:0/776777602 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7fd2bc05a6a0 con 0x7fd2c80fbb40 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 3, 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:21:26.210 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:21:26.211 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:21:26.211 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:21:26.211 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:21:26.211 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 7, 2023-12-16T03:21:26.211 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 6 2023-12-16T03:21:26.211 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:21:26.211 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd2b806ce60 msgr2=0x7fd2b806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd2b806ce60 0x7fd2b806f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8065e30 tx=0x7fd2b4009ee0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c80fbb40 msgr2=0x7fd2c810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c80fbb40 0x7fd2c810e6f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00b3b0 tx=0x7fd2bc009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 shutdown_connections 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd2b806ce60 0x7fd2b806f310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2c80fbb40 0x7fd2c810e6f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 --2- 172.21.15.64:0/776777602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2c8101b00 0x7fd2c810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 >> 172.21.15.64:0/776777602 conn(0x7fd2c80719b0 msgr2=0x7fd2c80fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:26.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 shutdown_connections 2023-12-16T03:21:26.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.209+0000 7fd2ceaed700 1 -- 172.21.15.64:0/776777602 wait complete. 2023-12-16T03:21:26.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.337+0000 7fc89adb4700 1 -- 172.21.15.64:0/4167119341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 msgr2=0x7fc894101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.337+0000 7fc89adb4700 1 --2- 172.21.15.64:0/4167119341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 0x7fc894101ec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc888004940 tx=0x7fc888009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.337+0000 7fc89adb4700 1 -- 172.21.15.64:0/4167119341 shutdown_connections 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.337+0000 7fc89adb4700 1 --2- 172.21.15.64:0/4167119341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8940fbb30 0x7fc8940fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.337+0000 7fc89adb4700 1 --2- 172.21.15.64:0/4167119341 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 0x7fc894101ec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.337+0000 7fc89adb4700 1 -- 172.21.15.64:0/4167119341 >> 172.21.15.64:0/4167119341 conn(0x7fc8940f7690 msgr2=0x7fc8940f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.337+0000 7fc89adb4700 1 -- 172.21.15.64:0/4167119341 shutdown_connections 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.337+0000 7fc89adb4700 1 -- 172.21.15.64:0/4167119341 wait complete. 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.338+0000 7fc89adb4700 1 Processor -- start 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.338+0000 7fc89adb4700 1 -- start start 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.338+0000 7fc89adb4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8940fbb30 0x7fc89410e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:26.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.338+0000 7fc89adb4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 0x7fc89410ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.338+0000 7fc89adb4700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89410f150 con 0x7fc894101af0 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.338+0000 7fc89adb4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89410f290 con 0x7fc8940fbb30 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc893fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 0x7fc89410ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc893fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 0x7fc89410ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40692/0 (socket says 172.21.15.64:40692) 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc893fff700 1 -- 172.21.15.64:0/556280408 learned_addr learned my addr 172.21.15.64:0/556280408 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc898b50700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8940fbb30 0x7fc89410e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc893fff700 1 -- 172.21.15.64:0/556280408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8940fbb30 msgr2=0x7fc89410e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc893fff700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8940fbb30 0x7fc89410e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc893fff700 1 -- 172.21.15.64:0/556280408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888005040 con 0x7fc894101af0 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc898b50700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8940fbb30 0x7fc89410e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc893fff700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 0x7fc89410ebc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc880002a80 tx=0x7fc8800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc8917fa700 1 -- 172.21.15.64:0/556280408 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc880007cc0 con 0x7fc894101af0 2023-12-16T03:21:26.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8941175f0 con 0x7fc894101af0 2023-12-16T03:21:26.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc8917fa700 1 -- 172.21.15.64:0/556280408 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc88000f040 con 0x7fc894101af0 2023-12-16T03:21:26.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc8917fa700 1 -- 172.21.15.64:0/556280408 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc880009640 con 0x7fc894101af0 2023-12-16T03:21:26.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.339+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc894117b00 con 0x7fc894101af0 2023-12-16T03:21:26.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.341+0000 7fc8917fa700 1 -- 172.21.15.64:0/556280408 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc8800097a0 con 0x7fc894101af0 2023-12-16T03:21:26.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.341+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc894103fd0 con 0x7fc894101af0 2023-12-16T03:21:26.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.342+0000 7fc8917fa700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc88406ce60 0x7fc88406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:26.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.342+0000 7fc8917fa700 1 -- 172.21.15.64:0/556280408 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc88008bab0 con 0x7fc894101af0 2023-12-16T03:21:26.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.342+0000 7fc898b50700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc88406ce60 0x7fc88406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:26.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.342+0000 7fc898b50700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc88406ce60 0x7fc88406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc888004f90 tx=0x7fc888009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:26.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.347+0000 7fc8917fa700 1 -- 172.21.15.64:0/556280408 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc880055a50 con 0x7fc894101af0 2023-12-16T03:21:26.657 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.654+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc894064800 con 0x7fc894101af0 2023-12-16T03:21:26.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.655+0000 7fc8917fa700 1 -- 172.21.15.64:0/556280408 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1854 (secure 0 0 0) 0x7fc880059070 con 0x7fc894101af0 2023-12-16T03:21:26.658 INFO:teuthology.orchestra.run.smithi064.stdout:e17 2023-12-16T03:21:26.658 INFO:teuthology.orchestra.run.smithi064.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:21:26.658 INFO:teuthology.orchestra.run.smithi064.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:21:26.658 INFO:teuthology.orchestra.run.smithi064.stdout:legacy client fscid: 1 2023-12-16T03:21:26.658 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:21:26.658 INFO:teuthology.orchestra.run.smithi064.stdout:Filesystem 'cephfs' (1) 2023-12-16T03:21:26.658 INFO:teuthology.orchestra.run.smithi064.stdout:fs_name cephfs 2023-12-16T03:21:26.658 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 17 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:modified 2023-12-16T03:20:28.477911+0000 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:tableserver 0 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:root 0 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:session_timeout 60 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:session_autoclose 300 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:max_file_size 1099511627776 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:max_xattr_size 65536 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:required_client_features {} 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure 0 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure_osd_epoch 0 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:21:26.659 INFO:teuthology.orchestra.run.smithi064.stdout:max_mds 2 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:in 0,1 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:up {0=14460,1=24269} 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:failed 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:damaged 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:stopped 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:data_pools [3] 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:metadata_pool 2 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:inline_data enabled 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:balancer 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:bal_rank_mask -1 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:standby_count_wanted 1 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:21:26.660 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:21:26.661 INFO:teuthology.orchestra.run.smithi064.stdout:Standby daemons: 2023-12-16T03:21:26.661 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:21:26.661 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:21:26.661 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:21:26.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.657+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc88406ce60 msgr2=0x7fc88406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.657+0000 7fc89adb4700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc88406ce60 0x7fc88406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc888004f90 tx=0x7fc888009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.657+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 msgr2=0x7fc89410ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.657+0000 7fc89adb4700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 0x7fc89410ebc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc880002a80 tx=0x7fc8800046b0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.657+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 shutdown_connections 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.657+0000 7fc89adb4700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc88406ce60 0x7fc88406f310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.657+0000 7fc89adb4700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8940fbb30 0x7fc89410e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.657+0000 7fc89adb4700 1 --2- 172.21.15.64:0/556280408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc894101af0 0x7fc89410ebc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.657+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 >> 172.21.15.64:0/556280408 conn(0x7fc8940f7690 msgr2=0x7fc8940f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.658+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 shutdown_connections 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.658+0000 7fc89adb4700 1 -- 172.21.15.64:0/556280408 wait complete. 2023-12-16T03:21:26.662 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 17 2023-12-16T03:21:26.721 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:26 smithi064 ceph-mon[216854]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:26.721 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:26 smithi064 ceph-mon[216854]: pgmap v75: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/366 objects degraded (12.022%) 2023-12-16T03:21:26.721 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:26.722 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:21:26.722 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:26 smithi064 ceph-mon[216854]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:26.722 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:26 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/776777602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.778+0000 7f0bebe60700 1 -- 172.21.15.64:0/385897620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be4102c00 msgr2=0x7f0be4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.778+0000 7f0bebe60700 1 --2- 172.21.15.64:0/385897620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be4102c00 0x7f0be4102fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0be0004940 tx=0x7f0be0009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.779+0000 7f0bebe60700 1 -- 172.21.15.64:0/385897620 shutdown_connections 2023-12-16T03:21:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.779+0000 7f0bebe60700 1 --2- 172.21.15.64:0/385897620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be41035a0 0x7f0be40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.779+0000 7f0bebe60700 1 --2- 172.21.15.64:0/385897620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be4102c00 0x7f0be4102fd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.779+0000 7f0bebe60700 1 -- 172.21.15.64:0/385897620 >> 172.21.15.64:0/385897620 conn(0x7f0be40f8790 msgr2=0x7f0be40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.779+0000 7f0bebe60700 1 -- 172.21.15.64:0/385897620 shutdown_connections 2023-12-16T03:21:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.779+0000 7f0bebe60700 1 -- 172.21.15.64:0/385897620 wait complete. 2023-12-16T03:21:26.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.779+0000 7f0bebe60700 1 Processor -- start 2023-12-16T03:21:26.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0bebe60700 1 -- start start 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0bebe60700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4102c00 0x7f0be4113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0bebe60700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be41035a0 0x7f0be4113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0bebe60700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41141e0 con 0x7f0be41035a0 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0bebe60700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be410d4d0 con 0x7f0be4102c00 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0be93fb700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be41035a0 0x7f0be4113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0be93fb700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be41035a0 0x7f0be4113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40706/0 (socket says 172.21.15.64:40706) 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0be93fb700 1 -- 172.21.15.64:0/4210709846 learned_addr learned my addr 172.21.15.64:0/4210709846 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0be9bfc700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4102c00 0x7f0be4113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0be93fb700 1 -- 172.21.15.64:0/4210709846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4102c00 msgr2=0x7f0be4113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0be93fb700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4102c00 0x7f0be4113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0be93fb700 1 -- 172.21.15.64:0/4210709846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0005040 con 0x7f0be41035a0 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.780+0000 7f0be9bfc700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4102c00 0x7f0be4113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.781+0000 7f0be93fb700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be41035a0 0x7f0be4113b90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4002a50 tx=0x7f0bd4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:26.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.781+0000 7f0bda7fc700 1 -- 172.21.15.64:0/4210709846 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bd4007cc0 con 0x7f0be41035a0 2023-12-16T03:21:26.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.781+0000 7f0bda7fc700 1 -- 172.21.15.64:0/4210709846 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0bd400f040 con 0x7f0be41035a0 2023-12-16T03:21:26.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.781+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be410d760 con 0x7f0be41035a0 2023-12-16T03:21:26.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.781+0000 7f0bda7fc700 1 -- 172.21.15.64:0/4210709846 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bd400d9a0 con 0x7f0be41035a0 2023-12-16T03:21:26.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.781+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be410dca0 con 0x7f0be41035a0 2023-12-16T03:21:26.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.782+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc80052e0 con 0x7f0be41035a0 2023-12-16T03:21:26.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.783+0000 7f0bda7fc700 1 -- 172.21.15.64:0/4210709846 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0bd400dc10 con 0x7f0be41035a0 2023-12-16T03:21:26.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.783+0000 7f0bda7fc700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0bd006ce60 0x7f0bd006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:26.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.783+0000 7f0bda7fc700 1 -- 172.21.15.64:0/4210709846 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0bd408bf60 con 0x7f0be41035a0 2023-12-16T03:21:26.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.783+0000 7f0be9bfc700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0bd006ce60 0x7f0bd006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:26.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.784+0000 7f0be9bfc700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0bd006ce60 0x7f0bd006f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0be0004f90 tx=0x7f0be0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:26.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:26.788+0000 7f0bda7fc700 1 -- 172.21.15.64:0/4210709846 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0bd40bf300 con 0x7f0be41035a0 2023-12-16T03:21:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:26 smithi184 ceph-mon[184130]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:26.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:26 smithi184 ceph-mon[184130]: pgmap v75: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/366 objects degraded (12.022%) 2023-12-16T03:21:26.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:26 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:26.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:26 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:21:26.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:26 smithi184 ceph-mon[184130]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:26.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:26 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/776777602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:27.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.043+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bc8000bf0 con 0x7f0bd006ce60 2023-12-16T03:21:27.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.045+0000 7f0bda7fc700 1 -- 172.21.15.64:0/4210709846 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0bc8000bf0 con 0x7f0bd006ce60 2023-12-16T03:21:27.047 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:21:27.047 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: "crash", 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: "mon", 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "9/21 daemons upgraded", 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:21:27.048 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:21:27.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0bd006ce60 msgr2=0x7f0bd006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0bd006ce60 0x7f0bd006f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0be0004f90 tx=0x7f0be0009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be41035a0 msgr2=0x7f0be4113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be41035a0 0x7f0be4113b90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4002a50 tx=0x7f0bd4004600 comp rx=0 tx=0).stop 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 shutdown_connections 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0bd006ce60 0x7f0bd006f310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4102c00 0x7f0be4113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 --2- 172.21.15.64:0/4210709846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0be41035a0 0x7f0be4113b90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 >> 172.21.15.64:0/4210709846 conn(0x7f0be40f8790 msgr2=0x7f0be40fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 shutdown_connections 2023-12-16T03:21:27.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.047+0000 7f0bebe60700 1 -- 172.21.15.64:0/4210709846 wait complete. 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.154+0000 7fef68338700 1 -- 172.21.15.64:0/307985623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60102c20 msgr2=0x7fef60102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.154+0000 7fef68338700 1 --2- 172.21.15.64:0/307985623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60102c20 0x7fef60102ff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fef5c004940 tx=0x7fef5c009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 -- 172.21.15.64:0/307985623 shutdown_connections 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 --2- 172.21.15.64:0/307985623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef60065390 0x7fef60065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 --2- 172.21.15.64:0/307985623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60102c20 0x7fef60102ff0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 -- 172.21.15.64:0/307985623 >> 172.21.15.64:0/307985623 conn(0x7fef600719b0 msgr2=0x7fef60071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 -- 172.21.15.64:0/307985623 shutdown_connections 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 -- 172.21.15.64:0/307985623 wait complete. 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 Processor -- start 2023-12-16T03:21:27.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 -- start start 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60065390 0x7fef600fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef60102c20 0x7fef600fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600fc730 con 0x7fef60065390 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.155+0000 7fef68338700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600fc8a0 con 0x7fef60102c20 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef660d4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60065390 0x7fef600fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef660d4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60065390 0x7fef600fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40718/0 (socket says 172.21.15.64:40718) 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef660d4700 1 -- 172.21.15.64:0/2309583977 learned_addr learned my addr 172.21.15.64:0/2309583977 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef658d3700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef60102c20 0x7fef600fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef660d4700 1 -- 172.21.15.64:0/2309583977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef60102c20 msgr2=0x7fef600fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef660d4700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef60102c20 0x7fef600fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:27.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef660d4700 1 -- 172.21.15.64:0/2309583977 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c005040 con 0x7fef60065390 2023-12-16T03:21:27.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef660d4700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60065390 0x7fef600fbbf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0040d0 tx=0x7fef5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:27.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef56ffd700 1 -- 172.21.15.64:0/2309583977 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef5c021070 con 0x7fef60065390 2023-12-16T03:21:27.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef56ffd700 1 -- 172.21.15.64:0/2309583977 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef5c0093b0 con 0x7fef60065390 2023-12-16T03:21:27.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef60119870 con 0x7fef60065390 2023-12-16T03:21:27.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef56ffd700 1 -- 172.21.15.64:0/2309583977 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef5c00e070 con 0x7fef60065390 2023-12-16T03:21:27.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.156+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef60119c70 con 0x7fef60065390 2023-12-16T03:21:27.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.157+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef600fff40 con 0x7fef60065390 2023-12-16T03:21:27.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.158+0000 7fef56ffd700 1 -- 172.21.15.64:0/2309583977 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fef5c01c5e0 con 0x7fef60065390 2023-12-16T03:21:27.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.158+0000 7fef56ffd700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4c06ce70 0x7fef4c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:27.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.159+0000 7fef56ffd700 1 -- 172.21.15.64:0/2309583977 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fef5c08d2d0 con 0x7fef60065390 2023-12-16T03:21:27.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.159+0000 7fef658d3700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4c06ce70 0x7fef4c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:27.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.159+0000 7fef658d3700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4c06ce70 0x7fef4c06f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef600fd5f0 tx=0x7fef5000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:27.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.163+0000 7fef56ffd700 1 -- 172.21.15.64:0/2309583977 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fef5c057320 con 0x7fef60065390 2023-12-16T03:21:27.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.463+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fef600fd330 con 0x7fef60065390 2023-12-16T03:21:27.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.463+0000 7fef56ffd700 1 -- 172.21.15.64:0/2309583977 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1186 (secure 0 0 0) 0x7fef5c05a940 con 0x7fef60065390 2023-12-16T03:21:27.466 INFO:teuthology.orchestra.run.smithi064.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 44/366 objects degraded (12.022%), 13 pgs degraded 2023-12-16T03:21:27.466 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:21:27.466 INFO:teuthology.orchestra.run.smithi064.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: osd.2 (root=default,host=smithi064) is down 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 44/366 objects degraded (12.022%), 13 pgs degraded 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2023-12-16T03:21:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2023-12-16T03:21:27.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.465+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4c06ce70 msgr2=0x7fef4c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:27.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.465+0000 7fef68338700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4c06ce70 0x7fef4c06f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef600fd5f0 tx=0x7fef5000b040 comp rx=0 tx=0).stop 2023-12-16T03:21:27.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.465+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60065390 msgr2=0x7fef600fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:27.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.465+0000 7fef68338700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60065390 0x7fef600fbbf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0040d0 tx=0x7fef5c009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:27.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.466+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 shutdown_connections 2023-12-16T03:21:27.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.466+0000 7fef68338700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4c06ce70 0x7fef4c06f320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:27.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.466+0000 7fef68338700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef60065390 0x7fef600fbbf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:27.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.466+0000 7fef68338700 1 --2- 172.21.15.64:0/2309583977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef60102c20 0x7fef600fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:27.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.466+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 >> 172.21.15.64:0/2309583977 conn(0x7fef600719b0 msgr2=0x7fef600fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:27.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.466+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 shutdown_connections 2023-12-16T03:21:27.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:27.466+0000 7fef68338700 1 -- 172.21.15.64:0/2309583977 wait complete. 2023-12-16T03:21:27.780 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:27 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/556280408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:21:27.781 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:27 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:27.781 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:27 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:27.781 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:27 smithi064 ceph-mon[216854]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:27 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/556280408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:21:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:27 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:27.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:27 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:27.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:27 smithi184 ceph-mon[184130]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:28.192 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:27 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[246767]: 2023-12-16T03:21:27.776+0000 7faa9e6ad640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-16T03:21:28.513 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:28 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[246767]: 2023-12-16T03:21:28.255+0000 7faa9e6ad640 -1 osd.2 56 log_to_monitors true 2023-12-16T03:21:28.513 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:28 smithi064 ceph-mon[216854]: pgmap v76: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/366 objects degraded (12.022%) 2023-12-16T03:21:28.513 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:28 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/2309583977' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:21:28.513 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:28 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 44/366 objects degraded (12.022%), 13 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:28.513 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:28.513 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:28.513 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:28 smithi064 ceph-mon[216854]: from='osd.2 [v2:172.21.15.64:6818/4197214596,v1:172.21.15.64:6819/4197214596]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T03:21:28.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:28 smithi184 ceph-mon[184130]: pgmap v76: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 314 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/366 objects degraded (12.022%) 2023-12-16T03:21:28.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:28 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/2309583977' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:21:28.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:28 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 44/366 objects degraded (12.022%), 13 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:28.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:28.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:28.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:28 smithi184 ceph-mon[184130]: from='osd.2 [v2:172.21.15.64:6818/4197214596,v1:172.21.15.64:6819/4197214596]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T03:21:29.193 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:21:28 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[246767]: 2023-12-16T03:21:28.982+0000 7faa8db1a700 -1 osd.2 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:21:30.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:29 smithi184 ceph-mon[184130]: from='osd.2 [v2:172.21.15.64:6818/4197214596,v1:172.21.15.64:6819/4197214596]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T03:21:30.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:29 smithi184 ceph-mon[184130]: osdmap e59: 6 total, 5 up, 6 in 2023-12-16T03:21:30.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:29 smithi184 ceph-mon[184130]: from='osd.2 [v2:172.21.15.64:6818/4197214596,v1:172.21.15.64:6819/4197214596]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:21:30.320 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:29 smithi064 ceph-mon[216854]: from='osd.2 [v2:172.21.15.64:6818/4197214596,v1:172.21.15.64:6819/4197214596]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T03:21:30.320 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:29 smithi064 ceph-mon[216854]: osdmap e59: 6 total, 5 up, 6 in 2023-12-16T03:21:30.320 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:29 smithi064 ceph-mon[216854]: from='osd.2 [v2:172.21.15.64:6818/4197214596,v1:172.21.15.64:6819/4197214596]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: pgmap v78: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 44/366 objects degraded (12.022%) 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: osd.2 [v2:172.21.15.64:6818/4197214596,v1:172.21.15.64:6819/4197214596] boot 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: osdmap e60: 6 total, 6 up, 6 in 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: failed to encode map e59 with expected crc 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: failed to encode map e59 with expected crc 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: failed to encode map e59 with expected crc 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:21:31.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:21:31.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:31.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:21:31.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:31.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:31.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:31.312 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T03:21:31.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: pgmap v78: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 44/366 objects degraded (12.022%) 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: osd.2 [v2:172.21.15.64:6818/4197214596,v1:172.21.15.64:6819/4197214596] boot 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: osdmap e60: 6 total, 6 up, 6 in 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: failed to encode map e59 with expected crc 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: failed to encode map e59 with expected crc 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: failed to encode map e59 with expected crc 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:31.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:31.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:31.444 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T03:21:32.296 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:31 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T03:21:32.296 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:31 smithi064 ceph-mon[216854]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T03:21:32.296 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:31 smithi064 ceph-mon[216854]: failed to encode map e61 with expected crc 2023-12-16T03:21:32.296 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:31 smithi064 ceph-mon[216854]: osdmap e61: 6 total, 6 up, 6 in 2023-12-16T03:21:32.296 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:31 smithi064 ceph-mon[216854]: failed to encode map e61 with expected crc 2023-12-16T03:21:32.296 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:31 smithi064 ceph-mon[216854]: failed to encode map e61 with expected crc 2023-12-16T03:21:32.296 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:31 smithi064 ceph-mon[216854]: failed to encode map e61 with expected crc 2023-12-16T03:21:32.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:31 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T03:21:32.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:31 smithi184 ceph-mon[184130]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T03:21:32.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:31 smithi184 ceph-mon[184130]: failed to encode map e61 with expected crc 2023-12-16T03:21:32.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:31 smithi184 ceph-mon[184130]: osdmap e61: 6 total, 6 up, 6 in 2023-12-16T03:21:32.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:31 smithi184 ceph-mon[184130]: failed to encode map e61 with expected crc 2023-12-16T03:21:32.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:31 smithi184 ceph-mon[184130]: failed to encode map e61 with expected crc 2023-12-16T03:21:32.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:31 smithi184 ceph-mon[184130]: failed to encode map e61 with expected crc 2023-12-16T03:21:33.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:32 smithi184 ceph-mon[184130]: pgmap v81: 65 pgs: 8 active+undersized+degraded, 9 active+undersized, 48 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 28/366 objects degraded (7.650%) 2023-12-16T03:21:33.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:32 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:33.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:32 smithi064 ceph-mon[216854]: pgmap v81: 65 pgs: 8 active+undersized+degraded, 9 active+undersized, 48 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 28/366 objects degraded (7.650%) 2023-12-16T03:21:33.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:32 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:35.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:34 smithi184 ceph-mon[184130]: pgmap v82: 65 pgs: 8 active+undersized+degraded, 9 active+undersized, 48 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 28/366 objects degraded (7.650%) 2023-12-16T03:21:35.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:34 smithi064 ceph-mon[216854]: pgmap v82: 65 pgs: 8 active+undersized+degraded, 9 active+undersized, 48 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 28/366 objects degraded (7.650%) 2023-12-16T03:21:36.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:36 smithi184 ceph-mon[184130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded) 2023-12-16T03:21:36.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:36 smithi064 ceph-mon[216854]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/366 objects degraded (7.650%), 8 pgs degraded) 2023-12-16T03:21:37.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:37 smithi184 ceph-mon[184130]: pgmap v83: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:37.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:37 smithi064 ceph-mon[216854]: pgmap v83: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:39.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:39 smithi184 ceph-mon[184130]: pgmap v84: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:39.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:39 smithi064 ceph-mon[216854]: pgmap v84: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:41.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:41 smithi184 ceph-mon[184130]: pgmap v85: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:41.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:41 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:41.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:41 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:21:41.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:41 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:41.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:41 smithi064 ceph-mon[216854]: pgmap v85: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:41.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:41 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:41.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:41 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:21:41.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:41 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:43.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:43 smithi184 ceph-mon[184130]: pgmap v86: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:43.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:43 smithi064 ceph-mon[216854]: pgmap v86: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:45.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:45 smithi184 ceph-mon[184130]: pgmap v87: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:45.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:45 smithi064 ceph-mon[216854]: pgmap v87: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:46.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:46 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T03:21:46.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:46 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T03:21:47.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:47 smithi184 ceph-mon[184130]: pgmap v88: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:47.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:47 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T03:21:47.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:47 smithi184 ceph-mon[184130]: Upgrade: osd.3 is safe to restart 2023-12-16T03:21:47.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:47 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:47.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:47 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T03:21:47.328 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:47 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:21:47.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:47 smithi064 ceph-mon[216854]: pgmap v88: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:47 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T03:21:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:47 smithi064 ceph-mon[216854]: Upgrade: osd.3 is safe to restart 2023-12-16T03:21:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:47 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:47 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T03:21:47.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:47 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:21:48.308 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:48 smithi184 ceph-mon[184130]: Upgrade: Updating osd.3 2023-12-16T03:21:48.308 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:48 smithi184 ceph-mon[184130]: Deploying daemon osd.3 on smithi184 2023-12-16T03:21:48.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:48 smithi064 ceph-mon[216854]: Upgrade: Updating osd.3 2023-12-16T03:21:48.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:48 smithi064 ceph-mon[216854]: Deploying daemon osd.3 on smithi184 2023-12-16T03:21:49.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:49 smithi184 ceph-mon[184130]: pgmap v89: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:49.311 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:48 smithi184 systemd[1]: Stopping Ceph osd.3 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:21:49.312 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:49 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[127570]: 2023-12-16T03:21:49.118+0000 7fbb980bf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:21:49.312 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:49 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[127570]: 2023-12-16T03:21:49.118+0000 7fbb980bf700 -1 osd.3 61 *** Got signal Terminated *** 2023-12-16T03:21:49.312 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:49 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[127570]: 2023-12-16T03:21:49.118+0000 7fbb980bf700 -1 osd.3 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:21:49.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:49 smithi064 ceph-mon[216854]: pgmap v89: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:50.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:50 smithi064 ceph-mon[216854]: osd.3 marked itself down and dead 2023-12-16T03:21:50.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:50 smithi184 ceph-mon[184130]: osd.3 marked itself down and dead 2023-12-16T03:21:51.060 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:50 smithi184 bash[196169]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3 2023-12-16T03:21:51.355 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:51 smithi184 ceph-mon[184130]: pgmap v90: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:51.355 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:51 smithi184 ceph-mon[184130]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:21:51.355 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:51 smithi184 ceph-mon[184130]: failed to encode map e62 with expected crc 2023-12-16T03:21:51.355 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:51 smithi184 ceph-mon[184130]: osdmap e62: 6 total, 5 up, 6 in 2023-12-16T03:21:51.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:51 smithi064 ceph-mon[216854]: pgmap v90: 65 pgs: 65 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:21:51.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:51 smithi064 ceph-mon[216854]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:21:51.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:51 smithi064 ceph-mon[216854]: failed to encode map e62 with expected crc 2023-12-16T03:21:51.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:51 smithi064 ceph-mon[216854]: osdmap e62: 6 total, 5 up, 6 in 2023-12-16T03:21:52.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:52 smithi064 ceph-mon[216854]: osdmap e63: 6 total, 5 up, 6 in 2023-12-16T03:21:52.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:52 smithi064 ceph-mon[216854]: failed to encode map e63 with expected crc 2023-12-16T03:21:52.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:52 smithi064 ceph-mon[216854]: failed to encode map e63 with expected crc 2023-12-16T03:21:52.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:52 smithi064 ceph-mon[216854]: failed to encode map e63 with expected crc 2023-12-16T03:21:52.443 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:52 smithi064 ceph-mon[216854]: failed to encode map e63 with expected crc 2023-12-16T03:21:52.464 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 systemd[1]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.3.service: Succeeded. 2023-12-16T03:21:52.464 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 systemd[1]: Stopped Ceph osd.3 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:21:52.464 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 systemd[1]: Starting Ceph osd.3 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:21:52.464 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:52 smithi184 ceph-mon[184130]: osdmap e63: 6 total, 5 up, 6 in 2023-12-16T03:21:52.464 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:52 smithi184 ceph-mon[184130]: failed to encode map e63 with expected crc 2023-12-16T03:21:52.464 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:52 smithi184 ceph-mon[184130]: failed to encode map e63 with expected crc 2023-12-16T03:21:52.465 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:52 smithi184 ceph-mon[184130]: failed to encode map e63 with expected crc 2023-12-16T03:21:52.465 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:52 smithi184 ceph-mon[184130]: failed to encode map e63 with expected crc 2023-12-16T03:21:53.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:53 smithi184 ceph-mon[184130]: pgmap v93: 65 pgs: 9 active+undersized+degraded, 6 stale+active+clean, 9 active+undersized, 41 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/366 objects degraded (11.749%) 2023-12-16T03:21:53.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:53 smithi184 ceph-mon[184130]: Health check failed: Degraded data redundancy: 43/366 objects degraded (11.749%), 9 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:53.311 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 bash[196435]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T03:21:53.311 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 bash[196435]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T03:21:53.311 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 bash[196435]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T03:21:53.311 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 bash[196435]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T03:21:53.311 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 bash[196435]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-16T03:21:53.311 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 bash[196435]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T03:21:53.311 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:52 smithi184 bash[196435]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-16T03:21:53.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:53 smithi064 ceph-mon[216854]: pgmap v93: 65 pgs: 9 active+undersized+degraded, 6 stale+active+clean, 9 active+undersized, 41 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/366 objects degraded (11.749%) 2023-12-16T03:21:53.442 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:53 smithi064 ceph-mon[216854]: Health check failed: Degraded data redundancy: 43/366 objects degraded (11.749%), 9 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:54.060 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:53 smithi184 ceph-osd[196724]: -- 172.21.15.184:0/3672686899 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561bf10bd6c0 con 0x561bf108d000 2023-12-16T03:21:54.060 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:53 smithi184 bash[196686]: da6380fd0161cbb22045dc13a6ab58c3efb00c7798e3c71abc7463f8a7701ca7 2023-12-16T03:21:54.061 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:53 smithi184 systemd[1]: Started Ceph osd.3 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:21:54.460 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:54 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[196701]: 2023-12-16T03:21:54.196+0000 7ff60bef5640 -1 Falling back to public interface 2023-12-16T03:21:55.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:54 smithi184 ceph-mon[184130]: pgmap v94: 65 pgs: 9 active+undersized+degraded, 6 stale+active+clean, 9 active+undersized, 41 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/366 objects degraded (11.749%) 2023-12-16T03:21:55.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:55.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:55.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:21:55.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:54 smithi064 ceph-mon[216854]: pgmap v94: 65 pgs: 9 active+undersized+degraded, 6 stale+active+clean, 9 active+undersized, 41 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/366 objects degraded (11.749%) 2023-12-16T03:21:55.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:55.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:55.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:21:56.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:56 smithi184 ceph-mon[184130]: pgmap v95: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 77/366 objects degraded (21.038%) 2023-12-16T03:21:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:21:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:56.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:56.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:56 smithi064 ceph-mon[216854]: pgmap v95: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 77/366 objects degraded (21.038%) 2023-12-16T03:21:56.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:56.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:21:56.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:56.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.590+0000 7f0fd22af700 1 -- 172.21.15.64:0/3633279892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc065390 msgr2=0x7f0fcc065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.590+0000 7f0fd22af700 1 --2- 172.21.15.64:0/3633279892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc065390 0x7f0fcc065800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0004940 tx=0x7f0fc0009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.590+0000 7f0fd22af700 1 -- 172.21.15.64:0/3633279892 shutdown_connections 2023-12-16T03:21:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.590+0000 7f0fd22af700 1 --2- 172.21.15.64:0/3633279892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc065390 0x7f0fcc065800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.590+0000 7f0fd22af700 1 --2- 172.21.15.64:0/3633279892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc102c20 0x7f0fcc102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.590+0000 7f0fd22af700 1 -- 172.21.15.64:0/3633279892 >> 172.21.15.64:0/3633279892 conn(0x7f0fcc0719b0 msgr2=0x7f0fcc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.590+0000 7f0fd22af700 1 -- 172.21.15.64:0/3633279892 shutdown_connections 2023-12-16T03:21:57.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.590+0000 7f0fd22af700 1 -- 172.21.15.64:0/3633279892 wait complete. 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.590+0000 7f0fd22af700 1 Processor -- start 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fd22af700 1 -- start start 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fd22af700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc065390 0x7f0fcc1135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fd22af700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc102c20 0x7f0fcc113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fd22af700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc114170 con 0x7f0fcc102c20 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fd22af700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc10d4a0 con 0x7f0fcc065390 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fcb7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc102c20 0x7f0fcc113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fcbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc065390 0x7f0fcc1135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fcb7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc102c20 0x7f0fcc113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47232/0 (socket says 172.21.15.64:47232) 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fcbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc065390 0x7f0fcc1135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.64:49470/0 (socket says 172.21.15.64:49470) 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.591+0000 7f0fcb7fe700 1 -- 172.21.15.64:0/2475145760 learned_addr learned my addr 172.21.15.64:0/2475145760 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fcb7fe700 1 -- 172.21.15.64:0/2475145760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc065390 msgr2=0x7f0fcc1135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:57.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fcb7fe700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc065390 0x7f0fcc1135e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fcb7fe700 1 -- 172.21.15.64:0/2475145760 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0005040 con 0x7f0fcc102c20 2023-12-16T03:21:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fcbfff700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc065390 0x7f0fcc1135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:21:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fcb7fe700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc102c20 0x7f0fcc113b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0000c00 tx=0x7f0fc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fc8ff9700 1 -- 172.21.15.64:0/2475145760 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fc0021070 con 0x7f0fcc102c20 2023-12-16T03:21:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fc8ff9700 1 -- 172.21.15.64:0/2475145760 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0fc001c400 con 0x7f0fcc102c20 2023-12-16T03:21:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fcc10d720 con 0x7f0fcc102c20 2023-12-16T03:21:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fc8ff9700 1 -- 172.21.15.64:0/2475145760 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fc000e070 con 0x7f0fcc102c20 2023-12-16T03:21:57.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.592+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fcc10dc00 con 0x7f0fcc102c20 2023-12-16T03:21:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.593+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fcc0fff40 con 0x7f0fcc102c20 2023-12-16T03:21:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.594+0000 7f0fc8ff9700 1 -- 172.21.15.64:0/2475145760 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0fc001c970 con 0x7f0fcc102c20 2023-12-16T03:21:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.594+0000 7f0fc8ff9700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0fb406ce60 0x7f0fb406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.594+0000 7f0fc8ff9700 1 -- 172.21.15.64:0/2475145760 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0fc008d2c0 con 0x7f0fcc102c20 2023-12-16T03:21:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.594+0000 7f0fcbfff700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0fb406ce60 0x7f0fb406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:57.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.594+0000 7f0fcbfff700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0fb406ce60 0x7f0fb406f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009b80 tx=0x7f0fbc00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:57.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.599+0000 7f0fc8ff9700 1 -- 172.21.15.64:0/2475145760 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0fc005ada0 con 0x7f0fcc102c20 2023-12-16T03:21:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:57.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.822+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fcc04bb80 con 0x7f0fb406ce60 2023-12-16T03:21:57.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.823+0000 7f0fc8ff9700 1 -- 172.21.15.64:0/2475145760 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0fcc04bb80 con 0x7f0fb406ce60 2023-12-16T03:21:57.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0fb406ce60 msgr2=0x7f0fb406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:57.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0fb406ce60 0x7f0fb406f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009b80 tx=0x7f0fbc00b040 comp rx=0 tx=0).stop 2023-12-16T03:21:57.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc102c20 msgr2=0x7f0fcc113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:57.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc102c20 0x7f0fcc113b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0000c00 tx=0x7f0fc0009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:57.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 shutdown_connections 2023-12-16T03:21:57.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0fb406ce60 0x7f0fb406f310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:57.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fcc065390 0x7f0fcc1135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:57.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 --2- 172.21.15.64:0/2475145760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc102c20 0x7f0fcc113b20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:57.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 >> 172.21.15.64:0/2475145760 conn(0x7f0fcc0719b0 msgr2=0x7f0fcc0fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:57.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 shutdown_connections 2023-12-16T03:21:57.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.826+0000 7f0fd22af700 1 -- 172.21.15.64:0/2475145760 wait complete. 2023-12-16T03:21:57.838 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:21:57.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.931+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/2181291349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 msgr2=0x7f2d580fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:57.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.931+0000 7f2d5ca4a700 1 --2- 172.21.15.64:0/2181291349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 0x7f2d580fbfb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d40004940 tx=0x7f2d40009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:57.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.931+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/2181291349 shutdown_connections 2023-12-16T03:21:57.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.931+0000 7f2d5ca4a700 1 --2- 172.21.15.64:0/2181291349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 0x7f2d580fbfb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:57.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.931+0000 7f2d5ca4a700 1 --2- 172.21.15.64:0/2181291349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d58101b00 0x7f2d58101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:57.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.931+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/2181291349 >> 172.21.15.64:0/2181291349 conn(0x7f2d580719b0 msgr2=0x7f2d58071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:57.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.931+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/2181291349 shutdown_connections 2023-12-16T03:21:57.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.931+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/2181291349 wait complete. 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.931+0000 7f2d5ca4a700 1 Processor -- start 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5ca4a700 1 -- start start 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5ca4a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 0x7f2d581135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5ca4a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d58101b00 0x7f2d58113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5ca4a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58114150 con 0x7f2d580fbb40 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5ca4a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5810d480 con 0x7f2d58101b00 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 0x7f2d581135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 0x7f2d581135c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47250/0 (socket says 172.21.15.64:47250) 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5659c700 1 -- 172.21.15.64:0/1720543378 learned_addr learned my addr 172.21.15.64:0/1720543378 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d4ffff700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d58101b00 0x7f2d58113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5659c700 1 -- 172.21.15.64:0/1720543378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d58101b00 msgr2=0x7f2d58113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5659c700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d58101b00 0x7f2d58113b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5659c700 1 -- 172.21.15.64:0/1720543378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40005040 con 0x7f2d580fbb40 2023-12-16T03:21:57.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d5659c700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 0x7f2d581135c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800eb40 tx=0x7f2d4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:57.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.932+0000 7f2d4effd700 1 -- 172.21.15.64:0/1720543378 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d48007cc0 con 0x7f2d580fbb40 2023-12-16T03:21:57.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.933+0000 7f2d4effd700 1 -- 172.21.15.64:0/1720543378 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d4800f040 con 0x7f2d580fbb40 2023-12-16T03:21:57.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.933+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5810d700 con 0x7f2d580fbb40 2023-12-16T03:21:57.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.933+0000 7f2d4effd700 1 -- 172.21.15.64:0/1720543378 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d4800c990 con 0x7f2d580fbb40 2023-12-16T03:21:57.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.933+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5810dc10 con 0x7f2d580fbb40 2023-12-16T03:21:57.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.933+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d580734d0 con 0x7f2d580fbb40 2023-12-16T03:21:57.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.934+0000 7f2d4effd700 1 -- 172.21.15.64:0/1720543378 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f2d4800cc00 con 0x7f2d580fbb40 2023-12-16T03:21:57.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.934+0000 7f2d4effd700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f2d4406ce60 0x7f2d4406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:57.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.934+0000 7f2d4effd700 1 -- 172.21.15.64:0/1720543378 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2d4808be80 con 0x7f2d580fbb40 2023-12-16T03:21:57.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.934+0000 7f2d4ffff700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f2d4406ce60 0x7f2d4406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:57.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.935+0000 7f2d4ffff700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f2d4406ce60 0x7f2d4406f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d5810e7b0 tx=0x7f2d40009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:57.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:57.939+0000 7f2d4effd700 1 -- 172.21.15.64:0/1720543378 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f2d480598f0 con 0x7f2d580fbb40 2023-12-16T03:21:57.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:57.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:58.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.158+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d5810ec40 con 0x7f2d4406ce60 2023-12-16T03:21:58.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.159+0000 7f2d4effd700 1 -- 172.21.15.64:0/1720543378 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2d5810ec40 con 0x7f2d4406ce60 2023-12-16T03:21:58.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f2d4406ce60 msgr2=0x7f2d4406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f2d4406ce60 0x7f2d4406f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d5810e7b0 tx=0x7f2d40009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:58.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 msgr2=0x7f2d581135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 0x7f2d581135c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800eb40 tx=0x7f2d4800b040 comp rx=0 tx=0).stop 2023-12-16T03:21:58.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 shutdown_connections 2023-12-16T03:21:58.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f2d4406ce60 0x7f2d4406f310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d580fbb40 0x7f2d581135c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 --2- 172.21.15.64:0/1720543378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d58101b00 0x7f2d58113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 >> 172.21.15.64:0/1720543378 conn(0x7f2d580719b0 msgr2=0x7f2d580653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:58.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 shutdown_connections 2023-12-16T03:21:58.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.161+0000 7f2d5ca4a700 1 -- 172.21.15.64:0/1720543378 wait complete. 2023-12-16T03:21:58.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.266+0000 7f3f301b0700 1 -- 172.21.15.64:0/2673762497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 msgr2=0x7f3f280fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.266+0000 7f3f301b0700 1 --2- 172.21.15.64:0/2673762497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 0x7f3f280fbfb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f24004940 tx=0x7f3f24009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:58.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.266+0000 7f3f301b0700 1 -- 172.21.15.64:0/2673762497 shutdown_connections 2023-12-16T03:21:58.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.266+0000 7f3f301b0700 1 --2- 172.21.15.64:0/2673762497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 0x7f3f280fbfb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.266+0000 7f3f301b0700 1 --2- 172.21.15.64:0/2673762497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f28101b00 0x7f3f28101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.266+0000 7f3f301b0700 1 -- 172.21.15.64:0/2673762497 >> 172.21.15.64:0/2673762497 conn(0x7f3f280719b0 msgr2=0x7f3f28071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:58.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.266+0000 7f3f301b0700 1 -- 172.21.15.64:0/2673762497 shutdown_connections 2023-12-16T03:21:58.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.266+0000 7f3f301b0700 1 -- 172.21.15.64:0/2673762497 wait complete. 2023-12-16T03:21:58.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f301b0700 1 Processor -- start 2023-12-16T03:21:58.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f301b0700 1 -- start start 2023-12-16T03:21:58.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f301b0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 0x7f3f281135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:58.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f301b0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f28101b00 0x7f3f28113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:58.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f301b0700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28114150 con 0x7f3f280fbb40 2023-12-16T03:21:58.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f301b0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2810d480 con 0x7f3f28101b00 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f2df4c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 0x7f3f281135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f2df4c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 0x7f3f281135c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47268/0 (socket says 172.21.15.64:47268) 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f2df4c700 1 -- 172.21.15.64:0/3092821107 learned_addr learned my addr 172.21.15.64:0/3092821107 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f2d74b700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f28101b00 0x7f3f28113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f2df4c700 1 -- 172.21.15.64:0/3092821107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f28101b00 msgr2=0x7f3f28113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f2df4c700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f28101b00 0x7f3f28113b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.267+0000 7f3f2df4c700 1 -- 172.21.15.64:0/3092821107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24005040 con 0x7f3f280fbb40 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.268+0000 7f3f2df4c700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 0x7f3f281135c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f18002a80 tx=0x7f3f180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.268+0000 7f3f1e7fc700 1 -- 172.21.15.64:0/3092821107 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f18007cc0 con 0x7f3f280fbb40 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.268+0000 7f3f1e7fc700 1 -- 172.21.15.64:0/3092821107 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f1800f040 con 0x7f3f280fbb40 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.268+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2810d760 con 0x7f3f280fbb40 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.268+0000 7f3f1e7fc700 1 -- 172.21.15.64:0/3092821107 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f1800da60 con 0x7f3f280fbb40 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.268+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2810dca0 con 0x7f3f280fbb40 2023-12-16T03:21:58.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.269+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f280734d0 con 0x7f3f280fbb40 2023-12-16T03:21:58.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.269+0000 7f3f1e7fc700 1 -- 172.21.15.64:0/3092821107 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f3f1800dbc0 con 0x7f3f280fbb40 2023-12-16T03:21:58.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.270+0000 7f3f1e7fc700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f3f1406ce60 0x7f3f1406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:58.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.270+0000 7f3f1e7fc700 1 -- 172.21.15.64:0/3092821107 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3f1808be10 con 0x7f3f280fbb40 2023-12-16T03:21:58.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.270+0000 7f3f2d74b700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f3f1406ce60 0x7f3f1406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:58.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.270+0000 7f3f2d74b700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f3f1406ce60 0x7f3f1406f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f2810ee60 tx=0x7f3f24009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:58.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.274+0000 7f3f1e7fc700 1 -- 172.21.15.64:0/3092821107 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f3f18059850 con 0x7f3f280fbb40 2023-12-16T03:21:58.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.489+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f2810ecb0 con 0x7f3f1406ce60 2023-12-16T03:21:58.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.499+0000 7f3f1e7fc700 1 -- 172.21.15.64:0/3092821107 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3f2810ecb0 con 0x7f3f1406ce60 2023-12-16T03:21:58.501 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:21:58.501 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (3m) 31s ago 11m 29.4M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:21:58.501 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (114s) 31s ago 12m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f a416f0797862 2023-12-16T03:21:58.501 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (110s) 2s ago 11m 7444k - 19.0.0-191-g6d933094 a29c258b5d6f 4d5da6df7dee 2023-12-16T03:21:58.501 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (3m) 31s ago 11m 87.4M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:21:58.501 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (7m) 31s ago 7m 15.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (8m) 31s ago 8m 6646M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (8m) 2s ago 7m 4652M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (7m) 2s ago 7m 16.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (5m) 31s ago 13m 511M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (4m) 2s ago 11m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (2m) 31s ago 13m 65.5M 2048M 19.0.0-191-g6d933094 a29c258b5d6f fcfcecd16324 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (2m) 2s ago 11m 50.2M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 1523b5eb5b04 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (4m) 31s ago 12m 18.2M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (4m) 2s ago 11m 19.3M - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (95s) 31s ago 10m 121M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ff051ca1c9ba 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (65s) 31s ago 10m 123M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 16e84d481761 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (35s) 31s ago 9m 15.0M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 237e9d69d7c9 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (5s) 2s ago 9m 12.0M 2592M 19.0.0-191-g6d933094 a29c258b5d6f da6380fd0161 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (9m) 2s ago 9m 788M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 be12c7c7f08c 2023-12-16T03:21:58.502 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (9m) 2s ago 9m 872M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:21:58.503 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (4m) 31s ago 11m 60.6M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:21:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f3f1406ce60 msgr2=0x7f3f1406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f3f1406ce60 0x7f3f1406f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f2810ee60 tx=0x7f3f24009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 msgr2=0x7f3f281135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 0x7f3f281135c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f18002a80 tx=0x7f3f180046b0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 shutdown_connections 2023-12-16T03:21:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f3f1406ce60 0x7f3f1406f310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3f280fbb40 0x7f3f281135c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 --2- 172.21.15.64:0/3092821107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f28101b00 0x7f3f28113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 >> 172.21.15.64:0/3092821107 conn(0x7f3f280719b0 msgr2=0x7f3f28065390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:58.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.501+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 shutdown_connections 2023-12-16T03:21:58.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.502+0000 7f3f301b0700 1 -- 172.21.15.64:0/3092821107 wait complete. 2023-12-16T03:21:58.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.605+0000 7f1c1a845700 1 -- 172.21.15.64:0/3034545024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c14101b00 msgr2=0x7f1c14101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.605+0000 7f1c1a845700 1 --2- 172.21.15.64:0/3034545024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c14101b00 0x7f1c14101ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c04004940 tx=0x7f1c04009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:58.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.605+0000 7f1c1a845700 1 -- 172.21.15.64:0/3034545024 shutdown_connections 2023-12-16T03:21:58.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.605+0000 7f1c1a845700 1 --2- 172.21.15.64:0/3034545024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c140fbb40 0x7f1c140fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.605+0000 7f1c1a845700 1 --2- 172.21.15.64:0/3034545024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c14101b00 0x7f1c14101ed0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.605+0000 7f1c1a845700 1 -- 172.21.15.64:0/3034545024 >> 172.21.15.64:0/3034545024 conn(0x7f1c140719b0 msgr2=0x7f1c14071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:58.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.605+0000 7f1c1a845700 1 -- 172.21.15.64:0/3034545024 shutdown_connections 2023-12-16T03:21:58.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.605+0000 7f1c1a845700 1 -- 172.21.15.64:0/3034545024 wait complete. 2023-12-16T03:21:58.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.606+0000 7f1c1a845700 1 Processor -- start 2023-12-16T03:21:58.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.606+0000 7f1c1a845700 1 -- start start 2023-12-16T03:21:58.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.606+0000 7f1c1a845700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c140fbb40 0x7f1c141124a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:58.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.606+0000 7f1c1a845700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c14101b00 0x7f1c141129e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.606+0000 7f1c1a845700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14113030 con 0x7f1c140fbb40 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.606+0000 7f1c1a845700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1410c360 con 0x7f1c14101b00 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c140fbb40 0x7f1c141124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c140fbb40 0x7f1c141124a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47276/0 (socket says 172.21.15.64:47276) 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c13fff700 1 -- 172.21.15.64:0/1186342017 learned_addr learned my addr 172.21.15.64:0/1186342017 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c137fe700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c14101b00 0x7f1c141129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c13fff700 1 -- 172.21.15.64:0/1186342017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c14101b00 msgr2=0x7f1c141129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c13fff700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c14101b00 0x7f1c141129e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c13fff700 1 -- 172.21.15.64:0/1186342017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c04005040 con 0x7f1c140fbb40 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c13fff700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c140fbb40 0x7f1c141124a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009180 tx=0x7f1c04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c10ff9700 1 -- 172.21.15.64:0/1186342017 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0400e040 con 0x7f1c140fbb40 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1410c5e0 con 0x7f1c140fbb40 2023-12-16T03:21:58.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1410cb20 con 0x7f1c140fbb40 2023-12-16T03:21:58.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c10ff9700 1 -- 172.21.15.64:0/1186342017 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c04004290 con 0x7f1c140fbb40 2023-12-16T03:21:58.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.607+0000 7f1c10ff9700 1 -- 172.21.15.64:0/1186342017 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0401c3f0 con 0x7f1c140fbb40 2023-12-16T03:21:58.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.608+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c000052e0 con 0x7f1c140fbb40 2023-12-16T03:21:58.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.609+0000 7f1c10ff9700 1 -- 172.21.15.64:0/1186342017 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1c0400bb80 con 0x7f1c140fbb40 2023-12-16T03:21:58.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.609+0000 7f1c10ff9700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f1bfc06ce60 0x7f1bfc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:58.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.609+0000 7f1c10ff9700 1 -- 172.21.15.64:0/1186342017 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1c0408d4f0 con 0x7f1c140fbb40 2023-12-16T03:21:58.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.609+0000 7f1c137fe700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f1bfc06ce60 0x7f1bfc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:58.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.610+0000 7f1c137fe700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f1bfc06ce60 0x7f1bfc06f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c1410dd40 tx=0x7f1c0800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:58.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.614+0000 7f1c10ff9700 1 -- 172.21.15.64:0/1186342017 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f1c0405af30 con 0x7f1c140fbb40 2023-12-16T03:21:58.880 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:58 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[196701]: 2023-12-16T03:21:58.818+0000 7ff60bef5640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-16T03:21:58.880 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:58 smithi184 ceph-mon[184130]: pgmap v96: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 77/366 objects degraded (21.038%) 2023-12-16T03:21:58.880 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:58 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 77/366 objects degraded (21.038%), 20 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:58.880 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:58 smithi184 ceph-mon[184130]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:58.880 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:58 smithi184 ceph-mon[184130]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:58.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.900+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1c00005da0 con 0x7f1c140fbb40 2023-12-16T03:21:58.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.901+0000 7f1c10ff9700 1 -- 172.21.15.64:0/1186342017 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f1c0405aac0 con 0x7f1c140fbb40 2023-12-16T03:21:58.903 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2, 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 3 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:21:58.904 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:21:58.905 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6, 2023-12-16T03:21:58.905 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 7 2023-12-16T03:21:58.905 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:21:58.905 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f1bfc06ce60 msgr2=0x7f1bfc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f1bfc06ce60 0x7f1bfc06f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c1410dd40 tx=0x7f1c0800b040 comp rx=0 tx=0).stop 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c140fbb40 msgr2=0x7f1c141124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c140fbb40 0x7f1c141124a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009180 tx=0x7f1c04009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 shutdown_connections 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f1bfc06ce60 0x7f1bfc06f310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c140fbb40 0x7f1c141124a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 --2- 172.21.15.64:0/1186342017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c14101b00 0x7f1c141129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 >> 172.21.15.64:0/1186342017 conn(0x7f1c140719b0 msgr2=0x7f1c140faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 shutdown_connections 2023-12-16T03:21:58.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:58.903+0000 7f1c1a845700 1 -- 172.21.15.64:0/1186342017 wait complete. 2023-12-16T03:21:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:58 smithi064 ceph-mon[216854]: pgmap v96: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 77/366 objects degraded (21.038%) 2023-12-16T03:21:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:58 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 77/366 objects degraded (21.038%), 20 pgs degraded (PG_DEGRADED) 2023-12-16T03:21:58.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:58 smithi064 ceph-mon[216854]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:58 smithi064 ceph-mon[216854]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:59.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.008+0000 7f8cb0758700 1 -- 172.21.15.64:0/3950657211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca81035a0 msgr2=0x7f8ca80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.008+0000 7f8cb0758700 1 --2- 172.21.15.64:0/3950657211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca81035a0 0x7f8ca80fcc10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4004940 tx=0x7f8ca4009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:59.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.008+0000 7f8cb0758700 1 -- 172.21.15.64:0/3950657211 shutdown_connections 2023-12-16T03:21:59.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.008+0000 7f8cb0758700 1 --2- 172.21.15.64:0/3950657211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca81035a0 0x7f8ca80fcc10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.008+0000 7f8cb0758700 1 --2- 172.21.15.64:0/3950657211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ca8102c00 0x7f8ca8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.008+0000 7f8cb0758700 1 -- 172.21.15.64:0/3950657211 >> 172.21.15.64:0/3950657211 conn(0x7f8ca80f8790 msgr2=0x7f8ca80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:59.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.008+0000 7f8cb0758700 1 -- 172.21.15.64:0/3950657211 shutdown_connections 2023-12-16T03:21:59.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.008+0000 7f8cb0758700 1 -- 172.21.15.64:0/3950657211 wait complete. 2023-12-16T03:21:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cb0758700 1 Processor -- start 2023-12-16T03:21:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cb0758700 1 -- start start 2023-12-16T03:21:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cb0758700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca8102c00 0x7f8ca8113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cb0758700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ca81035a0 0x7f8ca8113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cb0758700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca8114250 con 0x7f8ca8102c00 2023-12-16T03:21:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cb0758700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca810d540 con 0x7f8ca81035a0 2023-12-16T03:21:59.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cae4f4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca8102c00 0x7f8ca8113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cae4f4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca8102c00 0x7f8ca8113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47290/0 (socket says 172.21.15.64:47290) 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cae4f4700 1 -- 172.21.15.64:0/3292028874 learned_addr learned my addr 172.21.15.64:0/3292028874 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.009+0000 7f8cadcf3700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ca81035a0 0x7f8ca8113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.010+0000 7f8cae4f4700 1 -- 172.21.15.64:0/3292028874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ca81035a0 msgr2=0x7f8ca8113c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.010+0000 7f8cae4f4700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ca81035a0 0x7f8ca8113c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.010+0000 7f8cae4f4700 1 -- 172.21.15.64:0/3292028874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca4005040 con 0x7f8ca8102c00 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.010+0000 7f8cae4f4700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca8102c00 0x7f8ca8113680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800eb70 tx=0x7f8c9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.010+0000 7f8c9effd700 1 -- 172.21.15.64:0/3292028874 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c98007cc0 con 0x7f8ca8102c00 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.010+0000 7f8c9effd700 1 -- 172.21.15.64:0/3292028874 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c9800f040 con 0x7f8ca8102c00 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.010+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca810d770 con 0x7f8ca8102c00 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.010+0000 7f8c9effd700 1 -- 172.21.15.64:0/3292028874 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9800c9f0 con 0x7f8ca8102c00 2023-12-16T03:21:59.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.010+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca810dc80 con 0x7f8ca8102c00 2023-12-16T03:21:59.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.011+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca81050d0 con 0x7f8ca8102c00 2023-12-16T03:21:59.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.011+0000 7f8c9effd700 1 -- 172.21.15.64:0/3292028874 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f8c9800cb50 con 0x7f8ca8102c00 2023-12-16T03:21:59.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.012+0000 7f8c9effd700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8c9406ce60 0x7f8c9406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:59.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.012+0000 7f8c9effd700 1 -- 172.21.15.64:0/3292028874 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8c9808be20 con 0x7f8ca8102c00 2023-12-16T03:21:59.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.012+0000 7f8cadcf3700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8c9406ce60 0x7f8c9406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:59.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.012+0000 7f8cadcf3700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8c9406ce60 0x7f8c9406f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000c00 tx=0x7f8ca4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:59.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.016+0000 7f8c9effd700 1 -- 172.21.15.64:0/3292028874 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f8c980597e0 con 0x7f8ca8102c00 2023-12-16T03:21:59.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.269+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8ca804bbb0 con 0x7f8ca8102c00 2023-12-16T03:21:59.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.270+0000 7f8c9effd700 1 -- 172.21.15.64:0/3292028874 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f8c98059370 con 0x7f8ca8102c00 2023-12-16T03:21:59.272 INFO:teuthology.orchestra.run.smithi064.stdout:e17 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:legacy client fscid: 1 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:Filesystem 'cephfs' (1) 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:fs_name cephfs 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 17 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:modified 2023-12-16T03:20:28.477911+0000 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:tableserver 0 2023-12-16T03:21:59.273 INFO:teuthology.orchestra.run.smithi064.stdout:root 0 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:session_timeout 60 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:session_autoclose 300 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:max_file_size 1099511627776 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:max_xattr_size 65536 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:required_client_features {} 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure 0 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure_osd_epoch 0 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:max_mds 2 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:in 0,1 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:up {0=14460,1=24269} 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:failed 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:damaged 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:stopped 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi064.stdout:data_pools [3] 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:metadata_pool 2 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:inline_data enabled 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:balancer 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:bal_rank_mask -1 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:standby_count_wanted 1 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:Standby daemons: 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:21:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.271+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8c9406ce60 msgr2=0x7f8c9406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.271+0000 7f8cb0758700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8c9406ce60 0x7f8c9406f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000c00 tx=0x7f8ca4009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.272+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca8102c00 msgr2=0x7f8ca8113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.272+0000 7f8cb0758700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca8102c00 0x7f8ca8113680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800eb70 tx=0x7f8c9800b040 comp rx=0 tx=0).stop 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.272+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 shutdown_connections 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.272+0000 7f8cb0758700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8c9406ce60 0x7f8c9406f310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.272+0000 7f8cb0758700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ca8102c00 0x7f8ca8113680 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.272+0000 7f8cb0758700 1 --2- 172.21.15.64:0/3292028874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ca81035a0 0x7f8ca8113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.272+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 >> 172.21.15.64:0/3292028874 conn(0x7f8ca80f8790 msgr2=0x7f8ca80fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:59.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.272+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 shutdown_connections 2023-12-16T03:21:59.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.272+0000 7f8cb0758700 1 -- 172.21.15.64:0/3292028874 wait complete. 2023-12-16T03:21:59.277 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 17 2023-12-16T03:21:59.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.381+0000 7f94e722e700 1 -- 172.21.15.64:0/3603686871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0065390 msgr2=0x7f94e0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.381+0000 7f94e722e700 1 --2- 172.21.15.64:0/3603686871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0065390 0x7f94e0065800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f94cc004940 tx=0x7f94cc009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:59.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.381+0000 7f94e722e700 1 -- 172.21.15.64:0/3603686871 shutdown_connections 2023-12-16T03:21:59.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.381+0000 7f94e722e700 1 --2- 172.21.15.64:0/3603686871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0065390 0x7f94e0065800 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.381+0000 7f94e722e700 1 --2- 172.21.15.64:0/3603686871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e0102c20 0x7f94e0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.381+0000 7f94e722e700 1 -- 172.21.15.64:0/3603686871 >> 172.21.15.64:0/3603686871 conn(0x7f94e00719b0 msgr2=0x7f94e0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:59.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.381+0000 7f94e722e700 1 -- 172.21.15.64:0/3603686871 shutdown_connections 2023-12-16T03:21:59.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.381+0000 7f94e722e700 1 -- 172.21.15.64:0/3603686871 wait complete. 2023-12-16T03:21:59.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.382+0000 7f94e722e700 1 Processor -- start 2023-12-16T03:21:59.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.382+0000 7f94e722e700 1 -- start start 2023-12-16T03:21:59.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.382+0000 7f94e722e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e0065390 0x7f94e00fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:59.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.382+0000 7f94e722e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0102c20 0x7f94e00fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:59.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.382+0000 7f94e722e700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00fc730 con 0x7f94e0102c20 2023-12-16T03:21:59.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.382+0000 7f94e722e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00fc8a0 con 0x7f94e0065390 2023-12-16T03:21:59.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.382+0000 7f94dffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0102c20 0x7f94e00fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.382+0000 7f94dffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0102c20 0x7f94e00fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47314/0 (socket says 172.21.15.64:47314) 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.382+0000 7f94dffff700 1 -- 172.21.15.64:0/1934312879 learned_addr learned my addr 172.21.15.64:0/1934312879 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94e4fca700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e0065390 0x7f94e00fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94dffff700 1 -- 172.21.15.64:0/1934312879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e0065390 msgr2=0x7f94e00fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94dffff700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e0065390 0x7f94e00fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94dffff700 1 -- 172.21.15.64:0/1934312879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc005040 con 0x7f94e0102c20 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94dffff700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0102c20 0x7f94e00fc130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009180 tx=0x7f94cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94dd7fa700 1 -- 172.21.15.64:0/1934312879 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc00e040 con 0x7f94e0102c20 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e0119820 con 0x7f94e0102c20 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94dd7fa700 1 -- 172.21.15.64:0/1934312879 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f94cc004290 con 0x7f94e0102c20 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94dd7fa700 1 -- 172.21.15.64:0/1934312879 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc01c3f0 con 0x7f94e0102c20 2023-12-16T03:21:59.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.383+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e0119c80 con 0x7f94e0102c20 2023-12-16T03:21:59.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.384+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00fff40 con 0x7f94e0102c20 2023-12-16T03:21:59.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.385+0000 7f94dd7fa700 1 -- 172.21.15.64:0/1934312879 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f94cc013420 con 0x7f94e0102c20 2023-12-16T03:21:59.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.385+0000 7f94dd7fa700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f94d006ce60 0x7f94d006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:59.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.385+0000 7f94e4fca700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f94d006ce60 0x7f94d006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:59.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.385+0000 7f94dd7fa700 1 -- 172.21.15.64:0/1934312879 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f94cc08d550 con 0x7f94e0102c20 2023-12-16T03:21:59.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.386+0000 7f94e4fca700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f94d006ce60 0x7f94d006f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009fd0 tx=0x7f94d400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:59.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.390+0000 7f94dd7fa700 1 -- 172.21.15.64:0/1934312879 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f94cc0575b0 con 0x7f94e0102c20 2023-12-16T03:21:59.560 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[196701]: 2023-12-16T03:21:59.341+0000 7ff60bef5640 -1 osd.3 61 log_to_monitors true 2023-12-16T03:21:59.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.612+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94e004bc20 con 0x7f94d006ce60 2023-12-16T03:21:59.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.613+0000 7f94dd7fa700 1 -- 172.21.15.64:0/1934312879 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f94d400f040 con 0x7f94d006ce60 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "crash", 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "mon", 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "10/21 daemons upgraded", 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:21:59.616 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:21:59.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f94d006ce60 msgr2=0x7f94d006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f94d006ce60 0x7f94d006f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009fd0 tx=0x7f94d400b040 comp rx=0 tx=0).stop 2023-12-16T03:21:59.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0102c20 msgr2=0x7f94e00fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0102c20 0x7f94e00fc130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009180 tx=0x7f94cc009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:59.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 shutdown_connections 2023-12-16T03:21:59.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f94d006ce60 0x7f94d006f310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e0065390 0x7f94e00fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 --2- 172.21.15.64:0/1934312879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94e0102c20 0x7f94e00fc130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 >> 172.21.15.64:0/1934312879 conn(0x7f94e00719b0 msgr2=0x7f94e00fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:59.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 shutdown_connections 2023-12-16T03:21:59.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.615+0000 7f94e722e700 1 -- 172.21.15.64:0/1934312879 wait complete. 2023-12-16T03:21:59.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 -- 172.21.15.64:0/1747167811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59980fbb40 msgr2=0x7f59980fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 --2- 172.21.15.64:0/1747167811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59980fbb40 0x7f59980fbfb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5984004940 tx=0x7f5984009e30 comp rx=0 tx=0).stop 2023-12-16T03:21:59.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 -- 172.21.15.64:0/1747167811 shutdown_connections 2023-12-16T03:21:59.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 --2- 172.21.15.64:0/1747167811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59980fbb40 0x7f59980fbfb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 --2- 172.21.15.64:0/1747167811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5998101b00 0x7f5998101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 -- 172.21.15.64:0/1747167811 >> 172.21.15.64:0/1747167811 conn(0x7f59980719b0 msgr2=0x7f5998071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:21:59.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 -- 172.21.15.64:0/1747167811 shutdown_connections 2023-12-16T03:21:59.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 -- 172.21.15.64:0/1747167811 wait complete. 2023-12-16T03:21:59.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 Processor -- start 2023-12-16T03:21:59.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.719+0000 7f599f018700 1 -- start start 2023-12-16T03:21:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f599f018700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59980fbb40 0x7f59980fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f599f018700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5998101b00 0x7f59980fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f599f018700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980fe2d0 con 0x7f5998101b00 2023-12-16T03:21:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f599f018700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980fe440 con 0x7f59980fbb40 2023-12-16T03:21:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f5997fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5998101b00 0x7f59980fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f5997fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5998101b00 0x7f59980fdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:47326/0 (socket says 172.21.15.64:47326) 2023-12-16T03:21:59.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f5997fff700 1 -- 172.21.15.64:0/2107581928 learned_addr learned my addr 172.21.15.64:0/2107581928 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f599cdb4700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59980fbb40 0x7f59980fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f5997fff700 1 -- 172.21.15.64:0/2107581928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59980fbb40 msgr2=0x7f59980fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f5997fff700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59980fbb40 0x7f59980fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f5997fff700 1 -- 172.21.15.64:0/2107581928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984005040 con 0x7f5998101b00 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.720+0000 7f5997fff700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5998101b00 0x7f59980fdc80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5984009fd0 tx=0x7f5984009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.721+0000 7f59957fa700 1 -- 172.21.15.64:0/2107581928 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f598400e040 con 0x7f5998101b00 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.721+0000 7f59957fa700 1 -- 172.21.15.64:0/2107581928 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5984013420 con 0x7f5998101b00 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.721+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59981198f0 con 0x7f5998101b00 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.721+0000 7f59957fa700 1 -- 172.21.15.64:0/2107581928 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f598401c630 con 0x7f5998101b00 2023-12-16T03:21:59.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.721+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5998119dd0 con 0x7f5998101b00 2023-12-16T03:21:59.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.722+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59980734d0 con 0x7f5998101b00 2023-12-16T03:21:59.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.722+0000 7f59957fa700 1 -- 172.21.15.64:0/2107581928 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5984013590 con 0x7f5998101b00 2023-12-16T03:21:59.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.723+0000 7f59957fa700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f598806ce70 0x7f598806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:21:59.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.723+0000 7f59957fa700 1 -- 172.21.15.64:0/2107581928 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f598408d480 con 0x7f5998101b00 2023-12-16T03:21:59.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.723+0000 7f599cdb4700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f598806ce70 0x7f598806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:21:59.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.723+0000 7f599cdb4700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f598806ce70 0x7f598806f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f598c004f40 tx=0x7f598c00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:21:59.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:21:59.727+0000 7f59957fa700 1 -- 172.21.15.64:0/2107581928 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f59840574e0 con 0x7f5998101b00 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/1186342017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/3292028874' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='osd.3 [v2:172.21.15.184:6800/3426374330,v1:172.21.15.184:6801/3426374330]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T03:21:59.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:21:59.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:59.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:59.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:21:59.944 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:21:59 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.016+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f59980fee60 con 0x7f5998101b00 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.016+0000 7f59957fa700 1 -- 172.21.15.64:0/2107581928 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1573 (secure 0 0 0) 0x7f598405ab00 con 0x7f5998101b00 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 77/366 objects degraded (21.038%), 20 pgs degraded 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stdout: osd.3 (root=default,host=smithi184) is down 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 77/366 objects degraded (21.038%), 20 pgs degraded 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2023-12-16T03:22:00.019 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2023-12-16T03:22:00.020 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2023-12-16T03:22:00.021 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2023-12-16T03:22:00.021 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2023-12-16T03:22:00.021 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2023-12-16T03:22:00.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.018+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f598806ce70 msgr2=0x7f598806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:00.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.018+0000 7f599f018700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f598806ce70 0x7f598806f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f598c004f40 tx=0x7f598c00b040 comp rx=0 tx=0).stop 2023-12-16T03:22:00.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.018+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5998101b00 msgr2=0x7f59980fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:00.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.018+0000 7f599f018700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5998101b00 0x7f59980fdc80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5984009fd0 tx=0x7f5984009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:00.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.019+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 shutdown_connections 2023-12-16T03:22:00.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.019+0000 7f599f018700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f598806ce70 0x7f598806f320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:00.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.019+0000 7f599f018700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59980fbb40 0x7f59980fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:00.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.019+0000 7f599f018700 1 --2- 172.21.15.64:0/2107581928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5998101b00 0x7f59980fdc80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:00.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.019+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 >> 172.21.15.64:0/2107581928 conn(0x7f59980719b0 msgr2=0x7f59980654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:00.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.019+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 shutdown_connections 2023-12-16T03:22:00.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:00.019+0000 7f599f018700 1 -- 172.21.15.64:0/2107581928 wait complete. 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/1186342017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/3292028874' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='osd.3 [v2:172.21.15.184:6800/3426374330,v1:172.21.15.184:6801/3426374330]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:00.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:00.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:00.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:21:59 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T03:22:00.811 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[196701]: 2023-12-16T03:22:00.339+0000 7ff5fcb65700 -1 osd.3 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:22:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-mon[184130]: pgmap v97: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 77/366 objects degraded (21.038%) 2023-12-16T03:22:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T03:22:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-mon[184130]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-16T03:22:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-mon[184130]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/2107581928' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:22:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-mon[184130]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T03:22:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-mon[184130]: osdmap e64: 6 total, 5 up, 6 in 2023-12-16T03:22:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-mon[184130]: from='osd.3 [v2:172.21.15.184:6800/3426374330,v1:172.21.15.184:6801/3426374330]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:00.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:00 smithi184 ceph-mon[184130]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:00.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:00 smithi064 ceph-mon[216854]: pgmap v97: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 314 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 77/366 objects degraded (21.038%) 2023-12-16T03:22:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:00 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T03:22:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:00 smithi064 ceph-mon[216854]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-16T03:22:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:00 smithi064 ceph-mon[216854]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:00 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/2107581928' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:22:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:00 smithi064 ceph-mon[216854]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T03:22:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:00 smithi064 ceph-mon[216854]: osdmap e64: 6 total, 5 up, 6 in 2023-12-16T03:22:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:00 smithi064 ceph-mon[216854]: from='osd.3 [v2:172.21.15.184:6800/3426374330,v1:172.21.15.184:6801/3426374330]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:00.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:00 smithi064 ceph-mon[216854]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:01 smithi064 ceph-mon[216854]: failed to encode map e64 with expected crc 2023-12-16T03:22:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:01 smithi064 ceph-mon[216854]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:22:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:01 smithi064 ceph-mon[216854]: osd.3 [v2:172.21.15.184:6800/3426374330,v1:172.21.15.184:6801/3426374330] boot 2023-12-16T03:22:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:01 smithi064 ceph-mon[216854]: osdmap e65: 6 total, 6 up, 6 in 2023-12-16T03:22:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:22:02.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:01 smithi184 ceph-mon[184130]: failed to encode map e64 with expected crc 2023-12-16T03:22:02.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:01 smithi184 ceph-mon[184130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:22:02.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:01 smithi184 ceph-mon[184130]: osd.3 [v2:172.21.15.184:6800/3426374330,v1:172.21.15.184:6801/3426374330] boot 2023-12-16T03:22:02.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:01 smithi184 ceph-mon[184130]: osdmap e65: 6 total, 6 up, 6 in 2023-12-16T03:22:02.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T03:22:02.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:02 smithi064 ceph-mon[216854]: failed to encode map e64 with expected crc 2023-12-16T03:22:02.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:02 smithi064 ceph-mon[216854]: pgmap v100: 65 pgs: 8 peering, 17 active+undersized+degraded, 13 active+undersized, 27 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 66/366 objects degraded (18.033%) 2023-12-16T03:22:02.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:02 smithi064 ceph-mon[216854]: osdmap e66: 6 total, 6 up, 6 in 2023-12-16T03:22:03.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:02 smithi184 ceph-mon[184130]: failed to encode map e64 with expected crc 2023-12-16T03:22:03.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:02 smithi184 ceph-mon[184130]: pgmap v100: 65 pgs: 8 peering, 17 active+undersized+degraded, 13 active+undersized, 27 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 66/366 objects degraded (18.033%) 2023-12-16T03:22:03.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:02 smithi184 ceph-mon[184130]: osdmap e66: 6 total, 6 up, 6 in 2023-12-16T03:22:03.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:03 smithi064 ceph-mon[216854]: failed to encode map e66 with expected crc 2023-12-16T03:22:03.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:03 smithi064 ceph-mon[216854]: failed to encode map e66 with expected crc 2023-12-16T03:22:03.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:03 smithi064 ceph-mon[216854]: failed to encode map e66 with expected crc 2023-12-16T03:22:03.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:03 smithi064 ceph-mon[216854]: failed to encode map e66 with expected crc 2023-12-16T03:22:03.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:03 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 66/366 objects degraded (18.033%), 17 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:04.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:03 smithi184 ceph-mon[184130]: failed to encode map e66 with expected crc 2023-12-16T03:22:04.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:03 smithi184 ceph-mon[184130]: failed to encode map e66 with expected crc 2023-12-16T03:22:04.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:03 smithi184 ceph-mon[184130]: failed to encode map e66 with expected crc 2023-12-16T03:22:04.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:03 smithi184 ceph-mon[184130]: failed to encode map e66 with expected crc 2023-12-16T03:22:04.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:03 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 66/366 objects degraded (18.033%), 17 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:04.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:04 smithi064 ceph-mon[216854]: pgmap v102: 65 pgs: 8 peering, 17 active+undersized+degraded, 13 active+undersized, 27 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 66/366 objects degraded (18.033%) 2023-12-16T03:22:05.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:04 smithi184 ceph-mon[184130]: pgmap v102: 65 pgs: 8 peering, 17 active+undersized+degraded, 13 active+undersized, 27 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 66/366 objects degraded (18.033%) 2023-12-16T03:22:06.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:05 smithi184 ceph-mon[184130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 66/366 objects degraded (18.033%), 17 pgs degraded) 2023-12-16T03:22:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:05 smithi064 ceph-mon[216854]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 66/366 objects degraded (18.033%), 17 pgs degraded) 2023-12-16T03:22:07.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:06 smithi184 ceph-mon[184130]: pgmap v103: 65 pgs: 8 peering, 57 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:07.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:06 smithi064 ceph-mon[216854]: pgmap v103: 65 pgs: 8 peering, 57 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:09.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:08 smithi184 ceph-mon[184130]: pgmap v104: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:09.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:08 smithi064 ceph-mon[216854]: pgmap v104: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:11.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:10 smithi184 ceph-mon[184130]: pgmap v105: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:11.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:10 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:11.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:10 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:22:11.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:10 smithi064 ceph-mon[216854]: pgmap v105: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:11.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:10 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:11.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:10 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:22:13.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:12 smithi184 ceph-mon[184130]: pgmap v106: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:13.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:12 smithi064 ceph-mon[216854]: pgmap v106: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:14 smithi184 ceph-mon[184130]: pgmap v107: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:15.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:14 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T03:22:15.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:14 smithi064 ceph-mon[216854]: pgmap v107: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:15.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:14 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T03:22:16.016 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:15 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T03:22:16.016 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:15 smithi184 ceph-mon[184130]: Upgrade: osd.4 is safe to restart 2023-12-16T03:22:16.016 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:15 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:16.016 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:15 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:16.016 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:15 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T03:22:16.016 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:15 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:16.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:15 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T03:22:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:15 smithi064 ceph-mon[216854]: Upgrade: osd.4 is safe to restart 2023-12-16T03:22:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:15 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:15 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:15 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T03:22:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:15 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:17.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:16 smithi184 ceph-mon[184130]: pgmap v108: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:17.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:16 smithi184 ceph-mon[184130]: Upgrade: Updating osd.4 2023-12-16T03:22:17.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:16 smithi184 ceph-mon[184130]: Deploying daemon osd.4 on smithi184 2023-12-16T03:22:17.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:16 smithi064 ceph-mon[216854]: pgmap v108: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:17.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:16 smithi064 ceph-mon[216854]: Upgrade: Updating osd.4 2023-12-16T03:22:17.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:16 smithi064 ceph-mon[216854]: Deploying daemon osd.4 on smithi184 2023-12-16T03:22:18.311 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:17 smithi184 systemd[1]: Stopping Ceph osd.4 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:22:18.311 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:18 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[135646]: 2023-12-16T03:22:18.012+0000 7f92e34f5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:22:18.311 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:18 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[135646]: 2023-12-16T03:22:18.012+0000 7f92e34f5700 -1 osd.4 66 *** Got signal Terminated *** 2023-12-16T03:22:18.311 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:18 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[135646]: 2023-12-16T03:22:18.012+0000 7f92e34f5700 -1 osd.4 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:22:19.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:18 smithi184 ceph-mon[184130]: pgmap v109: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:19.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:18 smithi184 ceph-mon[184130]: osd.4 marked itself down and dead 2023-12-16T03:22:19.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:18 smithi064 ceph-mon[216854]: pgmap v109: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:19.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:18 smithi064 ceph-mon[216854]: osd.4 marked itself down and dead 2023-12-16T03:22:19.757 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:19 smithi184 bash[202255]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4 2023-12-16T03:22:20.027 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:19 smithi184 ceph-mon[184130]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:22:20.028 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:19 smithi184 ceph-mon[184130]: failed to encode map e67 with expected crc 2023-12-16T03:22:20.028 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:19 smithi184 ceph-mon[184130]: failed to encode map e67 with expected crc 2023-12-16T03:22:20.028 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:19 smithi184 ceph-mon[184130]: osdmap e67: 6 total, 5 up, 6 in 2023-12-16T03:22:20.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:19 smithi064 ceph-mon[216854]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:22:20.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:19 smithi064 ceph-mon[216854]: failed to encode map e67 with expected crc 2023-12-16T03:22:20.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:19 smithi064 ceph-mon[216854]: failed to encode map e67 with expected crc 2023-12-16T03:22:20.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:19 smithi064 ceph-mon[216854]: osdmap e67: 6 total, 5 up, 6 in 2023-12-16T03:22:21.061 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:20 smithi184 systemd[1]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.4.service: Succeeded. 2023-12-16T03:22:21.061 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:20 smithi184 systemd[1]: Stopped Ceph osd.4 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:22:21.061 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:20 smithi184 systemd[1]: Starting Ceph osd.4 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:22:21.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:20 smithi184 ceph-mon[184130]: pgmap v111: 65 pgs: 2 peering, 5 stale+active+clean, 58 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:21.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:20 smithi184 ceph-mon[184130]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T03:22:21.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:20 smithi184 ceph-mon[184130]: failed to encode map e68 with expected crc 2023-12-16T03:22:21.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:20 smithi184 ceph-mon[184130]: osdmap e68: 6 total, 5 up, 6 in 2023-12-16T03:22:21.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:20 smithi184 ceph-mon[184130]: failed to encode map e68 with expected crc 2023-12-16T03:22:21.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:20 smithi184 ceph-mon[184130]: failed to encode map e68 with expected crc 2023-12-16T03:22:21.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:20 smithi064 ceph-mon[216854]: pgmap v111: 65 pgs: 2 peering, 5 stale+active+clean, 58 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:21.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:20 smithi064 ceph-mon[216854]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T03:22:21.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:20 smithi064 ceph-mon[216854]: failed to encode map e68 with expected crc 2023-12-16T03:22:21.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:20 smithi064 ceph-mon[216854]: osdmap e68: 6 total, 5 up, 6 in 2023-12-16T03:22:21.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:20 smithi064 ceph-mon[216854]: failed to encode map e68 with expected crc 2023-12-16T03:22:21.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:20 smithi064 ceph-mon[216854]: failed to encode map e68 with expected crc 2023-12-16T03:22:22.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:21 smithi184 ceph-mon[184130]: Health check failed: Degraded data redundancy: 35/366 objects degraded (9.563%), 8 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:22.061 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:21 smithi184 bash[202518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T03:22:22.061 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:21 smithi184 bash[202518]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T03:22:22.061 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:21 smithi184 bash[202518]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T03:22:22.061 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:21 smithi184 bash[202518]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T03:22:22.061 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:21 smithi184 bash[202518]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-16T03:22:22.062 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:21 smithi184 bash[202518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T03:22:22.062 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:21 smithi184 bash[202518]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-16T03:22:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:21 smithi064 ceph-mon[216854]: Health check failed: Degraded data redundancy: 35/366 objects degraded (9.563%), 8 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:22.811 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:22 smithi184 bash[202794]: c2b8b55e6a9008b116a66751f4266b72804e0919286612ef97dcc1e9d39ec553 2023-12-16T03:22:22.811 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:22 smithi184 systemd[1]: Started Ceph osd.4 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:22:23.166 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:22 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:22:22.899+0000 7f375a6d6640 -1 Falling back to public interface 2023-12-16T03:22:23.166 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:22 smithi184 ceph-mon[184130]: pgmap v113: 65 pgs: 8 active+undersized+degraded, 10 peering, 2 stale+active+clean, 8 active+undersized, 37 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 35/366 objects degraded (9.563%) 2023-12-16T03:22:23.166 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:22 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:23.166 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:22 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:23.166 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:22 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:23.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:22 smithi064 ceph-mon[216854]: pgmap v113: 65 pgs: 8 active+undersized+degraded, 10 peering, 2 stale+active+clean, 8 active+undersized, 37 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 35/366 objects degraded (9.563%) 2023-12-16T03:22:23.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:22 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:23.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:22 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:23.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:22 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:24 smithi064 ceph-mon[216854]: pgmap v114: 65 pgs: 8 active+undersized+degraded, 10 peering, 2 stale+active+clean, 8 active+undersized, 37 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 35/366 objects degraded (9.563%) 2023-12-16T03:22:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:24 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:25.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:24 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:25.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:24 smithi184 ceph-mon[184130]: pgmap v114: 65 pgs: 8 active+undersized+degraded, 10 peering, 2 stale+active+clean, 8 active+undersized, 37 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 35/366 objects degraded (9.563%) 2023-12-16T03:22:25.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:24 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:25.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:24 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:26.553 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:26 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:26.553 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:26 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:26.553 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:26 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:26.553 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:26 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:22:26.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:26.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:26.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:26.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:26 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:22:27.561 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:27 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:22:27.258+0000 7f375a6d6640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-16T03:22:27.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:27 smithi184 ceph-mon[184130]: pgmap v115: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2023-12-16T03:22:27.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:27 smithi184 ceph-mon[184130]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-16T03:22:27.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:27 smithi064 ceph-mon[216854]: pgmap v115: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2023-12-16T03:22:27.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:27 smithi064 ceph-mon[216854]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-16T03:22:28.038 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:27 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:22:27.855+0000 7f375a6d6640 -1 osd.4 66 log_to_monitors true 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 62/366 objects degraded (16.940%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='osd.4 [v2:172.21.15.184:6808/992163260,v1:172.21.15.184:6809/992163260]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:28.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:28.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:28.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:28.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:28 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T03:22:28.701 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 62/366 objects degraded (16.940%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='osd.4 [v2:172.21.15.184:6808/992163260,v1:172.21.15.184:6809/992163260]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:28.702 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T03:22:29.062 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:22:28 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:22:28.699+0000 7f3748340700 -1 osd.4 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:22:29.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:29 smithi064 ceph-mon[216854]: pgmap v116: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2023-12-16T03:22:29.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:29 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T03:22:29.694 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:29 smithi064 ceph-mon[216854]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T03:22:29.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:29 smithi064 ceph-mon[216854]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T03:22:29.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:29 smithi064 ceph-mon[216854]: failed to encode map e69 with expected crc 2023-12-16T03:22:29.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:29 smithi064 ceph-mon[216854]: osdmap e69: 6 total, 5 up, 6 in 2023-12-16T03:22:29.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:29 smithi064 ceph-mon[216854]: from='osd.4 [v2:172.21.15.184:6808/992163260,v1:172.21.15.184:6809/992163260]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:29.695 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:29 smithi064 ceph-mon[216854]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:29.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:29 smithi184 ceph-mon[184130]: pgmap v116: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2023-12-16T03:22:29.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:29 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T03:22:29.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:29 smithi184 ceph-mon[184130]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T03:22:29.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:29 smithi184 ceph-mon[184130]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T03:22:29.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:29 smithi184 ceph-mon[184130]: failed to encode map e69 with expected crc 2023-12-16T03:22:29.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:29 smithi184 ceph-mon[184130]: osdmap e69: 6 total, 5 up, 6 in 2023-12-16T03:22:29.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:29 smithi184 ceph-mon[184130]: from='osd.4 [v2:172.21.15.184:6808/992163260,v1:172.21.15.184:6809/992163260]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:29.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:29 smithi184 ceph-mon[184130]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:30.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.138+0000 7fc821893700 1 -- 172.21.15.64:0/3460088754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c101b00 msgr2=0x7fc81c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.138+0000 7fc821893700 1 --2- 172.21.15.64:0/3460088754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c101b00 0x7fc81c101ed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc80c004940 tx=0x7fc80c009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:30.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.138+0000 7fc821893700 1 -- 172.21.15.64:0/3460088754 shutdown_connections 2023-12-16T03:22:30.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.138+0000 7fc821893700 1 --2- 172.21.15.64:0/3460088754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc81c0fbb40 0x7fc81c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.138+0000 7fc821893700 1 --2- 172.21.15.64:0/3460088754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c101b00 0x7fc81c101ed0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.138+0000 7fc821893700 1 -- 172.21.15.64:0/3460088754 >> 172.21.15.64:0/3460088754 conn(0x7fc81c0f76c0 msgr2=0x7fc81c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:30.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.139+0000 7fc821893700 1 -- 172.21.15.64:0/3460088754 shutdown_connections 2023-12-16T03:22:30.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.139+0000 7fc821893700 1 -- 172.21.15.64:0/3460088754 wait complete. 2023-12-16T03:22:30.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.139+0000 7fc821893700 1 Processor -- start 2023-12-16T03:22:30.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.139+0000 7fc821893700 1 -- start start 2023-12-16T03:22:30.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc821893700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c0fbb40 0x7fc81c113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:30.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc821893700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc81c101b00 0x7fc81c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:30.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc821893700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c114220 con 0x7fc81c0fbb40 2023-12-16T03:22:30.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc821893700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c10d510 con 0x7fc81c101b00 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc81affd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c0fbb40 0x7fc81c113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc81affd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c0fbb40 0x7fc81c113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33862/0 (socket says 172.21.15.64:33862) 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc81affd700 1 -- 172.21.15.64:0/311855400 learned_addr learned my addr 172.21.15.64:0/311855400 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc81a7fc700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc81c101b00 0x7fc81c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc81affd700 1 -- 172.21.15.64:0/311855400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc81c101b00 msgr2=0x7fc81c113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc81affd700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc81c101b00 0x7fc81c113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc81affd700 1 -- 172.21.15.64:0/311855400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c005040 con 0x7fc81c0fbb40 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc81affd700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c0fbb40 0x7fc81c113650 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009180 tx=0x7fc80c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.140+0000 7fc8037fe700 1 -- 172.21.15.64:0/311855400 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc80c00e040 con 0x7fc81c0fbb40 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.141+0000 7fc8037fe700 1 -- 172.21.15.64:0/311855400 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc80c013420 con 0x7fc81c0fbb40 2023-12-16T03:22:30.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.141+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c10d740 con 0x7fc81c0fbb40 2023-12-16T03:22:30.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.141+0000 7fc8037fe700 1 -- 172.21.15.64:0/311855400 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc80c01c630 con 0x7fc81c0fbb40 2023-12-16T03:22:30.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.141+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c10dc80 con 0x7fc81c0fbb40 2023-12-16T03:22:30.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.142+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c0fb2c0 con 0x7fc81c0fbb40 2023-12-16T03:22:30.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.142+0000 7fc8037fe700 1 -- 172.21.15.64:0/311855400 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc80c0139e0 con 0x7fc81c0fbb40 2023-12-16T03:22:30.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.142+0000 7fc8037fe700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc80406ce60 0x7fc80406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:30.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.143+0000 7fc8037fe700 1 -- 172.21.15.64:0/311855400 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc80c08d540 con 0x7fc81c0fbb40 2023-12-16T03:22:30.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.143+0000 7fc81a7fc700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc80406ce60 0x7fc80406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:30.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.143+0000 7fc81a7fc700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc80406ce60 0x7fc80406f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc810007fd0 tx=0x7fc810009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:30.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.147+0000 7fc8037fe700 1 -- 172.21.15.64:0/311855400 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc80c05b020 con 0x7fc81c0fbb40 2023-12-16T03:22:30.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.373+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc81c10eca0 con 0x7fc80406ce60 2023-12-16T03:22:30.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.374+0000 7fc8037fe700 1 -- 172.21.15.64:0/311855400 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc81c10eca0 con 0x7fc80406ce60 2023-12-16T03:22:30.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.376+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc80406ce60 msgr2=0x7fc80406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.376+0000 7fc821893700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc80406ce60 0x7fc80406f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc810007fd0 tx=0x7fc810009040 comp rx=0 tx=0).stop 2023-12-16T03:22:30.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.376+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c0fbb40 msgr2=0x7fc81c113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.376+0000 7fc821893700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c0fbb40 0x7fc81c113650 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009180 tx=0x7fc80c009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:30.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.377+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 shutdown_connections 2023-12-16T03:22:30.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.377+0000 7fc821893700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc80406ce60 0x7fc80406f310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.377+0000 7fc821893700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc81c0fbb40 0x7fc81c113650 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.377+0000 7fc821893700 1 --2- 172.21.15.64:0/311855400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc81c101b00 0x7fc81c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.377+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 >> 172.21.15.64:0/311855400 conn(0x7fc81c0f76c0 msgr2=0x7fc81c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:30.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.377+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 shutdown_connections 2023-12-16T03:22:30.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.377+0000 7fc821893700 1 -- 172.21.15.64:0/311855400 wait complete. 2023-12-16T03:22:30.389 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:22:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.481+0000 7f5e08191700 1 -- 172.21.15.64:0/3125491345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 msgr2=0x7f5e000fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.481+0000 7f5e08191700 1 --2- 172.21.15.64:0/3125491345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 0x7f5e000fdfd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5df4004940 tx=0x7f5df4009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.481+0000 7f5e08191700 1 -- 172.21.15.64:0/3125491345 shutdown_connections 2023-12-16T03:22:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.481+0000 7f5e08191700 1 --2- 172.21.15.64:0/3125491345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e000fe5a0 0x7f5e00106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.481+0000 7f5e08191700 1 --2- 172.21.15.64:0/3125491345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 0x7f5e000fdfd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.481+0000 7f5e08191700 1 -- 172.21.15.64:0/3125491345 >> 172.21.15.64:0/3125491345 conn(0x7f5e000f7690 msgr2=0x7f5e000f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:30.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.481+0000 7f5e08191700 1 -- 172.21.15.64:0/3125491345 shutdown_connections 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.481+0000 7f5e08191700 1 -- 172.21.15.64:0/3125491345 wait complete. 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e08191700 1 Processor -- start 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e08191700 1 -- start start 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e08191700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 0x7f5e00113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e08191700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e000fe5a0 0x7f5e00113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e08191700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00114200 con 0x7f5e000fdc00 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e08191700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0010d4f0 con 0x7f5e000fe5a0 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e05f2d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 0x7f5e00113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e05f2d700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 0x7f5e00113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33882/0 (socket says 172.21.15.64:33882) 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e05f2d700 1 -- 172.21.15.64:0/1788839676 learned_addr learned my addr 172.21.15.64:0/1788839676 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.482+0000 7f5e0572c700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e000fe5a0 0x7f5e00113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.483+0000 7f5e05f2d700 1 -- 172.21.15.64:0/1788839676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e000fe5a0 msgr2=0x7f5e00113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.483+0000 7f5e05f2d700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e000fe5a0 0x7f5e00113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.483+0000 7f5e05f2d700 1 -- 172.21.15.64:0/1788839676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4005040 con 0x7f5e000fdc00 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.483+0000 7f5e05f2d700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 0x7f5e00113630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009390 tx=0x7f5df4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:30.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.483+0000 7f5df27fc700 1 -- 172.21.15.64:0/1788839676 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5df400e040 con 0x7f5e000fdc00 2023-12-16T03:22:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.483+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0010d720 con 0x7f5e000fdc00 2023-12-16T03:22:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.483+0000 7f5df27fc700 1 -- 172.21.15.64:0/1788839676 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5df4013420 con 0x7f5e000fdc00 2023-12-16T03:22:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.483+0000 7f5df27fc700 1 -- 172.21.15.64:0/1788839676 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5df401c630 con 0x7f5e000fdc00 2023-12-16T03:22:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.483+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0010dc60 con 0x7f5e000fdc00 2023-12-16T03:22:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.484+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e001041f0 con 0x7f5e000fdc00 2023-12-16T03:22:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.485+0000 7f5df27fc700 1 -- 172.21.15.64:0/1788839676 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5df4013590 con 0x7f5e000fdc00 2023-12-16T03:22:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.485+0000 7f5df27fc700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5dec06ce70 0x7f5dec06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:30.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.485+0000 7f5df27fc700 1 -- 172.21.15.64:0/1788839676 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5df408d740 con 0x7f5e000fdc00 2023-12-16T03:22:30.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.485+0000 7f5e0572c700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5dec06ce70 0x7f5dec06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:30.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.485+0000 7f5e0572c700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5dec06ce70 0x7f5dec06f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5e0010eed0 tx=0x7f5dfc00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:30.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.490+0000 7f5df27fc700 1 -- 172.21.15.64:0/1788839676 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f5df405b180 con 0x7f5e000fdc00 2023-12-16T03:22:30.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:30 smithi064 ceph-mon[216854]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:22:30.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:30 smithi064 ceph-mon[216854]: failed to encode map e70 with expected crc 2023-12-16T03:22:30.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:30 smithi064 ceph-mon[216854]: osd.4 [v2:172.21.15.184:6808/992163260,v1:172.21.15.184:6809/992163260] boot 2023-12-16T03:22:30.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:30 smithi064 ceph-mon[216854]: osdmap e70: 6 total, 6 up, 6 in 2023-12-16T03:22:30.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:30 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:22:30.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.731+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e0010ec10 con 0x7f5dec06ce70 2023-12-16T03:22:30.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.732+0000 7f5df27fc700 1 -- 172.21.15.64:0/1788839676 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5e0010ec10 con 0x7f5dec06ce70 2023-12-16T03:22:30.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.734+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5dec06ce70 msgr2=0x7f5dec06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.734+0000 7f5e08191700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5dec06ce70 0x7f5dec06f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5e0010eed0 tx=0x7f5dfc00b040 comp rx=0 tx=0).stop 2023-12-16T03:22:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.734+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 msgr2=0x7f5e00113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.734+0000 7f5e08191700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 0x7f5e00113630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009390 tx=0x7f5df4009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.734+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 shutdown_connections 2023-12-16T03:22:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.734+0000 7f5e08191700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f5dec06ce70 0x7f5dec06f320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.734+0000 7f5e08191700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e000fdc00 0x7f5e00113630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.735+0000 7f5e08191700 1 --2- 172.21.15.64:0/1788839676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e000fe5a0 0x7f5e00113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.735+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 >> 172.21.15.64:0/1788839676 conn(0x7f5e000f7690 msgr2=0x7f5e00101370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.735+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 shutdown_connections 2023-12-16T03:22:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.735+0000 7f5e08191700 1 -- 172.21.15.64:0/1788839676 wait complete. 2023-12-16T03:22:30.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:30 smithi184 ceph-mon[184130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:22:30.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:30 smithi184 ceph-mon[184130]: failed to encode map e70 with expected crc 2023-12-16T03:22:30.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:30 smithi184 ceph-mon[184130]: osd.4 [v2:172.21.15.184:6808/992163260,v1:172.21.15.184:6809/992163260] boot 2023-12-16T03:22:30.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:30 smithi184 ceph-mon[184130]: osdmap e70: 6 total, 6 up, 6 in 2023-12-16T03:22:30.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:30 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T03:22:30.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.839+0000 7fa8e7335700 1 -- 172.21.15.64:0/449051919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 msgr2=0x7fa8e00fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.839+0000 7fa8e7335700 1 --2- 172.21.15.64:0/449051919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 0x7fa8e00fbfb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0004940 tx=0x7fa8d0009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:30.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.839+0000 7fa8e7335700 1 -- 172.21.15.64:0/449051919 shutdown_connections 2023-12-16T03:22:30.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.839+0000 7fa8e7335700 1 --2- 172.21.15.64:0/449051919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 0x7fa8e00fbfb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.839+0000 7fa8e7335700 1 --2- 172.21.15.64:0/449051919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e0101b00 0x7fa8e0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.839+0000 7fa8e7335700 1 -- 172.21.15.64:0/449051919 >> 172.21.15.64:0/449051919 conn(0x7fa8e00719b0 msgr2=0x7fa8e0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:30.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.839+0000 7fa8e7335700 1 -- 172.21.15.64:0/449051919 shutdown_connections 2023-12-16T03:22:30.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.839+0000 7fa8e7335700 1 -- 172.21.15.64:0/449051919 wait complete. 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e7335700 1 Processor -- start 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e7335700 1 -- start start 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e7335700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 0x7fa8e01136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e7335700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e0101b00 0x7fa8e0113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e7335700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0114280 con 0x7fa8e00fbb40 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e7335700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e010d570 con 0x7fa8e0101b00 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e50d1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 0x7fa8e01136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e50d1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 0x7fa8e01136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33904/0 (socket says 172.21.15.64:33904) 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e50d1700 1 -- 172.21.15.64:0/3177896926 learned_addr learned my addr 172.21.15.64:0/3177896926 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e48d0700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e0101b00 0x7fa8e0113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e50d1700 1 -- 172.21.15.64:0/3177896926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e0101b00 msgr2=0x7fa8e0113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e50d1700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e0101b00 0x7fa8e0113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:30.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.840+0000 7fa8e50d1700 1 -- 172.21.15.64:0/3177896926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0005040 con 0x7fa8e00fbb40 2023-12-16T03:22:30.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.841+0000 7fa8e50d1700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 0x7fa8e01136f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc002a50 tx=0x7fa8dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.841+0000 7fa8d5ffb700 1 -- 172.21.15.64:0/3177896926 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8dc007cc0 con 0x7fa8e00fbb40 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.841+0000 7fa8d5ffb700 1 -- 172.21.15.64:0/3177896926 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8dc00f040 con 0x7fa8e00fbb40 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.841+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e010d850 con 0x7fa8e00fbb40 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.841+0000 7fa8d5ffb700 1 -- 172.21.15.64:0/3177896926 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8dc00d9c0 con 0x7fa8e00fbb40 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.841+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e010dd90 con 0x7fa8e00fbb40 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.842+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e01133a0 con 0x7fa8e00fbb40 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.842+0000 7fa8d5ffb700 1 -- 172.21.15.64:0/3177896926 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa8dc00db20 con 0x7fa8e00fbb40 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.843+0000 7fa8d5ffb700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa8cc06ce60 0x7fa8cc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.843+0000 7fa8d5ffb700 1 -- 172.21.15.64:0/3177896926 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa8dc08bfb0 con 0x7fa8e00fbb40 2023-12-16T03:22:30.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.843+0000 7fa8e48d0700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa8cc06ce60 0x7fa8cc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:30.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.843+0000 7fa8e48d0700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa8cc06ce60 0x7fa8cc06f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8e010ef50 tx=0x7fa8d0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:30.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:30.847+0000 7fa8d5ffb700 1 -- 172.21.15.64:0/3177896926 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fa8dc059970 con 0x7fa8e00fbb40 2023-12-16T03:22:31.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.057+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8e010ed00 con 0x7fa8cc06ce60 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.067+0000 7fa8d5ffb700 1 -- 172.21.15.64:0/3177896926 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa8e010ed00 con 0x7fa8cc06ce60 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (4m) 64s ago 12m 29.4M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (2m) 64s ago 12m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f a416f0797862 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (2m) 6s ago 11m 7444k - 19.0.0-191-g6d933094 a29c258b5d6f 4d5da6df7dee 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (4m) 64s ago 12m 87.4M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (8m) 64s ago 8m 15.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (8m) 64s ago 8m 6646M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (8m) 6s ago 8m 4652M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:22:31.069 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (8m) 6s ago 8m 16.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (5m) 64s ago 13m 511M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (5m) 6s ago 11m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (3m) 64s ago 13m 65.5M 2048M 19.0.0-191-g6d933094 a29c258b5d6f fcfcecd16324 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (2m) 6s ago 11m 57.5M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 1523b5eb5b04 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (4m) 64s ago 12m 18.2M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (4m) 6s ago 11m 19.6M - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (2m) 64s ago 11m 121M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ff051ca1c9ba 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (97s) 64s ago 10m 123M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 16e84d481761 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (67s) 64s ago 10m 15.0M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 237e9d69d7c9 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (37s) 6s ago 10m 131M 2592M 19.0.0-191-g6d933094 a29c258b5d6f da6380fd0161 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (8s) 6s ago 9m 14.7M 2592M 19.0.0-191-g6d933094 a29c258b5d6f c2b8b55e6a90 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (9m) 6s ago 9m 879M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 126c00aa29bf 2023-12-16T03:22:31.070 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (4m) 64s ago 12m 60.6M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa8cc06ce60 msgr2=0x7fa8cc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa8cc06ce60 0x7fa8cc06f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8e010ef50 tx=0x7fa8d0009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 msgr2=0x7fa8e01136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 0x7fa8e01136f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc002a50 tx=0x7fa8dc0046b0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 shutdown_connections 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fa8cc06ce60 0x7fa8cc06f310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8e00fbb40 0x7fa8e01136f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 --2- 172.21.15.64:0/3177896926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8e0101b00 0x7fa8e0113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 >> 172.21.15.64:0/3177896926 conn(0x7fa8e00719b0 msgr2=0x7fa8e00654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 shutdown_connections 2023-12-16T03:22:31.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.069+0000 7fa8e7335700 1 -- 172.21.15.64:0/3177896926 wait complete. 2023-12-16T03:22:31.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.172+0000 7f8e75968700 1 -- 172.21.15.64:0/1799759482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 msgr2=0x7f8e70102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.172+0000 7f8e75968700 1 --2- 172.21.15.64:0/1799759482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 0x7f8e70102fd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8e60004940 tx=0x7f8e60009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:31.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.172+0000 7f8e75968700 1 -- 172.21.15.64:0/1799759482 shutdown_connections 2023-12-16T03:22:31.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.172+0000 7f8e75968700 1 --2- 172.21.15.64:0/1799759482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e701035a0 0x7f8e700fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.172+0000 7f8e75968700 1 --2- 172.21.15.64:0/1799759482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 0x7f8e70102fd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.173+0000 7f8e75968700 1 -- 172.21.15.64:0/1799759482 >> 172.21.15.64:0/1799759482 conn(0x7f8e700f8790 msgr2=0x7f8e700faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.173+0000 7f8e75968700 1 -- 172.21.15.64:0/1799759482 shutdown_connections 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.173+0000 7f8e75968700 1 -- 172.21.15.64:0/1799759482 wait complete. 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.173+0000 7f8e75968700 1 Processor -- start 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.173+0000 7f8e75968700 1 -- start start 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.173+0000 7f8e75968700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 0x7f8e70113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.173+0000 7f8e75968700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e701035a0 0x7f8e70113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.173+0000 7f8e75968700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e701141d0 con 0x7f8e70102c00 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.173+0000 7f8e75968700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7010d510 con 0x7f8e701035a0 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e6effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 0x7f8e70113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e6effd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 0x7f8e70113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33918/0 (socket says 172.21.15.64:33918) 2023-12-16T03:22:31.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e6effd700 1 -- 172.21.15.64:0/3729200220 learned_addr learned my addr 172.21.15.64:0/3729200220 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e6e7fc700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e701035a0 0x7f8e70113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e6effd700 1 -- 172.21.15.64:0/3729200220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e701035a0 msgr2=0x7f8e70113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e6effd700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e701035a0 0x7f8e70113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e6effd700 1 -- 172.21.15.64:0/3729200220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60005040 con 0x7f8e70102c00 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e6effd700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 0x7f8e70113640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009180 tx=0x7f8e60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e577fe700 1 -- 172.21.15.64:0/3729200220 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e6000e040 con 0x7f8e70102c00 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7010d790 con 0x7f8e70102c00 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e577fe700 1 -- 172.21.15.64:0/3729200220 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e60013420 con 0x7f8e70102c00 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e577fe700 1 -- 172.21.15.64:0/3729200220 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e6001c630 con 0x7f8e70102c00 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.174+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7010dcd0 con 0x7f8e70102c00 2023-12-16T03:22:31.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.175+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e701132f0 con 0x7f8e70102c00 2023-12-16T03:22:31.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.176+0000 7f8e577fe700 1 -- 172.21.15.64:0/3729200220 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f8e600139e0 con 0x7f8e70102c00 2023-12-16T03:22:31.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.176+0000 7f8e577fe700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8e5806ce60 0x7f8e5806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:31.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.176+0000 7f8e577fe700 1 -- 172.21.15.64:0/3729200220 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8e6008d5b0 con 0x7f8e70102c00 2023-12-16T03:22:31.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.176+0000 7f8e6e7fc700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8e5806ce60 0x7f8e5806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:31.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.177+0000 7f8e6e7fc700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8e5806ce60 0x7f8e5806f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e7010eea0 tx=0x7f8e64009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:31.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.181+0000 7f8e577fe700 1 -- 172.21.15.64:0/3729200220 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f8e6005aff0 con 0x7f8e70102c00 2023-12-16T03:22:31.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.470+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8e7010ebe0 con 0x7f8e70102c00 2023-12-16T03:22:31.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.470+0000 7f8e577fe700 1 -- 172.21.15.64:0/3729200220 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f8e6005ab80 con 0x7f8e70102c00 2023-12-16T03:22:31.472 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:22:31.472 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:22:31.472 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:22:31.472 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:22:31.472 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:22:31.472 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 5 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5, 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 9 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:22:31.473 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:22:31.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8e5806ce60 msgr2=0x7f8e5806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8e5806ce60 0x7f8e5806f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e7010eea0 tx=0x7f8e64009040 comp rx=0 tx=0).stop 2023-12-16T03:22:31.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 msgr2=0x7f8e70113640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 0x7f8e70113640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009180 tx=0x7f8e60009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:31.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 shutdown_connections 2023-12-16T03:22:31.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f8e5806ce60 0x7f8e5806f310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e70102c00 0x7f8e70113640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 --2- 172.21.15.64:0/3729200220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e701035a0 0x7f8e70113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 >> 172.21.15.64:0/3729200220 conn(0x7f8e700f8790 msgr2=0x7f8e700fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:31.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.472+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 shutdown_connections 2023-12-16T03:22:31.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.473+0000 7f8e75968700 1 -- 172.21.15.64:0/3729200220 wait complete. 2023-12-16T03:22:31.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.576+0000 7f26ff0b4700 1 -- 172.21.15.64:0/989244053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 msgr2=0x7f26f80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.576+0000 7f26ff0b4700 1 --2- 172.21.15.64:0/989244053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 0x7f26f80fbfb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f26e4004940 tx=0x7f26e4009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:31.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.576+0000 7f26ff0b4700 1 -- 172.21.15.64:0/989244053 shutdown_connections 2023-12-16T03:22:31.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.576+0000 7f26ff0b4700 1 --2- 172.21.15.64:0/989244053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 0x7f26f80fbfb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.576+0000 7f26ff0b4700 1 --2- 172.21.15.64:0/989244053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26f8101b00 0x7f26f8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.576+0000 7f26ff0b4700 1 -- 172.21.15.64:0/989244053 >> 172.21.15.64:0/989244053 conn(0x7f26f80719b0 msgr2=0x7f26f8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:31.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.576+0000 7f26ff0b4700 1 -- 172.21.15.64:0/989244053 shutdown_connections 2023-12-16T03:22:31.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.576+0000 7f26ff0b4700 1 -- 172.21.15.64:0/989244053 wait complete. 2023-12-16T03:22:31.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.577+0000 7f26ff0b4700 1 Processor -- start 2023-12-16T03:22:31.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.577+0000 7f26ff0b4700 1 -- start start 2023-12-16T03:22:31.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.577+0000 7f26ff0b4700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 0x7f26f810e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:31.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.577+0000 7f26ff0b4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26f8101b00 0x7f26f810ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:31.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.577+0000 7f26ff0b4700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f810f180 con 0x7f26f80fbb40 2023-12-16T03:22:31.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.577+0000 7f26ff0b4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f810f2f0 con 0x7f26f8101b00 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.577+0000 7f26fce50700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 0x7f26f810e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.577+0000 7f26fce50700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 0x7f26f810e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33936/0 (socket says 172.21.15.64:33936) 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.577+0000 7f26fce50700 1 -- 172.21.15.64:0/1853178743 learned_addr learned my addr 172.21.15.64:0/1853178743 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26f7fff700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26f8101b00 0x7f26f810ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26fce50700 1 -- 172.21.15.64:0/1853178743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26f8101b00 msgr2=0x7f26f810ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26fce50700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26f8101b00 0x7f26f810ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26fce50700 1 -- 172.21.15.64:0/1853178743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4005040 con 0x7f26f80fbb40 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26fce50700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 0x7f26f810e690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f26ec002a80 tx=0x7f26ec0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26f57fa700 1 -- 172.21.15.64:0/1853178743 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26ec007cc0 con 0x7f26f80fbb40 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f8117660 con 0x7f26f80fbb40 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26f57fa700 1 -- 172.21.15.64:0/1853178743 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26ec00f040 con 0x7f26f80fbb40 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26f57fa700 1 -- 172.21.15.64:0/1853178743 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26ec009640 con 0x7f26f80fbb40 2023-12-16T03:22:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.578+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f8117b70 con 0x7f26f80fbb40 2023-12-16T03:22:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.579+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f80734d0 con 0x7f26f80fbb40 2023-12-16T03:22:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.580+0000 7f26f57fa700 1 -- 172.21.15.64:0/1853178743 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f26ec0097a0 con 0x7f26f80fbb40 2023-12-16T03:22:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.580+0000 7f26f57fa700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f26e806ce70 0x7f26e806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.580+0000 7f26f57fa700 1 -- 172.21.15.64:0/1853178743 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f26ec08ba60 con 0x7f26f80fbb40 2023-12-16T03:22:31.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.580+0000 7f26f7fff700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f26e806ce70 0x7f26e806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:31.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.581+0000 7f26f7fff700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f26e806ce70 0x7f26e806f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26e400b020 tx=0x7f26e4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:31.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.585+0000 7f26f57fa700 1 -- 172.21.15.64:0/1853178743 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f26ec055990 con 0x7f26f80fbb40 2023-12-16T03:22:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:31 smithi064 ceph-mon[216854]: pgmap v118: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2023-12-16T03:22:31.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:31 smithi064 ceph-mon[216854]: osdmap e71: 6 total, 6 up, 6 in 2023-12-16T03:22:31.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:31 smithi064 ceph-mon[216854]: failed to encode map e71 with expected crc 2023-12-16T03:22:31.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:31 smithi064 ceph-mon[216854]: failed to encode map e71 with expected crc 2023-12-16T03:22:31.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:31 smithi184 ceph-mon[184130]: pgmap v118: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 62/366 objects degraded (16.940%) 2023-12-16T03:22:31.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:31 smithi184 ceph-mon[184130]: osdmap e71: 6 total, 6 up, 6 in 2023-12-16T03:22:31.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:31 smithi184 ceph-mon[184130]: failed to encode map e71 with expected crc 2023-12-16T03:22:31.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:31 smithi184 ceph-mon[184130]: failed to encode map e71 with expected crc 2023-12-16T03:22:31.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.828+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f26f8117d90 con 0x7f26f80fbb40 2023-12-16T03:22:31.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.828+0000 7f26f57fa700 1 -- 172.21.15.64:0/1853178743 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f26ec058fb0 con 0x7f26f80fbb40 2023-12-16T03:22:31.830 INFO:teuthology.orchestra.run.smithi064.stdout:e17 2023-12-16T03:22:31.830 INFO:teuthology.orchestra.run.smithi064.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T03:22:31.830 INFO:teuthology.orchestra.run.smithi064.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:22:31.830 INFO:teuthology.orchestra.run.smithi064.stdout:legacy client fscid: 1 2023-12-16T03:22:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:Filesystem 'cephfs' (1) 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:fs_name cephfs 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 17 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-12-16T03:13:53.443533+0000 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:modified 2023-12-16T03:20:28.477911+0000 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:tableserver 0 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:root 0 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:session_timeout 60 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:session_autoclose 300 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:max_file_size 1099511627776 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:max_xattr_size 65536 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:required_client_features {} 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure 0 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:last_failure_osd_epoch 0 2023-12-16T03:22:31.831 INFO:teuthology.orchestra.run.smithi064.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:max_mds 2 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:in 0,1 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:up {0=14460,1=24269} 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:failed 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:damaged 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:stopped 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:data_pools [3] 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:metadata_pool 2 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:inline_data enabled 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:balancer 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:bal_rank_mask -1 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:standby_count_wanted 1 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.jaepzs{0:14460} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.64:6826/3506550972,v1:172.21.15.64:6827/3506550972] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.jfpiqk{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.184:6824/885772583,v1:172.21.15.184:6825/885772583] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:22:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:22:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:22:31.833 INFO:teuthology.orchestra.run.smithi064.stdout:Standby daemons: 2023-12-16T03:22:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:22:31.833 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi064.edrjyd{-1:14472} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6828/1065201064,v1:172.21.15.64:6829/1065201064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:22:31.833 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.cephfs.smithi184.uqpwjn{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/2576924937,v1:172.21.15.184:6827/2576924937] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T03:22:31.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.830+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f26e806ce70 msgr2=0x7f26e806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.830+0000 7f26ff0b4700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f26e806ce70 0x7f26e806f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26e400b020 tx=0x7f26e4009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:31.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.830+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 msgr2=0x7f26f810e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.830+0000 7f26ff0b4700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 0x7f26f810e690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f26ec002a80 tx=0x7f26ec0046b0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.830+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 shutdown_connections 2023-12-16T03:22:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.830+0000 7f26ff0b4700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f26e806ce70 0x7f26e806f320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.830+0000 7f26ff0b4700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f26f80fbb40 0x7f26f810e690 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.830+0000 7f26ff0b4700 1 --2- 172.21.15.64:0/1853178743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26f8101b00 0x7f26f810ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.830+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 >> 172.21.15.64:0/1853178743 conn(0x7f26f80719b0 msgr2=0x7f26f80faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.831+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 shutdown_connections 2023-12-16T03:22:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.831+0000 7f26ff0b4700 1 -- 172.21.15.64:0/1853178743 wait complete. 2023-12-16T03:22:31.835 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 17 2023-12-16T03:22:31.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.935+0000 7fb9c0646700 1 -- 172.21.15.64:0/299384431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80fbb40 msgr2=0x7fb9b80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.935+0000 7fb9c0646700 1 --2- 172.21.15.64:0/299384431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80fbb40 0x7fb9b80fbfb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8004940 tx=0x7fb9a8009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 -- 172.21.15.64:0/299384431 shutdown_connections 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 --2- 172.21.15.64:0/299384431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b80fbb40 0x7fb9b80fbfb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 --2- 172.21.15.64:0/299384431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b8101b00 0x7fb9b8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 -- 172.21.15.64:0/299384431 >> 172.21.15.64:0/299384431 conn(0x7fb9b80719b0 msgr2=0x7fb9b8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 -- 172.21.15.64:0/299384431 shutdown_connections 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 -- 172.21.15.64:0/299384431 wait complete. 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 Processor -- start 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 -- start start 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80fbb40 0x7fb9b810e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b8101b00 0x7fb9b810ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b810f180 con 0x7fb9b8101b00 2023-12-16T03:22:31.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9c0646700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b810f2f0 con 0x7fb9b80fbb40 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.936+0000 7fb9bdbe1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b8101b00 0x7fb9b810ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9bdbe1700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b8101b00 0x7fb9b810ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33960/0 (socket says 172.21.15.64:33960) 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9bdbe1700 1 -- 172.21.15.64:0/3629948253 learned_addr learned my addr 172.21.15.64:0/3629948253 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9be3e2700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80fbb40 0x7fb9b810e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9bdbe1700 1 -- 172.21.15.64:0/3629948253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80fbb40 msgr2=0x7fb9b810e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9bdbe1700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80fbb40 0x7fb9b810e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9bdbe1700 1 -- 172.21.15.64:0/3629948253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8005040 con 0x7fb9b8101b00 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9bdbe1700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b8101b00 0x7fb9b810ebd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009360 tx=0x7fb9a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9aeffd700 1 -- 172.21.15.64:0/3629948253 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a800e040 con 0x7fb9b8101b00 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9aeffd700 1 -- 172.21.15.64:0/3629948253 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb9a8013420 con 0x7fb9b8101b00 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b8117600 con 0x7fb9b8101b00 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9aeffd700 1 -- 172.21.15.64:0/3629948253 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a801c610 con 0x7fb9b8101b00 2023-12-16T03:22:31.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.937+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b8117b10 con 0x7fb9b8101b00 2023-12-16T03:22:31.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.938+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b80734d0 con 0x7fb9b8101b00 2023-12-16T03:22:31.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.939+0000 7fb9aeffd700 1 -- 172.21.15.64:0/3629948253 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb9a8013590 con 0x7fb9b8101b00 2023-12-16T03:22:31.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.939+0000 7fb9aeffd700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fb9a406ce70 0x7fb9a406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:31.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.939+0000 7fb9be3e2700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fb9a406ce70 0x7fb9a406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:31.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.939+0000 7fb9aeffd700 1 -- 172.21.15.64:0/3629948253 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb9a808d4b0 con 0x7fb9b8101b00 2023-12-16T03:22:31.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.940+0000 7fb9be3e2700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fb9a406ce70 0x7fb9a406f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009fd0 tx=0x7fb9b400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:31.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:31.944+0000 7fb9aeffd700 1 -- 172.21.15.64:0/3629948253 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb9a8057510 con 0x7fb9b8101b00 2023-12-16T03:22:32.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.169+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b8065be0 con 0x7fb9a406ce70 2023-12-16T03:22:32.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.171+0000 7fb9aeffd700 1 -- 172.21.15.64:0/3629948253 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb9b8065be0 con 0x7fb9a406ce70 2023-12-16T03:22:32.172 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:22:32.172 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:22:32.172 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout: "crash", 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout: "mon", 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "11/21 daemons upgraded", 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": false 2023-12-16T03:22:32.173 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fb9a406ce70 msgr2=0x7fb9a406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fb9a406ce70 0x7fb9a406f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009fd0 tx=0x7fb9b400b040 comp rx=0 tx=0).stop 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b8101b00 msgr2=0x7fb9b810ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b8101b00 0x7fb9b810ebd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009360 tx=0x7fb9a8009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 shutdown_connections 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fb9a406ce70 0x7fb9a406f320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9b80fbb40 0x7fb9b810e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 --2- 172.21.15.64:0/3629948253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9b8101b00 0x7fb9b810ebd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 >> 172.21.15.64:0/3629948253 conn(0x7fb9b80719b0 msgr2=0x7fb9b80faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 shutdown_connections 2023-12-16T03:22:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.173+0000 7fb9c0646700 1 -- 172.21.15.64:0/3629948253 wait complete. 2023-12-16T03:22:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.277+0000 7f6c5632b700 1 -- 172.21.15.64:0/1429279515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 msgr2=0x7f6c500fb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.277+0000 7f6c5632b700 1 --2- 172.21.15.64:0/1429279515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 0x7f6c500fb2d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c38004940 tx=0x7f6c38009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.277+0000 7f6c5632b700 1 -- 172.21.15.64:0/1429279515 shutdown_connections 2023-12-16T03:22:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.277+0000 7f6c5632b700 1 --2- 172.21.15.64:0/1429279515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 0x7f6c500fb2d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.277+0000 7f6c5632b700 1 --2- 172.21.15.64:0/1429279515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c50101270 0x7f6c50101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.277+0000 7f6c5632b700 1 -- 172.21.15.64:0/1429279515 >> 172.21.15.64:0/1429279515 conn(0x7f6c500711a0 msgr2=0x7f6c500715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.277+0000 7f6c5632b700 1 -- 172.21.15.64:0/1429279515 shutdown_connections 2023-12-16T03:22:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.277+0000 7f6c5632b700 1 -- 172.21.15.64:0/1429279515 wait complete. 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.277+0000 7f6c5632b700 1 Processor -- start 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c5632b700 1 -- start start 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c5632b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c50101270 0x7f6c50113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c5632b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 0x7f6c50113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c5632b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c50114240 con 0x7f6c50101c10 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c5632b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5010d530 con 0x7f6c50101270 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c4f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 0x7f6c50113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c4f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 0x7f6c50113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33984/0 (socket says 172.21.15.64:33984) 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c4f7fe700 1 -- 172.21.15.64:0/1846538124 learned_addr learned my addr 172.21.15.64:0/1846538124 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c4ffff700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c50101270 0x7f6c50113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:32.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c4f7fe700 1 -- 172.21.15.64:0/1846538124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c50101270 msgr2=0x7f6c50113670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:32.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c4f7fe700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c50101270 0x7f6c50113670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:32.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c4f7fe700 1 -- 172.21.15.64:0/1846538124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38005040 con 0x7f6c50101c10 2023-12-16T03:22:32.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.278+0000 7f6c4f7fe700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 0x7f6c50113bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009360 tx=0x7f6c38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:32.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.279+0000 7f6c4cff9700 1 -- 172.21.15.64:0/1846538124 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c3800e040 con 0x7f6c50101c10 2023-12-16T03:22:32.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.279+0000 7f6c4cff9700 1 -- 172.21.15.64:0/1846538124 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6c38013420 con 0x7f6c50101c10 2023-12-16T03:22:32.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.279+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5010d760 con 0x7f6c50101c10 2023-12-16T03:22:32.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.279+0000 7f6c4cff9700 1 -- 172.21.15.64:0/1846538124 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c3801c610 con 0x7f6c50101c10 2023-12-16T03:22:32.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.279+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5010dca0 con 0x7f6c50101c10 2023-12-16T03:22:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.280+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c50103740 con 0x7f6c50101c10 2023-12-16T03:22:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.280+0000 7f6c4cff9700 1 -- 172.21.15.64:0/1846538124 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f6c38013590 con 0x7f6c50101c10 2023-12-16T03:22:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.281+0000 7f6c4cff9700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c3c06ce70 0x7f6c3c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:22:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.281+0000 7f6c4cff9700 1 -- 172.21.15.64:0/1846538124 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6c3808d4c0 con 0x7f6c50101c10 2023-12-16T03:22:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.281+0000 7f6c4ffff700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c3c06ce70 0x7f6c3c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:22:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.281+0000 7f6c4ffff700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c3c06ce70 0x7f6c3c06f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c500f9930 tx=0x7f6c40009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:22:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.285+0000 7f6c4cff9700 1 -- 172.21.15.64:0/1846538124 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f6c3805ae80 con 0x7f6c50101c10 2023-12-16T03:22:32.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.571+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6c50072cc0 con 0x7f6c50101c10 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.571+0000 7f6c4cff9700 1 -- 172.21.15.64:0/1846538124 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+928 (secure 0 0 0) 0x7f6c3805aa10 con 0x7f6c50101c10 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 32/366 objects degraded (8.743%), 10 pgs degraded 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 32/366 objects degraded (8.743%), 10 pgs degraded 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2023-12-16T03:22:32.573 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2023-12-16T03:22:32.574 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2023-12-16T03:22:32.574 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2023-12-16T03:22:32.574 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2023-12-16T03:22:32.574 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2023-12-16T03:22:32.574 INFO:teuthology.orchestra.run.smithi064.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2023-12-16T03:22:32.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c3c06ce70 msgr2=0x7f6c3c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c3c06ce70 0x7f6c3c06f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c500f9930 tx=0x7f6c40009040 comp rx=0 tx=0).stop 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 msgr2=0x7f6c50113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 0x7f6c50113bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009360 tx=0x7f6c38009e30 comp rx=0 tx=0).stop 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 shutdown_connections 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6c3c06ce70 0x7f6c3c06f320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c50101270 0x7f6c50113670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 --2- 172.21.15.64:0/1846538124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c50101c10 0x7f6c50113bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 >> 172.21.15.64:0/1846538124 conn(0x7f6c500711a0 msgr2=0x7f6c500fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 shutdown_connections 2023-12-16T03:22:32.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:22:32.573+0000 7f6c5632b700 1 -- 172.21.15.64:0/1846538124 wait complete. 2023-12-16T03:22:32.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:32 smithi064 ceph-mon[216854]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:32.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:32 smithi064 ceph-mon[216854]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:32.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:32 smithi064 ceph-mon[216854]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:32.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:32 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/3729200220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:32.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:32 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/1853178743' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:22:32.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:32 smithi184 ceph-mon[184130]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:32.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:32 smithi184 ceph-mon[184130]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:32.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:32 smithi184 ceph-mon[184130]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:32.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:32 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/3729200220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:32.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:32 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/1853178743' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T03:22:33.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:33 smithi064 ceph-mon[216854]: pgmap v121: 65 pgs: 10 peering, 10 active+undersized+degraded, 10 active+undersized, 35 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32/366 objects degraded (8.743%) 2023-12-16T03:22:33.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:33 smithi064 ceph-mon[216854]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:33.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:33 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/1846538124' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:22:33.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:33 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 32/366 objects degraded (8.743%), 10 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:33.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:33 smithi184 ceph-mon[184130]: pgmap v121: 65 pgs: 10 peering, 10 active+undersized+degraded, 10 active+undersized, 35 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32/366 objects degraded (8.743%) 2023-12-16T03:22:33.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:33 smithi184 ceph-mon[184130]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:22:33.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:33 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/1846538124' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:22:33.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:33 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 32/366 objects degraded (8.743%), 10 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:35.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:35 smithi064 ceph-mon[216854]: pgmap v122: 65 pgs: 10 peering, 10 active+undersized+degraded, 10 active+undersized, 35 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32/366 objects degraded (8.743%) 2023-12-16T03:22:35.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:35 smithi184 ceph-mon[184130]: pgmap v122: 65 pgs: 10 peering, 10 active+undersized+degraded, 10 active+undersized, 35 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32/366 objects degraded (8.743%) 2023-12-16T03:22:36.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:36 smithi064 ceph-mon[216854]: pgmap v123: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:36.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:36 smithi064 ceph-mon[216854]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/366 objects degraded (8.743%), 10 pgs degraded) 2023-12-16T03:22:36.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:36 smithi184 ceph-mon[184130]: pgmap v123: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:36.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:36 smithi184 ceph-mon[184130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/366 objects degraded (8.743%), 10 pgs degraded) 2023-12-16T03:22:38.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:38 smithi064 ceph-mon[216854]: pgmap v124: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:39.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:38 smithi184 ceph-mon[184130]: pgmap v124: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:40.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:40 smithi064 ceph-mon[216854]: pgmap v125: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:40.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:40 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:40.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:40 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:22:40.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:40 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:41.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:40 smithi184 ceph-mon[184130]: pgmap v125: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:41.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:40 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:41.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:40 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:22:41.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:40 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:42.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:42 smithi064 ceph-mon[216854]: pgmap v126: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:43.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:42 smithi184 ceph-mon[184130]: pgmap v126: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:43.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:43 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T03:22:43.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:43 smithi064 ceph-mon[216854]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T03:22:43.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:43 smithi064 ceph-mon[216854]: Upgrade: osd.5 is safe to restart 2023-12-16T03:22:44.038 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:43 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T03:22:44.038 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:43 smithi184 ceph-mon[184130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T03:22:44.038 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:43 smithi184 ceph-mon[184130]: Upgrade: osd.5 is safe to restart 2023-12-16T03:22:44.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:44 smithi064 ceph-mon[216854]: pgmap v127: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:44.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:44 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:44.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:44 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T03:22:44.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:44 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:45.027 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:44 smithi184 ceph-mon[184130]: pgmap v127: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:45.028 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:44 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:45.028 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:44 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T03:22:45.028 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:44 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:45.949 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:45 smithi184 ceph-mon[184130]: Upgrade: Updating osd.5 2023-12-16T03:22:45.949 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:45 smithi184 ceph-mon[184130]: Deploying daemon osd.5 on smithi184 2023-12-16T03:22:46.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:45 smithi064 ceph-mon[216854]: Upgrade: Updating osd.5 2023-12-16T03:22:46.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:45 smithi064 ceph-mon[216854]: Deploying daemon osd.5 on smithi184 2023-12-16T03:22:47.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:46 smithi184 ceph-mon[184130]: pgmap v128: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:47.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:46 smithi184 systemd[1]: Stopping Ceph osd.5 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:22:47.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:46 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[143756]: 2023-12-16T03:22:46.857+0000 7f1caae6d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:22:47.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:46 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[143756]: 2023-12-16T03:22:46.857+0000 7f1caae6d700 -1 osd.5 71 *** Got signal Terminated *** 2023-12-16T03:22:47.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:46 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[143756]: 2023-12-16T03:22:46.857+0000 7f1caae6d700 -1 osd.5 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:22:47.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:46 smithi064 ceph-mon[216854]: pgmap v128: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:48.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:47 smithi184 ceph-mon[184130]: osd.5 marked itself down and dead 2023-12-16T03:22:48.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:47 smithi064 ceph-mon[216854]: osd.5 marked itself down and dead 2023-12-16T03:22:48.561 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:48 smithi184 bash[209106]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5 2023-12-16T03:22:48.960 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:48 smithi184 ceph-mon[184130]: pgmap v129: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:48.960 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:48 smithi184 ceph-mon[184130]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:22:48.960 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:48 smithi184 ceph-mon[184130]: osdmap e72: 6 total, 5 up, 6 in 2023-12-16T03:22:49.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:48 smithi064 ceph-mon[216854]: pgmap v129: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:22:49.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:48 smithi064 ceph-mon[216854]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T03:22:49.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:48 smithi064 ceph-mon[216854]: osdmap e72: 6 total, 5 up, 6 in 2023-12-16T03:22:50.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:49 smithi184 ceph-mon[184130]: osdmap e73: 6 total, 5 up, 6 in 2023-12-16T03:22:50.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:49 smithi184 systemd[1]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.5.service: Succeeded. 2023-12-16T03:22:50.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:49 smithi184 systemd[1]: Stopped Ceph osd.5 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:22:50.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:49 smithi184 systemd[1]: Starting Ceph osd.5 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:22:50.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:49 smithi064 ceph-mon[216854]: osdmap e73: 6 total, 5 up, 6 in 2023-12-16T03:22:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:50 smithi184 ceph-mon[184130]: pgmap v132: 65 pgs: 3 active+undersized+degraded, 10 peering, 4 stale+active+clean, 2 active+undersized, 46 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 9/366 objects degraded (2.459%) 2023-12-16T03:22:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:50 smithi184 ceph-mon[184130]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2023-12-16T03:22:51.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:50 smithi184 ceph-mon[184130]: Health check failed: Degraded data redundancy: 9/366 objects degraded (2.459%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:51.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:50 smithi184 bash[209374]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T03:22:51.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:50 smithi184 bash[209374]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T03:22:51.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:50 smithi184 bash[209374]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T03:22:51.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:50 smithi184 bash[209374]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T03:22:51.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:50 smithi184 bash[209374]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-16T03:22:51.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:50 smithi184 bash[209374]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T03:22:51.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:50 smithi184 bash[209374]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-16T03:22:51.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:50 smithi064 ceph-mon[216854]: pgmap v132: 65 pgs: 3 active+undersized+degraded, 10 peering, 4 stale+active+clean, 2 active+undersized, 46 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 9/366 objects degraded (2.459%) 2023-12-16T03:22:51.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:50 smithi064 ceph-mon[216854]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2023-12-16T03:22:51.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:50 smithi064 ceph-mon[216854]: Health check failed: Degraded data redundancy: 9/366 objects degraded (2.459%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:51.560 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:51 smithi184 ceph-osd[209666]: -- 172.21.15.184:0/3672532315 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fdbf1ab6c0 con 0x55fdbf17b000 2023-12-16T03:22:51.561 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:51 smithi184 bash[209628]: ff24811f977de847c439846460f6389ef4e3d214e35ae2aedd6d2d5b94a6ed52 2023-12-16T03:22:51.561 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:51 smithi184 systemd[1]: Started Ceph osd.5 for 5b4de048-9bc0-11ee-95a5-87774f69a715. 2023-12-16T03:22:52.103 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:51 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:22:51.834+0000 7f73e55e4640 -1 Falling back to public interface 2023-12-16T03:22:52.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:52 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:52.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:52 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:52.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:52 smithi064 ceph-mon[216854]: pgmap v133: 65 pgs: 11 active+undersized+degraded, 10 peering, 7 active+undersized, 37 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%) 2023-12-16T03:22:52.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:52 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:52.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:52 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:52.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:52 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:52.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:52 smithi184 ceph-mon[184130]: pgmap v133: 65 pgs: 11 active+undersized+degraded, 10 peering, 7 active+undersized, 37 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%) 2023-12-16T03:22:52.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:52 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:54.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:54.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:54 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:54.716 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:54.716 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:54.716 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:54.716 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:54 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:55.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:55 smithi064 ceph-mon[216854]: pgmap v134: 65 pgs: 11 active+undersized+degraded, 10 peering, 7 active+undersized, 37 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%) 2023-12-16T03:22:55.795 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:55 smithi184 ceph-mon[184130]: pgmap v134: 65 pgs: 11 active+undersized+degraded, 10 peering, 7 active+undersized, 37 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/366 objects degraded (13.115%) 2023-12-16T03:22:56.060 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:55 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:22:55.791+0000 7f73e55e4640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-16T03:22:56.561 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:56 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:22:56.308+0000 7f73e55e4640 -1 osd.5 71 log_to_monitors true 2023-12-16T03:22:56.561 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:22:56 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:22:56.485+0000 7f73d2a4d700 -1 osd.5 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:22:56.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:56 smithi184 ceph-mon[184130]: pgmap v135: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2023-12-16T03:22:56.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:56.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:56 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:22:56.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:56 smithi184 ceph-mon[184130]: from='osd.5 [v2:172.21.15.184:6816/219910245,v1:172.21.15.184:6817/219910245]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T03:22:56.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:56 smithi184 ceph-mon[184130]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T03:22:56.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:56 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 56/366 objects degraded (15.301%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:56.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:56 smithi184 ceph-mon[184130]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2023-12-16T03:22:56.823 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:56 smithi064 ceph-mon[216854]: pgmap v135: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2023-12-16T03:22:56.823 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:56.823 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:56 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:22:56.824 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:56 smithi064 ceph-mon[216854]: from='osd.5 [v2:172.21.15.184:6816/219910245,v1:172.21.15.184:6817/219910245]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T03:22:56.824 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:56 smithi064 ceph-mon[216854]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T03:22:56.824 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:56 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 56/366 objects degraded (15.301%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T03:22:56.824 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:56 smithi064 ceph-mon[216854]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2023-12-16T03:22:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T03:22:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: osdmap e74: 6 total, 5 up, 6 in 2023-12-16T03:22:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='osd.5 [v2:172.21.15.184:6816/219910245,v1:172.21.15.184:6817/219910245]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:57.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: Upgrade: Setting container_image for all osd 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-16T03:22:57.812 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T03:22:57.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: pgmap v137: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2023-12-16T03:22:57.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:57.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:57.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:22:57.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.825 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T03:22:57.825 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: osdmap e74: 6 total, 5 up, 6 in 2023-12-16T03:22:57.825 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='osd.5 [v2:172.21.15.184:6816/219910245,v1:172.21.15.184:6817/219910245]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:57.825 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-12-16T03:22:57.825 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.825 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.825 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:57.825 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: Upgrade: Setting container_image for all osd 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-16T03:22:57.826 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: pgmap v137: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/366 objects degraded (15.301%) 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:22:57.827 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:22:58.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:57 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064[216831]: 2023-12-16T03:22:57.822+0000 7fe8a6858700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T03:22:58.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:58 smithi184 ceph-mon[184130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:22:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:58 smithi184 ceph-mon[184130]: osd.5 [v2:172.21.15.184:6816/219910245,v1:172.21.15.184:6817/219910245] boot 2023-12-16T03:22:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:58 smithi184 ceph-mon[184130]: osdmap e75: 6 total, 6 up, 6 in 2023-12-16T03:22:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:58 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:22:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:58 smithi184 ceph-mon[184130]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T03:22:58.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:58 smithi184 ceph-mon[184130]: osdmap e76: 6 total, 6 up, 6 in 2023-12-16T03:22:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:58 smithi064 ceph-mon[216854]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T03:22:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:58 smithi064 ceph-mon[216854]: osd.5 [v2:172.21.15.184:6816/219910245,v1:172.21.15.184:6817/219910245] boot 2023-12-16T03:22:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:58 smithi064 ceph-mon[216854]: osdmap e75: 6 total, 6 up, 6 in 2023-12-16T03:22:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:58 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T03:22:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:58 smithi064 ceph-mon[216854]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T03:22:58.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:58 smithi064 ceph-mon[216854]: osdmap e76: 6 total, 6 up, 6 in 2023-12-16T03:22:59.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:22:59 smithi184 ceph-mon[184130]: pgmap v140: 65 pgs: 12 active+undersized+degraded, 12 active+undersized, 41 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/366 objects degraded (14.208%) 2023-12-16T03:22:59.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:22:59 smithi064 ceph-mon[216854]: pgmap v140: 65 pgs: 12 active+undersized+degraded, 12 active+undersized, 41 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/366 objects degraded (14.208%) 2023-12-16T03:23:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:01 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:23:01.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:01 smithi184 ceph-mon[184130]: pgmap v141: 65 pgs: 5 active+undersized+degraded, 8 active+undersized, 52 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17/366 objects degraded (4.645%) 2023-12-16T03:23:01.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:01 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:23:01.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:01 smithi064 ceph-mon[216854]: pgmap v141: 65 pgs: 5 active+undersized+degraded, 8 active+undersized, 52 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17/366 objects degraded (4.645%) 2023-12-16T03:23:02.692 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:02 smithi064 ceph-mon[216854]: Health check update: Degraded data redundancy: 17/366 objects degraded (4.645%), 5 pgs degraded (PG_DEGRADED) 2023-12-16T03:23:02.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.690+0000 7fcdced68700 1 -- 172.21.15.64:0/810353480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 msgr2=0x7fcdc8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.690+0000 7fcdced68700 1 --2- 172.21.15.64:0/810353480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 0x7fcdc8101ed0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc004940 tx=0x7fcdbc009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.690+0000 7fcdced68700 1 -- 172.21.15.64:0/810353480 shutdown_connections 2023-12-16T03:23:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.690+0000 7fcdced68700 1 --2- 172.21.15.64:0/810353480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdc80fbb40 0x7fcdc80fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.690+0000 7fcdced68700 1 --2- 172.21.15.64:0/810353480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 0x7fcdc8101ed0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.690+0000 7fcdced68700 1 -- 172.21.15.64:0/810353480 >> 172.21.15.64:0/810353480 conn(0x7fcdc80719b0 msgr2=0x7fcdc8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.690+0000 7fcdced68700 1 -- 172.21.15.64:0/810353480 shutdown_connections 2023-12-16T03:23:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.690+0000 7fcdced68700 1 -- 172.21.15.64:0/810353480 wait complete. 2023-12-16T03:23:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.691+0000 7fcdced68700 1 Processor -- start 2023-12-16T03:23:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.691+0000 7fcdced68700 1 -- start start 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.691+0000 7fcdced68700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdc80fbb40 0x7fcdc81135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.691+0000 7fcdced68700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 0x7fcdc8113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.691+0000 7fcdced68700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc8114170 con 0x7fcdc8101b00 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.691+0000 7fcdced68700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc810d4a0 con 0x7fcdc80fbb40 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc7fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 0x7fcdc8113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc7fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 0x7fcdc8113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49250/0 (socket says 172.21.15.64:49250) 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc7fff700 1 -- 172.21.15.64:0/1126134470 learned_addr learned my addr 172.21.15.64:0/1126134470 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdccb04700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdc80fbb40 0x7fcdc81135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc7fff700 1 -- 172.21.15.64:0/1126134470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdc80fbb40 msgr2=0x7fcdc81135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc7fff700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdc80fbb40 0x7fcdc81135e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc7fff700 1 -- 172.21.15.64:0/1126134470 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc005040 con 0x7fcdc8101b00 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc7fff700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 0x7fcdc8113b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4002a80 tx=0x7fcdb40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc57fa700 1 -- 172.21.15.64:0/1126134470 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb4007cc0 con 0x7fcdc8101b00 2023-12-16T03:23:02.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc810d780 con 0x7fcdc8101b00 2023-12-16T03:23:02.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc57fa700 1 -- 172.21.15.64:0/1126134470 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdb400f040 con 0x7fcdc8101b00 2023-12-16T03:23:02.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdc57fa700 1 -- 172.21.15.64:0/1126134470 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb4009640 con 0x7fcdc8101b00 2023-12-16T03:23:02.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.692+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc810dcc0 con 0x7fcdc8101b00 2023-12-16T03:23:02.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.693+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc8103fb0 con 0x7fcdc8101b00 2023-12-16T03:23:02.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.694+0000 7fcdc57fa700 1 -- 172.21.15.64:0/1126134470 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fcdb40097a0 con 0x7fcdc8101b00 2023-12-16T03:23:02.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.694+0000 7fcdc57fa700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fcdb806ce70 0x7fcdb806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:02.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.694+0000 7fcdc57fa700 1 -- 172.21.15.64:0/1126134470 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcdb408ba60 con 0x7fcdc8101b00 2023-12-16T03:23:02.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.695+0000 7fcdccb04700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fcdb806ce70 0x7fcdb806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:02.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.695+0000 7fcdccb04700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fcdb806ce70 0x7fcdb806f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00b020 tx=0x7fcdbc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:02.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.700+0000 7fcdc57fa700 1 -- 172.21.15.64:0/1126134470 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fcdb4059420 con 0x7fcdc8101b00 2023-12-16T03:23:02.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:02 smithi184 ceph-mon[184130]: Health check update: Degraded data redundancy: 17/366 objects degraded (4.645%), 5 pgs degraded (PG_DEGRADED) 2023-12-16T03:23:02.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.920+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdc804bbf0 con 0x7fcdb806ce70 2023-12-16T03:23:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.921+0000 7fcdc57fa700 1 -- 172.21.15.64:0/1126134470 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fcdc804bbf0 con 0x7fcdb806ce70 2023-12-16T03:23:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fcdb806ce70 msgr2=0x7fcdb806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fcdb806ce70 0x7fcdb806f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00b020 tx=0x7fcdbc009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 msgr2=0x7fcdc8113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 0x7fcdc8113b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4002a80 tx=0x7fcdb40046b0 comp rx=0 tx=0).stop 2023-12-16T03:23:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 shutdown_connections 2023-12-16T03:23:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fcdb806ce70 0x7fcdb806f320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdc80fbb40 0x7fcdc81135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 --2- 172.21.15.64:0/1126134470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdc8101b00 0x7fcdc8113b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 >> 172.21.15.64:0/1126134470 conn(0x7fcdc80719b0 msgr2=0x7fcdc80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 shutdown_connections 2023-12-16T03:23:02.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:02.924+0000 7fcdced68700 1 -- 172.21.15.64:0/1126134470 wait complete. 2023-12-16T03:23:02.937 INFO:teuthology.orchestra.run.smithi064.stdout:true 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.028+0000 7f470ce45700 1 -- 172.21.15.64:0/1976725765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4708101b00 msgr2=0x7f4708101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.028+0000 7f470ce45700 1 --2- 172.21.15.64:0/1976725765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4708101b00 0x7f4708101ed0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46f8004940 tx=0x7f46f8009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.028+0000 7f470ce45700 1 -- 172.21.15.64:0/1976725765 shutdown_connections 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.028+0000 7f470ce45700 1 --2- 172.21.15.64:0/1976725765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47080fbb40 0x7f47080fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.028+0000 7f470ce45700 1 --2- 172.21.15.64:0/1976725765 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4708101b00 0x7f4708101ed0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.028+0000 7f470ce45700 1 -- 172.21.15.64:0/1976725765 >> 172.21.15.64:0/1976725765 conn(0x7f47080719b0 msgr2=0x7f4708071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.028+0000 7f470ce45700 1 -- 172.21.15.64:0/1976725765 shutdown_connections 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.028+0000 7f470ce45700 1 -- 172.21.15.64:0/1976725765 wait complete. 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f470ce45700 1 Processor -- start 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f470ce45700 1 -- start start 2023-12-16T03:23:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f470ce45700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47080fbb40 0x7f47081136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f470ce45700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708101b00 0x7f4708113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f470ce45700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4708114230 con 0x7f47080fbb40 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f470ce45700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470810d520 con 0x7f4708101b00 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f470659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47080fbb40 0x7f47081136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f470659c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47080fbb40 0x7f47081136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49258/0 (socket says 172.21.15.64:49258) 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f470659c700 1 -- 172.21.15.64:0/2143178629 learned_addr learned my addr 172.21.15.64:0/2143178629 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.029+0000 7f4705d9b700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708101b00 0x7f4708113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.030+0000 7f470659c700 1 -- 172.21.15.64:0/2143178629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708101b00 msgr2=0x7f4708113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.030+0000 7f470659c700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708101b00 0x7f4708113be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.030+0000 7f470659c700 1 -- 172.21.15.64:0/2143178629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8005040 con 0x7f47080fbb40 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.030+0000 7f470659c700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47080fbb40 0x7f47081136a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f46f800b3b0 tx=0x7f46f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.030+0000 7f46f6ffd700 1 -- 172.21.15.64:0/2143178629 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f800e040 con 0x7f47080fbb40 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.030+0000 7f46f6ffd700 1 -- 172.21.15.64:0/2143178629 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f46f800bc50 con 0x7f47080fbb40 2023-12-16T03:23:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.030+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470810d7a0 con 0x7f47080fbb40 2023-12-16T03:23:03.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.030+0000 7f46f6ffd700 1 -- 172.21.15.64:0/2143178629 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f8013420 con 0x7f47080fbb40 2023-12-16T03:23:03.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.030+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470810dce0 con 0x7f47080fbb40 2023-12-16T03:23:03.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.031+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4708113350 con 0x7f47080fbb40 2023-12-16T03:23:03.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.031+0000 7f46f6ffd700 1 -- 172.21.15.64:0/2143178629 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f46f801c430 con 0x7f47080fbb40 2023-12-16T03:23:03.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.032+0000 7f46f6ffd700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f46f006ce60 0x7f46f006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:03.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.032+0000 7f46f6ffd700 1 -- 172.21.15.64:0/2143178629 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f46f808cf60 con 0x7f47080fbb40 2023-12-16T03:23:03.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.032+0000 7f4705d9b700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f46f006ce60 0x7f46f006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:03.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.032+0000 7f4705d9b700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f46f006ce60 0x7f46f006f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f46fc007fd0 tx=0x7f46fc009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:03.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.036+0000 7f46f6ffd700 1 -- 172.21.15.64:0/2143178629 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f46f80c0300 con 0x7f47080fbb40 2023-12-16T03:23:03.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.256+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f470810ecb0 con 0x7f46f006ce60 2023-12-16T03:23:03.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.258+0000 7f46f6ffd700 1 -- 172.21.15.64:0/2143178629 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f470810ecb0 con 0x7f46f006ce60 2023-12-16T03:23:03.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.259+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f46f006ce60 msgr2=0x7f46f006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:03.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.259+0000 7f470ce45700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f46f006ce60 0x7f46f006f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f46fc007fd0 tx=0x7f46fc009040 comp rx=0 tx=0).stop 2023-12-16T03:23:03.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.259+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47080fbb40 msgr2=0x7f47081136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:03.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.259+0000 7f470ce45700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47080fbb40 0x7f47081136a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f46f800b3b0 tx=0x7f46f8009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:03.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.260+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 shutdown_connections 2023-12-16T03:23:03.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.260+0000 7f470ce45700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f46f006ce60 0x7f46f006f310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:03.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.260+0000 7f470ce45700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47080fbb40 0x7f47081136a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:03.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.260+0000 7f470ce45700 1 --2- 172.21.15.64:0/2143178629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708101b00 0x7f4708113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:03.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.260+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 >> 172.21.15.64:0/2143178629 conn(0x7f47080719b0 msgr2=0x7f47080654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:03.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.260+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 shutdown_connections 2023-12-16T03:23:03.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:03.260+0000 7f470ce45700 1 -- 172.21.15.64:0/2143178629 wait complete. 2023-12-16T03:23:03.273 INFO:teuthology.orchestra.run.smithi064.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-16T03:23:03.679 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch ps' 2023-12-16T03:23:03.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:03 smithi064 ceph-mon[216854]: pgmap v142: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:03.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:03 smithi064 ceph-mon[216854]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:23:03.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:03 smithi064 ceph-mon[216854]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:23:03.957 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:23:04.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:03 smithi184 ceph-mon[184130]: pgmap v142: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:04.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:03 smithi184 ceph-mon[184130]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:23:04.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:03 smithi184 ceph-mon[184130]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:23:04.767 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:04 smithi064 ceph-mon[216854]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/366 objects degraded (4.645%), 5 pgs degraded) 2023-12-16T03:23:04.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.948+0000 7f7679f40700 1 -- 172.21.15.64:0/506220268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 msgr2=0x7f7674101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.948+0000 7f7679f40700 1 --2- 172.21.15.64:0/506220268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 0x7f7674101ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7664004940 tx=0x7f7664009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.948+0000 7f7679f40700 1 -- 172.21.15.64:0/506220268 shutdown_connections 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.948+0000 7f7679f40700 1 --2- 172.21.15.64:0/506220268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76740fbb40 0x7f76740fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.948+0000 7f7679f40700 1 --2- 172.21.15.64:0/506220268 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 0x7f7674101ed0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.948+0000 7f7679f40700 1 -- 172.21.15.64:0/506220268 >> 172.21.15.64:0/506220268 conn(0x7f76740719b0 msgr2=0x7f7674071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.948+0000 7f7679f40700 1 -- 172.21.15.64:0/506220268 shutdown_connections 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.948+0000 7f7679f40700 1 -- 172.21.15.64:0/506220268 wait complete. 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7679f40700 1 Processor -- start 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7679f40700 1 -- start start 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7679f40700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76740fbb40 0x7f7674115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7679f40700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 0x7f7674115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:04.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7679f40700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76741163e0 con 0x7f7674101b00 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7679f40700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767410f710 con 0x7f76740fbb40 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7672ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 0x7f7674115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7672ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 0x7f7674115d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49288/0 (socket says 172.21.15.64:49288) 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7672ffd700 1 -- 172.21.15.64:0/4077517403 learned_addr learned my addr 172.21.15.64:0/4077517403 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f76737fe700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76740fbb40 0x7f7674115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7672ffd700 1 -- 172.21.15.64:0/4077517403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76740fbb40 msgr2=0x7f7674115850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7672ffd700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76740fbb40 0x7f7674115850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.949+0000 7f7672ffd700 1 -- 172.21.15.64:0/4077517403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664005040 con 0x7f7674101b00 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.950+0000 7f7672ffd700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 0x7f7674115d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7668002a50 tx=0x7f76680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.950+0000 7f765bfff700 1 -- 172.21.15.64:0/4077517403 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7668007cc0 con 0x7f7674101b00 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.950+0000 7f765bfff700 1 -- 172.21.15.64:0/4077517403 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f766800f040 con 0x7f7674101b00 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.950+0000 7f765bfff700 1 -- 172.21.15.64:0/4077517403 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f766800d9c0 con 0x7f7674101b00 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.950+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767410f9f0 con 0x7f7674101b00 2023-12-16T03:23:04.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.950+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767410ff30 con 0x7f7674101b00 2023-12-16T03:23:04.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.951+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76740734d0 con 0x7f7674101b00 2023-12-16T03:23:04.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.951+0000 7f765bfff700 1 -- 172.21.15.64:0/4077517403 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f766800db20 con 0x7f7674101b00 2023-12-16T03:23:04.956 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.952+0000 7f765bfff700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f765c06ce60 0x7f765c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:04.956 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.952+0000 7f765bfff700 1 -- 172.21.15.64:0/4077517403 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f766808c050 con 0x7f7674101b00 2023-12-16T03:23:04.956 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.952+0000 7f76737fe700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f765c06ce60 0x7f765c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:04.956 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.952+0000 7f76737fe700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f765c06ce60 0x7f765c06f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7664004f90 tx=0x7f7664009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:04.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:04.956+0000 7f765bfff700 1 -- 172.21.15.64:0/4077517403 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f7668059970 con 0x7f7674101b00 2023-12-16T03:23:05.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:04 smithi184 ceph-mon[184130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/366 objects degraded (4.645%), 5 pgs degraded) 2023-12-16T03:23:05.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.171+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7674115520 con 0x7f765c06ce60 2023-12-16T03:23:05.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.181+0000 7f765bfff700 1 -- 172.21.15.64:0/4077517403 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7674115520 con 0x7f765c06ce60 2023-12-16T03:23:05.184 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:23:05.184 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (5m) 98s ago 13m 29.4M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (3m) 98s ago 13m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f a416f0797862 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (2m) 11s ago 12m 7444k - 19.0.0-191-g6d933094 a29c258b5d6f 4d5da6df7dee 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (4m) 98s ago 12m 87.4M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (9m) 98s ago 9m 15.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (9m) 98s ago 9m 6646M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (9m) 11s ago 9m 4652M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (9m) 11s ago 9m 16.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (6m) 98s ago 14m 511M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (5m) 11s ago 12m 450M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:23:05.185 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (3m) 98s ago 14m 65.5M 2048M 19.0.0-191-g6d933094 a29c258b5d6f fcfcecd16324 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (3m) 11s ago 12m 51.9M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 1523b5eb5b04 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (5m) 98s ago 13m 18.2M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (5m) 11s ago 12m 19.4M - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (2m) 98s ago 11m 121M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ff051ca1c9ba 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (2m) 98s ago 11m 123M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 16e84d481761 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (102s) 98s ago 11m 15.0M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 237e9d69d7c9 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (71s) 11s ago 10m 140M 2592M 19.0.0-191-g6d933094 a29c258b5d6f da6380fd0161 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (43s) 11s ago 10m 127M 2592M 19.0.0-191-g6d933094 a29c258b5d6f c2b8b55e6a90 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (14s) 11s ago 10m 12.6M 2592M 19.0.0-191-g6d933094 a29c258b5d6f ff24811f977d 2023-12-16T03:23:05.186 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (5m) 98s ago 12m 60.6M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f765c06ce60 msgr2=0x7f765c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f765c06ce60 0x7f765c06f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7664004f90 tx=0x7f7664009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 msgr2=0x7f7674115d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 0x7f7674115d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7668002a50 tx=0x7f76680046b0 comp rx=0 tx=0).stop 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 shutdown_connections 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f765c06ce60 0x7f765c06f310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76740fbb40 0x7f7674115850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 --2- 172.21.15.64:0/4077517403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7674101b00 0x7f7674115d90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 >> 172.21.15.64:0/4077517403 conn(0x7f76740719b0 msgr2=0x7f76740654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 shutdown_connections 2023-12-16T03:23:05.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:05.184+0000 7f7679f40700 1 -- 172.21.15.64:0/4077517403 wait complete. 2023-12-16T03:23:05.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade status' 2023-12-16T03:23:05.856 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:23:05.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:05 smithi064 ceph-mon[216854]: pgmap v143: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:05.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:05 smithi064 ceph-mon[216854]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:23:06.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:05 smithi184 ceph-mon[184130]: pgmap v143: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:06.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:05 smithi184 ceph-mon[184130]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:23:07.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.036+0000 7f0e0221a700 1 -- 172.21.15.64:0/4060364230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 msgr2=0x7f0dfc106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:07.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.036+0000 7f0e0221a700 1 --2- 172.21.15.64:0/4060364230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 0x7f0dfc106c60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0df0004940 tx=0x7f0df0009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:07.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.037+0000 7f0e0221a700 1 -- 172.21.15.64:0/4060364230 shutdown_connections 2023-12-16T03:23:07.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.037+0000 7f0e0221a700 1 --2- 172.21.15.64:0/4060364230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 0x7f0dfc106c60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:07.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.037+0000 7f0e0221a700 1 --2- 172.21.15.64:0/4060364230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dfc0fdbf0 0x7f0dfc0fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:07.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.037+0000 7f0e0221a700 1 -- 172.21.15.64:0/4060364230 >> 172.21.15.64:0/4060364230 conn(0x7f0dfc0f7690 msgr2=0x7f0dfc0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.037+0000 7f0e0221a700 1 -- 172.21.15.64:0/4060364230 shutdown_connections 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.037+0000 7f0e0221a700 1 -- 172.21.15.64:0/4060364230 wait complete. 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.037+0000 7f0e0221a700 1 Processor -- start 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.037+0000 7f0e0221a700 1 -- start start 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0e0221a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dfc0fdbf0 0x7f0dfc113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0e0221a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 0x7f0dfc113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0e0221a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc10d4d0 con 0x7f0dfc0fe590 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0e0221a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc10d640 con 0x7f0dfc0fdbf0 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0dfaffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 0x7f0dfc113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0dfaffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 0x7f0dfc113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49314/0 (socket says 172.21.15.64:49314) 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0dfaffd700 1 -- 172.21.15.64:0/4233811332 learned_addr learned my addr 172.21.15.64:0/4233811332 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0dfb7fe700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dfc0fdbf0 0x7f0dfc113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0dfaffd700 1 -- 172.21.15.64:0/4233811332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dfc0fdbf0 msgr2=0x7f0dfc113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0dfaffd700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dfc0fdbf0 0x7f0dfc113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:07.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0dfaffd700 1 -- 172.21.15.64:0/4233811332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0005040 con 0x7f0dfc0fe590 2023-12-16T03:23:07.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0dfaffd700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 0x7f0dfc113b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009390 tx=0x7f0df0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:07.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0de3fff700 1 -- 172.21.15.64:0/4233811332 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df000e040 con 0x7f0dfc0fe590 2023-12-16T03:23:07.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0de3fff700 1 -- 172.21.15.64:0/4233811332 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0df0013420 con 0x7f0dfc0fe590 2023-12-16T03:23:07.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc10d8c0 con 0x7f0dfc0fe590 2023-12-16T03:23:07.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0de3fff700 1 -- 172.21.15.64:0/4233811332 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df001c630 con 0x7f0dfc0fe590 2023-12-16T03:23:07.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.038+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc10de00 con 0x7f0dfc0fe590 2023-12-16T03:23:07.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.039+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc1042c0 con 0x7f0dfc0fe590 2023-12-16T03:23:07.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.040+0000 7f0de3fff700 1 -- 172.21.15.64:0/4233811332 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0df000bb80 con 0x7f0dfc0fe590 2023-12-16T03:23:07.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.040+0000 7f0de3fff700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0de406ce70 0x7f0de406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:07.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.040+0000 7f0dfb7fe700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0de406ce70 0x7f0de406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:07.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.040+0000 7f0de3fff700 1 -- 172.21.15.64:0/4233811332 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0df008d6c0 con 0x7f0dfc0fe590 2023-12-16T03:23:07.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.041+0000 7f0dfb7fe700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0de406ce70 0x7f0de406f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0f8f00 tx=0x7f0dec0091a0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:07.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.045+0000 7f0de3fff700 1 -- 172.21.15.64:0/4233811332 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0df005b100 con 0x7f0dfc0fe590 2023-12-16T03:23:07.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.267+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dfc04bb80 con 0x7f0de406ce70 2023-12-16T03:23:07.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.268+0000 7f0de3fff700 1 -- 172.21.15.64:0/4233811332 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f0dfc04bb80 con 0x7f0de406ce70 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "in_progress": true, 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "services_complete": [ 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "crash", 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "osd", 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "mon", 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr" 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: ], 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "progress": "12/21 daemons upgraded", 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout: "is_paused": true 2023-12-16T03:23:07.271 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0de406ce70 msgr2=0x7f0de406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0de406ce70 0x7f0de406f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0f8f00 tx=0x7f0dec0091a0 comp rx=0 tx=0).stop 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 msgr2=0x7f0dfc113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 0x7f0dfc113b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009390 tx=0x7f0df0009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 shutdown_connections 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f0de406ce70 0x7f0de406f320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dfc0fdbf0 0x7f0dfc113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 --2- 172.21.15.64:0/4233811332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dfc0fe590 0x7f0dfc113b90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 >> 172.21.15.64:0/4233811332 conn(0x7f0dfc0f7690 msgr2=0x7f0dfc101440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 shutdown_connections 2023-12-16T03:23:07.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:07.270+0000 7f0e0221a700 1 -- 172.21.15.64:0/4233811332 wait complete. 2023-12-16T03:23:07.775 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph health detail' 2023-12-16T03:23:08.051 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:23:08.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:07 smithi064 ceph-mon[216854]: pgmap v144: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:08.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:07 smithi064 ceph-mon[216854]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:23:08.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:07 smithi184 ceph-mon[184130]: pgmap v144: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:08.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:07 smithi184 ceph-mon[184130]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:23:09.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.408+0000 7f75d6979700 1 -- 172.21.15.64:0/2996631358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d0102c70 msgr2=0x7f75d0103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:09.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.408+0000 7f75d6979700 1 --2- 172.21.15.64:0/2996631358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d0102c70 0x7f75d0103040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75c0004940 tx=0x7f75c0009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:09.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.408+0000 7f75d6979700 1 -- 172.21.15.64:0/2996631358 shutdown_connections 2023-12-16T03:23:09.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.408+0000 7f75d6979700 1 --2- 172.21.15.64:0/2996631358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d00fb1e0 0x7f75d00fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:09.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.408+0000 7f75d6979700 1 --2- 172.21.15.64:0/2996631358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d0102c70 0x7f75d0103040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:09.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.408+0000 7f75d6979700 1 -- 172.21.15.64:0/2996631358 >> 172.21.15.64:0/2996631358 conn(0x7f75d00711a0 msgr2=0x7f75d00715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.408+0000 7f75d6979700 1 -- 172.21.15.64:0/2996631358 shutdown_connections 2023-12-16T03:23:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.408+0000 7f75d6979700 1 -- 172.21.15.64:0/2996631358 wait complete. 2023-12-16T03:23:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75d6979700 1 Processor -- start 2023-12-16T03:23:09.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75d6979700 1 -- start start 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75d6979700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d00fb1e0 0x7f75d0113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75d6979700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d0102c70 0x7f75d0113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75d6979700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d01141c0 con 0x7f75d00fb1e0 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75d6979700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d010d4b0 con 0x7f75d0102c70 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75cffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d00fb1e0 0x7f75d0113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75cffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d00fb1e0 0x7f75d0113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49326/0 (socket says 172.21.15.64:49326) 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75cffff700 1 -- 172.21.15.64:0/3637979250 learned_addr learned my addr 172.21.15.64:0/3637979250 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.409+0000 7f75cf7fe700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d0102c70 0x7f75d0113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.410+0000 7f75cffff700 1 -- 172.21.15.64:0/3637979250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d0102c70 msgr2=0x7f75d0113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.410+0000 7f75cffff700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d0102c70 0x7f75d0113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.410+0000 7f75cffff700 1 -- 172.21.15.64:0/3637979250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c0005040 con 0x7f75d00fb1e0 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.410+0000 7f75cffff700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d00fb1e0 0x7f75d0113630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009180 tx=0x7f75c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.410+0000 7f75ccff9700 1 -- 172.21.15.64:0/3637979250 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c000e040 con 0x7f75d00fb1e0 2023-12-16T03:23:09.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.410+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d010d730 con 0x7f75d00fb1e0 2023-12-16T03:23:09.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.410+0000 7f75ccff9700 1 -- 172.21.15.64:0/3637979250 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75c0013420 con 0x7f75d00fb1e0 2023-12-16T03:23:09.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.410+0000 7f75ccff9700 1 -- 172.21.15.64:0/3637979250 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c001c630 con 0x7f75d00fb1e0 2023-12-16T03:23:09.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.410+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d010dc70 con 0x7f75d00fb1e0 2023-12-16T03:23:09.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.411+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d01132e0 con 0x7f75d00fb1e0 2023-12-16T03:23:09.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.411+0000 7f75ccff9700 1 -- 172.21.15.64:0/3637979250 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f75c00139e0 con 0x7f75d00fb1e0 2023-12-16T03:23:09.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.412+0000 7f75ccff9700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f75b806ce60 0x7f75b806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:09.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.412+0000 7f75ccff9700 1 -- 172.21.15.64:0/3637979250 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f75c008d610 con 0x7f75d00fb1e0 2023-12-16T03:23:09.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.412+0000 7f75cf7fe700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f75b806ce60 0x7f75b806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:09.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.412+0000 7f75cf7fe700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f75b806ce60 0x7f75b806f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75c4006fd0 tx=0x7f75c4008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:09.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.417+0000 7f75ccff9700 1 -- 172.21.15.64:0/3637979250 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f75c005aff0 con 0x7f75d00fb1e0 2023-12-16T03:23:09.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.700+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f75d0072cc0 con 0x7f75d00fb1e0 2023-12-16T03:23:09.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.701+0000 7f75ccff9700 1 -- 172.21.15.64:0/3637979250 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+451 (secure 0 0 0) 0x7f75c005ab80 con 0x7f75d00fb1e0 2023-12-16T03:23:09.703 INFO:teuthology.orchestra.run.smithi064.stdout:HEALTH_ERR 1 filesystem with deprecated feature inline_data; Upgrade: failed due to an unexpected exception 2023-12-16T03:23:09.704 INFO:teuthology.orchestra.run.smithi064.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T03:23:09.704 INFO:teuthology.orchestra.run.smithi064.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T03:23:09.704 INFO:teuthology.orchestra.run.smithi064.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T03:23:09.704 INFO:teuthology.orchestra.run.smithi064.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-16T03:23:09.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.702+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f75b806ce60 msgr2=0x7f75b806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:09.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.702+0000 7f75d6979700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f75b806ce60 0x7f75b806f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75c4006fd0 tx=0x7f75c4008040 comp rx=0 tx=0).stop 2023-12-16T03:23:09.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.702+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d00fb1e0 msgr2=0x7f75d0113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:09.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.702+0000 7f75d6979700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d00fb1e0 0x7f75d0113630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009180 tx=0x7f75c0009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:09.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.703+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 shutdown_connections 2023-12-16T03:23:09.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.703+0000 7f75d6979700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f75b806ce60 0x7f75b806f310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:09.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.703+0000 7f75d6979700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75d00fb1e0 0x7f75d0113630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:09.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.703+0000 7f75d6979700 1 --2- 172.21.15.64:0/3637979250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d0102c70 0x7f75d0113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:09.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.703+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 >> 172.21.15.64:0/3637979250 conn(0x7f75d00711a0 msgr2=0x7f75d00fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:09.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.703+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 shutdown_connections 2023-12-16T03:23:09.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:09.703+0000 7f75d6979700 1 -- 172.21.15.64:0/3637979250 wait complete. 2023-12-16T03:23:10.068 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:09 smithi064 ceph-mon[216854]: pgmap v145: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:10.068 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:09 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/3637979250' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:23:10.087 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions' 2023-12-16T03:23:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:09 smithi184 ceph-mon[184130]: pgmap v145: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:10.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:09 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/3637979250' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T03:23:10.360 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:23:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.408+0000 7f7996320700 1 -- 172.21.15.64:0/1794511402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 msgr2=0x7f7990102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.408+0000 7f7996320700 1 --2- 172.21.15.64:0/1794511402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 0x7f7990102ff0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7980004940 tx=0x7f7980009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.408+0000 7f7996320700 1 -- 172.21.15.64:0/1794511402 shutdown_connections 2023-12-16T03:23:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.408+0000 7f7996320700 1 --2- 172.21.15.64:0/1794511402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7990065390 0x7f7990065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.408+0000 7f7996320700 1 --2- 172.21.15.64:0/1794511402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 0x7f7990102ff0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.408+0000 7f7996320700 1 -- 172.21.15.64:0/1794511402 >> 172.21.15.64:0/1794511402 conn(0x7f79900719b0 msgr2=0x7f7990071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.408+0000 7f7996320700 1 -- 172.21.15.64:0/1794511402 shutdown_connections 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.408+0000 7f7996320700 1 -- 172.21.15.64:0/1794511402 wait complete. 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.409+0000 7f7996320700 1 Processor -- start 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.409+0000 7f7996320700 1 -- start start 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.409+0000 7f7996320700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7990065390 0x7f7990113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.409+0000 7f7996320700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 0x7f7990113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.409+0000 7f7996320700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799010d540 con 0x7f7990102c20 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.409+0000 7f7996320700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799010d6b0 con 0x7f7990065390 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 0x7f7990113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798f7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 0x7f7990113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49344/0 (socket says 172.21.15.64:49344) 2023-12-16T03:23:11.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798f7fe700 1 -- 172.21.15.64:0/3820829223 learned_addr learned my addr 172.21.15.64:0/3820829223 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:23:11.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798ffff700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7990065390 0x7f7990113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:11.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798f7fe700 1 -- 172.21.15.64:0/3820829223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7990065390 msgr2=0x7f7990113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:11.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798f7fe700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7990065390 0x7f7990113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:11.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798f7fe700 1 -- 172.21.15.64:0/3820829223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7980005040 con 0x7f7990102c20 2023-12-16T03:23:11.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798ffff700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7990065390 0x7f7990113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798f7fe700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 0x7f7990113c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f798400b790 tx=0x7f7984009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798cff9700 1 -- 172.21.15.64:0/3820829223 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798400f770 con 0x7f7990102c20 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798cff9700 1 -- 172.21.15.64:0/3820829223 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f798400fd80 con 0x7f7990102c20 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799010d990 con 0x7f7990102c20 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f798cff9700 1 -- 172.21.15.64:0/3820829223 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798400d310 con 0x7f7990102c20 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.410+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799010ded0 con 0x7f7990102c20 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.411+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79900fff40 con 0x7f7990102c20 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.412+0000 7f798cff9700 1 -- 172.21.15.64:0/3820829223 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f7984010420 con 0x7f7990102c20 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.412+0000 7f798cff9700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f797806ce60 0x7f797806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.412+0000 7f798cff9700 1 -- 172.21.15.64:0/3820829223 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f798408c130 con 0x7f7990102c20 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.412+0000 7f798ffff700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f797806ce60 0x7f797806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:23:11.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.413+0000 7f798ffff700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f797806ce60 0x7f797806f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7980009fd0 tx=0x7f7980009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:23:11.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.417+0000 7f798cff9700 1 -- 172.21.15.64:0/3820829223 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f7984059c10 con 0x7f7990102c20 2023-12-16T03:23:11.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.707+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f799004bb80 con 0x7f7990102c20 2023-12-16T03:23:11.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.707+0000 7f798cff9700 1 -- 172.21.15.64:0/3820829223 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7f79840597a0 con 0x7f7990102c20 2023-12-16T03:23:11.710 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:23:11.710 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:23:11.710 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 6 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 10 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:23:11.711 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:23:11.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.709+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f797806ce60 msgr2=0x7f797806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:11.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.709+0000 7f7996320700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f797806ce60 0x7f797806f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7980009fd0 tx=0x7f7980009e30 comp rx=0 tx=0).stop 2023-12-16T03:23:11.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.709+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 msgr2=0x7f7990113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:23:11.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.709+0000 7f7996320700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 0x7f7990113c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f798400b790 tx=0x7f7984009250 comp rx=0 tx=0).stop 2023-12-16T03:23:11.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.709+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 shutdown_connections 2023-12-16T03:23:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.709+0000 7f7996320700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f797806ce60 0x7f797806f310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.709+0000 7f7996320700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7990065390 0x7f7990113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.709+0000 7f7996320700 1 --2- 172.21.15.64:0/3820829223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7990102c20 0x7f7990113c00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:23:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.709+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 >> 172.21.15.64:0/3820829223 conn(0x7f79900719b0 msgr2=0x7f79900faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:23:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.710+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 shutdown_connections 2023-12-16T03:23:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:23:11.710+0000 7f7996320700 1 -- 172.21.15.64:0/3820829223 wait complete. 2023-12-16T03:23:11.735 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:11 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:23:11.736 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:11 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:23:11.736 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:11 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:23:11.736 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:11 smithi064 ceph-mon[216854]: pgmap v146: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:11.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:11 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:23:11.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:11 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:23:11.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:11 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:23:11.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:11 smithi184 ceph-mon[184130]: pgmap v146: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:12.134 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-16T03:23:12.407 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:23:12.810 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:12 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/3820829223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:23:12.939 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:12 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/3820829223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:23:13.439 INFO:teuthology.orchestra.run.smithi064.stdout:wait for servicemap items w/ changing names to refresh 2023-12-16T03:23:13.797 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'sleep 60' 2023-12-16T03:23:13.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:13 smithi064 ceph-mon[216854]: pgmap v147: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:14.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:13 smithi184 ceph-mon[184130]: pgmap v147: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:14.070 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:23:16.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:15 smithi064 ceph-mon[216854]: pgmap v148: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:16.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:15 smithi184 ceph-mon[184130]: pgmap v148: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:18.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:17 smithi064 ceph-mon[216854]: pgmap v149: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:18.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:17 smithi184 ceph-mon[184130]: pgmap v149: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:20.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:19 smithi064 ceph-mon[216854]: pgmap v150: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:20.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:19 smithi184 ceph-mon[184130]: pgmap v150: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:21 smithi064 ceph-mon[216854]: pgmap v151: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:22.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:21 smithi184 ceph-mon[184130]: pgmap v151: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:23.942 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:23 smithi064 ceph-mon[216854]: pgmap v152: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:24.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:23 smithi184 ceph-mon[184130]: pgmap v152: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:26.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:25 smithi064 ceph-mon[216854]: pgmap v153: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:26.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:25 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:23:26.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:25 smithi184 ceph-mon[184130]: pgmap v153: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:26.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:25 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:23:28.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:27 smithi064 ceph-mon[216854]: pgmap v154: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:28.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:27 smithi184 ceph-mon[184130]: pgmap v154: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:30.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:29 smithi064 ceph-mon[216854]: pgmap v155: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:30.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:29 smithi184 ceph-mon[184130]: pgmap v155: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:32.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:31 smithi064 ceph-mon[216854]: pgmap v156: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:32.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:31 smithi184 ceph-mon[184130]: pgmap v156: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:34.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:33 smithi184 ceph-mon[184130]: pgmap v157: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:34.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:33 smithi064 ceph-mon[216854]: pgmap v157: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:36.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:35 smithi064 ceph-mon[216854]: pgmap v158: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:36.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:35 smithi184 ceph-mon[184130]: pgmap v158: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:38.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:37 smithi064 ceph-mon[216854]: pgmap v159: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:38.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:37 smithi184 ceph-mon[184130]: pgmap v159: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:40.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:39 smithi064 ceph-mon[216854]: pgmap v160: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:40.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:39 smithi184 ceph-mon[184130]: pgmap v160: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:41.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:40 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:23:41.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:40 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:23:42.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:41 smithi064 ceph-mon[216854]: pgmap v161: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:42.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:41 smithi184 ceph-mon[184130]: pgmap v161: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:44.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:43 smithi184 ceph-mon[184130]: pgmap v162: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:44.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:43 smithi064 ceph-mon[216854]: pgmap v162: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:46.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:45 smithi064 ceph-mon[216854]: pgmap v163: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:46.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:45 smithi184 ceph-mon[184130]: pgmap v163: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:48.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:47 smithi064 ceph-mon[216854]: pgmap v164: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:48.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:47 smithi184 ceph-mon[184130]: pgmap v164: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:50.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:49 smithi064 ceph-mon[216854]: pgmap v165: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:50.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:49 smithi184 ceph-mon[184130]: pgmap v165: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:52.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:51 smithi064 ceph-mon[216854]: pgmap v166: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:52.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:51 smithi184 ceph-mon[184130]: pgmap v166: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:54.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:53 smithi184 ceph-mon[184130]: pgmap v167: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:54.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:53 smithi064 ceph-mon[216854]: pgmap v167: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:56.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:55 smithi064 ceph-mon[216854]: pgmap v168: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:56.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:55 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:23:56.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:55 smithi184 ceph-mon[184130]: pgmap v168: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:56.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:55 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:23:58.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:57 smithi064 ceph-mon[216854]: pgmap v169: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:58.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:23:58.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:23:58.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:23:58.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:57 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:23:58.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:57 smithi184 ceph-mon[184130]: pgmap v169: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:23:58.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T03:23:58.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T03:23:58.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T03:23:58.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:57 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' 2023-12-16T03:24:00.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:23:59 smithi064 ceph-mon[216854]: pgmap v170: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:00.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:23:59 smithi184 ceph-mon[184130]: pgmap v170: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:02.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:01 smithi064 ceph-mon[216854]: pgmap v171: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:02.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:01 smithi184 ceph-mon[184130]: pgmap v171: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:04.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:03 smithi184 ceph-mon[184130]: pgmap v172: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:04.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:03 smithi064 ceph-mon[216854]: pgmap v172: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:06.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:05 smithi064 ceph-mon[216854]: pgmap v173: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:06.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:05 smithi184 ceph-mon[184130]: pgmap v173: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:08.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:07 smithi064 ceph-mon[216854]: pgmap v174: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:08.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:07 smithi184 ceph-mon[184130]: pgmap v174: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:10.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:09 smithi064 ceph-mon[216854]: pgmap v175: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:10.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:09 smithi184 ceph-mon[184130]: pgmap v175: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:11.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:10 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:24:11.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:10 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:24:12.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:11 smithi064 ceph-mon[216854]: pgmap v176: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:12.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:11 smithi184 ceph-mon[184130]: pgmap v176: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:14.061 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:13 smithi184 ceph-mon[184130]: pgmap v177: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:14.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:13 smithi064 ceph-mon[216854]: pgmap v177: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:15.367 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch ps' 2023-12-16T03:24:15.648 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:24:16.148 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:15 smithi064 ceph-mon[216854]: pgmap v178: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:16.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:15 smithi184 ceph-mon[184130]: pgmap v178: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.708+0000 7f6ff5c30700 1 -- 172.21.15.64:0/486097855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0065390 msgr2=0x7f6ff0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.708+0000 7f6ff5c30700 1 --2- 172.21.15.64:0/486097855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0065390 0x7f6ff0065800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4004940 tx=0x7f6fe4009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.708+0000 7f6ff5c30700 1 -- 172.21.15.64:0/486097855 shutdown_connections 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.708+0000 7f6ff5c30700 1 --2- 172.21.15.64:0/486097855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0065390 0x7f6ff0065800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.708+0000 7f6ff5c30700 1 --2- 172.21.15.64:0/486097855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0102c20 0x7f6ff0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.708+0000 7f6ff5c30700 1 -- 172.21.15.64:0/486097855 >> 172.21.15.64:0/486097855 conn(0x7f6ff00719b0 msgr2=0x7f6ff0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.708+0000 7f6ff5c30700 1 -- 172.21.15.64:0/486097855 shutdown_connections 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.708+0000 7f6ff5c30700 1 -- 172.21.15.64:0/486097855 wait complete. 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.709+0000 7f6ff5c30700 1 Processor -- start 2023-12-16T03:24:16.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.709+0000 7f6ff5c30700 1 -- start start 2023-12-16T03:24:16.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.709+0000 7f6ff5c30700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0065390 0x7f6ff00fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:16.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.709+0000 7f6ff5c30700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0102c20 0x7f6ff00fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:16.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.709+0000 7f6ff5c30700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00fc730 con 0x7f6ff0102c20 2023-12-16T03:24:16.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.709+0000 7f6ff5c30700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00fc8a0 con 0x7f6ff0065390 2023-12-16T03:24:16.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6feeffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0102c20 0x7f6ff00fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6feeffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0102c20 0x7f6ff00fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45646/0 (socket says 172.21.15.64:45646) 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6feeffd700 1 -- 172.21.15.64:0/1647367001 learned_addr learned my addr 172.21.15.64:0/1647367001 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6fef7fe700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0065390 0x7f6ff00fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6feeffd700 1 -- 172.21.15.64:0/1647367001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0065390 msgr2=0x7f6ff00fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6feeffd700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0065390 0x7f6ff00fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6feeffd700 1 -- 172.21.15.64:0/1647367001 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4005040 con 0x7f6ff0102c20 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6feeffd700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0102c20 0x7f6ff00fc130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009180 tx=0x7f6fe4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6fd7fff700 1 -- 172.21.15.64:0/1647367001 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe400e040 con 0x7f6ff0102c20 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff0119970 con 0x7f6ff0102c20 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6fd7fff700 1 -- 172.21.15.64:0/1647367001 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6fe4013420 con 0x7f6ff0102c20 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6fd7fff700 1 -- 172.21.15.64:0/1647367001 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe401c630 con 0x7f6ff0102c20 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.710+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff0119dd0 con 0x7f6ff0102c20 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.711+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff00fff40 con 0x7f6ff0102c20 2023-12-16T03:24:16.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.712+0000 7f6fd7fff700 1 -- 172.21.15.64:0/1647367001 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f6fe40139e0 con 0x7f6ff0102c20 2023-12-16T03:24:16.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.712+0000 7f6fd7fff700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6fd806ce60 0x7f6fd806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:16.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.712+0000 7f6fd7fff700 1 -- 172.21.15.64:0/1647367001 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6fe408d5c0 con 0x7f6ff0102c20 2023-12-16T03:24:16.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.712+0000 7f6fef7fe700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6fd806ce60 0x7f6fd806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:16.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.713+0000 7f6fef7fe700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6fd806ce60 0x7f6fd806f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0007fd0 tx=0x7f6fe0009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:16.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.717+0000 7f6fd7fff700 1 -- 172.21.15.64:0/1647367001 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f6fe4057570 con 0x7f6ff0102c20 2023-12-16T03:24:16.932 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.931+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 --> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ff00fd330 con 0x7f6fd806ce60 2023-12-16T03:24:16.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.941+0000 7f6fd7fff700 1 -- 172.21.15.64:0/1647367001 <== mgr.34100 v2:172.21.15.64:6800/1308629780 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6ff00fd330 con 0x7f6fd806ce60 2023-12-16T03:24:16.943 INFO:teuthology.orchestra.run.smithi064.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T03:24:16.943 INFO:teuthology.orchestra.run.smithi064.stdout:alertmanager.smithi064 smithi064 *:9093,9094 running (6m) 2m ago 14m 29.4M - 0.25.0 c8568f914cd2 515970ac9481 2023-12-16T03:24:16.943 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi064 smithi064 running (4m) 2m ago 14m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f a416f0797862 2023-12-16T03:24:16.943 INFO:teuthology.orchestra.run.smithi064.stdout:crash.smithi184 smithi184 running (4m) 83s ago 13m 7444k - 19.0.0-191-g6d933094 a29c258b5d6f 4d5da6df7dee 2023-12-16T03:24:16.943 INFO:teuthology.orchestra.run.smithi064.stdout:grafana.smithi064 smithi064 *:3000 running (6m) 2m ago 14m 87.4M - 9.4.12 a0ea5e3c46d9 9277d19b9549 2023-12-16T03:24:16.943 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.edrjyd smithi064 running (10m) 2m ago 10m 15.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fe3875a03afd 2023-12-16T03:24:16.943 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi064.jaepzs smithi064 running (10m) 2m ago 10m 6646M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 30701a63d46a 2023-12-16T03:24:16.943 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.jfpiqk smithi184 running (10m) 83s ago 10m 4652M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 a0c4b02cc877 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:mds.cephfs.smithi184.uqpwjn smithi184 running (10m) 83s ago 10m 16.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fd74cb714517 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi064.ueciyw smithi064 *:8443,9283,8765 running (7m) 2m ago 15m 511M - 19.0.0-191-g6d933094 a29c258b5d6f f05f3ef4f988 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:mgr.smithi184.urtxla smithi184 *:8443,9283,8765 running (6m) 83s ago 13m 450M - 19.0.0-191-g6d933094 a29c258b5d6f 32e6705e3e42 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi064 smithi064 running (4m) 2m ago 15m 65.5M 2048M 19.0.0-191-g6d933094 a29c258b5d6f fcfcecd16324 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:mon.smithi184 smithi184 running (4m) 83s ago 13m 51.9M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 1523b5eb5b04 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi064 smithi064 *:9100 running (6m) 2m ago 14m 18.2M - 1.5.0 0da6a335fe13 dba89bcacd9e 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:node-exporter.smithi184 smithi184 *:9100 running (6m) 83s ago 13m 19.4M - 1.5.0 0da6a335fe13 bf9f6585d5fa 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:osd.0 smithi064 running (3m) 2m ago 12m 121M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ff051ca1c9ba 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:osd.1 smithi064 running (3m) 2m ago 12m 123M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 16e84d481761 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:osd.2 smithi064 running (2m) 2m ago 12m 15.0M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 237e9d69d7c9 2023-12-16T03:24:16.944 INFO:teuthology.orchestra.run.smithi064.stdout:osd.3 smithi184 running (2m) 83s ago 11m 140M 2592M 19.0.0-191-g6d933094 a29c258b5d6f da6380fd0161 2023-12-16T03:24:16.945 INFO:teuthology.orchestra.run.smithi064.stdout:osd.4 smithi184 running (114s) 83s ago 11m 127M 2592M 19.0.0-191-g6d933094 a29c258b5d6f c2b8b55e6a90 2023-12-16T03:24:16.945 INFO:teuthology.orchestra.run.smithi064.stdout:osd.5 smithi184 running (85s) 83s ago 11m 12.6M 2592M 19.0.0-191-g6d933094 a29c258b5d6f ff24811f977d 2023-12-16T03:24:16.945 INFO:teuthology.orchestra.run.smithi064.stdout:prometheus.smithi064 smithi064 *:9095 running (6m) 2m ago 13m 60.6M - 2.43.0 a07b618ecd1d 1d918d6c1590 2023-12-16T03:24:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6fd806ce60 msgr2=0x7f6fd806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:16.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6fd806ce60 0x7f6fd806f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0007fd0 tx=0x7f6fe0009040 comp rx=0 tx=0).stop 2023-12-16T03:24:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0102c20 msgr2=0x7f6ff00fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0102c20 0x7f6ff00fc130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009180 tx=0x7f6fe4009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 shutdown_connections 2023-12-16T03:24:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f6fd806ce60 0x7f6fd806f310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0065390 0x7f6ff00fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 --2- 172.21.15.64:0/1647367001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff0102c20 0x7f6ff00fc130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 >> 172.21.15.64:0/1647367001 conn(0x7f6ff00719b0 msgr2=0x7f6ff00fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 shutdown_connections 2023-12-16T03:24:16.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:16.943+0000 7f6ff5c30700 1 -- 172.21.15.64:0/1647367001 wait complete. 2023-12-16T03:24:17.352 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions' 2023-12-16T03:24:17.641 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:24:18.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:17 smithi064 ceph-mon[216854]: pgmap v179: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:18.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:17 smithi064 ceph-mon[216854]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:24:18.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:17 smithi184 ceph-mon[184130]: pgmap v179: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:18.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:17 smithi184 ceph-mon[184130]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T03:24:18.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 -- 172.21.15.64:0/1285390209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 msgr2=0x7ff4c0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:18.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 --2- 172.21.15.64:0/1285390209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 0x7ff4c0102ff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc004940 tx=0x7ff4bc009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:18.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 -- 172.21.15.64:0/1285390209 shutdown_connections 2023-12-16T03:24:18.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 --2- 172.21.15.64:0/1285390209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4c0065390 0x7ff4c0065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:18.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 --2- 172.21.15.64:0/1285390209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 0x7ff4c0102ff0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:18.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 -- 172.21.15.64:0/1285390209 >> 172.21.15.64:0/1285390209 conn(0x7ff4c00719b0 msgr2=0x7ff4c0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:18.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 -- 172.21.15.64:0/1285390209 shutdown_connections 2023-12-16T03:24:18.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 -- 172.21.15.64:0/1285390209 wait complete. 2023-12-16T03:24:18.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 Processor -- start 2023-12-16T03:24:18.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.706+0000 7ff4c7325700 1 -- start start 2023-12-16T03:24:18.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c7325700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4c0065390 0x7ff4c00fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:18.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c7325700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 0x7ff4c00fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:18.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c7325700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00fc7c0 con 0x7ff4c0102c20 2023-12-16T03:24:18.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c7325700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00fc930 con 0x7ff4c0065390 2023-12-16T03:24:18.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c48c0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 0x7ff4c00fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:18.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c48c0700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 0x7ff4c00fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45658/0 (socket says 172.21.15.64:45658) 2023-12-16T03:24:18.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c48c0700 1 -- 172.21.15.64:0/1039713160 learned_addr learned my addr 172.21.15.64:0/1039713160 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:18.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c48c0700 1 -- 172.21.15.64:0/1039713160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4c0065390 msgr2=0x7ff4c00fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c48c0700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4c0065390 0x7ff4c00fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c48c0700 1 -- 172.21.15.64:0/1039713160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc005040 con 0x7ff4c0102c20 2023-12-16T03:24:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c48c0700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 0x7ff4c00fc130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000b790 tx=0x7ff4b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4b5ffb700 1 -- 172.21.15.64:0/1039713160 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b000f770 con 0x7ff4c0102c20 2023-12-16T03:24:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4b5ffb700 1 -- 172.21.15.64:0/1039713160 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff4b000fd80 con 0x7ff4c0102c20 2023-12-16T03:24:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c0119920 con 0x7ff4c0102c20 2023-12-16T03:24:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.707+0000 7ff4b5ffb700 1 -- 172.21.15.64:0/1039713160 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b000d310 con 0x7ff4c0102c20 2023-12-16T03:24:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.708+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c0119e10 con 0x7ff4c0102c20 2023-12-16T03:24:18.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.709+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c00fff40 con 0x7ff4c0102c20 2023-12-16T03:24:18.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.709+0000 7ff4b5ffb700 1 -- 172.21.15.64:0/1039713160 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7ff4b0010420 con 0x7ff4c0102c20 2023-12-16T03:24:18.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.709+0000 7ff4b5ffb700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4ac06ce70 0x7ff4ac06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:18.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.709+0000 7ff4b5ffb700 1 -- 172.21.15.64:0/1039713160 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff4b008c130 con 0x7ff4c0102c20 2023-12-16T03:24:18.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.709+0000 7ff4c50c1700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4ac06ce70 0x7ff4ac06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:18.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.710+0000 7ff4c50c1700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4ac06ce70 0x7ff4ac06f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc004f90 tx=0x7ff4bc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:18.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:18.714+0000 7ff4b5ffb700 1 -- 172.21.15.64:0/1039713160 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7ff4b0056180 con 0x7ff4c0102c20 2023-12-16T03:24:19.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.005+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff4c00734d0 con 0x7ff4c0102c20 2023-12-16T03:24:19.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.006+0000 7ff4b5ffb700 1 -- 172.21.15.64:0/1039713160 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7ff4b00597a0 con 0x7ff4c0102c20 2023-12-16T03:24:19.008 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-12-16T03:24:19.008 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": { 2023-12-16T03:24:19.008 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:24:19.008 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": { 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": { 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 6 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-12-16T03:24:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: "overall": { 2023-12-16T03:24:19.010 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T03:24:19.010 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 10 2023-12-16T03:24:19.010 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-12-16T03:24:19.010 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-12-16T03:24:19.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4ac06ce70 msgr2=0x7ff4ac06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:19.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4ac06ce70 0x7ff4ac06f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc004f90 tx=0x7ff4bc009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:19.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 msgr2=0x7ff4c00fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:19.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 0x7ff4c00fc130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000b790 tx=0x7ff4b0009250 comp rx=0 tx=0).stop 2023-12-16T03:24:19.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 shutdown_connections 2023-12-16T03:24:19.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7ff4ac06ce70 0x7ff4ac06f320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:19.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4c0065390 0x7ff4c00fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:19.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 --2- 172.21.15.64:0/1039713160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4c0102c20 0x7ff4c00fc130 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:19.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 >> 172.21.15.64:0/1039713160 conn(0x7ff4c00719b0 msgr2=0x7ff4c00faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:19.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 shutdown_connections 2023-12-16T03:24:19.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:19.008+0000 7ff4c7325700 1 -- 172.21.15.64:0/1039713160 wait complete. 2023-12-16T03:24:19.388 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-16T03:24:19.661 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/mon.smithi064/config 2023-12-16T03:24:20.130 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:19 smithi064 ceph-mon[216854]: pgmap v180: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:20.130 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:19 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/1039713160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:24:20.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:19 smithi184 ceph-mon[184130]: pgmap v180: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:20.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:19 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/1039713160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:24:20.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.709+0000 7fbff280e700 1 -- 172.21.15.64:0/681830779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec0fbb40 msgr2=0x7fbfec0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:20.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.709+0000 7fbff280e700 1 --2- 172.21.15.64:0/681830779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec0fbb40 0x7fbfec0fbfb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0004940 tx=0x7fbfe0009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:20.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.709+0000 7fbff280e700 1 -- 172.21.15.64:0/681830779 shutdown_connections 2023-12-16T03:24:20.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.709+0000 7fbff280e700 1 --2- 172.21.15.64:0/681830779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec0fbb40 0x7fbfec0fbfb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:20.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.709+0000 7fbff280e700 1 --2- 172.21.15.64:0/681830779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec101b00 0x7fbfec101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:20.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.709+0000 7fbff280e700 1 -- 172.21.15.64:0/681830779 >> 172.21.15.64:0/681830779 conn(0x7fbfec0719b0 msgr2=0x7fbfec071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:20.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.709+0000 7fbff280e700 1 -- 172.21.15.64:0/681830779 shutdown_connections 2023-12-16T03:24:20.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.709+0000 7fbff280e700 1 -- 172.21.15.64:0/681830779 wait complete. 2023-12-16T03:24:20.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbff280e700 1 Processor -- start 2023-12-16T03:24:20.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbff280e700 1 -- start start 2023-12-16T03:24:20.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbff280e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec0fbb40 0x7fbfec10e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:20.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbff280e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec101b00 0x7fbfec10ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbff280e700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec10f240 con 0x7fbfec101b00 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbff280e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec10f3b0 con 0x7fbfec0fbb40 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbfeb7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec101b00 0x7fbfec10ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbfeb7fe700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec101b00 0x7fbfec10ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45684/0 (socket says 172.21.15.64:45684) 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbfeb7fe700 1 -- 172.21.15.64:0/4064611620 learned_addr learned my addr 172.21.15.64:0/4064611620 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbfebfff700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec0fbb40 0x7fbfec10e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbfeb7fe700 1 -- 172.21.15.64:0/4064611620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec0fbb40 msgr2=0x7fbfec10e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbfeb7fe700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec0fbb40 0x7fbfec10e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.710+0000 7fbfeb7fe700 1 -- 172.21.15.64:0/4064611620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0005040 con 0x7fbfec101b00 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.711+0000 7fbfeb7fe700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec101b00 0x7fbfec10ec20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009380 tx=0x7fbfe0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.711+0000 7fbfe8ff9700 1 -- 172.21.15.64:0/4064611620 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe000e040 con 0x7fbfec101b00 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.711+0000 7fbfe8ff9700 1 -- 172.21.15.64:0/4064611620 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbfe000bc50 con 0x7fbfec101b00 2023-12-16T03:24:20.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.711+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec1176a0 con 0x7fbfec101b00 2023-12-16T03:24:20.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.711+0000 7fbfe8ff9700 1 -- 172.21.15.64:0/4064611620 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe0013660 con 0x7fbfec101b00 2023-12-16T03:24:20.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.711+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec117bb0 con 0x7fbfec101b00 2023-12-16T03:24:20.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.712+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfec103fb0 con 0x7fbfec101b00 2023-12-16T03:24:20.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.712+0000 7fbfe8ff9700 1 -- 172.21.15.64:0/4064611620 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fbfe00138d0 con 0x7fbfec101b00 2023-12-16T03:24:20.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.713+0000 7fbfe8ff9700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fbfd406ce60 0x7fbfd406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:20.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.713+0000 7fbfe8ff9700 1 -- 172.21.15.64:0/4064611620 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbfe008d090 con 0x7fbfec101b00 2023-12-16T03:24:20.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.713+0000 7fbfebfff700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fbfd406ce60 0x7fbfd406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:20.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.713+0000 7fbfebfff700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fbfd406ce60 0x7fbfd406f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc006fd0 tx=0x7fbfdc008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:20.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:20.717+0000 7fbfe8ff9700 1 -- 172.21.15.64:0/4064611620 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fbfe0057050 con 0x7fbfec101b00 2023-12-16T03:24:21.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.009+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbfec0734d0 con 0x7fbfec101b00 2023-12-16T03:24:21.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.010+0000 7fbfe8ff9700 1 -- 172.21.15.64:0/4064611620 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7fbfe005a670 con 0x7fbfec101b00 2023-12-16T03:24:21.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fbfd406ce60 msgr2=0x7fbfd406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:21.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fbfd406ce60 0x7fbfd406f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc006fd0 tx=0x7fbfdc008040 comp rx=0 tx=0).stop 2023-12-16T03:24:21.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec101b00 msgr2=0x7fbfec10ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:21.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec101b00 0x7fbfec10ec20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009380 tx=0x7fbfe0009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:21.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 shutdown_connections 2023-12-16T03:24:21.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fbfd406ce60 0x7fbfd406f310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:21.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec0fbb40 0x7fbfec10e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:21.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 --2- 172.21.15.64:0/4064611620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfec101b00 0x7fbfec10ec20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:21.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 >> 172.21.15.64:0/4064611620 conn(0x7fbfec0719b0 msgr2=0x7fbfec0faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:21.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 shutdown_connections 2023-12-16T03:24:21.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.012+0000 7fbff280e700 1 -- 172.21.15.64:0/4064611620 wait complete. 2023-12-16T03:24:21.025 INFO:teuthology.orchestra.run.smithi064.stdout:false 2023-12-16T03:24:21.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:24:21.394 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi064 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-16T03:24:21.468 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=33ae0e2130c74e2dbc9de40f700f7985 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi064 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-16T03:24:21.472 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-16T03:24:21.483 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-16T03:24:21.483 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:24:21.483 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:24:21.509 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-12-16T03:24:21.509 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:24:21.570 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:24:21.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.732+0000 7f88b4c17700 1 -- 172.21.15.64:0/1703259122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 msgr2=0x7f88b00fde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:21.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.732+0000 7f88b4c17700 1 --2- 172.21.15.64:0/1703259122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 0x7f88b00fde20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8898004940 tx=0x7f8898009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:21.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.732+0000 7f88b4c17700 1 -- 172.21.15.64:0/1703259122 shutdown_connections 2023-12-16T03:24:21.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.732+0000 7f88b4c17700 1 --2- 172.21.15.64:0/1703259122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b00fe3f0 0x7f88b0106ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:21.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.732+0000 7f88b4c17700 1 --2- 172.21.15.64:0/1703259122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 0x7f88b00fde20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:21.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.732+0000 7f88b4c17700 1 -- 172.21.15.64:0/1703259122 >> 172.21.15.64:0/1703259122 conn(0x7f88b00756d0 msgr2=0x7f88b00f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:21.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.732+0000 7f88b4c17700 1 -- 172.21.15.64:0/1703259122 shutdown_connections 2023-12-16T03:24:21.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.732+0000 7f88b4c17700 1 -- 172.21.15.64:0/1703259122 wait complete. 2023-12-16T03:24:21.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.733+0000 7f88b4c17700 1 Processor -- start 2023-12-16T03:24:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.733+0000 7f88b4c17700 1 -- start start 2023-12-16T03:24:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.733+0000 7f88b4c17700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 0x7f88b01132a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.733+0000 7f88b4c17700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b00fe3f0 0x7f88b01137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.733+0000 7f88b4c17700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0113e30 con 0x7f88b00fda50 2023-12-16T03:24:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.733+0000 7f88b4c17700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b010d350 con 0x7f88b00fe3f0 2023-12-16T03:24:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.733+0000 7f88ae59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 0x7f88b01132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.733+0000 7f88ae59c700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 0x7f88b01132a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45704/0 (socket says 172.21.15.64:45704) 2023-12-16T03:24:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.733+0000 7f88ae59c700 1 -- 172.21.15.64:0/3994301349 learned_addr learned my addr 172.21.15.64:0/3994301349 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88add9b700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b00fe3f0 0x7f88b01137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88ae59c700 1 -- 172.21.15.64:0/3994301349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b00fe3f0 msgr2=0x7f88b01137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88ae59c700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b00fe3f0 0x7f88b01137e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88ae59c700 1 -- 172.21.15.64:0/3994301349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898005040 con 0x7f88b00fda50 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88add9b700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b00fe3f0 0x7f88b01137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88ae59c700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 0x7f88b01132a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8898009380 tx=0x7f8898009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88a6ffd700 1 -- 172.21.15.64:0/3994301349 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f889800e040 con 0x7f88b00fda50 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88a6ffd700 1 -- 172.21.15.64:0/3994301349 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8898004290 con 0x7f88b00fda50 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b010d5d0 con 0x7f88b00fda50 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88a6ffd700 1 -- 172.21.15.64:0/3994301349 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f889801c630 con 0x7f88b00fda50 2023-12-16T03:24:21.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.734+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b010db10 con 0x7f88b00fda50 2023-12-16T03:24:21.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.735+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b0104120 con 0x7f88b00fda50 2023-12-16T03:24:21.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.735+0000 7f88a6ffd700 1 -- 172.21.15.64:0/3994301349 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f889800bc50 con 0x7f88b00fda50 2023-12-16T03:24:21.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.736+0000 7f88a6ffd700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f889c06ce60 0x7f889c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:21.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.736+0000 7f88a6ffd700 1 -- 172.21.15.64:0/3994301349 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f889808cfc0 con 0x7f88b00fda50 2023-12-16T03:24:21.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.736+0000 7f88add9b700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f889c06ce60 0x7f889c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:21.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.736+0000 7f88add9b700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f889c06ce60 0x7f889c06f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009fd0 tx=0x7f88a000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:21.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.740+0000 7f88a6ffd700 1 -- 172.21.15.64:0/3994301349 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f88980c0300 con 0x7f88b00fda50 2023-12-16T03:24:21.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.942+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88b010e880 con 0x7f88b00fda50 2023-12-16T03:24:21.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.943+0000 7f88a6ffd700 1 -- 172.21.15.64:0/3994301349 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16258 (secure 0 0 0) 0x7f889805a960 con 0x7f88b00fda50 2023-12-16T03:24:21.945 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:24:21.945 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":76,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","created":"2023-12-16T03:08:52.761746+0000","modified":"2023-12-16T03:22:58.469531+0000","last_up_change":"2023-12-16T03:22:57.467644+0000","last_in_change":"2023-12-16T03:12:46.192351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:12:08.817940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T03:13:52.316878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T03:13:52.858683+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94788c05-539e-4b9d-aaa5-099f071ba934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":46,"up_from":50,"up_thru":75,"down_at":47,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":224541298},{"type":"v1","addr":"172.21.15.64:6803","nonce":224541298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":224541298},{"type":"v1","addr":"172.21.15.64:6805","nonce":224541298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":224541298},{"type":"v1","addr":"172.21.15.64:6809","nonce":224541298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":224541298},{"type":"v1","addr":"172.21.15.64:6807","nonce":224541298}]},"public_addr":"172.21.15.64:6803/224541298","cluster_addr":"172.21.15.64:6805/224541298","heartbeat_back_addr":"172.21.15.64:6809/224541298","heartbeat_front_addr":"172.21.15.64:6807/224541298","state":["exists","up"]},{"osd":1,"uuid":"b08e3c59-129c-4baf-89ee-61012384a515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":51,"up_from":55,"up_thru":75,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":262863118},{"type":"v1","addr":"172.21.15.64:6811","nonce":262863118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":262863118},{"type":"v1","addr":"172.21.15.64:6813","nonce":262863118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":262863118},{"type":"v1","addr":"172.21.15.64:6817","nonce":262863118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":262863118},{"type":"v1","addr":"172.21.15.64:6815","nonce":262863118}]},"public_addr":"172.21.15.64:6811/262863118","cluster_addr":"172.21.15.64:6813/262863118","heartbeat_back_addr":"172.21.15.64:6817/262863118","heartbeat_front_addr":"172.21.15.64:6815/262863118","state":["exists","up"]},{"osd":2,"uuid":"18ed018b-ab10-4041-86f5-393af106517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":56,"up_from":60,"up_thru":75,"down_at":57,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":4197214596},{"type":"v1","addr":"172.21.15.64:6819","nonce":4197214596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":4197214596},{"type":"v1","addr":"172.21.15.64:6821","nonce":4197214596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4197214596},{"type":"v1","addr":"172.21.15.64:6825","nonce":4197214596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":4197214596},{"type":"v1","addr":"172.21.15.64:6823","nonce":4197214596}]},"public_addr":"172.21.15.64:6819/4197214596","cluster_addr":"172.21.15.64:6821/4197214596","heartbeat_back_addr":"172.21.15.64:6825/4197214596","heartbeat_front_addr":"172.21.15.64:6823/4197214596","state":["exists","up"]},{"osd":3,"uuid":"de1cc449-de96-410d-9a56-210aae20b3d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":61,"up_from":65,"up_thru":75,"down_at":62,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3426374330},{"type":"v1","addr":"172.21.15.184:6801","nonce":3426374330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3426374330},{"type":"v1","addr":"172.21.15.184:6803","nonce":3426374330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3426374330},{"type":"v1","addr":"172.21.15.184:6807","nonce":3426374330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3426374330},{"type":"v1","addr":"172.21.15.184:6805","nonce":3426374330}]},"public_addr":"172.21.15.184:6801/3426374330","cluster_addr":"172.21.15.184:6803/3426374330","heartbeat_back_addr":"172.21.15.184:6807/3426374330","heartbeat_front_addr":"172.21.15.184:6805/3426374330","state":["exists","up"]},{"osd":4,"uuid":"4dda63b7-8319-476c-8bb6-60dbb2aa1e92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":66,"up_from":70,"up_thru":75,"down_at":67,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":992163260},{"type":"v1","addr":"172.21.15.184:6809","nonce":992163260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":992163260},{"type":"v1","addr":"172.21.15.184:6811","nonce":992163260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":992163260},{"type":"v1","addr":"172.21.15.184:6815","nonce":992163260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":992163260},{"type":"v1","addr":"172.21.15.184:6813","nonce":992163260}]},"public_addr":"172.21.15.184:6809/992163260","cluster_addr":"172.21.15.184:6811/992163260","heartbeat_back_addr":"172.21.15.184:6815/992163260","heartbeat_front_addr":"172.21.15.184:6813/992163260","state":["exists","up"]},{"osd":5,"uuid":"55282f72-d6e4-4f91-9285-9b81aa14a948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":71,"up_from":75,"up_thru":75,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":219910245},{"type":"v1","addr":"172.21.15.184:6817","nonce":219910245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":219910245},{"type":"v1","addr":"172.21.15.184:6819","nonce":219910245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":219910245},{"type":"v1","addr":"172.21.15.184:6823","nonce":219910245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":219910245},{"type":"v1","addr":"172.21.15.184:6821","nonce":219910245}]},"public_addr":"172.21.15.184:6817/219910245","cluster_addr":"172.21.15.184:6819/219910245","heartbeat_back_addr":"172.21.15.184:6823/219910245","heartbeat_front_addr":"172.21.15.184:6821/219910245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:24.502427+0000","dead_epoch":46},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:45.326372+0000","dead_epoch":51},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:05.862744+0000","dead_epoch":56},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:24.099546+0000","dead_epoch":61},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:42.577575+0000","dead_epoch":66},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:13:01.012096+0000","dead_epoch":71}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6801/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6801/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/443331071":"2023-12-17T03:16:07.028074+0000","172.21.15.184:0/4039896286":"2023-12-17T03:17:04.353568+0000","172.21.15.64:0/74591443":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/2708172205":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/1123447957":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/3499478012":"2023-12-17T03:19:25.379885+0000","172.21.15.64:6800/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/724630608":"2023-12-17T03:16:07.028074+0000","172.21.15.184:6829/2992718398":"2023-12-17T03:17:04.353568+0000","172.21.15.184:6828/2992718398":"2023-12-17T03:17:04.353568+0000","172.21.15.64:0/1829112257":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/3738748261":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/2508480563":"2023-12-17T03:16:07.028074+0000","172.21.15.184:0/1750382545":"2023-12-17T03:17:04.353568+0000","172.21.15.184:0/3731510372":"2023-12-17T03:17:04.353568+0000","172.21.15.64:6800/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/2069535093":"2023-12-17T03:16:07.028074+0000","172.21.15.64:0/1472132975":"2023-12-17T03:19:25.379885+0000","172.21.15.64:6800/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/4039513088":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/882697123":"2023-12-17T03:19:25.379885+0000","172.21.15.184:0/3067356072":"2023-12-17T03:17:04.353568+0000","172.21.15.64:0/2114099737":"2023-12-17T03:16:07.028074+0000","172.21.15.184:0/3518047884":"2023-12-17T03:17:04.353568+0000","172.21.15.64:6800/795909098":"2023-12-17T03:19:25.379885+0000","172.21.15.64:0/3590618737":"2023-12-17T03:19:25.379885+0000","172.21.15.64:6800/2069535093":"2023-12-17T03:16:07.028074+0000","172.21.15.64:6801/795909098":"2023-12-17T03:19:25.379885+0000","172.21.15.64:0/1577100459":"2023-12-17T03:09:16.219813+0000","172.21.15.184:0/2993136503":"2023-12-17T03:17:04.353568+0000","172.21.15.64:0/277874032":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/3838233490":"2023-12-17T03:09:42.758504+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:24:21.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f889c06ce60 msgr2=0x7f889c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:21.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f889c06ce60 0x7f889c06f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009fd0 tx=0x7f88a000b040 comp rx=0 tx=0).stop 2023-12-16T03:24:21.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 msgr2=0x7f88b01132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:21.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 0x7f88b01132a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8898009380 tx=0x7f8898009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:21.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 shutdown_connections 2023-12-16T03:24:21.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f889c06ce60 0x7f889c06f310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:21.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88b00fda50 0x7f88b01132a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:21.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 --2- 172.21.15.64:0/3994301349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b00fe3f0 0x7f88b01137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:21.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 >> 172.21.15.64:0/3994301349 conn(0x7f88b00756d0 msgr2=0x7f88b01012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:21.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 shutdown_connections 2023-12-16T03:24:21.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:21.945+0000 7f88b4c17700 1 -- 172.21.15.64:0/3994301349 wait complete. 2023-12-16T03:24:21.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:12:08.817940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T03:13:52.316878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T03:13:52.858683+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:24:21.960 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:24:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.083+0000 7fc7906be700 1 -- 172.21.15.64:0/4129472409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 msgr2=0x7fc788101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.083+0000 7fc7906be700 1 --2- 172.21.15.64:0/4129472409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 0x7fc788101e90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc784004940 tx=0x7fc784009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 -- 172.21.15.64:0/4129472409 shutdown_connections 2023-12-16T03:24:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 --2- 172.21.15.64:0/4129472409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7881023d0 0x7fc7880fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 --2- 172.21.15.64:0/4129472409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 0x7fc788101e90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 -- 172.21.15.64:0/4129472409 >> 172.21.15.64:0/4129472409 conn(0x7fc788071970 msgr2=0x7fc788071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:22.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 -- 172.21.15.64:0/4129472409 shutdown_connections 2023-12-16T03:24:22.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 -- 172.21.15.64:0/4129472409 wait complete. 2023-12-16T03:24:22.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 Processor -- start 2023-12-16T03:24:22.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 -- start start 2023-12-16T03:24:22.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 0x7fc7881121b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:22.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7881023d0 0x7fc7881126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:22.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc788112d40 con 0x7fc788101ac0 2023-12-16T03:24:22.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc7906be700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78810c260 con 0x7fc7881023d0 2023-12-16T03:24:22.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.084+0000 7fc78e45a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 0x7fc7881121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:22.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc78e45a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 0x7fc7881121b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45722/0 (socket says 172.21.15.64:45722) 2023-12-16T03:24:22.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc78e45a700 1 -- 172.21.15.64:0/182920713 learned_addr learned my addr 172.21.15.64:0/182920713 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:22.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc78dc59700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7881023d0 0x7fc7881126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:22.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc78e45a700 1 -- 172.21.15.64:0/182920713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7881023d0 msgr2=0x7fc7881126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc78e45a700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7881023d0 0x7fc7881126f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc78e45a700 1 -- 172.21.15.64:0/182920713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784005040 con 0x7fc788101ac0 2023-12-16T03:24:22.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc78dc59700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7881023d0 0x7fc7881126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:24:22.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc78e45a700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 0x7fc7881121b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc784000c00 tx=0x7fc784009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:22.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc77effd700 1 -- 172.21.15.64:0/182920713 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc784021070 con 0x7fc788101ac0 2023-12-16T03:24:22.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc77effd700 1 -- 172.21.15.64:0/182920713 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc78401c400 con 0x7fc788101ac0 2023-12-16T03:24:22.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78810c4e0 con 0x7fc788101ac0 2023-12-16T03:24:22.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc77effd700 1 -- 172.21.15.64:0/182920713 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78400e070 con 0x7fc788101ac0 2023-12-16T03:24:22.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.085+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78810ca40 con 0x7fc788101ac0 2023-12-16T03:24:22.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.086+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc788064730 con 0x7fc788101ac0 2023-12-16T03:24:22.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.087+0000 7fc77effd700 1 -- 172.21.15.64:0/182920713 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc78401c9e0 con 0x7fc788101ac0 2023-12-16T03:24:22.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.087+0000 7fc77effd700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc77406ce60 0x7fc77406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:22.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.087+0000 7fc77effd700 1 -- 172.21.15.64:0/182920713 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc78408d430 con 0x7fc788101ac0 2023-12-16T03:24:22.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.087+0000 7fc78dc59700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc77406ce60 0x7fc77406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:22.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.087+0000 7fc78dc59700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc77406ce60 0x7fc77406f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc778004600 tx=0x7fc77800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:22.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.092+0000 7fc77effd700 1 -- 172.21.15.64:0/182920713 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc78405af10 con 0x7fc788101ac0 2023-12-16T03:24:22.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:21 smithi064 ceph-mon[216854]: pgmap v181: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:22.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:21 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/4064611620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:24:22.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.291+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc78810cc60 con 0x7fc788101ac0 2023-12-16T03:24:22.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.291+0000 7fc77effd700 1 -- 172.21.15.64:0/182920713 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc78405aaa0 con 0x7fc788101ac0 2023-12-16T03:24:22.294 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-12-16T03:24:22.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.293+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc77406ce60 msgr2=0x7fc77406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.293+0000 7fc7906be700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc77406ce60 0x7fc77406f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc778004600 tx=0x7fc77800b040 comp rx=0 tx=0).stop 2023-12-16T03:24:22.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.293+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 msgr2=0x7fc7881121b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.293+0000 7fc7906be700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 0x7fc7881121b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc784000c00 tx=0x7fc784009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:22.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.293+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 shutdown_connections 2023-12-16T03:24:22.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.293+0000 7fc7906be700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fc77406ce60 0x7fc77406f310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.293+0000 7fc7906be700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc788101ac0 0x7fc7881121b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.293+0000 7fc7906be700 1 --2- 172.21.15.64:0/182920713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7881023d0 0x7fc7881126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.293+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 >> 172.21.15.64:0/182920713 conn(0x7fc788071970 msgr2=0x7fc7880fae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:22.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.294+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 shutdown_connections 2023-12-16T03:24:22.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.294+0000 7fc7906be700 1 -- 172.21.15.64:0/182920713 wait complete. 2023-12-16T03:24:22.308 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T03:24:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:21 smithi184 ceph-mon[184130]: pgmap v181: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:22.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:21 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/4064611620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T03:24:22.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 -- 172.21.15.64:0/1584577620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 msgr2=0x7fe5c0102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 --2- 172.21.15.64:0/1584577620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 0x7fe5c0102f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0004940 tx=0x7fe5b0009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:22.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 -- 172.21.15.64:0/1584577620 shutdown_connections 2023-12-16T03:24:22.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 --2- 172.21.15.64:0/1584577620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c01034d0 0x7fe5c00fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 --2- 172.21.15.64:0/1584577620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 0x7fe5c0102f00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 -- 172.21.15.64:0/1584577620 >> 172.21.15.64:0/1584577620 conn(0x7fe5c00f8680 msgr2=0x7fe5c00faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:22.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 -- 172.21.15.64:0/1584577620 shutdown_connections 2023-12-16T03:24:22.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 -- 172.21.15.64:0/1584577620 wait complete. 2023-12-16T03:24:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 Processor -- start 2023-12-16T03:24:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 -- start start 2023-12-16T03:24:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.431+0000 7fe5c65bc700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 0x7fe5c006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5c65bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c01034d0 0x7fe5c0070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5c65bc700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00709c0 con 0x7fe5c0102b30 2023-12-16T03:24:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5c65bc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0070b00 con 0x7fe5c01034d0 2023-12-16T03:24:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 0x7fe5c006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bffff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 0x7fe5c006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45942/0 (socket says 172.21.15.64:45942) 2023-12-16T03:24:22.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bffff700 1 -- 172.21.15.64:0/2768739066 learned_addr learned my addr 172.21.15.64:0/2768739066 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bffff700 1 -- 172.21.15.64:0/2768739066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c01034d0 msgr2=0x7fe5c0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bffff700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c01034d0 0x7fe5c0070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bffff700 1 -- 172.21.15.64:0/2768739066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0005040 con 0x7fe5c0102b30 2023-12-16T03:24:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bffff700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 0x7fe5c006ff40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009fd0 tx=0x7fe5b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bcff9700 1 -- 172.21.15.64:0/2768739066 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5b000e040 con 0x7fe5c0102b30 2023-12-16T03:24:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bcff9700 1 -- 172.21.15.64:0/2768739066 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5b000bc50 con 0x7fe5c0102b30 2023-12-16T03:24:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c0070d80 con 0x7fe5c0102b30 2023-12-16T03:24:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5bcff9700 1 -- 172.21.15.64:0/2768739066 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5b0013ea0 con 0x7fe5c0102b30 2023-12-16T03:24:22.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.432+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c0119a60 con 0x7fe5c0102b30 2023-12-16T03:24:22.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.433+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c00ffe40 con 0x7fe5c0102b30 2023-12-16T03:24:22.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.434+0000 7fe5bcff9700 1 -- 172.21.15.64:0/2768739066 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe5b0013420 con 0x7fe5c0102b30 2023-12-16T03:24:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.434+0000 7fe5bcff9700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe5a806ce70 0x7fe5a806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.434+0000 7fe5bcff9700 1 -- 172.21.15.64:0/2768739066 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe5b008d7a0 con 0x7fe5c0102b30 2023-12-16T03:24:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.434+0000 7fe5bf7fe700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe5a806ce70 0x7fe5a806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.435+0000 7fe5bf7fe700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe5a806ce70 0x7fe5a806f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0071730 tx=0x7fe5b4007d40 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:22.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.439+0000 7fe5bcff9700 1 -- 172.21.15.64:0/2768739066 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe5b00576d0 con 0x7fe5c0102b30 2023-12-16T03:24:22.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.639+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fe5c0063ea0 con 0x7fe5c0102b30 2023-12-16T03:24:22.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.639+0000 7fe5bcff9700 1 -- 172.21.15.64:0/2768739066 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v76) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe5b005acf0 con 0x7fe5c0102b30 2023-12-16T03:24:22.642 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-12-16T03:24:22.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.641+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe5a806ce70 msgr2=0x7fe5a806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.641+0000 7fe5c65bc700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe5a806ce70 0x7fe5a806f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0071730 tx=0x7fe5b4007d40 comp rx=0 tx=0).stop 2023-12-16T03:24:22.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.641+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 msgr2=0x7fe5c006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.641+0000 7fe5c65bc700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 0x7fe5c006ff40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009fd0 tx=0x7fe5b0009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:22.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.642+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 shutdown_connections 2023-12-16T03:24:22.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.642+0000 7fe5c65bc700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe5a806ce70 0x7fe5a806f320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.642+0000 7fe5c65bc700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5c0102b30 0x7fe5c006ff40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.642+0000 7fe5c65bc700 1 --2- 172.21.15.64:0/2768739066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c01034d0 0x7fe5c0070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.642+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 >> 172.21.15.64:0/2768739066 conn(0x7fe5c00f8680 msgr2=0x7fe5c00fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:22.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.642+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 shutdown_connections 2023-12-16T03:24:22.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.642+0000 7fe5c65bc700 1 -- 172.21.15.64:0/2768739066 wait complete. 2023-12-16T03:24:22.656 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T03:24:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 -- 172.21.15.64:0/3587950207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 msgr2=0x7fd7a4065000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 --2- 172.21.15.64:0/3587950207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 0x7fd7a4065000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0004940 tx=0x7fd7a0009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:22.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 -- 172.21.15.64:0/3587950207 shutdown_connections 2023-12-16T03:24:22.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 --2- 172.21.15.64:0/3587950207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 0x7fd7a4065000 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 --2- 172.21.15.64:0/3587950207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7a4102bb0 0x7fd7a4102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 -- 172.21.15.64:0/3587950207 >> 172.21.15.64:0/3587950207 conn(0x7fd7a4071970 msgr2=0x7fd7a4071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:22.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 -- 172.21.15.64:0/3587950207 shutdown_connections 2023-12-16T03:24:22.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 -- 172.21.15.64:0/3587950207 wait complete. 2023-12-16T03:24:22.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 Processor -- start 2023-12-16T03:24:22.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.781+0000 7fd7aba6e700 1 -- start start 2023-12-16T03:24:22.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7aba6e700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 0x7fd7a4113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7aba6e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7a4102bb0 0x7fd7a4113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7aba6e700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4113dd0 con 0x7fd7a4064bb0 2023-12-16T03:24:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7aba6e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a410d330 con 0x7fd7a4102bb0 2023-12-16T03:24:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7a980a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 0x7fd7a4113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7a980a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 0x7fd7a4113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45974/0 (socket says 172.21.15.64:45974) 2023-12-16T03:24:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7a980a700 1 -- 172.21.15.64:0/242037088 learned_addr learned my addr 172.21.15.64:0/242037088 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7a980a700 1 -- 172.21.15.64:0/242037088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7a4102bb0 msgr2=0x7fd7a4113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7a980a700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7a4102bb0 0x7fd7a4113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7a980a700 1 -- 172.21.15.64:0/242037088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a0005040 con 0x7fd7a4064bb0 2023-12-16T03:24:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7a980a700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 0x7fd7a4113240 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd794002a80 tx=0x7fd7940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd79a7fc700 1 -- 172.21.15.64:0/242037088 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd794007cc0 con 0x7fd7a4064bb0 2023-12-16T03:24:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a410d610 con 0x7fd7a4064bb0 2023-12-16T03:24:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd79a7fc700 1 -- 172.21.15.64:0/242037088 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd79400f040 con 0x7fd7a4064bb0 2023-12-16T03:24:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd79a7fc700 1 -- 172.21.15.64:0/242037088 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd794009640 con 0x7fd7a4064bb0 2023-12-16T03:24:22.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.782+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a410dbd0 con 0x7fd7a4064bb0 2023-12-16T03:24:22.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.783+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a4104f90 con 0x7fd7a4064bb0 2023-12-16T03:24:22.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.784+0000 7fd79a7fc700 1 -- 172.21.15.64:0/242037088 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fd7940097a0 con 0x7fd7a4064bb0 2023-12-16T03:24:22.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.784+0000 7fd79a7fc700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd79006ce60 0x7fd79006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:22.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.784+0000 7fd79a7fc700 1 -- 172.21.15.64:0/242037088 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd79408ba60 con 0x7fd7a4064bb0 2023-12-16T03:24:22.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.784+0000 7fd7a9009700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd79006ce60 0x7fd79006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:22.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.785+0000 7fd7a9009700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd79006ce60 0x7fd79006f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0004f90 tx=0x7fd7a0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:22.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.789+0000 7fd79a7fc700 1 -- 172.21.15.64:0/242037088 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fd794055990 con 0x7fd7a4064bb0 2023-12-16T03:24:22.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.988+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd7a4064730 con 0x7fd7a4064bb0 2023-12-16T03:24:22.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.988+0000 7fd79a7fc700 1 -- 172.21.15.64:0/242037088 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v76) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd794058fb0 con 0x7fd7a4064bb0 2023-12-16T03:24:22.990 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-12-16T03:24:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.990+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd79006ce60 msgr2=0x7fd79006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.990+0000 7fd7aba6e700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd79006ce60 0x7fd79006f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0004f90 tx=0x7fd7a0009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.990+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 msgr2=0x7fd7a4113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.990+0000 7fd7aba6e700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 0x7fd7a4113240 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd794002a80 tx=0x7fd7940046b0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.990+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 shutdown_connections 2023-12-16T03:24:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.990+0000 7fd7aba6e700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fd79006ce60 0x7fd79006f310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.990+0000 7fd7aba6e700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a4064bb0 0x7fd7a4113240 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.990+0000 7fd7aba6e700 1 --2- 172.21.15.64:0/242037088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7a4102bb0 0x7fd7a4113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.990+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 >> 172.21.15.64:0/242037088 conn(0x7fd7a4071970 msgr2=0x7fd7a40faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:22.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.991+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 shutdown_connections 2023-12-16T03:24:22.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:22.991+0000 7fd7aba6e700 1 -- 172.21.15.64:0/242037088 wait complete. 2023-12-16T03:24:23.005 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:24:23.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.125+0000 7fe1b65ad700 1 -- 172.21.15.64:0/2394735028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b0101a40 msgr2=0x7fe1b0101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:23.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.125+0000 7fe1b65ad700 1 --2- 172.21.15.64:0/2394735028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b0101a40 0x7fe1b0101e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0004940 tx=0x7fe1a0009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:23.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.125+0000 7fe1b65ad700 1 -- 172.21.15.64:0/2394735028 shutdown_connections 2023-12-16T03:24:23.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.125+0000 7fe1b65ad700 1 --2- 172.21.15.64:0/2394735028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b00fba00 0x7fe1b00fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:23.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.125+0000 7fe1b65ad700 1 --2- 172.21.15.64:0/2394735028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b0101a40 0x7fe1b0101e10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:23.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.125+0000 7fe1b65ad700 1 -- 172.21.15.64:0/2394735028 >> 172.21.15.64:0/2394735028 conn(0x7fe1b00f7580 msgr2=0x7fe1b00f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:23.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.125+0000 7fe1b65ad700 1 -- 172.21.15.64:0/2394735028 shutdown_connections 2023-12-16T03:24:23.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.125+0000 7fe1b65ad700 1 -- 172.21.15.64:0/2394735028 wait complete. 2023-12-16T03:24:23.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.126+0000 7fe1b65ad700 1 Processor -- start 2023-12-16T03:24:23.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.126+0000 7fe1b65ad700 1 -- start start 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1b65ad700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b00fba00 0x7fe1b01121b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1b65ad700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b0101a40 0x7fe1b01126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1b65ad700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0112d40 con 0x7fe1b00fba00 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1b65ad700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b010c260 con 0x7fe1b0101a40 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1affff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b00fba00 0x7fe1b01121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1affff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b00fba00 0x7fe1b01121b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45984/0 (socket says 172.21.15.64:45984) 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1affff700 1 -- 172.21.15.64:0/4064029646 learned_addr learned my addr 172.21.15.64:0/4064029646 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1af7fe700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b0101a40 0x7fe1b01126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1affff700 1 -- 172.21.15.64:0/4064029646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b0101a40 msgr2=0x7fe1b01126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1affff700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b0101a40 0x7fe1b01126f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1affff700 1 -- 172.21.15.64:0/4064029646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a0005040 con 0x7fe1b00fba00 2023-12-16T03:24:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1af7fe700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b0101a40 0x7fe1b01126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:24:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1affff700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b00fba00 0x7fe1b01121b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b3b0 tx=0x7fe1a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1acff9700 1 -- 172.21.15.64:0/4064029646 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a000e040 con 0x7fe1b00fba00 2023-12-16T03:24:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b010c4e0 con 0x7fe1b00fba00 2023-12-16T03:24:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1acff9700 1 -- 172.21.15.64:0/4064029646 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1a000bc50 con 0x7fe1b00fba00 2023-12-16T03:24:23.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1acff9700 1 -- 172.21.15.64:0/4064029646 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a0013420 con 0x7fe1b00fba00 2023-12-16T03:24:23.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.127+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b010caa0 con 0x7fe1b00fba00 2023-12-16T03:24:23.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.128+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b0103ec0 con 0x7fe1b00fba00 2023-12-16T03:24:23.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.129+0000 7fe1acff9700 1 -- 172.21.15.64:0/4064029646 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe1a001c430 con 0x7fe1b00fba00 2023-12-16T03:24:23.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.129+0000 7fe1acff9700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe19806ce60 0x7fe19806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:23.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.129+0000 7fe1acff9700 1 -- 172.21.15.64:0/4064029646 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe1a008d020 con 0x7fe1b00fba00 2023-12-16T03:24:23.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.129+0000 7fe1af7fe700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe19806ce60 0x7fe19806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:23.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.130+0000 7fe1af7fe700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe19806ce60 0x7fe19806f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4007fd0 tx=0x7fe1a4009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:23.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.134+0000 7fe1acff9700 1 -- 172.21.15.64:0/4064029646 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe1a005ab10 con 0x7fe1b00fba00 2023-12-16T03:24:23.192 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:22 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/3994301349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:24:23.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:22 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/182920713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T03:24:23.193 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:22 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/2768739066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T03:24:23.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:22 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/3994301349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:24:23.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:22 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/182920713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T03:24:23.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:22 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/2768739066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T03:24:23.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.354+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe1b0063ea0 con 0x7fe1b00fba00 2023-12-16T03:24:23.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.354+0000 7fe1acff9700 1 -- 172.21.15.64:0/4064029646 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v76) v1 ==== 81+0+2064 (secure 0 0 0) 0x7fe1a005a6a0 con 0x7fe1b00fba00 2023-12-16T03:24:23.357 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/2673193978 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:23.357 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/1165076471 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:23.357 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/443331071 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:23.357 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/4039896286 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:23.357 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/74591443 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:23.357 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/2708172205 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:23.357 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/1123447957 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:23.358 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/3499478012 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:23.358 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/1165076471 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:23.358 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/724630608 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:23.358 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:6829/2992718398 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:23.358 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:6828/2992718398 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:23.358 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/1829112257 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:23.358 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/3738748261 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:23.358 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/2508480563 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:23.358 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/1750382545 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:23.359 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/3731510372 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:23.359 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/150543208 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:23.359 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/2069535093 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:23.359 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/1472132975 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:23.359 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/2673193978 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:23.359 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/4039513088 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:23.359 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/150543208 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:23.359 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/882697123 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:23.359 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/3067356072 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:23.360 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/2114099737 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:23.360 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/3518047884 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:23.360 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/795909098 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:23.360 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/3590618737 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:23.360 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/2069535093 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:23.360 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/795909098 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:23.360 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/1577100459 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:23.360 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/2993136503 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:23.360 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/277874032 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:23.361 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/3838233490 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:23.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe19806ce60 msgr2=0x7fe19806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe19806ce60 0x7fe19806f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4007fd0 tx=0x7fe1a4009040 comp rx=0 tx=0).stop 2023-12-16T03:24:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b00fba00 msgr2=0x7fe1b01121b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b00fba00 0x7fe1b01121b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b3b0 tx=0x7fe1a0009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 shutdown_connections 2023-12-16T03:24:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fe19806ce60 0x7fe19806f310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1b00fba00 0x7fe1b01121b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 --2- 172.21.15.64:0/4064029646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b0101a40 0x7fe1b01126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 >> 172.21.15.64:0/4064029646 conn(0x7fe1b00f7580 msgr2=0x7fe1b00f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 shutdown_connections 2023-12-16T03:24:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.357+0000 7fe1b65ad700 1 -- 172.21.15.64:0/4064029646 wait complete. 2023-12-16T03:24:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:listed 35 entries 2023-12-16T03:24:23.371 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-16T03:24:23.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:23.371 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-16T03:24:23.410 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:24:23.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:23.410 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T03:24:23.515 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:24:23.516 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:24:23.633 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-12-16T03:24:23.633 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:24:23.697 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:24:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.824+0000 7fad3965a700 1 -- 172.21.15.64:0/816227496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 msgr2=0x7fad34101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.824+0000 7fad3965a700 1 --2- 172.21.15.64:0/816227496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 0x7fad34101060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad24004940 tx=0x7fad24009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:23.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.824+0000 7fad3965a700 1 -- 172.21.15.64:0/816227496 shutdown_connections 2023-12-16T03:24:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.824+0000 7fad3965a700 1 --2- 172.21.15.64:0/816227496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad34101630 0x7fad340faca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.824+0000 7fad3965a700 1 --2- 172.21.15.64:0/816227496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 0x7fad34101060 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.824+0000 7fad3965a700 1 -- 172.21.15.64:0/816227496 >> 172.21.15.64:0/816227496 conn(0x7fad340f67e0 msgr2=0x7fad340f8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.824+0000 7fad3965a700 1 -- 172.21.15.64:0/816227496 shutdown_connections 2023-12-16T03:24:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.824+0000 7fad3965a700 1 -- 172.21.15.64:0/816227496 wait complete. 2023-12-16T03:24:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.825+0000 7fad3965a700 1 Processor -- start 2023-12-16T03:24:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.825+0000 7fad3965a700 1 -- start start 2023-12-16T03:24:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.825+0000 7fad3965a700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 0x7fad341121a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:23.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.825+0000 7fad3965a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad34101630 0x7fad341126e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.825+0000 7fad3965a700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad34112dc0 con 0x7fad34100c90 2023-12-16T03:24:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.825+0000 7fad3965a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3410c250 con 0x7fad34101630 2023-12-16T03:24:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.825+0000 7fad32ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 0x7fad341121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad32ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 0x7fad341121a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45996/0 (socket says 172.21.15.64:45996) 2023-12-16T03:24:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad32ffd700 1 -- 172.21.15.64:0/2837896601 learned_addr learned my addr 172.21.15.64:0/2837896601 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad327fc700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad34101630 0x7fad341126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad32ffd700 1 -- 172.21.15.64:0/2837896601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad34101630 msgr2=0x7fad341126e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad32ffd700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad34101630 0x7fad341126e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:23.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad32ffd700 1 -- 172.21.15.64:0/2837896601 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24005040 con 0x7fad34100c90 2023-12-16T03:24:23.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad32ffd700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 0x7fad341121a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fad2400b3b0 tx=0x7fad24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:23.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad1b7fe700 1 -- 172.21.15.64:0/2837896601 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad2400e040 con 0x7fad34100c90 2023-12-16T03:24:23.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad1b7fe700 1 -- 172.21.15.64:0/2837896601 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad2400bc50 con 0x7fad34100c90 2023-12-16T03:24:23.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3410c470 con 0x7fad34100c90 2023-12-16T03:24:23.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad1b7fe700 1 -- 172.21.15.64:0/2837896601 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad24013420 con 0x7fad34100c90 2023-12-16T03:24:23.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.826+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3410ca30 con 0x7fad34100c90 2023-12-16T03:24:23.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.827+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad34064b80 con 0x7fad34100c90 2023-12-16T03:24:23.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.828+0000 7fad1b7fe700 1 -- 172.21.15.64:0/2837896601 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fad2401c430 con 0x7fad34100c90 2023-12-16T03:24:23.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.828+0000 7fad1b7fe700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fad1c06ce60 0x7fad1c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:23.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.828+0000 7fad1b7fe700 1 -- 172.21.15.64:0/2837896601 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fad2408cfe0 con 0x7fad34100c90 2023-12-16T03:24:23.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.828+0000 7fad327fc700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fad1c06ce60 0x7fad1c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:23.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.829+0000 7fad327fc700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fad1c06ce60 0x7fad1c06f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad28006fd0 tx=0x7fad28008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:23.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:23.833+0000 7fad1b7fe700 1 -- 172.21.15.64:0/2837896601 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fad2405aaf0 con 0x7fad34100c90 2023-12-16T03:24:24.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.037+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad34108100 con 0x7fad34100c90 2023-12-16T03:24:24.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.038+0000 7fad1b7fe700 1 -- 172.21.15.64:0/2837896601 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16258 (secure 0 0 0) 0x7fad2405a680 con 0x7fad34100c90 2023-12-16T03:24:24.040 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-12-16T03:24:24.041 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":76,"fsid":"5b4de048-9bc0-11ee-95a5-87774f69a715","created":"2023-12-16T03:08:52.761746+0000","modified":"2023-12-16T03:22:58.469531+0000","last_up_change":"2023-12-16T03:22:57.467644+0000","last_in_change":"2023-12-16T03:12:46.192351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:12:08.817940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T03:13:52.316878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T03:13:52.858683+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94788c05-539e-4b9d-aaa5-099f071ba934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":46,"up_from":50,"up_thru":75,"down_at":47,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":224541298},{"type":"v1","addr":"172.21.15.64:6803","nonce":224541298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":224541298},{"type":"v1","addr":"172.21.15.64:6805","nonce":224541298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":224541298},{"type":"v1","addr":"172.21.15.64:6809","nonce":224541298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":224541298},{"type":"v1","addr":"172.21.15.64:6807","nonce":224541298}]},"public_addr":"172.21.15.64:6803/224541298","cluster_addr":"172.21.15.64:6805/224541298","heartbeat_back_addr":"172.21.15.64:6809/224541298","heartbeat_front_addr":"172.21.15.64:6807/224541298","state":["exists","up"]},{"osd":1,"uuid":"b08e3c59-129c-4baf-89ee-61012384a515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":51,"up_from":55,"up_thru":75,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":262863118},{"type":"v1","addr":"172.21.15.64:6811","nonce":262863118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":262863118},{"type":"v1","addr":"172.21.15.64:6813","nonce":262863118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":262863118},{"type":"v1","addr":"172.21.15.64:6817","nonce":262863118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":262863118},{"type":"v1","addr":"172.21.15.64:6815","nonce":262863118}]},"public_addr":"172.21.15.64:6811/262863118","cluster_addr":"172.21.15.64:6813/262863118","heartbeat_back_addr":"172.21.15.64:6817/262863118","heartbeat_front_addr":"172.21.15.64:6815/262863118","state":["exists","up"]},{"osd":2,"uuid":"18ed018b-ab10-4041-86f5-393af106517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":56,"up_from":60,"up_thru":75,"down_at":57,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":4197214596},{"type":"v1","addr":"172.21.15.64:6819","nonce":4197214596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":4197214596},{"type":"v1","addr":"172.21.15.64:6821","nonce":4197214596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4197214596},{"type":"v1","addr":"172.21.15.64:6825","nonce":4197214596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":4197214596},{"type":"v1","addr":"172.21.15.64:6823","nonce":4197214596}]},"public_addr":"172.21.15.64:6819/4197214596","cluster_addr":"172.21.15.64:6821/4197214596","heartbeat_back_addr":"172.21.15.64:6825/4197214596","heartbeat_front_addr":"172.21.15.64:6823/4197214596","state":["exists","up"]},{"osd":3,"uuid":"de1cc449-de96-410d-9a56-210aae20b3d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":61,"up_from":65,"up_thru":75,"down_at":62,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3426374330},{"type":"v1","addr":"172.21.15.184:6801","nonce":3426374330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3426374330},{"type":"v1","addr":"172.21.15.184:6803","nonce":3426374330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3426374330},{"type":"v1","addr":"172.21.15.184:6807","nonce":3426374330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3426374330},{"type":"v1","addr":"172.21.15.184:6805","nonce":3426374330}]},"public_addr":"172.21.15.184:6801/3426374330","cluster_addr":"172.21.15.184:6803/3426374330","heartbeat_back_addr":"172.21.15.184:6807/3426374330","heartbeat_front_addr":"172.21.15.184:6805/3426374330","state":["exists","up"]},{"osd":4,"uuid":"4dda63b7-8319-476c-8bb6-60dbb2aa1e92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":66,"up_from":70,"up_thru":75,"down_at":67,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":992163260},{"type":"v1","addr":"172.21.15.184:6809","nonce":992163260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":992163260},{"type":"v1","addr":"172.21.15.184:6811","nonce":992163260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":992163260},{"type":"v1","addr":"172.21.15.184:6815","nonce":992163260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":992163260},{"type":"v1","addr":"172.21.15.184:6813","nonce":992163260}]},"public_addr":"172.21.15.184:6809/992163260","cluster_addr":"172.21.15.184:6811/992163260","heartbeat_back_addr":"172.21.15.184:6815/992163260","heartbeat_front_addr":"172.21.15.184:6813/992163260","state":["exists","up"]},{"osd":5,"uuid":"55282f72-d6e4-4f91-9285-9b81aa14a948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":71,"up_from":75,"up_thru":75,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":219910245},{"type":"v1","addr":"172.21.15.184:6817","nonce":219910245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":219910245},{"type":"v1","addr":"172.21.15.184:6819","nonce":219910245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":219910245},{"type":"v1","addr":"172.21.15.184:6823","nonce":219910245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":219910245},{"type":"v1","addr":"172.21.15.184:6821","nonce":219910245}]},"public_addr":"172.21.15.184:6817/219910245","cluster_addr":"172.21.15.184:6819/219910245","heartbeat_back_addr":"172.21.15.184:6823/219910245","heartbeat_front_addr":"172.21.15.184:6821/219910245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:24.502427+0000","dead_epoch":46},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:11:45.326372+0000","dead_epoch":51},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:05.862744+0000","dead_epoch":56},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:24.099546+0000","dead_epoch":61},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:12:42.577575+0000","dead_epoch":66},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:13:01.012096+0000","dead_epoch":71}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6801/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:6801/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/443331071":"2023-12-17T03:16:07.028074+0000","172.21.15.184:0/4039896286":"2023-12-17T03:17:04.353568+0000","172.21.15.64:0/74591443":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/2708172205":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/1123447957":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/3499478012":"2023-12-17T03:19:25.379885+0000","172.21.15.64:6800/1165076471":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/724630608":"2023-12-17T03:16:07.028074+0000","172.21.15.184:6829/2992718398":"2023-12-17T03:17:04.353568+0000","172.21.15.184:6828/2992718398":"2023-12-17T03:17:04.353568+0000","172.21.15.64:0/1829112257":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/3738748261":"2023-12-17T03:10:32.323993+0000","172.21.15.64:0/2508480563":"2023-12-17T03:16:07.028074+0000","172.21.15.184:0/1750382545":"2023-12-17T03:17:04.353568+0000","172.21.15.184:0/3731510372":"2023-12-17T03:17:04.353568+0000","172.21.15.64:6800/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/2069535093":"2023-12-17T03:16:07.028074+0000","172.21.15.64:0/1472132975":"2023-12-17T03:19:25.379885+0000","172.21.15.64:6800/2673193978":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/4039513088":"2023-12-17T03:09:16.219813+0000","172.21.15.64:6801/150543208":"2023-12-17T03:09:16.219813+0000","172.21.15.64:0/882697123":"2023-12-17T03:19:25.379885+0000","172.21.15.184:0/3067356072":"2023-12-17T03:17:04.353568+0000","172.21.15.64:0/2114099737":"2023-12-17T03:16:07.028074+0000","172.21.15.184:0/3518047884":"2023-12-17T03:17:04.353568+0000","172.21.15.64:6800/795909098":"2023-12-17T03:19:25.379885+0000","172.21.15.64:0/3590618737":"2023-12-17T03:19:25.379885+0000","172.21.15.64:6800/2069535093":"2023-12-17T03:16:07.028074+0000","172.21.15.64:6801/795909098":"2023-12-17T03:19:25.379885+0000","172.21.15.64:0/1577100459":"2023-12-17T03:09:16.219813+0000","172.21.15.184:0/2993136503":"2023-12-17T03:17:04.353568+0000","172.21.15.64:0/277874032":"2023-12-17T03:09:42.758504+0000","172.21.15.64:0/3838233490":"2023-12-17T03:09:42.758504+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:24:24.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fad1c06ce60 msgr2=0x7fad1c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fad1c06ce60 0x7fad1c06f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad28006fd0 tx=0x7fad28008040 comp rx=0 tx=0).stop 2023-12-16T03:24:24.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 msgr2=0x7fad341121a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 0x7fad341121a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fad2400b3b0 tx=0x7fad24009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:24.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 shutdown_connections 2023-12-16T03:24:24.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fad1c06ce60 0x7fad1c06f310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad34100c90 0x7fad341121a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 --2- 172.21.15.64:0/2837896601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad34101630 0x7fad341126e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 >> 172.21.15.64:0/2837896601 conn(0x7fad340f67e0 msgr2=0x7fad34104400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:24.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 shutdown_connections 2023-12-16T03:24:24.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.041+0000 7fad3965a700 1 -- 172.21.15.64:0/2837896601 wait complete. 2023-12-16T03:24:24.054 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:23 smithi064 ceph-mon[216854]: pgmap v182: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:24.054 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:23 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/242037088' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T03:24:24.054 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:23 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/4064029646' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T03:24:24.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:12:08.817940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T03:13:52.316878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T03:13:52.858683+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:24:24.056 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:24:24.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.178+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/1398490049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb88101aa0 msgr2=0x7fdb88101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.178+0000 7fdb8e2fb700 1 --2- 172.21.15.64:0/1398490049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb88101aa0 0x7fdb88101e70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdb78004940 tx=0x7fdb78009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:24.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.178+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/1398490049 shutdown_connections 2023-12-16T03:24:24.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.178+0000 7fdb8e2fb700 1 --2- 172.21.15.64:0/1398490049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb880fba60 0x7fdb880fbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.178+0000 7fdb8e2fb700 1 --2- 172.21.15.64:0/1398490049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb88101aa0 0x7fdb88101e70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.178+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/1398490049 >> 172.21.15.64:0/1398490049 conn(0x7fdb880f7600 msgr2=0x7fdb880f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:24.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.178+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/1398490049 shutdown_connections 2023-12-16T03:24:24.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.178+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/1398490049 wait complete. 2023-12-16T03:24:24.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.179+0000 7fdb8e2fb700 1 Processor -- start 2023-12-16T03:24:24.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.179+0000 7fdb8e2fb700 1 -- start start 2023-12-16T03:24:24.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.179+0000 7fdb8e2fb700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb880fba60 0x7fdb88112240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:24.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.179+0000 7fdb8e2fb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb88101aa0 0x7fdb88112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.179+0000 7fdb8e2fb700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb88112e60 con 0x7fdb880fba60 2023-12-16T03:24:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.179+0000 7fdb8e2fb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8810c330 con 0x7fdb88101aa0 2023-12-16T03:24:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.179+0000 7fdb87fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb880fba60 0x7fdb88112240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb87fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb880fba60 0x7fdb88112240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46010/0 (socket says 172.21.15.64:46010) 2023-12-16T03:24:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb87fff700 1 -- 172.21.15.64:0/3232262658 learned_addr learned my addr 172.21.15.64:0/3232262658 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb877fe700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb88101aa0 0x7fdb88112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb87fff700 1 -- 172.21.15.64:0/3232262658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb88101aa0 msgr2=0x7fdb88112780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb87fff700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb88101aa0 0x7fdb88112780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb87fff700 1 -- 172.21.15.64:0/3232262658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78005040 con 0x7fdb880fba60 2023-12-16T03:24:24.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb87fff700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb880fba60 0x7fdb88112240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800b3b0 tx=0x7fdb78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:24.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb84ff9700 1 -- 172.21.15.64:0/3232262658 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb7800e040 con 0x7fdb880fba60 2023-12-16T03:24:24.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb84ff9700 1 -- 172.21.15.64:0/3232262658 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb7801c430 con 0x7fdb880fba60 2023-12-16T03:24:24.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8810c5b0 con 0x7fdb880fba60 2023-12-16T03:24:24.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb84ff9700 1 -- 172.21.15.64:0/3232262658 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb78013640 con 0x7fdb880fba60 2023-12-16T03:24:24.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.180+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8810caf0 con 0x7fdb880fba60 2023-12-16T03:24:24.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.181+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb88103f20 con 0x7fdb880fba60 2023-12-16T03:24:24.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.182+0000 7fdb84ff9700 1 -- 172.21.15.64:0/3232262658 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fdb7801c5a0 con 0x7fdb880fba60 2023-12-16T03:24:24.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.183+0000 7fdb84ff9700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdb7406ce60 0x7fdb7406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:24.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.183+0000 7fdb84ff9700 1 -- 172.21.15.64:0/3232262658 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fdb7808d560 con 0x7fdb880fba60 2023-12-16T03:24:24.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.183+0000 7fdb877fe700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdb7406ce60 0x7fdb7406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:24.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.183+0000 7fdb877fe700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdb7406ce60 0x7fdb7406f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdb8810db20 tx=0x7fdb700091a0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:24.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.187+0000 7fdb84ff9700 1 -- 172.21.15.64:0/3232262658 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fdb78057660 con 0x7fdb880fba60 2023-12-16T03:24:24.310 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:23 smithi184 ceph-mon[184130]: pgmap v182: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-16T03:24:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:23 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/242037088' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T03:24:24.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:23 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/4064029646' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T03:24:24.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.386+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb8810d860 con 0x7fdb880fba60 2023-12-16T03:24:24.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.386+0000 7fdb84ff9700 1 -- 172.21.15.64:0/3232262658 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb7805ac80 con 0x7fdb880fba60 2023-12-16T03:24:24.389 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-12-16T03:24:24.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdb7406ce60 msgr2=0x7fdb7406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdb7406ce60 0x7fdb7406f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdb8810db20 tx=0x7fdb700091a0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb880fba60 msgr2=0x7fdb88112240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb880fba60 0x7fdb88112240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800b3b0 tx=0x7fdb78009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:24.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 shutdown_connections 2023-12-16T03:24:24.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdb7406ce60 0x7fdb7406f310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb880fba60 0x7fdb88112240 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 --2- 172.21.15.64:0/3232262658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb88101aa0 0x7fdb88112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 >> 172.21.15.64:0/3232262658 conn(0x7fdb880f7600 msgr2=0x7fdb880f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:24.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 shutdown_connections 2023-12-16T03:24:24.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.389+0000 7fdb8e2fb700 1 -- 172.21.15.64:0/3232262658 wait complete. 2023-12-16T03:24:24.403 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T03:24:24.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.526+0000 7f32b9b3b700 1 -- 172.21.15.64:0/1890084099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fdb50 msgr2=0x7f32b40fdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.526+0000 7f32b9b3b700 1 --2- 172.21.15.64:0/1890084099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fdb50 0x7f32b40fdf20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f329c004940 tx=0x7f329c009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:24.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.526+0000 7f32b9b3b700 1 -- 172.21.15.64:0/1890084099 shutdown_connections 2023-12-16T03:24:24.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.526+0000 7f32b9b3b700 1 --2- 172.21.15.64:0/1890084099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32b40fe4f0 0x7f32b4106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.526+0000 7f32b9b3b700 1 --2- 172.21.15.64:0/1890084099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fdb50 0x7f32b40fdf20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.526+0000 7f32b9b3b700 1 -- 172.21.15.64:0/1890084099 >> 172.21.15.64:0/1890084099 conn(0x7f32b40f7600 msgr2=0x7f32b40f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:24.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.526+0000 7f32b9b3b700 1 -- 172.21.15.64:0/1890084099 shutdown_connections 2023-12-16T03:24:24.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.526+0000 7f32b9b3b700 1 -- 172.21.15.64:0/1890084099 wait complete. 2023-12-16T03:24:24.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.526+0000 7f32b9b3b700 1 Processor -- start 2023-12-16T03:24:24.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b9b3b700 1 -- start start 2023-12-16T03:24:24.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b9b3b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32b40fdb50 0x7f32b4113300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:24.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b9b3b700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fe4f0 0x7f32b4113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:24.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b9b3b700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4113e90 con 0x7f32b40fe4f0 2023-12-16T03:24:24.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b9b3b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b410d3b0 con 0x7f32b40fdb50 2023-12-16T03:24:24.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b2ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fe4f0 0x7f32b4113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:24.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b2ffd700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fe4f0 0x7f32b4113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46026/0 (socket says 172.21.15.64:46026) 2023-12-16T03:24:24.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b2ffd700 1 -- 172.21.15.64:0/572356474 learned_addr learned my addr 172.21.15.64:0/572356474 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:24.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b37fe700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32b40fdb50 0x7f32b4113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:24.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b2ffd700 1 -- 172.21.15.64:0/572356474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32b40fdb50 msgr2=0x7f32b4113300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b2ffd700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32b40fdb50 0x7f32b4113300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b2ffd700 1 -- 172.21.15.64:0/572356474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c005040 con 0x7f32b40fe4f0 2023-12-16T03:24:24.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b37fe700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32b40fdb50 0x7f32b4113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:24:24.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.527+0000 7f32b2ffd700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fe4f0 0x7f32b4113840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f32a4002a50 tx=0x7f32a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:24.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.528+0000 7f32abfff700 1 -- 172.21.15.64:0/572356474 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a4007cc0 con 0x7f32b40fe4f0 2023-12-16T03:24:24.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.528+0000 7f32abfff700 1 -- 172.21.15.64:0/572356474 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f32a400f040 con 0x7f32b40fe4f0 2023-12-16T03:24:24.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.528+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b410d690 con 0x7f32b40fe4f0 2023-12-16T03:24:24.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.528+0000 7f32abfff700 1 -- 172.21.15.64:0/572356474 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a4009540 con 0x7f32b40fe4f0 2023-12-16T03:24:24.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.528+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b410dbd0 con 0x7f32b40fe4f0 2023-12-16T03:24:24.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.529+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b4104140 con 0x7f32b40fe4f0 2023-12-16T03:24:24.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.529+0000 7f32abfff700 1 -- 172.21.15.64:0/572356474 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f32a40096a0 con 0x7f32b40fe4f0 2023-12-16T03:24:24.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.530+0000 7f32abfff700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f32a006ce60 0x7f32a006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:24.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.530+0000 7f32b37fe700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f32a006ce60 0x7f32a006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:24.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.530+0000 7f32abfff700 1 -- 172.21.15.64:0/572356474 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f32a408c0a0 con 0x7f32b40fe4f0 2023-12-16T03:24:24.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.530+0000 7f32b37fe700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f32a006ce60 0x7f32a006f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f329c004f90 tx=0x7f329c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:24.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.534+0000 7f32abfff700 1 -- 172.21.15.64:0/572356474 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f32a4059a60 con 0x7f32b40fe4f0 2023-12-16T03:24:24.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.736+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f32b4063ea0 con 0x7f32b40fe4f0 2023-12-16T03:24:24.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.736+0000 7f32abfff700 1 -- 172.21.15.64:0/572356474 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v76) v1 ==== 107+0+11 (secure 0 0 0) 0x7f32a40595f0 con 0x7f32b40fe4f0 2023-12-16T03:24:24.738 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-12-16T03:24:24.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f32a006ce60 msgr2=0x7f32a006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f32a006ce60 0x7f32a006f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f329c004f90 tx=0x7f329c009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:24.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fe4f0 msgr2=0x7f32b4113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fe4f0 0x7f32b4113840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f32a4002a50 tx=0x7f32a40046b0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 shutdown_connections 2023-12-16T03:24:24.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7f32a006ce60 0x7f32a006f310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32b40fdb50 0x7f32b4113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 --2- 172.21.15.64:0/572356474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b40fe4f0 0x7f32b4113840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 >> 172.21.15.64:0/572356474 conn(0x7f32b40f7600 msgr2=0x7f32b41012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 shutdown_connections 2023-12-16T03:24:24.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.739+0000 7f32b9b3b700 1 -- 172.21.15.64:0/572356474 wait complete. 2023-12-16T03:24:24.753 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T03:24:24.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.877+0000 7fef5a535700 1 -- 172.21.15.64:0/1900794143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef541023d0 msgr2=0x7fef540fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.877+0000 7fef5a535700 1 --2- 172.21.15.64:0/1900794143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef541023d0 0x7fef540fba60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef3c004940 tx=0x7fef3c009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:24.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.877+0000 7fef5a535700 1 -- 172.21.15.64:0/1900794143 shutdown_connections 2023-12-16T03:24:24.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.877+0000 7fef5a535700 1 --2- 172.21.15.64:0/1900794143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef541023d0 0x7fef540fba60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.877+0000 7fef5a535700 1 --2- 172.21.15.64:0/1900794143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef54101ac0 0x7fef54101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.877+0000 7fef5a535700 1 -- 172.21.15.64:0/1900794143 >> 172.21.15.64:0/1900794143 conn(0x7fef54071970 msgr2=0x7fef54071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:24.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.877+0000 7fef5a535700 1 -- 172.21.15.64:0/1900794143 shutdown_connections 2023-12-16T03:24:24.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.877+0000 7fef5a535700 1 -- 172.21.15.64:0/1900794143 wait complete. 2023-12-16T03:24:24.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef5a535700 1 Processor -- start 2023-12-16T03:24:24.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef5a535700 1 -- start start 2023-12-16T03:24:24.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef5a535700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef54101ac0 0x7fef54112240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:24.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef5a535700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef541023d0 0x7fef54112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:24.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef5a535700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54112dd0 con 0x7fef54101ac0 2023-12-16T03:24:24.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef5a535700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5410c2f0 con 0x7fef541023d0 2023-12-16T03:24:24.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef53fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef54101ac0 0x7fef54112240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:24.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef53fff700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef54101ac0 0x7fef54112240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46054/0 (socket says 172.21.15.64:46054) 2023-12-16T03:24:24.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef53fff700 1 -- 172.21.15.64:0/2870619599 learned_addr learned my addr 172.21.15.64:0/2870619599 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:24.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.878+0000 7fef537fe700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef541023d0 0x7fef54112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:24.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef53fff700 1 -- 172.21.15.64:0/2870619599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef541023d0 msgr2=0x7fef54112780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:24.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef53fff700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef541023d0 0x7fef54112780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:24.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef53fff700 1 -- 172.21.15.64:0/2870619599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c005040 con 0x7fef54101ac0 2023-12-16T03:24:24.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef537fe700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef541023d0 0x7fef54112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:24:24.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef53fff700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef54101ac0 0x7fef54112240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c830 tx=0x7fef44004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:24.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef50ff9700 1 -- 172.21.15.64:0/2870619599 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef4400a760 con 0x7fef54101ac0 2023-12-16T03:24:24.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef50ff9700 1 -- 172.21.15.64:0/2870619599 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef4400ad70 con 0x7fef54101ac0 2023-12-16T03:24:24.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5410c5d0 con 0x7fef54101ac0 2023-12-16T03:24:24.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef50ff9700 1 -- 172.21.15.64:0/2870619599 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef440113a0 con 0x7fef54101ac0 2023-12-16T03:24:24.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.879+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5410cb90 con 0x7fef54101ac0 2023-12-16T03:24:24.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.880+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef54103f00 con 0x7fef54101ac0 2023-12-16T03:24:24.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.880+0000 7fef50ff9700 1 -- 172.21.15.64:0/2870619599 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fef44012400 con 0x7fef54101ac0 2023-12-16T03:24:24.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.881+0000 7fef50ff9700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4006ce60 0x7fef4006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:24.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.881+0000 7fef50ff9700 1 -- 172.21.15.64:0/2870619599 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fef4408c2c0 con 0x7fef54101ac0 2023-12-16T03:24:24.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.881+0000 7fef537fe700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4006ce60 0x7fef4006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:24.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.881+0000 7fef537fe700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4006ce60 0x7fef4006f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00b3b0 tx=0x7fef3c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:24.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:24.885+0000 7fef50ff9700 1 -- 172.21.15.64:0/2870619599 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fef44059d00 con 0x7fef54101ac0 2023-12-16T03:24:25.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.084+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fef5410d820 con 0x7fef54101ac0 2023-12-16T03:24:25.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.085+0000 7fef50ff9700 1 -- 172.21.15.64:0/2870619599 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v76) v1 ==== 107+0+11 (secure 0 0 0) 0x7fef44059890 con 0x7fef54101ac0 2023-12-16T03:24:25.087 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-12-16T03:24:25.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4006ce60 msgr2=0x7fef4006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:25.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4006ce60 0x7fef4006f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00b3b0 tx=0x7fef3c009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:25.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef54101ac0 msgr2=0x7fef54112240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:25.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef54101ac0 0x7fef54112240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c830 tx=0x7fef44004470 comp rx=0 tx=0).stop 2023-12-16T03:24:25.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 shutdown_connections 2023-12-16T03:24:25.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fef4006ce60 0x7fef4006f310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:25.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef54101ac0 0x7fef54112240 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:25.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 --2- 172.21.15.64:0/2870619599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef541023d0 0x7fef54112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:25.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 >> 172.21.15.64:0/2870619599 conn(0x7fef54071970 msgr2=0x7fef540faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:25.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 shutdown_connections 2023-12-16T03:24:25.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.087+0000 7fef5a535700 1 -- 172.21.15.64:0/2870619599 wait complete. 2023-12-16T03:24:25.100 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:24 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/2837896601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:24:25.100 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:24 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/3232262658' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T03:24:25.100 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:24 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/572356474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T03:24:25.101 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:24:25.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.222+0000 7fdf63467700 1 -- 172.21.15.64:0/2576498814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c101ac0 msgr2=0x7fdf5c101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:25.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.222+0000 7fdf63467700 1 --2- 172.21.15.64:0/2576498814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c101ac0 0x7fdf5c101e90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdf58004940 tx=0x7fdf58009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:25.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.222+0000 7fdf63467700 1 -- 172.21.15.64:0/2576498814 shutdown_connections 2023-12-16T03:24:25.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.222+0000 7fdf63467700 1 --2- 172.21.15.64:0/2576498814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf5c1023d0 0x7fdf5c0fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:25.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.222+0000 7fdf63467700 1 --2- 172.21.15.64:0/2576498814 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c101ac0 0x7fdf5c101e90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:25.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.223+0000 7fdf63467700 1 -- 172.21.15.64:0/2576498814 >> 172.21.15.64:0/2576498814 conn(0x7fdf5c071970 msgr2=0x7fdf5c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:25.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.223+0000 7fdf63467700 1 -- 172.21.15.64:0/2576498814 shutdown_connections 2023-12-16T03:24:25.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.223+0000 7fdf63467700 1 -- 172.21.15.64:0/2576498814 wait complete. 2023-12-16T03:24:25.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.223+0000 7fdf63467700 1 Processor -- start 2023-12-16T03:24:25.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.223+0000 7fdf63467700 1 -- start start 2023-12-16T03:24:25.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.223+0000 7fdf63467700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf5c101ac0 0x7fdf5c112240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:25.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.223+0000 7fdf63467700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c1023d0 0x7fdf5c112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:25.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.223+0000 7fdf63467700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c112dd0 con 0x7fdf5c1023d0 2023-12-16T03:24:25.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.223+0000 7fdf63467700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c10c2f0 con 0x7fdf5c101ac0 2023-12-16T03:24:25.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf60a02700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c1023d0 0x7fdf5c112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:25.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf60a02700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c1023d0 0x7fdf5c112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46084/0 (socket says 172.21.15.64:46084) 2023-12-16T03:24:25.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf60a02700 1 -- 172.21.15.64:0/1290937816 learned_addr learned my addr 172.21.15.64:0/1290937816 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-12-16T03:24:25.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf61203700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf5c101ac0 0x7fdf5c112240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:25.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf60a02700 1 -- 172.21.15.64:0/1290937816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf5c101ac0 msgr2=0x7fdf5c112240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:25.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf60a02700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf5c101ac0 0x7fdf5c112240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:25.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf60a02700 1 -- 172.21.15.64:0/1290937816 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf58005040 con 0x7fdf5c1023d0 2023-12-16T03:24:25.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf60a02700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c1023d0 0x7fdf5c112780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000fce0 tx=0x7fdf50004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:25.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf4dffb700 1 -- 172.21.15.64:0/1290937816 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf5000fe90 con 0x7fdf5c1023d0 2023-12-16T03:24:25.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf4dffb700 1 -- 172.21.15.64:0/1290937816 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf500090d0 con 0x7fdf5c1023d0 2023-12-16T03:24:25.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf4dffb700 1 -- 172.21.15.64:0/1290937816 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf500126a0 con 0x7fdf5c1023d0 2023-12-16T03:24:25.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c10c570 con 0x7fdf5c1023d0 2023-12-16T03:24:25.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.224+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c10cb30 con 0x7fdf5c1023d0 2023-12-16T03:24:25.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.225+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5c064730 con 0x7fdf5c1023d0 2023-12-16T03:24:25.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.226+0000 7fdf4dffb700 1 -- 172.21.15.64:0/1290937816 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fdf50009690 con 0x7fdf5c1023d0 2023-12-16T03:24:25.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.226+0000 7fdf4dffb700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdf4806ce70 0x7fdf4806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:25.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.226+0000 7fdf4dffb700 1 -- 172.21.15.64:0/1290937816 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fdf5008eaa0 con 0x7fdf5c1023d0 2023-12-16T03:24:25.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.226+0000 7fdf61203700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdf4806ce70 0x7fdf4806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:25.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.227+0000 7fdf61203700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdf4806ce70 0x7fdf4806f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800b3b0 tx=0x7fdf58009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:25.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.231+0000 7fdf4dffb700 1 -- 172.21.15.64:0/1290937816 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fdf5005c460 con 0x7fdf5c1023d0 2023-12-16T03:24:25.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:24 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/2837896601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T03:24:25.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:24 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/3232262658' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T03:24:25.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:24 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/572356474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T03:24:25.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.449+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdf5c108a10 con 0x7fdf5c1023d0 2023-12-16T03:24:25.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.449+0000 7fdf4dffb700 1 -- 172.21.15.64:0/1290937816 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v76) v1 ==== 81+0+2064 (secure 0 0 0) 0x7fdf5005bff0 con 0x7fdf5c1023d0 2023-12-16T03:24:25.451 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/2673193978 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:25.451 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/1165076471 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:25.451 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/443331071 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:25.451 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/4039896286 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:25.452 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/74591443 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:25.452 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/2708172205 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:25.452 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/1123447957 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:25.452 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/3499478012 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:25.452 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/1165076471 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:25.452 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/724630608 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:25.452 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:6829/2992718398 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:25.452 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:6828/2992718398 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:25.453 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/1829112257 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:25.453 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/3738748261 2023-12-17T03:10:32.323993+0000 2023-12-16T03:24:25.453 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/2508480563 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:25.453 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/1750382545 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:25.453 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/3731510372 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:25.453 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/150543208 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:25.453 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/2069535093 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:25.453 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/1472132975 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:25.453 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/2673193978 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:25.454 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/4039513088 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:25.454 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/150543208 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:25.454 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/882697123 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:25.454 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/3067356072 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:25.454 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/2114099737 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:25.454 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/3518047884 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:25.454 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/795909098 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:25.454 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/3590618737 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:25.454 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6800/2069535093 2023-12-17T03:16:07.028074+0000 2023-12-16T03:24:25.455 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:6801/795909098 2023-12-17T03:19:25.379885+0000 2023-12-16T03:24:25.455 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/1577100459 2023-12-17T03:09:16.219813+0000 2023-12-16T03:24:25.455 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.184:0/2993136503 2023-12-17T03:17:04.353568+0000 2023-12-16T03:24:25.455 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/277874032 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:25.455 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64:0/3838233490 2023-12-17T03:09:42.758504+0000 2023-12-16T03:24:25.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdf4806ce70 msgr2=0x7fdf4806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:25.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdf4806ce70 0x7fdf4806f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800b3b0 tx=0x7fdf58009e30 comp rx=0 tx=0).stop 2023-12-16T03:24:25.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c1023d0 msgr2=0x7fdf5c112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:25.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c1023d0 0x7fdf5c112780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000fce0 tx=0x7fdf50004600 comp rx=0 tx=0).stop 2023-12-16T03:24:25.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 shutdown_connections 2023-12-16T03:24:25.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:6800/1308629780,v1:172.21.15.64:6801/1308629780] conn(0x7fdf4806ce70 0x7fdf4806f320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:25.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf5c101ac0 0x7fdf5c112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:25.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 --2- 172.21.15.64:0/1290937816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf5c1023d0 0x7fdf5c112780 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:25.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 >> 172.21.15.64:0/1290937816 conn(0x7fdf5c071970 msgr2=0x7fdf5c0faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:25.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.451+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 shutdown_connections 2023-12-16T03:24:25.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-12-16T03:24:25.452+0000 7fdf63467700 1 -- 172.21.15.64:0/1290937816 wait complete. 2023-12-16T03:24:25.457 INFO:teuthology.orchestra.run.smithi064.stderr:listed 35 entries 2023-12-16T03:24:25.466 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T03:24:25.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:25.466 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T03:24:25.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-12-16T03:24:25.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:25.518 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T03:24:25.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:25.584 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-12-16T03:24:25.656 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T03:24:25.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:25.656 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:24:25.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:25.733 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2023-12-16T03:24:25.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:25.819 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-12-16T03:24:25.838 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T03:24:25.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:25.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:24:25.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:24:25.929 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-12-16T03:24:25.998 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-16T03:24:26.008 INFO:tasks.cephadm:Teardown begin 2023-12-16T03:24:26.009 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T03:24:26.036 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:25 smithi064 ceph-mon[216854]: pgmap v183: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-16T03:24:26.036 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:25 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/2870619599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T03:24:26.036 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:25 smithi064 ceph-mon[216854]: from='client.? 172.21.15.64:0/1290937816' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T03:24:26.036 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:25 smithi064 ceph-mon[216854]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:24:26.039 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T03:24:26.069 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-16T03:24:26.069 DEBUG:teuthology.orchestra.run.smithi064:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-16T03:24:26.098 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-16T03:24:26.127 INFO:tasks.cephadm:Stopping all daemons... 2023-12-16T03:24:26.127 INFO:tasks.cephadm.mon.smithi064:Stopping mon.smithi064... 2023-12-16T03:24:26.128 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi064 2023-12-16T03:24:26.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:25 smithi184 ceph-mon[184130]: pgmap v183: 65 pgs: 65 active+clean; 314 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-16T03:24:26.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:25 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/2870619599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T03:24:26.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:25 smithi184 ceph-mon[184130]: from='client.? 172.21.15.64:0/1290937816' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T03:24:26.311 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:25 smithi184 ceph-mon[184130]: from='mgr.34100 172.21.15.64:0/1631875535' entity='mgr.smithi064.ueciyw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T03:24:26.346 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:26 smithi064 systemd[1]: Stopping Ceph mon.smithi064 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:24:26.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:26 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064[216831]: 2023-12-16T03:24:26.343+0000 7fe8a985e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi064 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:24:26.693 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:26 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064[216831]: 2023-12-16T03:24:26.343+0000 7fe8a985e700 -1 mon.smithi064@0(leader) e3 *** Got Signal Terminated *** 2023-12-16T03:24:27.026 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Dec 16 03:24:26 smithi064 bash[256662]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi064 2023-12-16T03:24:27.032 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi064.service' 2023-12-16T03:24:27.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T03:24:27.086 INFO:tasks.cephadm.mon.smithi064:Stopped mon.smithi064 2023-12-16T03:24:27.086 INFO:tasks.cephadm.mon.smithi184:Stopping mon.smithi184... 2023-12-16T03:24:27.086 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi184 2023-12-16T03:24:27.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:27 smithi184 systemd[1]: Stopping Ceph mon.smithi184 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:24:27.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:27 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi184[184107]: 2023-12-16T03:24:27.361+0000 7f3ee5fa1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi184 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:24:27.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:27 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi184[184107]: 2023-12-16T03:24:27.361+0000 7f3ee5fa1700 -1 mon.smithi184@1(peon) e3 *** Got Signal Terminated *** 2023-12-16T03:24:28.017 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Dec 16 03:24:27 smithi184 bash[215352]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-mon-smithi184 2023-12-16T03:24:28.024 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@mon.smithi184.service' 2023-12-16T03:24:28.081 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T03:24:28.082 INFO:tasks.cephadm.mon.smithi184:Stopped mon.smithi184 2023-12-16T03:24:28.082 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-16T03:24:28.082 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.0 2023-12-16T03:24:28.442 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:24:28 smithi064 systemd[1]: Stopping Ceph osd.0 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:24:28.443 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:24:28 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[232116]: 2023-12-16T03:24:28.318+0000 7fa6e6a0b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:24:28.443 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:24:28 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[232116]: 2023-12-16T03:24:28.318+0000 7fa6e6a0b700 -1 osd.0 76 *** Got signal Terminated *** 2023-12-16T03:24:28.443 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:24:28 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0[232116]: 2023-12-16T03:24:28.318+0000 7fa6e6a0b700 -1 osd.0 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:24:34.193 INFO:journalctl@ceph.osd.0.smithi064.stdout:Dec 16 03:24:34 smithi064 bash[256818]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-0 2023-12-16T03:24:35.154 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.0.service' 2023-12-16T03:24:35.196 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T03:24:35.196 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-16T03:24:35.196 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-16T03:24:35.196 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.1 2023-12-16T03:24:35.432 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:24:35 smithi064 systemd[1]: Stopping Ceph osd.1 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:24:35.692 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:24:35 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[239418]: 2023-12-16T03:24:35.429+0000 7fc3c0967700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:24:35.693 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:24:35 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[239418]: 2023-12-16T03:24:35.429+0000 7fc3c0967700 -1 osd.1 76 *** Got signal Terminated *** 2023-12-16T03:24:35.693 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:24:35 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1[239418]: 2023-12-16T03:24:35.429+0000 7fc3c0967700 -1 osd.1 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:24:41.193 INFO:journalctl@ceph.osd.1.smithi064.stdout:Dec 16 03:24:40 smithi064 bash[257079]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-1 2023-12-16T03:24:42.127 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.1.service' 2023-12-16T03:24:42.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T03:24:42.169 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-16T03:24:42.170 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-16T03:24:42.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.2 2023-12-16T03:24:42.434 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:24:42 smithi064 systemd[1]: Stopping Ceph osd.2 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:24:42.693 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:24:42 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[246767]: 2023-12-16T03:24:42.431+0000 7faa94525700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:24:42.693 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:24:42 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[246767]: 2023-12-16T03:24:42.431+0000 7faa94525700 -1 osd.2 76 *** Got signal Terminated *** 2023-12-16T03:24:42.693 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:24:42 smithi064 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2[246767]: 2023-12-16T03:24:42.431+0000 7faa94525700 -1 osd.2 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:24:48.443 INFO:journalctl@ceph.osd.2.smithi064.stdout:Dec 16 03:24:48 smithi064 bash[257346]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-2 2023-12-16T03:24:49.375 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.2.service' 2023-12-16T03:24:49.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T03:24:49.417 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-16T03:24:49.417 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-16T03:24:49.418 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.3 2023-12-16T03:24:49.811 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:24:49 smithi184 systemd[1]: Stopping Ceph osd.3 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:24:49.811 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:24:49 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[196701]: 2023-12-16T03:24:49.636+0000 7ff601d6d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:24:49.811 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:24:49 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[196701]: 2023-12-16T03:24:49.636+0000 7ff601d6d700 -1 osd.3 76 *** Got signal Terminated *** 2023-12-16T03:24:49.812 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:24:49 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[196701]: 2023-12-16T03:24:49.636+0000 7ff601d6d700 -1 osd.3 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:24:55.060 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:24:54 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3[196701]: 2023-12-16T03:24:54.564+0000 7ff5fe368700 -1 osd.3 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:28.363835+0000 front 2023-12-16T03:24:28.363903+0000 (oldest deadline 2023-12-16T03:24:54.263751+0000) 2023-12-16T03:24:55.560 INFO:journalctl@ceph.osd.3.smithi184.stdout:Dec 16 03:24:55 smithi184 bash[215500]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-3 2023-12-16T03:24:56.061 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:24:55 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:24:55.992+0000 7f3749b43700 -1 osd.4 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:30.871841+0000 front 2023-12-16T03:24:30.871826+0000 (oldest deadline 2023-12-16T03:24:55.571847+0000) 2023-12-16T03:24:56.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.3.service' 2023-12-16T03:24:56.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T03:24:56.617 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-16T03:24:56.617 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-16T03:24:56.617 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.4 2023-12-16T03:24:56.883 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:24:56 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:24:56.707+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:24:56.883 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:24:56 smithi184 systemd[1]: Stopping Ceph osd.4 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:24:56.883 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:24:56 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:24:56.880+0000 7f375054e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:24:56.883 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:24:56 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:24:56.880+0000 7f375054e700 -1 osd.4 76 *** Got signal Terminated *** 2023-12-16T03:24:56.884 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:24:56 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:24:56.880+0000 7f375054e700 -1 osd.4 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:24:57.310 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:24:57 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:24:57.030+0000 7f3749b43700 -1 osd.4 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:30.871841+0000 front 2023-12-16T03:24:30.871826+0000 (oldest deadline 2023-12-16T03:24:55.571847+0000) 2023-12-16T03:24:58.007 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:24:57 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:24:57.693+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:24:58.311 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:24:58 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:24:58.005+0000 7f3749b43700 -1 osd.4 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:30.871841+0000 front 2023-12-16T03:24:30.871826+0000 (oldest deadline 2023-12-16T03:24:55.571847+0000) 2023-12-16T03:24:58.997 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:24:58 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:24:58.650+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:24:59.310 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:24:58 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:24:58.995+0000 7f3749b43700 -1 osd.4 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:30.871841+0000 front 2023-12-16T03:24:30.871826+0000 (oldest deadline 2023-12-16T03:24:55.571847+0000) 2023-12-16T03:24:59.998 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:24:59 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:24:59.648+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:00.311 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:24:59 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:24:59.996+0000 7f3749b43700 -1 osd.4 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:30.871841+0000 front 2023-12-16T03:24:30.871826+0000 (oldest deadline 2023-12-16T03:24:55.571847+0000) 2023-12-16T03:25:00.961 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:00 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:00.651+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:01.311 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:25:00 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4[202808]: 2023-12-16T03:25:00.959+0000 7f3749b43700 -1 osd.4 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:30.871841+0000 front 2023-12-16T03:24:30.871826+0000 (oldest deadline 2023-12-16T03:24:55.571847+0000) 2023-12-16T03:25:02.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:01 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:01.611+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:02.811 INFO:journalctl@ceph.osd.4.smithi184.stdout:Dec 16 03:25:02 smithi184 bash[215762]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-4 2023-12-16T03:25:02.811 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:02 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:02.567+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:02.811 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:02 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:02.567+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6814 osd.1 since back 2023-12-16T03:24:36.325256+0000 front 2023-12-16T03:24:36.325198+0000 (oldest deadline 2023-12-16T03:25:01.624954+0000) 2023-12-16T03:25:03.810 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:03 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:03.579+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:03.811 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:03 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:03.579+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6814 osd.1 since back 2023-12-16T03:24:36.325256+0000 front 2023-12-16T03:24:36.325198+0000 (oldest deadline 2023-12-16T03:25:01.624954+0000) 2023-12-16T03:25:03.832 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.4.service' 2023-12-16T03:25:03.873 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T03:25:03.873 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-16T03:25:03.873 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-16T03:25:03.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.5 2023-12-16T03:25:04.111 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:03 smithi184 systemd[1]: Stopping Ceph osd.5 for 5b4de048-9bc0-11ee-95a5-87774f69a715... 2023-12-16T03:25:04.534 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:04 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:04.109+0000 7f73db45c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T03:25:04.534 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:04 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:04.109+0000 7f73db45c700 -1 osd.5 76 *** Got signal Terminated *** 2023-12-16T03:25:04.534 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:04 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:04.109+0000 7f73db45c700 -1 osd.5 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T03:25:04.534 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:04 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:04.532+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:04.810 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:04 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:04.532+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6814 osd.1 since back 2023-12-16T03:24:36.325256+0000 front 2023-12-16T03:24:36.325198+0000 (oldest deadline 2023-12-16T03:25:01.624954+0000) 2023-12-16T03:25:05.810 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:05 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:05.505+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:05.811 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:05 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:05.505+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6814 osd.1 since back 2023-12-16T03:24:36.325256+0000 front 2023-12-16T03:24:36.325198+0000 (oldest deadline 2023-12-16T03:25:01.624954+0000) 2023-12-16T03:25:06.811 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:06 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:06.540+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:06.811 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:06 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:06.540+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6814 osd.1 since back 2023-12-16T03:24:36.325256+0000 front 2023-12-16T03:24:36.325198+0000 (oldest deadline 2023-12-16T03:25:01.624954+0000) 2023-12-16T03:25:07.810 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:07 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:07.520+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:07.811 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:07 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:07.520+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6814 osd.1 since back 2023-12-16T03:24:36.325256+0000 front 2023-12-16T03:24:36.325198+0000 (oldest deadline 2023-12-16T03:25:01.624954+0000) 2023-12-16T03:25:09.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:08 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:08.568+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6806 osd.0 since back 2023-12-16T03:24:31.724293+0000 front 2023-12-16T03:24:31.724305+0000 (oldest deadline 2023-12-16T03:24:56.324628+0000) 2023-12-16T03:25:09.061 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:08 smithi184 ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5[209643]: 2023-12-16T03:25:08.568+0000 7f73d4250700 -1 osd.5 76 heartbeat_check: no reply from 172.21.15.64:6814 osd.1 since back 2023-12-16T03:24:36.325256+0000 front 2023-12-16T03:24:36.325198+0000 (oldest deadline 2023-12-16T03:25:01.624954+0000) 2023-12-16T03:25:10.060 INFO:journalctl@ceph.osd.5.smithi184.stdout:Dec 16 03:25:09 smithi184 bash[216031]: ceph-5b4de048-9bc0-11ee-95a5-87774f69a715-osd-5 2023-12-16T03:25:11.089 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b4de048-9bc0-11ee-95a5-87774f69a715@osd.5.service' 2023-12-16T03:25:11.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T03:25:11.129 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-16T03:25:11.129 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-16T03:25:29.411 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-16T03:25:42.709 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T03:25:42.747 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T03:25:42.779 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-16T03:25:42.781 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523/remote/smithi064/crash 2023-12-16T03:25:42.782 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/crash -- . 2023-12-16T03:25:42.818 INFO:teuthology.orchestra.run.smithi064.stderr:tar: /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-16T03:25:42.818 INFO:teuthology.orchestra.run.smithi064.stderr:tar: Error is not recoverable: exiting now 2023-12-16T03:25:42.820 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523/remote/smithi184/crash 2023-12-16T03:25:42.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/crash -- . 2023-12-16T03:25:42.846 INFO:teuthology.orchestra.run.smithi184.stderr:tar: /var/lib/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-16T03:25:42.847 INFO:teuthology.orchestra.run.smithi184.stderr:tar: Error is not recoverable: exiting now 2023-12-16T03:25:42.848 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-16T03:25:42.848 DEBUG:teuthology.orchestra.run.smithi064:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-16T03:25:42.893 INFO:teuthology.orchestra.run.smithi064.stderr:grep: /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph.log: No such file or directory 2023-12-16T03:25:42.895 INFO:tasks.cephadm:Compressing logs... 2023-12-16T03:25:42.895 DEBUG:teuthology.orchestra.run.smithi064:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T03:25:42.937 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T03:25:42.964 INFO:teuthology.orchestra.run.smithi064.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-16T03:25:42.964 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T03:25:42.964 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T03:25:42.965 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-16T03:25:42.966 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-16T03:25:42.966 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi064.jaepzs.log 2023-12-16T03:25:42.967 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mon.smithi064.log 2023-12-16T03:25:42.967 INFO:teuthology.orchestra.run.smithi184.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-16T03:25:42.968 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T03:25:42.968 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mgr.smithi184.urtxla.log 2023-12-16T03:25:42.968 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/cephadm.log: -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T03:25:42.968 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mgr.smithi184.urtxla.log: gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mon.smithi184.log 2023-12-16T03:25:42.968 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-16T03:25:42.968 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-volume.log: /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mon.smithi184.log: gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi184.jfpiqk.log 2023-12-16T03:25:42.968 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.3.log: /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi184.jfpiqk.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T03:25:42.972 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-16T03:25:42.972 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-16T03:25:42.975 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi064.jaepzs.log: gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mgr.smithi064.ueciyw.log 2023-12-16T03:25:42.975 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mon.smithi064.log: /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mgr.smithi064.ueciyw.log: 91.0% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T03:25:42.975 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi064.edrjyd.log 2023-12-16T03:25:42.976 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-16T03:25:42.977 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.4.log: /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi184.uqpwjn.log 2023-12-16T03:25:42.977 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi184.uqpwjn.log: 91.0% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T03:25:42.977 INFO:teuthology.orchestra.run.smithi184.stderr: 94.2% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi184.uqpwjn.log.gz 2023-12-16T03:25:42.980 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi064.edrjyd.log: /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.1.log: 90.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T03:25:42.980 INFO:teuthology.orchestra.run.smithi064.stderr: 94.2% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi064.edrjyd.log.gz 2023-12-16T03:25:43.009 INFO:teuthology.orchestra.run.smithi184.stderr: 88.4% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mgr.smithi184.urtxla.log.gz 2023-12-16T03:25:43.255 INFO:teuthology.orchestra.run.smithi184.stderr: 92.5% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mon.smithi184.log.gz 2023-12-16T03:25:43.269 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mgr.smithi064.ueciyw.log.gz 2023-12-16T03:25:43.822 INFO:teuthology.orchestra.run.smithi064.stderr: 90.7% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mon.smithi064.log.gz 2023-12-16T03:25:46.812 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-16T03:25:47.027 INFO:teuthology.orchestra.run.smithi184.stderr: 93.5% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-16T03:25:47.751 INFO:teuthology.orchestra.run.smithi064.stderr: 93.4% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-16T03:25:47.922 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-16T03:25:47.954 INFO:teuthology.orchestra.run.smithi184.stderr: 93.5% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-16T03:25:48.420 INFO:teuthology.orchestra.run.smithi184.stderr: 93.4% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-16T03:26:17.808 INFO:teuthology.orchestra.run.smithi184.stderr: 93.2% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi184.jfpiqk.log.gz 2023-12-16T03:26:17.809 INFO:teuthology.orchestra.run.smithi184.stderr: 2023-12-16T03:26:17.810 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m34.855s 2023-12-16T03:26:17.810 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m47.941s 2023-12-16T03:26:17.810 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m1.692s 2023-12-16T03:26:38.115 INFO:teuthology.orchestra.run.smithi064.stderr: 93.0% -- replaced with /var/log/ceph/5b4de048-9bc0-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi064.jaepzs.log.gz 2023-12-16T03:26:38.117 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-12-16T03:26:38.117 INFO:teuthology.orchestra.run.smithi064.stderr:real 0m55.163s 2023-12-16T03:26:38.117 INFO:teuthology.orchestra.run.smithi064.stderr:user 1m7.735s 2023-12-16T03:26:38.117 INFO:teuthology.orchestra.run.smithi064.stderr:sys 0m2.056s 2023-12-16T03:26:38.118 INFO:tasks.cephadm:Archiving logs... 2023-12-16T03:26:38.118 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523/remote/smithi064/log 2023-12-16T03:26:38.119 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T03:26:48.114 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523/remote/smithi184/log 2023-12-16T03:26:48.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T03:26:55.676 INFO:tasks.cephadm:Removing cluster... 2023-12-16T03:26:55.676 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 --force 2023-12-16T03:26:56.237 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 --force 2023-12-16T03:26:56.757 INFO:tasks.cephadm:Removing cephadm ... 2023-12-16T03:26:56.757 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-16T03:26:56.778 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-16T03:26:56.796 INFO:tasks.cephadm:Teardown complete 2023-12-16T03:26:56.796 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-16T03:26:56.808 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-16T03:26:56.808 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T03:26:56.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T03:26:56.918 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-16T03:26:56.930 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-16T03:26:56.930 DEBUG:teuthology.orchestra.run.smithi064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:26:56.933 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:26:56.949 INFO:teuthology.orchestra.run.smithi064.stderr:bash: ntpq: command not found 2023-12-16T03:26:56.950 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-12-16T03:26:56.953 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T03:26:56.954 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2023-12-16T03:26:56.954 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 58 +102us[ +132us] +/- 71ms 2023-12-16T03:26:56.954 INFO:teuthology.orchestra.run.smithi064.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -126us[ -95us] +/- 55ms 2023-12-16T03:26:56.955 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +89us[ +119us] +/- 66ms 2023-12-16T03:26:56.955 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:26:56.956 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T03:26:56.956 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-12-16T03:26:56.957 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 59 +117us[ +117us] +/- 71ms 2023-12-16T03:26:56.957 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv02.front.sepia.ceph.com 3 6 377 60 -111us[ -86us] +/- 55ms 2023-12-16T03:26:56.957 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +92us[ +117us] +/- 66ms 2023-12-16T03:26:56.957 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:26:56.957 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-16T03:26:56.970 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-16T03:26:56.970 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-16T03:26:56.981 DEBUG:teuthology.orchestra.run.smithi064:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T03:26:57.102 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T03:26:57.197 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T03:26:57.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:26:57.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T03:26:57.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:26:57.264 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-16T03:26:57.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-16T03:26:57.287 INFO:teuthology.task.internal:Duration was 1819.957042 seconds 2023-12-16T03:26:57.288 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-16T03:26:57.300 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-16T03:26:57.300 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T03:26:57.302 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T03:26:57.347 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T03:26:57.349 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T03:26:57.705 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-16T03:26:57.706 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi064.front.sepia.ceph.com 2023-12-16T03:26:57.706 DEBUG:teuthology.orchestra.run.smithi064:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T03:26:57.730 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2023-12-16T03:26:57.730 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T03:26:57.752 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-16T03:26:57.753 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T03:26:57.772 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T03:26:57.842 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-16T03:26:57.842 DEBUG:teuthology.orchestra.run.smithi064:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T03:26:57.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T03:26:57.963 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-16T03:26:57.975 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-16T03:26:57.976 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T03:26:58.003 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T03:26:58.030 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-16T03:26:58.043 DEBUG:teuthology.orchestra.run.smithi064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T03:26:58.046 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T03:26:58.071 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = core 2023-12-16T03:26:58.097 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2023-12-16T03:26:58.111 DEBUG:teuthology.orchestra.run.smithi064:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T03:26:58.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:26:58.142 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T03:26:58.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:26:58.168 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-16T03:26:58.180 INFO:teuthology.task.internal:Transferring archived files... 2023-12-16T03:26:58.181 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523/remote/smithi064 2023-12-16T03:26:58.181 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T03:26:58.227 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523/remote/smithi184 2023-12-16T03:26:58.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T03:26:58.267 INFO:teuthology.task.internal:Removing archive directory... 2023-12-16T03:26:58.267 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T03:26:58.269 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T03:26:58.319 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-16T03:26:58.333 INFO:teuthology.task.internal:Not uploading archives. 2023-12-16T03:26:58.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-16T03:26:58.346 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-16T03:26:58.346 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T03:26:58.348 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T03:26:58.364 INFO:teuthology.orchestra.run.smithi064.stdout: 526083 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 03:26 /home/ubuntu/cephtest 2023-12-16T03:26:58.376 INFO:teuthology.orchestra.run.smithi184.stdout: 525359 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 03:26 /home/ubuntu/cephtest 2023-12-16T03:26:58.378 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-16T03:26:58.391 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-16T03:26:58.419 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T03:26:58.445 DEBUG:teuthology.nuke:shortname: smithi064 2023-12-16T03:26:58.446 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T03:26:58.469 DEBUG:teuthology.nuke:shortname: smithi184 2023-12-16T03:26:58.470 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T03:26:58.473 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 02:48:06.760530', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJNmUeTk7cvV4/hBxeHJHabAwqQSG/0I544i8eBAl8M8nQqLVbUMWirq2BjY8t1iG9Ms03YbUrUpnxQ7Z02tp/I='} 2023-12-16T03:26:58.494 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493523', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 02:48:06.758803', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRIjktrYHU73h4pCJsuSjrdVTHmQyG9O7D3ilqeIBoQiqLa6lFF37s12hE2RUfcD/NqcbajAFkh5mNiotN/c9s='} 2023-12-16T03:26:58.528 INFO:teuthology.orchestra.console.smithi064:Power off 2023-12-16T03:26:58.528 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T03:26:58.552 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-12-16T03:26:58.553 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:26:58.569 INFO:teuthology.orchestra.console.smithi184:Power off 2023-12-16T03:26:58.570 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T03:26:58.580 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-16T03:26:58.593 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-12-16T03:26:58.594 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:26:58.617 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-12-16T03:27:02.584 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:27:02.617 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:27:02.696 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-12-16T03:27:02.728 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-12-16T03:27:06.702 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:27:06.729 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:27:06.813 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-12-16T03:27:06.840 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-12-16T03:27:06.914 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-12-16T03:27:10.845 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:27:10.955 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-12-16T03:27:11.056 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-12-16T03:27:11.165 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1819.957041501999 failure_reason: 'Command failed on smithi064 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b4de048-9bc0-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=33ae0e2130c74e2dbc9de40f700f7985 status: fail success: false 2023-12-16T03:27:11.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:27:11.255 INFO:teuthology.run:FAIL